You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@beam.apache.org by Rui Wang <ru...@google.com> on 2018/06/19 01:20:24 UTC

Supporting Unbounded Limit in Beam SQL Shell

Hi,

I want to support "unbounded limit" in Beam SQL shell (jira:
https://issues.apache.org/jira/browse/BEAM-4194).

Unbound limit means running limit query on unbounded input data (e.g.
Apache Kafka, Cloud Pub/Sub). One example query is "SELECT col_name FROM
unbounded_table LIMIT 1". This is useful in SQL Shell as users would be
able to sample data from unbounded input data.


Here is a google doc about my proposal, please take a look and comment:
https://docs.google.com/document/d/13zeTewHH9nfwhSlcE4x77WQwr1U2Z4sTiNRjOXUj2aw/edit?usp=sharing



Thanks,
Rui