Editor for BeamSQL

[Jozef Vilcek <jo...@gmail.com>]

Hello,

does anyone use or is aware some kind of editor integration options for
BeamSQL? It would be to enable less technical people to execute SQL or do
data analysis queries conveniently. E.g. like HUE integration for SparkSQL
or similar

Thanks,
Jozef

Re: Editor for BeamSQL

[Jozef Vilcek <jo...@gmail.com>]

Yes, this is helpful information! JDBC driver capable of launching queries
over runner is good start. So far I am researching options.
I will definitely report back any useful feedback when I get there.
Thanks!

On Fri, Nov 16, 2018 at 6:57 PM Anton Kedin <ke...@google.com> wrote:

> Hi Jozef,
>
> Short answer is yes, Beam SQL provides a JDBC driver[1] that UI tools
> should in theory be able to consume.
>
> Longer answer:
>
> Primary use case for the JDBC driver at the moment is to expose Beam SQL
> as shell REPL environment, see [2]. Beam SQL shell wraps[3] the sqlline
> tool [4] to connect to Beam SQL using the JDBC driver. Other UI tools that
> support JDBC drivers should be able to interact with it as well.
>
> Caveat:
>
> Given the above I don't think there is a dedicated effort to integrate
> Beam SQL with specific GUI environments, so the documentation is lacking
> and you might see bugs if you try to do it.
>
> Will the JDBC approach work for you? It would be great if you could try it
> and report findings, so that we can improve our JDBC story.
>
> [1]:
> https://github.com/apache/beam/blob/6ed194200df892167094f4ec5967b0ff21e9f669/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/JdbcDriver.java
> [2]: https://beam.apache.org/documentation/dsls/sql/shell/
> [3]:
> https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/jdbc/src/main/java/org/apache/beam/sdk/extensions/sql/jdbc/BeamSqlLine.java
> [4]: https://github.com/julianhyde/sqlline
>
> Regards,
> Anton
>
> On Fri, Nov 16, 2018 at 2:03 AM Jozef Vilcek <jo...@gmail.com>
> wrote:
>
>> Hello,
>>
>> does anyone use or is aware some kind of editor integration options for
>> BeamSQL? It would be to enable less technical people to execute SQL or do
>> data analysis queries conveniently. E.g. like HUE integration for SparkSQL
>> or similar
>>
>> Thanks,
>> Jozef
>>
>

Re: Editor for BeamSQL

[Anton Kedin <ke...@google.com>]

Hi Jozef,

Short answer is yes, Beam SQL provides a JDBC driver[1] that UI tools
should in theory be able to consume.

Longer answer:

Primary use case for the JDBC driver at the moment is to expose Beam SQL as
shell REPL environment, see [2]. Beam SQL shell wraps[3] the sqlline tool
[4] to connect to Beam SQL using the JDBC driver. Other UI tools that
support JDBC drivers should be able to interact with it as well.

Caveat:

Given the above I don't think there is a dedicated effort to integrate Beam
SQL with specific GUI environments, so the documentation is lacking and you
might see bugs if you try to do it.

Will the JDBC approach work for you? It would be great if you could try it
and report findings, so that we can improve our JDBC story.

[1]:
https://github.com/apache/beam/blob/6ed194200df892167094f4ec5967b0ff21e9f669/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/JdbcDriver.java
[2]: https://beam.apache.org/documentation/dsls/sql/shell/
[3]:
https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/jdbc/src/main/java/org/apache/beam/sdk/extensions/sql/jdbc/BeamSqlLine.java
[4]: https://github.com/julianhyde/sqlline

Regards,
Anton

On Fri, Nov 16, 2018 at 2:03 AM Jozef Vilcek <jo...@gmail.com> wrote:

> Hello,
>
> does anyone use or is aware some kind of editor integration options for
> BeamSQL? It would be to enable less technical people to execute SQL or do
> data analysis queries conveniently. E.g. like HUE integration for SparkSQL
> or similar
>
> Thanks,
> Jozef
>