You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by LuNing Wang <wa...@gmail.com> on 2022/03/30 12:04:18 UTC

Trino Runner

Hi,

Have any plans to support Trino/Pesto runner?

Best,
LuNing Wang

Re: Trino Runner

Posted by Brian Hulette <bh...@google.com>.
It sounds like what you're interested in might be more akin to
(projection/predicate) pushdown to a Presto/Trino IO. That is, given a Beam
SQL statement, you want to execute as much of it as possible natively in
the Presto/Trino source. In theory this could look like a runner if the
entire pipeline is relational and can be pushed down to the source.

On Wed, Mar 30, 2022 at 7:55 PM LuNing Wang <wa...@gmail.com> wrote:

> Hi,
>
> I want to use Presto/Trino via Beam SQL. If so a Beam SQL statement can
> support all Batch/Stream/OLAP/ad-hoc situations.
>
> LuNing Wang
>
> Evan Galpin <eg...@apache.org> 于2022年3月31日周四 04:30写道:
>
>> Though this might not be what's being asked, might it be possible to
>> integrate Presto using the JDBC driver[1] along with Beam's JdbcIO[2] ?
>>
>> [1] https://prestodb.io/docs/current/installation/jdbc.html
>> [2]
>> https://beam.apache.org/releases/javadoc/2.37.0/org/apache/beam/sdk/io/jdbc/JdbcIO.html
>>
>> - Evan
>>
>> On Wed, Mar 30, 2022 at 1:35 PM Pablo Estrada <pa...@google.com> wrote:
>>
>>> Hi Luning!
>>> I am not aware of any efforts so far to support these. Perhaps worth
>>> checking in their community if there's interest to work with Beam.
>>> Thanks!
>>> -P.
>>>
>>> On Wed, Mar 30, 2022 at 5:04 AM LuNing Wang <wa...@gmail.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> Have any plans to support Trino/Pesto runner?
>>>>
>>>> Best,
>>>> LuNing Wang
>>>>
>>>

Re: Trino Runner

Posted by LuNing Wang <wa...@gmail.com>.
Hi,

I want to use Presto/Trino via Beam SQL. If so a Beam SQL statement can
support all Batch/Stream/OLAP/ad-hoc situations.

LuNing Wang

Evan Galpin <eg...@apache.org> 于2022年3月31日周四 04:30写道:

> Though this might not be what's being asked, might it be possible to
> integrate Presto using the JDBC driver[1] along with Beam's JdbcIO[2] ?
>
> [1] https://prestodb.io/docs/current/installation/jdbc.html
> [2]
> https://beam.apache.org/releases/javadoc/2.37.0/org/apache/beam/sdk/io/jdbc/JdbcIO.html
>
> - Evan
>
> On Wed, Mar 30, 2022 at 1:35 PM Pablo Estrada <pa...@google.com> wrote:
>
>> Hi Luning!
>> I am not aware of any efforts so far to support these. Perhaps worth
>> checking in their community if there's interest to work with Beam.
>> Thanks!
>> -P.
>>
>> On Wed, Mar 30, 2022 at 5:04 AM LuNing Wang <wa...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> Have any plans to support Trino/Pesto runner?
>>>
>>> Best,
>>> LuNing Wang
>>>
>>

Re: Trino Runner

Posted by Evan Galpin <eg...@apache.org>.
Though this might not be what's being asked, might it be possible to
integrate Presto using the JDBC driver[1] along with Beam's JdbcIO[2] ?

[1] https://prestodb.io/docs/current/installation/jdbc.html
[2]
https://beam.apache.org/releases/javadoc/2.37.0/org/apache/beam/sdk/io/jdbc/JdbcIO.html

- Evan

On Wed, Mar 30, 2022 at 1:35 PM Pablo Estrada <pa...@google.com> wrote:

> Hi Luning!
> I am not aware of any efforts so far to support these. Perhaps worth
> checking in their community if there's interest to work with Beam.
> Thanks!
> -P.
>
> On Wed, Mar 30, 2022 at 5:04 AM LuNing Wang <wa...@gmail.com> wrote:
>
>> Hi,
>>
>> Have any plans to support Trino/Pesto runner?
>>
>> Best,
>> LuNing Wang
>>
>

Re: Trino Runner

Posted by Pablo Estrada <pa...@google.com>.
Hi Luning!
I am not aware of any efforts so far to support these. Perhaps worth
checking in their community if there's interest to work with Beam.
Thanks!
-P.

On Wed, Mar 30, 2022 at 5:04 AM LuNing Wang <wa...@gmail.com> wrote:

> Hi,
>
> Have any plans to support Trino/Pesto runner?
>
> Best,
> LuNing Wang
>