You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@storm.apache.org by Manu Zhang <ow...@gmail.com> on 2016/08/08 08:31:48 UTC

storm-sql

Hi all,

We are interested in the storm-sql feature and plan to use it for some ETL
cases.  However, we are concerned about latency since storm-sql is compiled
to Trident. Is there a plan to compile SQL to storm-core ? Is it a design
document or road map for storm-sql module ? All I've found are umbrella
jiras for two-phase SQL support.


Thanks,
Manu Zhang

Re: storm-sql

Posted by Manu Zhang <ow...@gmail.com>.

Thanks, I missed that.

On Wed, Aug 10, 2016 at 7:56 AM Xin Wang <da...@gmail.com> wrote:

> Hi Manu,
>
> http://storm.apache.org/releases/1.0.1/storm-sql-internal.html
> This page describes the design and the implementation of the Storm SQL
> integration.
>
> 2016-08-09 9:50 GMT+08:00 Jungtaek Lim <ka...@gmail.com>:
>
> > Hi Manu,
> >
> > AFAIK there seems no design doc, and visible road map is just Phase 2
> > umbrella issue.
> > I'm working on Phase 2 for storm-sql, but I'm not familiar with storm-sql
> > and also Calcite and so, so having time to look into it. Helping from
> > others are all appreciated.
> > Once we get familiar with storm-sql and resolve issues for Phase 2, we
> can
> > even build the roadmap for storm-sql.
> >
> > One thing I'm thinking about is sql with storm-core & windowing. I'm
> > wondering its value for handling individual tuple via sql, but with
> > windowing it would be decent.
> >
> > If you're interested to contribute this area and would like to cooperate
> or
> > share the load, please let me know.
> >
> > Thanks,
> > Jungtaek Lim (HeartSaVioR)
> >
> > 2016년 8월 8일 (월) 오후 5:32, Manu Zhang <ow...@gmail.com>님이 작성:
> >
> > > Hi all,
> > >
> > > We are interested in the storm-sql feature and plan to use it for some
> > ETL
> > > cases.  However, we are concerned about latency since storm-sql is
> > compiled
> > > to Trident. Is there a plan to compile SQL to storm-core ? Is it a
> design
> > > document or road map for storm-sql module ? All I've found are umbrella
> > > jiras for two-phase SQL support.
> > >
> > >
> > > Thanks,
> > > Manu Zhang
> > >
> >
>

Re: storm-sql

Posted by Xin Wang <da...@gmail.com>.

Hi Manu,

http://storm.apache.org/releases/1.0.1/storm-sql-internal.html
This page describes the design and the implementation of the Storm SQL
integration.

2016-08-09 9:50 GMT+08:00 Jungtaek Lim <ka...@gmail.com>:

> Hi Manu,
>
> AFAIK there seems no design doc, and visible road map is just Phase 2
> umbrella issue.
> I'm working on Phase 2 for storm-sql, but I'm not familiar with storm-sql
> and also Calcite and so, so having time to look into it. Helping from
> others are all appreciated.
> Once we get familiar with storm-sql and resolve issues for Phase 2, we can
> even build the roadmap for storm-sql.
>
> One thing I'm thinking about is sql with storm-core & windowing. I'm
> wondering its value for handling individual tuple via sql, but with
> windowing it would be decent.
>
> If you're interested to contribute this area and would like to cooperate or
> share the load, please let me know.
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
> 2016년 8월 8일 (월) 오후 5:32, Manu Zhang <ow...@gmail.com>님이 작성:
>
> > Hi all,
> >
> > We are interested in the storm-sql feature and plan to use it for some
> ETL
> > cases.  However, we are concerned about latency since storm-sql is
> compiled
> > to Trident. Is there a plan to compile SQL to storm-core ? Is it a design
> > document or road map for storm-sql module ? All I've found are umbrella
> > jiras for two-phase SQL support.
> >
> >
> > Thanks,
> > Manu Zhang
> >
>

Re: storm-sql

Posted by Jungtaek Lim <ka...@gmail.com>.

Hi Manu,

AFAIK there seems no design doc, and visible road map is just Phase 2
umbrella issue.
I'm working on Phase 2 for storm-sql, but I'm not familiar with storm-sql
and also Calcite and so, so having time to look into it. Helping from
others are all appreciated.
Once we get familiar with storm-sql and resolve issues for Phase 2, we can
even build the roadmap for storm-sql.

One thing I'm thinking about is sql with storm-core & windowing. I'm
wondering its value for handling individual tuple via sql, but with
windowing it would be decent.

If you're interested to contribute this area and would like to cooperate or
share the load, please let me know.

Thanks,
Jungtaek Lim (HeartSaVioR)

2016년 8월 8일 (월) 오후 5:32, Manu Zhang <ow...@gmail.com>님이 작성:

> Hi all,
>
> We are interested in the storm-sql feature and plan to use it for some ETL
> cases.  However, we are concerned about latency since storm-sql is compiled
> to Trident. Is there a plan to compile SQL to storm-core ? Is it a design
> document or road map for storm-sql module ? All I've found are umbrella
> jiras for two-phase SQL support.
>
>
> Thanks,
> Manu Zhang
>

Re:storm-sql

Posted by "darion.yaphet" <fl...@163.com>.

Hi Manu Storm SQL current just support CREATE TABLE DDL maybe it's hard to use to do ETL .
At 2016-08-08 16:31:48, "Manu Zhang" <ow...@gmail.com> wrote:
>Hi all,
>
>We are interested in the storm-sql feature and plan to use it for some ETL
>cases.  However, we are concerned about latency since storm-sql is compiled
>to Trident. Is there a plan to compile SQL to storm-core ? Is it a design
>document or road map for storm-sql module ? All I've found are umbrella
>jiras for two-phase SQL support.
>
>
>Thanks,
>Manu Zhang