Cassandra spout

[S G <sg...@gmail.com>]

Hi,

We need Cassandra spout to read from Cassandra and write to other systems.

But I could not find any such thing documented at:
http://storm.apache.org/releases/1.0.3/storm-cassandra.html

Is there a reason why there exists only Cassandra Bolt?
Would Cassandra Spout be a welcome addition to the codebase?

Thanks
SG

Re: Cassandra spout

[Tech Id <te...@gmail.com>]

There is a storm-jdbc component
https://github.com/apache/storm/tree/master/external/storm-jdbc
And it talks something about "lookup from database"

But its not really clear whether there is a JdbcSpout or not.
A quick search through the code does not show JdbcSpout exists.

If there were one, you could have used the Cassandra-JDBC driver.

Cheers,
TI


On Thu, Feb 16, 2017 at 9:03 AM, Hugo Da Cruz Louro <hl...@hortonworks.com>
wrote:

> There is a JIRA filed for this: https://issues.apache.org/
> jira/browse/STORM-2362
>
> SG, can you please add any requirements that you may have in mind to the
> JIRA.
>
> Thanks,
> Hugo
>
> On Feb 16, 2017, at 8:48 AM, Jungtaek Lim <kabhwan@gmail.com<mailto:kabh
> wan@gmail.com>> wrote:
>
> For me, I'm OK to adopt the Spout implementation if it can be used for
> general purpose, and also can meet at-least-once semantic. I didn't add
> Redis spout (using pubsub or list) because it can't meet at-least-once
> semantic.
>
> Do you have any sketches or design doc for Cassandra spout?
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
> 2017년 2월 16일 (목) 오전 3:22, S G <sg.online.email@gmail.com<mailto:
> sg.online.email@gmail.com>>님이 작성:
>
> Hi,
>
> We need Cassandra spout to read from Cassandra and write to other systems.
>
> But I could not find any such thing documented at:
> http://storm.apache.org/releases/1.0.3/storm-cassandra.html
>
> Is there a reason why there exists only Cassandra Bolt?
> Would Cassandra Spout be a welcome addition to the codebase?
>
> Thanks
> SG
>
>
>

Re: Cassandra spout

[Hugo Da Cruz Louro <hl...@hortonworks.com>]

There is a JIRA filed for this: https://issues.apache.org/jira/browse/STORM-2362

SG, can you please add any requirements that you may have in mind to the JIRA.

Thanks,
Hugo

On Feb 16, 2017, at 8:48 AM, Jungtaek Lim <ka...@gmail.com>> wrote:

For me, I'm OK to adopt the Spout implementation if it can be used for
general purpose, and also can meet at-least-once semantic. I didn't add
Redis spout (using pubsub or list) because it can't meet at-least-once
semantic.

Do you have any sketches or design doc for Cassandra spout?

Thanks,
Jungtaek Lim (HeartSaVioR)

2017년 2월 16일 (목) 오전 3:22, S G <sg...@gmail.com>>님이 작성:

Hi,

We need Cassandra spout to read from Cassandra and write to other systems.

But I could not find any such thing documented at:
http://storm.apache.org/releases/1.0.3/storm-cassandra.html

Is there a reason why there exists only Cassandra Bolt?
Would Cassandra Spout be a welcome addition to the codebase?

Thanks
SG

Re: Cassandra spout

[Jungtaek Lim <ka...@gmail.com>]

For me, I'm OK to adopt the Spout implementation if it can be used for
general purpose, and also can meet at-least-once semantic. I didn't add
Redis spout (using pubsub or list) because it can't meet at-least-once
semantic.

Do you have any sketches or design doc for Cassandra spout?

Thanks,
Jungtaek Lim (HeartSaVioR)

2017년 2월 16일 (목) 오전 3:22, S G <sg...@gmail.com>님이 작성:

> Hi,
>
> We need Cassandra spout to read from Cassandra and write to other systems.
>
> But I could not find any such thing documented at:
> http://storm.apache.org/releases/1.0.3/storm-cassandra.html
>
> Is there a reason why there exists only Cassandra Bolt?
> Would Cassandra Spout be a welcome addition to the codebase?
>
> Thanks
> SG
>