[jira] [Comment Edited] (IGNITE-429) Implement IgniteStormStreamer to stream data from Apache Storm

["Gianfranco Murador (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IGNITE-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877480#comment-14877480 ] 

Gianfranco Murador edited comment on IGNITE-429 at 9/20/15 11:51 AM:
---------------------------------------------------------------------

Hello Chandresh,
 the implementation is simple ( this is good ), but It does not take into account of some aspects that may not work in Ignite. As we have done in Kafka streamer is a good idea to create an ExecutorService to submit streams from apache storm (This improves performance) . You have to rely to a naming convention that must be declared with your solution, while it might be a good idea to create our bolt to filter results. I will make a new branch with all the changes, so you can make a new pull request. Still I am not very skilled with git :).
Regards, Gianfranco 


was (Author: glutters):
Hello Chandresh,
how do you see the implementation is simple ( this is good ), but It does not take into account of some aspects that may not work in Ignite. As we have done in Kafka streamer is a good idea to create an ExecutorService to submit streams from apache storm (This improves performance) . You have to rely to a naming convention that must be declared with your solution, while it might be a good idea to create our bolt to filter results. I will make a new branch with all the changes, so you can make a new pull request. Still I am not very skilled with git :).
Regards, Gianfranco 

> Implement IgniteStormStreamer to stream data from Apache Storm
> --------------------------------------------------------------
>
>                 Key: IGNITE-429
>                 URL: https://issues.apache.org/jira/browse/IGNITE-429
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: streaming
>            Reporter: Dmitriy Setrakyan
>            Assignee: Chandresh Pancholi
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under high load. It was previously named {{IgniteDataLoader}}, see ticket IGNITE-394.
> See [Apache Storm|https://storm.apache.org/] for more information.
> We should create {{IgniteStormStreamer}} which will consume tuples from Storm and stream them into Ignite caches. 
> More details to follow, but to the least we should be able to:
> - Convert/Intercept Storm tuples to Ignite data using an optional pluggable converter.
> - Specify the cache name for the Ignite cache to load data into.
> - Specify other flags available on {{IgniteDataStreamer}} class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)