[jira] [Comment Edited] (IGNITE-532) Implement IgniteAkkaStreamer to stream data from Akka actors.

["Dmitriy Setrakyan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IGNITE-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381533#comment-14381533 ] 

Dmitriy Setrakyan edited comment on IGNITE-532 at 3/26/15 8:06 AM:
-------------------------------------------------------------------

As far as the proposed sequence, I would need some clarification. It just seems to me that this sequence would work faster than the one you are suggesting:
{noformat}
[akka actor] -> [ignite-data-streamer]
{noformat}
I also think that we may need this as well
{noformat}
akka-stream -> [akka stream flow (conversion)] -> [ignite-data-streamer]
{noformat}

Perhaps we should support both?

I don't think you need to extend {{DataStreamerImpl}} class. I think using public Ignite API and delegating from your Akka code directly to {{IgniteDataStreamer}} is a better approach, e.g.
{code}
IgniteDataStreamer stmr = ignite.dataStreamer("myStreamName");

stmr.addData(...);
{code}

Let me know what you think.


was (Author: dsetrakyan):
As far as the proposed sequence, I would need some clarification. It just seems to me that this sequence would work faster than the one you are suggesting:
{noformat}
[akka actor] -> [ignite-data-streamer]
{noformat}
I also think that we may need this as well
{noformat}
akka-stream -> [akka stream flow (conversion)] -> [ignite-data-streamer]
{noformat}

Perhaps we should support both?

I don't think you need to extend {{DataStreamerImpl}} class. I think using public Ignite API and delegating from your Akka code directly to {{IgniteDataStreamer}} is a better approach.

Let me know what you think.

> Implement IgniteAkkaStreamer to stream data from Akka actors.
> -------------------------------------------------------------
>
>                 Key: IGNITE-532
>                 URL: https://issues.apache.org/jira/browse/IGNITE-532
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: streaming
>            Reporter: Dmitriy Setrakyan
>            Assignee: Joshua Goldie
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under high load. It was previously named {{IgniteDataLoader}}, see ticket IGNITE-394.
> See [Akka|http://akka.io/] for more information. Given that Akka is a Scala frameworks, this streamer should be available in Scala.
> We should create {{IgniteAkkaStreamer}} which will consume messages from Akka Actors and stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert data from Akka to Ignite using an optional pluggable converter. If not provided, then we should have some default mechanism.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)