Put Vs Datastreamer

[Gaurav Bajaj <ga...@gmail.com>]

Hi,

I was using below initially to populate 200,000 records in data grid. Then
I switched to IgniteDataStreamer (snippet 2) but didn't see performance
improvement, in both cases it was around 12 secs. Am I missing something
here?

Snippet 1:


    for (Employee emp: emps) {
           emp.setPayment(150000);
           empCache.put(randomId, emp);
    }

Snippet 2:

try (IgniteDataStreamer<String, Employee> txnStmr =
ignite.dataStreamer("Employee_Cache")) {
    for (Employee emp: emps) {
        emp.setPayment(150000);
        txnStmr.addData(randomId, emp);

    }
}


Thanks,

Gaurav

Re: Put Vs Datastreamer

[Gaurav Bajaj <ga...@gmail.com>]

Hi Val,

Yes, you are right, it's on local single node.
Sorry I should have been more thorough in describing my environment.
I will test it on multi-node environment and check the performance.


Thanks,
Gaurav

On Thu, Jan 5, 2017 at 10:24 PM, vkulichenko <va...@gmail.com>
wrote:

> Hi Gaurav,
>
> How many nodes do you have? I think your results only possible with local
> deployment when there is only one server node. When network is added into
> the picture, streamer batching should provide big improvement.
>
> If this is not the case, please provide a test case that we can run to
> reproduce the issue.
>
> -Val
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/Put-Vs-Datastreamer-tp9902p9914.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

Re: Put Vs Datastreamer

[vkulichenko <va...@gmail.com>]

Hi Gaurav,

How many nodes do you have? I think your results only possible with local
deployment when there is only one server node. When network is added into
the picture, streamer batching should provide big improvement.

If this is not the case, please provide a test case that we can run to
reproduce the issue.

-Val



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Put-Vs-Datastreamer-tp9902p9914.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.