You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by KR Kumar <ig...@gmail.com> on 2018/11/16 13:02:01 UTC
DataStreamer
Hi Guys - I have a weird problem. when I am using data streamer to write data
to ignite ( file based persistence), not all the entries are getting
persisted as later some gets are returning nulls for few keys. This is very
random in terms of which keys getting persisted but consistent in terms not
writing all data to files.
I am using 24 node cluster for both persistence based cache and distributed
compute task execution.
Any Pointers?
Thanx and Regards,
KR Kumar
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: DataStreamer
Posted by Evgenii Zhuravlev <e....@gmail.com>.
Hi,
Can you share the full code? Especially when you're closing it or flushing.
Evgenii
пт, 16 нояб. 2018 г. в 17:43, KR Kumar <ig...@gmail.com>:
> Following code creates the data streamer instance
>
> dataStreamer =
> IgniteContextWrapper.getInstance().getEngine().dataStreamer("eventCache-" +
> System.getProperty(RUN_ID) +"-"+ tenantId);
>
> and for writing the data to cache,
>
> dataStreamer.addData(key, value);
>
> Nothing fancy, very simple code.
>
> Instead of streamer, If I used cache.put, everything works fine but its
> dead
> slow
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Re: DataStreamer
Posted by KR Kumar <ig...@gmail.com>.
Following code creates the data streamer instance
dataStreamer =
IgniteContextWrapper.getInstance().getEngine().dataStreamer("eventCache-" +
System.getProperty(RUN_ID) +"-"+ tenantId);
and for writing the data to cache,
dataStreamer.addData(key, value);
Nothing fancy, very simple code.
Instead of streamer, If I used cache.put, everything works fine but its dead
slow
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: DataStreamer
Posted by Evgenii Zhuravlev <e....@gmail.com>.
Hi,
Can you share the code when you load data with DataStreamer?
Evgenii
пт, 16 нояб. 2018 г. в 16:02, KR Kumar <ig...@gmail.com>:
> Hi Guys - I have a weird problem. when I am using data streamer to write
> data
> to ignite ( file based persistence), not all the entries are getting
> persisted as later some gets are returning nulls for few keys. This is very
> random in terms of which keys getting persisted but consistent in terms not
> writing all data to files.
>
>
> I am using 24 node cluster for both persistence based cache and distributed
> compute task execution.
>
> Any Pointers?
>
>
> Thanx and Regards,
> KR Kumar
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>