You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Josh Katz <Jo...@dodgeandcox.com> on 2021/03/05 21:59:10 UTC
Loading data to cache using a data streamer
Client node gets disconnected while trying to load data to cache using a data streamer...
How can we overcome this issue and load data to cache reliably?
See Exception call stack:
Apache.Ignite.Core.Common.ClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 ---> Apache.Ignite.Core.Common.JavaException: class org.apache.ignite.IgniteClientDisconnectedException: Client node disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 at org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93) at org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175) at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379) at org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593) at org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496) at org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187) at org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55) at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck() at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj, IntPtr methodId, Int64* argsPtr) at Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef target, Int32 opType, Int64 memPtr) at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val) --- End of inner exception stack trace --- at Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64 val) at Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean value) at PopulateCache(String accountStyle, DateTime startDate, DateTime endDate)
Thanks,
Josh Katz
----------------------------------------------------------------------
Please follow the hyperlink to important disclosures.https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html
Re: Loading data to cache using a data streamer
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
Unfortunately, the exception snippet that you have pasted is not sufficient
to understand what's going on.
Regards,
--
Ilya Kasnacheev
ср, 10 мар. 2021 г. в 19:35, Pelado <ma...@gmail.com>:
> Take a look at the data node. If the data node has restarted you might see
> a client disconnected exception.
>
> On Tue, Mar 9, 2021 at 1:12 PM Ilya Kasnacheev <il...@gmail.com>
> wrote:
>
>> Hello!
>>
>> Does it work with a smaller batch? My guess is that you end up consuming
>> too much resources and then the cluster falls apart.
>>
>> Regards,
>> --
>> Ilya Kasnacheev
>>
>>
>> сб, 6 мар. 2021 г. в 00:59, Josh Katz <
>> Josh.Katz.Contractor@dodgeandcox.com>:
>>
>>> Client node gets disconnected while trying to load data to cache using a
>>> data streamer…
>>>
>>>
>>>
>>> How can we overcome this issue and load data to cache reliably?
>>>
>>>
>>>
>>> See Exception call stack:
>>>
>>>
>>>
>>> Apache.Ignite.Core.Common.ClientDisconnectedException: Client node
>>> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 --->
>>> Apache.Ignite.Core.Common.JavaException: class
>>> org.apache.ignite.IgniteClientDisconnectedException: Client node
>>> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 at
>>> org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)
>>> at
>>> org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)
>>> at
>>> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)
>>> at
>>> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)
>>> at
>>> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)
>>> at
>>> org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)
>>> at
>>> org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)
>>> at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck() at
>>> Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj,
>>> IntPtr methodId, Int64* argsPtr) at
>>> Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef
>>> target, Int32 opType, Int64 memPtr) at
>>> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
>>> val) --- End of inner exception stack trace --- at
>>> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
>>> val) at
>>> Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean
>>> value) at PopulateCache(String accountStyle, DateTime startDate,
>>> DateTime endDate)
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Josh Katz
>>> ------------------------------
>>> Please follow the hyperlink to important disclosures.
>>> https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html
>>>
>>>
>
> --
> Facundo Maldonado
>
Re: Loading data to cache using a data streamer
Posted by Pelado <ma...@gmail.com>.
Take a look at the data node. If the data node has restarted you might see
a client disconnected exception.
On Tue, Mar 9, 2021 at 1:12 PM Ilya Kasnacheev <il...@gmail.com>
wrote:
> Hello!
>
> Does it work with a smaller batch? My guess is that you end up consuming
> too much resources and then the cluster falls apart.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> сб, 6 мар. 2021 г. в 00:59, Josh Katz <
> Josh.Katz.Contractor@dodgeandcox.com>:
>
>> Client node gets disconnected while trying to load data to cache using a
>> data streamer…
>>
>>
>>
>> How can we overcome this issue and load data to cache reliably?
>>
>>
>>
>> See Exception call stack:
>>
>>
>>
>> Apache.Ignite.Core.Common.ClientDisconnectedException: Client node
>> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 --->
>> Apache.Ignite.Core.Common.JavaException: class
>> org.apache.ignite.IgniteClientDisconnectedException: Client node
>> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 at
>> org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)
>> at
>> org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)
>> at
>> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)
>> at
>> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)
>> at
>> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)
>> at
>> org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)
>> at
>> org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)
>> at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck() at
>> Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj,
>> IntPtr methodId, Int64* argsPtr) at
>> Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef
>> target, Int32 opType, Int64 memPtr) at
>> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
>> val) --- End of inner exception stack trace --- at
>> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
>> val) at
>> Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean
>> value) at PopulateCache(String accountStyle, DateTime startDate,
>> DateTime endDate)
>>
>>
>>
>> Thanks,
>>
>> Josh Katz
>> ------------------------------
>> Please follow the hyperlink to important disclosures.
>> https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html
>>
>>
--
Facundo Maldonado
Re: Loading data to cache using a data streamer
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
Does it work with a smaller batch? My guess is that you end up consuming
too much resources and then the cluster falls apart.
Regards,
--
Ilya Kasnacheev
сб, 6 мар. 2021 г. в 00:59, Josh Katz <Josh.Katz.Contractor@dodgeandcox.com
>:
> Client node gets disconnected while trying to load data to cache using a
> data streamer…
>
>
>
> How can we overcome this issue and load data to cache reliably?
>
>
>
> See Exception call stack:
>
>
>
> Apache.Ignite.Core.Common.ClientDisconnectedException: Client node
> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 --->
> Apache.Ignite.Core.Common.JavaException: class
> org.apache.ignite.IgniteClientDisconnectedException: Client node
> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 at
> org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)
> at
> org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)
> at
> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)
> at
> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)
> at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)
> at
> org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)
> at
> org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)
> at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck() at
> Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj,
> IntPtr methodId, Int64* argsPtr) at
> Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef
> target, Int32 opType, Int64 memPtr) at
> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
> val) --- End of inner exception stack trace --- at
> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
> val) at
> Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean
> value) at PopulateCache(String accountStyle, DateTime startDate,
> DateTime endDate)
>
>
>
> Thanks,
>
> Josh Katz
> ------------------------------
> Please follow the hyperlink to important disclosures.
> https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html
>
>
Re: Loading data to cache using a data streamer
Posted by Pavel Tupitsyn <pt...@apache.org>.
Josh,
Do you have a reproducer for this issue?
Can you please attach logs from all nodes?
On Sat, Mar 6, 2021 at 12:59 AM Josh Katz <
Josh.Katz.Contractor@dodgeandcox.com> wrote:
> Client node gets disconnected while trying to load data to cache using a
> data streamer…
>
>
>
> How can we overcome this issue and load data to cache reliably?
>
>
>
> See Exception call stack:
>
>
>
> Apache.Ignite.Core.Common.ClientDisconnectedException: Client node
> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 --->
> Apache.Ignite.Core.Common.JavaException: class
> org.apache.ignite.IgniteClientDisconnectedException: Client node
> disconnected: ignite-instance-dab0a266-a4fb-403f-863c-289d3ed18ab7 at
> org.apache.ignite.internal.GridKernalGatewayImpl.readLock(GridKernalGatewayImpl.java:93)
> at
> org.apache.ignite.internal.cluster.ClusterGroupAdapter.guard(ClusterGroupAdapter.java:175)
> at
> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forPredicate(ClusterGroupAdapter.java:379)
> at
> org.apache.ignite.internal.cluster.ClusterGroupAdapter.forCacheNodes(ClusterGroupAdapter.java:593)
> at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.allowOverwrite(DataStreamerImpl.java:496)
> at
> org.apache.ignite.internal.processors.platform.datastreamer.PlatformDataStreamer.processInLongOutLong(PlatformDataStreamer.java:187)
> at
> org.apache.ignite.internal.processors.platform.PlatformTargetProxyImpl.inLongOutLong(PlatformTargetProxyImpl.java:55)
> at Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.ExceptionCheck() at
> Apache.Ignite.Core.Impl.Unmanaged.Jni.Env.CallLongMethod(GlobalRef obj,
> IntPtr methodId, Int64* argsPtr) at
> Apache.Ignite.Core.Impl.Unmanaged.UnmanagedUtils.TargetInLongOutLong(GlobalRef
> target, Int32 opType, Int64 memPtr) at
> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
> val) --- End of inner exception stack trace --- at
> Apache.Ignite.Core.Impl.PlatformJniTarget.InLongOutLong(Int32 type, Int64
> val) at
> Apache.Ignite.Core.Impl.Datastream.DataStreamerImpl`2.set_AllowOverwrite(Boolean
> value) at PopulateCache(String accountStyle, DateTime startDate,
> DateTime endDate)
>
>
>
> Thanks,
>
> Josh Katz
> ------------------------------
> Please follow the hyperlink to important disclosures.
> https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html
>
>