You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Pavel Tupitsyn (Jira)" <ji...@apache.org> on 2025/07/17 11:00:00 UTC
[jira] [Updated] (IGNITE-25941) .NET: UpsertAll fails on large collections
[ https://issues.apache.org/jira/browse/IGNITE-25941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pavel Tupitsyn updated IGNITE-25941:
------------------------------------
Priority: Critical (was: Major)
> .NET: UpsertAll fails on large collections
> ------------------------------------------
>
> Key: IGNITE-25941
> URL: https://issues.apache.org/jira/browse/IGNITE-25941
> Project: Ignite
> Issue Type: Bug
> Components: platforms ai3, thin clients ai3
> Reporter: Pavel Tupitsyn
> Assignee: Pavel Tupitsyn
> Priority: Critical
> Labels: ignite-3
> Fix For: 3.1
>
>
> Modify *RecordViewBinaryTests* like this:
> {code}
> [TearDown]
> public async Task CleanTable()
> {
> await Client.Sql.ExecuteScriptAsync($"DELETE FROM {Table.Name}");
> }
> [Test]
> public async Task TestUpsertAllMany()
> {
> int count = 12345;
> var tuples = Enumerable.Range(0, count)
> .Select(id => new IgniteTuple { [KeyCol] = (long)id, [ValCol] = $"test{id}" })
> .ToList();
> await TupleView.UpsertAllAsync(null, tuples);
> }
> {code}
> *TestUpsertAllMany* fails:
> {code}
> JetBrains.ReSharper.TestRunner.Logging.TraceListener+AssertionException : _index + count < _buffer.Length
> at JetBrains.ReSharper.TestRunner.Logging.TraceListener.Fail(String message, String detailMessage) in Z:\BuildAgent\work\1b668fe37ef92293\ReSharperTestRunner\src\TestRunner.Utilities\Logging\TraceListener.cs:line 33
> at System.Diagnostics.TraceInternal.Fail(String message, String detailMessage)
> at System.Diagnostics.Debug.Fail(String message, String detailMessage)
> at Apache.Ignite.Internal.Buffers.PooledArrayBuffer.Advance(Int32 count) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line 106
> at Apache.Ignite.Internal.Buffers.PooledArrayBuffer.GetSpanAndAdvance(Int32 size) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Buffers/PooledArrayBuffer.cs:line 144
> at Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteExtensionHeader(Byte typeCode, Int32 dataLength) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line 249
> at Apache.Ignite.Internal.Proto.MsgPack.MsgPackWriter.WriteBitSet(Int32 bitCount) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Proto/MsgPack/MsgPackWriter.cs:line 230
> at Apache.Ignite.Internal.Table.Serialization.IRecordSerializerHandler`1.Write(MsgPackWriter& writer, Schema schema, T record, Boolean keyOnly, Boolean computeHash) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/IRecordSerializerHandler.cs:line 51
> at Apache.Ignite.Internal.Table.Serialization.RecordSerializer`1.WriteMultiple(PooledArrayBuffer buf, Nullable`1 txId, Schema schema, IEnumerator`1 recs, Boolean keyOnly) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/Serialization/RecordSerializer.cs:line 234
> at Apache.Ignite.Internal.Table.RecordView`1.DoMultiRecordOutOpAsync(ClientOp op, ITransaction transaction, IEnumerable`1 recs, Boolean keyOnly, Nullable`1 schemaVersionOverride) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line 643
> at Apache.Ignite.Internal.Table.RecordView`1.UpsertAllAsync(ITransaction transaction, IEnumerable`1 records) in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite/Internal/Table/RecordView.cs:line 182
> at Apache.Ignite.Tests.Table.RecordViewBinaryTests.TestUpsertAllMany() in /home/pavel/w/ignite-3/modules/platforms/dotnet/Apache.Ignite.Tests/Table/RecordViewBinaryTests.cs:line 49
> at NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.BlockUntilCompleted()
> at NUnit.Framework.Internal.MessagePumpStrategy.NoMessagePumpStrategy.WaitForCompletion(AwaitAdapter awaiter)
> at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
> at NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext context)
> at NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext context)
> at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.<Execute>b__0()
> at NUnit.Framework.Internal.Commands.DelegatingTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)
> {code}
> Set count to 7000, different failure (server side):
> {code}
> Apache.Ignite.IgniteException : Expected Ext, but got Integer (4c)
> ----> Apache.Ignite.IgniteException : org.apache.ignite.lang.IgniteException: IGN-CMN-65535 Expected Ext, but got Integer (4c) TraceId:43f0cc6e
> at org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.lambda$mapToPublicException$2(IgniteExceptionMapperUtil.java:88)
> at org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapCheckingResultIsPublic(IgniteExceptionMapperUtil.java:141)
> at org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapToPublicException(IgniteExceptionMapperUtil.java:137)
> at org.apache.ignite.internal.lang.IgniteExceptionMapperUtil.mapToPublicException(IgniteExceptionMapperUtil.java:88)
> at org.apache.ignite.client.handler.ClientInboundMessageHandler.writeErrorCore(ClientInboundMessageHandler.java:684)
> at org.apache.ignite.client.handler.ClientInboundMessageHandler.writeError(ClientInboundMessageHandler.java:653)
> at org.apache.ignite.client.handler.ClientInboundMessageHandler.processOperation(ClientInboundMessageHandler.java:757)
> at org.apache.ignite.client.handler.ClientInboundMessageHandler.channelRead(ClientInboundMessageHandler.java:398)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
> at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
> at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
> at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:289)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
> at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
> at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)
> at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
> at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)
> at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
> at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
> at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
> at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
> at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
> at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
> at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.base/java.lang.Thread.run(Thread.java:840)
> Caused by: org.msgpack.core.MessageTypeException: Expected Ext, but got Integer (4c)
> at org.apache.ignite.internal.client.proto.ClientMessageUnpacker.unexpected(ClientMessageUnpacker.java:94)
> at org.apache.ignite.internal.client.proto.ClientMessageUnpacker.unpackExtensionTypeHeader(ClientMessageUnpacker.java:424)
> at org.apache.ignite.internal.client.proto.ClientMessageUnpacker.unpackBitSet(ClientMessageUnpacker.java:700)
> at org.apache.ignite.client.handler.requests.table.ClientTuplesRequestBase.readAsync(ClientTuplesRequestBase.java:106)
> at org.apache.ignite.client.handler.requests.table.ClientTuplesRequestBase.readAsync(ClientTuplesRequestBase.java:78)
> at org.apache.ignite.client.handler.requests.table.ClientTupleUpsertAllRequest.process(ClientTupleUpsertAllRequest.java:54)
> at org.apache.ignite.client.handler.ClientInboundMessageHandler.processOperation(ClientInboundMessageHandler.java:793)
> at org.apache.ignite.client.handler.ClientInboundMessageHandler.processOperationInternal(ClientInboundMessageHandler.java:1047)
> at org.apache.ignite.client.handler.ClientInboundMessageHandler.processOperation(ClientInboundMessageHandler.java:752)
> ... 26 more
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)