You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Rohan Sharma via user <us...@ignite.apache.org> on 2023/06/19 08:32:36 UTC
Ignite compression not working on windows
I am trying to user apache ignite disk compression on windows for a cache with disk persistence ON but it fails with below error -
Caused by: class org.apache.ignite.IgniteCheckedException: Currently page compression is supported only for Linux. at org.apache.ignite.internal.processors.compress.CompressionProcessorImpl.checkPageCompressionSupported(CompressionProcessorImpl.java:76)
I am following steps mentioned on the page - https://ignite.apache.org/docs/latest/persistence/disk-compression#:~:text=Disk%20compression%20refers%20to%20the,compressed%20using%20the%20configured%20algorithm.
No where in the ignite documentation says that it is NOT supported on Windows.
Is it supported on windows?
I want to reduce the disk storage for a particular cache that will be holding large amount of data, any other way possible if compression doesn't work?
Thanks Rohan Sharma
Re: SEVERE log every time a client leaves the cluster
Posted by Hitesh Nandwana <hi...@gmail.com>.
Unsubscribe
On Tue, 20 Jun, 2023, 18:50 Maria_GaffneyLovett.amat.com via user, <
user@ignite.apache.org> wrote:
> Ignite version 2.14
>
>
>
> When a client node leaves the cluster, I see this error logged. It is a
> normal scenario for our client nodes to leave the cluster, with all cleanup
> performed using onLifecycleEvent where necessary and all nodes executing
> ignite.close() before termination. Please advise on how I can prevent this
> error? Is there something more I should be doing before leaving the cluster?
>
>
>
> Maria
>
>
>
> [SEVERE][grid-nio-worker-tcp-comm-0-#47%TcpCommunicationSpi%][TcpCommunicationSpi]
> Failed to process selector key [ses=GridSelectorNioSessionImpl
> [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0,
> bytesRcvd=97176, bytesSent=37628, bytesRcvd0=0, bytesSent0=0, select=true,
> super=GridWorker [name=grid-nio-worker-tcp-comm-0,
> igniteInstanceName=TcpCommunicationSpi, finished=false,
> heartbeatTs=1687195263283, hashCode=393162678, interrupted=false,
> runner=grid-nio-worker-tcp-comm-0-#47%TcpCommunicationSpi%]]],
> writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
> readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
> inRecovery=GridNioRecoveryDescriptor [acked=12, resendCnt=0, rcvCnt=15,
> sentCnt=15, reserved=true, lastAck=5, nodeLeft=false, node=TcpDiscoveryNode
> [id=0b4e5a16-9ce7-4f73-8e24-bf0362f181f8,
> consistentId=pel-ignite-client-node-Design-Perceptive-JVM-1,
> addrs=ArrayList [127.0.0.1, 192.168.7.147], sockAddrs=null, discPort=0,
> order=9, intOrder=8, lastExchangeTime=1687187880464, loc=false,
> ver=2.14.0#20220929-sha1:951e8deb, isClient=true], connected=false,
> connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false],
> outRecovery=GridNioRecoveryDescriptor [acked=12, resendCnt=0, rcvCnt=15,
> sentCnt=15, reserved=true, lastAck=5, nodeLeft=false, node=TcpDiscoveryNode
> [id=0b4e5a16-9ce7-4f73-8e24-bf0362f181f8,
> consistentId=pel-ignite-client-node-Design-Perceptive-JVM-1,
> addrs=ArrayList [127.0.0.1, 192.168.7.147], sockAddrs=null, discPort=0,
> order=9, intOrder=8, lastExchangeTime=1687187880464, loc=false,
> ver=2.14.0#20220929-sha1:951e8deb, isClient=true], connected=false,
> connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false],
> closeSocket=true,
> outboundMessagesQueueSizeMetric=o.a.i.i.processors.metric.impl.LongAdderMetric@69a257d1,
> super=GridNioSessionImpl [locAddr=/127.0.0.1:56695, rmtAddr=/
> 127.0.0.1:47106, createTime=1687193725944, closeTime=0, bytesSent=18382,
> bytesRcvd=1935, bytesSent0=0, bytesRcvd0=0, sndSchedTime=1687193725944,
> lastSndTime=1687195193511, lastRcvTime=1687195193511, readsPaused=false,
> filterChain=FilterChain[filters=[GridNioCodecFilter
> [parser=o.a.i.i.util.nio.GridDirectParser@4e641008, directMode=true],
> GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]]
>
> java.net.SocketException: Connection reset
>
> at
> java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
>
> at
> java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
>
> at
> org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1351)
>
> at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508)
>
> at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273)
>
> at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910)
>
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
>
> at java.base/java.lang.Thread.run(Thread.java:833)
>
>
>
>
>
> *Dr Maria Lovett*
>
> Principal Software Engineering KPU | SmartFactory Rx®
> <https://appliedsmartfactory.com/pharmaceutical/>
>
> Applied Materials | APG Pharma & Process Industries
> M: +44 7394 406152 | E: Maria_GaffneyLovett@amat.com
>
>
>
>
> <https://www.linkedin.com/company/perceptive-engineering-limited/mycompany/>
>
>
> Perceptive Engineering an Applied Materials Company | Vanguard House,
> Keckwick Lane, Daresbury, Warrington, Cheshire, WA4 4AB
> Registered in England and Wales, company no: 04589932
>
> The content of this message is APPLIED MATERIALS CONFIDENTIAL. If you are
> not the intended recipient, please notify me, delete this email and do not
> use or distribute this email.
>
>
>
>
>
SEVERE log every time a client leaves the cluster
Posted by "Maria_GaffneyLovett.amat.com via user" <us...@ignite.apache.org>.
Ignite version 2.14
When a client node leaves the cluster, I see this error logged. It is a normal scenario for our client nodes to leave the cluster, with all cleanup performed using onLifecycleEvent where necessary and all nodes executing ignite.close() before termination. Please advise on how I can prevent this error? Is there something more I should be doing before leaving the cluster?
Maria
[SEVERE][grid-nio-worker-tcp-comm-0-#47%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0, bytesRcvd=97176, bytesSent=37628, bytesRcvd0=0, bytesSent0=0, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=TcpCommunicationSpi, finished=false, heartbeatTs=1687195263283, hashCode=393162678, interrupted=false, runner=grid-nio-worker-tcp-comm-0-#47%TcpCommunicationSpi%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=12, resendCnt=0, rcvCnt=15, sentCnt=15, reserved=true, lastAck=5, nodeLeft=false, node=TcpDiscoveryNode [id=0b4e5a16-9ce7-4f73-8e24-bf0362f181f8, consistentId=pel-ignite-client-node-Design-Perceptive-JVM-1, addrs=ArrayList [127.0.0.1, 192.168.7.147], sockAddrs=null, discPort=0, order=9, intOrder=8, lastExchangeTime=1687187880464, loc=false, ver=2.14.0#20220929-sha1:951e8deb, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=12, resendCnt=0, rcvCnt=15, sentCnt=15, reserved=true, lastAck=5, nodeLeft=false, node=TcpDiscoveryNode [id=0b4e5a16-9ce7-4f73-8e24-bf0362f181f8, consistentId=pel-ignite-client-node-Design-Perceptive-JVM-1, addrs=ArrayList [127.0.0.1, 192.168.7.147], sockAddrs=null, discPort=0, order=9, intOrder=8, lastExchangeTime=1687187880464, loc=false, ver=2.14.0#20220929-sha1:951e8deb, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], closeSocket=true, outboundMessagesQueueSizeMetric=o.a.i.i.processors.metric.impl.LongAdderMetric@69a257d1<ma...@69a257d1>, super=GridNioSessionImpl [locAddr=/127.0.0.1:56695, rmtAddr=/127.0.0.1:47106, createTime=1687193725944, closeTime=0, bytesSent=18382, bytesRcvd=1935, bytesSent0=0, bytesRcvd0=0, sndSchedTime=1687193725944, lastSndTime=1687195193511, lastRcvTime=1687195193511, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@4e641008, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]]
java.net.SocketException: Connection reset
at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1351)
at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508)
at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273)
at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
at java.base/java.lang.Thread.run(Thread.java:833)
Dr Maria Lovett
Principal Software Engineering KPU | SmartFactory Rx®<https://appliedsmartfactory.com/pharmaceutical/>
Applied Materials | APG Pharma & Process Industries
M: +44 7394 406152 | E: Maria_GaffneyLovett@amat.com<ma...@amat.com>
[cid:image001.png@01D9A37B.401170D0]<https://www.linkedin.com/company/perceptive-engineering-limited/mycompany/>
Perceptive Engineering an Applied Materials Company | Vanguard House, Keckwick Lane, Daresbury, Warrington, Cheshire, WA4 4AB
Registered in England and Wales, company no: 04589932
The content of this message is APPLIED MATERIALS CONFIDENTIAL. If you are not the intended recipient, please notify me, delete this email and do not use or distribute this email.
SEVERE log every time a client leaves the cluster
Posted by Ma...@amat.com.INVALID.
Ignite version 2.14
When a client node leaves the cluster, I see this error logged. It is a normal scenario for our client nodes to leave the cluster, with all cleanup performed using onLifecycleEvent where necessary and all nodes executing ignite.close() before termination. Please advise on how I can prevent this error? Is there something more I should be doing before leaving the cluster?
Maria
[SEVERE][grid-nio-worker-tcp-comm-0-#47%TcpCommunicationSpi%][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0, bytesRcvd=97176, bytesSent=37628, bytesRcvd0=0, bytesSent0=0, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=TcpCommunicationSpi, finished=false, heartbeatTs=1687195263283, hashCode=393162678, interrupted=false, runner=grid-nio-worker-tcp-comm-0-#47%TcpCommunicationSpi%]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=12, resendCnt=0, rcvCnt=15, sentCnt=15, reserved=true, lastAck=5, nodeLeft=false, node=TcpDiscoveryNode [id=0b4e5a16-9ce7-4f73-8e24-bf0362f181f8, consistentId=pel-ignite-client-node-Design-Perceptive-JVM-1, addrs=ArrayList [127.0.0.1, 192.168.7.147], sockAddrs=null, discPort=0, order=9, intOrder=8, lastExchangeTime=1687187880464, loc=false, ver=2.14.0#20220929-sha1:951e8deb, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=12, resendCnt=0, rcvCnt=15, sentCnt=15, reserved=true, lastAck=5, nodeLeft=false, node=TcpDiscoveryNode [id=0b4e5a16-9ce7-4f73-8e24-bf0362f181f8, consistentId=pel-ignite-client-node-Design-Perceptive-JVM-1, addrs=ArrayList [127.0.0.1, 192.168.7.147], sockAddrs=null, discPort=0, order=9, intOrder=8, lastExchangeTime=1687187880464, loc=false, ver=2.14.0#20220929-sha1:951e8deb, isClient=true], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=1, pairedConnections=false], closeSocket=true, outboundMessagesQueueSizeMetric=o.a.i.i.processors.metric.impl.LongAdderMetric@69a257d1<ma...@69a257d1>, super=GridNioSessionImpl [locAddr=/127.0.0.1:56695, rmtAddr=/127.0.0.1:47106, createTime=1687193725944, closeTime=0, bytesSent=18382, bytesRcvd=1935, bytesSent0=0, bytesRcvd0=0, sndSchedTime=1687193725944, lastSndTime=1687195193511, lastRcvTime=1687195193511, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@4e641008, directMode=true], GridConnectionBytesVerifyFilter], accepted=false, markedForClose=false]]]
java.net.SocketException: Connection reset
at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processRead(GridNioServer.java:1351)
at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508)
at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273)
at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910)
at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
at java.base/java.lang.Thread.run(Thread.java:833)
Dr Maria Lovett
Principal Software Engineering KPU | SmartFactory Rx®<https://appliedsmartfactory.com/pharmaceutical/>
Applied Materials | APG Pharma & Process Industries
M: +44 7394 406152 | E: Maria_GaffneyLovett@amat.com<ma...@amat.com>
[cid:image001.png@01D9A37B.401170D0]<https://www.linkedin.com/company/perceptive-engineering-limited/mycompany/>
Perceptive Engineering an Applied Materials Company | Vanguard House, Keckwick Lane, Daresbury, Warrington, Cheshire, WA4 4AB
Registered in England and Wales, company no: 04589932
The content of this message is APPLIED MATERIALS CONFIDENTIAL. If you are not the intended recipient, please notify me, delete this email and do not use or distribute this email.
Re: Ignite compression not working on windows
Posted by Stephen Darlington <st...@gridgain.com>.
I would believe the error message. It’s pretty clear and explicit. Maybe you can leave some feedback on the documentation (there’s a button on the bottom right of each page).
> On 19 Jun 2023, at 09:32, Rohan Sharma via user <us...@ignite.apache.org> wrote:
>
> I am trying to user apache ignite disk compression on windows for a cache with disk persistence ON but it fails with below error -
>
> Caused by: class org.apache.ignite.IgniteCheckedException: Currently page compression is supported only for Linux. at org.apache.ignite.internal.processors.compress.CompressionProcessorImpl.checkPageCompressionSupported(CompressionProcessorImpl.java:76)
>
> I am following steps mentioned on the page - https://ignite.apache.org/docs/latest/persistence/disk-compression#:~:text=Disk%20compression%20refers%20to%20the,compressed%20using%20the%20configured%20algorithm <https://ignite.apache.org/docs/latest/persistence/disk-compression#:%7E:text=Disk%20compression%20refers%20to%20the,compressed%20using%20the%20configured%20algorithm>.
>
> No where in the ignite documentation says that it is NOT supported on Windows.
>
> Is it supported on windows?
>
> I want to reduce the disk storage for a particular cache that will be holding large amount of data, any other way possible if compression doesn't work?
>
>
> Thanks
> Rohan Sharma