You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@plc4x.apache.org by "Julian Feinauer (Jira)" <ji...@apache.org> on 2020/02/05 15:17:00 UTC

[jira] [Commented] (PLC4X-163) Netty OutOfDirectMemoryError

    [ https://issues.apache.org/jira/browse/PLC4X-163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030729#comment-17030729 ] 

Julian Feinauer commented on PLC4X-163:
---------------------------------------

[~swiendl] sorry, that I'm replying that late but I finally was able to fix the Buffer Leak also in the "old" rel/0.6 branch. Would you mind helping me a bit with checking it?
I created a branch  bugfix/PLC4X-163-fix-buffer-leaks which should be leak free.

> Netty OutOfDirectMemoryError
> ----------------------------
>
>                 Key: PLC4X-163
>                 URL: https://issues.apache.org/jira/browse/PLC4X-163
>             Project: Apache PLC4X
>          Issue Type: Bug
>          Components: Util-Scraper
>    Affects Versions: 0.5.0
>         Environment: Ubuntu 16.04 LTS
> Java 1.8.0_201
> {code}$ java -XX:+PrintFlagsFinal -version | grep -iE 'HeapSize|PermSize|ThreadStackSize'
>      intx CompilerThreadStackSize                   = 0                                   {pd product}
>     uintx ErgoHeapSizeLimit                         = 0                                   {product}
>     uintx HeapSizePerGCThread                       = 87241520                            {product}
>     uintx InitialHeapSize                          := 132120576                           {product}
>     uintx LargePageHeapSizeThreshold                = 134217728                           {product}
>     uintx MaxHeapSize                              := 2092957696                          {product}
>      intx ThreadStackSize                           = 1024                                {pd product}
>      intx VMThreadStackSize                         = 1024                                {pd product}
> java version "1.8.0_201"
> Java(TM) SE Runtime Environment (build 1.8.0_201-b09)
> Java HotSpot(TM) 64-Bit Server VM (build 25.201-b09, mixed mode){code}
>            Reporter: Sebastian Wiendl
>            Assignee: Julian Feinauer
>            Priority: Blocker
>         Attachments: screenshot-1.png
>
>
> After roughly 5-7 days of continued scraper operation (about 10 PLC tags, 100ms sampling rate), the scraper stops working with the following log output:{code}2019-12-12 18:08:29.569  WARN 23031 --- [nioEventLoopGroup-2-1] io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was fired, and it reached at the tail of the pipeline. It usually means the last handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 1845493760, max: 1860698112)
> 	at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.569  WARN 23031 --- [nioEventLoopGroup-2-1] io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was fired, and it reached at the tail of the pipeline. It usually means the last handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 1845493760, max: 1860698112)
> 	at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.570  WARN 23031 --- [nioEventLoopGroup-2-1] io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was fired, and it reached at the tail of the pipeline. It usually means the last handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 1845493760, max: 1860698112)
> 	at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.570  WARN 23031 --- [nioEventLoopGroup-2-1] io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was fired, and it reached at the tail of the pipeline. It usually means the last handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 1845493760, max: 1860698112)
> 	at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:178) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:139) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:147) ~[netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:29.570  WARN 23031 --- [nioEventLoopGroup-2-1] io.netty.channel.DefaultChannelPipeline  : An exceptionCaught() event was fired, and it reached at the tail of the pipeline. It usually means the last handler in the pipeline did not handle the exception.
> io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 1845493760, max: 1860698112)
> 	at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:726) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:681) ~[netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:215) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:342) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:187) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:123) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.buffer.AbstractByteBuf.readBytes(AbstractByteBuf.java:886) ~[netty-buffer-4.1.43.Final.jar!/:4.1.43.Final]
> 	at org.apache.plc4x.java.isoontcp.protocol.IsoOnTcpProtocol.decode(IsoOnTcpProtocol.java:100) ~[plc4j-protocol-iso-on-tcp-0.5.0.jar!/:0.5.0]
> 	at io.netty.handler.codec.ByteToMessageCodec$1.decode(ByteToMessageCodec.java:42) ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:503) ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:442) ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:281) ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.handler.codec.ByteToMessageCodec.channelRead(ByteToMessageCodec.java:103) ~[netty-codec-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) [netty-transport-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.43.Final.jar!/:4.1.43.Final]
> 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
> 2019-12-12 18:08:31.563  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:33.564  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:35.565  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:37.566  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:39.566  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:41.567  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:43.568  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:45.568  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:47.569  WARN 23031 --- [triggeredscraper-scheduling-thread-20] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:49.569  WARN 23031 --- [triggeredscraper-scheduling-thread-7] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG
> 2019-12-12 18:08:51.570  WARN 23031 --- [triggeredscraper-scheduling-thread-7] o.a.p.j.s.t.TriggeredScraperTask         : Exception during scraping of Job example, Connection-Alias S7: Error-message: null - for stack-trace change logging to DEBUG{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)