You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2019/01/25 15:16:43 UTC
[GitHub] keith-turner opened a new issue #920: Configuring snappy left minor
compaction hung.
keith-turner opened a new issue #920: Configuring snappy left minor compaction hung.
URL: https://github.com/apache/accumulo/issues/920
While runnning continuous ingest on EC2 using 2.0.0-alpha-2 I tried configuring snappy and this threw an exception. This seemed to have left the tablets in a bad state, because when I set compression back to gzip the tablets never tried to compact again. I had to kill the tservers. Ideally this problem would work itself out when config is updated.
Below are some of the exceptions seen on the tserver.
```
2019-01-24 17:03:25,319 [tablet.Tablet] ERROR: Failed to free tablet memory
java.lang.IllegalStateException
at org.apache.accumulo.tserver.tablet.TabletMemory.finalizeMinC(TabletMemory.java:114)
at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:937)
at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:91)
at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
at java.lang.Thread.run(Thread.java:748)
2019-01-24 17:03:25,323 [tablet.MinorCompactionTask] ERROR: Unknown error during minor compaction for extent: 2<;7b6db6db6db6db81
java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:933)
at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:91)
at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native Method)
at org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63)
at org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:136)
at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150)
at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:168)
at org.apache.accumulo.core.file.rfile.bcfile.Compression$Algorithm.getCompressor(Compression.java:648)
at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer$WBlockState.<init>(BCFile.java:150)
at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer.prepareMetaBlock(BCFile.java:389)
at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer.prepareMetaBlock(BCFile.java:409)
at org.apache.accumulo.core.file.rfile.RFile$Writer.close(RFile.java:603)
at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:272)
at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:124)
at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:918)
... 7 more
```
```
2019-01-24 17:03:25,324 [tserver.TabletServerResourceManager] ERROR: Thread "minor compactor 2" died java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:107)
at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:933)
at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:91)
... 6 more
Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
at org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native Method)
at org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63)
at org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:136)
at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150)
at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:168)
at org.apache.accumulo.core.file.rfile.bcfile.Compression$Algorithm.getCompressor(Compression.java:648)
at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer$WBlockState.<init>(BCFile.java:150)
at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer.prepareMetaBlock(BCFile.java:389)
at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer.prepareMetaBlock(BCFile.java:409)
at org.apache.accumulo.core.file.rfile.RFile$Writer.close(RFile.java:603)
at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:272)
at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:124)
at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:918)
... 7 more
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services