You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Kiru Pakkirisamy <ki...@yahoo.com> on 2015/10/27 07:11:59 UTC
lzo error while running mr job
I am seeing a weird error after we moved to the new hadoop mapreduce java packages in 2.4We are not using lzo (as in io.compression.codecs) but we still get this error. Does it mean we have to have lzo installed even though we are not using ? Thanks.
Regards,- kiru
2015-10-27 00:18:57,994 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader | Could not load native gpl libraryjava.lang.UnsatisfiedLinkError: no gplcompression in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886) ~[?:1.7.0_85] at java.lang.Runtime.loadLibrary0(Runtime.java:849) ~[?:1.7.0_85] at java.lang.System.loadLibrary(System.java:1088) ~[?:1.7.0_85] at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:31) [flow-trunk.242-470787.jar:?] at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:60) [flow-trunk.242-470787.jar:?] at java.lang.Class.forName0(Native Method) [?:1.7.0_85] at java.lang.Class.forName(Class.java:278) [?:1.7.0_85] at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.isSplitable(CombineFileInputFormat.java:159) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getMoreSplits(CombineFileInputFormat.java:283) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:243) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493) [flow-trunk.242-470787.jar:?]
Regards, - kiru
lzo error while running mr job
Posted by Kiru Pakkirisamy <ki...@yahoo.com>.
I am seeing a weird error after we moved to the new hadoop mapreduce java packages in 2.4We are not using lzo (as in io.compression.codecs) but we still get this error. Does it mean we have to have lzo installed even though we are not using ? Thanks.
Regards,- kiru
2015-10-27 00:18:57,994 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader | Could not load native gpl libraryjava.lang.UnsatisfiedLinkError: no gplcompression in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886) ~[?:1.7.0_85] at java.lang.Runtime.loadLibrary0(Runtime.java:849) ~[?:1.7.0_85] at java.lang.System.loadLibrary(System.java:1088) ~[?:1.7.0_85] at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:31) [flow-trunk.242-470787.jar:?] at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:60) [flow-trunk.242-470787.jar:?] at java.lang.Class.forName0(Native Method) [?:1.7.0_85] at java.lang.Class.forName(Class.java:278) [?:1.7.0_85] at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.isSplitable(CombineFileInputFormat.java:159) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getMoreSplits(CombineFileInputFormat.java:283) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:243) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493) [flow-trunk.242-470787.jar:?]
Regards, - kiru
lzo error while running mr job
Posted by Kiru Pakkirisamy <ki...@yahoo.com>.
I am seeing a weird error after we moved to the new hadoop mapreduce java packages in 2.4We are not using lzo (as in io.compression.codecs) but we still get this error. Does it mean we have to have lzo installed even though we are not using ? Thanks.
Regards,- kiru
2015-10-27 00:18:57,994 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader | Could not load native gpl libraryjava.lang.UnsatisfiedLinkError: no gplcompression in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886) ~[?:1.7.0_85] at java.lang.Runtime.loadLibrary0(Runtime.java:849) ~[?:1.7.0_85] at java.lang.System.loadLibrary(System.java:1088) ~[?:1.7.0_85] at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:31) [flow-trunk.242-470787.jar:?] at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:60) [flow-trunk.242-470787.jar:?] at java.lang.Class.forName0(Native Method) [?:1.7.0_85] at java.lang.Class.forName(Class.java:278) [?:1.7.0_85] at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.isSplitable(CombineFileInputFormat.java:159) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getMoreSplits(CombineFileInputFormat.java:283) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:243) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493) [flow-trunk.242-470787.jar:?]
Regards, - kiru
lzo error while running mr job
Posted by Kiru Pakkirisamy <ki...@yahoo.com>.
I am seeing a weird error after we moved to the new hadoop mapreduce java packages in 2.4We are not using lzo (as in io.compression.codecs) but we still get this error. Does it mean we have to have lzo installed even though we are not using ? Thanks.
Regards,- kiru
2015-10-27 00:18:57,994 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader | Could not load native gpl libraryjava.lang.UnsatisfiedLinkError: no gplcompression in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886) ~[?:1.7.0_85] at java.lang.Runtime.loadLibrary0(Runtime.java:849) ~[?:1.7.0_85] at java.lang.System.loadLibrary(System.java:1088) ~[?:1.7.0_85] at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:31) [flow-trunk.242-470787.jar:?] at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:60) [flow-trunk.242-470787.jar:?] at java.lang.Class.forName0(Native Method) [?:1.7.0_85] at java.lang.Class.forName(Class.java:278) [?:1.7.0_85] at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.isSplitable(CombineFileInputFormat.java:159) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getMoreSplits(CombineFileInputFormat.java:283) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:243) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493) [flow-trunk.242-470787.jar:?]
Regards, - kiru
lzo error while running mr job
Posted by Kiru Pakkirisamy <ki...@yahoo.com>.
I am seeing a weird error after we moved to the new hadoop mapreduce java packages in 2.4We are not using lzo (as in io.compression.codecs) but we still get this error. Does it mean we have to have lzo installed even though we are not using ? Thanks.
Regards,- kiru
2015-10-27 00:18:57,994 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader | Could not load native gpl libraryjava.lang.UnsatisfiedLinkError: no gplcompression in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1886) ~[?:1.7.0_85] at java.lang.Runtime.loadLibrary0(Runtime.java:849) ~[?:1.7.0_85] at java.lang.System.loadLibrary(System.java:1088) ~[?:1.7.0_85] at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:31) [flow-trunk.242-470787.jar:?] at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:60) [flow-trunk.242-470787.jar:?] at java.lang.Class.forName0(Native Method) [?:1.7.0_85] at java.lang.Class.forName(Class.java:278) [?:1.7.0_85] at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:1834) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1799) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:128) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:175) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.isSplitable(CombineFileInputFormat.java:159) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getMoreSplits(CombineFileInputFormat.java:283) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:243) [flow-trunk.242-470787.jar:?] at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493) [flow-trunk.242-470787.jar:?]
Regards, - kiru