You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2014/07/17 23:22:04 UTC
[jira] [Commented] (MAPREDUCE-5978) native-task CompressTest
failure on Ubuntu
[ https://issues.apache.org/jira/browse/MAPREDUCE-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065570#comment-14065570 ]
Todd Lipcon commented on MAPREDUCE-5978:
----------------------------------------
I see the following in the logs:
load nativetask lib failed, Native-Task Delegation is disabled
org.apache.hadoop.mapred.InvalidJobConfException: Native output collector don't support compression codec org.apache.hadoop.io.compress.BZip2Codec, We support Gzip, Lz4, snappy
at org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator.init(NativeMapOutputCollectorDelegator.java:94)
at org.apache.hadoop.mapred.nativetask.testutil.EnforceNativeOutputCollectorDelegator.init(EnforceNativeOutputCollectorDelegator.java:31)
at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:392)
at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:80)
at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:683)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:755)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:244)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
create file ./compress/input.txt
org.apache.hadoop.io.Text org.apache.hadoop.io.Text
create file ./compress/input.txt
org.apache.hadoop.io.Text org.apache.hadoop.io.Text
load nativetask lib failed, Native-Task Delegation is disabled
org.apache.hadoop.mapred.InvalidJobConfException: Native output collector don't support compression codec org.apache.hadoop.io.compress.DefaultCodec, We support Gzip, Lz4, snappy
at org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator.init(NativeMapOutputCollectorDelegator.java:94)
at org.apache.hadoop.mapred.nativetask.testutil.EnforceNativeOutputCollectorDelegator.init(EnforceNativeOutputCollectorDelegator.java:31)
at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:392)
at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:80)
at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:683)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:755)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:244)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
> native-task CompressTest failure on Ubuntu
> ------------------------------------------
>
> Key: MAPREDUCE-5978
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5978
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: task
> Reporter: Todd Lipcon
>
> The MR-2841 branch fails the following unit tests on my box:
> CompressTest.testBzip2Compress:84 file compare result: if they are the same ,then return true expected:<true> but was:<false>
> CompressTest.testDefaultCompress:116 file compare result: if they are the same ,then return true expected:<true> but was:<false>
> We need to fix these before merging.
--
This message was sent by Atlassian JIRA
(v6.2#6252)