[jira] [Updated] (CRUNCH-203) test fails with hadoop-2

["Josh Wills (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CRUNCH-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills updated CRUNCH-203:
------------------------------

    Attachment: CRUNCH-203.patch

Fix for this, which required porting Trevni's outputformat into Crunch. This JIRA should be used as a reminder for me the next time I want to import a new source/target type into Crunch. ;-)
                
> test fails with hadoop-2
> ------------------------
>
>                 Key: CRUNCH-203
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-203
>             Project: Crunch
>          Issue Type: Bug
>          Components: IO
>         Environment: mvn clean verify -Phadoop-2 -Dit.test=TrevniKeyPipelineIT
>            Reporter: Chao Shi
>         Attachments: CRUNCH-203.patch
>
>
> It seems like trevni is still using hadoop-1. Do they have releases for hadoop-2?
> java.lang.Exception: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:400)
> Caused by: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
>         at org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordWriter.initSchema(AvroTrevniKeyRecordWriter.java:57)
>         at org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase.<init>(AvroTrevniRecordWriterBase.java:82)
>         at org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordWriter.<init>(AvroTrevniKeyRecordWriter.java:42)
>         at org.apache.trevni.avro.mapreduce.AvroTrevniKeyOutputFormat.getRecordWriter(AvroTrevniKeyOutputFormat.java:54)
>         at org.apache.crunch.io.CrunchOutputs.getRecordWriter(CrunchOutputs.java:175)
>         at org.apache.crunch.io.CrunchOutputs.write(CrunchOutputs.java:129)
>         at org.apache.crunch.impl.mr.emit.MultipleOutputEmitter.emit(MultipleOutputEmitter.java:43)
>         at org.apache.crunch.MapFn.process(MapFn.java:34)
>         at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:93)
>         at org.apache.crunch.impl.mr.emit.IntermediateEmitter.emit(IntermediateEmitter.java:57)
>         at org.apache.crunch.MapFn.process(MapFn.java:34)
>         at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:93)
>         at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:104)
>         at org.apache.crunch.impl.mr.run.CrunchMapper.map(CrunchMapper.java:64)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:232)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>         at java.lang.Thread.run(Thread.java:662)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira