You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Marek Horst (JIRA)" <ji...@apache.org> on 2015/05/12 20:13:03 UTC
[jira] [Commented] (PIG-3358) Pig Avro Writer: Unsupported type in
record:class java.lang.String
[ https://issues.apache.org/jira/browse/PIG-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14540379#comment-14540379 ]
Marek Horst commented on PIG-3358:
----------------------------------
Just tried this one on PIG (0.12.0-cdh5.3.2) being part of cloudera distribution having PIG-4219 backport applied and I am receiving exact same exception when running attached test case.
> Pig Avro Writer: Unsupported type in record:class java.lang.String
> ------------------------------------------------------------------
>
> Key: PIG-3358
> URL: https://issues.apache.org/jira/browse/PIG-3358
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.11.1
> Reporter: Nick White
> Attachments: TestTypeInference.java
>
>
> Attached test case gives the exception below - the avro writer always fails when writing to a schema with a single field (I've only tested with string fields though).
> org.apache.avro.file.DataFileWriter$AppendWriteException: java.lang.RuntimeException: Unsupported type in record:class java.lang.String
> at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:263)
> at org.apache.pig.piggybank.storage.avro.PigAvroRecordWriter.write(PigAvroRecordWriter.java:49)
> at org.apache.pig.piggybank.storage.avro.AvroStorage.putNext(AvroStorage.java:727)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:139)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:1)
> at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:639)
> at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.collect(PigMapOnly.java:48)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:284)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:277)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:1)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
> Caused by: java.lang.RuntimeException: Unsupported type in record:class java.lang.String
> at org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter.getField(PigAvroDatumWriter.java:385)
> at org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter.writeRecord(PigAvroDatumWriter.java:363)
> at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:66)
> at org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter.write(PigAvroDatumWriter.java:99)
> at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:58)
> at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:257)
> ... 14 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)