You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Egil Sorensen (JIRA)" <ji...@apache.org> on 2013/05/14 02:21:19 UTC
[jira] [Created] (PIG-3323) AVRO: default value not stored in file
when given as paramter to AvroStorage
Egil Sorensen created PIG-3323:
----------------------------------
Summary: AVRO: default value not stored in file when given as paramter to AvroStorage
Key: PIG-3323
URL: https://issues.apache.org/jira/browse/PIG-3323
Project: Pig
Issue Type: Bug
Components: piggybank
Affects Versions: 0.11.2
Reporter: Egil Sorensen
Assignee: Viraj Bhat
Fix For: 0.12, 0.11.2
I am getting NPE when loading a file with AvroStorage a file that has schema like:
{code}
["null",{"type":"record","name":"TUPLE_0","fields":[{"name":"name","type":["null","string"],"doc":"autogenerated from Pig Field Schema"},{"name":"age","type":["null","int"],"doc":"autogenerated from Pig Field Schema"},{"name":"gpa","type":["null","double"],"doc":"autogenerated from Pig Field Schema"}]}]
{code}
E.g. see the e2e style test, which fails on this:
{code}
{
'num' => 4,
# storing file with Pig type tuple relying on conversion to record
# loading using stored schemas
'notmq' => 1,
'pig' => q\
a = load ':INPATH:/singlefile/studentcomplextab10k' using PigStorage() as (m:[], t:(name:chararray, age:int, gpa:double), b:{t:(name:chararray, age:int, gpa:double)});
b = foreach a generate t;
describe b;
store b into ':OUTPATH:.intermediate' USING org.apache.pig.piggybank.storage.avro.AvroStorage();
exec;
-- Read back what was stored with Avro
u = load ':OUTPATH:.intermediate' USING org.apache.pig.piggybank.storage.avro.AvroStorage();
describe u;
store u into ':OUTPATH:';
\,
'verify_pig_script' => q\
a = load ':INPATH:/singlefile/studentcomplextab10k' using PigStorage() as (m:[], t:(name:chararray, age:int, gpa:double), b:{t:(name:chararray, age:int, gpa:double)});
b = foreach a generate t;
describe b;
store b into ':OUTPATH:';
\,
},
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira