You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (Created) (JIRA)" <ji...@apache.org> on 2012/03/15 22:46:38 UTC
[jira] [Created] (PIG-2594) JsonLoader/JsonStorage does not work
with boolean
JsonLoader/JsonStorage does not work with boolean
-------------------------------------------------
Key: PIG-2594
URL: https://issues.apache.org/jira/browse/PIG-2594
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.10
Reporter: Daniel Dai
The following script fail:
{code}
A = LOAD 'allscalar10k.json' using JsonLoader();
store B into 'output';
{code}
Exception:
java.io.IOException: Unknown type in input schema: 5
at org.apache.pig.builtin.JsonLoader.readField(JsonLoader.java:292)
at org.apache.pig.builtin.JsonLoader.getNext(JsonLoader.java:157)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:187)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532)
at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2594) JsonLoader/JsonStorage does not work
with boolean
Posted by "Paul Groudas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Groudas updated PIG-2594:
------------------------------
Attachment: PIG-2594.patch
Just a quick cleanup to add Boolean support to JsonStorage.
> JsonLoader/JsonStorage does not work with boolean
> -------------------------------------------------
>
> Key: PIG-2594
> URL: https://issues.apache.org/jira/browse/PIG-2594
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.10.0
> Reporter: Daniel Dai
> Attachments: PIG-2594.patch
>
>
> The following script fail:
> {code}
> A = LOAD 'allscalar10k.json' using JsonLoader();
> store B into 'output';
> {code}
> Exception:
> java.io.IOException: Unknown type in input schema: 5
> at org.apache.pig.builtin.JsonLoader.readField(JsonLoader.java:292)
> at org.apache.pig.builtin.JsonLoader.getNext(JsonLoader.java:157)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:187)
> at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532)
> at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2594) JsonLoader/JsonStorage does not work
with boolean
Posted by "Paul Groudas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Groudas updated PIG-2594:
------------------------------
Attachment: PIG-2594.patch
Extending unit test that tests null storing/loading.
> JsonLoader/JsonStorage does not work with boolean
> -------------------------------------------------
>
> Key: PIG-2594
> URL: https://issues.apache.org/jira/browse/PIG-2594
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.10.0
> Reporter: Daniel Dai
> Attachments: PIG-2594.patch, PIG-2594.patch
>
>
> The following script fail:
> {code}
> A = LOAD 'allscalar10k.json' using JsonLoader();
> store B into 'output';
> {code}
> Exception:
> java.io.IOException: Unknown type in input schema: 5
> at org.apache.pig.builtin.JsonLoader.readField(JsonLoader.java:292)
> at org.apache.pig.builtin.JsonLoader.getNext(JsonLoader.java:157)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:187)
> at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532)
> at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2594) JsonLoader/JsonStorage does not work
with boolean
Posted by "Paul Groudas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Groudas updated PIG-2594:
------------------------------
Attachment: PIG-2594-2.patch
Sorry, Resubmitting with checking the 'Grant license' option.
> JsonLoader/JsonStorage does not work with boolean
> -------------------------------------------------
>
> Key: PIG-2594
> URL: https://issues.apache.org/jira/browse/PIG-2594
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.10.0
> Reporter: Daniel Dai
> Attachments: PIG-2594-2.patch, PIG-2594.patch, PIG-2594.patch
>
>
> The following script fail:
> {code}
> A = LOAD 'allscalar10k.json' using JsonLoader();
> store B into 'output';
> {code}
> Exception:
> java.io.IOException: Unknown type in input schema: 5
> at org.apache.pig.builtin.JsonLoader.readField(JsonLoader.java:292)
> at org.apache.pig.builtin.JsonLoader.getNext(JsonLoader.java:157)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:187)
> at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532)
> at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira