You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2010/12/16 22:24:01 UTC
[jira] Updated: (PIG-1771) New logical plan: Merge schema fail if
LoadFunc.getSchema return different schema with "Load...AS"
[ https://issues.apache.org/jira/browse/PIG-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai updated PIG-1771:
----------------------------
Description:
The following script fail:
{code}
a = load '1.txt' as (a0:chararray, a1:chararray, a3, a4:map[]);
store a into '1.bin' using BinStorage();
auxData = LOAD '1.bin' USING BinStorage('Utf8StorageConverter') AS (cookieId:chararray, type:chararray, record:tuple(), state:map[]);
dump auxData;
{code}
Error message:
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2246: Error merging schema record#-1:tuple{} and null#-1:bytearray
at org.apache.pig.newplan.logical.relational.LogicalSchema.merge(LogicalSchema.java:337)
at org.apache.pig.newplan.logical.relational.LOLoad.getSchema(LOLoad.java:103)
at org.apache.pig.newplan.logical.optimizer.SchemaResetter.visit(SchemaResetter.java:59)
at org.apache.pig.newplan.logical.relational.LOLoad.accept(LOLoad.java:159)
at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:261)
... 12 more
was:
The following script fail:
{code}
a = load '1.txt' as (a0:chararray, a1:chararray, a3, a4:map[]);
store a into '1.bin' using BinStorage();
auxData = LOAD '1.bin' USING BinStorage() AS (cookieId:chararray, type:chararray, record:tuple(), state:map[]);
dump auxData;
{code}
Error message:
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2246: Error merging schema record#-1:tuple{} and null#-1:bytearray
at org.apache.pig.newplan.logical.relational.LogicalSchema.merge(LogicalSchema.java:337)
at org.apache.pig.newplan.logical.relational.LOLoad.getSchema(LOLoad.java:103)
at org.apache.pig.newplan.logical.optimizer.SchemaResetter.visit(SchemaResetter.java:59)
at org.apache.pig.newplan.logical.relational.LOLoad.accept(LOLoad.java:159)
at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:261)
... 12 more
> New logical plan: Merge schema fail if LoadFunc.getSchema return different schema with "Load...AS"
> --------------------------------------------------------------------------------------------------
>
> Key: PIG-1771
> URL: https://issues.apache.org/jira/browse/PIG-1771
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.8.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.8.0
>
>
> The following script fail:
> {code}
> a = load '1.txt' as (a0:chararray, a1:chararray, a3, a4:map[]);
> store a into '1.bin' using BinStorage();
> auxData = LOAD '1.bin' USING BinStorage('Utf8StorageConverter') AS (cookieId:chararray, type:chararray, record:tuple(), state:map[]);
> dump auxData;
> {code}
> Error message:
> Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2246: Error merging schema record#-1:tuple{} and null#-1:bytearray
> at org.apache.pig.newplan.logical.relational.LogicalSchema.merge(LogicalSchema.java:337)
> at org.apache.pig.newplan.logical.relational.LOLoad.getSchema(LOLoad.java:103)
> at org.apache.pig.newplan.logical.optimizer.SchemaResetter.visit(SchemaResetter.java:59)
> at org.apache.pig.newplan.logical.relational.LOLoad.accept(LOLoad.java:159)
> at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
> at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50)
> at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:261)
> ... 12 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.