You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Alan Gates (JIRA)" <ji...@apache.org> on 2008/09/09 21:01:49 UTC
[jira] Updated: (PIG-416) split with types causing failure during
dump
[ https://issues.apache.org/jira/browse/PIG-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan Gates updated PIG-416:
---------------------------
Attachment: PIG-416.patch
Fixes LogicalOptimizer to properly select the SplitOutputs to patch up projections for when inserting types. Also fixes explain to work with splits.
> split with types causing failure during dump
> --------------------------------------------
>
> Key: PIG-416
> URL: https://issues.apache.org/jira/browse/PIG-416
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Alan Gates
> Priority: Critical
> Fix For: types_branch
>
> Attachments: PIG-416.patch
>
>
> grunt> A = load 'data' as (name: chararray, age: int, gpa: float);
> grunt> split A into A1 if name == 'foo', A2 if name != 'foo';
> grunt> dump A1;
> The following script causes runtime exception:
> 08/09/04 16:24:33 INFO mapReduceLayer.MapReduceLauncher: 0% complete
> 08/09/04 16:24:36 INFO mapReduceLayer.MapReduceLauncher: 50% complete
> 08/09/04 16:25:01 INFO mapReduceLayer.MapReduceLauncher: 100% complete
> 08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Map reduce job failed
> 08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Job failed!
> 08/09/04 16:25:04 ERROR mapReduceLayer.Launcher: Error message from task (map) tip_200808261638_3037_m_000000java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.DataByteArray
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression.getNext(ConstantExpression.java:111)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.EqualToExpr.getNext(EqualToExpr.java:68)
> at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:147)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:127)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:64)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.