[jira] Updated: (PIG-400) flatten causes schema naming problems

["Santhosh Srinivasan (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Santhosh Srinivasan updated PIG-400:
------------------------------------

    Attachment: PIG_400.patch

The patch (PIG_400.patch) fixes the following:

1. Allows users to specify schema for flattened columns
2. Performs a prefix merge of schemas provided by users
3. Unit test cases to handle points 1 and 2
3. Removed debug statements from PODistinct

Unit tests that still fail are:

    [junit] Running org.apache.pig.test.TestBuiltin
    [junit] Tests run: 23, Failures: 1, Errors: 2, Time elapsed: 14.495 sec
    [junit] Test org.apache.pig.test.TestBuiltin FAILED

    [junit] Running org.apache.pig.test.TestEvalPipeline
    [junit] Tests run: 9, Failures: 1, Errors: 1, Time elapsed: 170.88 sec
    [junit] Test org.apache.pig.test.TestEvalPipeline FAILED

    [junit] Running org.apache.pig.test.TestFilterOpNumeric
    [junit] Tests run: 8, Failures: 0, Errors: 1, Time elapsed: 56.765 sec
    [junit] Test org.apache.pig.test.TestFilterOpNumeric FAILED

    [junit] Running org.apache.pig.test.TestMRCompiler
    [junit] Tests run: 16, Failures: 1, Errors: 0, Time elapsed: 0.401 sec
    [junit] Test org.apache.pig.test.TestMRCompiler FAILED

> flatten causes schema naming problems
> -------------------------------------
>
>                 Key: PIG-400
>                 URL: https://issues.apache.org/jira/browse/PIG-400
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Olga Natkovich
>            Assignee: Santhosh Srinivasan
>             Fix For: types_branch
>
>         Attachments: PIG_400.patch
>
>
> Script:
> A = load 'data' as (name: chararray, age: chararray, gpa: float);
> B = group A by (name, age);
> C = foreach B generate flatten(group) as res, COUNT(A);
> D = foreach C generate res;
> dump D;
> Error:
> java.io.IOException: Invalid alias: res in {res::name: chararray,res::age: chararray,long}
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:255)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:422)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:241)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:82)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:64)
>         at org.apache.pig.Main.main(Main.java:302)
> Caused by: org.apache.pig.impl.logicalLayer.parser.ParseException: Invalid alias: res in {res::name: chararray,res::age: chararray,long}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.