[jira] [Created] (DATAFU-40) Using BagGroup may yield error: Problem while reconciling output schema of ForEach

["Matthew Hayes (JIRA)" <ji...@apache.org>]

Matthew Hayes created DATAFU-40:
-----------------------------------

             Summary: Using BagGroup may yield error: Problem while reconciling output schema of ForEach
                 Key: DATAFU-40
                 URL: https://issues.apache.org/jira/browse/DATAFU-40
             Project: DataFu
          Issue Type: Bug
            Reporter: Matthew Hayes


This test fails:

{code}
/**
  define BagSum datafu.pig.bags.BagSum();
  define BagGroup datafu.pig.bags.BagGroup();
  
  data = LOAD 'input' USING PigStorage(',') AS (id:int, key:chararray, val:int);
  describe data;
  
  data2 = GROUP data BY id;
  data3 = FOREACH data2 GENERATE group as id, BagGroup(data,data.key) as grouped;
  
  describe data3;
  
  data4 = FOREACH data3 {
    summed = FOREACH grouped GENERATE group as key, SUM(data.val) as total;
    ordered = ORDER summed BY key;
    GENERATE id, ordered;
  }
  
  describe data4;
  
  STORE data4 INTO 'output';

   */
  @Multiline
  private String bagSumTest;
  
  @Test
  public void bagSumTest() throws Exception
  {
    PigTest test = createPigTestFromString(bagSumTest);
    writeLinesToFile("input", "1,A,1","1,B,2","2,A,3","3,A,4","1,C,5","1,C,6",
                     "3,A,7","2,B,8","1,A,9","2,A,10");
    test.runScript();
    assertOutput(test, "data4", 
                 "(1,{(A,10),(B,2),(C,11)})",
                 "(2,{(A,13),(B,8)})",
                 "(3,{(A,11)})");
  }
{code}

The failure message is:

{code}
Caused by: org.apache.pig.impl.logicalLayer.validators.TypeCheckerException: ERROR 1059: 
<line 6, column 8> Problem while reconciling output schema of ForEach
{code}

However, if {{data}} is replaced with {{$1}} the test passes.



--
This message was sent by Atlassian JIRA
(v6.2#6252)