You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2010/07/10 02:27:49 UTC

[jira] Resolved: (PIG-769) COUNT fails on local mode but executes correctly on grid mode for the same data

     [ https://issues.apache.org/jira/browse/PIG-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich resolved PIG-769.
--------------------------------

    Fix Version/s: 0.7.0
       Resolution: Fixed

Local mode now uses the same code path as MR mode. Please, re-open if this is till a problem.

> COUNT fails on local mode but executes correctly on grid mode for the same data
> -------------------------------------------------------------------------------
>
>                 Key: PIG-769
>                 URL: https://issues.apache.org/jira/browse/PIG-769
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.2.0
>            Reporter: George Mavromatis
>             Fix For: 0.7.0
>
>
> The following script run on the grid executes correctly. It  prints (4L) for '/user/gmavr/k_sample_preprocessed_withj_sample'
> On local mode (invoked with -x local) and the same data in the local filesystem, it failes with:
> -2009-04-11 03:23:15,155 [main] ERROR org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore - Received error from storer function: org.apache.pig.backend.executionengine.ExecException: ERROR 2106: Error while computing count in COUNT
> %declare k_sample_preprocessed_withj '/user/gmavr/k_sample_preprocessed_withj_sample';
> -- %declare k_sample_preprocessed_withj '/homes/gmavr/mlrSite/k_sample_preprocessed_withj_sample';
> webdataFiltered = LOAD '$k_sample_preprocessed_withj' USING BinStorage() AS (url:chararray, pg:bytearray);
> X1 = GROUP webdataFiltered ALL;
> Y1 = FOREACH X1 GENERATE COUNT(*);
> DUMP Y1;

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.