You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "George Mavromatis (JIRA)" <ji...@apache.org> on 2009/04/16 07:54:15 UTC
[jira] Created: (PIG-769) COUNT fails on local mode but executes
correctly on grid mode for the same data
COUNT fails on local mode but executes correctly on grid mode for the same data
-------------------------------------------------------------------------------
Key: PIG-769
URL: https://issues.apache.org/jira/browse/PIG-769
Project: Pig
Issue Type: Bug
Affects Versions: 0.2.0
Reporter: George Mavromatis
The following script run on the grid executes correctly. It prints (4L) for '/user/gmavr/k_sample_preprocessed_withj_sample'
On local mode (invoked with -x local) and the same data in the local filesystem, it failes with:
-2009-04-11 03:23:15,155 [main] ERROR org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore - Received error from storer function: org.apache.pig.backend.executionengine.ExecException: ERROR 2106: Error while computing count in COUNT
%declare k_sample_preprocessed_withj '/user/gmavr/k_sample_preprocessed_withj_sample';
-- %declare k_sample_preprocessed_withj '/homes/gmavr/mlrSite/k_sample_preprocessed_withj_sample';
webdataFiltered = LOAD '$k_sample_preprocessed_withj' USING BinStorage() AS (url:chararray, pg:bytearray);
X1 = GROUP webdataFiltered ALL;
Y1 = FOREACH X1 GENERATE COUNT(*);
DUMP Y1;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (PIG-769) COUNT fails on local mode but executes
correctly on grid mode for the same data
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich resolved PIG-769.
--------------------------------
Fix Version/s: 0.7.0
Resolution: Fixed
Local mode now uses the same code path as MR mode. Please, re-open if this is till a problem.
> COUNT fails on local mode but executes correctly on grid mode for the same data
> -------------------------------------------------------------------------------
>
> Key: PIG-769
> URL: https://issues.apache.org/jira/browse/PIG-769
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.2.0
> Reporter: George Mavromatis
> Fix For: 0.7.0
>
>
> The following script run on the grid executes correctly. It prints (4L) for '/user/gmavr/k_sample_preprocessed_withj_sample'
> On local mode (invoked with -x local) and the same data in the local filesystem, it failes with:
> -2009-04-11 03:23:15,155 [main] ERROR org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore - Received error from storer function: org.apache.pig.backend.executionengine.ExecException: ERROR 2106: Error while computing count in COUNT
> %declare k_sample_preprocessed_withj '/user/gmavr/k_sample_preprocessed_withj_sample';
> -- %declare k_sample_preprocessed_withj '/homes/gmavr/mlrSite/k_sample_preprocessed_withj_sample';
> webdataFiltered = LOAD '$k_sample_preprocessed_withj' USING BinStorage() AS (url:chararray, pg:bytearray);
> X1 = GROUP webdataFiltered ALL;
> Y1 = FOREACH X1 GENERATE COUNT(*);
> DUMP Y1;
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.