You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Vivek Padmanabhan (JIRA)" <ji...@apache.org> on 2011/03/14 05:20:29 UTC
[jira] Commented: (PIG-1894) Worng stats shown when there are
multiple stores but same file names
[ https://issues.apache.org/jira/browse/PIG-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006328#comment-13006328 ]
Vivek Padmanabhan commented on PIG-1894:
----------------------------------------
Just for reference; the issue is PIG-1779 (Worng stats shown when there are multiple loads but same file names)
> Worng stats shown when there are multiple stores but same file names
> --------------------------------------------------------------------
>
> Key: PIG-1894
> URL: https://issues.apache.org/jira/browse/PIG-1894
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
>
> Pig 0.8/0.9 shows wrong stats for store counters when I have multiple store but of the same name.
> To reproduce the issue please use the below script :
> {code}
> A = load 'sampledata1' as (f1:chararray,f2:chararray,f3:int);
> B = filter A by f3==1;
> C = filter A by f3==2;
> D = filter A by f3==3;
> store B into '/folder/B/out.gz';
> store C into '/folder/C/out.gz';
> store D into '/folder/D/out.gz';
> {code}
> Input
> {code}
> aaa a 1
> aaa b 1
> bbb a 2
> bbb b 2
> ccc a 3
> ccc b 3
> {code}
> For this script Pig shows
> Output(s):
> Successfully stored 6 records (32 bytes) in: "/folder/B/out.gz"
> Successfully stored 6 records (32 bytes) in: "/folder/C/out.gz"
> Successfully stored 6 records (32 bytes) in: "/folder/D/out.gz"
> Counters:
> Total records written : 18
> Total bytes written : 96
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira