You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Vivek Padmanabhan (JIRA)" <ji...@apache.org> on 2010/12/22 08:02:01 UTC
[jira] Created: (PIG-1779) Worng stats shown when there are
multiple loads but same file names
Worng stats shown when there are multiple loads but same file names
-------------------------------------------------------------------
Key: PIG-1779
URL: https://issues.apache.org/jira/browse/PIG-1779
Project: Pig
Issue Type: Bug
Components: tools
Affects Versions: 0.8.0
Reporter: Vivek Padmanabhan
In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
a) Problem 1
Sample Script :
A = LOAD 'myfolder/tryme' AS (f1);
B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
C = JOIN A BY f1, B BY f2;
DUMP C;
Here I have 10 records for A and 3 records for B , but pig says
Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
Successfully read 6 records from: "<nn>myfolder/tryme"
b) Problem 2
A = LOAD 'myfolder/tryme' AS (f1);
B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
C = JOIN A BY f1, B BY f2;
DUMP C;
Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
Failed to read data from "<nn>/myfolder/tryme"
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-1779) Worng stats shown when there are
multiple loads but same file names
Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002890#comment-13002890 ]
Thejas M Nair commented on PIG-1779:
------------------------------------
+1
> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
> Key: PIG-1779
> URL: https://issues.apache.org/jira/browse/PIG-1779
> Project: Pig
> Issue Type: Bug
> Components: tools
> Affects Versions: 0.8.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-1779.patch
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script :
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (PIG-1779) Worng stats shown when there are
multiple loads but same file names
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1779:
------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Patch committed to trunk.
> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
> Key: PIG-1779
> URL: https://issues.apache.org/jira/browse/PIG-1779
> Project: Pig
> Issue Type: Bug
> Components: tools
> Affects Versions: 0.8.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-1779.patch
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script :
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (PIG-1779) Worng stats shown when there are
multiple loads but same file names
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1779:
------------------------------
Fix Version/s: 0.9.0
> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
> Key: PIG-1779
> URL: https://issues.apache.org/jira/browse/PIG-1779
> Project: Pig
> Issue Type: Bug
> Components: tools
> Affects Versions: 0.8.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script :
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1779) Worng stats shown when there are
multiple loads but same file names
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1779:
------------------------------
Status: Patch Available (was: Open)
> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
> Key: PIG-1779
> URL: https://issues.apache.org/jira/browse/PIG-1779
> Project: Pig
> Issue Type: Bug
> Components: tools
> Affects Versions: 0.8.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-1779.patch
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script :
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (PIG-1779) Worng stats shown when there are
multiple loads but same file names
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding reassigned PIG-1779:
---------------------------------
Assignee: Richard Ding
> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
> Key: PIG-1779
> URL: https://issues.apache.org/jira/browse/PIG-1779
> Project: Pig
> Issue Type: Bug
> Components: tools
> Affects Versions: 0.8.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script :
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-1779) Worng stats shown when there are
multiple loads but same file names
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1779:
------------------------------
Attachment: PIG-1779.patch
Output of test-patch:
{code}
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
{code}
> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
> Key: PIG-1779
> URL: https://issues.apache.org/jira/browse/PIG-1779
> Project: Pig
> Issue Type: Bug
> Components: tools
> Affects Versions: 0.8.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
> Attachments: PIG-1779.patch
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script :
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira