You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Alan Gates (JIRA)" <ji...@apache.org> on 2008/04/10 23:50:05 UTC

[jira] Created: (PIG-204) Revision 643583 for PIG-94 broke input splits

Revision 643583 for PIG-94 broke input splits
---------------------------------------------

                 Key: PIG-204
                 URL: https://issues.apache.org/jira/browse/PIG-204
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: 0.0.0
            Reporter: Alan Gates
            Assignee: Arun C Murthy


For revisions of the code after 643583, all pig jobs run in 1 map, instead of multiple maps.  The jobs still produce correct results, but they do not run in parallel.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-204) Revision 643583 for PIG-94 broke input splits

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated PIG-204:
------------------------------

    Status: Patch Available  (was: Open)

Submitting patch for review, passes all unit-tests locally.

> Revision 643583 for PIG-94 broke input splits
> ---------------------------------------------
>
>                 Key: PIG-204
>                 URL: https://issues.apache.org/jira/browse/PIG-204
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.0.0
>            Reporter: Alan Gates
>            Assignee: Arun C Murthy
>         Attachments: PIG-204_0_20080410.patch, PIG-204_1_20080411.patch
>
>
> For revisions of the code after 643583, all pig jobs run in 1 map, instead of multiple maps.  The jobs still produce correct results, but they do not run in parallel.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-204) Revision 643583 for PIG-94 broke input splits

Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alan Gates updated PIG-204:
---------------------------

       Resolution: Fixed
    Fix Version/s: 0.1.0
           Status: Resolved  (was: Patch Available)

Fix checked in at revision 647356.  Thanks Arun for your quick response.

> Revision 643583 for PIG-94 broke input splits
> ---------------------------------------------
>
>                 Key: PIG-204
>                 URL: https://issues.apache.org/jira/browse/PIG-204
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.0.0
>            Reporter: Alan Gates
>            Assignee: Arun C Murthy
>             Fix For: 0.1.0
>
>         Attachments: PIG-204_0_20080410.patch, PIG-204_1_20080411.patch
>
>
> For revisions of the code after 643583, all pig jobs run in 1 map, instead of multiple maps.  The jobs still produce correct results, but they do not run in parallel.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-204) Revision 643583 for PIG-94 broke input splits

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated PIG-204:
------------------------------

    Attachment: PIG-204_0_20080410.patch

Fix to PigInputFormat...

> Revision 643583 for PIG-94 broke input splits
> ---------------------------------------------
>
>                 Key: PIG-204
>                 URL: https://issues.apache.org/jira/browse/PIG-204
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.0.0
>            Reporter: Alan Gates
>            Assignee: Arun C Murthy
>         Attachments: PIG-204_0_20080410.patch
>
>
> For revisions of the code after 643583, all pig jobs run in 1 map, instead of multiple maps.  The jobs still produce correct results, but they do not run in parallel.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-204) Revision 643583 for PIG-94 broke input splits

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated PIG-204:
------------------------------

    Attachment: PIG-204_1_20080411.patch

Updated patch, I had to fix {{MapreducePlanCompile.connectInputs}} to correctly propagate the properties, also fixed {{EvalSpec.copy}} to do the same. Finally {{PigInputFormat.getSplits}} now uses the correct default value for {{pig.input.splittable}}.

> Revision 643583 for PIG-94 broke input splits
> ---------------------------------------------
>
>                 Key: PIG-204
>                 URL: https://issues.apache.org/jira/browse/PIG-204
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.0.0
>            Reporter: Alan Gates
>            Assignee: Arun C Murthy
>         Attachments: PIG-204_0_20080410.patch, PIG-204_1_20080411.patch
>
>
> For revisions of the code after 643583, all pig jobs run in 1 map, instead of multiple maps.  The jobs still produce correct results, but they do not run in parallel.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.