You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2009/12/21 22:35:18 UTC

[jira] Created: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

[zebra] Zebra does not support Hadoop Globs
-------------------------------------------

                 Key: PIG-1167
                 URL: https://issues.apache.org/jira/browse/PIG-1167
             Project: Pig
          Issue Type: Improvement
            Reporter: Olga Natkovich
            Assignee: Jay Tang


Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793419#action_12793419 ] 

Yan Zhou commented on PIG-1167:
-------------------------------

Zebra's TableLoader, the implementation of PIG's LoadFunc, does support glob by design. But Map/Reduce interface does not. TableLoader just expands the glob and passes the paths
to Map/Reduce interface so a union of underlying Zebra tables will be loaded. It looks like that not enough test coverage is present in this area.

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Jay Tang
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Zhou updated PIG-1167:
--------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed to both Apache trunk and 6.0 branch.

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Yan Zhou
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: PIG-1167.patch
>
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Zhou updated PIG-1167:
--------------------------

    Status: Patch Available  (was: Open)

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Yan Zhou
>         Attachments: PIG-1167.patch
>
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794541#action_12794541 ] 

Hadoop QA commented on PIG-1167:
--------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12428935/PIG-1167.patch
  against trunk revision 893827.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 11 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/162/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/162/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/162/console

This message is automatically generated.

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Yan Zhou
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: PIG-1167.patch
>
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Zhou updated PIG-1167:
--------------------------

    Attachment: PIG-1167.patch

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Yan Zhou
>         Attachments: PIG-1167.patch
>
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793420#action_12793420 ] 

Olga Natkovich commented on PIG-1167:
-------------------------------------

Just to clarify. Pig does support it for all loaders that use default pig slicer. Zebra, however, uses its own and that's why it is not getting this functionality for free.

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Jay Tang
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Zhou reassigned PIG-1167:
-----------------------------

    Assignee: Yan Zhou  (was: Jay Tang)

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Yan Zhou
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Chao Wang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796259#action_12796259 ] 

Chao Wang commented on PIG-1167:
--------------------------------

Patch looks good +1.

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Yan Zhou
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: PIG-1167.patch
>
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1167) [zebra] Zebra does not support Hadoop Globs

Posted by "Yan Zhou (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Zhou updated PIG-1167:
--------------------------

    Fix Version/s: 0.7.0
                   0.6.0

> [zebra] Zebra does not support Hadoop Globs
> -------------------------------------------
>
>                 Key: PIG-1167
>                 URL: https://issues.apache.org/jira/browse/PIG-1167
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Olga Natkovich
>            Assignee: Yan Zhou
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: PIG-1167.patch
>
>
> Pssing the following path to Zebra causing error but works with Hadoop directly: /projects/FETL/sample/ABF1/{2009120204}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.