You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Michael Kramer (JIRA)" <ji...@apache.org> on 2013/03/01 22:23:13 UTC

[jira] [Updated] (PIG-3223) AvroStorage does not handle comma separated input paths

     [ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Kramer updated PIG-3223:
--------------------------------

    Attachment: AvroStorageUtils.patch
                AvroStorage.patch
    
> AvroStorage does not handle comma separated input paths
> -------------------------------------------------------
>
>                 Key: PIG-3223
>                 URL: https://issues.apache.org/jira/browse/PIG-3223
>             Project: Pig
>          Issue Type: Bug
>          Components: piggybank
>    Affects Versions: 0.10.0, 0.11
>            Reporter: Michael Kramer
>            Assignee: Johnny Zhang
>         Attachments: AvroStorage.patch, AvroStorageUtils.patch
>
>
> In pig 0.11, a patch was issued to AvroStorage to support globs and comma separated input paths (PIG-2492).  While this function works fine for glob-formatted input paths, it fails when issued a standard comma separated list of paths.  fs.globStatus does not seem to be able to parse out such a list, and a java.net.URISyntaxException is thrown when toURI is called on the path.  
> I have a working fix for this, but it's extremely ugly (basically checking if the string of input paths is globbed, otherwise splitting on ",").  I'm sure there's a more elegant solution.  I'd be happy to post the relevant methods and "fixes" if necessary.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira