You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Johnny Zhang (JIRA)" <ji...@apache.org> on 2013/03/01 02:22:11 UTC

[jira] [Commented] (PIG-3223) AvroStorage does not handle comma separated input paths

    [ https://issues.apache.org/jira/browse/PIG-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13590143#comment-13590143 ] 

Johnny Zhang commented on PIG-3223:
-----------------------------------

[~mkramer], I am willing to continue working on this item. Seems very interesting. Do you mind post your current patch?
                
> AvroStorage does not handle comma separated input paths
> -------------------------------------------------------
>
>                 Key: PIG-3223
>                 URL: https://issues.apache.org/jira/browse/PIG-3223
>             Project: Pig
>          Issue Type: Bug
>          Components: piggybank
>    Affects Versions: 0.10.0, 0.11
>            Reporter: Michael Kramer
>
> In pig 0.11, a patch was issued to AvroStorage to support globs and comma separated input paths (PIG-2492).  While this function works fine for glob-formatted input paths, it fails when issued a standard comma separated list of paths.  fs.globStatus does not seem to be able to parse out such a list, and a java.net.URISyntaxException is thrown when toURI is called on the path.  
> I have a working fix for this, but it's extremely ugly (basically checking if the string of input paths is globbed, otherwise splitting on ",").  I'm sure there's a more elegant solution.  I'd be happy to post the relevant methods and "fixes" if necessary.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira