You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Michael Kramer (JIRA)" <ji...@apache.org> on 2013/02/28 01:55:16 UTC

[jira] [Created] (PIG-3223) AvroStorage does not handle comma separated input paths

Michael Kramer created PIG-3223:
-----------------------------------

             Summary: AvroStorage does not handle comma separated input paths
                 Key: PIG-3223
                 URL: https://issues.apache.org/jira/browse/PIG-3223
             Project: Pig
          Issue Type: Bug
          Components: piggybank
    Affects Versions: 0.11, 0.10.0
            Reporter: Michael Kramer


In pig 0.11, a patch was issued to AvroStorage to support globs and comma separated input paths (PIG-2492).  While this function works fine for glob-formatted input paths, it fails when issued a standard comma separated list of paths.  fs.globStatus does not seem to be able to parse out such a list, and a java.net.URISyntaxException is thrown when toURI is called on the path.  

I have a working fix for this, but it's extremely ugly (basically checking if the string of input paths is globbed, otherwise splitting on ",").  I'm sure there's a more elegant solution.  I'd be happy to post the relevant methods and "fixes" if necessary.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira