[jira] [Created] (PIG-3548) Allow pig to load multiple paths specified in a filenames.txt

["Madhavi Nadig (JIRA)" <ji...@apache.org>]

Madhavi Nadig created PIG-3548:
----------------------------------

             Summary: Allow pig to load multiple paths specified in a filenames.txt
                 Key: PIG-3548
                 URL: https://issues.apache.org/jira/browse/PIG-3548
             Project: Pig
          Issue Type: Improvement
            Reporter: Madhavi Nadig


I have a list of paths stored in a filenames.txt. I would like to load them all using a single LOAD command. The paths don't conform to one or more regexes, so they have to specified individually.

So far I've used the -param option with pig to specify them. But it results in an extremely long commandline and I'm afraid I wont be able to scale my script.

shell : pig -param read_paths=<my-long-list-of-paths> something.pig
something.pig : requests = LOAD '$read_paths' USING PigStorage(',');





--
This message was sent by Atlassian JIRA
(v6.1#6144)