[jira] Commented: (PIG-62) Need to add pig script and input dirs (in clear text format) to jobconf

["Benjamin Francisoud (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-62?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562538#action_12562538 ] 

Benjamin Francisoud commented on PIG-62:
----------------------------------------

Adding more details about the patch:

the key/value will look like:
{noformat}
pig.queries =>
    input = LOAD '/my/input/dir/path' USING PigStorage(); 
    words = FOREACH input GENERATE FLATTEN(TOKENIZE(*)); 
    grouped = GROUP words BY $0; 
    counts = FOREACH grouped GENERATE group, COUNT(words);
{noformat}

so the input dir is available...

> Need to add pig script and input dirs (in clear text format) to jobconf
> -----------------------------------------------------------------------
>
>                 Key: PIG-62
>                 URL: https://issues.apache.org/jira/browse/PIG-62
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Runping Qi
>         Attachments: PIG-62-v01.patch
>
>
> We'd like to know what pig query each pig related map/reduce job is for, and what input dir the pig job use.
> It will be nice to add pig script and input dirs (in clear text format) to the jobconfs of the jobs created for a pig script.
> .

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.