You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Russell Jurney (JIRA)" <ji...@apache.org> on 2010/07/12 23:44:49 UTC

[jira] Created: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Add -q command line option to set queue name for Pig jobs from command line
---------------------------------------------------------------------------

                 Key: PIG-1495
                 URL: https://issues.apache.org/jira/browse/PIG-1495
             Project: Pig
          Issue Type: New Feature
          Components: impl
    Affects Versions: 0.7.0
            Reporter: Russell Jurney
             Fix For: 0.8.0


rjurney$ pig -q default

This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  

Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888279#action_12888279 ] 

Hadoop QA commented on PIG-1495:
--------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12449293/set_queue.patch
  against trunk revision 963830.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no tests are needed for this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/368/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/368/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/368/console

This message is automatically generated.

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Russell Jurney (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Russell Jurney updated PIG-1495:
--------------------------------

    Attachment: set_queue.patch

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Russell Jurney (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Russell Jurney updated PIG-1495:
--------------------------------

    Status: Open  (was: Patch Available)

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Russell Jurney (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887585#action_12887585 ] 

Russell Jurney commented on PIG-1495:
-------------------------------------

This doesn't work yet.  Doh!

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887851#action_12887851 ] 

Richard Ding commented on PIG-1495:
-----------------------------------


Pig trunk now utilizes Hadoop GenericOptionsParser which supports generic options:

{code}
-conf <configuration file>     specify a configuration file
-D <property=value>            use value for given property
-fs <local|namenode:port>      specify a namenode
-jt <local|jobtracker:port>    specify a job tracker
-files <comma separated list of files>    specify comma separated
                            files to be copied to the map reduce cluster
-libjars <comma separated list of jars>   specify comma separated
                            jar files to include in the classpath.
-archives <comma separated list of archives>    specify comma
             separated archives to be unarchived on the compute machines.
{code}

So you can use option -Dmapred.job.queue.name=<queue name>.

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Russell Jurney (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Russell Jurney updated PIG-1495:
--------------------------------

    Status: Patch Available  (was: Open)

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich resolved PIG-1495.
---------------------------------

    Resolution: Fixed

closing since we did not see any objections to the approach. Please, reopen if further discussion is needed

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888452#action_12888452 ] 

Olga Natkovich commented on PIG-1495:
-------------------------------------

Russel, are you ok with proposal from Richard? Can we close this?

> Add -q command line option to set queue name for Pig jobs from command line
> ---------------------------------------------------------------------------
>
>                 Key: PIG-1495
>                 URL: https://issues.apache.org/jira/browse/PIG-1495
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Russell Jurney
>             Fix For: 0.8.0
>
>         Attachments: set_queue.patch
>
>
> rjurney$ pig -q default
> This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.  
> Patch attached.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.