You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2012/10/23 04:34:12 UTC

[jira] [Created] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Jarek Jarcec Cecho created SQOOP-650:
----------------------------------------

             Summary: Add ability to name mapreduce job generated by Sqoop
                 Key: SQOOP-650
                 URL: https://issues.apache.org/jira/browse/SQOOP-650
             Project: Sqoop
          Issue Type: Improvement
    Affects Versions: 1.4.2
            Reporter: Jarek Jarcec Cecho
            Assignee: Jarek Jarcec Cecho
            Priority: Minor
             Fix For: 1.4.3


Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.

Please note that thi-s can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489879#comment-13489879 ] 

Jarek Jarcec Cecho commented on SQOOP-650:
------------------------------------------

Pingning active committers - would it be possible to review my patch?
                
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>         Attachments: SQOOP-650.patch
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Jarcec Cecho updated SQOOP-650:
-------------------------------------

    Attachment: bugSQOOP-650.patch
    
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>         Attachments: bugSQOOP-650.patch, SQOOP-650.patch
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492056#comment-13492056 ] 

Hudson commented on SQOOP-650:
------------------------------

Integrated in Sqoop-ant-jdk-1.6-hadoop23 #426 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/426/])
    SQOOP-650 Add ability to name mapreduce job generated by Sqoop (Revision ebeb93351335cc73d6d77ef1fd0d7316655defa3)

     Result = SUCCESS
cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ebeb93351335cc73d6d77ef1fd0d7316655defa3
Files : 
* src/java/org/apache/sqoop/tool/BaseSqoopTool.java
* src/java/org/apache/sqoop/mapreduce/ImportJobBase.java
* src/java/org/apache/sqoop/SqoopOptions.java
* src/java/org/apache/sqoop/tool/ExportTool.java
* src/java/org/apache/sqoop/tool/ImportTool.java
* src/java/org/apache/sqoop/mapreduce/ExportJobBase.java

                
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>         Attachments: bugSQOOP-650.patch, SQOOP-650.patch
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492055#comment-13492055 ] 

Hudson commented on SQOOP-650:
------------------------------

Integrated in Sqoop-ant-jdk-1.6-hadoop200 #279 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/279/])
    SQOOP-650 Add ability to name mapreduce job generated by Sqoop (Revision ebeb93351335cc73d6d77ef1fd0d7316655defa3)

     Result = SUCCESS
cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ebeb93351335cc73d6d77ef1fd0d7316655defa3
Files : 
* src/java/org/apache/sqoop/mapreduce/ImportJobBase.java
* src/java/org/apache/sqoop/tool/ExportTool.java
* src/java/org/apache/sqoop/tool/ImportTool.java
* src/java/org/apache/sqoop/SqoopOptions.java
* src/java/org/apache/sqoop/tool/BaseSqoopTool.java
* src/java/org/apache/sqoop/mapreduce/ExportJobBase.java

                
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>         Attachments: bugSQOOP-650.patch, SQOOP-650.patch
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Jarcec Cecho updated SQOOP-650:
-------------------------------------

    Attachment: SQOOP-650.patch
    
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>         Attachments: SQOOP-650.patch
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492052#comment-13492052 ] 

Hudson commented on SQOOP-650:
------------------------------

Integrated in Sqoop-ant-jdk-1.6-hadoop20 #273 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/273/])
    SQOOP-650 Add ability to name mapreduce job generated by Sqoop (Revision ebeb93351335cc73d6d77ef1fd0d7316655defa3)

     Result = SUCCESS
cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ebeb93351335cc73d6d77ef1fd0d7316655defa3
Files : 
* src/java/org/apache/sqoop/mapreduce/ImportJobBase.java
* src/java/org/apache/sqoop/mapreduce/ExportJobBase.java
* src/java/org/apache/sqoop/tool/ImportTool.java
* src/java/org/apache/sqoop/tool/BaseSqoopTool.java
* src/java/org/apache/sqoop/SqoopOptions.java
* src/java/org/apache/sqoop/tool/ExportTool.java

                
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>         Attachments: bugSQOOP-650.patch, SQOOP-650.patch
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Jarcec Cecho updated SQOOP-650:
-------------------------------------

    Description: 
Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.

Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

  was:
Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.

Please note that thi-s can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

    
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (SQOOP-650) Add ability to name mapreduce job generated by Sqoop

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SQOOP-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492051#comment-13492051 ] 

Hudson commented on SQOOP-650:
------------------------------

Integrated in Sqoop-ant-jdk-1.6-hadoop100 #267 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/267/])
    SQOOP-650 Add ability to name mapreduce job generated by Sqoop (Revision ebeb93351335cc73d6d77ef1fd0d7316655defa3)

     Result = SUCCESS
cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ebeb93351335cc73d6d77ef1fd0d7316655defa3
Files : 
* src/java/org/apache/sqoop/mapreduce/ExportJobBase.java
* src/java/org/apache/sqoop/tool/ImportTool.java
* src/java/org/apache/sqoop/SqoopOptions.java
* src/java/org/apache/sqoop/tool/BaseSqoopTool.java
* src/java/org/apache/sqoop/tool/ExportTool.java
* src/java/org/apache/sqoop/mapreduce/ImportJobBase.java

                
> Add ability to name mapreduce job generated by Sqoop
> ----------------------------------------------------
>
>                 Key: SQOOP-650
>                 URL: https://issues.apache.org/jira/browse/SQOOP-650
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>            Priority: Minor
>             Fix For: 1.4.3
>
>         Attachments: bugSQOOP-650.patch, SQOOP-650.patch
>
>
> Names of generated mapreduce job is currently the same as jar name (for example table_name.jar). It would be nice if Sqoop would have command line parameter to override that so that user could modify that arbitrarily.
> Please note that this can be partially achieved even now, by passing Dmapred.job.name. However this approach do not work reliably when executing from Oozie or other tools that are directly executing hadoop jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira