You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Shuaishuai Nie (JIRA)" <ji...@apache.org> on 2013/08/13 06:02:47 UTC

[jira] [Commented] (HIVE-5072) Enable directly invoke Sqoop job through Templeton

    [ https://issues.apache.org/jira/browse/HIVE-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737780#comment-13737780 ] 

Shuaishuai Nie commented on HIVE-5072:
--------------------------------------

The patch attached implements SqoopDelegator which enable user to invoke a Sqoop job through Templeton by using curl commands like following:
{code}
example1: (passing Sqoop command directly)
curl -s -d user.name=hadoop -d command="import --connect jdbc:sqlserver://localhost:4033;databaseName=SqoopDB;user=hadoop;password=password --table mytable --target-dir user/hadoop/importtable" -d statusdir="sqoop.output" 'http://localhost:50111/templeton/v1/sqoop'

example2: (passing source file which contains sqoop command)
curl -s -d user.name=hadoop -d file="/sqoopcommand/command0.txt"  -d statusdir="sqoop.output" 'http://localhost:50111/templeton/v1/sqoop'

example3: (using --options-file in the middle of sqoop command to enable reuse part of Sqoop command like connection string)
curl -s -d user.name=hadoop -d files="/sqoopcommand/command1.txt,/sqoopcommand/command2.txt" -d command="import --options-file command1.txt --options-file command2.txt" -d statusdir="sqoop.output" 'http://localhost:50111/templeton/v1/sqoop'
{code}

                
> Enable directly invoke Sqoop job through Templeton
> --------------------------------------------------
>
>                 Key: HIVE-5072
>                 URL: https://issues.apache.org/jira/browse/HIVE-5072
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Shuaishuai Nie
>         Attachments: HIVE-5072.1.patch, Templeton-Sqoop-Action.pdf
>
>
> Now it is hard to invoke a Sqoop job through templeton. The only way is to use the classpath jar generated by a sqoop job and use the jar delegator in Templeton. We should implement Sqoop Delegator to enable directly invoke Sqoop job through Templeton.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira