You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Shuaishuai Nie (JIRA)" <ji...@apache.org> on 2013/08/13 06:02:47 UTC
[jira] [Commented] (HIVE-5072) Enable directly invoke Sqoop job
through Templeton
[ https://issues.apache.org/jira/browse/HIVE-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737780#comment-13737780 ]
Shuaishuai Nie commented on HIVE-5072:
--------------------------------------
The patch attached implements SqoopDelegator which enable user to invoke a Sqoop job through Templeton by using curl commands like following:
{code}
example1: (passing Sqoop command directly)
curl -s -d user.name=hadoop -d command="import --connect jdbc:sqlserver://localhost:4033;databaseName=SqoopDB;user=hadoop;password=password --table mytable --target-dir user/hadoop/importtable" -d statusdir="sqoop.output" 'http://localhost:50111/templeton/v1/sqoop'
example2: (passing source file which contains sqoop command)
curl -s -d user.name=hadoop -d file="/sqoopcommand/command0.txt" -d statusdir="sqoop.output" 'http://localhost:50111/templeton/v1/sqoop'
example3: (using --options-file in the middle of sqoop command to enable reuse part of Sqoop command like connection string)
curl -s -d user.name=hadoop -d files="/sqoopcommand/command1.txt,/sqoopcommand/command2.txt" -d command="import --options-file command1.txt --options-file command2.txt" -d statusdir="sqoop.output" 'http://localhost:50111/templeton/v1/sqoop'
{code}
> Enable directly invoke Sqoop job through Templeton
> --------------------------------------------------
>
> Key: HIVE-5072
> URL: https://issues.apache.org/jira/browse/HIVE-5072
> Project: Hive
> Issue Type: Improvement
> Reporter: Shuaishuai Nie
> Attachments: HIVE-5072.1.patch, Templeton-Sqoop-Action.pdf
>
>
> Now it is hard to invoke a Sqoop job through templeton. The only way is to use the classpath jar generated by a sqoop job and use the jar delegator in Templeton. We should implement Sqoop Delegator to enable directly invoke Sqoop job through Templeton.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira