You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Sean Mackrory (JIRA)" <ji...@apache.org> on 2012/12/19 18:03:12 UTC
[jira] [Comment Edited] (SQOOP-796) Unable to use new Hadoop
environment variables
[ https://issues.apache.org/jira/browse/SQOOP-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536127#comment-13536127 ]
Sean Mackrory edited comment on SQOOP-796 at 12/19/12 5:01 PM:
---------------------------------------------------------------
This patch includes changes to the shell scripts which detect the environment variables or set defaults, the documentation (I've chosen to simply replace HADOOP_HOME with the 2 new variables since it's deprecated, even though it should still work), and the Java code. It allows Sqoop to use HADOOP_COMMON_HOME (for the hadoop executable) and HADOOP_MAPRED_HOME (for the hadoop-core library) if they are available, but it can still use HADOOP_HOME for both if necessary.
edit: I still need to do a bit more testing on this - I had some trouble on YARN but it appears to be a problem with my cluster, not Sqoop. Will update when I'm sure...
was (Author: mackrorysd):
This patch includes changes to the shell scripts which detect the environment variables or set defaults, the documentation (I've chosen to simply replace HADOOP_HOME with the 2 new variables since it's deprecated, even though it should still work), and the Java code. It allows Sqoop to use HADOOP_COMMON_HOME (for the hadoop executable) and HADOOP_MAPRED_HOME (for the hadoop-core library) if they are available, but it can still use HADOOP_HOME for both if necessary.
> Unable to use new Hadoop environment variables
> ----------------------------------------------
>
> Key: SQOOP-796
> URL: https://issues.apache.org/jira/browse/SQOOP-796
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.2
> Reporter: Sean Mackrory
> Assignee: Sean Mackrory
> Attachments: SQOOP-796.patch.1
>
>
> Sqoop uses HADOOP_HOME to locate its dependencies, but if using YARN, then the use of HADOOP_HOME has been deprecated and may not sufficient to locate all of the dependencies. Sqoop needs to be able to use HADOOP_COMMON_HOME and HADOOP_MAPRED_HOME when they are used instead of HADOOP_HOME.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira