[jira] [Created] (MAPREDUCE-7152) LD_LIBRARY_PATH is always passed from MR AM to tasks

["Peter Bacsko (JIRA)" <ji...@apache.org>]

Peter Bacsko created MAPREDUCE-7152:
---------------------------------------

             Summary: LD_LIBRARY_PATH is always passed from MR AM to tasks
                 Key: MAPREDUCE-7152
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7152
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Peter Bacsko
            Assignee: Peter Bacsko


{{LD_LIBRARY_PATH}} is set to {{$HADOOP_COMMON_HOME/lib/native}} by default in Hadoop (as part of {{mapreduce.admin.user.env}} and {{yarn.app.mapreduce.am.user.env}}), and passed as an environment variable from AM container to task containers in the container launch context.

In cases where {{HADOOP_COMMON_HOME}} is different in AM node and task node, tasks will fail to load native library. A reliable way to fix this is to add {{LD_LIBRARY_PATH}} in {{yarn.nodemanager.admin-env}} instead.

Another approach is to perform a lazy evaluation of {{LD_LIBRARY_PATH}} on the NM side.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org