You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2014/08/01 17:14:38 UTC

[jira] [Updated] (MAPREDUCE-6021) MR AM should add working directory to LD_LIBRARY_PATH

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Lowe updated MAPREDUCE-6021:
----------------------------------

    Attachment: MAPREDUCE-6021.patch

Patch so YARNRunner adds {{PWD}} to the front of LD_LIBRARY_PATH.  Tested via a unit test in the patch and manually tested by running a job with -Dyarn.app.mapreduce.am.env='LD_DEBUG=libs' and examining the search path logs emitted from the dynamic linker.

> MR AM should add working directory to LD_LIBRARY_PATH
> -----------------------------------------------------
>
>                 Key: MAPREDUCE-6021
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6021
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mr-am
>    Affects Versions: 2.4.1
>            Reporter: Jason Lowe
>         Attachments: MAPREDUCE-6021.patch
>
>
> Tasks implicitly pick up shared libraries added to the job because the task launch context explicitly adds the container working directory to LD_LIBRARY_PATH.  However the same is not done for the AM container which is inconsistent.  User code can run in the AM via output committer, speculator, uber job, etc., so the AM's LD_LIBRARY_PATH should have the container work directory for consistency with tasks.



--
This message was sent by Atlassian JIRA
(v6.2#6252)