You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "shanyu zhao (JIRA)" <ji...@apache.org> on 2016/01/24 05:37:39 UTC

[jira] [Commented] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114196#comment-15114196 ] 

shanyu zhao commented on MAPREDUCE-6454:
----------------------------------------

The patch in this JIRA caused regression. Previously the MR container inherit HADOOP_CLASSPATH from system environment, now it completely replaced it. I think we need to add this line to the end of setClasspath() in MRApps.java:
{code}
    MRApps.addToEnvironment(
        environment,
        hadoopClasspathEnvVar,
        System.getenv(hadoopClasspathEnvVar),
        conf);
{code}

> MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6454
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>             Fix For: 2.7.2, 2.6.2
>
>         Attachments: MAPREDUCE-6454-v2.1.patch, MAPREDUCE-6454-v2.patch, MAPREDUCE-6454-v3.1.patch, MAPREDUCE-6454-v3.patch, MAPREDUCE-6454.patch
>
>
> We already set lib jars on distributed-cache to CLASSPATH. However, in some corner cases (like: MR local mode, Hive Map side local join, etc.), we need these jars on HADOOP_CLASSPATH so hadoop scripts can take it in launching runjar process.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)