You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2015/08/21 03:35:47 UTC

[jira] [Comment Edited] (MAPREDUCE-6454) MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706076#comment-14706076 ] 

Allen Wittenauer edited comment on MAPREDUCE-6454 at 8/21/15 1:35 AM:
----------------------------------------------------------------------

Just so it's on record so when someone hits this problem:  this is fragile and subject to breakage, regardless of the version of hadoop in play.  It all depends upon how users have HADOOP_CLASSPATH configured in hadoop-env.sh and yarn-env.sh.  


was (Author: aw):
Just so it's on record so when someone hits this problem:  this is fragile and subject to breakage.  It all depends upon how users have HADOOP_CLASSPATH configured in hadoop-env.sh and yarn-env.sh.  

> MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6454
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6454
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>             Fix For: 2.7.2, 2.6.2
>
>         Attachments: MAPREDUCE-6454-v2.1.patch, MAPREDUCE-6454-v2.patch, MAPREDUCE-6454-v3.1.patch, MAPREDUCE-6454-v3.patch, MAPREDUCE-6454.patch
>
>
> We already set lib jars on distributed-cache to CLASSPATH. However, in some corner cases (like: MR local mode, Hive Map side local join, etc.), we need these jars on HADOOP_CLASSPATH so hadoop scripts can take it in launching runjar process.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)