You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Tom Melendez (JIRA)" <ji...@apache.org> on 2011/05/12 00:03:47 UTC

[jira] [Created] (MAPREDUCE-2485) reinitialize CLASSPATH variable when executing Mapper/Reducer code

reinitialize CLASSPATH variable when executing Mapper/Reducer code
------------------------------------------------------------------

                 Key: MAPREDUCE-2485
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2485
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: pipes
    Affects Versions: 0.20.2
         Environment: Ubuntu 10.04 LTS
            Reporter: Tom Melendez


We're using pipes, and using libhdfs inside our mapper and reducer code.  We've determined that we need to execute a putenv call in order for libhdfs to actually have access to the CLASSPATH.  Ideally, it should just use the CLASSPATH we set when the job was executed.

For some more context, see these threads:
https://groups.google.com/a/cloudera.org/group/cdh-user/browse_thread/thread/ae9808d80fb132fb?tvc=2
http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/25830



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAPREDUCE-2485) reinitialize CLASSPATH variable when executing Mapper/Reducer code

Posted by "Tom Melendez (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom Melendez resolved MAPREDUCE-2485.
-------------------------------------

    Resolution: Invalid

False alarm, works OK.

> reinitialize CLASSPATH variable when executing Mapper/Reducer code
> ------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2485
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2485
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: pipes
>    Affects Versions: 0.20.2
>         Environment: Ubuntu 10.04 LTS
>            Reporter: Tom Melendez
>
> We're using pipes, and using libhdfs inside our mapper and reducer code.  We've determined that we need to execute a putenv call in order for libhdfs to actually have access to the CLASSPATH.  Ideally, it should just use the CLASSPATH we set when the job was executed.
> For some more context, see these threads:
> https://groups.google.com/a/cloudera.org/group/cdh-user/browse_thread/thread/ae9808d80fb132fb?tvc=2
> http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/25830

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira