You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2006/09/23 01:06:22 UTC

[jira] Created: (HADOOP-555) Tasks should inherit some of the server's environment

Tasks should inherit some of the server's environment
-----------------------------------------------------

                 Key: HADOOP-555
                 URL: http://issues.apache.org/jira/browse/HADOOP-555
             Project: Hadoop
          Issue Type: Improvement
            Reporter: Owen O'Malley


When the task trackers start up the Task process, they clear the environment variables. It would be better if there was a SERVER config that listed the names of the environment variables that would be copied from the server's enviroment.

So the task tracker's config would have:

<property><name>mapred.task.environment</name>
<value>PATH,LD_LIBRARY_PATH</value></property>

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Resolved: (HADOOP-555) Tasks should inherit some of the server's environment

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-555?page=all ]

Owen O'Malley resolved HADOOP-555.
----------------------------------

    Resolution: Cannot Reproduce

It seems to work fine. I'm not sure why my test program didn't work right.

> Tasks should inherit some of the server's environment
> -----------------------------------------------------
>
>                 Key: HADOOP-555
>                 URL: http://issues.apache.org/jira/browse/HADOOP-555
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Owen O'Malley
>
> When the task trackers start up the Task process, they clear the environment variables. It would be better if there was a SERVER config that listed the names of the environment variables that would be copied from the server's enviroment.
> So the task tracker's config would have:
> <property><name>mapred.task.environment</name>
> <value>PATH,LD_LIBRARY_PATH</value></property>

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-555) Tasks should inherit some of the server's environment

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/HADOOP-555?page=comments#action_12437685 ] 
            
Doug Cutting commented on HADOOP-555:
-------------------------------------

I'm confused.  Don't child processes inherit their parent's environment?  They should.

You should be able to set LD_LIBRARY_PATH, PATH, etc. in conf/hadoo-env.sh and these should be seen by the child.  If that doesn't work, I think it's a bug that should be fixed.  If it does work, is it sufficient?

> Tasks should inherit some of the server's environment
> -----------------------------------------------------
>
>                 Key: HADOOP-555
>                 URL: http://issues.apache.org/jira/browse/HADOOP-555
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>
> When the task trackers start up the Task process, they clear the environment variables. It would be better if there was a SERVER config that listed the names of the environment variables that would be copied from the server's enviroment.
> So the task tracker's config would have:
> <property><name>mapred.task.environment</name>
> <value>PATH,LD_LIBRARY_PATH</value></property>

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-555) Tasks should inherit some of the server's environment

Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-555?page=all ]

Sameer Paranjpye updated HADOOP-555:
------------------------------------

    Component/s: mapred

> Tasks should inherit some of the server's environment
> -----------------------------------------------------
>
>                 Key: HADOOP-555
>                 URL: http://issues.apache.org/jira/browse/HADOOP-555
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Owen O'Malley
>
> When the task trackers start up the Task process, they clear the environment variables. It would be better if there was a SERVER config that listed the names of the environment variables that would be copied from the server's enviroment.
> So the task tracker's config would have:
> <property><name>mapred.task.environment</name>
> <value>PATH,LD_LIBRARY_PATH</value></property>

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-555) Tasks should inherit some of the server's environment

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/HADOOP-555?page=comments#action_12437695 ] 
            
Owen O'Malley commented on HADOOP-555:
--------------------------------------

TaskRunner is currently explicitly clearing the environment for the child. I assumed it was a requirement. *smile* I'm ok with passing the entire down to the child if that is ok with everyone. It certainly makes this bug very easy to fix.

> Tasks should inherit some of the server's environment
> -----------------------------------------------------
>
>                 Key: HADOOP-555
>                 URL: http://issues.apache.org/jira/browse/HADOOP-555
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>
> When the task trackers start up the Task process, they clear the environment variables. It would be better if there was a SERVER config that listed the names of the environment variables that would be copied from the server's enviroment.
> So the task tracker's config would have:
> <property><name>mapred.task.environment</name>
> <value>PATH,LD_LIBRARY_PATH</value></property>

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira