You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Mithun Radhakrishnan (JIRA)" <ji...@apache.org> on 2014/04/29 00:57:17 UTC

[jira] [Commented] (TEZ-1085) Tez job gets "Could not load native gpl library or native-lzo library" error

    [ https://issues.apache.org/jira/browse/TEZ-1085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983703#comment-13983703 ] 

Mithun Radhakrishnan commented on TEZ-1085:
-------------------------------------------

FWIW, +1. Good thing you moved the Pattern.compile() out to a static variable.

Minor typo in comment:
{code} // If the env key is note present leave {code}

> Tez job gets "Could not load native gpl library or native-lzo library" error
> ----------------------------------------------------------------------------
>
>                 Key: TEZ-1085
>                 URL: https://issues.apache.org/jira/browse/TEZ-1085
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.4.0
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>         Attachments: TEZ-1085-1.patch
>
>
> Even when mapreduce.admin.user.env property is set to LD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native and MRHelpers.updateEnvironmentForMRTasks(conf, taskEnv, isMap); is called it does not work if HADOOP_COMMON_HOME is not set on the client. TezYARNUtils.setEnvFromInputString sets an env variable to "" if not found. But HADOOP_COMMON_HOME will be set by the ContainerLaunch.java in YARN as part of YarnConfiguration.DEFAULT_NM_ENV_WHITELIST. So it is not necessary that the clients have HADOOP_COMMON_HOME set. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)