how to set system properties for mapper/reducer?

[Yin Lou <yi...@gmail.com>]

Hi,

Is there any way to pass system properties, like java.library.path to each
mapper/reducer?

Thanks,
Yin

Re: how to set system properties for mapper/reducer?

[Yin Lou <yi...@gmail.com>]

Thanks! I think this is what I'm looking for
http://hadoop.apache.org/common/docs/current/native_libraries.html

Thanks anyway.

Yin

On Thu, Oct 7, 2010 at 8:48 PM, Ted Yu <yu...@gmail.com> wrote:

> If you look at the parameters passed to your mapper/reducer, you should see
> something like this:
>
>
> -Djava.library.path=/opt//hadoop/bin/../lib/native/Linux-amd64-64:/tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201010062322_0002/attempt_201010062322_0002_m_000000_0/work
>
>
> On Thu, Oct 7, 2010 at 5:12 PM, Yin Lou <yi...@gmail.com> wrote:
>
>> I don't understand. I want to pass something like
>> java.library.path="/home/.../libXXX.so" so that every mapper can load that
>> lib and use the native code.
>>
>> Could you give me an example?
>>
>> Thanks!
>>  Yin
>>
>>
>> On Thu, Oct 7, 2010 at 6:05 PM, Ted Yu <yu...@gmail.com> wrote:
>>
>>> Take a look at bin/hadoop:
>>> hadoop:  HADOOP_OPTS="$HADOOP_OPTS
>>> -Djava.library.path=$JAVA_LIBRARY_PATH"
>>>
>>>
>>> On Thu, Oct 7, 2010 at 12:04 PM, Yin Lou <yi...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Is there any way to pass system properties, like java.library.path to
>>>> each mapper/reducer?
>>>>
>>>> Thanks,
>>>> Yin
>>>>
>>>
>>>
>>
>

Re: how to set system properties for mapper/reducer?

[Ted Yu <yu...@gmail.com>]

If you look at the parameters passed to your mapper/reducer, you should see
something like this:

-Djava.library.path=/opt//hadoop/bin/../lib/native/Linux-amd64-64:/tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201010062322_0002/attempt_201010062322_0002_m_000000_0/work

On Thu, Oct 7, 2010 at 5:12 PM, Yin Lou <yi...@gmail.com> wrote:

> I don't understand. I want to pass something like
> java.library.path="/home/.../libXXX.so" so that every mapper can load that
> lib and use the native code.
>
> Could you give me an example?
>
> Thanks!
>  Yin
>
>
> On Thu, Oct 7, 2010 at 6:05 PM, Ted Yu <yu...@gmail.com> wrote:
>
>> Take a look at bin/hadoop:
>> hadoop:  HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$JAVA_LIBRARY_PATH"
>>
>>
>> On Thu, Oct 7, 2010 at 12:04 PM, Yin Lou <yi...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Is there any way to pass system properties, like java.library.path to
>>> each mapper/reducer?
>>>
>>> Thanks,
>>> Yin
>>>
>>
>>
>

Re: how to set system properties for mapper/reducer?

[Yin Lou <yi...@gmail.com>]

I don't understand. I want to pass something like
java.library.path="/home/.../libXXX.so" so that every mapper can load that
lib and use the native code.

Could you give me an example?

Thanks!
Yin

On Thu, Oct 7, 2010 at 6:05 PM, Ted Yu <yu...@gmail.com> wrote:

> Take a look at bin/hadoop:
> hadoop:  HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$JAVA_LIBRARY_PATH"
>
>
> On Thu, Oct 7, 2010 at 12:04 PM, Yin Lou <yi...@gmail.com> wrote:
>
>> Hi,
>>
>> Is there any way to pass system properties, like java.library.path to each
>> mapper/reducer?
>>
>> Thanks,
>> Yin
>>
>
>

Re: how to set system properties for mapper/reducer?

[Ted Yu <yu...@gmail.com>]

Take a look at bin/hadoop:
hadoop:  HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$JAVA_LIBRARY_PATH"

On Thu, Oct 7, 2010 at 12:04 PM, Yin Lou <yi...@gmail.com> wrote:

> Hi,
>
> Is there any way to pass system properties, like java.library.path to each
> mapper/reducer?
>
> Thanks,
> Yin
>