Accessing stderr with Hadoop Streaming

[S D <sd...@gmail.com>]

Is there a way to access stderr when using Hadoop Streaming? I see how
stdout is written to the log files but I'm more concerned about what happens
when errors occur. Access to stderr would help debug when a run doesn't
complete successfully but I haven't been able to figure out how to retrieve
what's written to stderr. Presumably another approach would be to redirect
stderr to stdout but I wanted to exhaust other approaches before trying
that.

Thanks,
SD

Re: Accessing stderr with Hadoop Streaming

[Mayuran Yogarajah <ma...@casalemedia.com>]

S D wrote:
> Is there a way to access stderr when using Hadoop Streaming? I see how
> stdout is written to the log files but I'm more concerned about what happens
> when errors occur. Access to stderr would help debug when a run doesn't
> complete successfully but I haven't been able to figure out how to retrieve
> what's written to stderr. Presumably another approach would be to redirect
> stderr to stdout but I wanted to exhaust other approaches before trying
> that.
>
> Thanks,
> SD
>   
I normally see whats been written to stderr through the web interface.
They're in the 'userlogs' directory in /opt/hadoop/logs. 

M