You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Mayuran Yogarajah <ma...@casalemedia.com> on 2009/05/08 22:08:52 UTC

Logging in Hadoop Stream jobs

How do people handle logging in a Hadoop stream job?

I'm currently looking at using syslog for this but would like to know of 
other ways
people are doing this currently.

thanks

Re: Logging in Hadoop Stream jobs

Posted by Billy Pearson <sa...@pearsonwholesale.com>.
When I was looking to capture debugging data about my scripts I would just 
write to stderr stream in php it like
fwrite(STDERR,"message you want here");

then it get captured in the task logs when you view the detail of each task.

Billy


"Mayuran Yogarajah" 
<ma...@casalemedia.com> wrote in message 
news:4A049154.6070704@casalemedia.com...
> How do people handle logging in a Hadoop stream job?
>
> I'm currently looking at using syslog for this but would like to know of 
> other ways
> people are doing this currently.
>
> thanks
>