You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by S D <sd...@gmail.com> on 2009/02/05 22:40:14 UTC
Reporter for Hadoop Streaming?
Is there a way to use the Reporter interface (or something similar such as
Counters) with Hadoop streaming? Alternatively, can how could STDOUT be
intercepted for the purpose of updates? If anyone could point me to
documentation or examples that cover this I'd appreciate it.
Thanks,
John
Re: Reporter for Hadoop Streaming?
Posted by Tom White <to...@cloudera.com>.
You can retrieve them from the command line using
bin/hadoop job -counter <job-id> <group-name> <counter-name>
Tom
On Wed, Feb 11, 2009 at 12:20 AM, scruffy323 <st...@gmail.com> wrote:
>
> Do you know how to access those counters programmatically after the job has
> run?
>
>
> S D-5 wrote:
>>
>> This does it. Thanks!
>>
>> On Thu, Feb 5, 2009 at 9:14 PM, Arun C Murthy <ac...@yahoo-inc.com> wrote:
>>
>>>
>>> On Feb 5, 2009, at 1:40 PM, S D wrote:
>>>
>>> Is there a way to use the Reporter interface (or something similar such
>>> as
>>>> Counters) with Hadoop streaming? Alternatively, can how could STDOUT be
>>>> intercepted for the purpose of updates? If anyone could point me to
>>>> documentation or examples that cover this I'd appreciate it.
>>>>
>>>>
>>>
>>> http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+counters+in+streaming+applications%3F
>>>
>>> http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+status+in+streaming+applications%3F
>>>
>>> Arun
>>>
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Reporter-for-Hadoop-Streaming--tp21861786p21945843.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>
Re: Reporter for Hadoop Streaming?
Posted by scruffy323 <st...@gmail.com>.
Do you know how to access those counters programmatically after the job has
run?
S D-5 wrote:
>
> This does it. Thanks!
>
> On Thu, Feb 5, 2009 at 9:14 PM, Arun C Murthy <ac...@yahoo-inc.com> wrote:
>
>>
>> On Feb 5, 2009, at 1:40 PM, S D wrote:
>>
>> Is there a way to use the Reporter interface (or something similar such
>> as
>>> Counters) with Hadoop streaming? Alternatively, can how could STDOUT be
>>> intercepted for the purpose of updates? If anyone could point me to
>>> documentation or examples that cover this I'd appreciate it.
>>>
>>>
>>
>> http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+counters+in+streaming+applications%3F
>>
>> http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+status+in+streaming+applications%3F
>>
>> Arun
>>
>
>
--
View this message in context: http://www.nabble.com/Reporter-for-Hadoop-Streaming--tp21861786p21945843.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
Re: Reporter for Hadoop Streaming?
Posted by S D <sd...@gmail.com>.
This does it. Thanks!
On Thu, Feb 5, 2009 at 9:14 PM, Arun C Murthy <ac...@yahoo-inc.com> wrote:
>
> On Feb 5, 2009, at 1:40 PM, S D wrote:
>
> Is there a way to use the Reporter interface (or something similar such as
>> Counters) with Hadoop streaming? Alternatively, can how could STDOUT be
>> intercepted for the purpose of updates? If anyone could point me to
>> documentation or examples that cover this I'd appreciate it.
>>
>>
>
> http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+counters+in+streaming+applications%3F
>
> http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+status+in+streaming+applications%3F
>
> Arun
>
Re: Reporter for Hadoop Streaming?
Posted by Arun C Murthy <ac...@yahoo-inc.com>.
On Feb 5, 2009, at 1:40 PM, S D wrote:
> Is there a way to use the Reporter interface (or something similar
> such as
> Counters) with Hadoop streaming? Alternatively, can how could STDOUT
> be
> intercepted for the purpose of updates? If anyone could point me to
> documentation or examples that cover this I'd appreciate it.
>
http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+counters+in+streaming+applications%3F
http://hadoop.apache.org/core/docs/current/streaming.html#How+do+I+update+status+in+streaming+applications%3F
Arun