You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Miles Osborne <mi...@inf.ed.ac.uk> on 2008/06/11 00:16:43 UTC
Streaming --counters question
Is there support for counters in streaming? In particular, it would be nice
to be able to access these after a job has run.
Thanks!
Miles
--
The University of Edinburgh is a charitable body, registered in Scotland,
with registration number SC005336.
Re: Streaming --counters question
Posted by Billy Pearson <sa...@pearsonwholesale.com>.
Streaming works on stdin and stdout so unless there was a way to capture the
stdout as a counter I do not see any other way to report the to the
jobtracker. Unless there was a url the task could call on the jobtracker to
update counters.
Billy
"Miles Osborne" <mi...@inf.ed.ac.uk> wrote in
message news:73e5a5310806101516h5315eeadwdf90d59e315fc559@mail.gmail.com...
> Is there support for counters in streaming? In particular, it would be
> nice
> to be able to access these after a job has run.
>
> Thanks!
>
> Miles
>
>
> --
> The University of Edinburgh is a charitable body, registered in Scotland,
> with registration number SC005336.
>
Re: Streaming --counters question
Posted by Miles Osborne <mi...@inf.ed.ac.uk>.
great! looking forwards to 0.18
Miles
2008/6/11 Arun C Murthy <ar...@yahoo-inc.com>:
>
> On Jun 10, 2008, at 3:16 PM, Miles Osborne wrote:
>
> Is there support for counters in streaming? In particular, it would be
>> nice
>> to be able to access these after a job has run.
>>
>>
> Yes. Streaming applications can update counters in hadoop-0.18:
> http://issues.apache.org/jira/browse/HADOOP-1328
>
> Arun
>
>
> Thanks!
>>
>> Miles
>>
>>
>> --
>> The University of Edinburgh is a charitable body, registered in Scotland,
>> with registration number SC005336.
>>
>
>
--
The University of Edinburgh is a charitable body, registered in Scotland,
with registration number SC005336.
Re: Streaming --counters question
Posted by Arun C Murthy <ar...@yahoo-inc.com>.
On Jun 10, 2008, at 3:16 PM, Miles Osborne wrote:
> Is there support for counters in streaming? In particular, it
> would be nice
> to be able to access these after a job has run.
>
Yes. Streaming applications can update counters in hadoop-0.18:
http://issues.apache.org/jira/browse/HADOOP-1328
Arun
> Thanks!
>
> Miles
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland,
> with registration number SC005336.