You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Brian Seaman <bs...@truveo.com> on 2009/05/26 22:59:54 UTC
get mapper number in pipes
Hi,
I am trying to figure out if it is possible to extract the number of the
mapper running in the actual mapper of a pipes job. There are
occasionally times when I want to rerun a job but not have certain mappers
emit data depending on what they did the previous time. I can pass in
which mappers to skip in a config file but can't figure out how to find
the number of the mapper currently running.
Any help will be greatly appreciated.
Thanks,
-Brian