You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Raghavendra Prabhu <rr...@gmail.com> on 2006/04/05 15:01:59 UTC
HADOOP--116 doubt
Hi Doug
But Does not it wait in a loop until the job is complete?
It seemed that files are getting created when a job is submitted by the
client
Am i missing something here?
What i saw was theat
JobClient does a submitJob which creates the /tmp/mapred/hadoop/system files
Then it waits for it to complete in the while loop (!running.isComplete())
and at the end of it i delete the files.(the above /tmp/mapred/hadoop/system
files
Is there anything else which uses the above files even after the above run
is complete???
Maybe i am not familiar with the architecture (as per my previous mail)
Rgds
Prabhu
Re: HADOOP--116 doubt
Posted by Doug Cutting <cu...@apache.org>.
Raghavendra Prabhu wrote:
> But Does not it wait in a loop until the job is complete?
Yes, but if one types Control-C, or the submitting workstation is
rebooted, etc., then the job continues to run. So the cleanup is best
done when the job completes rather than when the submitter exits.
Usually those are the same time, but not always.
Doug