You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Aaron Baff <Aa...@telescope.tv> on 2010/12/02 20:21:49 UTC

Worker JVM's not terminating quickly with JVM reuse

I've encountered an issue where I have JVM reuse turned on (via setting in the Job configuration, not the JobTracker), and when I submit another job immediately after the first one finishes, it takes several seconds before any Map tasks begin. In looking at an individual Task node, it appears that all of the worker JVM's need to terminate before any new Map tasks from a different Job can be started. I understand that the JVM reuse only applies within a single Job, but is there a setting to have the JobTracker tell the individual TaskTrackers that the Job has finished and so they need to terminate the worker JVM's? Or is there a setting to reduce the time that the worker JVM's hang around before terminating?

--Aaron