You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Devaraj K (JIRA)" <ji...@apache.org> on 2011/02/08 16:04:57 UTC
[jira] Created: (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
If we stop Job Tracker, Task Tracker is also getting stopped.
-------------------------------------------------------------
Key: MAPREDUCE-2310
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: tasktracker
Affects Versions: 0.20.2
Reporter: Devaraj K
Priority: Minor
If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-2310:
---------------------------------
Attachment: MAPREDUCE-2310.patch
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Priority: Minor
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13096860#comment-13096860 ]
Harsh J commented on MAPREDUCE-2310:
------------------------------------
s/look/loop
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-2310:
---------------------------------
Fix Version/s: 0.20.4
Status: Patch Available (was: Open)
When we start job tracker and task tracker using start-mapred.sh, sometimes job tracker is still in initialization and task tracker is stopping because the job tracker is not available by that time.
Provided retry mechanism for task tracker to connect to job tracker when job tracker is in initialization state.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Fix For: 0.20.4
>
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Devaraj K (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K resolved MAPREDUCE-2310.
----------------------------------
Resolution: Won't Fix
It is not a problem in active versions.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K reassigned MAPREDUCE-2310:
------------------------------------
Assignee: Devaraj K
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Harsh J Chouraria (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992653#comment-12992653 ]
Harsh J Chouraria commented on MAPREDUCE-2310:
----------------------------------------------
None in CDH2/3 either, nor in Yahoo's one at GitHub.
There's a stop-jobhistoryserver.sh available in 0.20.100, however. Is that probably it?
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Priority: Minor
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-2310:
-------------------------------------
Status: Open (was: Patch Available)
Sorry to come in late, the patch has gone stale. Can you please rebase? Thanks.
Given this is not an issue with MRv2 should we still commit this? I'm happy to, but not sure it's useful. Thanks.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992869#comment-12992869 ]
Devaraj K commented on MAPREDUCE-2310:
--------------------------------------
I am sorry. stop-jobtracker.sh was written by us. I have mistakenly assumed that it is from hadoop release.
stop-jobtracker.sh contains this,
{code:xml}
bin=`dirname "$0"`
bin=`cd "$bin"; pwd`
. "$bin"/hadoop-config.sh
"$bin"/hadoop-daemon.sh --config $HADOOP_CONF_DIR stop jobtracker
{code}
If I try to stop job tacker using the above script, task tracker is also stopping.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Priority: Minor
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Harsh J Chouraria (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992634#comment-12992634 ]
Harsh J Chouraria commented on MAPREDUCE-2310:
----------------------------------------------
Do we really have a stop-jobtracker.sh in 0.20? I couldn't see one in the 0.20 branch under common nor in Y!'s 0.20.100; which release has it?
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Priority: Minor
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Harsh J (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13096859#comment-13096859 ]
Harsh J commented on MAPREDUCE-2310:
------------------------------------
Hm, experimented a bit more here and I believe you should update the JIRA summaries and description to illustrate the problem better.
The said problem of the TT crashing out _only_ occurs when the JobTracker has not completely initialized and added in the specific TT node before its taken down. If the TT faced proper initialization before the JT went down, you won't see this.
Patch is OK to me, since waitForProxy anyway waits internally (while the look implemented doesn't seem to sleep). However, this would be fixing a very rare case where a JT is taken down immediately for some reason, and not in case of general restarts. I suppose it is okay to have the uninited TTs running anyway, like zombies awaiting their master… :)
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036250#comment-13036250 ]
Hadoop QA commented on MAPREDUCE-2310:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12479776/MAPREDUCE-2310.patch
against trunk revision 1124553.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/276//console
This message is automatically generated.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Fix For: 0.20.4
>
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992643#comment-12992643 ]
Allen Wittenauer commented on MAPREDUCE-2310:
---------------------------------------------
The Apache 0.20 release does not have stop-jobtracker. This is likely a Y! 0.20 or CDH 0.20 special.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Priority: Minor
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12992873#comment-12992873 ]
Allen Wittenauer commented on MAPREDUCE-2310:
---------------------------------------------
Argh! Another raw $0. I swear I'm going to start -1'ing any new code that has them. We clearly need to add unit tests that undef's $HADOOP_HOME and calls all shell scripts from a raw path so that they will fail.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Priority: Minor
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2310) If we stop Job Tracker, Task
Tracker is also getting stopped.
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036254#comment-13036254 ]
Devaraj K commented on MAPREDUCE-2310:
--------------------------------------
Patch is provided for 0.20 version.
> If we stop Job Tracker, Task Tracker is also getting stopped.
> -------------------------------------------------------------
>
> Key: MAPREDUCE-2310
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2310
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.2
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Minor
> Fix For: 0.20.4
>
> Attachments: MAPREDUCE-2310.patch
>
>
> If we execute stop-jobtracker.sh for stopping Job Tracker, Task Tracker is also stopping.
> This is not applicable for the latest (trunk) code because stop-jobtracker.sh file is not coming.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira