You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2009/03/12 09:06:50 UTC
[jira] Created: (HADOOP-5473) Race condition in command-line kill
for a task
Race condition in command-line kill for a task
----------------------------------------------
Key: HADOOP-5473
URL: https://issues.apache.org/jira/browse/HADOOP-5473
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Amareshwari Sriramadasu
Assignee: Amareshwari Sriramadasu
The race condition occurs in following sequence of events:
1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
2. TT reports the task status as SUCCEEDED.
3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
4. Reducers fail fetching the map output.
5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-5473:
--------------------------------------------
Attachment: patch-5473-1.txt
Patch accepts the state as SUCCEEDED and ignores user request to kill, when TT reports task as SUCCEEDED, and there was user request to kill the task.
Patch has been tested for the same.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Attachments: patch-5473-1.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12689450#action_12689450 ]
Hadoop QA commented on HADOOP-5473:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12403601/patch-5473-1.txt
against trunk revision 758518.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/141/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/141/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/141/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/141/console
This message is automatically generated.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt, patch-5473-2.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-5473:
--------------------------------------------
Fix Version/s: 0.19.2
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12688589#action_12688589 ]
Amareshwari Sriramadasu commented on HADOOP-5473:
-------------------------------------------------
bq. 2. TT reports the task status as SUCCEEDED.
When TT reports task as SUCCEEDED, and there was user request to kill the task,
1. we can accept the state as SUCCEEDED. and ignore user request to kill. (remove the request from tasksToKill map and don't send a KillTaskAction).
or
2. Dont accept the state as SUCCEEDED, mark it KILLED and send a KillTaskAction.
Thoughts?
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-5473:
--------------------------------------------
Attachment: patch-5473-2.txt
There is a small window at TT, when KillTaskAction and reportDone are processed together, the state will be SUCCEEDED and still TT cleanups map outputs.
So, taking up option (2) looks like proper solution.
Patch marks the task KILLED, if TT reports task as SUCCEEDED, but there was user request to kill the task.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt, patch-5473-2.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695437#action_12695437 ]
Hudson commented on HADOOP-5473:
--------------------------------
Integrated in Hadoop-trunk #796 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/796/])
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.20.0
>
> Attachments: patch-5473-1.txt, patch-5473-2.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-5473:
--------------------------------------------
Status: Patch Available (was: Open)
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Attachments: patch-5473-1.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-5473:
--------------------------------------------
Status: Patch Available (was: Open)
test-patch result:
{noformat}
[exec]
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
[exec] Please justify why no tests are needed for this patch.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
{noformat}
The patch has been tested for the issue.
All unit tests passed on my machine.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt, patch-5473-2.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-5473:
--------------------------------
Resolution: Fixed
Fix Version/s: (was: 0.19.2)
0.20.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Amareshwari!
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.20.0
>
> Attachments: patch-5473-1.txt, patch-5473-2.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12689369#action_12689369 ]
Jothi Padmanabhan commented on HADOOP-5473:
-------------------------------------------
+1
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12689363#action_12689363 ]
Amareshwari Sriramadasu commented on HADOOP-5473:
-------------------------------------------------
test-patch result :
{noformat}
[exec]
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
[exec] Please justify why no tests are needed for this patch.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
{noformat}
All unit tests passed on my machine.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693706#action_12693706 ]
Amareshwari Sriramadasu commented on HADOOP-5473:
-------------------------------------------------
Contrib-test failure is not related to the patch.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt, patch-5473-2.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12689883#action_12689883 ]
Hadoop QA commented on HADOOP-5473:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12403701/patch-5473-2.txt
against trunk revision 759030.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/148/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/148/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/148/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-vesta.apache.org/148/console
This message is automatically generated.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt, patch-5473-2.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5473) Race condition in command-line kill
for a task
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jothi Padmanabhan updated HADOOP-5473:
--------------------------------------
Status: Open (was: Patch Available)
Actually, the patch does not solve a synchronization problem at the TT . Cancelling patch till Amareshwari comes up with a new one.
> Race condition in command-line kill for a task
> ----------------------------------------------
>
> Key: HADOOP-5473
> URL: https://issues.apache.org/jira/browse/HADOOP-5473
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.2
>
> Attachments: patch-5473-1.txt
>
>
> The race condition occurs in following sequence of events:
> 1. User issues a command-line kill for a RUNNING map-task. JT stores the task in tasksToKill mapping.
> 2. TT reports the task status as SUCCEEDED.
> 3. JT creates a TaskCompletionEvent as SUCCEEDED. Also sends a killTaskAction.
> 4. Reducers fail fetching the map output.
> 5. finally, the task would fail with Fetch failures. After HADOOP-4759, the task is left as FAILED_UNCLEAN task, since the task is present in tasksToKill mapping.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.