You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org> on 2008/09/06 01:46:44 UTC
[jira] Created: (HADOOP-4097) Hive interaction with speculative
execution is broken
Hive interaction with speculative execution is broken
-----------------------------------------------------
Key: HADOOP-4097
URL: https://issues.apache.org/jira/browse/HADOOP-4097
Project: Hadoop Core
Issue Type: Bug
Components: contrib/hive
Reporter: Joydeep Sen Sarma
Assignee: Joydeep Sen Sarma
Priority: Critical
Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12629104#action_12629104 ]
Hadoop QA commented on HADOOP-4097:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12389657/hadoop-4097.1.patch
against trunk revision 692996.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3204/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3204/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3204/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3204/console
This message is automatically generated.
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hadoop-4097.1.patch
>
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12629356#action_12629356 ]
Zheng Shao commented on HADOOP-4097:
------------------------------------
+1
Looks good. Changes only affect src/contrib/hive.
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hadoop-4097.1.patch
>
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HADOOP-4097:
--------------------------------------
Attachment: hadoop-4097.1.patch
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hadoop-4097.1.patch
>
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HADOOP-4097:
--------------------------------------
Status: Open (was: Patch Available)
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HADOOP-4097:
--------------------------------------
Status: Patch Available (was: Open)
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hadoop-4097.1.patch
>
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-4097:
-------------------------------------
Resolution: Fixed
Fix Version/s: 0.19.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks Joydeep!
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Fix For: 0.19.0
>
> Attachments: hadoop-4097.1.patch
>
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12630185#action_12630185 ]
Hudson commented on HADOOP-4097:
--------------------------------
Integrated in Hadoop-trunk #600 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/600/])
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Fix For: 0.19.0
>
> Attachments: hadoop-4097.1.patch
>
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4097) Hive interaction with speculative
execution is broken
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HADOOP-4097:
--------------------------------------
Status: Patch Available (was: Open)
> Hive interaction with speculative execution is broken
> -----------------------------------------------------
>
> Key: HADOOP-4097
> URL: https://issues.apache.org/jira/browse/HADOOP-4097
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hive
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
>
> Hive does not cleanup output files when tasks are killed. With speculative execution, partial result files may get left behind. The commit step of the results should detect and remove any partial output files.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.