You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (Created) (JIRA)" <ji...@apache.org> on 2012/04/06 08:10:33 UTC
[jira] [Created] (HIVE-2929) race condition in DAG execute tasks
for hive
race condition in DAG execute tasks for hive
--------------------------------------------
Key: HIVE-2929
URL: https://issues.apache.org/jira/browse/HIVE-2929
Project: Hive
Issue Type: Bug
Reporter: Namit Jain
select ...
(
SubQuery involving MapReduce
union all
SubQuery involving MapReduce
);
or
select ...
(SubQuery involving MapReduce)
join
(SubQuery involving MapReduce)
;
If both the subQueries finish at nearly the same time, there is a race
condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Namit Jain (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-2929:
-----------------------------
Status: Patch Available (was: Open)
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.2929.1.patch
>
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Namit Jain (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-2929:
-----------------------------
Attachment: hive.2929.1.patch
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.2929.1.patch
>
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Namit Jain (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain reassigned HIVE-2929:
--------------------------------
Assignee: Namit Jain
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.2929.1.patch
>
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Ashutosh Chauhan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-2929:
-----------------------------------
Fix Version/s: 0.10
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Fix For: 0.10
>
> Attachments: hive.2929.1.patch
>
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Namit Jain (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248114#comment-13248114 ]
Namit Jain commented on HIVE-2929:
----------------------------------
https://reviews.facebook.net/differential/diff/8571/
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Siying Dong (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siying Dong updated HIVE-2929:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.2929.1.patch
>
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Siying Dong (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248940#comment-13248940 ]
Siying Dong commented on HIVE-2929:
-----------------------------------
+1
committed. Thanks Namit!
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.2929.1.patch
>
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2929) race condition in DAG execute tasks
for hive
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249219#comment-13249219 ]
Hudson commented on HIVE-2929:
------------------------------
Integrated in Hive-trunk-h0.21 #1360 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1360/])
HIVE-2929 race condition in DAG execute tasks for hive (Namit Jain via Siying Dong) (Revision 1310619)
Result = ABORTED
sdong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1310619
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
> race condition in DAG execute tasks for hive
> --------------------------------------------
>
> Key: HIVE-2929
> URL: https://issues.apache.org/jira/browse/HIVE-2929
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.2929.1.patch
>
>
> select ...
> (
> SubQuery involving MapReduce
> union all
> SubQuery involving MapReduce
> );
> or
> select ...
> (SubQuery involving MapReduce)
> join
> (SubQuery involving MapReduce)
> ;
> If both the subQueries finish at nearly the same time, there is a race
> condition in which the results of the subQuery finishing last will be completely missed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira