You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "He Yongqiang (JIRA)" <ji...@apache.org> on 2010/02/16 20:41:28 UTC
[jira] Created: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Job counter error if "hive.merge.mapfiles" equals true
------------------------------------------------------
Key: HIVE-1174
URL: https://issues.apache.org/jira/browse/HIVE-1174
Project: Hadoop Hive
Issue Type: Bug
Reporter: He Yongqiang
if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-1174:
-------------------------------
Attachment: hive-1174.2.patch
> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: hive-1174.1.patch, hive-1174.2.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1174) Fix job counter error if
"hive.merge.mapfiles" equals true
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-1174:
---------------------------------
Release Note: (was: HIVE-1174. Fix Job counter error if "hive.merge.mapfiles" equals true. (Yongqiang He via zshao))
Summary: Fix job counter error if "hive.merge.mapfiles" equals true (was: Job counter error if "hive.merge.mapfiles" equals true)
> Fix job counter error if "hive.merge.mapfiles" equals true
> ----------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.6.0
>
> Attachments: hive-1174.1.patch, hive-1174.2.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang reassigned HIVE-1174:
----------------------------------
Assignee: He Yongqiang
> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao updated HIVE-1174:
-----------------------------
Resolution: Fixed
Fix Version/s: 0.6.0
Release Note: HIVE-1174. Fix Job counter error if "hive.merge.mapfiles" equals true. (Yongqiang He via zshao)
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed. Thanks Yongqiang!
> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.6.0
>
> Attachments: hive-1174.1.patch, hive-1174.2.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12834529#action_12834529 ]
Zheng Shao commented on HIVE-1174:
----------------------------------
+1. Will test and commit.
> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: hive-1174.1.patch, hive-1174.2.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-1174:
-------------------------------
Status: Patch Available (was: Open)
> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: hive-1174.1.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-1174:
-------------------------------
Attachment: hive-1174.1.patch
> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: hive-1174.1.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1174) Job counter error if
"hive.merge.mapfiles" equals true
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12834536#action_12834536 ]
He Yongqiang commented on HIVE-1174:
------------------------------------
The problem in this jira is:
1) countJobs in Driver only count map-reduce tasks.
2) For mergeJob, there are two tasks (one dummyMove, and one merge task which is a MRTask). It will count 1 job because dummyMove is not a MapReduceTask
3) But a bug in ConditionalTask will always inc jobCounter by 1 when removing a task from candidate task list, even though it is not a MRTask,
> Job counter error if "hive.merge.mapfiles" equals true
> ------------------------------------------------------
>
> Key: HIVE-1174
> URL: https://issues.apache.org/jira/browse/HIVE-1174
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: hive-1174.1.patch, hive-1174.2.patch
>
>
> if hive.merge.mapfiles is set to true, the job counter will go to 3.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.