You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Siying Dong (JIRA)" <ji...@apache.org> on 2011/02/14 22:35:57 UTC
[jira] Created: (HIVE-1991) Hive Shell to output number of mappers
and number of reducers
Hive Shell to output number of mappers and number of reducers
-------------------------------------------------------------
Key: HIVE-1991
URL: https://issues.apache.org/jira/browse/HIVE-1991
Project: Hive
Issue Type: Improvement
Components: CLI
Reporter: Siying Dong
Assignee: Siying Dong
Priority: Trivial
Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1991) Hive Shell to output number of mappers
and number of reducers
Posted by "Siying Dong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siying Dong updated HIVE-1991:
------------------------------
Attachment: HIVE-1991.1.patch
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1991) Hive Shell to output number of mappers
and number of reducers
Posted by "Siying Dong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siying Dong updated HIVE-1991:
------------------------------
Attachment: HIVE-1991.2.patch
Thanks Ning for the comment.
Changed getMapTaskReports -> getReduceTaskReports.
HiveHistory is dumped to history .txt file. It already dumps information like hadoop ID, job progress, rows inserted, etc. I think it's straight-forward to also put this information there.
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch, HIVE-1991.2.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1991) Hive Shell to output number of
mappers and number of reducers
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994575#comment-12994575 ]
Ning Zhang commented on HIVE-1991:
----------------------------------
ExecDriver.java:
- line 371: getMapTaskReports -> getReduceTaskReports
- ss.getHiveHistory is keeping a map for # of mappers/reducers, but they are not used anywhere else. Is it needed at all?
Otherwise it looks good
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1991) Hive Shell to output number of mappers
and number of reducers
Posted by "Siying Dong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siying Dong updated HIVE-1991:
------------------------------
Attachment: (was: HIVE-1991.1.patch)
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1991) Hive Shell to output number of
mappers and number of reducers
Posted by "Siying Dong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13004226#comment-13004226 ]
Siying Dong commented on HIVE-1991:
-----------------------------------
This change was overriden by HIVE-1950.
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Fix For: 0.8.0
>
> Attachments: HIVE-1991.1.patch, HIVE-1991.2.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1991) Hive Shell to output number of mappers
and number of reducers
Posted by "Siying Dong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siying Dong updated HIVE-1991:
------------------------------
Status: Patch Available (was: Open)
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1991) Hive Shell to output number of mappers
and number of reducers
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ning Zhang updated HIVE-1991:
-----------------------------
Resolution: Fixed
Fix Version/s: 0.8.0
Status: Resolved (was: Patch Available)
Committed. Thanks Siying!
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Fix For: 0.8.0
>
> Attachments: HIVE-1991.1.patch, HIVE-1991.2.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1991) Hive Shell to output number of
mappers and number of reducers
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994563#comment-12994563 ]
Ning Zhang commented on HIVE-1991:
----------------------------------
I will take a look
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1991) Hive Shell to output number of mappers
and number of reducers
Posted by "Siying Dong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siying Dong updated HIVE-1991:
------------------------------
Attachment: HIVE-1991.1.patch
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1991) Hive Shell to output number of
mappers and number of reducers
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994593#comment-12994593 ]
Ning Zhang commented on HIVE-1991:
----------------------------------
+1. will commit if tests pass.
> Hive Shell to output number of mappers and number of reducers
> -------------------------------------------------------------
>
> Key: HIVE-1991
> URL: https://issues.apache.org/jira/browse/HIVE-1991
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Siying Dong
> Assignee: Siying Dong
> Priority: Trivial
> Attachments: HIVE-1991.1.patch, HIVE-1991.2.patch
>
>
> Number of mappers and number of reducers are nice information to be outputted for users to know.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira