You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Dmytro Molkov (JIRA)" <ji...@apache.org> on 2012/06/13 03:59:42 UTC
[jira] [Created] (HIVE-3123) Hadoop20Shim. CombineFileRecordReader
does not report progress within files
Dmytro Molkov created HIVE-3123:
-----------------------------------
Summary: Hadoop20Shim. CombineFileRecordReader does not report progress within files
Key: HIVE-3123
URL: https://issues.apache.org/jira/browse/HIVE-3123
Project: Hive
Issue Type: Bug
Reporter: Dmytro Molkov
Priority: Trivial
When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3123) Hadoop20Shim. CombineFileRecordReader
does not report progress within files
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kevin Wilfong updated HIVE-3123:
--------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed, thanks Dmytro.
> Hadoop20Shim. CombineFileRecordReader does not report progress within files
> ---------------------------------------------------------------------------
>
> Key: HIVE-3123
> URL: https://issues.apache.org/jira/browse/HIVE-3123
> Project: Hive
> Issue Type: Bug
> Reporter: Dmytro Molkov
> Priority: Trivial
> Attachments: shim.patch
>
>
> When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3123) Hadoop20Shim.
CombineFileRecordReader does not report progress within files
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294792#comment-13294792 ]
Carl Steinbach commented on HIVE-3123:
--------------------------------------
@Kevin: Please set the component and fix version fields.
> Hadoop20Shim. CombineFileRecordReader does not report progress within files
> ---------------------------------------------------------------------------
>
> Key: HIVE-3123
> URL: https://issues.apache.org/jira/browse/HIVE-3123
> Project: Hive
> Issue Type: Bug
> Reporter: Dmytro Molkov
> Priority: Trivial
> Attachments: shim.patch
>
>
> When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3123) Hadoop20Shim. CombineFileRecordReader
does not report progress within files
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kevin Wilfong updated HIVE-3123:
--------------------------------
Status: Patch Available (was: Open)
> Hadoop20Shim. CombineFileRecordReader does not report progress within files
> ---------------------------------------------------------------------------
>
> Key: HIVE-3123
> URL: https://issues.apache.org/jira/browse/HIVE-3123
> Project: Hive
> Issue Type: Bug
> Reporter: Dmytro Molkov
> Priority: Trivial
> Attachments: shim.patch
>
>
> When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3123) Hadoop20Shim.
CombineFileRecordReader does not report progress within files
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294836#comment-13294836 ]
Hudson commented on HIVE-3123:
------------------------------
Integrated in Hive-trunk-h0.21 #1486 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1486/])
HIVE-3123. Hadoop20Shim. CombineFileRecordReader does not report progress within files (Dmytro Molkov via kevinwilfong) (Revision 1350054)
Result = FAILURE
kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1350054
Files :
* /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
> Hadoop20Shim. CombineFileRecordReader does not report progress within files
> ---------------------------------------------------------------------------
>
> Key: HIVE-3123
> URL: https://issues.apache.org/jira/browse/HIVE-3123
> Project: Hive
> Issue Type: Bug
> Reporter: Dmytro Molkov
> Priority: Trivial
> Attachments: shim.patch
>
>
> When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3123) Hadoop20Shim. CombineFileRecordReader
does not report progress within files
Posted by "Dmytro Molkov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmytro Molkov updated HIVE-3123:
--------------------------------
Attachment: shim.patch
> Hadoop20Shim. CombineFileRecordReader does not report progress within files
> ---------------------------------------------------------------------------
>
> Key: HIVE-3123
> URL: https://issues.apache.org/jira/browse/HIVE-3123
> Project: Hive
> Issue Type: Bug
> Reporter: Dmytro Molkov
> Priority: Trivial
> Attachments: shim.patch
>
>
> When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3123) Hadoop20Shim. CombineFileRecordReader
does not report progress within files
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kevin Wilfong updated HIVE-3123:
--------------------------------
Component/s: Shims
Fix Version/s: 0.10.0
> Hadoop20Shim. CombineFileRecordReader does not report progress within files
> ---------------------------------------------------------------------------
>
> Key: HIVE-3123
> URL: https://issues.apache.org/jira/browse/HIVE-3123
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Reporter: Dmytro Molkov
> Priority: Trivial
> Fix For: 0.10.0
>
> Attachments: shim.patch
>
>
> When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3123) Hadoop20Shim.
CombineFileRecordReader does not report progress within files
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294058#comment-13294058 ]
Kevin Wilfong commented on HIVE-3123:
-------------------------------------
+1 For reference https://issues.apache.org/jira/secure/attachment/12440139/MAPREDUCE-1480-branch20.patch
> Hadoop20Shim. CombineFileRecordReader does not report progress within files
> ---------------------------------------------------------------------------
>
> Key: HIVE-3123
> URL: https://issues.apache.org/jira/browse/HIVE-3123
> Project: Hive
> Issue Type: Bug
> Reporter: Dmytro Molkov
> Priority: Trivial
> Attachments: shim.patch
>
>
> When using CombineHiveInputFormat the progress of the task only changes on each of the processed parts of the split, but not within them. This patch fixes the issue and the progress of the task will be reported continuously.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira