You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Mahadev konar (JIRA)" <ji...@apache.org> on 2008/06/13 22:21:45 UTC
[jira] Created: (HADOOP-3560) Archvies sometimes create empty part
files.
Archvies sometimes create empty part files.
-------------------------------------------
Key: HADOOP-3560
URL: https://issues.apache.org/jira/browse/HADOOP-3560
Project: Hadoop Core
Issue Type: Bug
Reporter: Mahadev konar
Assignee: Mahadev konar
Priority: Blocker
Fix For: 0.18.0, 0.19.0
Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3560) Archvies sometimes create empty part
files.
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated HADOOP-3560:
--------------------------------------------
Component/s: tools/harchive
> Archvies sometimes create empty part files.
> -------------------------------------------
>
> Key: HADOOP-3560
> URL: https://issues.apache.org/jira/browse/HADOOP-3560
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0, 0.19.0
>
> Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3560) Archvies sometimes create empty
part files.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605588#action_12605588 ]
Hudson commented on HADOOP-3560:
--------------------------------
Integrated in Hadoop-trunk #521 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/521/])
> Archvies sometimes create empty part files.
> -------------------------------------------
>
> Key: HADOOP-3560
> URL: https://issues.apache.org/jira/browse/HADOOP-3560
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0, 0.19.0
>
> Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3560) Archvies sometimes create empty part
files.
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3560:
----------------------------------
Status: Patch Available (was: Open)
> Archvies sometimes create empty part files.
> -------------------------------------------
>
> Key: HADOOP-3560
> URL: https://issues.apache.org/jira/browse/HADOOP-3560
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0, 0.19.0
>
> Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3560) Archvies sometimes create empty part
files.
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated HADOOP-3560:
----------------------------------
Attachment: hadoop-3560_1.patch
this patch fixes the splits created in archive map reduce jobs so that splits are evenly distributed amongst the maps. The sync marker made the splits to be non uniform amongst the maps. The sync marker is called on each record append in the filesplits file.
> Archvies sometimes create empty part files.
> -------------------------------------------
>
> Key: HADOOP-3560
> URL: https://issues.apache.org/jira/browse/HADOOP-3560
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0, 0.19.0
>
> Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3560) Archvies sometimes create empty
part files.
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605398#action_12605398 ]
Mahadev konar commented on HADOOP-3560:
---------------------------------------
i have not added tests since the test require creation of large input files.
> Archvies sometimes create empty part files.
> -------------------------------------------
>
> Key: HADOOP-3560
> URL: https://issues.apache.org/jira/browse/HADOOP-3560
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0, 0.19.0
>
> Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3560) Archvies sometimes create empty part
files.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-3560:
--------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Mahadev!
> Archvies sometimes create empty part files.
> -------------------------------------------
>
> Key: HADOOP-3560
> URL: https://issues.apache.org/jira/browse/HADOOP-3560
> Project: Hadoop Core
> Issue Type: Bug
> Components: tools/harchive
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0, 0.19.0
>
> Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3560) Archvies sometimes create empty
part files.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605023#action_12605023 ]
Hadoop QA commented on HADOOP-3560:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12383998/hadoop-3560_1.patch
against trunk revision 667506.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2658/console
This message is automatically generated.
> Archvies sometimes create empty part files.
> -------------------------------------------
>
> Key: HADOOP-3560
> URL: https://issues.apache.org/jira/browse/HADOOP-3560
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.18.0, 0.19.0
>
> Attachments: hadoop-3560_1.patch
>
>
> Archvies creates a bunch of empty part files sometimes which are not necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.