You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Bochun Bai (JIRA)" <ji...@apache.org> on 2011/06/07 06:17:59 UTC
[jira] [Created] (MAPREDUCE-2571) CombineFileInputFormat.getSplits
throws a java.lang.ArrayStoreException
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
-----------------------------------------------------------------------
Key: MAPREDUCE-2571
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.21.0
Reporter: Bochun Bai
Priority: Blocker
The getSplits methods of
org.apache.hadoop.mapred.lib.CombineFileInputFormat
not work.
...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2571) CombineFileInputFormat.getSplits
throws a java.lang.ArrayStoreException
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated MAPREDUCE-2571:
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.22.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed to 22 and trunk, thanks Bochun!
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057255#comment-13057255 ]
Hudson commented on MAPREDUCE-2571:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #722 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/722/])
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2571) CombineFileInputFormat.getSplits
throws a java.lang.ArrayStoreException
Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bochun Bai updated MAPREDUCE-2571:
----------------------------------
Status: Patch Available (was: Open)
The patch uses a loop instead of toArray in getSplits.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-2571) CombineFileInputFormat.getSplits
throws a java.lang.ArrayStoreException
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reassigned MAPREDUCE-2571:
--------------------------------------
Assignee: Bochun Bai
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045635#comment-13045635 ]
Hadoop QA commented on MAPREDUCE-2571:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12481729/MAPREDUCE-2571.patch
against trunk revision 1132807.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these core unit tests:
org.apache.hadoop.cli.TestMRCLI
org.apache.hadoop.fs.TestFileSystem
org.apache.hadoop.mapred.TestRecoveryManager
+1 contrib tests. The patch passed contrib unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/358//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/358//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/358//console
This message is automatically generated.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045644#comment-13045644 ]
Todd Lipcon commented on MAPREDUCE-2571:
----------------------------------------
+1
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2571) CombineFileInputFormat.getSplits
throws a java.lang.ArrayStoreException
Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bochun Bai updated MAPREDUCE-2571:
----------------------------------
Attachment: MAPREDUCE-2571.patch
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045547#comment-13045547 ]
Hadoop QA commented on MAPREDUCE-2571:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12481721/MAPREDUCE-2571.patch
against trunk revision 1132807.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The patch appears to cause tar ant target to fail.
-1 findbugs. The patch appears to cause Findbugs (version 1.3.9) to fail.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these core unit tests:
-1 contrib tests. The patch failed contrib unit tests.
-1 system test framework. The patch failed system test framework compile.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/357//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/357//console
This message is automatically generated.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2571) CombineFileInputFormat.getSplits
throws a java.lang.ArrayStoreException
Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bochun Bai updated MAPREDUCE-2571:
----------------------------------
Attachment: MAPREDUCE-2571.patch
Yes, it is not related.
A new patch is uploading.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045675#comment-13045675 ]
Hudson commented on MAPREDUCE-2571:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #718 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/718/])
MAPREDUCE-2571. CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException. Contributed by Bochun Bai.
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1133175
Files :
* /hadoop/mapreduce/trunk/CHANGES.txt
* /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/lib/CombineFileInputFormat.java
* /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestCombineFileInputFormat.java
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045535#comment-13045535 ]
Todd Lipcon commented on MAPREDUCE-2571:
----------------------------------------
Patch looks pretty good. I'm not sure I follow why the main() and unquote() methods are in the test case, though - they seem unrelated and unused by the actual unit test, right?
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2571) CombineFileInputFormat.getSplits
throws a java.lang.ArrayStoreException
Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bochun Bai updated MAPREDUCE-2571:
----------------------------------
Attachment: MAPREDUCE-2571.patch
Fix previous patch which contains syntax error.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045562#comment-13045562 ]
Bochun Bai commented on MAPREDUCE-2571:
---------------------------------------
囧rz，I should run test-patch myself before uploading.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045302#comment-13045302 ]
Hadoop QA commented on MAPREDUCE-2571:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12481653/MAPREDUCE-2571.patch
against trunk revision 1132807.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these core unit tests:
org.apache.hadoop.cli.TestMRCLI
org.apache.hadoop.fs.TestFileSystem
+1 contrib tests. The patch passed contrib unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/355//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/355//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/355//console
This message is automatically generated.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045738#comment-13045738 ]
Hudson commented on MAPREDUCE-2571:
-----------------------------------
Integrated in Hadoop-Mapreduce-22-branch #59 (See [https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/59/])
MAPREDUCE-2571. CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException. Contributed by Bochun Bai.
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1133176
Files :
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/mapred/TestCombineFileInputFormat.java
* /hadoop/mapreduce/branches/branch-0.22/CHANGES.txt
* /hadoop/mapreduce/branches/branch-0.22/src/java/org/apache/hadoop/mapred/lib/CombineFileInputFormat.java
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2571)
CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045645#comment-13045645 ]
Todd Lipcon commented on MAPREDUCE-2571:
----------------------------------------
I should note: the new findbugs warning seems like it must have come from a different patch - nothing related to CombineFileInputFormat shows up in the findbugs results. Same with the failing tests.
> CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreException
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2571
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2571
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Reporter: Bochun Bai
> Assignee: Bochun Bai
> Priority: Blocker
> Attachments: MAPREDUCE-2571.patch, MAPREDUCE-2571.patch, MAPREDUCE-2571.patch
>
>
> The getSplits methods of
> org.apache.hadoop.mapred.lib.CombineFileInputFormat
> not work.
> ...mapred.lib.CombineFileInputFormat(0.20-style) is a proxy for ...mapreduce.lib.input.CombineFileInputFormat(0.21-style)
> The 0.21-style getSplits returns ArrayList<...mapreduce.lib.input.CombineFileSplit>
> and the 0.20-style delegation calls toArray(...mapred.InputSplit[])
> The ...mapreduce.lib.input.CombineFileSplit is based on ...mapreduce.InputSplit
> and ...mapred.InputSplit is a interface, not a super-class of ...mapreduce.InputSplit
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira