You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amar Kamat (JIRA)" <ji...@apache.org> on 2009/09/23 13:19:16 UTC
[jira] Created: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
TestCopyFiles fails on testHftpAccessControl()
----------------------------------------------
Key: MAPREDUCE-1029
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Reporter: Amar Kamat
Log :
Testcase: testHftpAccessControl took 2.692 sec
FAILED
expected:<-3> but was:<-999>
junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764036#action_12764036 ]
Hadoop QA commented on MAPREDUCE-1029:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12421729/mr-1029.patch
against trunk revision 823227.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
-1 release audit. The applied patch generated 175 release audit warnings (more than the trunk's current 172 warnings).
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/155/testReport/
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/155/artifact/trunk/patchprocess/releaseAuditDiffWarnings.txt
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/155/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/155/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/155/console
This message is automatically generated.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated MAPREDUCE-1029:
----------------------------------------------
Component/s: (was: distcp)
build
The patch works! TestCopyFiles did not fail. However, there are release audit warnings. Is it because of the unzip?
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764738#action_12764738 ]
Aaron Kimball commented on MAPREDUCE-1029:
------------------------------------------
The build process doesn't build webapps from their .jsp sources if the unzip is in there. It takes the copies out of the pre-packaged jars (which all bundle all of the webapps for all daemons) and uses them on top of the source-based copies.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jothi Padmanabhan updated MAPREDUCE-1029:
-----------------------------------------
Status: Patch Available (was: Open)
Running Aaron's patch through Hudson
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765635#action_12765635 ]
Hudson commented on MAPREDUCE-1029:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #112 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/112/])
. Fix failing TestCopyFiles by restoring the unzipping of
HDFS webapps from the hdfs jar. Contributed by Aaron Kimball and Jothi Padmanabhan
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated MAPREDUCE-1029:
-------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I committed this. Thanks Jothi and Aaron!
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765177#action_12765177 ]
Aaron Kimball commented on MAPREDUCE-1029:
------------------------------------------
Those release-audit warnings apply to the autogenerated files unzipped from hdfs.jar. Ok to increase warning count.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764311#action_12764311 ]
Chris Douglas commented on MAPREDUCE-1029:
------------------------------------------
It looks like this was introduced by MAPREDUCE-679. And it was caught by Hudson. *sigh*
Yes, the release audit warnings are from the unzipped files. If the files require license headers, they should be added in HDFS.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jothi Padmanabhan updated MAPREDUCE-1029:
-----------------------------------------
Status: Open (was: Patch Available)
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765478#action_12765478 ]
Hudson commented on MAPREDUCE-1029:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #74 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/74/])
. Fix failing TestCopyFiles by restoring the unzipping of
HDFS webapps from the hdfs jar. Contributed by Aaron Kimball and Jothi Padmanabhan
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765462#action_12765462 ]
Chris Douglas commented on MAPREDUCE-1029:
------------------------------------------
I got the following failure on the 0.21 branch:
{noformat}
Testcase: testHftpAccessControl took 1.414 sec
Caused an ERROR
null
java.lang.StackOverflowError
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:598)
at java.lang.StringBuffer.append(StringBuffer.java:329)
at java.net.URI.appendAuthority(URI.java:1812)
at java.net.URI.appendSchemeSpecificPart(URI.java:1871)
at java.net.URI.toString(URI.java:1903)
at java.net.URI.<init>(URI.java:659)
at org.apache.hadoop.hdfs.HftpFileSystem.getUri(HftpFileSystem.java:96)
at org.apache.hadoop.fs.Path.makeQualified(Path.java:297)
at org.apache.hadoop.hdfs.HftpFileSystem.getWorkingDirectory(HftpFileSystem.java:289)
at org.apache.hadoop.fs.Path.makeQualified(Path.java:297)
at org.apache.hadoop.hdfs.HftpFileSystem.getWorkingDirectory(HftpFileSystem.java:289)
at org.apache.hadoop.fs.Path.makeQualified(Path.java:297)
at org.apache.hadoop.hdfs.HftpFileSystem.getWorkingDirectory(HftpFileSystem.java:289)
at org.apache.hadoop.fs.Path.makeQualified(Path.java:297)
at org.apache.hadoop.hdfs.HftpFileSystem.getWorkingDirectory(HftpFileSystem.java:289)
[...]
{noformat}
Updating the hdfs jar to the most recent version of the HDFS 0.21 branch resolved this, however.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jothi Padmanabhan updated MAPREDUCE-1029:
-----------------------------------------
Assignee: Jothi Padmanabhan
Status: Patch Available (was: Open)
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated MAPREDUCE-1029:
---------------------------------
Priority: Blocker (was: Major)
Affects Version/s: 0.21.0
Fix Version/s: 0.21.0
This fails on 0.21 branch too. Marking it as a blocker.
bq. This may be because the hdfs webapps aren't on the classpath, so MiniDFSCluster isn't starting Jetty, so HftpFileSystem (which uses http) fails to work.
Chris, do you know which issue caused this? This is the same reason for which HDFS NameNode UI doesn't come up when I start HDFS from inside mapreduce project. This used to work well until very recently.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Priority: Blocker
> Fix For: 0.21.0
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron Kimball updated MAPREDUCE-1029:
-------------------------------------
Attachment: MAPREDUCE-1029.2.patch
More specifically, the build/webapps/ directory contains WEB-INF/web.xml files that define the sitemap that jetty uses. The ones from the hdfs jar will block the inclusion of new servlets via the web.xml generated by the compilation process.
This patch unzips only the HDFS-specific webapps subdirectories. TestCopyFiles passes locally.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759237#action_12759237 ]
Chris Douglas commented on MAPREDUCE-1029:
------------------------------------------
This may be because the hdfs webapps aren't on the classpath, so MiniDFSCluster isn't starting Jetty, so HftpFileSystem (which uses http) fails to work.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Reporter: Amar Kamat
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764544#action_12764544 ]
Vinod K V commented on MAPREDUCE-1029:
--------------------------------------
The unzip was removed after [this|https://issues.apache.org/jira/browse/MAPREDUCE-679?focusedCommentId=12745749&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12745749] comment by Aaron Kimball on MAPREDUCE-679.
bq. # updates build.xml to fix bug in webapp compilation.
Not sure of its meaning, but I think we should confirm the reason before adding it back, just to be sure. Aaron?
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765007#action_12765007 ]
Hadoop QA commented on MAPREDUCE-1029:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12421883/MAPREDUCE-1029.2.patch
against trunk revision 824273.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
-1 release audit. The applied patch generated 175 release audit warnings (more than the trunk's current 172 warnings).
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/161/testReport/
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/161/artifact/trunk/patchprocess/releaseAuditDiffWarnings.txt
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/161/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/161/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/161/console
This message is automatically generated.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1029.2.patch, mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Jothi Padmanabhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jothi Padmanabhan updated MAPREDUCE-1029:
-----------------------------------------
Attachment: mr-1029.patch
Patch that restores the unzipping of hdfs/webapps during build.
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Priority: Blocker
> Fix For: 0.21.0
>
> Attachments: mr-1029.patch
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1029) TestCopyFiles fails on
testHftpAccessControl()
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12760185#action_12760185 ]
Chris Douglas commented on MAPREDUCE-1029:
------------------------------------------
bq. do you know which issue caused this? This is the same reason for which HDFS NameNode UI doesn't come up when I start HDFS from inside mapreduce project
No, the preceding was just a guess. I haven't looked into the regression, but noticed the webapp error messages around the same time the rest of the HDFS web UIs stopped working (and it would explain why hftp fails).
> TestCopyFiles fails on testHftpAccessControl()
> ----------------------------------------------
>
> Key: MAPREDUCE-1029
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1029
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 0.21.0
> Reporter: Amar Kamat
> Priority: Blocker
> Fix For: 0.21.0
>
>
> Log :
> Testcase: testHftpAccessControl took 2.692 sec
> FAILED
> expected:<-3> but was:<-999>
> junit.framework.AssertionFailedError: expected:<-3> but was:<-999>
> at org.apache.hadoop.tools.TestCopyFiles.testHftpAccessControl(TestCopyFiles.java:853)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.