You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Konstantin Boudnik (Created) (JIRA)" <ji...@apache.org> on 2011/10/30 00:49:32 UTC
[jira] [Created] (MAPREDUCE-3311) Bump jetty to 6.1.26
Bump jetty to 6.1.26
--------------------
Key: MAPREDUCE-3311
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
Project: Hadoop Map/Reduce
Issue Type: Task
Components: build
Affects Versions: 0.22.0
Reporter: Konstantin Boudnik
Assignee: Konstantin Boudnik
Fix For: 0.22.0
MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Shvachko (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150997#comment-13150997 ]
Konstantin Shvachko commented on MAPREDUCE-3311:
------------------------------------------------
I checked fairscheduler. It also needs common-lang. At least this fixed TestFairSchedulerSystem for me. We should add common-lang on the higher level, may be directly into mapred/ivy.xml
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Shvachko (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150843#comment-13150843 ]
Konstantin Shvachko commented on MAPREDUCE-3311:
------------------------------------------------
The following three tests failed. But they also are failing without this patch.
{code}
[junit] Test org.apache.hadoop.streaming.TestUlimit FAILED
[junit] Test org.apache.hadoop.mapred.TestFairSchedulerSystem FAILED
[junit] Test org.apache.hadoop.raid.TestRaidNode FAILED
{code}
So I am going to commit the Jetty upgrade patches.
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Shvachko (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151537#comment-13151537 ]
Konstantin Shvachko commented on MAPREDUCE-3311:
------------------------------------------------
I checked TestRaidNode is fixed by adding commons-lang to raid/ivy.xml
It was failing in the beginning, but turned out it was due to the ulimit. Increased ulimit - it passes now.
+1 on latest patch.
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Boudnik updated MAPREDUCE-3311:
------------------------------------------
Attachment: MAPREDUCE-3311.patch
It seems like (after having proper artifacts for all deps from common and hdfs in place) that MAPREDUCE-3396 is caused by the changes in transient dependencies. Thus I am joining it to the current patch.
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150920#comment-13150920 ]
Konstantin Boudnik commented on MAPREDUCE-3311:
-----------------------------------------------
s/not a blocker/not be a blocker/
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152055#comment-13152055 ]
Hudson commented on MAPREDUCE-3311:
-----------------------------------
Integrated in Hadoop-Mapreduce-22-branch #89 (See [https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/89/])
MAPREDUCE-3311. Bump jetty to 6.1.26. Controbuted by Konstantin Boudnik
cos : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1202990
Files :
* /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
* /hadoop/common/branches/branch-0.22/mapreduce/ivy/libraries.properties
* /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/capacity-scheduler/ivy.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/dynamic-scheduler/ivy.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/fairscheduler/ivy.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/gridmix/ivy.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/mumak/ivy.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/raid/ivy.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/contrib/streaming/ivy.xml
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150919#comment-13150919 ]
Konstantin Boudnik commented on MAPREDUCE-3311:
-----------------------------------------------
wrt MAPREDUCE-3396: looks like issue was caused by some crap laying around in my ivy cache after working on Jetty patches. I will verify it again, but after all it might not a blocker.
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Boudnik updated MAPREDUCE-3311:
------------------------------------------
Attachment: MAPREDUCE-3311.patch
Damn transient deps. are keeping biting...
With this patch in place I see two out of three tests start passing. However, I can't tell if adding {{commons-lang}} fixes the raid test because it is failing on my laptop on vanilla MR as well.
Please take a look and if raid got fixed with the latest patch then we can commit it.
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Shvachko (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142730#comment-13142730 ]
Konstantin Shvachko commented on MAPREDUCE-3311:
------------------------------------------------
TestMiniMRChildTask passed for me. Actually all MR tests passed. But test-contrib is failing with
{code}
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: org.mortbay.jetty#jsp-api-2.1;6.1.26: not found
[ivy:resolve] :: org.mortbay.jetty#jsp-2.1;6.1.26: not found
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
{code}
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Boudnik updated MAPREDUCE-3311:
------------------------------------------
Attachment: MAPREDUCE-3311.patch
I have ran smoke tests with all dependencies build for jetty 6.1.26 and I see that
org.apache.hadoop.mapred.TestMiniMRChildTask tests have failed.
Failures do not seem to be patch related though.
Also, I see messages like
{noformat}
2011-10-29 16:03:44,381 ERROR mapred.TaskTracker (TaskTracker.java:offerService(1582)) - Caught exception: java.io.IOException: Jetty problem. Jetty d
idn't bind to a valid port
at org.apache.hadoop.mapred.TaskTracker.checkJettyPort(TaskTracker.java:1387)
at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1560)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:2418)
at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:229)
at java.lang.Thread.run(Thread.java:680)
{noformat}
but tests are passing ok after them.
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Boudnik resolved MAPREDUCE-3311.
-------------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
I have just committed the patch.
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Boudnik updated MAPREDUCE-3311:
------------------------------------------
Attachment: MAPREDUCE-3311.patch
Fixing contrib issues.
Please be aware that this patch requires the fix for MAPREDUCE-3396
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3311) Bump jetty to 6.1.26
Posted by "Konstantin Boudnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Boudnik updated MAPREDUCE-3311:
------------------------------------------
Attachment: MAPREDUCE-3311.patch
I am sorry - put in wrong patch last time ;(
> Bump jetty to 6.1.26
> --------------------
>
> Key: MAPREDUCE-3311
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3311
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: build
> Affects Versions: 0.22.0
> Reporter: Konstantin Boudnik
> Assignee: Konstantin Boudnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch, MAPREDUCE-3311.patch
>
>
> MapReduce part of HADOOP-7450
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira