You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Markus Jelsma (Created) (JIRA)" <ji...@apache.org> on 2011/12/14 14:39:30 UTC
[jira] [Created] (NUTCH-1222) Upgrade to newer Hadoop versions
Upgrade to newer Hadoop versions
--------------------------------
Key: NUTCH-1222
URL: https://issues.apache.org/jira/browse/NUTCH-1222
Project: Nutch
Issue Type: Improvement
Reporter: Markus Jelsma
Priority: Critical
Fix For: 1.5
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-1222:
---------------------------------
Assignee: Markus Jelsma
Summary: Upgrade to new Hadoop 0.22.0 (was: Upgrade to newer Hadoop versions)
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Lewis John McGibbney (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207754#comment-13207754 ]
Lewis John McGibbney commented on NUTCH-1222:
---------------------------------------------
Hey Markus it was more a question rather than anything else really. I personally don't have much of a preference as I'm not following the Hadoop project decisions as closely as others, therefore I don't know intricate differences in development tracks if I'm honest. Maybe you may wish to keep this open or something. Up to you I guess :0)
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma resolved NUTCH-1222.
----------------------------------
Resolution: Fixed
Committed for 1.5 in rev. 1220786.
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172365#comment-13172365 ]
Hudson commented on NUTCH-1222:
-------------------------------
Integrated in nutch-trunk-maven #67 (See [https://builds.apache.org/job/nutch-trunk-maven/67/])
NUTCH-1222 Upgrade to new Hadoop 0.22.0
markus : http://svn.apache.org/viewvc/nutch/trunk/viewvc/?view=rev&root=&revision=1220786
Files :
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/ivy/ivy.xml
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-1222:
---------------------------------
Attachment: NUTCH-1222-1.5-1.patch
Ivy patch. Everything is fine! Make sure to do ant clean or remove the stuff manually.
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1222) Upgrade to newer Hadoop versions
Posted by "Markus Jelsma (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172211#comment-13172211 ]
Markus Jelsma commented on NUTCH-1222:
--------------------------------------
If there are no objections i'll upgrade the ivy deps to Hadoop 0.22.0
> Upgrade to newer Hadoop versions
> --------------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176166#comment-13176166 ]
Markus Jelsma commented on NUTCH-1222:
--------------------------------------
Reverted per rev. 1224906.
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-1222:
---------------------------------
Patch Info: Patch Available
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207739#comment-13207739 ]
Markus Jelsma commented on NUTCH-1222:
--------------------------------------
We can close this one i guess. However, today i read that 0.23 is going to become the new stable release instead of 1.0.0. But since we had a number of issues with 0.23 i'd recommend staying on 1.0.0 for a while. The 0.23 cluster was highly unstable.
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma resolved NUTCH-1222.
----------------------------------
Resolution: Won't Fix
Fix Version/s: (was: 1.5)
Assignee: (was: Markus Jelsma)
Will open new issue when appropriate.
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Priority: Critical
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Markus Jelsma (Reopened) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma reopened NUTCH-1222:
----------------------------------
Reopened issue. With large scale tests we are seeing unexplainable issues with 0.22.0 running on a 0.22.0 cluster although the fetcher still uses the old API. We see strange freezes, time outs and weird OOM heap space or overhead exceptions. Although we tested it well, it was not enough. Initial large scale tests were very promising.
It's starting to look like i have to downgrade to 0.20.205 which seems to do its job fine.
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Lewis John McGibbney (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207730#comment-13207730 ]
Lewis John McGibbney commented on NUTCH-1222:
---------------------------------------------
Is this necessary anymore Markus now that we are using 1.0.0?
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1222) Upgrade to new Hadoop 0.22.0
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172912#comment-13172912 ]
Hudson commented on NUTCH-1222:
-------------------------------
Integrated in Nutch-trunk #1698 (See [https://builds.apache.org/job/Nutch-trunk/1698/])
NUTCH-1222 Upgrade to new Hadoop 0.22.0
markus : http://svn.apache.org/viewvc/nutch/trunk/viewvc/?view=rev&root=&revision=1220786
Files :
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/ivy/ivy.xml
> Upgrade to new Hadoop 0.22.0
> ----------------------------
>
> Key: NUTCH-1222
> URL: https://issues.apache.org/jira/browse/NUTCH-1222
> Project: Nutch
> Issue Type: Improvement
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Critical
> Fix For: 1.5
>
> Attachments: NUTCH-1222-1.5-1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira