You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Dennis Kubes (JIRA)" <ji...@apache.org> on 2007/12/04 00:35:43 UTC
[jira] Created: (NUTCH-587) Upgrade Nutch to use Hadoop 0.15.1
release
Upgrade Nutch to use Hadoop 0.15.1 release
------------------------------------------
Key: NUTCH-587
URL: https://issues.apache.org/jira/browse/NUTCH-587
Project: Nutch
Issue Type: Improvement
Environment: All
Reporter: Dennis Kubes
Assignee: Dennis Kubes
Fix For: 1.0.0
Upgrade Nutch to use the recently released hadoop 0.15.1. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-587) Upgrade Nutch to use Hadoop 0.15.3
release
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dennis Kubes updated NUTCH-587:
-------------------------------
Description: Upgrade Nutch to use the recently released hadoop 0.15.3. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources. (was: Upgrade Nutch to use the recently released hadoop 0.15.1. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.)
Summary: Upgrade Nutch to use Hadoop 0.15.3 release (was: Upgrade Nutch to use Hadoop 0.15.1 release)
Now moving from 0.15.1 to 0.15.3.
> Upgrade Nutch to use Hadoop 0.15.3 release
> ------------------------------------------
>
> Key: NUTCH-587
> URL: https://issues.apache.org/jira/browse/NUTCH-587
> Project: Nutch
> Issue Type: Improvement
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 1.0.0
>
> Attachments: NUTCH-587-1.patch
>
>
> Upgrade Nutch to use the recently released hadoop 0.15.3. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-587) Upgrade Nutch to use Hadoop 0.15.1
release
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12550235 ]
Dennis Kubes commented on NUTCH-587:
------------------------------------
Anybody have any issues with me committing this. I think it would be good to add something to the changes.txt to show the removal and default and final resources. Other than that we have this working in a fairly large cluster with no problems.
> Upgrade Nutch to use Hadoop 0.15.1 release
> ------------------------------------------
>
> Key: NUTCH-587
> URL: https://issues.apache.org/jira/browse/NUTCH-587
> Project: Nutch
> Issue Type: Improvement
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 1.0.0
>
> Attachments: NUTCH-587-1.patch
>
>
> Upgrade Nutch to use the recently released hadoop 0.15.1. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-587) Upgrade Nutch to use Hadoop 0.15.1
release
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dennis Kubes updated NUTCH-587:
-------------------------------
Attachment: NUTCH-587-1.patch
This patch updates Nutch to use Hadoop 0.15.1 from 0.15.0. This includes removing methods that added default and final resources, now simply resources, and changing out the hadoop jar file and native libraries.
> Upgrade Nutch to use Hadoop 0.15.1 release
> ------------------------------------------
>
> Key: NUTCH-587
> URL: https://issues.apache.org/jira/browse/NUTCH-587
> Project: Nutch
> Issue Type: Improvement
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 1.0.0
>
> Attachments: NUTCH-587-1.patch
>
>
> Upgrade Nutch to use the recently released hadoop 0.15.1. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (NUTCH-587) Upgrade Nutch to use Hadoop 0.15.3
release
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dennis Kubes resolved NUTCH-587.
--------------------------------
Resolution: Fixed
Tested on both cygwin and linux. All unit tests passed. Ran through multiple search cycles without issue. This patch adds the hadoop native library for AMD systems.
> Upgrade Nutch to use Hadoop 0.15.3 release
> ------------------------------------------
>
> Key: NUTCH-587
> URL: https://issues.apache.org/jira/browse/NUTCH-587
> Project: Nutch
> Issue Type: Improvement
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 1.0.0
>
> Attachments: NUTCH-587-1.patch, NUTCH-587-2-20081026.patch
>
>
> Upgrade Nutch to use the recently released hadoop 0.15.3. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (NUTCH-587) Upgrade Nutch to use Hadoop 0.15.1
release
Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12550259 ]
Andrzej Bialecki commented on NUTCH-587:
-----------------------------------------
+1 except for the docs. Please document this change in CHANGES.txt. I think we should write a short explanation of this change, especially since mapred-default.xml is also going away, and this may be confusing (suddenly properties defined there will stop working). IMHO the ful explanation is too much to put in CHANGES.txt, perhaps you should put just a warning there and refer people to a Wiki page (if such a page exists)?
> Upgrade Nutch to use Hadoop 0.15.1 release
> ------------------------------------------
>
> Key: NUTCH-587
> URL: https://issues.apache.org/jira/browse/NUTCH-587
> Project: Nutch
> Issue Type: Improvement
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 1.0.0
>
> Attachments: NUTCH-587-1.patch
>
>
> Upgrade Nutch to use the recently released hadoop 0.15.1. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-587) Upgrade Nutch to use Hadoop 0.15.3
release
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dennis Kubes updated NUTCH-587:
-------------------------------
Attachment: NUTCH-587-2-20081026.patch
All unit tests passed successfully. Ran through 3 fetch cycles. Everything looks good. If nobody has any objections I will commit this in the next 24 hours.
> Upgrade Nutch to use Hadoop 0.15.3 release
> ------------------------------------------
>
> Key: NUTCH-587
> URL: https://issues.apache.org/jira/browse/NUTCH-587
> Project: Nutch
> Issue Type: Improvement
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 1.0.0
>
> Attachments: NUTCH-587-1.patch, NUTCH-587-2-20081026.patch
>
>
> Upgrade Nutch to use the recently released hadoop 0.15.3. There were some critical changes in hadoop between 0.15.0 and 0.15.1. The biggest as applies to Nutch is the removal of deprecated method for default and final resources.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.