You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "sha feng (JIRA)" <ji...@apache.org> on 2008/12/22 04:09:44 UTC
[jira] Created: (NUTCH-675) Reduce tasks do not report their status
and are killed by jobtracker
Reduce tasks do not report their status and are killed by jobtracker
--------------------------------------------------------------------
Key: NUTCH-675
URL: https://issues.apache.org/jira/browse/NUTCH-675
Project: Nutch
Issue Type: Bug
Components: fetcher
Affects Versions: 0.9.0
Environment: OS : Linux
Reporter: sha feng
Fix For: 0.9.0
We choose Fetcher2 as our fetcher. Map tasks of Fetcher2 fetches about 2,000,000 urls, but at reduce stage, all reduce tasks can not report their status and be killed by jobtracker. Although we change mapred.task.timeout from 60,000 to 1,800,000, it does not work. So, who can tell us why? By the way, the version of Nutch we use is 0.9 and the version of Hadoop is 0.12.
Thanks for your help!
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Commented: (NUTCH-675) Reduce tasks do not report their
status and are killed by jobtracker
Posted by Dennis Kubes <ku...@apache.org>.
This is old. It has been fixed in more recent versions of hadoop and nutch.
Otis Gospodnetic (JIRA) wrote:
> [ https://issues.apache.org/jira/browse/NUTCH-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12658610#action_12658610 ]
>
> Otis Gospodnetic commented on NUTCH-675:
> ----------------------------------------
>
> Sha Feng, could you please bring this up on the Nutch mailing list instead of JIRA?
> It would also be good if you could upgrade your Nutch (including Hadoop) and see if it works then. 0.12 is VERY old version of Hadoop.
>
>
>> Reduce tasks do not report their status and are killed by jobtracker
>> --------------------------------------------------------------------
>>
>> Key: NUTCH-675
>> URL: https://issues.apache.org/jira/browse/NUTCH-675
>> Project: Nutch
>> Issue Type: Bug
>> Components: fetcher
>> Affects Versions: 0.9.0
>> Environment: OS : Linux
>> Reporter: sha feng
>> Fix For: 0.9.0
>>
>>
>> We choose Fetcher2 as our fetcher. Map tasks of Fetcher2 fetches about 2,000,000 urls, but at reduce stage, all reduce tasks can not report their status and be killed by jobtracker. Although we change mapred.task.timeout from 60,000 to 1,800,000, it does not work. So, who can tell us why? By the way, the version of Nutch we use is 0.9 and the version of Hadoop is 0.12.
>> Thanks for your help!
>
[jira] Commented: (NUTCH-675) Reduce tasks do not report their
status and are killed by jobtracker
Posted by "Otis Gospodnetic (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12658610#action_12658610 ]
Otis Gospodnetic commented on NUTCH-675:
----------------------------------------
Sha Feng, could you please bring this up on the Nutch mailing list instead of JIRA?
It would also be good if you could upgrade your Nutch (including Hadoop) and see if it works then. 0.12 is VERY old version of Hadoop.
> Reduce tasks do not report their status and are killed by jobtracker
> --------------------------------------------------------------------
>
> Key: NUTCH-675
> URL: https://issues.apache.org/jira/browse/NUTCH-675
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 0.9.0
> Environment: OS : Linux
> Reporter: sha feng
> Fix For: 0.9.0
>
>
> We choose Fetcher2 as our fetcher. Map tasks of Fetcher2 fetches about 2,000,000 urls, but at reduce stage, all reduce tasks can not report their status and be killed by jobtracker. Although we change mapred.task.timeout from 60,000 to 1,800,000, it does not work. So, who can tell us why? By the way, the version of Nutch we use is 0.9 and the version of Hadoop is 0.12.
> Thanks for your help!
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (NUTCH-675) Reduce tasks do not report their
status and are killed by jobtracker
Posted by "Otis Gospodnetic (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Otis Gospodnetic resolved NUTCH-675.
------------------------------------
Resolution: Won't Fix
According to Dennis Kubes's response on the mailing list, this has already been fixed. Please try with the most recent versions of Nutch and Hadoop, Sha Feng.
> Reduce tasks do not report their status and are killed by jobtracker
> --------------------------------------------------------------------
>
> Key: NUTCH-675
> URL: https://issues.apache.org/jira/browse/NUTCH-675
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 0.9.0
> Environment: OS : Linux
> Reporter: sha feng
> Fix For: 0.9.0
>
>
> We choose Fetcher2 as our fetcher. Map tasks of Fetcher2 fetches about 2,000,000 urls, but at reduce stage, all reduce tasks can not report their status and be killed by jobtracker. Although we change mapred.task.timeout from 60,000 to 1,800,000, it does not work. So, who can tell us why? By the way, the version of Nutch we use is 0.9 and the version of Hadoop is 0.12.
> Thanks for your help!
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Closed: (NUTCH-675) Reduce tasks do not report their status
and are killed by jobtracker
Posted by "Doğacan Güney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/NUTCH-675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doğacan Güney closed NUTCH-675.
-------------------------------
> Reduce tasks do not report their status and are killed by jobtracker
> --------------------------------------------------------------------
>
> Key: NUTCH-675
> URL: https://issues.apache.org/jira/browse/NUTCH-675
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 0.9.0
> Environment: OS : Linux
> Reporter: sha feng
> Fix For: 0.9.0
>
>
> We choose Fetcher2 as our fetcher. Map tasks of Fetcher2 fetches about 2,000,000 urls, but at reduce stage, all reduce tasks can not report their status and be killed by jobtracker. Although we change mapred.task.timeout from 60,000 to 1,800,000, it does not work. So, who can tell us why? By the way, the version of Nutch we use is 0.9 and the version of Hadoop is 0.12.
> Thanks for your help!
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.