You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2007/01/23 06:10:49 UTC
[jira] Created: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
HADOOP-801 doesn't add property to hadoop-default.xml
-----------------------------------------------------
Key: HADOOP-919
URL: https://issues.apache.org/jira/browse/HADOOP-919
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.11.0
Reporter: Nigel Daley
Priority: Minor
HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12472187 ]
Arun C Murthy commented on HADOOP-919:
--------------------------------------
Without being aware of HADOOP-919, I've added 'jobclient.output.filter' to hadoop-default.xml (default value of 'FAILED') while on HADOOP-977; should we close this bug and open a new 'Improvement' bug to track Owen's request (i.e. add a TrackerFailure event) ?
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Priority: Minor
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-919:
-------------------------------
Attachment: HADOOP-919.patch
Attached patch makes NONE the default and add the property to hadoop-default.xml
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Priority: Minor
> Fix For: 0.11.0
>
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley reassigned HADOOP-919:
----------------------------------
Assignee: (was: Nigel Daley)
This is no longer a simple config file fix. Someone else is welcome to pick it up.
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Priority: Minor
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated HADOOP-919:
--------------------------------
Status: Open (was: Patch Available)
I agree that we should add a default value to hadoop-default.xml, but I don't think it sholuld be NONE, I think it should be FAILED, but that the output should be much more brief. Folks shouldn't see the full stack dump for every thread, but rather just a one-line message indicating that the task has failed. The gory details should be available through the web ui and logs. Perhaps the one-line message could even include a link to the gory details?
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Priority: Minor
> Fix For: 0.11.0
>
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12466795 ]
Owen O'Malley commented on HADOOP-919:
--------------------------------------
Another reduction that would be nice is to have a single lost task tracker event rather than losing all 300 map tasks that were stored on that machine. I'd much rather get a single line saying "task tracker node1234 lost" than 300 task failure reports.
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Priority: Minor
> Fix For: 0.11.0
>
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley reassigned HADOOP-919:
----------------------------------
Assignee: Nigel Daley
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Priority: Minor
> Fix For: 0.11.0
>
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12466666 ]
Hadoop QA commented on HADOOP-919:
----------------------------------
+1, because http://issues.apache.org/jira/secure/attachment/12349421/HADOOP-919.patch applied and successfully tested against trunk revision r498829.
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Priority: Minor
> Fix For: 0.11.0
>
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-919) HADOOP-801 doesn't add property to
hadoop-default.xml
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-919:
-------------------------------
Fix Version/s: 0.11.0
Status: Patch Available (was: Open)
> HADOOP-801 doesn't add property to hadoop-default.xml
> -----------------------------------------------------
>
> Key: HADOOP-919
> URL: https://issues.apache.org/jira/browse/HADOOP-919
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Priority: Minor
> Fix For: 0.11.0
>
> Attachments: HADOOP-919.patch
>
>
> HADOOP-801 (in fixing HADOOP-805) adds a new configuration option -- jobclient.output.filter. This property should have also been added to hadoop-default.xml with a default value of NONE (the current default of FAILURE is too verbose with INFO exceptions).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.