You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "dhruba borthakur (JIRA)" <ji...@apache.org> on 2007/03/30 19:58:25 UTC
[jira] Created: (HADOOP-1185) dynamically change dfs log levels
dynamically change dfs log levels
---------------------------------
Key: HADOOP-1185
URL: https://issues.apache.org/jira/browse/HADOOP-1185
Project: Hadoop
Issue Type: Improvement
Components: dfs
Reporter: dhruba borthakur
Assigned To: dhruba borthakur
I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539452 ]
Nigel Daley commented on HADOOP-1185:
-------------------------------------
A couple comments on the test:
testLog4JLogger() -> testDynamicLogLevelJSP()
output a message is the logger isn't an instanceof Log4JLogger so that at least you know the test was run.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539419 ]
dhruba borthakur commented on HADOOP-1185:
------------------------------------------
It would be nice to be able to change log levels from a command line utility too. Maybe an additional class in org.apache.hadoop.log is all that is necessary.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071101.patch)
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071102.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071030.patch
1185_20071030.patch: removed action in form. Thanks, Raghu.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537925 ]
Enis Soztutar commented on HADOOP-1185:
---------------------------------------
bq. I copy the file to all jsp directories (i.e. src/webapps/dfs, src/webapps/job, etc). Is there a better way?
I think Owen's method of adding a servlet to StatusHttpServer will be better i guess.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071025.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1185) dynamically change dfs log levels
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur reassigned HADOOP-1185:
----------------------------------------
Assignee: Tsz Wo (Nicholas), SZE (was: dhruba borthakur)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071024.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Status: Patch Available (was: Open)
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071102.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-1185:
-------------------------------------
Status: Open (was: Patch Available)
Would like a command line utility to change log levels.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071101.patch
1185_20071101.patch
- testLog4JLogger() -> testDynamicLogLevel()
- output a message in the test when the logger isn't an instanceof Log4JLogger
- Added a command daemonlog (or org.apache.hadoop.log.LogLevel)
- Added codes for testing the command.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071101.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538933 ]
Hadoop QA commented on HADOOP-1185:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12368715/1185_20071030b.patch
against trunk revision r590273.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests -1. The patch failed core unit tests.
contrib tests -1. The patch failed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1033/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1033/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1033/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1033/console
This message is automatically generated.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488432 ]
Owen O'Malley commented on HADOOP-1185:
---------------------------------------
The best approach would be something along the lines of:
Log LOG = ...;
if (LOG instanceof Log4JLogger) {
org.apache.log4j.Logger l4j = ((Log4JLogger) LOG).getLogger();
... control the logger in log4j specific ways...
}
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assigned To: dhruba borthakur
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-1185:
-------------------------------------
Fix Version/s: 0.15.0
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Fix For: 0.15.0
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-1185:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this. Thanks Nicholas!
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071102.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539970 ]
Hadoop QA commented on HADOOP-1185:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12368903/1185_20071102.patch
against trunk revision r591549.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1058/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1058/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1058/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1058/console
This message is automatically generated.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071102.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Status: Patch Available (was: Open)
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071101.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488451 ]
Owen O'Malley commented on HADOOP-1185:
---------------------------------------
I'd suggest putting a little servlet into StatusHttpServer so that all of the servers will respond to the same url. Something like:
http://$host:$port/setLogLevel?log=org.apache.hadoop.mapred.TaskTracker&level=debug
will push that server into logging the TaskTracker class at the debug level.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assigned To: dhruba borthakur
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071029.patch
Enis, I also think it is better.
1185_20071029.patch: Changed jsp to servlet.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071029.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Status: Open (was: Patch Available)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071030b.patch
1185_20071030b.patch: made the changes suggested by Raghu.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071029b.patch)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Component/s: (was: dfs)
util
Description:
I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
was:
I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
Summary: dynamically change log levels (was: dynamically change dfs log levels)
Edited the title and the description since the patch is working for all system components using StatusHttpServer.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071031.patch
1185_20071031.patch: using Java 5 now and added a junit test.
Nigel, you idea of the junit test is great, thanks!
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539430 ]
Doug Cutting commented on HADOOP-1185:
--------------------------------------
> Would like a command line utility to change log levels.
This sounds like a good thing to add to GenericOptionsParser, so that one can set log levels for any command line tool. Should we do that as a part of this issue or in a separate issue?
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539311 ]
Hadoop QA commented on HADOOP-1185:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12368794/1185_20071031.patch
against trunk revision r590875.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1048/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1048/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1048/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1048/console
This message is automatically generated.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12540477 ]
Hudson commented on HADOOP-1185:
--------------------------------
Integrated in Hadoop-Nightly #295 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/295/])
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071102.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071030.patch)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538945 ]
Nigel Daley commented on HADOOP-1185:
-------------------------------------
-1
No unit test.
Looks like you used a Java 6 constructor.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539750 ]
Hadoop QA commented on HADOOP-1185:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12368846/1185_20071101.patch
against trunk revision r591506.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs -1. The patch appears to introduce 1 new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1056/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1056/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1056/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1056/console
This message is automatically generated.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071101.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Status: Patch Available (was: Open)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538931 ]
Raghu Angadi commented on HADOOP-1185:
--------------------------------------
+1.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538871 ]
Raghu Angadi commented on HADOOP-1185:
--------------------------------------
Full request url is still used for 'Back' link. You can just use the Path part or last component of Path for back. Or just a javascript back.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071029.patch)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071025.patch)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Status: Open (was: Patch Available)
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071102.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Enis Soztutar updated HADOOP-1185:
----------------------------------
Fix Version/s: 0.16.0
Affects Version/s: 0.16.0
Status: Patch Available (was: Open)
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539459 ]
Doug Cutting commented on HADOOP-1185:
--------------------------------------
Sorry, I spoke out of context. A generic command line option makes sense for setting the log level of client programs, not daemons. So someone should be able to specify '-loglevel DEBUG' for any Hadoop command and have it affect the logging done by that command. But that's a separate issue from what's discussed here, and perhaps there's an easy way to do this already. (Is there?)
For the issue here, changing the log level of daemon processes, i agree that a separate command is needed. My preference might be something like:
bin/hadoop daemonlog -setlevel host:port NAME LEVEL
We use the term 'daemon' to generically refer to all our daemons. Perhaps the command could also read logs with something like, 'bin/hadoop daemonlog -tail NAME'? So the command might provide generic access to the logs of our daemons. That might not be supported in the first version, but would be the long-term plan for the command.
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071025.patch
1185_20071025.patch supports Log4JLogger and Jdk14Logger. It will show a message for unsupported loggers.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071024.patch, 1185_20071025.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071024.patch)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071025.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539456 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-1185:
------------------------------------------------
> This sounds like a good thing to add to GenericOptionsParser
Then, how would the command look like? I am thinking something like
hadoop LogLevel -get host:port logName
hadoop LogLevel -set host:port logName level
or using url (i.e. the same way as the servlet)
hadoop LogLevel http://host:port/logLevel?log=name&level=lev
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071031.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071102.patch
Fixed the findbugs warning
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
> Attachments: 1185_20071102.patch
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071030b.patch)
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: (was: 1185_20071031.patch)
> dynamically change log levels
> -----------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.16.0
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Fix For: 0.16.0
>
>
> I would like to switch on the debug log level of the namenode (or other components) without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537495 ]
dhruba borthakur commented on HADOOP-1185:
------------------------------------------
Can we make the jsp print an appropriate error message if the logging module that we use is not log4j?
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Attachments: 1185_20071024.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538873 ]
Raghu Angadi commented on HADOOP-1185:
--------------------------------------
You actully don't need 'Back' button. Both pages are same. You can always print the forms.. and if there other information to display that would be before the forms.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071030.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071029b.patch
1185_20071029b.patch: Raghu suggests that I should put addServlet(...) to the constructor of StatusHttpServer instead of doing it for each server.
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071029b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1185) dynamically change dfs log levels
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-1185:
-------------------------------------------
Attachment: 1185_20071024.patch
1185_20071024.patch provides a web page (logLevel.jsp) to change log level in runtime. I copy the file to all jsp directories (i.e. src/webapps/dfs, src/webapps/job, etc). Is there a better way?
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: dhruba borthakur
> Attachments: 1185_20071024.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by Nigel Daley <nd...@yahoo-inc.com>.
It shouldn't be very hard to add a test for this new feature.
On Oct 29, 2007, at 6:31 PM, Raghu Angadi (JIRA) wrote:
>
> [ https://issues.apache.org/jira/browse/HADOOP-1185?
> page=com.atlassian.jira.plugin.system.issuetabpanels:comment-
> tabpanel#action_12538645 ]
>
> Raghu Angadi commented on HADOOP-1185:
> --------------------------------------
>
> Looks good.
>
> The code sets <form action> to request url that server sees. This
> won't work if the server is behind a (server side) proxy. You can
> just remove 'action' attribute and the browser defaults to current
> url (that browser sees, which is what you really want).
>
>
>> dynamically change dfs log levels
>> ---------------------------------
>>
>> Key: HADOOP-1185
>> URL: https://issues.apache.org/jira/browse/
>> HADOOP-1185
>> Project: Hadoop
>> Issue Type: Improvement
>> Components: dfs
>> Reporter: dhruba borthakur
>> Assignee: Tsz Wo (Nicholas), SZE
>> Attachments: 1185_20071029b.patch
>>
>>
>> I would like to switch on the debug log level of the namenode
>> without restarting it. This is needed to analyze a production system.
>> Can somebody please advice on how to set the loglevel dyncamically
>> on a running namenode? I was thinking of enhancing dfsadmin to
>> make an RPC to the namenode to set a specified logging level. But
>> the apache common logging APi does not export an API to change
>> logging levels.
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538645 ]
Raghu Angadi commented on HADOOP-1185:
--------------------------------------
Looks good.
The code sets <form action> to request url that server sees. This won't work if the server is behind a (server side) proxy. You can just remove 'action' attribute and the browser defaults to current url (that browser sees, which is what you really want).
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: 1185_20071029b.patch
>
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1185) dynamically change dfs log levels
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488430 ]
dhruba borthakur commented on HADOOP-1185:
------------------------------------------
The apache common logging API does not let me set logging levels. Can somebody please suggest how I can get to the underlying log4j object?
> dynamically change dfs log levels
> ---------------------------------
>
> Key: HADOOP-1185
> URL: https://issues.apache.org/jira/browse/HADOOP-1185
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs
> Reporter: dhruba borthakur
> Assigned To: dhruba borthakur
>
> I would like to switch on the debug log level of the namenode without restarting it. This is needed to analyze a production system.
> Can somebody please advice on how to set the loglevel dyncamically on a running namenode? I was thinking of enhancing dfsadmin to make an RPC to the namenode to set a specified logging level. But the apache common logging APi does not export an API to change logging levels.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.