You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Harsh J (JIRA)" <ji...@apache.org> on 2012/05/04 13:40:48 UTC
[jira] [Created] (BIGTOP-577) [base conf] There's no
hadoop-metrics2.properties present in the configs that are shipped.
Harsh J created BIGTOP-577:
------------------------------
Summary: [base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.
Key: BIGTOP-577
URL: https://issues.apache.org/jira/browse/BIGTOP-577
Project: Bigtop
Issue Type: Improvement
Components: General
Reporter: Harsh J
Priority: Minor
The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:
{code}
[root@test ~]# ls -l /etc/hadoop/conf/
total 40
-rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
-rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
-rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
-rwxr-xr-x. 1 root root 1875 May 3 18:54 hdfs-site.xml
-rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
-rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
-rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
-rwxr-xr-x. 1 root root 2077 May 4 11:54 yarn-site.xml
{code}
And hence it leads to logs in RM such as:
{{2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties}}
We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:
{code}
./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
{code}
Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the {{HADOOP}} project.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-577) [base conf] There's no
hadoop-metrics2.properties present in the configs that are shipped.
Posted by "Peter Linnell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268517#comment-13268517 ]
Peter Linnell commented on BIGTOP-577:
--------------------------------------
+1 LGTM
> [base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.
> ------------------------------------------------------------------------------------------
>
> Key: BIGTOP-577
> URL: https://issues.apache.org/jira/browse/BIGTOP-577
> Project: Bigtop
> Issue Type: Improvement
> Components: General
> Affects Versions: 0.4.0
> Reporter: Harsh J
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 0.4.0
>
> Attachments: BIGTOP-577.patch.txt
>
>
> The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:
> {code}
> [root@test ~]# ls -l /etc/hadoop/conf/
> total 40
> -rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
> -rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
> -rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
> -rwxr-xr-x. 1 root root 1875 May 3 18:54 hdfs-site.xml
> -rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
> -rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
> -rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
> -rwxr-xr-x. 1 root root 2077 May 4 11:54 yarn-site.xml
> {code}
> And hence it leads to logs in RM such as:
> {{2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties}}
> We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:
> {code}
> ./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
> ./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
> ./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
> {code}
> Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the {{HADOOP}} project.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-577) [base conf] There's no
hadoop-metrics2.properties present in the configs that are shipped.
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-577:
------------------------------------
Attachment: BIGTOP-577.patch.txt
> [base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.
> ------------------------------------------------------------------------------------------
>
> Key: BIGTOP-577
> URL: https://issues.apache.org/jira/browse/BIGTOP-577
> Project: Bigtop
> Issue Type: Improvement
> Components: General
> Affects Versions: 0.4.0
> Reporter: Harsh J
> Priority: Minor
> Fix For: 0.4.0
>
> Attachments: BIGTOP-577.patch.txt
>
>
> The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:
> {code}
> [root@test ~]# ls -l /etc/hadoop/conf/
> total 40
> -rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
> -rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
> -rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
> -rwxr-xr-x. 1 root root 1875 May 3 18:54 hdfs-site.xml
> -rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
> -rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
> -rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
> -rwxr-xr-x. 1 root root 2077 May 4 11:54 yarn-site.xml
> {code}
> And hence it leads to logs in RM such as:
> {{2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties}}
> We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:
> {code}
> ./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
> ./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
> ./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
> {code}
> Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the {{HADOOP}} project.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-577) [base conf] There's no
hadoop-metrics2.properties present in the configs that are shipped.
Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268483#comment-13268483 ]
Roman Shaposhnik commented on BIGTOP-577:
-----------------------------------------
Thank for the bug report. The patch is attached.
> [base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.
> ------------------------------------------------------------------------------------------
>
> Key: BIGTOP-577
> URL: https://issues.apache.org/jira/browse/BIGTOP-577
> Project: Bigtop
> Issue Type: Improvement
> Components: General
> Affects Versions: 0.4.0
> Reporter: Harsh J
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 0.4.0
>
> Attachments: BIGTOP-577.patch.txt
>
>
> The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:
> {code}
> [root@test ~]# ls -l /etc/hadoop/conf/
> total 40
> -rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
> -rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
> -rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
> -rwxr-xr-x. 1 root root 1875 May 3 18:54 hdfs-site.xml
> -rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
> -rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
> -rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
> -rwxr-xr-x. 1 root root 2077 May 4 11:54 yarn-site.xml
> {code}
> And hence it leads to logs in RM such as:
> {{2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties}}
> We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:
> {code}
> ./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
> ./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
> ./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
> {code}
> Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the {{HADOOP}} project.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira