You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/08/10 16:34:08 UTC
[spark] branch master updated: [SPARK-32409][DOC] Document
dependency between spark.metrics.staticSources.enabled and JVMSource
registration
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 99f50c6 [SPARK-32409][DOC] Document dependency between spark.metrics.staticSources.enabled and JVMSource registration
99f50c6 is described below
commit 99f50c6286f4d86c02a15a0efd3046888ac45c75
Author: Luca Canali <lu...@cern.ch>
AuthorDate: Mon Aug 10 09:32:01 2020 -0700
[SPARK-32409][DOC] Document dependency between spark.metrics.staticSources.enabled and JVMSource registration
### What changes were proposed in this pull request?
Document the dependency between the config `spark.metrics.staticSources.enabled` and JVMSource registration.
### Why are the changes needed?
This PT just documents the dependency between config `spark.metrics.staticSources.enabled` and JVM source registration.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manually tested.
Closes #29203 from LucaCanali/bugJVMMetricsRegistration.
Authored-by: Luca Canali <lu...@cern.ch>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
docs/monitoring.md | 10 ++++++----
1 file changed, 6 insertions(+), 4 deletions(-)
diff --git a/docs/monitoring.md b/docs/monitoring.md
index 247957d..5fdf308 100644
--- a/docs/monitoring.md
+++ b/docs/monitoring.md
@@ -1082,7 +1082,7 @@ This is the component with the largest amount of instrumented metrics
- memory.remainingOnHeapMem_MB
- namespace=HiveExternalCatalog
- - **note:**: these metrics are conditional to a configuration parameter:
+ - **note:** these metrics are conditional to a configuration parameter:
`spark.metrics.staticSources.enabled` (default is true)
- fileCacheHits.count
- filesDiscovered.count
@@ -1091,7 +1091,7 @@ This is the component with the largest amount of instrumented metrics
- partitionsFetched.count
- namespace=CodeGenerator
- - **note:**: these metrics are conditional to a configuration parameter:
+ - **note:** these metrics are conditional to a configuration parameter:
`spark.metrics.staticSources.enabled` (default is true)
- compilationTime (histogram)
- generatedClassSize (histogram)
@@ -1254,7 +1254,7 @@ when running in local mode.
- shuffle-server.usedHeapMemory
- namespace=HiveExternalCatalog
- - **note:**: these metrics are conditional to a configuration parameter:
+ - **note:** these metrics are conditional to a configuration parameter:
`spark.metrics.staticSources.enabled` (default is true)
- fileCacheHits.count
- filesDiscovered.count
@@ -1263,7 +1263,7 @@ when running in local mode.
- partitionsFetched.count
- namespace=CodeGenerator
- - **note:**: these metrics are conditional to a configuration parameter:
+ - **note:** these metrics are conditional to a configuration parameter:
`spark.metrics.staticSources.enabled` (default is true)
- compilationTime (histogram)
- generatedClassSize (histogram)
@@ -1280,6 +1280,8 @@ when running in local mode.
Notes:
- Activate this source by setting the relevant `metrics.properties` file entry or the
configuration parameter:`spark.metrics.conf.*.source.jvm.class=org.apache.spark.metrics.source.JvmSource`
+ - These metrics are conditional to a configuration parameter:
+ `spark.metrics.staticSources.enabled` (default is true)
- This source is available for driver and executor instances and is also available for other instances.
- This source provides information on JVM metrics using the
[Dropwizard/Codahale Metric Sets for JVM instrumentation](https://metrics.dropwizard.io/3.1.0/manual/jvm/)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org