You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/07/06 00:07:51 UTC
(spark) branch master updated: [SPARK-52560][BUILD] Bump ap-loader 4.0(v10) to support for async-profiler 4.0
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new d1d29f9dd9ae [SPARK-52560][BUILD] Bump ap-loader 4.0(v10) to support for async-profiler 4.0
d1d29f9dd9ae is described below
commit d1d29f9dd9ae8a9dcee3147e7276dd4cffdb541d
Author: wforget <64...@qq.com>
AuthorDate: Sat Jul 5 17:07:39 2025 -0700
[SPARK-52560][BUILD] Bump ap-loader 4.0(v10) to support for async-profiler 4.0
### What changes were proposed in this pull request?
Bump ap-loader 4.0-10
### Why are the changes needed?
ap-loader 4.0 (v10) has already been released, which supports for async-profier 4.0. The release guide refers to [Loader for 4.0 (v10): Heatmaps and Native memory profiling](https://github.com/jvm-profiling-tools/ap-loader/releases/tag/4.0-10)
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #51257 from wForget/SPARK-52560.
Authored-by: wforget <64...@qq.com>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
connector/profiler/README.md | 4 ++--
pom.xml | 2 +-
2 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/connector/profiler/README.md b/connector/profiler/README.md
index 9e0a58444c60..742b1a8bb5da 100644
--- a/connector/profiler/README.md
+++ b/connector/profiler/README.md
@@ -16,7 +16,7 @@ or
## Executor Code Profiling
-The spark profiler module enables code profiling of executors in cluster mode based on the [async profiler](https://github.com/async-profiler/async-profiler/blob/v3.0/README.md), a low overhead sampling profiler. This allows a Spark application to capture CPU and memory profiles for application running on a cluster which can later be analyzed for performance issues. The profiler captures [Java Flight Recorder (jfr)](https://access.redhat.com/documentation/es-es/red_hat_build_of_openjdk/1 [...]
+The spark profiler module enables code profiling of executors in cluster mode based on the [async profiler](https://github.com/async-profiler/async-profiler/blob/v4.0/README.md), a low overhead sampling profiler. This allows a Spark application to capture CPU and memory profiles for application running on a cluster which can later be analyzed for performance issues. The profiler captures [Java Flight Recorder (jfr)](https://access.redhat.com/documentation/es-es/red_hat_build_of_openjdk/1 [...]
The profiler writes the jfr files to the executor's working directory in the executor's local file system and the files can grow to be large, so it is advisable that the executor machines have adequate storage. The profiler can be configured to copy the jfr files to a hdfs location before the executor shuts down.
@@ -95,7 +95,7 @@ Then enable the profiling in the configuration.
<td>event=wall,interval=10ms,alloc=2m,lock=10ms,chunktime=300s</td>
<td>
Arguments to pass to the Async Profiler. Detailed options are documented in the comments here:
- <a href="https://github.com/async-profiler/async-profiler/blob/v3.0/src/arguments.cpp#L44">Profiler arguments</a>.
+ <a href="https://github.com/async-profiler/async-profiler/blob/v4.0/docs/ProfilerOptions.md">Profiler options</a>.
Note that the arguments to start, stop, specify output format, and output file do not have to be specified.
</td>
<td>4.0.0</td>
diff --git a/pom.xml b/pom.xml
index aa0b984cfa87..1037eaf2863e 100644
--- a/pom.xml
+++ b/pom.xml
@@ -308,7 +308,7 @@
<tomcat.annotations.api.version>6.0.53</tomcat.annotations.api.version>
<!-- Version used in Profiler -->
- <ap-loader.version>3.0-9</ap-loader.version>
+ <ap-loader.version>4.0-10</ap-loader.version>
<CodeCacheSize>128m</CodeCacheSize>
<!-- Needed for consistent times -->
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org