You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2017/09/13 08:50:37 UTC
spark-website git commit: Update Yourkit usage
Repository: spark-website
Updated Branches:
refs/heads/asf-site a1f847efc -> 442b04535
Update Yourkit usage
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/442b0453
Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/442b0453
Diff: http://git-wip-us.apache.org/repos/asf/spark-website/diff/442b0453
Branch: refs/heads/asf-site
Commit: 442b04535b78fed3f778e12e05678774fd16c832
Parents: a1f847e
Author: Takeshi Yamamuro <ya...@apache.org>
Authored: Mon Sep 11 10:52:05 2017 +0900
Committer: Sean Owen <so...@cloudera.com>
Committed: Wed Sep 13 09:50:03 2017 +0100
----------------------------------------------------------------------
developer-tools.md | 14 +++++++-------
site/developer-tools.html | 14 +++++++-------
2 files changed, 14 insertions(+), 14 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark-website/blob/442b0453/developer-tools.md
----------------------------------------------------------------------
diff --git a/developer-tools.md b/developer-tools.md
index dab3e8a..c975e80 100644
--- a/developer-tools.md
+++ b/developer-tools.md
@@ -389,19 +389,19 @@ Here are instructions on profiling Spark applications using YourKit Java Profile
<a href="https://www.yourkit.com/download/index.jsp">YourKit downloads page</a>.
This file is pretty big (~100 MB) and YourKit downloads site is somewhat slow, so you may
consider mirroring this file or including it on a custom AMI.
-- Untar this file somewhere (in `/root` in our case): `tar xvjf yjp-12.0.5-linux.tar.bz2`
-- Copy the expanded YourKit files to each node using copy-dir: `~/spark-ec2/copy-dir /root/yjp-12.0.5`
+- Unzip this file somewhere (in `/root` in our case): `unzip YourKit-JavaProfiler-2017.02-b66.zip`
+- Copy the expanded YourKit files to each node using copy-dir: `~/spark-ec2/copy-dir /root/YourKit-JavaProfiler-2017.02`
- Configure the Spark JVMs to use the YourKit profiling agent by editing `~/spark/conf/spark-env.sh`
and adding the lines
```
-SPARK_DAEMON_JAVA_OPTS+=" -agentpath:/root/yjp-12.0.5/bin/linux-x86-64/libyjpagent.so=sampling"
+SPARK_DAEMON_JAVA_OPTS+=" -agentpath:/root/YourKit-JavaProfiler-2017.02/bin/linux-x86-64/libyjpagent.so=sampling"
export SPARK_DAEMON_JAVA_OPTS
-SPARK_JAVA_OPTS+=" -agentpath:/root/yjp-12.0.5/bin/linux-x86-64/libyjpagent.so=sampling"
-export SPARK_JAVA_OPTS
+SPARK_EXECUTOR_OPTS+=" -agentpath:/root/YourKit-JavaProfiler-2017.02/bin/linux-x86-64/libyjpagent.so=sampling"
+export SPARK_EXECUTOR_OPTS
```
- Copy the updated configuration to each node: `~/spark-ec2/copy-dir ~/spark/conf/spark-env.sh`
- Restart your Spark cluster: `~/spark/bin/stop-all.sh` and `~/spark/bin/start-all.sh`
-- By default, the YourKit profiler agents use ports 10001-10010. To connect the YourKit desktop
+- By default, the YourKit profiler agents use ports `10001-10010`. To connect the YourKit desktop
application to the remote profiler agents, you'll have to open these ports in the cluster's EC2
security groups. To do this, sign into the AWS Management Console. Go to the EC2 section and
select `Security Groups` from the `Network & Security` section on the left side of the page.
@@ -417,7 +417,7 @@ cluster with the same name, your security group settings will be re-used.
- YourKit should now be connected to the remote profiling agent. It may take a few moments for profiling information to appear.
Please see the full YourKit documentation for the full list of profiler agent
-<a href="http://www.yourkit.com/docs/80/help/startup_options.jsp">startup options</a>.
+<a href="https://www.yourkit.com/docs/java/help/startup_options.jsp">startup options</a>.
<h4>In Spark unit tests</h4>
http://git-wip-us.apache.org/repos/asf/spark-website/blob/442b0453/site/developer-tools.html
----------------------------------------------------------------------
diff --git a/site/developer-tools.html b/site/developer-tools.html
index 9a9ec8a..d8e3585 100644
--- a/site/developer-tools.html
+++ b/site/developer-tools.html
@@ -568,19 +568,19 @@ version: 1.5.0-SNAPSHOT
<a href="https://www.yourkit.com/download/index.jsp">YourKit downloads page</a>.
This file is pretty big (~100 MB) and YourKit downloads site is somewhat slow, so you may
consider mirroring this file or including it on a custom AMI.</li>
- <li>Untar this file somewhere (in <code>/root</code> in our case): <code>tar xvjf yjp-12.0.5-linux.tar.bz2</code></li>
- <li>Copy the expanded YourKit files to each node using copy-dir: <code>~/spark-ec2/copy-dir /root/yjp-12.0.5</code></li>
+ <li>Unzip this file somewhere (in <code>/root</code> in our case): <code>unzip YourKit-JavaProfiler-2017.02-b66.zip</code></li>
+ <li>Copy the expanded YourKit files to each node using copy-dir: <code>~/spark-ec2/copy-dir /root/YourKit-JavaProfiler-2017.02</code></li>
<li>Configure the Spark JVMs to use the YourKit profiling agent by editing <code>~/spark/conf/spark-env.sh</code>
and adding the lines
- <pre><code>SPARK_DAEMON_JAVA_OPTS+=" -agentpath:/root/yjp-12.0.5/bin/linux-x86-64/libyjpagent.so=sampling"
+ <pre><code>SPARK_DAEMON_JAVA_OPTS+=" -agentpath:/root/YourKit-JavaProfiler-2017.02/bin/linux-x86-64/libyjpagent.so=sampling"
export SPARK_DAEMON_JAVA_OPTS
-SPARK_JAVA_OPTS+=" -agentpath:/root/yjp-12.0.5/bin/linux-x86-64/libyjpagent.so=sampling"
-export SPARK_JAVA_OPTS
+SPARK_EXECUTOR_OPTS+=" -agentpath:/root/YourKit-JavaProfiler-2017.02/bin/linux-x86-64/libyjpagent.so=sampling"
+export SPARK_EXECUTOR_OPTS
</code></pre>
</li>
<li>Copy the updated configuration to each node: <code>~/spark-ec2/copy-dir ~/spark/conf/spark-env.sh</code></li>
<li>Restart your Spark cluster: <code>~/spark/bin/stop-all.sh</code> and <code>~/spark/bin/start-all.sh</code></li>
- <li>By default, the YourKit profiler agents use ports 10001-10010. To connect the YourKit desktop
+ <li>By default, the YourKit profiler agents use ports <code>10001-10010</code>. To connect the YourKit desktop
application to the remote profiler agents, you’ll have to open these ports in the cluster’s EC2
security groups. To do this, sign into the AWS Management Console. Go to the EC2 section and
select <code>Security Groups</code> from the <code>Network & Security</code> section on the left side of the page.
@@ -597,7 +597,7 @@ cluster with the same name, your security group settings will be re-used.</li>
</ul>
<p>Please see the full YourKit documentation for the full list of profiler agent
-<a href="http://www.yourkit.com/docs/80/help/startup_options.jsp">startup options</a>.</p>
+<a href="https://www.yourkit.com/docs/java/help/startup_options.jsp">startup options</a>.</p>
<h4>In Spark unit tests</h4>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org