You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@zeppelin.apache.org by mo...@apache.org on 2017/01/06 02:04:59 UTC
zeppelin git commit: [MINOR][DOCS] Add troubleshooting section to
spark_cluster_mode.md
Repository: zeppelin
Updated Branches:
refs/heads/master 759b4c52d -> eb893baa8
[MINOR][DOCS] Add troubleshooting section to spark_cluster_mode.md
### What is this PR for?
I faced a few problems while executing docker image described in [Spark on Mesos mode](http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/spark_cluster_mode.html#spark-on-mesos-mode). Thus I updated doc.
FYI, I am using
- Docker version 1.12.5, build 7392c3b
- OSX 10.11.6
### What type of PR is it?
[Documentation]
### Todos
Nothing
### What is the Jira issue?
MINOR, DOCS
### How should this be tested?
DOCS
### Screenshots (if appropriate)
Error 1
```
: java.net.UnknownHostException: moby: moby: Name or service not known
at java.net.InetAddress.getLocalHost(InetAddress.java:1496)
at org.apache.spark.util.Utils$.findLocalInetAddress(Utils.scala:789)
at org.apache.spark.util.Utils$.org$apache$spark$util$Utils$$localIpAddress$lzycompute(Utils.scala:782)
at org.apache.spark.util.Utils$.org$apache$spark$util$Utils$$localIpAddress(Utils.scala:782)
```
Error 2
```
I0103 20:17:22.329269 340 sched.cpp:330] New master detected at master127.0.1.1:5050
I0103 20:17:22.330749 340 sched.cpp:341] No credentials provided. Attempting to register without authentication
W0103 20:17:22.333531 340 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master127.0.0.1:5050' instead of the leading master 'master127.0.1.1:5050'
W0103 20:17:24.040252 339 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master127.0.0.1:5050' instead of the leading master 'master127.0.1.1:5050'
W0103 20:17:26.150250 339 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master127.0.0.1:5050' instead of the leading master 'master127.0.1.1:5050'
W0103 20:17:26.737604 339 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master127.0.0.1:5050' instead of the leading master 'master127.0.1.1:5050'
W0103 20:17:35.241714 336 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master127.0.0.1:5050' instead of the leading master 'master127.0.1.1:5050'
```
### Questions:
* Does the licenses files need update - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation - YES, I updated
Author: 1ambda <1a...@gmail.com>
Closes #1835 from 1ambda/docs/add-trouble-shooting-section-for-spark-mesos and squashes the following commits:
95f25c8 [1ambda] docs: Add troubleshooting sec to spark_cluster_mode.md
Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo
Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/eb893baa
Tree: http://git-wip-us.apache.org/repos/asf/zeppelin/tree/eb893baa
Diff: http://git-wip-us.apache.org/repos/asf/zeppelin/diff/eb893baa
Branch: refs/heads/master
Commit: eb893baa8beab4b2f8b80bb00e75092b9e77d34c
Parents: 759b4c5
Author: 1ambda <1a...@gmail.com>
Authored: Wed Jan 4 05:28:52 2017 +0900
Committer: Lee moon soo <mo...@apache.org>
Committed: Thu Jan 5 18:04:41 2017 -0800
----------------------------------------------------------------------
docs/install/spark_cluster_mode.md | 27 +++++++++++++++++++++++++++
1 file changed, 27 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/eb893baa/docs/install/spark_cluster_mode.md
----------------------------------------------------------------------
diff --git a/docs/install/spark_cluster_mode.md b/docs/install/spark_cluster_mode.md
index b848c96..36ba6f7 100644
--- a/docs/install/spark_cluster_mode.md
+++ b/docs/install/spark_cluster_mode.md
@@ -208,3 +208,30 @@ Don't forget to set Spark `master` as `mesos://127.0.1.1:5050` in Zeppelin **Int
After running a single paragraph with Spark interpreter in Zeppelin, browse `http://<hostname>:5050/#/frameworks` and check Zeppelin application is running well or not.
<img src="../assets/themes/zeppelin/img/docs-img/mesos_frameworks.png" />
+
+### Troubleshooting for Spark on Mesos
+
+- If you have problem with hostname, use `--add-host` option when executing `dockerrun`
+
+```
+## use `--add-host=moby:127.0.0.1` option to resolve
+## since docker container couldn't resolve `moby`
+
+: java.net.UnknownHostException: moby: moby: Name or service not known
+ at java.net.InetAddress.getLocalHost(InetAddress.java:1496)
+ at org.apache.spark.util.Utils$.findLocalInetAddress(Utils.scala:789)
+ at org.apache.spark.util.Utils$.org$apache$spark$util$Utils$$localIpAddress$lzycompute(Utils.scala:782)
+ at org.apache.spark.util.Utils$.org$apache$spark$util$Utils$$localIpAddress(Utils.scala:782)
+```
+
+- If you have problem with mesos master, try `mesos://127.0.0.1` instead of `mesos://127.0.1.1`
+
+```
+I0103 20:17:22.329269 340 sched.cpp:330] New master detected at master@127.0.1.1:5050
+I0103 20:17:22.330749 340 sched.cpp:341] No credentials provided. Attempting to register without authentication
+W0103 20:17:22.333531 340 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master@127.0.0.1:5050' instead of the leading master 'master@127.0.1.1:5050'
+W0103 20:17:24.040252 339 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master@127.0.0.1:5050' instead of the leading master 'master@127.0.1.1:5050'
+W0103 20:17:26.150250 339 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master@127.0.0.1:5050' instead of the leading master 'master@127.0.1.1:5050'
+W0103 20:17:26.737604 339 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master@127.0.0.1:5050' instead of the leading master 'master@127.0.1.1:5050'
+W0103 20:17:35.241714 336 sched.cpp:736] Ignoring framework registered message because it was sentfrom 'master@127.0.0.1:5050' instead of the leading master 'master@127.0.1.1:5050'
+```
\ No newline at end of file