You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "liuzhaokun (JIRA)" <ji...@apache.org> on 2017/05/25 12:00:08 UTC
[jira] [Created] (SPARK-20884) Spark' masters will be both standby
due to the bug of curator
liuzhaokun created SPARK-20884:
----------------------------------
Summary: Spark' masters will be both standby due to the bug of curator
Key: SPARK-20884
URL: https://issues.apache.org/jira/browse/SPARK-20884
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.1.1
Reporter: liuzhaokun
I built a cluster with two masters and three workers.When there is a switch of master's state,two masters are both standby in a long period.There are some ERROR in master's logfile " ERROR CuratorFrameworkImpl: Background exception was not retry-able or retry gave up
java.lang.IllegalArgumentException: Path must start with / character
at org.apache.curator.utils.PathUtils.validatePath(PathUtils.java:53)
at org.apache.curator.utils.ZKPaths.getNodeFromPath(ZKPaths.java:56)
at org.apache.curator.framework.recipes.leader.LeaderLatch.checkLeadership(LeaderLatch.java:421)
at org.apache.curator.framework.recipes.leader.LeaderLatch.access$500(LeaderLatch.java:60)
at org.apache.curator.framework.recipes.leader.LeaderLatch$6.processResult(LeaderLatch.java:478)
at org.apache.curator.framework.imps.CuratorFrameworkImpl.sendToBackgroundCallback(CuratorFrameworkImpl.java:686)
at org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:485)
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$2.processResult(GetChildrenBuilderImpl.java:166)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:587)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)"
it can be related to https://issues.apache.org/jira/browse/CURATOR-168.
So I think the version of curator in spark should be 2.8.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org