[jira] [Created] (SPARK-17449) executorTimeoutMs configure error

["Yang Liang (JIRA)" <ji...@apache.org>]

Yang Liang created SPARK-17449:
----------------------------------

             Summary: executorTimeoutMs configure error
                 Key: SPARK-17449
                 URL: https://issues.apache.org/jira/browse/SPARK-17449
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
            Reporter: Yang Liang




$ spark-shell --master yarn --conf spark.executor.heartbeatInterval=20s --num-executors 1

WARN HeartbeatReceiver: Removing executor 1 with no recent heartbeats: 168136 ms exceeds timeout 120000 ms
ERROR YarnScheduler: Lost executor 1 on datanode16: Executor heartbeat timed out after 168136 ms


spark-shell --master yarn --conf spark.executor.heartbeatInterval=200s --conf spark.network.timeout=10s --num-executors 1

WARN HeartbeatReceiver: Removing executor 1 with no recent heartbeats: 11949 ms exceeds timeout 10000 ms
ERROR YarnScheduler: Lost executor 1 on datanode31: Executor heartbeat timed out after 11949 m


spark-shell --master yarn --conf spark.executor.heartbeatInterval=200s --conf spark.network.timeout=10s --num-executors 1

WARN HeartbeatReceiver: Removing executor 1 with no recent heartbeats: 39299 ms exceeds timeout 10000 ms
ERROR YarnScheduler: Lost executor 1 on datanode19: Executor heartbeat timed out after 39299 ms


Source Code:

spark/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala

private val executorTimeoutMs =
    sc.conf.getTimeAsSeconds("spark.network.timeout", s"${slaveTimeoutMs}ms") * 1000




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org