You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by KhajaAsmath Mohammed <md...@gmail.com> on 2016/11/17 20:15:52 UTC
Spark Submit --> Unable to reach cluster manager to request executors

Hello Everyone,

Could you please let me know if there any optimal way to request executors
while submitting job in yarn mode.

My job is running slow by printing out following statements. Is there a way
to speed up process?


16/11/17 14:03:49 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:49 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 2 total executors!
16/11/17 14:03:50 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:50 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 3 total executors!
16/11/17 14:03:51 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:51 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 4 total executors!
16/11/17 14:03:52 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:52 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 5 total executors!
16/11/17 14:03:53 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:53 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 6 total executors!
16/11/17 14:03:54 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:54 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 7 total executors!
16/11/17 14:03:55 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:55 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 8 total executors!
16/11/17 14:03:56 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:56 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 9 total executors!
16/11/17 14:03:57 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:57 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 10 total executors!
16/11/17 14:03:58 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:58 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 11 total executors!
16/11/17 14:03:59 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode
16/11/17 14:03:59 WARN spark.ExecutorAllocationManager: Unable to reach the
cluster manager to request 12 total executors!
16/11/17 14:04:00 WARN spark.SparkContext: Requesting executors is only
supported in coarse-grained mode

Thanks,
Asmath.