You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Srikanth (JIRA)" <ji...@apache.org> on 2016/10/24 12:20:58 UTC
[jira] [Closed] (SPARK-18052) Spark Job failing with
org.apache.spark.rpc.RpcTimeoutException
[ https://issues.apache.org/jira/browse/SPARK-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Srikanth closed SPARK-18052.
----------------------------
Resolution: Not A Bug
> Spark Job failing with org.apache.spark.rpc.RpcTimeoutException
> ---------------------------------------------------------------
>
> Key: SPARK-18052
> URL: https://issues.apache.org/jira/browse/SPARK-18052
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 2.0.0
> Environment: 3 node spark cluster, all AWS r3.xlarge instances running on ubuntu.
> Reporter: Srikanth
> Attachments: sparkErrorLog.txt
>
>
> Spark submit jobs are failing with org.apache.spark.rpc.RpcTimeoutException. increased the spark.executor.heartbeatInterval value from 10s to 60s, but still the same issue.
> This is happening while saving a dataframe to a mounted network drive. Not using HDFS here. We are able to write successfully for smaller size files under 10G, the data here we are reading is nearly 20G
> driver memory = 10G
> executor memory = 25G
> Please see the attached log file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org