You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by shitijkuls <ku...@gmail.com> on 2017/08/22 18:16:06 UTC
Re: Spark submit OutOfMemory Error in local mode
Any help here will be appreciated.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29096.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark submit OutOfMemory Error in local mode
Posted by Naga G <gu...@gmail.com>.
Increase the cores, as you're trying to run multiple threads
Sent from Naga iPad
> On Aug 22, 2017, at 3:26 PM, "Uwe@Moosheimer.com" <Uw...@Moosheimer.com> wrote:
>
> Since you didn't post any concrete information it's hard to give you an advice.
>
> Try to increase the executor memory (spark.executor.memory).
> If that doesn't help give all the experts in the community a chance to help you by adding more details like version, logfile, source etc....
>
> Mit freundlichen Grüßen / best regards
> Kay-Uwe Moosheimer
>
>> Am 22.08.2017 um 20:16 schrieb shitijkuls <ku...@gmail.com>:
>>
>> Any help here will be appreciated.
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29096.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark submit OutOfMemory Error in local mode
Posted by "Uwe@Moosheimer.com" <Uw...@Moosheimer.com>.
Since you didn't post any concrete information it's hard to give you an advice.
Try to increase the executor memory (spark.executor.memory).
If that doesn't help give all the experts in the community a chance to help you by adding more details like version, logfile, source etc....
Mit freundlichen Grüßen / best regards
Kay-Uwe Moosheimer
> Am 22.08.2017 um 20:16 schrieb shitijkuls <ku...@gmail.com>:
>
> Any help here will be appreciated.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29096.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark submit OutOfMemory Error in local mode
Posted by muthu <ba...@gmail.com>.
Are you getting OutOfMemory on the driver or on the executor? Typical cause
of OOM in Spark can be due to fewer number of tasks for a job.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29117.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org