You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Mohit Durgapal <du...@gmail.com> on 2016/11/22 21:42:53 UTC

getting error on spark streaming : java.lang.OutOfMemoryError: unable to create new native thread

Hi Everyone,


I am getting the following error while running a spark streaming example on
my local machine, the being ingested is only 506kb.


*16/11/23 03:05:54 INFO MappedDStream: Slicing from 1479850537180 ms to
1479850537235 ms (aligned to 1479850537180 ms and 1479850537235 ms)*

*Exception in thread "streaming-job-executor-0" java.lang.OutOfMemoryError:
unable to create new native thread*


I looked it up and found out that it could be related to ulimit, I even
increased the ulimit to 10000 but still the same error.


Regards

Mohit

Re: getting error on spark streaming : java.lang.OutOfMemoryError: unable to create new native thread

Posted by "Shixiong(Ryan) Zhu" <sh...@databricks.com>.

Possibly https://issues.apache.org/jira/browse/SPARK-17396

On Tue, Nov 22, 2016 at 1:42 PM, Mohit Durgapal <du...@gmail.com>
wrote:

> Hi Everyone,
>
>
> I am getting the following error while running a spark streaming example
> on my local machine, the being ingested is only 506kb.
>
>
> *16/11/23 03:05:54 INFO MappedDStream: Slicing from 1479850537180 ms to
> 1479850537235 ms (aligned to 1479850537180 ms and 1479850537235 ms)*
>
> *Exception in thread "streaming-job-executor-0"
> java.lang.OutOfMemoryError: unable to create new native thread*
>
>
> I looked it up and found out that it could be related to ulimit, I even
> increased the ulimit to 10000 but still the same error.
>
>
> Regards
>
> Mohit
>