Spark Streaming Job is stucked

[rajat kumar <ku...@gmail.com>]

Hello Everyone,

My spark streaming job is running too slow, it is having batch time of 15
seconds and the batch gets completed in 20-22 secs. It was fine till 1st
week October, but it is behaving this way suddenly. I know changing the
batch time can help , but other than that any idea what can be done?

Please note I am using Direct Stream Approach

Thanks
Rajat Sharma

Re: Spark Streaming Job is stucked

[Artemis User <ar...@dtechspace.com>]

If it was running fine before and stops working now, one thing I could 
think of may be your disk was full.  Check your disk space and clean up 
your old log files might help...

On 10/18/20 12:06 PM, rajat kumar wrote:
> Hello Everyone,
>
> My spark streaming job is running too slow, it is having batch time of 
> 15 seconds and the batch gets completed in 20-22 secs. It was fine 
> till 1st week October, but it is behaving this way suddenly. I know 
> changing the batch time can help , but other than that any idea what 
> can be done?
>
> Please note I am using Direct Stream Approach
>
> Thanks
> Rajat Sharma

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org