Re: Spark Streaming Application Got killed after 2 hours

[Prannoy <pr...@sigmoidanalytics.com>]

Hi Saj,

What is the size of the input data that you are putting on the stream ?
Have you tried running the same application with different set of data ?
Its weird that exactly after 2 hours the streaming stops. Try running the
same application with different data of different size to look if it has
something to do with memory issue. Can you also provide a detailed error
log .

Thanks.

On Sun, Nov 16, 2014 at 11:49 AM, SAJ [via Apache Spark User List] <
ml-node+s1001560n19021h53@n3.nabble.com> wrote:

> Hi All,
> I am trying to run spark streaming application to run for 24/7 but exactly
> after 2 hours it got killed.I have again tried but again it got killed in 2
> hours.Following are the error log in worker
>
> 14/11/15 13:53:24 INFO network.ConnectionManager: Removing
> ReceivingConnection to ConnectionManagerId(ip-xxxxxxxxx,38863)
> 14/11/15 13:53:24 INFO network.ConnectionManager: Removing
> SendingConnection to ConnectionManagerId(ip-xxxxxxxxx,38863)
> 14/11/15 13:53:24 ERROR network.SendingConnection: Exception while reading
> SendingConnection to ConnectionManagerI
>
> Does anybody faced these same issue.
> Thanks & Regards,
> SAJ
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-Application-Got-killed-after-2-hours-tp19021.html
>  To start a new topic under Apache Spark User List, email
> ml-node+s1001560n1h33@n3.nabble.com
> To unsubscribe from Apache Spark User List, click here
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cHJhbm5veUBzaWdtb2lkYW5hbHl0aWNzLmNvbXwxfC0xNTI2NTg4NjQ2>
> .
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-Application-Got-killed-after-2-hours-tp19021p19023.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.