You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by "Mail.com" <pr...@mail.com> on 2016/07/23 13:11:27 UTC
spark context stop vs close
Hi All,
Where should we us spark context stop vs close. Should we stop the context first and then close.
Are general guidelines around this. When I stop and later try to close I get RPC already closed error.
Thanks,
Pradeep
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: spark context stop vs close
Posted by "Mail.com" <pr...@mail.com>.
Okay. Yes it is JavaSparkContext. Thanks.
> On Jul 24, 2016, at 1:31 PM, Sean Owen <so...@cloudera.com> wrote:
>
> I think this is about JavaSparkContext which implements the standard
> Closeable interface for convenience. Both do exactly the same thing.
>
>> On Sun, Jul 24, 2016 at 6:27 PM, Jacek Laskowski <ja...@japila.pl> wrote:
>> Hi,
>>
>> I can only find stop. Where did you find close?
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> ----
>> https://medium.com/@jaceklaskowski/
>> Mastering Apache Spark http://bit.ly/mastering-apache-spark
>> Follow me at https://twitter.com/jaceklaskowski
>>
>>
>>> On Sat, Jul 23, 2016 at 3:11 PM, Mail.com <pr...@mail.com> wrote:
>>> Hi All,
>>>
>>> Where should we us spark context stop vs close. Should we stop the context first and then close.
>>>
>>> Are general guidelines around this. When I stop and later try to close I get RPC already closed error.
>>>
>>> Thanks,
>>> Pradeep
>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: spark context stop vs close
Posted by Sean Owen <so...@cloudera.com>.
I think this is about JavaSparkContext which implements the standard
Closeable interface for convenience. Both do exactly the same thing.
On Sun, Jul 24, 2016 at 6:27 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> Hi,
>
> I can only find stop. Where did you find close?
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://medium.com/@jaceklaskowski/
> Mastering Apache Spark http://bit.ly/mastering-apache-spark
> Follow me at https://twitter.com/jaceklaskowski
>
>
> On Sat, Jul 23, 2016 at 3:11 PM, Mail.com <pr...@mail.com> wrote:
>> Hi All,
>>
>> Where should we us spark context stop vs close. Should we stop the context first and then close.
>>
>> Are general guidelines around this. When I stop and later try to close I get RPC already closed error.
>>
>> Thanks,
>> Pradeep
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: spark context stop vs close
Posted by Jacek Laskowski <ja...@japila.pl>.
Hi,
I can only find stop. Where did you find close?
Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski
On Sat, Jul 23, 2016 at 3:11 PM, Mail.com <pr...@mail.com> wrote:
> Hi All,
>
> Where should we us spark context stop vs close. Should we stop the context first and then close.
>
> Are general guidelines around this. When I stop and later try to close I get RPC already closed error.
>
> Thanks,
> Pradeep
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org