You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by anshu shukla <an...@gmail.com> on 2015/06/24 15:18:35 UTC

Loss of data due to congestion

How spark guarantees  that no RDD will fail /lost during its life cycle .
Is there  something like ask in storm or its does it by default .

-- 
Thanks & Regards,
Anshu Shukla

Re: Loss of data due to congestion

Posted by ayan guha <gu...@gmail.com>.
Then you should see checkpointing (
https://spark.apache.org/docs/latest/streaming-programming-guide.html#checkpointing
)

On Thu, Jun 25, 2015 at 3:33 PM, anshu shukla <an...@gmail.com>
wrote:

> Thaks,
> I  am talking about streaming.
> On 25 Jun 2015 5:37 am, "ayan guha" <gu...@gmail.com> wrote:
>
>> Can you elaborate little more? Are you talking about receiver or
>> streaming?
>> On 24 Jun 2015 23:18, "anshu shukla" <an...@gmail.com> wrote:
>>
>>> How spark guarantees  that no RDD will fail /lost during its life cycle
>>> . Is there  something like ask in storm or its does it by default .
>>>
>>> --
>>> Thanks & Regards,
>>> Anshu Shukla
>>>
>>


-- 
Best Regards,
Ayan Guha

Re: Loss of data due to congestion

Posted by anshu shukla <an...@gmail.com>.
Thaks,
I  am talking about streaming.
On 25 Jun 2015 5:37 am, "ayan guha" <gu...@gmail.com> wrote:

> Can you elaborate little more? Are you talking about receiver or streaming?
> On 24 Jun 2015 23:18, "anshu shukla" <an...@gmail.com> wrote:
>
>> How spark guarantees  that no RDD will fail /lost during its life cycle .
>> Is there  something like ask in storm or its does it by default .
>>
>> --
>> Thanks & Regards,
>> Anshu Shukla
>>
>

Re: Loss of data due to congestion

Posted by anshu shukla <an...@gmail.com>.
Thaks,
I  am talking about streaming.
On 25 Jun 2015 5:37 am, "ayan guha" <gu...@gmail.com> wrote:

> Can you elaborate little more? Are you talking about receiver or streaming?
> On 24 Jun 2015 23:18, "anshu shukla" <an...@gmail.com> wrote:
>
>> How spark guarantees  that no RDD will fail /lost during its life cycle .
>> Is there  something like ask in storm or its does it by default .
>>
>> --
>> Thanks & Regards,
>> Anshu Shukla
>>
>

Re: Loss of data due to congestion

Posted by ayan guha <gu...@gmail.com>.
Can you elaborate little more? Are you talking about receiver or streaming?
On 24 Jun 2015 23:18, "anshu shukla" <an...@gmail.com> wrote:

> How spark guarantees  that no RDD will fail /lost during its life cycle .
> Is there  something like ask in storm or its does it by default .
>
> --
> Thanks & Regards,
> Anshu Shukla
>