You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Dongwon Kim <ea...@gmail.com> on 2020/04/04 13:39:20 UTC
NPE from NullAwareMapIterator in flink-table-runtime-blink
Hi,
The attached is a stack trace from a member of Korean Flink User Group
about which I have no idea.
[image: 92164295_3052056384855585_3776552648744894464_o.jpg]
Can anyone give me some hint on this exception?
Thanks,
Dongwon
Re: NPE from NullAwareMapIterator in flink-table-runtime-blink
Posted by Jark Wu <im...@gmail.com>.
Hi Dongwon,
Thanks for providing the information. I think this is a bug because the
underlying HeapMapState#iterator may return a null iterato, but Rocksdb
not.
We should protect it in NullAwareMapIterator#hasNext. I created
https://issues.apache.org/jira/browse/FLINK-17015 to fix it.
Best,
Jark
On Mon, 6 Apr 2020 at 07:30, Dongwon Kim <ea...@gmail.com> wrote:
> Hey Jark,
>
> After he disables checkpointing, the exception seems to disappear.
> Hope this information helps.
>
> Best,
>
> Dongwon
>
> On Mon, Apr 6, 2020 at 8:21 AM Dongwon Kim <ea...@gmail.com> wrote:
>
>> Thanks Jark,
>>
>> I asked to the original questioner, and he answered
>> 1) Yes, he seems to turn on checkpointing but doesn't configure anything
>> further, which means he is using the Heap statebackend.
>> 2) It normally happens 5~10 mins after the job is started.
>>
>> If this was a bug specific to the Heap statebackend, would it be helpful
>> for him to use other statebackends like FS statebackend and RocksDB
>> statebackend?
>>
>> Best,
>> Dongwon
>>
>> On Sun, Apr 5, 2020 at 1:09 PM Jark Wu <im...@gmail.com> wrote:
>>
>>> Hi Dongwon,
>>>
>>> Thanks for reporting this. Let me ask some more questions first.
>>> 1) Are you using the Heap statebackend?
>>> 2) How often / How long will this exception happen after the job is
>>> started?
>>>
>>> Best,
>>> Jark
>>>
>>> On Sat, 4 Apr 2020 at 21:39, Dongwon Kim <ea...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> The attached is a stack trace from a member of Korean Flink User Group
>>>> about which I have no idea.
>>>> [image: 92164295_3052056384855585_3776552648744894464_o.jpg]
>>>>
>>>> Can anyone give me some hint on this exception?
>>>> Thanks,
>>>>
>>>> Dongwon
>>>>
>>>
Re: NPE from NullAwareMapIterator in flink-table-runtime-blink
Posted by Dongwon Kim <ea...@gmail.com>.
Hey Jark,
After he disables checkpointing, the exception seems to disappear.
Hope this information helps.
Best,
Dongwon
On Mon, Apr 6, 2020 at 8:21 AM Dongwon Kim <ea...@gmail.com> wrote:
> Thanks Jark,
>
> I asked to the original questioner, and he answered
> 1) Yes, he seems to turn on checkpointing but doesn't configure anything
> further, which means he is using the Heap statebackend.
> 2) It normally happens 5~10 mins after the job is started.
>
> If this was a bug specific to the Heap statebackend, would it be helpful
> for him to use other statebackends like FS statebackend and RocksDB
> statebackend?
>
> Best,
> Dongwon
>
> On Sun, Apr 5, 2020 at 1:09 PM Jark Wu <im...@gmail.com> wrote:
>
>> Hi Dongwon,
>>
>> Thanks for reporting this. Let me ask some more questions first.
>> 1) Are you using the Heap statebackend?
>> 2) How often / How long will this exception happen after the job is
>> started?
>>
>> Best,
>> Jark
>>
>> On Sat, 4 Apr 2020 at 21:39, Dongwon Kim <ea...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> The attached is a stack trace from a member of Korean Flink User Group
>>> about which I have no idea.
>>> [image: 92164295_3052056384855585_3776552648744894464_o.jpg]
>>>
>>> Can anyone give me some hint on this exception?
>>> Thanks,
>>>
>>> Dongwon
>>>
>>
Re: NPE from NullAwareMapIterator in flink-table-runtime-blink
Posted by Dongwon Kim <ea...@gmail.com>.
Thanks Jark,
I asked to the original questioner, and he answered
1) Yes, he seems to turn on checkpointing but doesn't configure anything
further, which means he is using the Heap statebackend.
2) It normally happens 5~10 mins after the job is started.
If this was a bug specific to the Heap statebackend, would it be helpful
for him to use other statebackends like FS statebackend and RocksDB
statebackend?
Best,
Dongwon
On Sun, Apr 5, 2020 at 1:09 PM Jark Wu <im...@gmail.com> wrote:
> Hi Dongwon,
>
> Thanks for reporting this. Let me ask some more questions first.
> 1) Are you using the Heap statebackend?
> 2) How often / How long will this exception happen after the job is
> started?
>
> Best,
> Jark
>
> On Sat, 4 Apr 2020 at 21:39, Dongwon Kim <ea...@gmail.com> wrote:
>
>> Hi,
>>
>> The attached is a stack trace from a member of Korean Flink User Group
>> about which I have no idea.
>> [image: 92164295_3052056384855585_3776552648744894464_o.jpg]
>>
>> Can anyone give me some hint on this exception?
>> Thanks,
>>
>> Dongwon
>>
>
Re: NPE from NullAwareMapIterator in flink-table-runtime-blink
Posted by Jark Wu <im...@gmail.com>.
Hi Dongwon,
Thanks for reporting this. Let me ask some more questions first.
1) Are you using the Heap statebackend?
2) How often / How long will this exception happen after the job is
started?
Best,
Jark
On Sat, 4 Apr 2020 at 21:39, Dongwon Kim <ea...@gmail.com> wrote:
> Hi,
>
> The attached is a stack trace from a member of Korean Flink User Group
> about which I have no idea.
> [image: 92164295_3052056384855585_3776552648744894464_o.jpg]
>
> Can anyone give me some hint on this exception?
> Thanks,
>
> Dongwon
>