You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Kien Truong <du...@gmail.com> on 2017/11/23 01:23:47 UTC

Bad entry in block exception with RocksDB

Hi,

We are seeing this exception in one of our job, whenever a check point or save point is performed.

java.lang.RuntimeException: Error while adding data to RocksDB
at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:119)
at org.apache.flink.runtime.state.UserFacingListState.add(UserFacingListState.java:50)
....
Caused by: org.rocksdb.RocksDBException: bad entry in block
at org.rocksdb.RocksDB.merge(Native Method)
at org.rocksdb.RocksDB.merge(RocksDB.java:683)
at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:116)

We are using Flink 1.3.2 with incremental checkpoint. Any idea what might be causing this ?

Best regards,
Kien

Re: Bad entry in block exception with RocksDB

Posted by Kostas Kloudas <k....@data-artisans.com>.
Hi Kien,

Could you share some more information about your job?
What operators are you using, the format of your elements, etc?

Thanks,
Kostas

> On Nov 23, 2017, at 2:23 AM, Kien Truong <du...@gmail.com> wrote:
> 
> Hi,
> 
> We are seeing this exception in one of our job, whenever a check point or save point is performed.
> 
> java.lang.RuntimeException: Error while adding data to RocksDB
> at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:119)
> at org.apache.flink.runtime.state.UserFacingListState.add(UserFacingListState.java:50)
> ....
> Caused by: org.rocksdb.RocksDBException: bad entry in block
> at org.rocksdb.RocksDB.merge(Native Method)
> at org.rocksdb.RocksDB.merge(RocksDB.java:683)
> at org.apache.flink.contrib.streaming.state.RocksDBListState.add(RocksDBListState.java:116)
> 
> We are using Flink 1.3.2 with incremental checkpoint. Any idea what might be causing this ?
> 
> Best regards,
> Kien