You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2020/05/27 12:33:07 UTC

[GitHub] [flink] lgo commented on pull request #12345: [FLINK-17288] [Runtime/StateBackends] Add RocksDB SST ingestion for batch writes

lgo commented on pull request #12345:
URL: https://github.com/apache/flink/pull/12345#issuecomment-634628869


   @Myasuka actually this is doing exactly what the bulk loading ticket is describing. The `RocksDBSSTIngestWriter` is a drop-in repacement for `RocksDBWriteBatchWrapper` where only `RocksDB#put` is being used, so this is implementing bulk loading.
   
   Right now, the PR has 2 locations changed to use it in full savepoint recovery and state migrations (`migrateStateValues`). This happens via `RocksDBWriteFactory#defaultPutWriter`, which will provide the new `RocksDBSSTIngestWriter` if it has been configured.
   
   Sorry, I'll update the description to be a bit more descriptive of this. This is definitely a draft, so I'll go ahead and add that tag (:


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org