You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/04/13 02:25:24 UTC

[GitHub] [hudi] MyLanPangzi edited a comment on pull request #2807: [HUDI-1787] Remove the rocksdb jar from hudi-flink-bundle

MyLanPangzi edited a comment on pull request #2807:
URL: https://github.com/apache/hudi/pull/2807#issuecomment-818383636


   > > > Hi @MyLanPangzi, we are planning to use `rocksdb` as the default state backend instead of `hdfs`, would you like to take this ticket https://issues.apache.org/jira/browse/HUDI-981
   > > 
   > > 
   > > What do you mean? The hudi-flink connecotr is using rocksdb as state backend now.
   > 
   > I mean`HoodieFlinkStreamer` and `HoodieFlinkStreamerV2`
   
   this should be a cli option or a yaml conf not hardcode. 
   follwing options is provided by flink .
   e.g
   state.backend: filesystem or rocksdb
   state.checkpoints.dir: hdfs://nameservice1/flink/chk/
   state.savepoints.dir: hdfs://nameservice1user/flink/savepoint/
   state.backend.incremental: true
   state.checkpoints.num-retained: 3
   execution.checkpointing.interval: 2 min
   execution.checkpointing.timeout: 20 min


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org