You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/01/19 15:29:00 UTC

[GitHub] [hudi] stym06 edited a comment on issue #4638: [SUPPORT] Deltastreamer job failing with RocksDB exception

stym06 edited a comment on issue #4638:
URL: https://github.com/apache/hudi/issues/4638#issuecomment-1016574839


   On quick googling, found that this is being caused by a segmentation fault in the LoggerJniCallback class inside rocksdb when the logging class of rocksdb which is being called here:https://github.com/apache/hudi/blob/master/hudi-common/src/main/java/org/apache/hudi/common/util/collection/RocksDBDAO.java#L102
   
   Hudi is using rocksdb-5.17.2 which has this issue and fails when run on an Alpine based image/vm which is stated here: https://github.com/facebook/rocksdb/issues/4277#issuecomment-533453851
   
   The fix is available with rocksdb v6.27.3 onwards. (https://github.com/facebook/rocksdb/commit/2367656b6c19048d76037d24025ef0caab136866#diff-950c1d37d965830d86d07977aab5a4d84550e86930fc2c6dd0ec8fc40a799b49)
   
   After removing the call or upgrading the version, this issue goes away on my local build.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org