You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/07/14 04:24:21 UTC

[GitHub] [hudi] bvaradar commented on issue #1823: [SUPPORT] MOR trigger compaction from Hudi CLI

bvaradar commented on issue #1823:
URL: https://github.com/apache/hudi/issues/1823#issuecomment-657958175


   @RajasekarSribalan :  Compactions should be able to be triggered and executed from CLI if there are delta files and configured correctly. Can you post the logs from "compaction schedule" after you disabled inline compaction and delta files got added.  The only constraint is that when scheduling compactions, ingestion should not be running.
   
    If you are running structured streaming job, please try out the PR suggested by @bhasudha which will execute compaction asynchronously. In batch mode, You can also enable inline compaction and setting a proper value for hoodie.compact.inline.max.delta.commits depending on how frequent you want to run compactions.
   
   Regarding (2) Compaction is only relevant for MOR tables. Compaction is the process of taking the delta-files and creating columnar files. CopyOnWrite tables are implicitly compacted.
   
   Regarding the error related to kryoException, Are you still seeing the error ? 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org