[jira] [Commented] (HUDI-5065) HoodieCleaner does not exit after completion

["Jonathan Vexler (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626702#comment-17626702 ] 

Jonathan Vexler commented on HUDI-5065:
---------------------------------------

check how hoodie compactor in utilities shuts down the spark context

> HoodieCleaner does not exit after completion
> --------------------------------------------
>
>                 Key: HUDI-5065
>                 URL: https://issues.apache.org/jira/browse/HUDI-5065
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: cleaning
>            Reporter: sivabalan narayanan
>            Assignee: Jonathan Vexler
>            Priority: Major
>             Fix For: 0.13.0
>
>
> use org.apache.hudi.utilities.hoodieCleaner realize asynchronous cleaning, after the completion of the spark-submit don't quit, need CTRL + c to exit
>  
> /opt/spark-3.2.2-bin-3.0.0-cdh6.2.1/bin/spark-submit \ --class org.apache.hudi.utilities.HoodieCleaner \ --jars /opt/hudi-utilities-bundle_2.12-0.12.1.jar \ /opt/hudi-utilities-bundle_2.12-0.12.1.jar \ --target-base-path /db/dwm_http_scan \ --spark-master yarn \ --hoodie-conf hoodie.cleaner.policy=KEEP_LATEST_BY_HOURS \ --hoodie-conf hoodie.cleaner.hours.retained=1
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)