You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "LiJie20190102 (via GitHub)" <gi...@apache.org> on 2023/04/04 01:29:38 UTC

[GitHub] [hudi] LiJie20190102 commented on issue #8331: [SUPPORT] When using the HoodieDeltaStreamer, is there a corresponding parameter that can control the number of cycles? For example, if I cycle 5 times, I stop accessing data

LiJie20190102 commented on issue #8331:
URL: https://github.com/apache/hudi/issues/8331#issuecomment-1495213134

   > @LiJie20190102 Can you let use know the complete spark-submit command you are using.
   
   I found a configuration: "-- post write termination strategy class". I tried using the 'org.apache.hudi.utilities.deltastreamer.NoNewDataTerminationStrategy' to stop the task, but it didn't seem to meet my expectations. I think that after it stops ExecutorService, the subsequent SparkContext will also stop, but now SparkContext will always be started and no subsequent logs will be visible.
   ![image](https://user-images.githubusercontent.com/53458004/229662805-e1b4bfa2-31f6-4ad1-aede-860ecb6af143.png)
   ![image](https://user-images.githubusercontent.com/53458004/229662822-ce078c25-467d-44fa-b286-db5d3d2e8d07.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org