You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Balaji Varadarajan (Jira)" <ji...@apache.org> on 2020/06/20 01:58:00 UTC

[jira] [Created] (HUDI-1031) Document how to set job scheduling configs for Async compaction

Balaji Varadarajan created HUDI-1031:
----------------------------------------

             Summary: Document how to set job scheduling configs for Async compaction 
                 Key: HUDI-1031
                 URL: https://issues.apache.org/jira/browse/HUDI-1031
             Project: Apache Hudi
          Issue Type: Task
          Components: Docs
            Reporter: Balaji Varadarajan
             Fix For: 0.6.0


 

In case of deltastreamer, Spark job scheduling configs are automatically set. As the configs needs to be set before spark context is initiated, it is not fully automated for Structured Streaming [https://spark.apache.org/docs/latest/job-scheduling.html]

We need to document how to set job scheduling configs for Spark Structured streaming.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)