You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2026/07/03 19:42:57 UTC

[PR] fix(spark): demote spurious per-write INFO logs to debug [hudi]

yihua opened a new pull request, #19170:
URL: https://github.com/apache/hudi/pull/19170

   ### Describe the issue this Pull Request addresses
   
   Closes #17345.
   
   Every Spark write logs several diagnostic / config-state lines at INFO in the commit path, which is noise for operators (it fires on every write, including every streaming micro-batch).
   
   ### Summary and Changelog
   
   Demote six per-write diagnostic log statements in `HoodieSparkSqlWriter` from INFO to DEBUG:
   
   - `commitAndPerformPostOperations`: "Proceeding to commit the write", "Compaction Scheduled is ...", "Clustering Scheduled is ...", "Is Async Compaction Enabled ? ...".
   - `isAsyncCompactionEnabled`: "Config.inlineCompactionEnabled ? ...".
   - `isAsyncClusteringEnabled`: "Config.asyncClusteringEnabled ? ...".
   
   The meaningful "Commit `<instant>` successful!/failed!" INFO lines are kept.
   
   ### Impact
   
   Less per-write log noise. No functional or behavior change (log level only).
   
   ### Risk Level
   
   low - log-level changes only.
   
   ### Documentation Update
   
   none
   
   ### Contributor's checklist
   
   - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [x] Enough context is provided in the sections above
   - [ ] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] fix(spark): demote spurious per-write INFO logs to debug [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19170:
URL: https://github.com/apache/hudi/pull/19170#issuecomment-4879014624

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ca380c82f2402979e1d11dd73b9ad17a7b5e6e83",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ca380c82f2402979e1d11dd73b9ad17a7b5e6e83",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ca380c82f2402979e1d11dd73b9ad17a7b5e6e83 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] fix(spark): demote spurious per-write INFO logs to debug [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19170:
URL: https://github.com/apache/hudi/pull/19170#issuecomment-4879037557

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ca380c82f2402979e1d11dd73b9ad17a7b5e6e83",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=15176",
       "triggerID" : "ca380c82f2402979e1d11dd73b9ad17a7b5e6e83",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ca380c82f2402979e1d11dd73b9ad17a7b5e6e83 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=15176) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] fix(spark): demote spurious per-write INFO logs to debug [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19170:
URL: https://github.com/apache/hudi/pull/19170#issuecomment-4880247131

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ca380c82f2402979e1d11dd73b9ad17a7b5e6e83",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=15176",
       "triggerID" : "ca380c82f2402979e1d11dd73b9ad17a7b5e6e83",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ca380c82f2402979e1d11dd73b9ad17a7b5e6e83 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=15176) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] fix(spark): demote spurious per-write INFO logs to debug [hudi]

Posted by "voonhous (via GitHub)" <gi...@apache.org>.
voonhous merged PR #19170:
URL: https://github.com/apache/hudi/pull/19170


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org