You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "manuzhang (via GitHub)" <gi...@apache.org> on 2025/02/26 12:50:45 UTC
[PR] Spark 3.5: Adjust repeated INFO logs to DEBUG in SparkWrite and SparkPositionDeltaWrite [iceberg]
manuzhang opened a new pull request, #12404:
URL: https://github.com/apache/iceberg/pull/12404
I see repeated logs as follows from `SparkWrite` in Spark driver.
```
25/02/26 01:48:56 INFO SparkWrite: Requesting 0 bytes advisory partition size for table ***
25/02/26 01:48:56 INFO SparkWrite: Requesting 0 bytes advisory partition size for table ***
25/02/26 01:48:56 INFO SparkWrite: Requesting 0 bytes advisory partition size for table ***
25/02/26 01:48:56 INFO SparkWrite: Requesting UnspecifiedDistribution as write distribution for table ***
25/02/26 01:48:56 INFO SparkWrite: Requesting UnspecifiedDistribution as write distribution for table ***
25/02/26 01:48:56 INFO SparkWrite: Requesting [] as write ordering for table ***
25/02/26 01:48:56 INFO SparkWrite: Requesting [] as write ordering for table ***
25/02/26 01:48:56 INFO SparkWrite: Requesting [] as write ordering for table ***
```
I think they are more appropriate for debugging purpose, so this PR adjusts the corresponding log levels to DEBUG
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark 3.5: Adjust repeated INFO logs to DEBUG in SparkWrite and SparkPositionDeltaWrite [iceberg]
Posted by "manuzhang (via GitHub)" <gi...@apache.org>.
manuzhang commented on PR #12404:
URL: https://github.com/apache/iceberg/pull/12404#issuecomment-2746716954
@nastra any more comments?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Spark 3.5: Adjust repeated INFO logs to DEBUG in SparkWrite and SparkPositionDeltaWrite [iceberg]
Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra merged PR #12404:
URL: https://github.com/apache/iceberg/pull/12404
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org