You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/10/23 12:22:59 UTC
(datafusion-comet) branch main updated (886e0a9532 -> eefa4dddb3)
This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from 886e0a9532 fix: scope fallback reasons to the current conversion (#7095)
add eefa4dddb3 test: cover speculation and executor loss in multi-task native Iceberg writes (#6601)
No new revisions were added by this update.
Summary of changes:
dev/ci/check-suites.py | 1 +
dev/iceberg-scheduler-kill-executor.py | 72 +++
.../iceberg-scheduler-failures.md | 234 +++++++++
docs/source/contributor-guide/iceberg-writes.md | 25 +-
docs/source/contributor-guide/index.md | 1 +
.../spark/sql/comet/CometIcebergWriteExec.scala | 22 +-
.../apache/spark/sql/comet/IcebergCommitExec.scala | 7 +-
.../sql/comet/IcebergSchedulerTestProbe.scala | 92 ++++
.../comet/CometIcebergSchedulerFailureSuite.scala | 584 +++++++++++++++++++++
.../comet/CometIcebergWriteActionSuite.scala | 429 ++++++++++++++-
.../apache/comet/IcebergSchedulerTestSupport.scala | 288 ++++++++++
.../scala/org/apache/comet/IcebergTestFiles.scala} | 27 +-
12 files changed, 1736 insertions(+), 46 deletions(-)
create mode 100755 dev/iceberg-scheduler-kill-executor.py
create mode 100644 docs/source/contributor-guide/iceberg-scheduler-failures.md
create mode 100644 spark/src/main/scala/org/apache/spark/sql/comet/IcebergSchedulerTestProbe.scala
create mode 100644 spark/src/test/scala/org/apache/comet/CometIcebergSchedulerFailureSuite.scala
create mode 100644 spark/src/test/scala/org/apache/comet/IcebergSchedulerTestSupport.scala
copy spark/src/{main/scala/org/apache/comet/MetricsSupport.scala => test/scala/org/apache/comet/IcebergTestFiles.scala} (57%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org