You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@auron.apache.org by "Sigma-Ma (via GitHub)" <gi...@apache.org> on 2026/10/15 08:55:23 UTC

[PR] [AURON #2581] Extract supported conjuncts for Iceberg changelog task … [auron]

Sigma-Ma opened a new pull request, #2583:
URL: https://github.com/apache/auron/pull/2583

   # Which issue does this PR close?
   
   Closes #2581
   
   # Rationale for this change
   
   A metadata predicate combined with an ordinary data-column predicate currently prevents Iceberg changelog task pruning. For example, `_change_type = 'INSERT' AND id = 3` retains DELETE tasks even though their metadata excludes them.
   
   # What changes are included in this PR?
   
   - Extract supported top-level AND conjuncts and validate each conjunct against the scan output by expression ID.
   - Reuse the existing changelog task filter and preserve the complete post-scan condition.
   - Keep OR/NOT boundaries, operator barriers, nondeterministic filters, task eligibility, and runtime-filter propagation conservative.
   - Extend regression coverage for mixed INSERT/DELETE ranges, nested AND conditions, projected data attributes, expression-ID mismatches, empty results, and runtime-filter copies. Assert expected rows, retained task counts, and file metrics independently.
   
   # Are there any user-facing changes?
   
   Eligible native Iceberg changelog scans can read fewer tasks when metadata predicates are combined with data-column conditions. No public API or configuration changes.
   
   # How was this patch tested?
   
   Build dependencies:
   
   ```bash
   ./build/mvn -o -ntp -Ppre,spark-3.5,scala-2.12,iceberg-1.10.1 -pl thirdparty/auron-iceberg -am -DskipTests -DskipBuildNative install
   
   ./build/mvn -o -ntp -Ppre,spark-3.5,scala-2.12,iceberg-1.10.1 -pl thirdparty/auron-iceberg -DskipBuildNative -DwildcardSuites=org.apache.auron.iceberg.AuronIcebergIntegrationSuite spotless:apply test
   
   ./dev/reformat --check
   ```
   
   # Was this patch authored or co-authored using generative AI tooling?
   
   - [x] Yes
   - [ ] No
   
   Generated-by: OpenAI Codex (GPT-6)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [AURON #2581] Extract supported conjuncts for Iceberg changelog task … [auron]

Posted by "slfan1989 (via GitHub)" <gi...@apache.org>.
slfan1989 merged PR #2583:
URL: https://github.com/apache/auron/pull/2583


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org