You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by "Jakob-al28 (via GitHub)" <gi...@apache.org> on 2026/08/05 20:13:42 UTC
[PR] [SYSTEMDS-3949] Extend Delta Spark round trip tests [systemds]
Jakob-al28 opened a new pull request, #2580:
URL: https://github.com/apache/systemds/pull/2580
The Spark round trip tests cover multi-file layouts, deletion vectors,
partitioning, column mapping and schema evolution. This adds three that were
missing: a log that has been checkpointed, a column type SystemDS cannot map,
and a table more than one engine has written to.
| test | covers |
| --- | --- |
| `checkpointBackedHistoryRead` | a log that rolled into a parquet checkpoint, with a delete after it, so the snapshot comes from a checkpoint plus trailing commits |
| `unsupportedColumnTypeRead` | DATE / TIMESTAMP / DECIMAL columns, which have no SystemDS value type and must be rejected by name before decoding |
| `systemdsCreateSparkAppendRead` | SystemDS creates the table, Spark appends to it, so a mixed engine commit history still reads back as one table |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [SYSTEMDS-3949] Extend Delta Spark round trip tests [systemds]
Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #2580:
URL: https://github.com/apache/systemds/pull/2580#issuecomment-5204858616
## [Codecov](https://app.codecov.io/gh/apache/systemds/pull/2580?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 71.45%. Comparing base ([`af500c8`](https://app.codecov.io/gh/apache/systemds/commit/af500c848d43bb03d66aa2a379eccbb80ef8c7bc?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`233edbe`](https://app.codecov.io/gh/apache/systemds/commit/233edbedede6830bd8e0a13ebb9c5215baaf6ab5?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 8 commits behind head on main.
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## main #2580 +/- ##
============================================
- Coverage 71.61% 71.45% -0.16%
- Complexity 50352 50409 +57
============================================
Files 1626 1629 +3
Lines 194664 195331 +667
Branches 38007 38078 +71
============================================
+ Hits 139408 139574 +166
- Misses 44328 44836 +508
+ Partials 10928 10921 -7
```
</details>
[:umbrella: View full report in Codecov by Harness](https://app.codecov.io/gh/apache/systemds/pull/2580?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [SYSTEMDS-3949] Extend Delta Spark round trip tests [systemds]
Posted by "Baunsgaard (via GitHub)" <gi...@apache.org>.
Baunsgaard merged PR #2580:
URL: https://github.com/apache/systemds/pull/2580
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org