You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by "janniklinde (via GitHub)" <gi...@apache.org> on 2026/08/01 10:38:21 UTC
[PR] [SYSTEMDS-3891] Add Materialized Planning Support [systemds]
janniklinde opened a new pull request, #2573:
URL: https://github.com/apache/systemds/pull/2573
This PR adds support for explicitly requesting and injecting materialization boundaries. This allows primitives to request persisted input streams, which may be shared across multiple downstream primitives.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [SYSTEMDS-3891] Add Materialized Planning Support [systemds]
Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #2573:
URL: https://github.com/apache/systemds/pull/2573#issuecomment-5151156065
## [Codecov](https://app.codecov.io/gh/apache/systemds/pull/2573?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `66.21622%` with `100 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 71.60%. Comparing base ([`bf7b6ba`](https://app.codecov.io/gh/apache/systemds/commit/bf7b6ba41a8e52f7f1cad2e5e2b9bd7f09b88230?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`15c3276`](https://app.codecov.io/gh/apache/systemds/commit/15c3276f983a7b54fc581a9fd1b4c8f697668dbf?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/systemds/pull/2573?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...untime/ooc/primitives/MaterializeOOCPrimitive.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fprimitives%2FMaterializeOOCPrimitive.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3ByaW1pdGl2ZXMvTWF0ZXJpYWxpemVPT0NQcmltaXRpdmUuamF2YQ==) | 53.06% | [16 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...org/apache/sysds/runtime/ooc/store/StateTable.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fstore%2FStateTable.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3N0b3JlL1N0YXRlVGFibGUuamF2YQ==) | 20.00% | [12 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...org/apache/sysds/runtime/ooc/store/StoreLease.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fstore%2FStoreLease.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3N0b3JlL1N0b3JlTGVhc2UuamF2YQ==) | 64.10% | [11 Missing and 3 partials :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [.../sysds/runtime/instructions/ooc/CachingStream.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Finstructions%2Fooc%2FCachingStream.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvaW5zdHJ1Y3Rpb25zL29vYy9DYWNoaW5nU3RyZWFtLmphdmE=) | 47.36% | [4 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...che/sysds/runtime/ooc/primitives/OOCPrimitive.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fprimitives%2FOOCPrimitive.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3ByaW1pdGl2ZXMvT09DUHJpbWl0aXZlLmphdmE=) | 84.84% | [6 Missing and 4 partials :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...che/sysds/runtime/ooc/planning/OOCStoreLayout.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fplanning%2FOOCStoreLayout.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3BsYW5uaW5nL09PQ1N0b3JlTGF5b3V0LmphdmE=) | 25.00% | [6 Missing :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...che/sysds/runtime/ooc/store/MaterializedStore.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fstore%2FMaterializedStore.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3N0b3JlL01hdGVyaWFsaXplZFN0b3JlLmphdmE=) | 82.85% | [3 Missing and 3 partials :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [.../sysds/runtime/ooc/stream/SourceOOCStreamable.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fstream%2FSourceOOCStreamable.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3N0cmVhbS9Tb3VyY2VPT0NTdHJlYW1hYmxlLmphdmE=) | 0.00% | [5 Missing :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...sysds/runtime/ooc/store/OOCStreamMaterializer.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Fooc%2Fstore%2FOOCStreamMaterializer.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvb29jL3N0b3JlL09PQ1N0cmVhbU1hdGVyaWFsaXplci5qYXZh) | 55.55% | [4 Missing :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [.../sysds/runtime/instructions/ooc/OOCStreamable.java](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&filepath=src%2Fmain%2Fjava%2Forg%2Fapache%2Fsysds%2Fruntime%2Finstructions%2Fooc%2FOOCStreamable.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-c3JjL21haW4vamF2YS9vcmcvYXBhY2hlL3N5c2RzL3J1bnRpbWUvaW5zdHJ1Y3Rpb25zL29vYy9PT0NTdHJlYW1hYmxlLmphdmE=) | 0.00% | [3 Missing :warning: ](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| ... and [2 more](https://app.codecov.io/gh/apache/systemds/pull/2573?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## main #2573 +/- ##
============================================
- Coverage 71.63% 71.60% -0.03%
- Complexity 50318 50359 +41
============================================
Files 1624 1626 +2
Lines 194442 194664 +222
Branches 37978 38007 +29
============================================
+ Hits 139290 139393 +103
- Misses 44252 44351 +99
- Partials 10900 10920 +20
```
</details>
[:umbrella: View full report in Codecov by Harness](https://app.codecov.io/gh/apache/systemds/pull/2573?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [SYSTEMDS-3891] Add Materialized Planning Support [systemds]
Posted by "janniklinde (via GitHub)" <gi...@apache.org>.
janniklinde merged PR #2573:
URL: https://github.com/apache/systemds/pull/2573
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org