You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by GitBox <gi...@apache.org> on 2022/11/27 19:04:15 UTC
[GitHub] [systemds] phaniarnab opened a new pull request, #1739: [SYSTEMDS-3470] Lineage-based local reuse of Spark actions
phaniarnab opened a new pull request, #1739:
URL: https://github.com/apache/systemds/pull/1739
This patch extends the lineage cache framework to cache the results of the Spark instruction, which return intermediates back to local. Only caching the actions avoids unnecessary triggering and fetching all Spark intermediates. For now, we avoid caching the future-based results.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] phaniarnab closed pull request #1739: [SYSTEMDS-3470] Lineage-based local reuse of Spark actions
Posted by GitBox <gi...@apache.org>.
phaniarnab closed pull request #1739: [SYSTEMDS-3470] Lineage-based local reuse of Spark actions
URL: https://github.com/apache/systemds/pull/1739
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org