You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by GitBox <gi...@apache.org> on 2022/10/10 16:56:20 UTC
[GitHub] [systemds] phaniarnab opened a new pull request, #1704: [SYSTEMDS-3443] Asynchronously execute and persist Spark transformations
phaniarnab opened a new pull request, #1704:
URL: https://github.com/apache/systemds/pull/1704
This patch adds an operator to asynchronously trigger a chain of Spark transformations and persist the result. This is a generalization of Prefetch instruction and works if the consumer is a Spark transformation
or action. TODO: operator placement (in parallel with a CP instruction chain).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] phaniarnab closed pull request #1704: [SYSTEMDS-3443] Asynchronously execute and persist Spark transformations
Posted by GitBox <gi...@apache.org>.
phaniarnab closed pull request #1704: [SYSTEMDS-3443] Asynchronously execute and persist Spark transformations
URL: https://github.com/apache/systemds/pull/1704
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org