[GitHub] [systemds] phaniarnab opened a new pull request, #1853: [SYSTEMDS-3585] Reuse lineage traces from lineage cache

["phaniarnab (via GitHub)" <gi...@apache.org>]

phaniarnab opened a new pull request, #1853:
URL: https://github.com/apache/systemds/pull/1853

   This commits adds a small but useful extension to lineage-base reuse. We now also reuse the lineage traces corresponding to the reused intermediates by replacing the live lineage traces with the cached ones. This change increases the use of same lineage items in many lineage DAGs, which in turn reduces probing cost and memory overhead. This extension is disabled for parfor and deduplicated lineage traces. Integrating with those require more thoughts.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [systemds] phaniarnab closed pull request #1853: [SYSTEMDS-3585] Reuse lineage traces from lineage cache

["phaniarnab (via GitHub)" <gi...@apache.org>]

phaniarnab closed pull request #1853: [SYSTEMDS-3585] Reuse lineage traces from lineage cache
URL: https://github.com/apache/systemds/pull/1853


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org