You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by GitBox <gi...@apache.org> on 2021/06/08 19:57:26 UTC
[GitHub] [systemds] Baunsgaard opened a new pull request #1305: [WIP][SYSTEMDS-2992+2993] Workload costing and Cost-based Compression Planning
Baunsgaard opened a new pull request #1305:
URL: https://github.com/apache/systemds/pull/1305
[SYSTEMDS-2992+2993] Workload costing and Cost-based Compression Planning
This commit contains a new package in the compression framework, that
allow selection of cost models for compression.
One classical cost model is memory size, in this commit there are
multiple more, most notably
MEMORY, W_TREE, HYBRID, DISTINCT.
- Memory is the memory based optimization,
- W_TREE is based on the extracted WTree of instructions
- HYBRID is a combination of memory and W_TREE,
- DISTINCT is based on making the dictionaries as small as possible.
- LEFT_MATRIX_MULT is based on optimizing only for Left Matrix Multiplications
- Decompression is ... for decompression time
- TSMM for fast transpose self matrix multiplication
Additionally to these additions all CoCoding thechniques now optimize
towards the given type of cost model, making it posible to make for
for instance BIN_PACKING DISTINCT optimization, or HYBRID Brute Force,
etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] Baunsgaard commented on pull request #1305: [SYSTEMDS-2992+2993] Workload costing and Cost-based Compression Planning
Posted by GitBox <gi...@apache.org>.
Baunsgaard commented on pull request #1305:
URL: https://github.com/apache/systemds/pull/1305#issuecomment-864896169
Closing because of continued work in PR : #1320
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] Baunsgaard closed pull request #1305: [SYSTEMDS-2992+2993] Workload costing and Cost-based Compression Planning
Posted by GitBox <gi...@apache.org>.
Baunsgaard closed pull request #1305:
URL: https://github.com/apache/systemds/pull/1305
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] Baunsgaard commented on pull request #1305: [SYSTEMDS-2992+2993] Workload costing and Cost-based Compression Planning
Posted by GitBox <gi...@apache.org>.
Baunsgaard commented on pull request #1305:
URL: https://github.com/apache/systemds/pull/1305#issuecomment-864896169
Closing because of continued work in PR : #1320
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [systemds] Baunsgaard closed pull request #1305: [SYSTEMDS-2992+2993] Workload costing and Cost-based Compression Planning
Posted by GitBox <gi...@apache.org>.
Baunsgaard closed pull request #1305:
URL: https://github.com/apache/systemds/pull/1305
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org