[GitHub] [systemds] Baunsgaard opened a new pull request, #1902: [SYSTEMDS-???] Compression codecs

["Baunsgaard (via GitHub)" <gi...@apache.org>]

Baunsgaard opened a new pull request, #1902:
URL: https://github.com/apache/systemds/pull/1902

   I am surprised, but with moderate to large size files our parallel writers are better if we enable snappy on the write path. It improve the write speed a little. and significantly reduce the size of the files on disk.
   
   Uncompressed:
   ```txt
   StandardDisk,    6.345+-  0.907 ms,   1260913549 Byte/s,   1278545356 Byte/s
   ```
   
   Snappy:
   ```txt
   StandardDisk,    6.021+-  0.946 ms,   1328816357Byte/s,     291445747 Byte/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [SYSTEMDS-3619] IO save Encoded [systemds]

["Baunsgaard (via GitHub)" <gi...@apache.org>]

Baunsgaard closed pull request #1902: [SYSTEMDS-3619] IO save Encoded
URL: https://github.com/apache/systemds/pull/1902


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org