You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/09/19 10:07:29 UTC

[GitHub] [airflow] anayrat opened a new issue, #26476: Consider faster compression algorithm

anayrat opened a new issue, #26476:
URL: https://github.com/apache/airflow/issues/26476

   ### Description
   
   Hello,
   
   I suggest to consider faster compression algorithm, such as zstd or lz4.
   
   ### Use case/motivation
   
   Such algorithms are way faster than gzip and as efficient as gzip : 
   https://github.com/facebook/zstd#benchmarks
   
   Furthermore, the cpu cost will be lowered.
   
   Maybe you can consider slower but more efficient algorithm, when size matter more than time to compress/decompress (lzma).
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #26476: Consider faster compression algorithm

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #26476:
URL: https://github.com/apache/airflow/issues/26476#issuecomment-1250821158

   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk closed issue #26476: Consider faster compression algorithm

Posted by GitBox <gi...@apache.org>.
potiuk closed issue #26476: Consider faster compression algorithm
URL: https://github.com/apache/airflow/issues/26476


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org