You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/05/21 06:59:36 UTC

[PR] [core] Append-Only table use zstd compression default instead of snappy for reduce storage in parquet format [paimon]

xuzifu666 opened a new pull request, #3360:
URL: https://github.com/apache/paimon/pull/3360

   <!-- Please specify the module before the PR name: [core] ... or [flink] ... -->
   
   When we test append only table in stream scences, we found the condition paimon table storage is 1.3x size of hive table，this is a litter high，then we change compression from snappy(wich is default) to zstd, storage from 1.3x to 1.04x which is expected to us.
   From other lake engine we also do the change and other lake engine also reduce storage and stream job is stable as the smame.
   So should we make the default compression in parquet to zstd?
   
   <!-- Linking this pull request to the issue -->
   Linked issue: [close #xxx](https://github.com/apache/paimon/issues/3359)
   
   <!-- What is the purpose of the change -->
   
   
   ### Tests
   
   <!-- List UT and IT cases to verify this change -->
   
   ### API and Format
   
   <!-- Does this change affect API or storage format -->
   
   ### Documentation
   
   <!-- Does this change introduce a new feature -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [core] Append-Only table use zstd compression default instead of snappy for reduce storage in parquet format [paimon]

Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 closed pull request #3360: [core] Append-Only table use zstd compression default instead of snappy for reduce storage in parquet format
URL: https://github.com/apache/paimon/pull/3360


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [core] Append-Only table use zstd compression default reduce storage in parquet format [paimon]

Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 closed pull request #3360: [core] Append-Only table use zstd compression default reduce storage in parquet format
URL: https://github.com/apache/paimon/pull/3360


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org