You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by GitBox <gi...@apache.org> on 2021/03/11 05:15:51 UTC

[GitHub] [kafka] dongjoon-hyun edited a comment on pull request #10285: KAFKA-12442: Upgrade ZSTD JNI from 1.4.8-4 to 1.4.9-1

dongjoon-hyun edited a comment on pull request #10285:
URL: https://github.com/apache/kafka/pull/10285#issuecomment-796460374


   Since the new features are not used, you may right. However, I believe the benefits are three-fold.
   - There exists ZSTD side bug-fixes at ZSTD 1.4.9.
   - There exists ZSTD JNI side memory optimization improvements at ZSTD JNI 1.4.8-5 ~ 1.4.8-7. (This includes some incompatible changes and recovery).
   - I hope this will reduce the chance of future potential version conflict issues across Apache projects.
      - Apache Spark 3.2.0 will use ZSTD 1.4.9. (https://github.com/apache/spark/commit/ba7e525a114cba01735ba94dc6d3a55dc372a2fc)
      - Apache Parquet 1.12.0 will use ZSTD 1.4.9 (https://github.com/apache/parquet-mr/commit/66ac28ce232c586626f53b72110276ea45ec5fa2)
      - Apache Avro 1.10.3 will use ZSTD 1.4.9 (https://github.com/apache/avro/commit/806667cb2b18e45d16fff25514c17a0272db2b2d)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org