You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Divij Vaidya (Jira)" <ji...@apache.org> on 2023/02/07 09:47:00 UTC
[jira] [Commented] (KAFKA-14630) Update zstd-jni version to 1.5.2-5
[ https://issues.apache.org/jira/browse/KAFKA-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685181#comment-17685181 ]
Divij Vaidya commented on KAFKA-14630:
--------------------------------------
I have added a new feature to zstd-jni which helps Kafka: [https://github.com/luben/zstd-jni/pull/244]
We should wait for the next release containing this feature before incrementing the version.
> Update zstd-jni version to 1.5.2-5
> ----------------------------------
>
> Key: KAFKA-14630
> URL: https://issues.apache.org/jira/browse/KAFKA-14630
> Project: Kafka
> Issue Type: Sub-task
> Components: core
> Reporter: Divij Vaidya
> Assignee: Divij Vaidya
> Priority: Major
>
> The latest version of zstd-jni as of Jan 2023 is 1.5.2-5. Note that this version inflates the size of binary [2]. Most of the improvements in the diff are associated with DirectBuffer streams (which we don't use) but we *could* use. Also note that other apache projects such as spark [3]have been using the upgraded version.
> {noformat}
> diviv:zstd-jni/ (master) $ git log --pretty=oneline v1.5.2-1...c1.5.2-5 [14:13:34]
> 32b337aed4b3f9b0edf6e0bfaa470ee777128c30 (tag: c1.5.2-5) v1.5.2-5
> 4a46d8126e9bd7f37ae6ebd7d1ad36594fee7847 Fix #151: add support for magicless frames
> d168ce7198dd1827d0f148a6948ff0bb0dd04df3 Fix typos in README and code
> 612e7ebb41e35061209748b8a231fd7e8bef4bcb Fix typos in README and code
> 451df09a7717793f0eae7c310378f8d33907ec85 Upgrade to ScalaTest-3.2
> 37faee49643b2739457716e3752f44fcaa09005f v1.5.2-4
> dcadaf0838412c96d26d44792d96384af55af0e7 Add option to increase the decompression window
> a3b5c4c1a02ddee56f6e2b019d6c8b52f8e63411 Add method to disable the native library loading
> 8e73994bc7731407a3ddea160298ca141dc3b190 Use new ZstdIOException when replacing IOException
> bdbb00b0a45a537a3ac218382d19e47b56156c68 Throw ZstdException when the error is coming from Zstd
> 905202f10e5355cf7ed7a558e909558bc6ebf184 Use negative values of error codes
> 2a19b846c2ccdbc20adfb4a2b4a45b635f641e19 Remove dependency on internal headers
> c970b548bb657df719fb5742a9496e6b3c07f0e3 Wrong srcSize used
> 1f04f24d02bd7c74c890b1325766b808fb353b4e Suppress warnings
> 5d89af50095f91a4da6628d99d4012823da195ff Fix copy/paste error
> 4b64eca0ce9ad8157474b453789d1305c2462c03 Update docs for Android tests
> 3320b520332c70c2bd48d2d7fdf68f0f6c87126a Do not use CXX flags
> c983ae3e086b63a40e1bb430cb2ebf95ecc52c71 (tag: v1.5.2-3) Adjust signature comments after e5c6a3290b8335db7c70877fda22ca26a96c72e4.
> 510bbd6be80592227c6e5cf8cd8d71cb76c0c279 Add methods for streaming (de)compression of direct ByteBuffers.
> 62b9dad49fc00f253cb35c1942c3ca6af4ee2b47 Fix lgtm C++.
> 73ae46e1af16619143b7c87e35ad9c05363e2c97 v1.5.2-3
> e5c6a3290b8335db7c70877fda22ca26a96c72e4 Fix overflows
> 54d3d50c16d96bd8a30e2d4c0a9648001a52d6f9 Fix some error return codes.
> b788a2ed7a5e36e5252b1696e6cc8bae48a7afbc Upgrade scala.
> 31060934c26e080031465702ec369591e12874f8 Add NoFinalizer variants for the direct buffer streams.
> 3d5ab915167f2dfe244d2d2192b66a9feac7c543 (tag: v1.5.2-2) Fix the symbols export on the cross-compiled libraries also
> 8a4993f57119e2b682d1f0b8db263027983208c6 Use different approach for MacOS to not export all symbols
> 15352a3941e8bec2dd1f374768478c02eaf69d6f Don't pass version-script to clang linker, it's not supported
> 9916cbd611cd882b5d4958d4acf0518c01363487 Don't export the zstd symbols, just our own ones
> 277cb2779e2e1922d6de0cf4e1e7519d2647acef fix spelling
> ff3a141d78abc71741734b0d0524bf47096b29f8 Fallback to `scp` if `rsync` in not installed on the build machines
> ba99eec9ac9a5c3eb16200ae67c235a91b16b570 Up the version
> 4c4d9cd382b6e515a7d0d6cd37c1ebb087f5ab73 Support LoongArch64
> 97550e35610cd36e2ad510e20e503c0f997c1a3a Remove frameHeaderSize(Min|Max){noformat}
> [2] [https://github.com/luben/zstd-jni/issues/237]
> [3][https://github.com/apache/spark/commit/c50d865fa9eb5207bc8c9992e37843412ec0cbc3]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)