You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "JingsongLi (via GitHub)" <gi...@apache.org> on 2026/07/27 15:30:32 UTC

[PR] [core] Optimize ZSTD block decompression [paimon]

JingsongLi opened a new pull request, #8865:
URL: https://github.com/apache/paimon/pull/8865

   ## What changed
   
   - Replace `ZstdInputStream` and `ByteArrayInputStream` with zstd-jni's direct byte-array decompression API.
   - Preserve source and destination offsets and translate zstd failures to `BufferDecompressionException`.
   
   ## Why
   
   Block decompression is a hot path for compressed local lookup data. The stream-based implementation allocates wrapper objects and repeatedly calls `read`; the direct API decompresses the complete block into the caller-provided buffer in one native call.
   
   ## Validation
   
   - `mvn -q -pl paimon-common -Pfast-build -DwildcardSuites=none -Dtest=BlockCompressionTest test`
   - `mvn -q -pl paimon-common spotless:check -DskipTests`
   - `mvn -q -pl paimon-common -DskipTests compile`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [core] Optimize ZSTD block decompression [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #8865:
URL: https://github.com/apache/paimon/pull/8865


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org