You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/08/02 03:31:41 UTC

[GitHub] [arrow] emkornfield commented on pull request #7326: ARROW-9010: [Java] Framework and interface changes for RecordBatch IPC buffer compression

emkornfield commented on pull request #7326:
URL: https://github.com/apache/arrow/pull/7326#issuecomment-667620948


   > Hi, I have a question... probably not related to what this PR focus on.
   What if the compressor / decompressor for the codec will have JNI call for compression / decomperssion? If so, it will have JNI call on each buffer. Can we support a JNI bridge to the RecordBatch level depending on the codec?
   
   I think parquet is considering moving to [Airlift](https://github.com/airlift/aircompressor) which doesn't use JNI.  We should discuss specific library choices on the mailing list. Also it might be nice but not a hard requirement to follow an SPI pattern (similar to what we do for allocators) to avoid a hard dependency on any particular allocator.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org