You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/09/21 15:08:38 UTC

[GitHub] [arrow] pitrou commented on pull request #8229: ARROW-9579: [C++] Provide the plugin API to support customized compression codec for parquet

pitrou commented on pull request #8229:
URL: https://github.com/apache/arrow/pull/8229#issuecomment-696176912


   Hmm, reading the mailing-list discussion again, I don't think we had agreed on a design. The first question for me is what the end-user API should be.
   * should the user calling the Parquet reader ask explicitly for a compression override (e.g. "instead of using standard GZip, use HW-accelerated GZip")
   * should instead the compression override be configured using a global setting?
   * or should the override even be transparent? (how?)
   
   From a first look, I see this PR proposes a plugin API, which does not seem necessary to solve the problem at hand. Arrow is a library and I'm not sure it's our duty to implement a specific extension-loading mechanism (though I could be convinced otherwise :-)).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org