You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "devinjdangelo (via GitHub)" <gi...@apache.org> on 2023/09/02 00:55:01 UTC

[GitHub] [arrow-datafusion] devinjdangelo opened a new pull request, #7463: Parquet col options

devinjdangelo opened a new pull request, #7463:
URL: https://github.com/apache/arrow-datafusion/pull/7463

   ## Which issue does this PR close?
   
   Closes #7442 
   
   ## Rationale for this change
   
   Extends syntax and allowed options for SQL statement options to configure parquet column level options (e.g. different compression for each column).
   
   ## What changes are included in this PR?
   
   Implements new parsing utils and options for parquet column specific options.
   
   ## Are these changes tested?
   
   Somewhat by existing tests, more tests needed.
   
   ## Are there any user-facing changes?
   
   Breaking change. Setting default parquet write settings are now suffixed with _default. E.g. "compression_default" since now "compression" expects column level settings.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow-datafusion] alamb closed pull request #7463: Support Configuring Parquet Column Specific Options via SQL Statement Options

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed pull request #7463: Support Configuring Parquet Column Specific Options via SQL Statement Options
URL: https://github.com/apache/arrow-datafusion/pull/7463


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org