You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Karl Dunkle Werner (Jira)" <ji...@apache.org> on 2019/10/30 21:16:00 UTC
[jira] [Created] (ARROW-7035) [R] Default arguments are unclear in
write_parquet docs
Karl Dunkle Werner created ARROW-7035:
-----------------------------------------
Summary: [R] Default arguments are unclear in write_parquet docs
Key: ARROW-7035
URL: https://issues.apache.org/jira/browse/ARROW-7035
Project: Apache Arrow
Issue Type: Improvement
Components: R
Affects Versions: 0.15.0
Environment: Ubuntu with libparquet-dev 0.15.0-1, R 3.6.1, and arrow 0.15.0.
Reporter: Karl Dunkle Werner
Fix For: 0.15.1
Thank you so much for adding support for reading and writing parquet files in R! I have a few questions about the user interface and optional arguments, but I want to highlight how great it is to have this useful filetype to pass data back and forth.
The defaults for the optional arguments in {{arrow::write_parquet}} aren't always clear. Here were my questions after reading the help docs from {{write_parquet}}:
* What's the default {{version}}? Should a user prefer "2.0" for new projects?
* What are acceptable values for {{compression}}? (Answer: {{uncompressed}}, {{snappy}}, {{gzip}}, {{brotli}}, {{zstd}}, or {{lz4}}.)
* What's the default for {{use_dictionary}}? Seems to be {{TRUE}}, at least some of the time.
* What's the default for {{write_statistics}}? Should a user prefer {{TRUE}}?
* Can I assume {{allow_truncated_timestamps}} is {{FALSE}} by default?
As someone who works in both R and Python, I was a little surprised when pyarrow uses snappy compression by default, but R's default is uncompressed. My preference would be having the same default arguments, but that might be a fringe use-case.
While I was digging into this, I was surprised that {{ParquetReaderProperties}} is exported and documented, but {{ParquetWriterProperties}} isn't. Is that intentional?
Thanks!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)