You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/08/17 21:11:00 UTC

[jira] [Updated] (ARROW-15409) [C++] The C++ API for writing datasets could be improved

     [ https://issues.apache.org/jira/browse/ARROW-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Weston Pace updated ARROW-15409:
--------------------------------
    Labels: good-first-issue  (was: )

> [C++] The C++ API for writing datasets could be improved
> --------------------------------------------------------
>
>                 Key: ARROW-15409
>                 URL: https://issues.apache.org/jira/browse/ARROW-15409
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: Weston Pace
>            Priority: Major
>              Labels: good-first-issue
>
> I was working on write dataset testing in the C++ API today and ran into a number of things that were not very intuitive.  All of these are abstracted away / hidden by the python / R interface so this really only applies to anyone using the C++ API directly.
>  * If no partitioning is specified the write will segfault.  Instead it should us a default (no-op) partitioning.
>  * The min_rows_per_group option should probably default to something higher than 0
>  * It's not clear how to specify the format (you do it by creating a format, then setting the file write options, which sets the format privately)
>  * There is no default for basename_template
>  * There is no default for filesystem (should be local filesystem)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)