You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/08/30 10:40:00 UTC

[jira] [Created] (ARROW-13791) [Python][Docs] Update datasets user guide with more details on Partitioning(Factory)

Joris Van den Bossche created ARROW-13791:
---------------------------------------------

             Summary: [Python][Docs] Update datasets user guide with more details on Partitioning(Factory)
                 Key: ARROW-13791
                 URL: https://issues.apache.org/jira/browse/ARROW-13791
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Documentation, Python
            Reporter: Joris Van den Bossche


Currently, the datasets user guide has a section about the different partitioning flavors: https://arrow.apache.org/docs/python/dataset.html#different-partitioning-schemes. However, for the case where the partitioning schema is inferred from the file paths, this only shows the "short-cut" way to do this, and not the equivalent explicit method to create a factory object with {{ds.Hive/DirectoryPartitioning.discover(..)}} call, which allows to specify more options (eg using dictionary types or not, etc).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)