You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2020/04/14 07:39:00 UTC
[jira] [Closed] (ARROW-8418) [Python] partition_filename_cb in
write_to_dataset should be passed additional keyword arguments rather than
just keys
[ https://issues.apache.org/jira/browse/ARROW-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joris Van den Bossche closed ARROW-8418.
----------------------------------------
Resolution: Not A Problem
> [Python] partition_filename_cb in write_to_dataset should be passed additional keyword arguments rather than just keys
> ----------------------------------------------------------------------------------------------------------------------
>
> Key: ARROW-8418
> URL: https://issues.apache.org/jira/browse/ARROW-8418
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Affects Versions: 0.16.0
> Reporter: Varun Patil
> Priority: Trivial
> Labels: easyfix, newbie
>
> I recently had a requirement where I would have liked to construct a filename based on additional context from Apache Airflow (specifically execution_date).
> It would be nice to pass the additional kwargs to *partition_filename_cb* so that the filename can be constructed using additional information rather than just the keys used for partitioning.
> I believe the fix should be as simple as passing kwargs to the *partition_filename_cb* inside *write_to_dataset.*
--
This message was sent by Atlassian Jira
(v8.3.4#803005)