You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "davlee1972 (via GitHub)" <gi...@apache.org> on 2024/12/09 17:16:22 UTC

Re: [I] [Python][Parquet] ParquetDataset should expose partition_base_dir [arrow]

davlee1972 commented on issue #44765:
URL: https://github.com/apache/arrow/issues/44765#issuecomment-2528789991

   https://github.com/apache/arrow/issues/38485
   
   I made some suggestions in the above ticket.
   
   you could work backwards to figure out the base dir..
   
   If your files are saved like:
   
   base_dir/USD/20241107/test1.parquet
   
   and your partitioning fields are [currency , fxdate]
   
   You should be able to work backwards to figure out base_dir is the base directory
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org