You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Neal Richardson (Jira)" <ji...@apache.org> on 2020/08/09 02:59:00 UTC
[jira] [Closed] (ARROW-9675) the table does not load if the file
path has a dot at start
[ https://issues.apache.org/jira/browse/ARROW-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Neal Richardson closed ARROW-9675.
----------------------------------
Fix Version/s: (was: 1.0.0)
Assignee: Ben Kietzman
Resolution: Duplicate
> the table does not load if the file path has a dot at start
> ------------------------------------------------------------
>
> Key: ARROW-9675
> URL: https://issues.apache.org/jira/browse/ARROW-9675
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 1.0.0
> Environment: Windows 10
> Reporter: Praveen Kulkarni
> Assignee: Ben Kietzman
> Priority: Major
> Labels: read, table
>
> Please check the below code. If I uncomment line six then the table written to disk is loaded as an empty table.
> Similar behavior is observed when the directory name starts with `_`.
> This was not the case in earlier versions.
>
> ```python
> import pyarrow.parquet as pq
> import pyarrow as pa
> import pathlib
> _path = pathlib.Path("abc").resolve()
> _path /= "xyz"
> _path /= ".lmn" # uncomment this has a 'dot' at start of the folder
> _path /= "file_name"
> pq.write_to_dataset(
> table=pa.table({"a": [1], "b": [2]}),
> root_path=_path.as_posix()
> )
> t = pq.read_table(_path)
> print(t.to_pandas())
> ```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)