You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/08/23 07:50:14 UTC

[GitHub] [arrow] jorisvandenbossche commented on pull request #13938: ARROW-17388: [C++][Python] Error on WriteTable if duplicate field names

jorisvandenbossche commented on PR #13938:
URL: https://github.com/apache/arrow/pull/13938#issuecomment-1223688965

   Indeed, we shouldn't disallow this since Parquet itself allows duplicate field names. And our Parquet reader actually also can read such files (it's only the dataset code that fails):
   
   ```
   >>> pq.read_table("file_duplicate.parquet")    # <-- defaults to use the dataset API
   ...
   ArrowInvalid: Multiple matches for FieldRef.Name(a) in ...
   
   >>> pq.ParquetFile("file_duplicate.parquet").read()   # <-- direct usage of Parquet reader works fine
   pyarrow.Table
   a: int64
   a: int64
   ----
   a: [[0,1,2,3,4]]
   a: [[5,6,7,8,9]]
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org