You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Platob (via GitHub)" <gi...@apache.org> on 2023/04/11 11:33:02 UTC
[GitHub] [arrow] Platob opened a new issue, #35037: [C#] Add Arrow.Parquet File Reader/Writer
Platob opened a new issue, #35037:
URL: https://github.com/apache/arrow/issues/35037
### Describe the enhancement requested
Hello,
It would be really nice to have Parquet Reader/Writer to Iterate over RowGroups converted in Arrow.RecordBatch
Is it planned ?
Would it be a wrapper around C++ implementation ?
Project alike: [ParquetSharp](https://github.com/G-Research/ParquetSharp)
Br
### Component(s)
C#
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] alikleit commented on issue #35037: [C#] Add Arrow.Parquet File Reader/Writer
Posted by "alikleit (via GitHub)" <gi...@apache.org>.
alikleit commented on issue #35037:
URL: https://github.com/apache/arrow/issues/35037#issuecomment-1686295334
I see that ParquetSharp might not fit the needs of Writing from Arrow.RecordBatch where we have to compose a List of Columns and each column has a logicalSystemType rather than an ArrowType. Therefor an extra Mapping Layer that will be present. While apache arrow parquet (python) implement's a writer that writes directly record batches into the table.
I find that quite important to have if you are working with multiple languages and the communication is via arrow, and parquet is the file format used by each.
Is there or would be there an option to do that in C#?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] Platob commented on issue #35037: [C#] Add Arrow.Parquet File Reader/Writer
Posted by "Platob (via GitHub)" <gi...@apache.org>.
Platob commented on issue #35037:
URL: https://github.com/apache/arrow/issues/35037#issuecomment-1506789287
Found a workaround reading/writing in C++ IPC files, and handling in cpp convertions
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] Platob closed issue #35037: [C#] Add Arrow.Parquet File Reader/Writer
Posted by "Platob (via GitHub)" <gi...@apache.org>.
Platob closed issue #35037: [C#] Add Arrow.Parquet File Reader/Writer
URL: https://github.com/apache/arrow/issues/35037
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org