[GitHub] [arrow] rtpsw commented on issue #35498: [C++][Parquet] Parquet write_to_dataset performance regression

["rtpsw (via GitHub)" <gi...@apache.org>]

rtpsw commented on issue #35498:
URL: https://github.com/apache/arrow/issues/35498#issuecomment-1540487190

   > I am not directly sure for the reason to do this here, cc @rtpsw @westonpace
   
   The reason for adding `EnsureAlignment` is that Flight generated misaligned buffer (#32276), and more generally because the combination of a zero-copy policy with a non-aligned format leads to misaligned buffers. Arrow requires [aligned buffers](https://arrow.apache.org/docs/format/Columnar.html#buffer-alignment-and-padding), and I'm not sure there is a good way around this requirement.
   
   Note that so far I didn't look into the specifics of the current issue - it may be due to Flight or some other misaligned format used as input, or some other reason.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org