You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "tustvold (via GitHub)" <gi...@apache.org> on 2023/06/07 13:41:08 UTC

[GitHub] [arrow-rs] tustvold commented on issue #4253: Prototype ArrayView Types

tustvold commented on issue #4253:
URL: https://github.com/apache/arrow-rs/issues/4253#issuecomment-1580849891

   The benchmarks in #4378 show half the execution time being spent rewriting data to remove empty array slices. This likely could be optimised, and it is unclear how realistic the benchmark is, but I thought it was an interesting data point.
   
   ![image](https://github.com/apache/arrow-rs/assets/1781103/4e413a3a-1f99-484d-99e4-d05a93ac5a3f)
   
   Theoretically ArrayView types would remove the need for this, whilst also removing the memcpy when decoding byte arrays. I'd anticipate roughly a 2x return, with bigger returns for more heavily nested data


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org