You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2019/10/08 17:22:43 UTC

[GitHub] [incubator-iceberg] anjalinorwood opened a new issue #522: Separate Arrow work into its own sub-module in Iceberg

anjalinorwood opened a new issue #522: Separate Arrow work into its own sub-module in Iceberg
URL: https://github.com/apache/incubator-iceberg/issues/522
 
 
   A few Arrow related changes (outlined below) were needed to get better performance with Vectorized Iceberg Reads. It would be good to get these issues fixed in Arrow, but meanwhile these Arrow-related fixes in Iceberg should be separated out in its own sub-module.
   The changes are: 
   1) Iceberg Vectorized Read code path maintains a separate validity vector (as array of booleans) on heap and consults this validity vector before accessing the data value. Arrow validity vector continues to get populated for correctness.
   2) Arrow checks to check for null values are disabled.
   3) 'Invalid memory access' checks are disabled.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org