[I] RecordBatch::normalize() does not propagate top level null bitmap into the results [arrow-rs]

["sqd (via GitHub)" <gi...@apache.org>]

sqd opened a new issue, #9732:
URL: https://github.com/apache/arrow-rs/issues/9732

   Currently RecordBatch::normalize() has a bug in that the top level struct's null bitmap is not propagated into the resulting normalized arrays' null bitmap. In other words, a child element may suddenly appear non-null, losing the fact that the parent level struct is null at that index.
   
   **To Reproduce**
   See the added test for RecordBatch::normalize() in the associated PR.
   
   **Expected behavior**
   RecordBatch::normalize() propagates top level struct's null bitmap into the resulting normalized arrays.
   
   **Additional context**
   This is perfectly legal https://github.com/apache/arrow/blob/main/docs/source/format/Columnar.rst#struct-validity:
   
   > A struct array has its own validity bitmap that is independent of its child arrays' validity bitmaps. The validity bitmap for the struct array might indicate a null when one or more of its child arrays has a non-null value in its corresponding slot; or conversely, a child array might indicate a null in its validity bitmap while the struct array's validity bitmap shows a non-null value.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] RecordBatch::normalize() does not propagate top level null bitmap into the results [arrow-rs]

["alamb (via GitHub)" <gi...@apache.org>]

alamb closed issue #9732: RecordBatch::normalize() does not propagate top level null bitmap into the results
URL: https://github.com/apache/arrow-rs/issues/9732


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] RecordBatch::normalize() does not propagate top level null bitmap into the results [arrow-rs]

["alamb (via GitHub)" <gi...@apache.org>]

alamb commented on issue #9732:
URL: https://github.com/apache/arrow-rs/issues/9732#issuecomment-4307523738

   `label_issue.py` automatically added labels {'arrow'} from #9733


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org