You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jorisvandenbossche (via GitHub)" <gi...@apache.org> on 2023/02/24 16:50:26 UTC

[GitHub] [arrow] jorisvandenbossche commented on issue #34315: [Python] `pa.compute.is_null()` returns incorrect answer for dense union arrays and segfaults for dense union scalars

jorisvandenbossche commented on issue #34315:
URL: https://github.com/apache/arrow/issues/34315#issuecomment-1444003463

   @dannygoldstein thanks for the report! That's indeed a bug. The problem is that for a union array, there is no top-level validity, but this is defined by the validity bitmaps of its child arrays. But the `is_null` kernel should take this into account, which doesn't seem to happen. 
   
   The problem is also that the `null_count` attribute is already wrong (and it might be that `is_null` is taking a shortcut because of that):
   
   ```
   >>> dense.null_count
   0
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org