You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "AlenkaF (via GitHub)" <gi...@apache.org> on 2023/03/30 11:38:53 UTC

[GitHub] [arrow] AlenkaF commented on issue #34774: [Python] Interchange `pa.Table`'s `Column.null_count` doesn't count NaNs

AlenkaF commented on issue #34774:
URL: https://github.com/apache/arrow/issues/34774#issuecomment-1490151014

   > cc @AlenkaF (let me know if not to tag you on things! coincidentally I was working on [data-apis/dataframe-interchange-tests#20](https://github.com/data-apis/dataframe-interchange-tests/issues/20) today when Ralf commented heh.)
   
   Do tag me please! =)
   Very cool you both jumped on it so quickly hehe.
   
   > I assume this is because Arrow does not treat NaNs as nulls, which semantically makes sense, but in the interchange protocol it should—see [vaexio/vaex#2120](https://github.com/vaexio/vaex/issues/2120) for a related discussion.
   
   But we agree with Maarten 😊  https://github.com/vaexio/vaex/issues/2120#issuecomment-1194047890
   There would be loss of information for all the libraries that actually differentiate between nan and null, right? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org