You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "JacekPliszka (via GitHub)" <gi...@apache.org> on 2023/11/16 21:02:58 UTC
[I] Add is_nan, is_null, is_valid as operators to DNF filters [arrow]
JacekPliszka opened a new issue, #38750:
URL: https://github.com/apache/arrow/issues/38750
### Describe the enhancement requested
Currently pyarrow.parquet.core.filters_to_expression handles equality/inequality operators and in and not in operators.
I propose adding is_nan, is_null, is_valid operators where value passed would be ignored but they would
return field.is_nan() field.is_null() field.is_valid() expressions.
This is a very easy change but it would allow null/nan filtering in DNF form.
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Add is_nan, is_null, is_valid as operators to DNF filters [arrow]
Posted by "davlee1972 (via GitHub)" <gi...@apache.org>.
davlee1972 commented on issue #38750:
URL: https://github.com/apache/arrow/issues/38750#issuecomment-2008610497
I added a bunch here with a DNF function.. “is” and “is not” operators support is None, is True, is False, is not None, is not True, etc..
https://github.com/apache/arrow/issues/39128
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Add is_nan, is_null, is_valid as operators to DNF filters [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #38750:
URL: https://github.com/apache/arrow/issues/38750#issuecomment-3921967493
This issue has been marked as stale because it has had no activity in the past 2 years. Please remove the stale label or comment below, or this issue will be closed in 14 days.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org