You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "barunkumaracharya (via GitHub)" <gi...@apache.org> on 2026/01/12 18:01:58 UTC
[I] [Feature Request]: Predicate Filter Pushdown support for Nested Columns. [beam]
barunkumaracharya opened a new issue, #37288:
URL: https://github.com/apache/beam/issues/37288
### What would you like to happen?
I see that From Apache Beam 2.66.0, one can apply "filter" on a Iceberg ManagedIO Read Operation.
For ex- If i have 2 columns named **day** and **ingestedAt**, i can write something like this and pass as a map to my Iceberg ManagedIO.read() transform.
`filter: "\"day\" = '20260109' AND \"ingestedAt\" = '2026-01-09T15:08:38.122'`
What i also want to know is, if its possible to apply this kind of a filter on a nested column (column present inside a struct type). For ex, if i had a column named **eventInfo** whose type is struct and it had a column called **zone** inside it, I wanted to know if i could apply a predicate pushdown filter like
`filter: "\"day\" = '20260109' AND \"ingestedAt\" = '2026-01-09T15:08:38.122' AND \"eventInfo.\".\"zone\" = 'abc'`
### Issue Priority
Priority: 2 (default / most feature requests should be filed as P2)
### Issue Components
- [ ] Component: Python SDK
- [x] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Infrastructure
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature Request]: IcebergIO Predicate Filter Pushdown support for Nested Columns. [beam]
Posted by "ahmedabu98 (via GitHub)" <gi...@apache.org>.
ahmedabu98 closed issue #37288: [Feature Request]: IcebergIO Predicate Filter Pushdown support for Nested Columns.
URL: https://github.com/apache/beam/issues/37288
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature Request]: IcebergIO Predicate Filter Pushdown support for Nested Columns. [beam]
Posted by "GaneshPatil7517 (via GitHub)" <gi...@apache.org>.
GaneshPatil7517 commented on issue #37288:
URL: https://github.com/apache/beam/issues/37288#issuecomment-3750680892
Hey @barunkumaracharya can you assign me i want to work on this...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature Request]: IcebergIO Predicate Filter Pushdown support for Nested Columns. [beam]
Posted by "barunkumaracharya (via GitHub)" <gi...@apache.org>.
barunkumaracharya commented on issue #37288:
URL: https://github.com/apache/beam/issues/37288#issuecomment-3884347285
@liferoad , can you share some status of the progress. Thanks for the help :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org