You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Anonymous (Jira)" <ji...@apache.org> on 2023/04/13 10:59:00 UTC
[jira] [Updated] (BEAM-8365) Add project push-down capability to IO APIs
[ https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anonymous updated BEAM-8365:
----------------------------
Status: Triage Needed (was: Resolved)
> Add project push-down capability to IO APIs
> -------------------------------------------
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
> Issue Type: New Feature
> Components: dsl-sql
> Reporter: Kirill Kozlov
> Assignee: Kirill Kozlov
> Priority: P2
> Fix For: 2.18.0
>
> Time Spent: 8h 20m
> Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection<Row> buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List<String> fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` list.
> * Create a rule to push fields used by a Calc (in projects and in a condition) down into TestTable IO.
> * Updating that same Calc (from previous step) to have a proper input and output schemes, remove unused fields.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)