You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kirill Kozlov (Jira)" <ji...@apache.org> on 2019/10/31 22:17:00 UTC

[jira] [Resolved] (BEAM-8365) Add project push-down capability to IO APIs

     [ https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kirill Kozlov resolved BEAM-8365.
---------------------------------
    Fix Version/s: 2.18.0
       Resolution: Fixed

> Add project push-down capability to IO APIs
> -------------------------------------------
>
>                 Key: BEAM-8365
>                 URL: https://issues.apache.org/jira/browse/BEAM-8365
>             Project: Beam
>          Issue Type: New Feature
>          Components: dsl-sql
>            Reporter: Kirill Kozlov
>            Assignee: Kirill Kozlov
>            Priority: Major
>             Fix For: 2.18.0
>
>          Time Spent: 8h 20m
>  Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection<Row> buildIOReader(
>     PBegin begin, BeamSqlTableFilter filters, List<String> fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` list.
>  * Create a rule to push fields used by a Calc (in projects and in a condition) down into TestTable IO.
>  * Updating that same Calc  (from previous step) to have a proper input and output schemes, remove unused fields.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)