You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kirill Kozlov (Jira)" <ji...@apache.org> on 2019/10/31 22:17:00 UTC
[jira] [Resolved] (BEAM-8365) Add project push-down capability to
IO APIs
[ https://issues.apache.org/jira/browse/BEAM-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kirill Kozlov resolved BEAM-8365.
---------------------------------
Fix Version/s: 2.18.0
Resolution: Fixed
> Add project push-down capability to IO APIs
> -------------------------------------------
>
> Key: BEAM-8365
> URL: https://issues.apache.org/jira/browse/BEAM-8365
> Project: Beam
> Issue Type: New Feature
> Components: dsl-sql
> Reporter: Kirill Kozlov
> Assignee: Kirill Kozlov
> Priority: Major
> Fix For: 2.18.0
>
> Time Spent: 8h 20m
> Remaining Estimate: 0h
>
> * InMemoryTable should implement a following method:
> {code:java}
> public PCollection<Row> buildIOReader(
> PBegin begin, BeamSqlTableFilter filters, List<String> fieldNames);{code}
> Which should return a `PCollection` with fields specified in `fieldNames` list.
> * Create a rule to push fields used by a Calc (in projects and in a condition) down into TestTable IO.
> * Updating that same Calc (from previous step) to have a proper input and output schemes, remove unused fields.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)