You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kirill Kozlov (Jira)" <ji...@apache.org> on 2019/11/07 23:30:00 UTC
[jira] [Updated] (BEAM-8583) [SQL] BigQuery should support
predicate push-down in DIRECT_READ mode
[ https://issues.apache.org/jira/browse/BEAM-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kirill Kozlov updated BEAM-8583:
--------------------------------
Description:
* Add BigQuery Dialect with TypeTranslation (since it is not implemented in Calcite 1.20.0, but is present in unreleased versions).
* Create a BigQueryFilter class.
* BigQueryTable#buildIOReader should translate supported filters into a Sql string and pass it to BigQueryIO.
Potential improvements:
* After updating vendor Calcite, class `BigQuerySqlDialectWithTypeTranslation` can be deleted and Calcite's `BigQuerySqlDialect` can be utilized instead.
* Once BigQuery adds support for more filters, `BigQueryFilter#isSupported` should be updated.
> [SQL] BigQuery should support predicate push-down in DIRECT_READ mode
> ---------------------------------------------------------------------
>
> Key: BEAM-8583
> URL: https://issues.apache.org/jira/browse/BEAM-8583
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql
> Reporter: Kirill Kozlov
> Assignee: Kirill Kozlov
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> * Add BigQuery Dialect with TypeTranslation (since it is not implemented in Calcite 1.20.0, but is present in unreleased versions).
> * Create a BigQueryFilter class.
> * BigQueryTable#buildIOReader should translate supported filters into a Sql string and pass it to BigQueryIO.
>
> Potential improvements:
> * After updating vendor Calcite, class `BigQuerySqlDialectWithTypeTranslation` can be deleted and Calcite's `BigQuerySqlDialect` can be utilized instead.
> * Once BigQuery adds support for more filters, `BigQueryFilter#isSupported` should be updated.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)