You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2021/01/08 05:41:00 UTC
[jira] [Updated] (FLINK-20791) Support local aggregate push down
for Blink batch planner
[ https://issues.apache.org/jira/browse/FLINK-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jark Wu updated FLINK-20791:
----------------------------
Description:
Aggregate operator of Flink SQL is currently fully done at Flink layer. With the developing of storage, many downstream storage of Flink SQL has the ability to deal with Aggregation operator.
Pushing down Aggregate to data source layer will improve performance from the perspective of the network IO and computation overhead.
I have drafted a design doc for this new feature. [https://docs.google.com/document/d/1kGwC_h4qBNxF2eMEz6T6arByOB8yilrPLqDN0QBQXW4/edit?usp=sharing]
Any comment or discussion is welcome.
Discuss thread: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Support-local-aggregate-push-down-for-Blink-batch-planner-td47439.html
was:
Aggregate operator of Flink SQL is currently fully done at Flink layer. With the developing of storage, many downstream storage of Flink SQL has the ability to deal with Aggregation operator.
Pushing down Aggregate to data source layer will improve performance from the perspective of the network IO and computation overhead.
I have drafted a design doc for this new feature. [https://docs.google.com/document/d/1kGwC_h4qBNxF2eMEz6T6arByOB8yilrPLqDN0QBQXW4/edit?usp=sharing]
Any comment or discussion is welcome.
> Support local aggregate push down for Blink batch planner
> ---------------------------------------------------------
>
> Key: FLINK-20791
> URL: https://issues.apache.org/jira/browse/FLINK-20791
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / API, Table SQL / Planner
> Reporter: Sebastian Liu
> Assignee: Sebastian Liu
> Priority: Major
>
> Aggregate operator of Flink SQL is currently fully done at Flink layer. With the developing of storage, many downstream storage of Flink SQL has the ability to deal with Aggregation operator.
> Pushing down Aggregate to data source layer will improve performance from the perspective of the network IO and computation overhead.
>
> I have drafted a design doc for this new feature. [https://docs.google.com/document/d/1kGwC_h4qBNxF2eMEz6T6arByOB8yilrPLqDN0QBQXW4/edit?usp=sharing]
>
> Any comment or discussion is welcome.
> Discuss thread: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Support-local-aggregate-push-down-for-Blink-batch-planner-td47439.html
--
This message was sent by Atlassian Jira
(v8.3.4#803005)