You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/11/20 21:30:00 UTC

[jira] [Work logged] (BEAM-8794) Projects should be handled by an IOPushDownRule before applying AggregateProjectMergeRule

     [ https://issues.apache.org/jira/browse/BEAM-8794?focusedWorklogId=347013&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-347013 ]

ASF GitHub Bot logged work on BEAM-8794:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 20/Nov/19 21:29
            Start Date: 20/Nov/19 21:29
    Worklog Time Spent: 10m 
      Work Description: 11moon11 commented on issue #10180: [BEAM-8794] Conditional aggregate project merge
URL: https://github.com/apache/beam/pull/10180#issuecomment-556421814
 
 
   R: @apilloud 
   CC: @amaliujia 
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 347013)
    Remaining Estimate: 0h
            Time Spent: 10m

> Projects should be handled by an IOPushDownRule before applying AggregateProjectMergeRule
> -----------------------------------------------------------------------------------------
>
>                 Key: BEAM-8794
>                 URL: https://issues.apache.org/jira/browse/BEAM-8794
>             Project: Beam
>          Issue Type: Improvement
>          Components: dsl-sql
>            Reporter: Kirill Kozlov
>            Assignee: Kirill Kozlov
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> It is more efficient to push-down projected fields at an IO level (vs merging with an Aggregate), when supported.
> When running queries like:
> {code:java}
> select SUM(score) as total_score from <TABLE> group by name{code}
> Projects get merged with an aggregate, as a result Calc (after an IOSourceRel) projects all fields and BeamIOPushDown rule does know what fields can be dropped, thus not dropping any.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)