You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by "Shiva Jahangiri (Jira)" <ji...@apache.org> on 2020/10/16 05:42:00 UTC

[jira] [Updated] (ASTERIXDB-2788) Plan's stages are not created correctly for bushy plans in compile time

     [ https://issues.apache.org/jira/browse/ASTERIXDB-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shiva Jahangiri updated ASTERIXDB-2788:
---------------------------------------
    Summary: Plan's stages are not created correctly for bushy plans in compile time  (was: Plan's stages do not create correct stages for bushy plans in compile time)

> Plan's stages are not created correctly for bushy plans in compile time
> -----------------------------------------------------------------------
>
>                 Key: ASTERIXDB-2788
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-2788
>             Project: Apache AsterixDB
>          Issue Type: Bug
>            Reporter: Shiva Jahangiri
>            Priority: Major
>
> PlanStagesGenerator generates "pipelines" instead of stages and as such for calculating the maximum required memory it calculates the memory needed for largest pipeline not the largest stage. It does not impact the linear plans, but for bushy plans, the independent pipelines (independent builds) that can be co-scheduled should get merged into one stage. In this case, merging some small pipelines can make a larger stage than what was considered to be the largest stage in the past (which is the largest pipeline).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)