You are viewing a plain text version of this content. The canonical link for it is here.

Posted to notifications@asterixdb.apache.org by "Shiva Jahangiri (Jira)" <ji...@apache.org> on 2020/10/16 05:41:00 UTC

[jira] [Created] (ASTERIXDB-2788) Plan's stages do not create correct stages for bushy plans in compile time

Shiva Jahangiri created ASTERIXDB-2788:
------------------------------------------

             Summary: Plan's stages do not create correct stages for bushy plans in compile time
                 Key: ASTERIXDB-2788
                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-2788
             Project: Apache AsterixDB
          Issue Type: Bug
            Reporter: Shiva Jahangiri


PlanStagesGenerator generates "pipelines" instead of stages and as such for calculating the maximum required memory it calculates the memory needed for largest pipeline not the largest stage. It does not impact the linear plans, but for bushy plans, the independent pipelines (independent builds) that can be co-scheduled should get merged into one stage. In this case, merging some small pipelines can make a larger stage than what was considered to be the largest stage in the past (which is the largest pipeline).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)