You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@asterixdb.apache.org by Murtadha Hubail <hu...@gmail.com> on 2025/08/15 16:26:52 UTC
Re: [DISCUSS][APE] Proposal for Adding Dynamic Scheduler Metadata Configuration Syntax
+1
We might want to tweak some keywords in the DDLs/DMLs, but looking good in general.
-Murtadha
________________________________
From: Michael J. Carey <dt...@apache.org>
Sent: Thursday, February 6, 2025 8:55:27 PM
To: dev@asterixdb.apache.org <de...@asterixdb.apache.org>
Subject: Re: [DISCUSS][APE] Proposal for Adding Dynamic Scheduler Metadata Configuration Syntax
+1 for this!
I just have a couple of tiny Q's/comments that I'll put in the APE on the wiki.
Let's get this stuff up and running!
On 2025/01/16 22:56:59 Hongyu Shi wrote:
> Hi *DB Dev community,
>
> Starting a discussion thread to propose new DDL/DML syntax that allows
> users to define group names with corresponding priorities, adjust query
> scheduler parameters for dynamic management, and incorporate these
> configurations into queries.
>
> *Feature:* Syntax for configuring the dynamic workload scheduler's metadata
> via DDL/DML and related statements.
> *Details:* The new scheduler allows the system to prioritize queries
> according to user-defined classifications and priorities. Additionally it
> also ensures that short, low-resource queries are prioritized, while also
> maintaining fair scheduling by balancing wait times relative to execution
> times.
> This proposal outlines the syntax for configuring relevant metadata. To
> provide users with a structured approach to manage these configurations,
> scheduler settings are stored in a dedicated metadata table. The proposed
> syntax enables users to add or remove query groups, adjust their
> priorities, and modify parameters related to the dynamic workload module as
> described in this document.
>
> The new syntax APE:
> *Metadata Configuration Syntax APE
> <https://cwiki.apache.org/confluence/display/ASTERIXDB/APE+18%3A+Dynamic+Workload+Configuration+Statement+Syntax>
> *
> To view the previous DWM APE:
> *Dynamic Workload Management APE*
> <https://cwiki.apache.org/confluence/display/ASTERIXDB/APE+13%3A+Dynamic+Workload+Management>
>
>
> Greatly appreciate any feedback on the syntax design to help identify
> potential issues and refine it further. Thanks so much!
>
> Best,
> Hongyu
>
Re: [DISCUSS][APE] Proposal for Adding Dynamic Scheduler Metadata Configuration Syntax
Posted by Hongyu Shi <hs...@scu.edu.INVALID>.
The vote to adopt Dynamic Scheduler DDL as APE 13 passes with tally: +1's
(PMC/binding): - Mike Carey - Ian Maxon - Murtadha Hubail and no 0s/-1's.
Thanks for the votes, everyone.
On Fri, Aug 15, 2025 at 9:28 AM Murtadha Hubail <hu...@gmail.com> wrote:
> +1
> We might want to tweak some keywords in the DDLs/DMLs, but looking good in
> general.
>
> -Murtadha
>
> ________________________________
> From: Michael J. Carey <dt...@apache.org>
> Sent: Thursday, February 6, 2025 8:55:27 PM
> To: dev@asterixdb.apache.org <de...@asterixdb.apache.org>
> Subject: Re: [DISCUSS][APE] Proposal for Adding Dynamic Scheduler Metadata
> Configuration Syntax
>
> +1 for this!
>
> I just have a couple of tiny Q's/comments that I'll put in the APE on the
> wiki.
> Let's get this stuff up and running!
>
> On 2025/01/16 22:56:59 Hongyu Shi wrote:
> > Hi *DB Dev community,
> >
> > Starting a discussion thread to propose new DDL/DML syntax that allows
> > users to define group names with corresponding priorities, adjust query
> > scheduler parameters for dynamic management, and incorporate these
> > configurations into queries.
> >
> > *Feature:* Syntax for configuring the dynamic workload scheduler's
> metadata
> > via DDL/DML and related statements.
> > *Details:* The new scheduler allows the system to prioritize queries
> > according to user-defined classifications and priorities. Additionally it
> > also ensures that short, low-resource queries are prioritized, while also
> > maintaining fair scheduling by balancing wait times relative to execution
> > times.
> > This proposal outlines the syntax for configuring relevant metadata. To
> > provide users with a structured approach to manage these configurations,
> > scheduler settings are stored in a dedicated metadata table. The proposed
> > syntax enables users to add or remove query groups, adjust their
> > priorities, and modify parameters related to the dynamic workload module
> as
> > described in this document.
> >
> > The new syntax APE:
> > *Metadata Configuration Syntax APE
> > <
> https://urldefense.com/v3/__https://cwiki.apache.org/confluence/display/ASTERIXDB/APE*18*3A*Dynamic*Workload*Configuration*Statement*Syntax__;KyUrKysrKw!!MLMg-p0Z!DjmPIw5lRxArWyx8z_GaIx_cgDoU72kU1m35W8Xy-KwOLUafYtuYJWXuYckKHJa0NnEnlZMFXlSlLw$
> >
> > *
> > To view the previous DWM APE:
> > *Dynamic Workload Management APE*
> > <
> https://urldefense.com/v3/__https://cwiki.apache.org/confluence/display/ASTERIXDB/APE*13*3A*Dynamic*Workload*Management__;KyUrKys!!MLMg-p0Z!DjmPIw5lRxArWyx8z_GaIx_cgDoU72kU1m35W8Xy-KwOLUafYtuYJWXuYckKHJa0NnEnlZPAKVmdzw$
> >
> >
> >
> > Greatly appreciate any feedback on the syntax design to help identify
> > potential issues and refine it further. Thanks so much!
> >
> > Best,
> > Hongyu
> >
>