You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@incubator.apache.org by WeitingChen <we...@apache.org> on 2025/12/24 14:20:40 UTC
[DISCUSS] Graduate Apache Gluten as an ASF top level project
Hi IPMC community,
I'd like to open a discussion regarding the potential graduation of
Apache Gluten from the Incubator.
Gluten entered the Incubator in Dec. 2023 and has since demonstrated
steady and consistent progress toward operating fully in the Apache
Way.
Given that the project was initiated and guided by contributors with
prior ASF experience and several ASF members, this level of maturity
is expected.
The project has:
- 35 PPMC members, 44 committers, and 176+ contributors [1]
- Added 16 new committers and 2 new PPMC members through a
transparent, merit-based process reflecting healthy community growth.
[2]
- Completed 5 incubating releases (1.2.0, 1.2.1, 1.3.0, 1.4.0, and
1.5.0), each handled by different release managers. All releases
comply with ASF release and distribution policies, and earlier
pre-incubation releases were also Apache-licensed. [3]
- Built a strong and diverse contributor base across companies such as
Alibaba, Baidu, ByteDance, BIGO, IBM, Intel, Kyligence, and Microsoft,
participating across code, documentation, testing, and community
operations. [4]
- Operated consistently in an open, transparent, and collaborative
manner, with website, source control, design discussions, feature
proposals, issue tracking, and decision‑making actively taking place
on the public mailing lists. [5][6][7][8][9]
- No known branding issues, and the project website, documentation,
and governance materials comply with ASF guidelines and policies.
[10][11]
- The project has prepared a maturity model to assist the IPMC in
evaluating readiness. [12]
- Gluten community has passed the vote for graduation with a
discussion and mentors have expressed support for graduation.
[13][14][15]
- Regular syncup with the board and the community [16][17]
- The community has discussed initial PMC membership and the process
of selecting a Chair [18][19]
- A draft project charter [20]
At this stage, the project has matured to a point where incubation is
unlikely to provide additional benefit.
With this email, I'd like to begin the discussion on whether Apache
Gluten is ready to graduate to a Top-Level Project (TLP).
If the IPMC has any questions, Gluten’s mentors and PPMC members are
happy to provide additional clarification.
Kind regards,
Weiting Chen
[1] https://github.com/apache/incubator-gluten
[2] https://incubator.apache.org/projects/gluten.html
[3] https://gluten.apache.org/downloads/
[4] https://gluten.apache.org/poweredby/
[5] https://gluten.apache.org/
[6] https://github.com/apache/incubator-gluten
[7] https://lists.apache.org/list.html?gluten.apache.org
[8] https://github.com/apache/incubator-gluten/discussions
[9] https://github.com/apache/incubator-gluten/issues
[10] https://whimsy.apache.org/pods/project/gluten
[11] https://incubator.apache.org/clutch
[12] https://github.com/apache/incubator-gluten/issues/10873
[13] https://lists.apache.org/thread/7qdyln5jqnhz46vzy6dmmwl86d7wf0pt
[14] https://lists.apache.org/thread/ncdwzr8npz154sn0vxnotsj1tngg83mk
[15] https://apache.org/foundation/records/minutes/2025/board_minutes_2025_10_15.txt
[16] https://whimsy.apache.org/board/minutes/Gluten.html
[17] https://docs.google.com/document/d/1g-veyoNB1QYFJY4-TMdewAq8wMkQqltbEt46CPxBrfE/edit?usp=sharing
[18] https://lists.apache.org/thread/qhyjfgmwvo8n7sjnzor5nt1q36t9m5vw
[19] https://lists.apache.org/thread/0glb7z98c911q6l71wgl64m2zy2rhcv0
[20] https://cwiki.apache.org/confluence/display/GLUTEN/Gluten+Badges
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Weiting Chen <we...@apache.org>.
Hi,
Thank you for your guidance and for confirming the steps taken so far.To address your remaining concern, the Gluten community has aligned on a sustainable brand stewardship plan that will continue after graduation.
The proposal will be:
* Conduct periodic public‑web audits (quarterly) to identify any incorrect or third‑party usages of the “Apache Gluten” brand. [1]
* Track and remediate external branding cases using a dedicated issue label in our GitHub tracker, similar to the recent cleanup work. The good news is that more than half of the issues (6 out of 10) have already been resolved in the current list. [2]
* Designate a rotating PMC member as the branding steward responsible for monitoring reports and ensuring timely follow‑up.Starting from me.
We believe this process provides an ongoing and durable mechanism for protecting the Apache Gluten brand.
With this, we would like to close the branding discussion and proceed with starting the graduation vote on the Incubator general@ list.
Please let me know if you have further suggestions.
Otherwise, I will initiate the VOTE thread.
Best regards,
William
[1] https://gluten.apache.org/poweredby/
[2] https://github.com/apache/incubator-gluten/issues/11438
On 2026/01/17 22:40:14 Justin Mclean wrote:
> Hi,
>
> Thanks for contacting Trademarks and for opening the tracking issue. That’s exactly the right step.
>
> My only remaining concern is about ongoing brand stewardship. The examples were easy to find through simple public searches, suggesting others may still exist. For graduation, the IPMC needs to understand what process the proposed PMC will use to actively monitor and protect the Apache Gluten brand going forward. It would be helpful if the community could briefly outline that plan before the graduation vote proceeds.
>
> Thanks,
> Justin
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Justin Mclean <ju...@classsoftware.com>.
Hi,
Thanks for contacting Trademarks and for opening the tracking issue. That’s exactly the right step.
My only remaining concern is about ongoing brand stewardship. The examples were easy to find through simple public searches, suggesting others may still exist. For graduation, the IPMC needs to understand what process the proposed PMC will use to actively monitor and protect the Apache Gluten brand going forward. It would be helpful if the community could briefly outline that plan before the graduation vote proceeds.
Thanks,
Justin
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Weiting Chen <we...@apache.org>.
Hi Justin,
Thanks for pointing these out.
We’ve already contacted the Apache Trademark team for guidance [1].
To ensure transparent tracking and resolution, we’ve created an issue in the Gluten repository covering the items you highlighted and related cases [2].
A couple of the cited issues have already been fixed in the past few days, and we’ll continue tracking and resolving the remaining ones to ensure full compliance.
I hope this helps address and resolve your concern regarding third‑party branding.
Best regards,
Weiting
[1] https://lists.apache.org/thread/4bwxrr414fsc0176b69skor47vg9jg7x2
[2] https://github.com/apache/incubator-gluten/issues/11438
On 2026/01/13 00:03:34 Justin Mclean wrote:
> Hi,
>
> Regarding third-party branding, this issue is still open.
>
> First, the IBM issue remains unresolved. The phrase “Gluten accelerated Spark” still appears on several current IBM pages, such as [1], [2], [3].
>
> Second, a quick review found several other third-party references with similar issues, such as implied ownership or the use of “Gluten” as a product or component name. These include:for example [4], [5], [6], [7], [8], [9], [10].
>
> Some of these are recent, suggesting that the project has not yet demonstrated effective monitoring and correction of third-party branding, as is required.
>
> I think this needs to be addressed, or at least a plan put in place, before graduation can proceed. Perhaps you should reach out to trademarks and see what they suggest.
>
> Kind regards,
> Justin
>
> [1] https://www.ibm.com/docs/en/watsonxdata/aws?topic=engine-introduction-gluten-accelerated-spark
> [2] https://www.ibm.com/docs/en/watsonxdata/standard/2.2.x?topic=components-gluten-accelerated-spark-engine
> [3] https://www.ibm.com/docs/en/watsonxdata-azure?topic=engine-provisioning-gluten-accelerated-spark
> [4] https://learn.microsoft.com/en-us/fabric/data-engineering/runtime
> [5] https://www.alibabacloud.com/help/en/analyticdb/analyticdb-for-mysql/user-guide/spark-confidential-engine-overview
> [6] https://www.alibabacloud.com/blog/601761
> [7] https://cn.kyligence.io/news/kyligence-gluten/
> [8] https://cloud.baidu.com/article/3322112
> [9] https://www.acceldata.io/blog/odp-apache-spark-with-gluten-velox
> [10] https://marketing.acceldatasolutions.net/odp-spark-with%20gluten-velox.pdf
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Justin Mclean <ju...@classsoftware.com>.
Hi,
Regarding third-party branding, this issue is still open.
First, the IBM issue remains unresolved. The phrase “Gluten accelerated Spark” still appears on several current IBM pages, such as [1], [2], [3].
Second, a quick review found several other third-party references with similar issues, such as implied ownership or the use of “Gluten” as a product or component name. These include:for example [4], [5], [6], [7], [8], [9], [10].
Some of these are recent, suggesting that the project has not yet demonstrated effective monitoring and correction of third-party branding, as is required.
I think this needs to be addressed, or at least a plan put in place, before graduation can proceed. Perhaps you should reach out to trademarks and see what they suggest.
Kind regards,
Justin
[1] https://www.ibm.com/docs/en/watsonxdata/aws?topic=engine-introduction-gluten-accelerated-spark
[2] https://www.ibm.com/docs/en/watsonxdata/standard/2.2.x?topic=components-gluten-accelerated-spark-engine
[3] https://www.ibm.com/docs/en/watsonxdata-azure?topic=engine-provisioning-gluten-accelerated-spark
[4] https://learn.microsoft.com/en-us/fabric/data-engineering/runtime
[5] https://www.alibabacloud.com/help/en/analyticdb/analyticdb-for-mysql/user-guide/spark-confidential-engine-overview
[6] https://www.alibabacloud.com/blog/601761
[7] https://cn.kyligence.io/news/kyligence-gluten/
[8] https://cloud.baidu.com/article/3322112
[9] https://www.acceldata.io/blog/odp-apache-spark-with-gluten-velox
[10] https://marketing.acceldatasolutions.net/odp-spark-with%20gluten-velox.pdf
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Weiting Chen <we...@apache.org>.
Hi Justin,
Thanks for your thoughtful review and feedback.
We've reviewed all the concerns you raised and taken the following steps:
- Third-party branding: IBM has revised their website to fix wrong brand usage. Please re-visit [1]. We have reviewed the other websites listed in public and no other significant third-party branding violations were observed on the sites reviewed including Google, Microsoft, Alibaba, ByteDance, ...and more.
- Decision-making channels: We've used dev mailing list for formal decisions including committer voting, important features discussion and will continue to ensure that the dev mailing list remains the primary channel for decision making in accordance with the Apache Way.
- PPMC composition: We've published the draft charter and added a clear list of proposed PMC members along with their affiliations across 14 companies[2] for transparency.
- PR backlog: We've shared a breakdown of PR triage and closure practices, including the explanation, pulse summary, and merge ratio as references.
Please let me know if this addresses all of your concerns.
Thanks,
Weiting
[1] https://www.ibm.com/docs/en/watsonxdata/aws?topic=engine-introduction-gluten-accelerated-spark
[2] https://lists.apache.org/thread/0l6bcb2t23fmcj6gms3d8mtl28nc9t2z
On 2025/12/24 15:26:52 Justin Mclean wrote:
> Hi,
>
> Apache Gluten seems nearly ready to graduate. Before we move forward, there are a few final checks I think the PPMC should confirm:
> - Third-party branding: Some vendor materials refer to “Gluten accelerated Spark” or similar [1] as named product features. This is not in line with the ASF branding policy, and the PPMC needs to address this.
> - Decision-making channels: The project uses GitHub Discussions and regular sync meetings. Please confirm that decisions are made on the dev mailing list, or at least summarised there.
> - PPMC composition: Please share one clear link to the draft project charter and include the proposed initial PMC members and Chair, along with their affiliations.
> - PR backlog: The large gap between PRs opened and merged over 12 months may reflect a vendor-driven shared roadmap. It would be helpful for the project to briefly explain how PR triage and closure are handled, and why this has occurred, especially given the short time to close most PRs.
>
> Note that this is from a very quick look; there may be other issues that need to be addressed. Addressing these points will help the IPMC finish the graduation discussion.
>
> Thanks,
> Justin
>
> 1. https://www.ibm.com/docs/en/watsonxdata/aws?topic=engine-introduction-gluten-accelerated-spark
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Weiting Chen <we...@apache.org>.
If no further questions, I would like to create a vote soon.
Thanks,
Weiting
On 2026/01/04 10:34:35 Weiting Chen wrote:
> Hi Justin,
>
> Thanks for the feedback, here are the responses to each point:
>
> 1. 3rd party branding: We've asked IBM to rephrase such mentions to comply with ASF branding. They will correct it soon.
>
> 2. Decision-making channels: Yes, even though we use GitHub Discussions and sync meetings for informal discussion, all important decisions are actually made on the dev@ mailing list (or at least summarized there). We make sure to follow Apache’s transparency norms by moving or logging outcomes on the dev list for the record.
>
> 3. PPMC composition: Please check below wiki page for more information
> Gluten Charter: https://cwiki.apache.org/confluence/display/GLUTEN/Gluten+Badges
> Gluten PPMC status: https://lists.apache.org/thread/qhyjfgmwvo8n7sjnzor5nt1q36t9m5vw
> Gluten PPMC chair voting: https://lists.apache.org/thread/0glb7z98c911q6l71wgl64m2zy2rhcv0
>
> 4. PR backlog: The gap between opened and merged PRs is mostly due to active triage and exploratory drafts, but also because some PRs target specific Spark or backend versions and get closed quickly once verified. We merge useful contributions fast and close stale or version-specific PRs promptly to keep the queue clean.
>
> Thanks,
> Weiting
>
> On 2025/12/24 15:26:52 Justin Mclean wrote:
> > Hi,
> >
> > Apache Gluten seems nearly ready to graduate. Before we move forward, there are a few final checks I think the PPMC should confirm:
> > - Third-party branding: Some vendor materials refer to “Gluten accelerated Spark” or similar [1] as named product features. This is not in line with the ASF branding policy, and the PPMC needs to address this.
> > - Decision-making channels: The project uses GitHub Discussions and regular sync meetings. Please confirm that decisions are made on the dev mailing list, or at least summarised there.
> > - PPMC composition: Please share one clear link to the draft project charter and include the proposed initial PMC members and Chair, along with their affiliations.
> > - PR backlog: The large gap between PRs opened and merged over 12 months may reflect a vendor-driven shared roadmap. It would be helpful for the project to briefly explain how PR triage and closure are handled, and why this has occurred, especially given the short time to close most PRs.
> >
> > Note that this is from a very quick look; there may be other issues that need to be addressed. Addressing these points will help the IPMC finish the graduation discussion.
> >
> > Thanks,
> > Justin
> >
> > 1. https://www.ibm.com/docs/en/watsonxdata/aws?topic=engine-introduction-gluten-accelerated-spark
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Binwei Yang <fe...@apache.org>.
Hi Justin,
Regarding to merge ratio of 2024-12-19 to 2025-12-19 from the https://github.com/apache/incubator/blob/master/tools/health/reports/Gluten.md
PRs: opened 2044 / merged 1000 | Median merge time (days): 1.1
1000 is not correct. It's not changed since created. While the open numer does change. Listed the links below:
https://github.com/apache/incubator/blame/a6efde0e7e1fd148992e706301c786d48bf1da7f/tools/health/reports/Gluten.md
https://github.com/apache/incubator/blame/f663a0df265d2074d6efc5123de43ebd325d5dac/tools/health/reports/Gluten.md
https://github.com/apache/incubator/blame/57b0b7f6ea6e18e3f35cb3d90b9ef0c1ed5b671e/tools/health/reports/Gluten.md
https://github.com/apache/incubator/blame/c15b1ab9c12755e999b45e262dc9dd22e33f3a92/tools/health/reports/Gluten.md
https://github.com/apache/incubator/blame/201365af8d6c9aab4ca096ca75b751c3fc3bf656/tools/health/reports/Gluten.md
https://github.com/apache/incubator/blame/28ba4fd97d6108eba6394332c9cd6231cb86b34d/tools/health/reports/Gluten.md
https://github.com/apache/incubator/blame/adebdd69cd1158f7d4a2540aeb27ba509bfa03a0/tools/health/reports/Gluten.md
The real merge ratio since 2024-12-19-2025-12-19 is 1549/2012 = 0.76
https://github.com/apache/incubator-gluten/pulls?q=sort%3Aupdated-desc+is%3Apr+created%3A%3E2025-01-01+is%3Amerged
463 PRs not merged, while 219 of which is because the CK/Velox backend rebase. They are open daily but we will close the previous PR if not merged when we open the new one.
So the real merge ratio is about 88%.
Thanks
Binwei
On 2026/01/04 20:59:30 Justin Mclean wrote:
> Hi,
>
> > 1. 3rd party branding: We've asked IBM to rephrase such mentions to comply with ASF branding. They will correct it soon.
>
> It’s good to hear that IBM has been asked to fix these references. However, until those materials are actually updated and publicly visible, this remains an open item. You say “soon”, but what is the expected timeframe for this? Has the PPMC looked into any other 3rd-party branding issues? As a reminder, the Apache Project Maturity Model[1] states:
>
> TB40 - The project monitors for any major misuses of their project's brand by others, and reports 15 any potential misuses to Brand Management.
>
> While it is not required to complete the maturity model, it can help find gaps like this.
>
> > 3. PPMC composition: Please check below wiki page for more information
> > Gluten Charter: https://cwiki.apache.org/confluence/display/GLUTEN/Gluten+Badges
> > Gluten PPMC status: https://lists.apache.org/thread/qhyjfgmwvo8n7sjnzor5nt1q36t9m5vw
> > Gluten PPMC chair voting: https://lists.apache.org/thread/0glb7z98c911q6l71wgl64m2zy2rhcv0
>
> The links provided discuss PMC formation and Chair selection, but they don’t list the proposed initial PMC current employers or organisational affiliation.
>
> > 4. PR backlog: The gap between opened and merged PRs is mostly due to active triage and exploratory drafts, but also because some PRs target specific Spark or backend versions and get closed quickly once verified. We merge useful contributions fast and close stale or version-specific PRs promptly to keep the queue clean.
>
> The explanation describes PR handling, but it doesn’t fully address the concern. Given the fast merge times but relatively low merge ratio in recent months, it would help to briefly explain how PR triage and prioritisation work across different contributor groups. This may be a data anomaly or unintentional, but I think the PPMC/mentors should look into this.
>
> At this point, I think it’s too early to call a graduation vote. I’d also like the project mentors to comment on readiness and share if they have any concerns.
>
> Kind Regards,
> Justin
>
> 1. https://community.apache.org/apache-way/apache-project-maturity-model.html
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Kent Yao <ya...@apache.org>.
Hi Justin and IPMC Members,
> The IPMC needs sufficient information to assess vendor neutrality, and at this time, we don’t have it.
I've queried the data from private@g.a.o and the original proposal.
It shows that the current Gluten PPMC membership consists of
contributors from more than a dozen organizations. The largest
affiliation group (IBM) has only six members and does not indicate
dominance. Contributors originate from a wide range of orgs
including Microsoft, Alibaba Cloud, NVIDIA, Meituan, Kyligence,
Intel, Datastrato, BIGO, Baidu, and more.Independent contributors
are also present.
Hoping data provided below addresses the IPMC’s vendor‑neutrality concerns.
Bests,
Kent Yao
== Affiliation Distribution ==
IBM: 6
Microsoft: 4
Alibaba Cloud: 4
Meituan: 2 (2 TBC)
BIGO: 2
Baidu: 2 (1 TBC)
Kyligence: 2 (1 TBC)
NVIDIA: 1
Intel: 1
Datastrato: 1
Bytedance: 1
Xiaomi: 1
AntGroup: 1
Individual: 1
TBD: 1
== Detailed List ==
changchen — Chang Chen — Microsoft
chengchengjin — Chengcheng Jin — TBD
felixcheung — Felix Cheung — NVIDIA
felixybw — Binwei Yang — IBM
jackylee — Junqing Li — Baidu
kejia — Ke Jia — Individual
lgbo — Liangjiabiao — BIGO
liuneng — Liuneng — Microsoft
liujiayi771 — Jiayi Liu — Alibaba Cloud
liyu — Yu Li — Alibaba Cloud
loneylee — Shuai Li — Xiaomi
mahongbin — Hongbin Ma — Kyligence (TBC)
marong — Rong Ma — IBM
ovilia — Wenli Zhang — Baidu (TBC)
philo — Feilong He — Intel
rui — Rui Mo — IBM
shaofengshi — Shaofeng Shi — Datastrato
taiyangli — Yang Li — Bytedance
ulyssesyou — Xiduo You — AntGroup
weitingchen — Weiting Chen — Microsoft
yangzy — Yang Zhang — Alibaba Cloud
yao — Kent Yao — Microsoft
yuanzhou — Yuan Zhou — IBM
zhaokuo — Zhao Kuo — Meituan (TBC)
zhanglistar — Zhibiao Zhang — BIGO
zhangzc — Zhichao Zhang — Kyligence
zhli — Zhen Li — Microsoft
zhztheplayer — Hongze Zhang — IBM
zhouky — Keyong Zhou — Alibaba Cloud
zuochunwei — Zuo Chunwei — Meituan (TBC)
Justin Mclean <ju...@classsoftware.com> 于2026年1月6日周二 04:34写道：
>
> Hi,
>
> > From my perspective as a mentor, I have not seen any individual contributor
> > or single organization exercising disproportionate influence over the Gluten
> > community. However, I'd also encourage the community to maintain an online
> > page for PMC members and committers with their organizational
> > affiliations, e.g. [1][2].
>
> The IPMC needs sufficient information to assess vendor neutrality, and at this time, we don’t have it.
>
> While affiliations are relevant for graduation review, I would generally discourage publishing them on the project website. Doing so could suggest that PMC membership is tied to certain employers, whereas contributors should participate as individuals and governance is based on merit, not who someone works for.
>
> For more background on this distinction, see [1][2]
>
> > For PR merge ratio and time-to merge metrics, I wrote a small tool to
> > help me evaluate.
>
> The IPMC already has this information. [3] The 12-month period was the more concerning one, but I can see why GlutenPerfBot could cause some data issues here. There is also a kyligence-git that could cause similar issues.
>
> Kind Regards,
> Justin
>
> 1. https://cwiki.apache.org/confluence/display/INCUBATOR/Vendor+Neutrality
> 2. https://cwiki.apache.org/confluence/display/INCUBATOR/Neutrality+In+Practice
> 3. https://github.com/apache/incubator/tree/master/tools/health/reports
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Justin Mclean <ju...@classsoftware.com>.
Hi,
> From my perspective as a mentor, I have not seen any individual contributor
> or single organization exercising disproportionate influence over the Gluten
> community. However, I'd also encourage the community to maintain an online
> page for PMC members and committers with their organizational
> affiliations, e.g. [1][2].
The IPMC needs sufficient information to assess vendor neutrality, and at this time, we don’t have it.
While affiliations are relevant for graduation review, I would generally discourage publishing them on the project website. Doing so could suggest that PMC membership is tied to certain employers, whereas contributors should participate as individuals and governance is based on merit, not who someone works for.
For more background on this distinction, see [1][2]
> For PR merge ratio and time-to merge metrics, I wrote a small tool to
> help me evaluate.
The IPMC already has this information. [3] The 12-month period was the more concerning one, but I can see why GlutenPerfBot could cause some data issues here. There is also a kyligence-git that could cause similar issues.
Kind Regards,
Justin
1. https://cwiki.apache.org/confluence/display/INCUBATOR/Vendor+Neutrality
2. https://cwiki.apache.org/confluence/display/INCUBATOR/Neutrality+In+Practice
3. https://github.com/apache/incubator/tree/master/tools/health/reports
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Kent Yao <ya...@gmail.com>.
Hi all,
From my perspective as a mentor, I have not seen any individual contributor
or single organization exercising disproportionate influence over the Gluten
community. However, I'd also encourage the community to maintain an online
page for PMC members and committers with their organizational
affiliations, e.g. [1][2].
For PR merge ratio and time-to merge metrics, I wrote a small tool to
help me evaluate[3]:
================ Pulse Summary: last 6 months ================
Window: 2025-07-09T07:00:33.188752+00:00 ~ 2026-01-05T07:00:33.188752+00:00
Commits: 669 (authors: 53)
PRs opened: 828
PRs closed: 853
PRs merged: 682
Merge ratio (merged/closed): 80.0%
Time to merge (for PRs merged in window)
Mean: 153.76 hours
Median: 28.00 hours
P90: 308.95 hours
The megre ratio looks ok to me and the relatively short median time‑to‑merge
is partly explained by the use of automation such as GlutenPerfBot[4]
for routine
or mechanical PRs, which can be merged quickly.
Kent Yao
[1] https://spark.apache.org/committers.html
[2] https://kyuubi.apache.org/become_committer.html
[3] https://gist.github.com/yaooqinn/cb892ec30e335cfe07d8163bbe52e32c
[4] https://github.com/apache/incubator-gluten/commits?author=GlutenPerfBot
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by ju...@classsoftware.com.
Hi,
I also note that [1] mentions a press release. Is the project working with Marketing and Publicity on this?
Kind Regards,
Justin
1. https://cwiki.apache.org/confluence/display/GLUTEN/Gluten+Badges
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Justin Mclean <ju...@classsoftware.com>.
Hi,
> 1. 3rd party branding: We've asked IBM to rephrase such mentions to comply with ASF branding. They will correct it soon.
It’s good to hear that IBM has been asked to fix these references. However, until those materials are actually updated and publicly visible, this remains an open item. You say “soon”, but what is the expected timeframe for this? Has the PPMC looked into any other 3rd-party branding issues? As a reminder, the Apache Project Maturity Model[1] states:
TB40 - The project monitors for any major misuses of their project's brand by others, and reports 15 any potential misuses to Brand Management.
While it is not required to complete the maturity model, it can help find gaps like this.
> 3. PPMC composition: Please check below wiki page for more information
> Gluten Charter: https://cwiki.apache.org/confluence/display/GLUTEN/Gluten+Badges
> Gluten PPMC status: https://lists.apache.org/thread/qhyjfgmwvo8n7sjnzor5nt1q36t9m5vw
> Gluten PPMC chair voting: https://lists.apache.org/thread/0glb7z98c911q6l71wgl64m2zy2rhcv0
The links provided discuss PMC formation and Chair selection, but they don’t list the proposed initial PMC current employers or organisational affiliation.
> 4. PR backlog: The gap between opened and merged PRs is mostly due to active triage and exploratory drafts, but also because some PRs target specific Spark or backend versions and get closed quickly once verified. We merge useful contributions fast and close stale or version-specific PRs promptly to keep the queue clean.
The explanation describes PR handling, but it doesn’t fully address the concern. Given the fast merge times but relatively low merge ratio in recent months, it would help to briefly explain how PR triage and prioritisation work across different contributor groups. This may be a data anomaly or unintentional, but I think the PPMC/mentors should look into this.
At this point, I think it’s too early to call a graduation vote. I’d also like the project mentors to comment on readiness and share if they have any concerns.
Kind Regards,
Justin
1. https://community.apache.org/apache-way/apache-project-maturity-model.html
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Weiting Chen <we...@apache.org>.
Hi Justin,
Thanks for the feedback, here are the responses to each point:
1. 3rd party branding: We've asked IBM to rephrase such mentions to comply with ASF branding. They will correct it soon.
2. Decision-making channels: Yes, even though we use GitHub Discussions and sync meetings for informal discussion, all important decisions are actually made on the dev@ mailing list (or at least summarized there). We make sure to follow Apache’s transparency norms by moving or logging outcomes on the dev list for the record.
3. PPMC composition: Please check below wiki page for more information
Gluten Charter: https://cwiki.apache.org/confluence/display/GLUTEN/Gluten+Badges
Gluten PPMC status: https://lists.apache.org/thread/qhyjfgmwvo8n7sjnzor5nt1q36t9m5vw
Gluten PPMC chair voting: https://lists.apache.org/thread/0glb7z98c911q6l71wgl64m2zy2rhcv0
4. PR backlog: The gap between opened and merged PRs is mostly due to active triage and exploratory drafts, but also because some PRs target specific Spark or backend versions and get closed quickly once verified. We merge useful contributions fast and close stale or version-specific PRs promptly to keep the queue clean.
Thanks,
Weiting
On 2025/12/24 15:26:52 Justin Mclean wrote:
> Hi,
>
> Apache Gluten seems nearly ready to graduate. Before we move forward, there are a few final checks I think the PPMC should confirm:
> - Third-party branding: Some vendor materials refer to “Gluten accelerated Spark” or similar [1] as named product features. This is not in line with the ASF branding policy, and the PPMC needs to address this.
> - Decision-making channels: The project uses GitHub Discussions and regular sync meetings. Please confirm that decisions are made on the dev mailing list, or at least summarised there.
> - PPMC composition: Please share one clear link to the draft project charter and include the proposed initial PMC members and Chair, along with their affiliations.
> - PR backlog: The large gap between PRs opened and merged over 12 months may reflect a vendor-driven shared roadmap. It would be helpful for the project to briefly explain how PR triage and closure are handled, and why this has occurred, especially given the short time to close most PRs.
>
> Note that this is from a very quick look; there may be other issues that need to be addressed. Addressing these points will help the IPMC finish the graduation discussion.
>
> Thanks,
> Justin
>
> 1. https://www.ibm.com/docs/en/watsonxdata/aws?topic=engine-introduction-gluten-accelerated-spark
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [DISCUSS] Graduate Apache Gluten as an ASF top level project
Posted by Justin Mclean <ju...@classsoftware.com>.
Hi,
Apache Gluten seems nearly ready to graduate. Before we move forward, there are a few final checks I think the PPMC should confirm:
- Third-party branding: Some vendor materials refer to “Gluten accelerated Spark” or similar [1] as named product features. This is not in line with the ASF branding policy, and the PPMC needs to address this.
- Decision-making channels: The project uses GitHub Discussions and regular sync meetings. Please confirm that decisions are made on the dev mailing list, or at least summarised there.
- PPMC composition: Please share one clear link to the draft project charter and include the proposed initial PMC members and Chair, along with their affiliations.
- PR backlog: The large gap between PRs opened and merged over 12 months may reflect a vendor-driven shared roadmap. It would be helpful for the project to briefly explain how PR triage and closure are handled, and why this has occurred, especially given the short time to close most PRs.
Note that this is from a very quick look; there may be other issues that need to be addressed. Addressing these points will help the IPMC finish the graduation discussion.
Thanks,
Justin
1. https://www.ibm.com/docs/en/watsonxdata/aws?topic=engine-introduction-gluten-accelerated-spark
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org