You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gluten.apache.org by Philo <ph...@apache.org> on 2026/07/24 04:39:15 UTC
[DISCUSS] Removing Spark 3.3 support
Hi all,
I'd like to start a discussion on removing Spark 3.3 support. Currently we
support Spark 3.3, 3.4, 3.5, 4.0, and 4.1. Dropping Spark 3.3 would let us
focus more on the other versions, especially since we may add Spark 4.2
support soon.
Removing Spark 3.3 would involve:
- Removing the Spark 3.3 shim layer
- Removing the imported Spark 3.3 tests
- Removing the Spark 3.3 test jobs to free up GHA (GitHub Actions) resources
- Unifying the shim-layer APIs that diverged between Spark 3.3 and later
versions
If we agree, we could start the removal next month on the Gluten main
branch (targeting 1.8). Spark 3.3 would remain supported through Gluten 1.7.
Thanks,
Philo
Re: [DISCUSS] Removing Spark 3.3 support
Posted by Ke Jia <ke...@gmail.com>.
+1
Terry Wang <zj...@gmail.com> 于2026年7月28日周二 07:14写道：
> +1
>
> On Mon, Jul 27, 2026 at 10:00 AM Jacky Lee <qc...@gmail.com> wrote:
>
> > +1
> >
> > Zhen Wang <wa...@apache.org> 于2026年7月27日周一 09:49写道：
> >
> > > +1
> > >
> > > Yuming Wang <yu...@apache.org> 于2026年7月26日周日 07:51写道：
> > > >
> > > > +1
> > > >
> > > > On Fri, Jul 24, 2026 at 12:39 PM Philo <ph...@apache.org> wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > > I'd like to start a discussion on removing Spark 3.3 support.
> > > Currently we
> > > > > support Spark 3.3, 3.4, 3.5, 4.0, and 4.1. Dropping Spark 3.3 would
> > > let us
> > > > > focus more on the other versions, especially since we may add Spark
> > 4.2
> > > > > support soon.
> > > > >
> > > > > Removing Spark 3.3 would involve:
> > > > > - Removing the Spark 3.3 shim layer
> > > > > - Removing the imported Spark 3.3 tests
> > > > > - Removing the Spark 3.3 test jobs to free up GHA (GitHub Actions)
> > > > > resources
> > > > > - Unifying the shim-layer APIs that diverged between Spark 3.3 and
> > > later
> > > > > versions
> > > > >
> > > > > If we agree, we could start the removal next month on the Gluten
> main
> > > > > branch (targeting 1.8). Spark 3.3 would remain supported through
> > Gluten
> > > > > 1.7.
> > > > >
> > > > > Thanks,
> > > > > Philo
> > > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@gluten.apache.org
> > > For additional commands, e-mail: dev-help@gluten.apache.org
> > >
> > >
> >
>
>
> --
> Best Regards,
> Terry Wang
>
Re: [DISCUSS] Removing Spark 3.3 support
Posted by Terry Wang <zj...@gmail.com>.
+1
On Mon, Jul 27, 2026 at 10:00 AM Jacky Lee <qc...@gmail.com> wrote:
> +1
>
> Zhen Wang <wa...@apache.org> 于2026年7月27日周一 09:49写道：
>
> > +1
> >
> > Yuming Wang <yu...@apache.org> 于2026年7月26日周日 07:51写道：
> > >
> > > +1
> > >
> > > On Fri, Jul 24, 2026 at 12:39 PM Philo <ph...@apache.org> wrote:
> > >
> > > > Hi all,
> > > >
> > > > I'd like to start a discussion on removing Spark 3.3 support.
> > Currently we
> > > > support Spark 3.3, 3.4, 3.5, 4.0, and 4.1. Dropping Spark 3.3 would
> > let us
> > > > focus more on the other versions, especially since we may add Spark
> 4.2
> > > > support soon.
> > > >
> > > > Removing Spark 3.3 would involve:
> > > > - Removing the Spark 3.3 shim layer
> > > > - Removing the imported Spark 3.3 tests
> > > > - Removing the Spark 3.3 test jobs to free up GHA (GitHub Actions)
> > > > resources
> > > > - Unifying the shim-layer APIs that diverged between Spark 3.3 and
> > later
> > > > versions
> > > >
> > > > If we agree, we could start the removal next month on the Gluten main
> > > > branch (targeting 1.8). Spark 3.3 would remain supported through
> Gluten
> > > > 1.7.
> > > >
> > > > Thanks,
> > > > Philo
> > > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@gluten.apache.org
> > For additional commands, e-mail: dev-help@gluten.apache.org
> >
> >
>
--
Best Regards,
Terry Wang
Re: [DISCUSS] Removing Spark 3.3 support
Posted by Jacky Lee <qc...@gmail.com>.
+1
Zhen Wang <wa...@apache.org> 于2026年7月27日周一 09:49写道：
> +1
>
> Yuming Wang <yu...@apache.org> 于2026年7月26日周日 07:51写道：
> >
> > +1
> >
> > On Fri, Jul 24, 2026 at 12:39 PM Philo <ph...@apache.org> wrote:
> >
> > > Hi all,
> > >
> > > I'd like to start a discussion on removing Spark 3.3 support.
> Currently we
> > > support Spark 3.3, 3.4, 3.5, 4.0, and 4.1. Dropping Spark 3.3 would
> let us
> > > focus more on the other versions, especially since we may add Spark 4.2
> > > support soon.
> > >
> > > Removing Spark 3.3 would involve:
> > > - Removing the Spark 3.3 shim layer
> > > - Removing the imported Spark 3.3 tests
> > > - Removing the Spark 3.3 test jobs to free up GHA (GitHub Actions)
> > > resources
> > > - Unifying the shim-layer APIs that diverged between Spark 3.3 and
> later
> > > versions
> > >
> > > If we agree, we could start the removal next month on the Gluten main
> > > branch (targeting 1.8). Spark 3.3 would remain supported through Gluten
> > > 1.7.
> > >
> > > Thanks,
> > > Philo
> > >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@gluten.apache.org
> For additional commands, e-mail: dev-help@gluten.apache.org
>
>
Re: [DISCUSS] Removing Spark 3.3 support
Posted by Zhen Wang <wa...@apache.org>.
+1
Yuming Wang <yu...@apache.org> 于2026年7月26日周日 07:51写道：
>
> +1
>
> On Fri, Jul 24, 2026 at 12:39 PM Philo <ph...@apache.org> wrote:
>
> > Hi all,
> >
> > I'd like to start a discussion on removing Spark 3.3 support. Currently we
> > support Spark 3.3, 3.4, 3.5, 4.0, and 4.1. Dropping Spark 3.3 would let us
> > focus more on the other versions, especially since we may add Spark 4.2
> > support soon.
> >
> > Removing Spark 3.3 would involve:
> > - Removing the Spark 3.3 shim layer
> > - Removing the imported Spark 3.3 tests
> > - Removing the Spark 3.3 test jobs to free up GHA (GitHub Actions)
> > resources
> > - Unifying the shim-layer APIs that diverged between Spark 3.3 and later
> > versions
> >
> > If we agree, we could start the removal next month on the Gluten main
> > branch (targeting 1.8). Spark 3.3 would remain supported through Gluten
> > 1.7.
> >
> > Thanks,
> > Philo
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@gluten.apache.org
For additional commands, e-mail: dev-help@gluten.apache.org
Re: [DISCUSS] Removing Spark 3.3 support
Posted by Yuming Wang <yu...@apache.org>.
+1
On Fri, Jul 24, 2026 at 12:39 PM Philo <ph...@apache.org> wrote:
> Hi all,
>
> I'd like to start a discussion on removing Spark 3.3 support. Currently we
> support Spark 3.3, 3.4, 3.5, 4.0, and 4.1. Dropping Spark 3.3 would let us
> focus more on the other versions, especially since we may add Spark 4.2
> support soon.
>
> Removing Spark 3.3 would involve:
> - Removing the Spark 3.3 shim layer
> - Removing the imported Spark 3.3 tests
> - Removing the Spark 3.3 test jobs to free up GHA (GitHub Actions)
> resources
> - Unifying the shim-layer APIs that diverged between Spark 3.3 and later
> versions
>
> If we agree, we could start the removal next month on the Gluten main
> branch (targeting 1.8). Spark 3.3 would remain supported through Gluten
> 1.7.
>
> Thanks,
> Philo
>