You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@paimon.apache.org by zxy <zo...@qq.com> on 2026/01/12 12:51:26 UTC
[DISCUSS] Deprecate and remove Spark 3.2 support
The final release of Apache Spark 3.2, version 3.2.4, was published on April 10, 2023—nearly three years ago.
Due to compatibility issues between Spark 3.2 and newer versions, we have invested significant effort in addressing them.
Meanwhile, other lakehouse formats, such as Iceberg and Hudi, removed support for Spark 3.2 quite some time ago.
Spark has now progressed to version 4.1.1, so I propose dropping support for Spark 3.2.
Re: [DISCUSS] Deprecate and remove Spark 3.2 support
Posted by 周伐 <zh...@gmail.com>.
Hi zxy:
Spark 3.2 is widely used at ByteDance, and there are no plans to
upgrade it in the near future. I would be extremely grateful if you could
keep it.
Thanks,
Fa Zhou
Jocean shi <jo...@gmail.com> 于2026年1月19日周一 14:17写道：
> Hi zxy:
> -1.
> spark 3.2 is still widely used now. I think it is still necessary
> to retain 3.2
> Thanks,
> Ocean shi
>
> Aitozi <gj...@gmail.com> 于2026年1月19日周一 11:13写道：
> >
> > Hi zxy:
> > Unfortunately, Spark 3.2 is still widely used within ByteDance, and
> > Paimon is our primary lake format.
> > Therefore, continued support from the community would be greatly
> > appreciated, and we are willing to help maintain the Spark 3.2
> integration.
> >
> > Thanks,
> > Aitozi.
> >
> > zxy <zo...@qq.com> 于2026年1月12日周一 20:52写道：
> >
> > > The final release of Apache Spark 3.2, version 3.2.4, was published on
> > > April 10, 2023—nearly three years ago.
> > > Due to compatibility issues between Spark 3.2 and newer versions, we
> have
> > > invested significant effort in addressing them.
> > > Meanwhile, other lakehouse formats, such as Iceberg and Hudi, removed
> > > support for Spark 3.2 quite some time ago.
> > > Spark has now progressed to version 4.1.1, so I propose dropping
> support
> > > for Spark 3.2.
> > >
>
Re: [DISCUSS] Deprecate and remove Spark 3.2 support
Posted by Jocean shi <jo...@gmail.com>.
Hi zxy:
-1.
spark 3.2 is still widely used now. I think it is still necessary
to retain 3.2
Thanks,
Ocean shi
Aitozi <gj...@gmail.com> 于2026年1月19日周一 11:13写道：
>
> Hi zxy:
> Unfortunately, Spark 3.2 is still widely used within ByteDance, and
> Paimon is our primary lake format.
> Therefore, continued support from the community would be greatly
> appreciated, and we are willing to help maintain the Spark 3.2 integration.
>
> Thanks,
> Aitozi.
>
> zxy <zo...@qq.com> 于2026年1月12日周一 20:52写道：
>
> > The final release of Apache Spark 3.2, version 3.2.4, was published on
> > April 10, 2023—nearly three years ago.
> > Due to compatibility issues between Spark 3.2 and newer versions, we have
> > invested significant effort in addressing them.
> > Meanwhile, other lakehouse formats, such as Iceberg and Hudi, removed
> > support for Spark 3.2 quite some time ago.
> > Spark has now progressed to version 4.1.1, so I propose dropping support
> > for Spark 3.2.
> >
Re: [DISCUSS] Deprecate and remove Spark 3.2 support
Posted by Aitozi <gj...@gmail.com>.
Hi zxy:
Unfortunately, Spark 3.2 is still widely used within ByteDance, and
Paimon is our primary lake format.
Therefore, continued support from the community would be greatly
appreciated, and we are willing to help maintain the Spark 3.2 integration.
Thanks,
Aitozi.
zxy <zo...@qq.com> 于2026年1月12日周一 20:52写道：
> The final release of Apache Spark 3.2, version 3.2.4, was published on
> April 10, 2023—nearly three years ago.
> Due to compatibility issues between Spark 3.2 and newer versions, we have
> invested significant effort in addressing them.
> Meanwhile, other lakehouse formats, such as Iceberg and Hudi, removed
> support for Spark 3.2 quite some time ago.
> Spark has now progressed to version 4.1.1, so I propose dropping support
> for Spark 3.2.
>