You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Fokko Driesprong <fo...@apache.org> on 2025/09/28 05:06:47 UTC
[DISCUSS] Drop PyIceberg Python 3.9 support
Hi everyone,
I wanted to check if there are any objections to dropping Python 3.9
support. Dropping means that we won't publish 3.9 wheels anymore.
The two main reasons to do this:
1. Reduce the CI cost when we add 3.13
2. Downstream projects like numpy and ray often support three Python
versions. If we want to support more, we have to have conditional
dependencies based on the Python version
<https://github.com/apache/iceberg-python/blob/2bff5efdd9ddde77b2f909b7584ec25a23a6ee90/pyproject.toml#L70-L73>.
This makes Poetry very slow, as the work effectively doubles.
Python 3.9 is marked as EoL next week
<https://devguide.python.org/versions/>. Around 5% of the downloads are
Python 3.9 <https://github.com/apache/iceberg-python/issues/2534>. But as
Kevin pointed out, most of that will probably be our CI.
Let us know if there are any objections!
Kind regards,
Fokko
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Kevin Liu <ke...@apache.org>.
Thanks everyone. The PR [1] was just merged. Future versions of pyiceberg
(0.11 and later) will no longer support python 3.9.
Best,
Kevin Liu
[1] https://github.com/apache/iceberg-python/pull/2554
On Tue, Oct 14, 2025 at 9:40 AM Kevin Liu <ke...@apache.org> wrote:
> Thanks for chiming in everyone. Since there has not been any concerns for
> removing python 3.9, I plan to merge this PR [1] by the end of the week,
> 10/17.
>
> Best,
> Kevin Liu
>
> [1] https://github.com/apache/iceberg-python/pull/2554
>
> On Tue, Oct 14, 2025 at 9:28 AM Fokko Driesprong <fo...@apache.org> wrote:
>
>> Thanks for chiming in, everyone. It looks like there are no major
>> concerns.
>>
>> Kind regards,
>> Fokko
>>
>> Op za 11 okt 2025 om 20:28 schreef Drew <im...@gmail.com>:
>>
>>> +1 to remove the support of 3.9.
>>>
>>> On Thu, Oct 9, 2025 at 11:28 PM Eduard Tudenhöfner <
>>> etudenhoefner@apache.org> wrote:
>>>
>>>> +1
>>>>
>>>> On Fri, Oct 10, 2025 at 6:31 AM Steven Wu <st...@gmail.com> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> On Thu, Oct 9, 2025 at 3:10 PM Alex Stephen
>>>>> <al...@google.com.invalid> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> Python 3.9 is EOL. We shouldn't be encouraging users to stay on EOL
>>>>>> versions of Python.
>>>>>>
>>>>>> This can be our community's contribution towards the Python
>>>>>> ecosystem's migration off 3.9. It's great to help out our fellow OSS
>>>>>> projects!
>>>>>>
>>>>>> On Mon, Oct 6, 2025 at 8:48 AM Honah J. <ho...@apache.org> wrote:
>>>>>>
>>>>>>> +1 to remove 3.9 support. Thanks for driving this!
>>>>>>>
>>>>>>> Best regards,
>>>>>>> Jonas (Honah)
>>>>>>>
>>>>>>> On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <
>>>>>>> jb@nanthrax.net> wrote:
>>>>>>>
>>>>>>>> +1
>>>>>>>>
>>>>>>>> It makes sense to me.
>>>>>>>>
>>>>>>>> Thanks !
>>>>>>>> Regards
>>>>>>>> JB
>>>>>>>>
>>>>>>>> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org>
>>>>>>>> wrote:
>>>>>>>> >
>>>>>>>> > Hi everyone,
>>>>>>>> >
>>>>>>>> > I wanted to check if there are any objections to dropping Python
>>>>>>>> 3.9 support. Dropping means that we won't publish 3.9 wheels anymore.
>>>>>>>> >
>>>>>>>> > The two main reasons to do this:
>>>>>>>> >
>>>>>>>> > Reduce the CI cost when we add 3.13
>>>>>>>> > Downstream projects like numpy and ray often support three Python
>>>>>>>> versions. If we want to support more, we have to have conditional
>>>>>>>> dependencies based on the Python version. This makes Poetry very slow, as
>>>>>>>> the work effectively doubles.
>>>>>>>> >
>>>>>>>> > Python 3.9 is marked as EoL next week. Around 5% of the downloads
>>>>>>>> are Python 3.9. But as Kevin pointed out, most of that will probably be our
>>>>>>>> CI.
>>>>>>>> >
>>>>>>>> > Let us know if there are any objections!
>>>>>>>> >
>>>>>>>> > Kind regards,
>>>>>>>> > Fokko
>>>>>>>> >
>>>>>>>>
>>>>>>>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Kevin Liu <ke...@apache.org>.
Thanks for chiming in everyone. Since there has not been any concerns for
removing python 3.9, I plan to merge this PR [1] by the end of the week,
10/17.
Best,
Kevin Liu
[1] https://github.com/apache/iceberg-python/pull/2554
On Tue, Oct 14, 2025 at 9:28 AM Fokko Driesprong <fo...@apache.org> wrote:
> Thanks for chiming in, everyone. It looks like there are no major concerns.
>
> Kind regards,
> Fokko
>
> Op za 11 okt 2025 om 20:28 schreef Drew <im...@gmail.com>:
>
>> +1 to remove the support of 3.9.
>>
>> On Thu, Oct 9, 2025 at 11:28 PM Eduard Tudenhöfner <
>> etudenhoefner@apache.org> wrote:
>>
>>> +1
>>>
>>> On Fri, Oct 10, 2025 at 6:31 AM Steven Wu <st...@gmail.com> wrote:
>>>
>>>> +1
>>>>
>>>> On Thu, Oct 9, 2025 at 3:10 PM Alex Stephen
>>>> <al...@google.com.invalid> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> Python 3.9 is EOL. We shouldn't be encouraging users to stay on EOL
>>>>> versions of Python.
>>>>>
>>>>> This can be our community's contribution towards the Python
>>>>> ecosystem's migration off 3.9. It's great to help out our fellow OSS
>>>>> projects!
>>>>>
>>>>> On Mon, Oct 6, 2025 at 8:48 AM Honah J. <ho...@apache.org> wrote:
>>>>>
>>>>>> +1 to remove 3.9 support. Thanks for driving this!
>>>>>>
>>>>>> Best regards,
>>>>>> Jonas (Honah)
>>>>>>
>>>>>> On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
>>>>>> wrote:
>>>>>>
>>>>>>> +1
>>>>>>>
>>>>>>> It makes sense to me.
>>>>>>>
>>>>>>> Thanks !
>>>>>>> Regards
>>>>>>> JB
>>>>>>>
>>>>>>> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org>
>>>>>>> wrote:
>>>>>>> >
>>>>>>> > Hi everyone,
>>>>>>> >
>>>>>>> > I wanted to check if there are any objections to dropping Python
>>>>>>> 3.9 support. Dropping means that we won't publish 3.9 wheels anymore.
>>>>>>> >
>>>>>>> > The two main reasons to do this:
>>>>>>> >
>>>>>>> > Reduce the CI cost when we add 3.13
>>>>>>> > Downstream projects like numpy and ray often support three Python
>>>>>>> versions. If we want to support more, we have to have conditional
>>>>>>> dependencies based on the Python version. This makes Poetry very slow, as
>>>>>>> the work effectively doubles.
>>>>>>> >
>>>>>>> > Python 3.9 is marked as EoL next week. Around 5% of the downloads
>>>>>>> are Python 3.9. But as Kevin pointed out, most of that will probably be our
>>>>>>> CI.
>>>>>>> >
>>>>>>> > Let us know if there are any objections!
>>>>>>> >
>>>>>>> > Kind regards,
>>>>>>> > Fokko
>>>>>>> >
>>>>>>>
>>>>>>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Fokko Driesprong <fo...@apache.org>.
Thanks for chiming in, everyone. It looks like there are no major concerns.
Kind regards,
Fokko
Op za 11 okt 2025 om 20:28 schreef Drew <im...@gmail.com>:
> +1 to remove the support of 3.9.
>
> On Thu, Oct 9, 2025 at 11:28 PM Eduard Tudenhöfner <
> etudenhoefner@apache.org> wrote:
>
>> +1
>>
>> On Fri, Oct 10, 2025 at 6:31 AM Steven Wu <st...@gmail.com> wrote:
>>
>>> +1
>>>
>>> On Thu, Oct 9, 2025 at 3:10 PM Alex Stephen
>>> <al...@google.com.invalid> wrote:
>>>
>>>> +1
>>>>
>>>> Python 3.9 is EOL. We shouldn't be encouraging users to stay on EOL
>>>> versions of Python.
>>>>
>>>> This can be our community's contribution towards the Python ecosystem's
>>>> migration off 3.9. It's great to help out our fellow OSS projects!
>>>>
>>>> On Mon, Oct 6, 2025 at 8:48 AM Honah J. <ho...@apache.org> wrote:
>>>>
>>>>> +1 to remove 3.9 support. Thanks for driving this!
>>>>>
>>>>> Best regards,
>>>>> Jonas (Honah)
>>>>>
>>>>> On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
>>>>> wrote:
>>>>>
>>>>>> +1
>>>>>>
>>>>>> It makes sense to me.
>>>>>>
>>>>>> Thanks !
>>>>>> Regards
>>>>>> JB
>>>>>>
>>>>>> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org>
>>>>>> wrote:
>>>>>> >
>>>>>> > Hi everyone,
>>>>>> >
>>>>>> > I wanted to check if there are any objections to dropping Python
>>>>>> 3.9 support. Dropping means that we won't publish 3.9 wheels anymore.
>>>>>> >
>>>>>> > The two main reasons to do this:
>>>>>> >
>>>>>> > Reduce the CI cost when we add 3.13
>>>>>> > Downstream projects like numpy and ray often support three Python
>>>>>> versions. If we want to support more, we have to have conditional
>>>>>> dependencies based on the Python version. This makes Poetry very slow, as
>>>>>> the work effectively doubles.
>>>>>> >
>>>>>> > Python 3.9 is marked as EoL next week. Around 5% of the downloads
>>>>>> are Python 3.9. But as Kevin pointed out, most of that will probably be our
>>>>>> CI.
>>>>>> >
>>>>>> > Let us know if there are any objections!
>>>>>> >
>>>>>> > Kind regards,
>>>>>> > Fokko
>>>>>> >
>>>>>>
>>>>>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Drew <im...@gmail.com>.
+1 to remove the support of 3.9.
On Thu, Oct 9, 2025 at 11:28 PM Eduard Tudenhöfner <et...@apache.org>
wrote:
> +1
>
> On Fri, Oct 10, 2025 at 6:31 AM Steven Wu <st...@gmail.com> wrote:
>
>> +1
>>
>> On Thu, Oct 9, 2025 at 3:10 PM Alex Stephen
>> <al...@google.com.invalid> wrote:
>>
>>> +1
>>>
>>> Python 3.9 is EOL. We shouldn't be encouraging users to stay on EOL
>>> versions of Python.
>>>
>>> This can be our community's contribution towards the Python ecosystem's
>>> migration off 3.9. It's great to help out our fellow OSS projects!
>>>
>>> On Mon, Oct 6, 2025 at 8:48 AM Honah J. <ho...@apache.org> wrote:
>>>
>>>> +1 to remove 3.9 support. Thanks for driving this!
>>>>
>>>> Best regards,
>>>> Jonas (Honah)
>>>>
>>>> On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
>>>> wrote:
>>>>
>>>>> +1
>>>>>
>>>>> It makes sense to me.
>>>>>
>>>>> Thanks !
>>>>> Regards
>>>>> JB
>>>>>
>>>>> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org>
>>>>> wrote:
>>>>> >
>>>>> > Hi everyone,
>>>>> >
>>>>> > I wanted to check if there are any objections to dropping Python 3.9
>>>>> support. Dropping means that we won't publish 3.9 wheels anymore.
>>>>> >
>>>>> > The two main reasons to do this:
>>>>> >
>>>>> > Reduce the CI cost when we add 3.13
>>>>> > Downstream projects like numpy and ray often support three Python
>>>>> versions. If we want to support more, we have to have conditional
>>>>> dependencies based on the Python version. This makes Poetry very slow, as
>>>>> the work effectively doubles.
>>>>> >
>>>>> > Python 3.9 is marked as EoL next week. Around 5% of the downloads
>>>>> are Python 3.9. But as Kevin pointed out, most of that will probably be our
>>>>> CI.
>>>>> >
>>>>> > Let us know if there are any objections!
>>>>> >
>>>>> > Kind regards,
>>>>> > Fokko
>>>>> >
>>>>>
>>>>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Eduard Tudenhöfner <et...@apache.org>.
+1
On Fri, Oct 10, 2025 at 6:31 AM Steven Wu <st...@gmail.com> wrote:
> +1
>
> On Thu, Oct 9, 2025 at 3:10 PM Alex Stephen <al...@google.com.invalid>
> wrote:
>
>> +1
>>
>> Python 3.9 is EOL. We shouldn't be encouraging users to stay on EOL
>> versions of Python.
>>
>> This can be our community's contribution towards the Python ecosystem's
>> migration off 3.9. It's great to help out our fellow OSS projects!
>>
>> On Mon, Oct 6, 2025 at 8:48 AM Honah J. <ho...@apache.org> wrote:
>>
>>> +1 to remove 3.9 support. Thanks for driving this!
>>>
>>> Best regards,
>>> Jonas (Honah)
>>>
>>> On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
>>> wrote:
>>>
>>>> +1
>>>>
>>>> It makes sense to me.
>>>>
>>>> Thanks !
>>>> Regards
>>>> JB
>>>>
>>>> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org>
>>>> wrote:
>>>> >
>>>> > Hi everyone,
>>>> >
>>>> > I wanted to check if there are any objections to dropping Python 3.9
>>>> support. Dropping means that we won't publish 3.9 wheels anymore.
>>>> >
>>>> > The two main reasons to do this:
>>>> >
>>>> > Reduce the CI cost when we add 3.13
>>>> > Downstream projects like numpy and ray often support three Python
>>>> versions. If we want to support more, we have to have conditional
>>>> dependencies based on the Python version. This makes Poetry very slow, as
>>>> the work effectively doubles.
>>>> >
>>>> > Python 3.9 is marked as EoL next week. Around 5% of the downloads are
>>>> Python 3.9. But as Kevin pointed out, most of that will probably be our CI.
>>>> >
>>>> > Let us know if there are any objections!
>>>> >
>>>> > Kind regards,
>>>> > Fokko
>>>> >
>>>>
>>>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Steven Wu <st...@gmail.com>.
+1
On Thu, Oct 9, 2025 at 3:10 PM Alex Stephen <al...@google.com.invalid>
wrote:
> +1
>
> Python 3.9 is EOL. We shouldn't be encouraging users to stay on EOL
> versions of Python.
>
> This can be our community's contribution towards the Python ecosystem's
> migration off 3.9. It's great to help out our fellow OSS projects!
>
> On Mon, Oct 6, 2025 at 8:48 AM Honah J. <ho...@apache.org> wrote:
>
>> +1 to remove 3.9 support. Thanks for driving this!
>>
>> Best regards,
>> Jonas (Honah)
>>
>> On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
>> wrote:
>>
>>> +1
>>>
>>> It makes sense to me.
>>>
>>> Thanks !
>>> Regards
>>> JB
>>>
>>> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org>
>>> wrote:
>>> >
>>> > Hi everyone,
>>> >
>>> > I wanted to check if there are any objections to dropping Python 3.9
>>> support. Dropping means that we won't publish 3.9 wheels anymore.
>>> >
>>> > The two main reasons to do this:
>>> >
>>> > Reduce the CI cost when we add 3.13
>>> > Downstream projects like numpy and ray often support three Python
>>> versions. If we want to support more, we have to have conditional
>>> dependencies based on the Python version. This makes Poetry very slow, as
>>> the work effectively doubles.
>>> >
>>> > Python 3.9 is marked as EoL next week. Around 5% of the downloads are
>>> Python 3.9. But as Kevin pointed out, most of that will probably be our CI.
>>> >
>>> > Let us know if there are any objections!
>>> >
>>> > Kind regards,
>>> > Fokko
>>> >
>>>
>>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Alex Stephen <al...@google.com.INVALID>.
+1
Python 3.9 is EOL. We shouldn't be encouraging users to stay on EOL
versions of Python.
This can be our community's contribution towards the Python ecosystem's
migration off 3.9. It's great to help out our fellow OSS projects!
On Mon, Oct 6, 2025 at 8:48 AM Honah J. <ho...@apache.org> wrote:
> +1 to remove 3.9 support. Thanks for driving this!
>
> Best regards,
> Jonas (Honah)
>
> On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
>
>> +1
>>
>> It makes sense to me.
>>
>> Thanks !
>> Regards
>> JB
>>
>> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org>
>> wrote:
>> >
>> > Hi everyone,
>> >
>> > I wanted to check if there are any objections to dropping Python 3.9
>> support. Dropping means that we won't publish 3.9 wheels anymore.
>> >
>> > The two main reasons to do this:
>> >
>> > Reduce the CI cost when we add 3.13
>> > Downstream projects like numpy and ray often support three Python
>> versions. If we want to support more, we have to have conditional
>> dependencies based on the Python version. This makes Poetry very slow, as
>> the work effectively doubles.
>> >
>> > Python 3.9 is marked as EoL next week. Around 5% of the downloads are
>> Python 3.9. But as Kevin pointed out, most of that will probably be our CI.
>> >
>> > Let us know if there are any objections!
>> >
>> > Kind regards,
>> > Fokko
>> >
>>
>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by "Honah J." <ho...@apache.org>.
+1 to remove 3.9 support. Thanks for driving this!
Best regards,
Jonas (Honah)
On Sun, Oct 5, 2025 at 10:07 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> +1
>
> It makes sense to me.
>
> Thanks !
> Regards
> JB
>
> On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org> wrote:
> >
> > Hi everyone,
> >
> > I wanted to check if there are any objections to dropping Python 3.9
> support. Dropping means that we won't publish 3.9 wheels anymore.
> >
> > The two main reasons to do this:
> >
> > Reduce the CI cost when we add 3.13
> > Downstream projects like numpy and ray often support three Python
> versions. If we want to support more, we have to have conditional
> dependencies based on the Python version. This makes Poetry very slow, as
> the work effectively doubles.
> >
> > Python 3.9 is marked as EoL next week. Around 5% of the downloads are
> Python 3.9. But as Kevin pointed out, most of that will probably be our CI.
> >
> > Let us know if there are any objections!
> >
> > Kind regards,
> > Fokko
> >
>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
+1
It makes sense to me.
Thanks !
Regards
JB
On Sun, Sep 28, 2025 at 7:06 AM Fokko Driesprong <fo...@apache.org> wrote:
>
> Hi everyone,
>
> I wanted to check if there are any objections to dropping Python 3.9 support. Dropping means that we won't publish 3.9 wheels anymore.
>
> The two main reasons to do this:
>
> Reduce the CI cost when we add 3.13
> Downstream projects like numpy and ray often support three Python versions. If we want to support more, we have to have conditional dependencies based on the Python version. This makes Poetry very slow, as the work effectively doubles.
>
> Python 3.9 is marked as EoL next week. Around 5% of the downloads are Python 3.9. But as Kevin pointed out, most of that will probably be our CI.
>
> Let us know if there are any objections!
>
> Kind regards,
> Fokko
>
Re: [DISCUSS] Drop PyIceberg Python 3.9 support
Posted by Kevin Liu <ke...@apache.org>.
+1 to remove python 3.9 support. Thanks for starting the conversation,
Fokko.
The community can still use python 3.9 with the latest pyiceberg release,
0.10. We will just no longer support python 3.9 for future release.
We remove python 3.8 last year around its EOL timeline too,
https://lists.apache.org/thread/d9r91hgq4wr30c2qm5y2zbkqb1nhjngh
Best,
Kevin Liu
On Sat, Sep 27, 2025 at 10:09 PM Fokko Driesprong <fo...@apache.org> wrote:
> Hi everyone,
>
> I wanted to check if there are any objections to dropping Python 3.9
> support. Dropping means that we won't publish 3.9 wheels anymore.
>
> The two main reasons to do this:
>
> 1. Reduce the CI cost when we add 3.13
> 2. Downstream projects like numpy and ray often support three Python
> versions. If we want to support more, we have to have conditional
> dependencies based on the Python version
> <https://github.com/apache/iceberg-python/blob/2bff5efdd9ddde77b2f909b7584ec25a23a6ee90/pyproject.toml#L70-L73>.
> This makes Poetry very slow, as the work effectively doubles.
>
> Python 3.9 is marked as EoL next week
> <https://devguide.python.org/versions/>. Around 5% of the downloads are
> Python 3.9 <https://github.com/apache/iceberg-python/issues/2534>. But as
> Kevin pointed out, most of that will probably be our CI.
>
> Let us know if there are any objections!
>
> Kind regards,
> Fokko
>
>