You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2023/06/14 11:05:58 UTC
[GitHub] [arrow] raulcd opened a new pull request, #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
raulcd opened a new pull request, #36061:
URL: https://github.com/apache/arrow/pull/36061
### Rationale for this change
Python 3.7 is End of Support on 27th June 2023. We can drop support for pyarrow 13.0.0.
See: https://endoflife.date/python
### What changes are included in this PR?
Remove support for 3.7. Update minimum required Python version and update some CI jobs to use the minimum Python supported version
### Are these changes tested?
They will be tested via Archery
### Are there any user-facing changes?
Yes in terms of not supporting older versions of Python. This will be a breaking change for some users but not for the API itself
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1230758341
##########
.github/workflows/python.yml:
##########
@@ -47,41 +47,41 @@ jobs:
name: ${{ matrix.title }}
runs-on: ubuntu-latest
if: ${{ !contains(github.event.pull_request.title, 'WIP') }}
- timeout-minutes: 60
+ timeout-minutes: 90
Review Comment:
Would you revert it back to 60 minutes and fix that on a different PR? I think that's probably better then.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1600608107
Revision: 896104313c74efc7da6d1343c39d98a0cb79ffe8
Submitted crossbow builds: [ursacomputing/crossbow @ actions-95518e1468](https://github.com/ursacomputing/crossbow/branches/all?query=actions-95518e1468)
|Task|Status|
|----|------|
|wheel-clean|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107878/jobs/9663149282)|
|wheel-macos-big-sur-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107668/jobs/9663148790)|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106741/jobs/9663146367)|
|wheel-macos-big-sur-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333112127/jobs/9663159176)|
|wheel-macos-big-sur-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333111434/jobs/9663157515)|
|wheel-macos-mojave-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107418/jobs/9663148207)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333109153/jobs/9663151910)|
|wheel-macos-mojave-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333112944/jobs/9663161022)|
|wheel-macos-mojave-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106551/jobs/9663145919)|
|wheel-manylinux-2-28-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333109633/jobs/9663153056)|
|wheel-manylinux-2-28-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333110476/jobs/9663155034)|
|wheel-manylinux-2-28-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333109371/jobs/9663152413)|
|wheel-manylinux-2-28-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333108133/jobs/9663149859)|
|wheel-manylinux-2-28-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333111676/jobs/9663158007)|
|wheel-manylinux-2-28-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107096/jobs/9663147363)|
|wheel-manylinux-2-28-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106889/jobs/9663146869)|
|wheel-manylinux-2-28-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333112309/jobs/9663159468)|
|wheel-manylinux-2014-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333112618/jobs/9663160236)|
|wheel-manylinux-2014-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333110656/jobs/9663155554)|
|wheel-manylinux-2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333109953/jobs/9663153604)|
|wheel-manylinux-2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333110294/jobs/9663154529)|
|wheel-manylinux-2014-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333108611/jobs/9663150761)|
|wheel-manylinux-2014-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333111056/jobs/9663156683)|
|wheel-manylinux-2014-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333110086/jobs/9663153937)|
|wheel-manylinux-2014-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333111313/jobs/9663157196)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333108942/jobs/9663151404)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333111918/jobs/9663158545)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333108345/jobs/9663150247)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5333110827/jobs/9663156099)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1235818254
##########
dev/tasks/tasks.yml:
##########
@@ -1517,9 +1516,9 @@ tasks:
image: conda-python-hdfs
{% endfor %}
-{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.7", "v3.1.2", "false", "latest"),
- ("3.8", "v3.2.0", "false", "1.23"),
- ("3.9", "master", "false", "latest")] %}
+{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.8", "v3.1.2", "false", "latest"),
Review Comment:
Ah, yes. It makes sense.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1600604037
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1591029836
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1230157950
##########
.github/workflows/python.yml:
##########
@@ -47,41 +47,41 @@ jobs:
name: ${{ matrix.title }}
runs-on: ubuntu-latest
if: ${{ !contains(github.event.pull_request.title, 'WIP') }}
- timeout-minutes: 60
+ timeout-minutes: 90
strategy:
fail-fast: false
matrix:
name:
- conda-python-docs
- - conda-python-3.8-nopandas
- - conda-python-3.7-pandas-1.0
- - conda-python-3.9-pandas-latest
+ - conda-python-3.9-nopandas
+ - conda-python-3.8-pandas-1.0
+ - conda-python-3.10-pandas-latest
include:
- name: conda-python-docs
cache: conda-python-3.9
image: conda-python-docs
title: AMD64 Conda Python 3.9 Sphinx & Numpydoc
python: 3.9
- - name: conda-python-3.8-nopandas
- cache: conda-python-3.8
+ - name: conda-python-3.9-nopandas
+ cache: conda-python-3.9
image: conda-python
- title: AMD64 Conda Python 3.8 Without Pandas
- python: 3.8
- - name: conda-python-3.7-pandas-1.0
- cache: conda-python-3.7
+ title: AMD64 Conda Python 3.9 Without Pandas
+ python: 3.9
+ - name: conda-python-3.8-pandas-1.0
+ cache: conda-python-3.8
image: conda-python-pandas
- title: AMD64 Conda Python 3.7 Pandas 1.0
- python: 3.7
+ title: AMD64 Conda Python 3.8 Pandas 1.0
+ python: 3.8
pandas: 1.0
numpy: 1.16
- - name: conda-python-3.9-pandas-latest
- cache: conda-python-3.9
+ - name: conda-python-3.10-pandas-latest
+ cache: conda-python-3.10
image: conda-python-pandas
- title: AMD64 Conda Python 3.9 Pandas latest
- python: 3.9
+ title: AMD64 Conda Python 3.10 Pandas latest
+ python: "3.10"
pandas: latest
env:
- PYTHON: ${{ matrix.python || 3.7 }}
+ PYTHON: ${{ matrix.python || 3.8 }}
UBUNTU: ${{ matrix.ubuntu || 18.04 }}
Review Comment:
We dropped support for Ubuntu 18.04: #33800
```suggestion
UBUNTU: ${{ matrix.ubuntu || 20.04 }}
```
##########
.github/workflows/python.yml:
##########
@@ -47,41 +47,41 @@ jobs:
name: ${{ matrix.title }}
runs-on: ubuntu-latest
if: ${{ !contains(github.event.pull_request.title, 'WIP') }}
- timeout-minutes: 60
+ timeout-minutes: 90
strategy:
fail-fast: false
matrix:
name:
- conda-python-docs
- - conda-python-3.8-nopandas
- - conda-python-3.7-pandas-1.0
- - conda-python-3.9-pandas-latest
+ - conda-python-3.9-nopandas
+ - conda-python-3.8-pandas-1.0
+ - conda-python-3.10-pandas-latest
include:
- name: conda-python-docs
cache: conda-python-3.9
image: conda-python-docs
title: AMD64 Conda Python 3.9 Sphinx & Numpydoc
python: 3.9
- - name: conda-python-3.8-nopandas
- cache: conda-python-3.8
+ - name: conda-python-3.9-nopandas
+ cache: conda-python-3.9
image: conda-python
- title: AMD64 Conda Python 3.8 Without Pandas
- python: 3.8
- - name: conda-python-3.7-pandas-1.0
- cache: conda-python-3.7
+ title: AMD64 Conda Python 3.9 Without Pandas
+ python: 3.9
+ - name: conda-python-3.8-pandas-1.0
+ cache: conda-python-3.8
image: conda-python-pandas
- title: AMD64 Conda Python 3.7 Pandas 1.0
- python: 3.7
+ title: AMD64 Conda Python 3.8 Pandas 1.0
+ python: 3.8
pandas: 1.0
Review Comment:
We may need to use `"1.0"`:
```suggestion
pandas: "1.0"
```
##########
dev/tasks/tasks.yml:
##########
@@ -1517,9 +1516,9 @@ tasks:
image: conda-python-hdfs
{% endfor %}
-{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.7", "v3.1.2", "false", "latest"),
- ("3.8", "v3.2.0", "false", "1.23"),
- ("3.9", "master", "false", "latest")] %}
+{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.8", "v3.1.2", "false", "latest"),
Review Comment:
Do we still need Spark 3.1.2?
I think that Spark 3.1 reached EOL:
https://spark.apache.org/versioning-policy.html
> Feature release branches will, generally, be maintained with bug fix releases for a period of 18 months.
And 3.1.1 was released on 2021-03-02:
https://spark.apache.org/news/index.html
> [Spark 3.1.1 released](https://spark.apache.org/news/spark-3-1-1-released.html)
>
> March 2, 2021
3.2 might reach EOL because 3.2.0 was released on 2021-10-13:
> [Spark 3.2.0 released](https://spark.apache.org/news/spark-3-2-0-released.html)
>
> October 13, 2021
@kiszk Do you know what Spark versions are maintained?
##########
python/requirements-wheel-test.txt:
##########
@@ -7,8 +7,7 @@ pytest-lazy-fixture
pytz
tzdata; sys_platform == 'win32'
-numpy==1.19.5; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.7"
-numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7" and python_version < "3.11"
+numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.8" and python_version < "3.11"
Review Comment:
```suggestion
numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.11"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] conbench-apache-arrow[bot] commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "conbench-apache-arrow[bot] (via GitHub)" <gi...@apache.org>.
conbench-apache-arrow[bot] commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1605007082
Conbench analyzed the 6 benchmark runs on commit `8d021c40`.
There was 1 benchmark result indicating a performance regression:
- Commit Run on `arm64-m6g-linux-compute` at [2023-06-22 09:01:14Z](http://conbench.ursa.dev/compare/runs/e0ce45fbf9d5437fa98c4d5a0914fb63...d78eaa12a6a14827af7aed88296ace38/)
- [params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmark](http://conbench.ursa.dev/compare/benchmarks/06493f936e6570d580008c846775e2dd...064940e1f31d71718000062f90c72664)
The [full Conbench report](https://github.com/apache/arrow/runs/14514790545) has more details.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1600607625
Revision: 896104313c74efc7da6d1343c39d98a0cb79ffe8
Submitted crossbow builds: [ursacomputing/crossbow @ actions-b99d4cde40](https://github.com/ursacomputing/crossbow/branches/all?query=actions-b99d4cde40)
|Task|Status|
|----|------|
|test-conda-python-3.10|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107473/jobs/9663148347)|
|test-conda-python-3.10-hdfs-2.9.2|[](https://github.com/ursacomputing/crossbow/actions/runs/5333104699/jobs/9663141398)|
|test-conda-python-3.10-hdfs-3.2.1|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107673/jobs/9663148826)|
|test-conda-python-3.10-pandas-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106475/jobs/9663145741)|
|test-conda-python-3.10-pandas-nightly|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107308/jobs/9663147925)|
|test-conda-python-3.10-spark-master|[](https://github.com/ursacomputing/crossbow/actions/runs/5333109045/jobs/9663151649)|
|test-conda-python-3.10-substrait|[](https://github.com/ursacomputing/crossbow/actions/runs/5333105437/jobs/9663143666)|
|test-conda-python-3.11|[](https://github.com/ursacomputing/crossbow/actions/runs/5333104469/jobs/9663140946)|
|test-conda-python-3.11-dask-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106841/jobs/9663146691)|
|test-conda-python-3.11-dask-upstream_devel|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106271/jobs/9663145176)|
|test-conda-python-3.11-hypothesis|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107941/jobs/9663149376)|
|test-conda-python-3.11-pandas-upstream_devel|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106998/jobs/9663147100)|
|test-conda-python-3.8|[](https://github.com/ursacomputing/crossbow/actions/runs/5333108438/jobs/9663150435)|
|test-conda-python-3.8-pandas-1.0|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106070/jobs/9663144628)|
|test-conda-python-3.8-spark-v3.1.2|[](https://github.com/ursacomputing/crossbow/actions/runs/5333107124/jobs/9663147456)|
|test-conda-python-3.9|[](https://github.com/ursacomputing/crossbow/actions/runs/5333105198/jobs/9663143073)|
|test-conda-python-3.9-pandas-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/5333106647/jobs/9663146211)|
|test-conda-python-3.9-spark-v3.2.0|[](https://github.com/ursacomputing/crossbow/actions/runs/5333105616/jobs/9663143930)|
|test-cuda-python|[](https://github.com/ursacomputing/crossbow/actions/runs/5333104905/jobs/9663141871)|
|test-debian-11-python-3|[](https://github.com/ursacomputing/crossbow/runs/14434145094)|
|test-fedora-35-python-3|[](https://github.com/ursacomputing/crossbow/runs/14434152578)|
|test-ubuntu-20.04-python-3|[](https://github.com/ursacomputing/crossbow/runs/14434154107)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1230888580
##########
.github/workflows/python.yml:
##########
@@ -47,41 +47,41 @@ jobs:
name: ${{ matrix.title }}
runs-on: ubuntu-latest
if: ${{ !contains(github.event.pull_request.title, 'WIP') }}
- timeout-minutes: 60
+ timeout-minutes: 90
Review Comment:
I've decided to revert it back. Thanks @kou
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1229631979
##########
.github/workflows/python.yml:
##########
@@ -47,41 +47,41 @@ jobs:
name: ${{ matrix.title }}
runs-on: ubuntu-latest
if: ${{ !contains(github.event.pull_request.title, 'WIP') }}
- timeout-minutes: 60
+ timeout-minutes: 90
Review Comment:
I've done this to fix the MacOS 12 job that was timing out after 60 minutes. Happy to revert if we think we should tackle the issue differently or on another PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1230152568
##########
.github/workflows/python.yml:
##########
@@ -47,41 +47,41 @@ jobs:
name: ${{ matrix.title }}
runs-on: ubuntu-latest
if: ${{ !contains(github.event.pull_request.title, 'WIP') }}
- timeout-minutes: 60
+ timeout-minutes: 90
Review Comment:
It seems that we use bundled Protobuf instead of using Homebrew's Protobuf:
https://github.com/apache/arrow/actions/runs/5267649495/jobs/9523177390#step:5:236
```text
-- Could NOT find Protobuf (missing: Protobuf_LIBRARIES Protobuf_INCLUDE_DIR) (Required is at least version "3.0.0")
```
I should have confirmed this from CI log explicitly in #36029...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1591034880
Revision: e4bdf1154f6c0e1a143a65f2caa9e9eabe94f178
Submitted crossbow builds: [ursacomputing/crossbow @ actions-b6bb6289fc](https://github.com/ursacomputing/crossbow/branches/all?query=actions-b6bb6289fc)
|Task|Status|
|----|------|
|wheel-clean|[](https://github.com/ursacomputing/crossbow/tree/actions-b6bb6289fc-github-wheel-clean)|
|wheel-macos-big-sur-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266660771/jobs/9520875520)|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266657519/jobs/9520867583)|
|wheel-macos-big-sur-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266657728/jobs/9520868151)|
|wheel-macos-big-sur-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266658687/jobs/9520869954)|
|wheel-macos-mojave-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266659682/jobs/9520872658)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266658460/jobs/9520869465)|
|wheel-macos-mojave-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266660493/jobs/9520874926)|
|wheel-macos-mojave-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266658212/jobs/9520868987)|
|wheel-manylinux-2-28-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266661431/jobs/9520877238)|
|wheel-manylinux-2-28-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266657932/jobs/9520868673)|
|wheel-manylinux-2-28-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266662221/jobs/9520879031)|
|wheel-manylinux-2-28-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266659304/jobs/9520871581)|
|wheel-manylinux-2-28-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266661953/jobs/9520878403)|
|wheel-manylinux-2-28-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266659903/jobs/9520873371)|
|wheel-manylinux-2-28-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266656876/jobs/9520865945)|
|wheel-manylinux-2-28-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266660299/jobs/9520874604)|
|wheel-manylinux-2014-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266659556/jobs/9520872323)|
|wheel-manylinux-2014-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266660922/jobs/9520875886)|
|wheel-manylinux-2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266659108/jobs/9520871015)|
|wheel-manylinux-2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266663100/jobs/9520881340)|
|wheel-manylinux-2014-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266657357/jobs/9520867184)|
|wheel-manylinux-2014-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266662634/jobs/9520880209)|
|wheel-manylinux-2014-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266660058/jobs/9520873864)|
|wheel-manylinux-2014-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266662836/jobs/9520880620)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266657045/jobs/9520866320)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266661182/jobs/9520876502)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266656349/jobs/9520864908)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/5266656538/jobs/9520865210)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1591035896
Revision: e4bdf1154f6c0e1a143a65f2caa9e9eabe94f178
Submitted crossbow builds: [ursacomputing/crossbow @ actions-fed8edc3db](https://github.com/ursacomputing/crossbow/branches/all?query=actions-fed8edc3db)
|Task|Status|
|----|------|
|test-conda-python-3.10|[](https://github.com/ursacomputing/crossbow/actions/runs/5266663738/jobs/9520883032)|
|test-conda-python-3.10-hdfs-2.9.2|[](https://github.com/ursacomputing/crossbow/actions/runs/5266662663/jobs/9520880244)|
|test-conda-python-3.10-hdfs-3.2.1|[](https://github.com/ursacomputing/crossbow/actions/runs/5266662256/jobs/9520879120)|
|test-conda-python-3.10-pandas-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/5266663926/jobs/9520883623)|
|test-conda-python-3.10-pandas-nightly|[](https://github.com/ursacomputing/crossbow/actions/runs/5266663536/jobs/9520882510)|
|test-conda-python-3.10-spark-master|[](https://github.com/ursacomputing/crossbow/actions/runs/5266664369/jobs/9520884809)|
|test-conda-python-3.10-substrait|[](https://github.com/ursacomputing/crossbow/actions/runs/5266664585/jobs/9520885149)|
|test-conda-python-3.11|[](https://github.com/ursacomputing/crossbow/actions/runs/5266661532/jobs/9520877426)|
|test-conda-python-3.11-dask-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/5266664815/jobs/9520885701)|
|test-conda-python-3.11-dask-upstream_devel|[](https://github.com/ursacomputing/crossbow/actions/runs/5266661794/jobs/9520878111)|
|test-conda-python-3.11-hypothesis|[](https://github.com/ursacomputing/crossbow/actions/runs/5266662066/jobs/9520878622)|
|test-conda-python-3.11-pandas-upstream_devel|[](https://github.com/ursacomputing/crossbow/actions/runs/5266665857/jobs/9520888064)|
|test-conda-python-3.8|[](https://github.com/ursacomputing/crossbow/actions/runs/5266666330/jobs/9520889272)|
|test-conda-python-3.8-pandas-1.0|[](https://github.com/ursacomputing/crossbow/actions/runs/5266665585/jobs/9520887398)|
|test-conda-python-3.8-spark-v3.1.2|[](https://github.com/ursacomputing/crossbow/actions/runs/5266665324/jobs/9520886946)|
|test-conda-python-3.9|[](https://github.com/ursacomputing/crossbow/actions/runs/5266665086/jobs/9520886448)|
|test-conda-python-3.9-pandas-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/5266666177/jobs/9520888762)|
|test-conda-python-3.9-spark-v3.2.0|[](https://github.com/ursacomputing/crossbow/actions/runs/5266662853/jobs/9520880677)|
|test-cuda-python|[](https://github.com/ursacomputing/crossbow/actions/runs/5266663133/jobs/9520881478)|
|test-debian-11-python-3|[](https://github.com/ursacomputing/crossbow/runs/14253871356)|
|test-fedora-35-python-3|[](https://github.com/ursacomputing/crossbow/runs/14253873929)|
|test-ubuntu-20.04-python-3|[](https://github.com/ursacomputing/crossbow/runs/14253881361)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1235328975
##########
dev/tasks/tasks.yml:
##########
@@ -1517,9 +1516,9 @@ tasks:
image: conda-python-hdfs
{% endfor %}
-{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.7", "v3.1.2", "false", "latest"),
- ("3.8", "v3.2.0", "false", "1.23"),
- ("3.9", "master", "false", "latest")] %}
+{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.8", "v3.1.2", "false", "latest"),
Review Comment:
@kou should we move the spark versions conversation to update them to its own ticket?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1600603704
@github-actions crossbow submit -g python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #36061:
URL: https://github.com/apache/arrow/pull/36061#discussion_r1236786836
##########
dev/tasks/tasks.yml:
##########
@@ -1517,9 +1516,9 @@ tasks:
image: conda-python-hdfs
{% endfor %}
-{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.7", "v3.1.2", "false", "latest"),
- ("3.8", "v3.2.0", "false", "1.23"),
- ("3.9", "master", "false", "latest")] %}
+{% for python_version, spark_version, test_pyarrow_only, numpy_version in [("3.8", "v3.1.2", "false", "latest"),
Review Comment:
I have created this issue to track it: https://github.com/apache/arrow/issues/36199
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou merged pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou merged PR #36061:
URL: https://github.com/apache/arrow/pull/36061
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1600757178
The failures on spark-maser, hypothesis and the arm64 wheels are already happening on our nightly builds.
@kou do you have any other concern or are you ok merging this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1591240292
The hypothesis, spark and hdfs failures are known nightly failures.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1591030700
@github-actions crossbow submit -g python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #36061: GH-34788: [Python][Packaging][CI] Drop Python 3.7 support
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #36061:
URL: https://github.com/apache/arrow/pull/36061#issuecomment-1600612485
I've rebased main and I am re-running tests to verify all is good before merging.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org