You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2026/09/14 09:48:46 UTC

[PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

raulcd opened a new pull request, #51326:
URL: https://github.com/apache/arrow/pull/51326

   ### Rationale for this change
   
   MinIO download URLs return HTTP 410. They have been removed.
   
   ### What changes are included in this PR?
   
   Use the exact same releases we use but use the GitHub releases download URL temporarily before moving to something else.
   
   ### Are these changes tested?
   
   Yes via archery and CI
   
   ### Are there any user-facing changes?
   
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #51326:
URL: https://github.com/apache/arrow/pull/51326#issuecomment-5662903563

   @github-actions crossbow submit wheel-*cp313*


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "Copilot (via GitHub)" <gi...@apache.org>.
Copilot commented on code in PR #51326:
URL: https://github.com/apache/arrow/pull/51326#discussion_r4004486038


##########
.github/workflows/cpp.yml:
##########
@@ -408,7 +408,7 @@ jobs:
           mkdir -p /usr/local/bin
           wget \
             --output-document /usr/local/bin/minio.exe \
-            https://dl.min.io/server/minio/release/windows-amd64/archive/minio.RELEASE.2025-01-20T14-49-07Z
+            https://github.com/minio/minio/releases/download/RELEASE.2025-01-20T14-49-07Z/minio.windows-amd64.RELEASE.2025-01-20T14-49-07Z.exe

Review Comment:
   Unlike the shared installer, this duplicated Windows download is not checked against the pinned SHA-256 (`ec1bf8de…`). A replaced release asset would therefore be accepted by this CI path even though the new installer rejects it. Add the same checksum verification here and fail the job on mismatch.



##########
ci/docker/python-wheel-windows-test-vs2022-base.dockerfile:
##########
@@ -51,7 +51,7 @@ SHELL ["cmd", "/S", "/C"]
 
 # Install git, wget, minio
 RUN choco install --no-progress -r -y git wget
-RUN curl https://dl.min.io/server/minio/release/windows-amd64/archive/minio.RELEASE.2025-01-20T14-49-07Z `
+RUN curl -L https://github.com/minio/minio/releases/download/RELEASE.2025-01-20T14-49-07Z/minio.windows-amd64.RELEASE.2025-01-20T14-49-07Z.exe `
     --output "C:\Windows\Minio.exe"

Review Comment:
   This Windows image download also bypasses the checksum verification added to `install_minio.sh`. A replaced release asset can enter the test image without detection; verify `C:\Windows\Minio.exe` against the pinned SHA-256 before completing this layer, and keep the check aligned with the workflow path.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #51326:
URL: https://github.com/apache/arrow/pull/51326#issuecomment-5662929397

   Revision: fd2d61f4b881e98c65ed96b098db353be66f86b3
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-794c2bac07](https://github.com/ursacomputing/crossbow/branches/all?query=actions-794c2bac07)
   
   |Task|Status|
   |----|------|
   |wheel-macos-monterey-cp313-cp313-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-794c2bac07-github-wheel-macos-monterey-cp313-cp313-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34836039341/job/103949963901)|
   |wheel-macos-monterey-cp313-cp313-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-794c2bac07-github-wheel-macos-monterey-cp313-cp313-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34836037837/job/103949957225)|
   |wheel-manylinux-2-28-cp313-cp313-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-794c2bac07-github-wheel-manylinux-2-28-cp313-cp313-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34836036595/job/103949953569)|
   |wheel-manylinux-2-28-cp313-cp313-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-794c2bac07-github-wheel-manylinux-2-28-cp313-cp313-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34836037664/job/103949956548)|
   |wheel-musllinux-1-2-cp313-cp313-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-794c2bac07-github-wheel-musllinux-1-2-cp313-cp313-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34836036677/job/103949953963)|
   |wheel-musllinux-1-2-cp313-cp313-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-794c2bac07-github-wheel-musllinux-1-2-cp313-cp313-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34836037247/job/103949955140)|
   |wheel-windows-cp313-cp313-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-794c2bac07-github-wheel-windows-cp313-cp313-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34836036743/job/103949954189)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "Copilot (via GitHub)" <gi...@apache.org>.
Copilot commented on code in PR #51326:
URL: https://github.com/apache/arrow/pull/51326#discussion_r4004019711


##########
ci/scripts/install_minio.sh:
##########
@@ -62,9 +62,16 @@ if [ "${version}" != "latest" ]; then
   exit 1
 fi
 
+# The binaries are no longer available from https://dl.min.io (HTTP 410),
+# so they are fetched from the GitHub releases instead. See GH-47908.
 # Use specific versions for minio server and client to avoid CI failures on new releases.
-minio_version="minio.RELEASE.2025-01-20T14-49-07Z"
-mc_version="mc.RELEASE.2024-09-16T17-43-14Z"
+minio_version="RELEASE.2025-01-20T14-49-07Z"

Review Comment:
   The Windows C++ job still downloads this pinned server from `https://dl.min.io/...` at `.github/workflows/cpp.yml:411`, so it will continue to fail with HTTP 410 even after this script is updated. Please update that job to the corresponding GitHub release asset (or reuse this installer) as part of this change.



##########
ci/scripts/install_minio.sh:
##########
@@ -80,13 +87,13 @@ download()
 }
 
 if [[ ! -x ${prefix}/bin/minio ]]; then
-  url="https://dl.min.io/server/minio/release/${platform}-${arch}/archive/${minio_version}"
+  url="https://github.com/minio/minio/releases/download/${minio_version}/minio.${platform}-${arch}.${minio_version}${exe_suffix}"

Review Comment:
   This template still maps `s390x` to `linux-s390x`, but the pinned MinIO GitHub release has no `minio.linux-s390x.RELEASE.2025-01-20T14-49-07Z` asset. An invocation on s390x will therefore fail with a 404; please provide a valid source for that architecture or remove it from the supported architecture map instead of constructing an unavailable URL.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #51326:
URL: https://github.com/apache/arrow/pull/51326#issuecomment-5662439745

   @github-actions crossbow submit wheel-*cp314*


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-51327: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #51326:
URL: https://github.com/apache/arrow/pull/51326#issuecomment-5664727114

   :warning: GitHub issue #51327 **has been automatically assigned in GitHub** to PR creator.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #51326:
URL: https://github.com/apache/arrow/pull/51326#issuecomment-5662469925

   Revision: 35c116bb90dbebc0f010354fb51caa89199f8c73
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-c58570452f](https://github.com/ursacomputing/crossbow/branches/all?query=actions-c58570452f)
   
   |Task|Status|
   |----|------|
   |wheel-macos-monterey-cp314-cp314-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-macos-monterey-cp314-cp314-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832530676/job/103938927673)|
   |wheel-macos-monterey-cp314-cp314-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-macos-monterey-cp314-cp314-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34832528482/job/103938922039)|
   |wheel-macos-monterey-cp314-cp314t-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-macos-monterey-cp314-cp314t-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832528808/job/103938922252)|
   |wheel-macos-monterey-cp314-cp314t-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-macos-monterey-cp314-cp314t-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34832529754/job/103938925189)|
   |wheel-manylinux-2-28-cp314-cp314-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-manylinux-2-28-cp314-cp314-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832529175/job/103938923943)|
   |wheel-manylinux-2-28-cp314-cp314-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-manylinux-2-28-cp314-cp314-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34832530873/job/103938928534)|
   |wheel-manylinux-2-28-cp314-cp314t-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-manylinux-2-28-cp314-cp314t-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832530656/job/103938927965)|
   |wheel-manylinux-2-28-cp314-cp314t-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-manylinux-2-28-cp314-cp314t-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34832530186/job/103938927174)|
   |wheel-musllinux-1-2-cp314-cp314-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-musllinux-1-2-cp314-cp314-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832529319/job/103938923826)|
   |wheel-musllinux-1-2-cp314-cp314-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-musllinux-1-2-cp314-cp314-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34832530148/job/103938926601)|
   |wheel-musllinux-1-2-cp314-cp314t-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-musllinux-1-2-cp314-cp314t-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832529560/job/103938925313)|
   |wheel-musllinux-1-2-cp314-cp314t-arm64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-musllinux-1-2-cp314-cp314t-arm64)](https://github.com/ursacomputing/crossbow/actions/runs/34832530946/job/103938929853)|
   |wheel-windows-cp314-cp314-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-windows-cp314-cp314-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832530352/job/103938926775)|
   |wheel-windows-cp314-cp314t-amd64|[![GitHub Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-c58570452f-github-wheel-windows-cp314-cp314t-amd64)](https://github.com/ursacomputing/crossbow/actions/runs/34832528396/job/103938922348)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-47908: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #51326:
URL: https://github.com/apache/arrow/pull/51326#issuecomment-5664106176

   @kou Could you take a quick look at the additional shell code? Otherwise I hope we can merge quickly to fix CI.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-51327: [CI][Dev] Change download minIO URLs for GitHub releases URL [arrow]

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou merged PR #51326:
URL: https://github.com/apache/arrow/pull/51326


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org