You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2023/03/23 11:12:07 UTC
[GitHub] [arrow] raulcd opened a new pull request, #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
raulcd opened a new pull request, #34705:
URL: https://github.com/apache/arrow/pull/34705
### Rationale for this change
We haven't been cleaning nightly wheels from gemfury for a long time.
### What changes are included in this PR?
Add a new job that should clean them. This is mainly reused from the one on arrow-adbc: https://github.com/apache/arrow-adbc/blob/main/ci/scripts/gemfury_clean.rb
### Are these changes tested?
I will trigger via crossbow
### Are there any user-facing changes?
No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1481003535
@kou @lidavidm @jorisvandenbossche before trying (and removing a bunch of wheels) I wanted to validate we are ok with keeping 90 days of nightly pyarrow wheels.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1482692109
The failure is expected until the PR is merged because crossbow can't find the ruby script when cloning arrow/main for cleaning the wheels.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1481160844
Oh, I meant it as "at least I'm ok with this" :) personally I think fewer days is fine, even.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #34705:
URL: https://github.com/apache/arrow/pull/34705#discussion_r1146239986
##########
dev/tasks/python-wheels/github.clean.yml:
##########
@@ -0,0 +1,35 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+{% import 'macros.jinja' as macros with context %}
+
+{{ macros.github_header() }}
+
+jobs:
+ build:
+ name: "Clean old wheels"
+ runs-on: ubuntu-latest
+ steps:
+ {{ macros.github_checkout_arrow()|indent }}
+
+ - name: Clean old wheels
+ shell: bash
+ run: |
+ gem install --user-install gemfury
+ ruby ./ci/scripts/gemfury_clean.rb
+ env:
+ GEMFURY_API_TOKEN: {{ '${{ secrets.CROSSBOW_GEMFURY_TOKEN }}' }}
Review Comment:
I've added a new secret to crossbow with the new token
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1484750481
:+1:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1481002280
* Closes: #34687
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on a diff in pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on code in PR #34705:
URL: https://github.com/apache/arrow/pull/34705#discussion_r1146081094
##########
dev/tasks/python-wheels/github.clean.yml:
##########
@@ -0,0 +1,35 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+{% import 'macros.jinja' as macros with context %}
+
+{{ macros.github_header() }}
+
+jobs:
+ build:
+ name: "Clean old wheels"
+ runs-on: ubuntu-latest
+ steps:
+ {{ macros.github_checkout_arrow()|indent }}
+
+ - name: Clean old wheels
+ shell: bash
+ run: |
+ gem install --user-install gemfury
+ ruby ./ci/scripts/gemfury_clean.rb
+ env:
+ GEMFURY_API_TOKEN: {{ '${{ secrets.CROSSBOW_GEMFURY_TOKEN }}' }}
Review Comment:
Is the crossbow token an upload token, or an API token? Gemfury has both
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] assignUser commented on a diff in pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "assignUser (via GitHub)" <gi...@apache.org>.
assignUser commented on code in PR #34705:
URL: https://github.com/apache/arrow/pull/34705#discussion_r1147037527
##########
dev/tasks/python-wheels/github.clean.yml:
##########
@@ -0,0 +1,35 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+{% import 'macros.jinja' as macros with context %}
+
+{{ macros.github_header() }}
+
+jobs:
+ build:
+ name: "Clean old wheels"
+ runs-on: ubuntu-latest
+ steps:
+ {{ macros.github_checkout_arrow()|indent }}
+
+ - name: Clean old wheels
+ shell: bash
+ run: |
+ gem install --user-install gemfury
+ ruby ./ci/scripts/gemfury_clean.rb
+ env:
+ GEMFURY_API_TOKEN: {{ '${{ secrets.CROSSBOW_GEMFURY_API_TOKEN }}' }}
Review Comment:
nit: It is good security practice to not define envvars with creds globally for a job but rather as close to the usage as possible, so usually in the step they are used in.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1482426269
I think 90 days is more than long enough, and indeed can probably even be a bit less. The nightly wheels are meant to test development versions, so you should never rely on the exact wheel long term.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a diff in pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on code in PR #34705:
URL: https://github.com/apache/arrow/pull/34705#discussion_r1155338349
##########
dev/tasks/python-wheels/github.clean.yml:
##########
@@ -0,0 +1,35 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+{% import 'macros.jinja' as macros with context %}
+
+{{ macros.github_header() }}
+
+jobs:
+ build:
+ name: "Clean old wheels"
+ runs-on: ubuntu-latest
+ steps:
+ {{ macros.github_checkout_arrow()|indent }}
+
+ - name: Clean old wheels
+ env:
+ GEMFURY_API_TOKEN: {{ '${{ secrets.CROSSBOW_GEMFURY_API_TOKEN }}' }}
+ shell: bash
+ run: |
+ gem install --user-install gemfury
+ ruby ./ci/scripts/gemfury_clean.rb
Review Comment:
@raulcd It seems that we need to use `arrow/ci/scripts/gemfury_clean.rb`: https://github.com/ursacomputing/crossbow/actions/runs/4587784310/jobs/8101540480
```text
ruby: No such file or directory -- ./ci/scripts/gemfury_clean.rb (LoadError)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1482615380
I am running this locally first. Just for reference the first wheel on gemfury was:
`Yanked pyarrow 0.16.1.dev342 (created 2020-03-25T17:56:25.572+00:00)`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #34705:
URL: https://github.com/apache/arrow/pull/34705#discussion_r1147426626
##########
dev/tasks/python-wheels/github.clean.yml:
##########
@@ -0,0 +1,35 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+{% import 'macros.jinja' as macros with context %}
+
+{{ macros.github_header() }}
+
+jobs:
+ build:
+ name: "Clean old wheels"
+ runs-on: ubuntu-latest
+ steps:
+ {{ macros.github_checkout_arrow()|indent }}
+
+ - name: Clean old wheels
+ shell: bash
+ run: |
+ gem install --user-install gemfury
+ ruby ./ci/scripts/gemfury_clean.rb
+ env:
+ GEMFURY_API_TOKEN: {{ '${{ secrets.CROSSBOW_GEMFURY_API_TOKEN }}' }}
Review Comment:
Thanks! Tab mistake :P I've pushed the change!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd merged pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd merged PR #34705:
URL: https://github.com/apache/arrow/pull/34705
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1481097990
> I'm ok with 90 days, at least
We can keep more (120 days?). Right now we have more than 2 years.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on code in PR #34705:
URL: https://github.com/apache/arrow/pull/34705#discussion_r1146098688
##########
dev/tasks/python-wheels/github.clean.yml:
##########
@@ -0,0 +1,35 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+{% import 'macros.jinja' as macros with context %}
+
+{{ macros.github_header() }}
+
+jobs:
+ build:
+ name: "Clean old wheels"
+ runs-on: ubuntu-latest
+ steps:
+ {{ macros.github_checkout_arrow()|indent }}
+
+ - name: Clean old wheels
+ shell: bash
+ run: |
+ gem install --user-install gemfury
+ ruby ./ci/scripts/gemfury_clean.rb
+ env:
+ GEMFURY_API_TOKEN: {{ '${{ secrets.CROSSBOW_GEMFURY_TOKEN }}' }}
Review Comment:
Thanks @lidavidm! I didn't know there were two types of tokens. I assume is the upload token because is the one we use to upload here: https://github.com/apache/arrow/blob/main/dev/tasks/macros.jinja#L119
Is the API token the one on the `Full Access Token` screen on Gemfury?
If so, I'll add that one to crossbow as a secret too (`CROSSBOW_GEMFURY_API_TOKEN`) and will update here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1482698731
Yes, it would be good to discuss sharing some of the infrastructure now that we have three/four subprojects using similar infrastructure (not sure how similar arrow-julia is to the rest).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1481002347
:warning: GitHub issue #34687 **has been automatically assigned in GitHub** to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1482623785
> I assume we will trigger this with a cron job in crossbow?
This will already be covered on the `wheel-*` group and run as part of the nightly-packaging.
> Side note: another bit of release infra that is duplicated from one of the arrow subprojects. IMO we should really find a way to avoid all of this C&P
Maybe we could open an issue, discuss some approaches and propose something on the ML. Without giving too much thought we could move some of this tooling / release to its own repo and either clone or use a submodule.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1481956261
I'm OK with 90 days.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1482690496
Revision: c6bbae092a6cdf70800f760172b5a65e6cd7ede9
Submitted crossbow builds: [ursacomputing/crossbow @ actions-5acda839a9](https://github.com/ursacomputing/crossbow/branches/all?query=actions-5acda839a9)
|Task|Status|
|----|------|
|wheel-clean|[](https://github.com/ursacomputing/crossbow/actions/runs/4510921424/jobs/7942450266)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1482687684
@github-actions crossbow submit wheel-clean
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on a diff in pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "lidavidm (via GitHub)" <gi...@apache.org>.
lidavidm commented on code in PR #34705:
URL: https://github.com/apache/arrow/pull/34705#discussion_r1146169591
##########
dev/tasks/python-wheels/github.clean.yml:
##########
@@ -0,0 +1,35 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+{% import 'macros.jinja' as macros with context %}
+
+{{ macros.github_header() }}
+
+jobs:
+ build:
+ name: "Clean old wheels"
+ runs-on: ubuntu-latest
+ steps:
+ {{ macros.github_checkout_arrow()|indent }}
+
+ - name: Clean old wheels
+ shell: bash
+ run: |
+ gem install --user-install gemfury
+ ruby ./ci/scripts/gemfury_clean.rb
+ env:
+ GEMFURY_API_TOKEN: {{ '${{ secrets.CROSSBOW_GEMFURY_TOKEN }}' }}
Review Comment:
Yeah, we need the other token added then
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] ursabot commented on pull request #34705: GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury
Posted by "ursabot (via GitHub)" <gi...@apache.org>.
ursabot commented on PR #34705:
URL: https://github.com/apache/arrow/pull/34705#issuecomment-1485001877
Benchmark runs are scheduled for baseline = 40115169c55932f0667652955041b03f70f19927 and contender = 0a21a4c22172615da2fc481090355e73e1e1599e. 0a21a4c22172615da2fc481090355e73e1e1599e is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished :arrow_down:0.0% :arrow_up:0.0%] [ec2-t3-xlarge-us-east-2](https://conbench.ursa.dev/compare/runs/73e32a3d789d4ec3aa7d3082a845b4ac...9a6a89a984014e1cb9e78fe44ccff4d7/)
[Failed :arrow_down:0.21% :arrow_up:0.0%] [test-mac-arm](https://conbench.ursa.dev/compare/runs/bb53e2df5dae4a5e959b66b568d149d3...c20bd1a25b804891b277ff5a5b5d5e43/)
[Finished :arrow_down:0.0% :arrow_up:0.0%] [ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/8ab5f3db57374b7bbc2151bfffa2ce32...5a024439666b44b7b5ac15cd4c5f9fcb/)
[Finished :arrow_down:0.15% :arrow_up:0.03%] [ursa-thinkcentre-m75q](https://conbench.ursa.dev/compare/runs/62ada43367884c22a412e5a99b62f801...ea66eb9f421449289ccc8b20b5d3f40c/)
Buildkite builds:
[Finished] [`0a21a4c2` ec2-t3-xlarge-us-east-2](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ec2-t3-xlarge-us-east-2/builds/2581)
[Failed] [`0a21a4c2` test-mac-arm](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/builds/2611)
[Finished] [`0a21a4c2` ursa-i9-9960x](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-i9-9960x/builds/2579)
[Finished] [`0a21a4c2` ursa-thinkcentre-m75q](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-thinkcentre-m75q/builds/2602)
[Finished] [`40115169` ec2-t3-xlarge-us-east-2](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ec2-t3-xlarge-us-east-2/builds/2580)
[Finished] [`40115169` test-mac-arm](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/builds/2610)
[Finished] [`40115169` ursa-i9-9960x](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-i9-9960x/builds/2578)
[Finished] [`40115169` ursa-thinkcentre-m75q](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-thinkcentre-m75q/builds/2601)
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org