You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2023/10/17 12:37:59 UTC

[PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

raulcd opened a new pull request, #38308:
URL: https://github.com/apache/arrow/pull/38308

   
   ### Rationale for this change
   
   wheel-clean nightly job is currently failing
   
   ### What changes are included in this PR?
   
   Catch exception and add login
   
   ### Are these changes tested?
   
   Via archery
   
   ### Are there any user-facing changes?
   
   No


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1766391390

   From what I can see this exception should be raised when a 404 is returned:
   https://github.com/gemfury/gemfury/blob/main/lib/gemfury/client.rb#L251C21-L251C54
   but the wheels are supposed to be there: https://pypi.fury.io/arrow-nightlies/pyarrow
   so I am not entirely sure what is happening


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1766620111

   @kou any idea why this might be failing for the last days?
   The ruby gem dependencies seem to be exactly the same versions for the last successful one:
   * Last success: https://github.com/ursacomputing/crossbow/actions/runs/6480009013/job/17594663052
   The current PR doesn't solve the issue just adds some logging and deals with the exception but I don't think we should catch it as this is hiding the current problem.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1769767770

   Sorry for not clarifying it.
   I wanted to suggest that we just remove `wheel-clean` task like ADBC did.
   If Gemfury reports any quota related error, we can recreate "pyarrow" package on Gemfury. It will remove all uploaded packages.
   
   Or we may be able to stop using Gemfury because we also upload nightly packages to conda-forge: https://arrow.apache.org/docs/developers/python.html#installing-nightly-packages
   But we need to ask the community about this on dev@ to choose this approach.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Remove gemfury_clean.rb [arrow]

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou merged PR #38308:
URL: https://github.com/apache/arrow/pull/38308


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Remove gemfury_clean.rb [arrow]

Posted by "conbench-apache-arrow[bot] (via GitHub)" <gi...@apache.org>.
conbench-apache-arrow[bot] commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1778916212

   After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit c8c74851313a322ac668dda4d51b274d6a40dbd1.
   
   There were no benchmark performance regressions. 🎉
   
   The [full Conbench report](https://github.com/apache/arrow/runs/18035685972) has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Remove gemfury_clean.rb [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1775119668

   > Sorry for not clarifying it. I wanted to suggest that we just remove `wheel-clean` task like ADBC did. If Gemfury reports any quota related error, we can recreate "pyarrow" package on Gemfury. It will remove all uploaded packages.
   
   Thanks @kou it makes sense to me to remove it. If we reach quota related issues we can recreate as suggested.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1766333846

   @github-actions crossbow submit wheel-clean


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1766346903

   Revision: 669dfc7d45bfbe38ce036e1347a8e2cee80778f9
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-73631f0661](https://github.com/ursacomputing/crossbow/branches/all?query=actions-73631f0661)
   
   |Task|Status|
   |----|------|
   |wheel-clean|[![Github Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-73631f0661-github-wheel-clean)](https://github.com/ursacomputing/crossbow/actions/runs/6547356935/job/17779676760)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1768009275

   > How about just removing `gemfury_clean.rb`?
   
   I am not sure I understand you, if we remove `gemfury_clean.rb` we can remove the `wheel-clean` task? Or are you suggesting a different approach to clean old wheels?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1766611969

   I don't understand why is failing to yank any wheel now:
   ```
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:14:54.440Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:14:55.255Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:22:53.335Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:23:02.456Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:30:59.804Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:32:31.240Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:34:39.163Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:36:48.953Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:37:44.074Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:39:39.833Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:39:51.160Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:45:38.766Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:47:21.756Z with Gemfury::NotFound
   Failed to yank pyarrow 13.0.0.dev497 (created 2023-07-13T10:47:25.564Z with Gemfury::NotFound
   ...
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1767415893

   It seems that this is a server side problem: https://github.com/apache/arrow-adbc/issues/1085
   
   How about just removing `gemfury_clean.rb`?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1766398685

   Revision: a0566c6d015405615b5013ba0b9407de2918c4bd
   
   Submitted crossbow builds: [ursacomputing/crossbow @ actions-85896bc72f](https://github.com/ursacomputing/crossbow/branches/all?query=actions-85896bc72f)
   
   |Task|Status|
   |----|------|
   |wheel-clean|[![Github Actions](https://github.com/ursacomputing/crossbow/actions/workflows/crossbow.yml/badge.svg?branch=actions-85896bc72f-github-wheel-clean)](https://github.com/ursacomputing/crossbow/actions/runs/6547745050/job/17780854827)|


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] GH-38307: [CI] Fix gemfury_clean.rb in case of artifact not found when removing version [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #38308:
URL: https://github.com/apache/arrow/pull/38308#issuecomment-1766381815

   @github-actions crossbow submit wheel-clean


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org