[I] [CI Problem] TLCPack Docker image unable to set LLVM version [tvm]

["Liam-Sturge (via GitHub)" <gi...@apache.org>]

Liam-Sturge opened a new issue, #16613:
URL: https://github.com/apache/tvm/issues/16613

   ### The Problem
   
   Intermittently, when running `./build_image.sh cpu`, the function `detect_llvm_version()` does not run correctly due to exceeding Github API rate limits. This then causes a complete failure as the script attempts to use Curl to fetch the LLVM project from Github with the following syntax `llvm-project-${LLVM_VERSION}.src.tar.xz`. As no version is set, an invalid URL is passed to Curl and an empty file is downloaded. In the logs when building a `package-cpu` Docker image the following error is seen:
   ```
    => ERROR [ 7/20] RUN bash /install/centos_build_llvm.sh 16.0
   ------
   [ 7/20] RUN bash /install/centos_build_llvm.sh 16.0:
   unxz: llvm-project-.src.tar.xz: File format not recognized
   ```
   
   ### Additional Details
   
   The Github API rate limit error looks like this:
   > ```{"message":"API rate limit exceeded for <IP ADDRESS>. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)","documentation_url":"https://docs.github.com/rest/overview/resources-in-the-rest-api#rate-limiting"}```
   
   The error can be replicated after the rate limit is exceeded by navigating to the LLVM URL directly: https://api.github.com/repos/llvm/llvm-project/releases?per_page=100
   
   In the `./build_image.sh` script we are not using an authenticated API request, so the rate is set very low (<50 in given timeout period).
   
   ### Flakiness
   
   Intermittent and more likely to impact CI running regularly, rather than an individual.
   
   ### Suggested Solution
   
   Don't use the Github API to detect the LLVM version. List the remote tags of the repo using `git ls-remote` instead. A Github support discussion [here](https://github.com/orgs/community/discussions/44515#discussioncomment-4795475) suggests 
   > Git operations do not consume part of your API rate limit, as there are no API calls made to GitHub.com via the git client.
   
   ### Triage
   
   Please refer to the list of label tags [here](https://github.com/apache/tvm/wiki/Issue-Triage-Labels) to find the relevant tags and add them below in a bullet format (example below).
   
   * needs-triage
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [CI Problem] TLCPack Docker image unable to set LLVM version [tvm]

["Liam-Sturge (via GitHub)" <gi...@apache.org>]

Liam-Sturge closed issue #16613: [CI Problem] TLCPack Docker image unable to set LLVM version
URL: https://github.com/apache/tvm/issues/16613


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [CI Problem] TLCPack Docker image unable to set LLVM version [tvm]

["Liam-Sturge (via GitHub)" <gi...@apache.org>]

Liam-Sturge closed issue #16613: [CI Problem] TLCPack Docker image unable to set LLVM version
URL: https://github.com/apache/tvm/issues/16613


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [CI Problem] TLCPack Docker image unable to set LLVM version [tvm]

["Liam-Sturge (via GitHub)" <gi...@apache.org>]

Liam-Sturge commented on issue #16613:
URL: https://github.com/apache/tvm/issues/16613#issuecomment-1954039000

   Raised issue on TLCPack repo instead: https://github.com/tlc-pack/tlcpack/issues/190


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org