You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2024/04/29 13:59:32 UTC
[I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]
raulcd opened a new issue, #659:
URL: https://github.com/apache/datafusion-python/issues/659
**Describe the bug**
The aarch 64 jobs for conda nightlies are failing with:
```
Conda detected a mismatch between the expected content and downloaded content
```
See:
- https://github.com/apache/datafusion-python/actions/runs/8852944986/job/24312680435
- https://github.com/apache/datafusion-python/actions/runs/8852944986/job/24312679875
- https://github.com/apache/datafusion-python/actions/runs/8852944986/job/24312681217
**To Reproduce**
- trigger CI
**Expected behavior**
Jobs succeed and build for aarch64
**Additional context**
Add any other context about the problem here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]
Posted by "Michael-J-Ward (via GitHub)" <gi...@apache.org>.
Michael-J-Ward commented on issue #659:
URL: https://github.com/apache/datafusion-python/issues/659#issuecomment-2092036264
Taking a look at the logs, a few things look off.
1) `conda-forge/linux-64` seems like it's the wrong cache for the `linux-aarch64` job.
2) `warning libmamba Cache file` was modified by another program makes me think concurrent jobs are modifying the same cache
3) `rust-std-x86_64` also seems like the wrong download, and that's the one that causes the mismatched hash error.
```console
Attempting to finalize metadata for datafusion
conda-forge/linux-64 Using cache
conda-forge/noarch Using cache
Reloading output folder:
/home/runner/work/datafusion-python/datafusion-python/packages
warning libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
...
Conda detected a mismatch between the expected content and downloaded content
for url 'https://conda.anaconda.org/conda-forge/noarch/rust-std-x86_64-unknown-linux-gnu-1.77.2-h2c6d0dc_0.conda'.
download saved to: /home/runner/conda_pkgs_dir/rust-std-x86_64-unknown-linux-gnu-1.77.2-h2c6d0dc_0.conda
expected sha256: a482597672076f47c83d0dd3f204eb437007b99ada4d630d56fa64b4b193c5db
actual sha256: 73f7537db6bc0471135a85a261798abe77e7e83794f945a0355c4068973f31f6
```
The things I'd like to try, in order.
1) set the concurrency to hard lock of 1 conda job at a time.
2) upgrade miniconda action ([v3 has automatic aarch detection](https://github.com/conda-incubator/setup-miniconda/blob/main/CHANGELOG.md#v302-2024-02-22))
3) blow out the conda and start fresh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #659: Build conda nightlies jobs are failing on main for aarch64
URL: https://github.com/apache/datafusion-python/issues/659
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]
Posted by "Michael-J-Ward (via GitHub)" <gi...@apache.org>.
Michael-J-Ward commented on issue #659:
URL: https://github.com/apache/datafusion-python/issues/659#issuecomment-2096815425
Investigating further. The `actual sha256sum` that the CI report matches both what I calculate when downloading the files and what [conda-forge](https://conda.anaconda.org/conda-forge/noarch/) lists.
```
file: rust-std-aarch64-unknown-linux-gnu-1.77.2-hbe8e118_0.conda
sha256sum: 9d583f04bfdbccc82ac2f0653de571f8371df04633727e714b71efd7e4a0140a
file: rust-std-x86_64-unknown-linux-gnu-1.77.2-h2c6d0dc_0.conda
sha256: 73f7537db6bc0471135a85a261798abe77e7e83794f945a0355c4068973f31f6
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]
Posted by "Michael-J-Ward (via GitHub)" <gi...@apache.org>.
Michael-J-Ward commented on issue #659:
URL: https://github.com/apache/datafusion-python/issues/659#issuecomment-2100566566
Ah, `publish-docs` is the tag @andygrove used to trigger the docs generation & publication.
Apparently, `conda` doesn't like that for a package/version.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org