You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2024/04/29 13:59:32 UTC

[I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]

raulcd opened a new issue, #659:
URL: https://github.com/apache/datafusion-python/issues/659

   **Describe the bug**
   The aarch 64 jobs for conda nightlies are failing with:
   ```
   Conda detected a mismatch between the expected content and downloaded content
   ```
   See:
   - https://github.com/apache/datafusion-python/actions/runs/8852944986/job/24312680435
   - https://github.com/apache/datafusion-python/actions/runs/8852944986/job/24312679875
   - https://github.com/apache/datafusion-python/actions/runs/8852944986/job/24312681217
   
   **To Reproduce**
   - trigger CI
   
   **Expected behavior**
   Jobs succeed and build for aarch64
   
   **Additional context**
   Add any other context about the problem here.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]

Posted by "Michael-J-Ward (via GitHub)" <gi...@apache.org>.
Michael-J-Ward commented on issue #659:
URL: https://github.com/apache/datafusion-python/issues/659#issuecomment-2092036264

   Taking a look at the logs, a few things look off.
   
   1) `conda-forge/linux-64` seems like it's the wrong cache for the `linux-aarch64` job.
   2) `warning libmamba Cache file` was modified by another program makes me think concurrent jobs are modifying the same cache
   3) `rust-std-x86_64` also seems like the wrong download, and that's the one that causes the mismatched hash error.
   
   ```console
   Attempting to finalize metadata for datafusion
   conda-forge/linux-64                                        Using cache
   conda-forge/noarch                                          Using cache
   Reloading output folder: 
   /home/runner/work/datafusion-python/datafusion-python/packages
   warning  libmamba Cache file "/home/runner/conda_pkgs_dir/cache/09cdf8bf.json" was modified by another program
   
   ...
   
   Conda detected a mismatch between the expected content and downloaded content
   for url 'https://conda.anaconda.org/conda-forge/noarch/rust-std-x86_64-unknown-linux-gnu-1.77.2-h2c6d0dc_0.conda'.
     download saved to: /home/runner/conda_pkgs_dir/rust-std-x86_64-unknown-linux-gnu-1.77.2-h2c6d0dc_0.conda
     expected sha256: a482597672076f47c83d0dd3f204eb437007b99ada4d630d56fa64b4b193c5db
     actual sha256: 73f7537db6bc0471135a85a261798abe77e7e83794f945a0355c4068973f31f6
   ```
   
   The things I'd like to try, in order.
   
   1) set the concurrency to hard lock of 1 conda job at a time.
   2) upgrade miniconda action ([v3 has automatic aarch detection](https://github.com/conda-incubator/setup-miniconda/blob/main/CHANGELOG.md#v302-2024-02-22))
   3) blow out the conda and start fresh
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]

Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #659: Build conda nightlies jobs are failing on main for aarch64
URL: https://github.com/apache/datafusion-python/issues/659


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]

Posted by "Michael-J-Ward (via GitHub)" <gi...@apache.org>.
Michael-J-Ward commented on issue #659:
URL: https://github.com/apache/datafusion-python/issues/659#issuecomment-2096815425

   Investigating further. The `actual sha256sum` that the CI report matches both what I calculate when downloading the files and what [conda-forge](https://conda.anaconda.org/conda-forge/noarch/) lists.
   
   ```
   file: rust-std-aarch64-unknown-linux-gnu-1.77.2-hbe8e118_0.conda
   sha256sum: 9d583f04bfdbccc82ac2f0653de571f8371df04633727e714b71efd7e4a0140a
   
   file:  rust-std-x86_64-unknown-linux-gnu-1.77.2-h2c6d0dc_0.conda
   sha256: 73f7537db6bc0471135a85a261798abe77e7e83794f945a0355c4068973f31f6
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [I] Build conda nightlies jobs are failing on main for aarch64 [datafusion-python]

Posted by "Michael-J-Ward (via GitHub)" <gi...@apache.org>.
Michael-J-Ward commented on issue #659:
URL: https://github.com/apache/datafusion-python/issues/659#issuecomment-2100566566

   Ah, `publish-docs` is the tag @andygrove used to trigger the docs generation & publication.
   
   Apparently, `conda` doesn't like that for a package/version.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org