You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zhouyuan (via GitHub)" <gi...@apache.org> on 2025/11/20 10:06:55 UTC

[I] [VL] Slow on downloading Spark release [incubator-gluten]

zhouyuan opened a new issue, #11132:
URL: https://github.com/apache/incubator-gluten/issues/11132

   ### Backend
   
   VL (Velox)
   
   ### Bug description
   
   When building the docker image, the spark resource downloading is extremely slow which result in job failure.
   It looks like the apache dynamic mirror is not effective:
   ```
   Thu, 20 Nov 2025 08:34:04 GMT
   #6 142.0 + ./install-spark-resources.sh 3.2
   Thu, 20 Nov 2025 09:08:14 GMT
   #6 2192.2 2025-11-20 09:08:14 URL:https://archive.apache.org/dist/spark/spark-3.2.2/spark-3.2.2-bin-hadoop3.2.tgz [301112604/301112604] -> "spark-3.2.2-bin-hadoop3.2.tgz" [1]
   Thu, 20 Nov 2025 09:10:32 GMT
   #6 2330.1 2025-11-20 09:10:32 URL:https://archive.apache.org/dist/spark/spark-3.2.2/spark-3.2.2.tgz [28442953/28442953] -> "spark-3.2.2.tgz" [1]
   Thu, 20 Nov 2025 09:10:33 GMT
   #6 2331.3 2025-11-20 09:10:33 URL:https://archive.apache.org/dist/spark/spark-3.2.2/spark-3.2.2-bin-hadoop3.2.tgz.sha512 [160/160] -> "spark-3.2.2-bin-hadoop3.2.tgz.sha512" [1]
   Thu, 20 Nov 2025 09:10:35 GMT
   #6 2333.0 2025-11-20 09:10:35 URL:https://archive.apache.org/dist/spark/spark-3.2.2/spark-3.2.2.tgz.sha512 [146/146] -> "spark-3.2.2.tgz.sha512" [1]
   Thu, 20 Nov 2025 09:10:38 GMT
   #6 2335.9 + ./install-spark-resources.sh 3.3
   ```
   
   ### Gluten version
   
   _No response_
   
   ### Spark version
   
   None
   
   ### Spark configurations
   
   _No response_
   
   ### System information
   
   _No response_
   
   ### Relevant logs
   
   ```bash
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [I] [VL] Slow on downloading Spark release [incubator-gluten]

Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan closed issue #11132: [VL] Slow on downloading Spark release
URL: https://github.com/apache/incubator-gluten/issues/11132


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [I] [VL] Slow on downloading Spark release [incubator-gluten]

Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on issue #11132:
URL: https://github.com/apache/incubator-gluten/issues/11132#issuecomment-3585351783

   closed by switch to a new mirror


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org