You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/08/17 06:43:08 UTC
[GitHub] [spark] Yikun commented on pull request #35663: [SPARK-37809][K8S] Add `YuniKorn` Feature Step
Yikun commented on PR #35663:
URL: https://github.com/apache/spark/pull/35663#issuecomment-1217527267
I think @dongjoon-hyun already catch all key parts. And I think we also need:
- doc in [here](https://github.com/apache/spark/tree/master/resource-managers/kubernetes/integration-tests#running-the-volcano-integration-tests) to show requreiment and how to do complete IT for spark and volcano.
- IIRC, as we dicussed before, we need to support x86/arm64 arch if we get it supported in Spark. According to Yunikorn doc, looks like it is still only supported amd64? https://hub.docker.com/r/apache/yunikron/tags . I will help to test in linux arm64/x86 and macos m1 when it's ready.
- BTW, unrelated but might useful Volcano community is going to introduce the native multi-arch support in 1.7 (about relese in next month), I will help to upgrade Volcano to 1.7 version in Spark 3.4. (I believe this is also @dongjoon-hyun's concern) , so pls don't mislead by arm64/x86 separate installtions of spark volcano integrations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org