You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yikun Jiang (Jira)" <ji...@apache.org> on 2022/01/06 07:54:00 UTC
[jira] [Updated] (SPARK-37759) Add ARM based self-hosted runner to Apache Spark
[ https://issues.apache.org/jira/browse/SPARK-37759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yikun Jiang updated SPARK-37759:
--------------------------------
Description:
# Prepare the custom runner
mkdir actions-runner && cd actions-runner
curl -o actions-runner-linux-arm64-2.286.0-airflow1.tar.gz -L https://github.com/ashb/runner/releases/download/v2.286.0-airflow1/actions-runner-linux-arm64-2.286.0-airflow1.tar.gz
tar xzf ./actions-runner-linux-arm64-2.286.0-airflow1.tar.gz
# Configure the self-hosted runner, the Apache Infra Team will give a $TOKEN
# 8U16G for Spark
./config.sh --url https://github.com/apache/spark --token $TOKEN --labels ubuntu-20.04-arm64
# 4U8G for PySpark
./config.sh --url https://github.com/apache/spark --token $TOKEN --labels ubuntu-20.04-arm64-pyspark
# Test on connecting
./run.sh
# Start it as a service
sudo ./svc.sh install
sudo ./svc.sh start
> Add ARM based self-hosted runner to Apache Spark
> ------------------------------------------------
>
> Key: SPARK-37759
> URL: https://issues.apache.org/jira/browse/SPARK-37759
> Project: Spark
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 3.3.0
> Reporter: Yikun Jiang
> Priority: Major
>
> # Prepare the custom runner
> mkdir actions-runner && cd actions-runner
> curl -o actions-runner-linux-arm64-2.286.0-airflow1.tar.gz -L https://github.com/ashb/runner/releases/download/v2.286.0-airflow1/actions-runner-linux-arm64-2.286.0-airflow1.tar.gz
> tar xzf ./actions-runner-linux-arm64-2.286.0-airflow1.tar.gz
> # Configure the self-hosted runner, the Apache Infra Team will give a $TOKEN
> # 8U16G for Spark
> ./config.sh --url https://github.com/apache/spark --token $TOKEN --labels ubuntu-20.04-arm64
> # 4U8G for PySpark
> ./config.sh --url https://github.com/apache/spark --token $TOKEN --labels ubuntu-20.04-arm64-pyspark
> # Test on connecting
> ./run.sh
> # Start it as a service
> sudo ./svc.sh install
> sudo ./svc.sh start
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org