You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tooling.apache.org by gs...@apache.org on 2026/08/16 20:40:27 UTC
(tooling-llmao) branch main updated: Provisioning script for vast.ai instances.
This is an automated email from the ASF dual-hosted git repository.
gstein pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/tooling-llmao.git
The following commit(s) were added to refs/heads/main by this push:
new 33f36a5 Provisioning script for vast.ai instances.
33f36a5 is described below
commit 33f36a5f30f65ecefdeae2264bae4fbf58816ad7
Author: Greg Stein <gs...@gmail.com>
AuthorDate: Sun Aug 16 15:39:01 2026 -0500
Provisioning script for vast.ai instances.
Co-authored-by: Grok <gr...@x.ai>
---
hosting/vast/provision.sh | 15 +++++++++++++++
1 file changed, 15 insertions(+)
diff --git a/hosting/vast/provision.sh b/hosting/vast/provision.sh
new file mode 100644
index 0000000..4b890a0
--- /dev/null
+++ b/hosting/vast/provision.sh
@@ -0,0 +1,15 @@
+#!/bin/bash
+set -eo pipefail
+cd /workspace
+
+# fetch launcher if needed
+# curl -fsSL -o vllm_launcher.py "$LAUNCHER_URL"
+# chmod +x vllm_launcher.py
+
+# fetch servers.yaml from asfquart
+curl -fsS -H "Authorization: Bearer $FLEET_KEY" \
+ "$ASFQUART_URL/vllm/config/$VLLM_SET" \
+ -o /workspace/servers.yaml
+
+python /workspace/vllm_launcher.py
+# or: nohup python ... & if on-start must return
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@tooling.apache.org
For additional commands, e-mail: commits-help@tooling.apache.org