You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tooling.apache.org by gs...@apache.org on 2026/08/16 20:40:27 UTC

(tooling-llmao) branch main updated: Provisioning script for vast.ai instances.

This is an automated email from the ASF dual-hosted git repository.

gstein pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/tooling-llmao.git


The following commit(s) were added to refs/heads/main by this push:
     new 33f36a5  Provisioning script for vast.ai instances.
33f36a5 is described below

commit 33f36a5f30f65ecefdeae2264bae4fbf58816ad7
Author: Greg Stein <gs...@gmail.com>
AuthorDate: Sun Aug 16 15:39:01 2026 -0500

    Provisioning script for vast.ai instances.
    
    Co-authored-by: Grok <gr...@x.ai>
---
 hosting/vast/provision.sh | 15 +++++++++++++++
 1 file changed, 15 insertions(+)

diff --git a/hosting/vast/provision.sh b/hosting/vast/provision.sh
new file mode 100644
index 0000000..4b890a0
--- /dev/null
+++ b/hosting/vast/provision.sh
@@ -0,0 +1,15 @@
+#!/bin/bash
+set -eo pipefail
+cd /workspace
+
+# fetch launcher if needed
+# curl -fsSL -o vllm_launcher.py "$LAUNCHER_URL"
+# chmod +x vllm_launcher.py
+
+# fetch servers.yaml from asfquart
+curl -fsS -H "Authorization: Bearer $FLEET_KEY" \
+  "$ASFQUART_URL/vllm/config/$VLLM_SET" \
+  -o /workspace/servers.yaml
+
+python /workspace/vllm_launcher.py
+# or: nohup python ... &   if on-start must return


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@tooling.apache.org
For additional commands, e-mail: commits-help@tooling.apache.org