You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by da...@apache.org on 2024/11/15 19:53:35 UTC
(beam) 01/01: Fix vllm typo
This is an automated email from the ASF dual-hosted git repository.
damccorm pushed a commit to branch users/damccorm/typo
in repository https://gitbox.apache.org/repos/asf/beam.git
commit cc57bded5c94ccbd45e70a5701c35d0d56683d59
Author: Danny McCormick <da...@google.com>
AuthorDate: Fri Nov 15 14:53:24 2024 -0500
Fix vllm typo
---
examples/notebooks/beam-ml/run_inference_vllm.ipynb | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/examples/notebooks/beam-ml/run_inference_vllm.ipynb b/examples/notebooks/beam-ml/run_inference_vllm.ipynb
index e9f1e53a452..13b4a915c08 100644
--- a/examples/notebooks/beam-ml/run_inference_vllm.ipynb
+++ b/examples/notebooks/beam-ml/run_inference_vllm.ipynb
@@ -66,7 +66,7 @@
{
"cell_type": "markdown",
"source": [
- "[vLLM](https://github.com/vllm-project/vllm) is a fast and user-frienly library for LLM inference and serving. vLLM optimizes LLM inference with mechanisms like PagedAttention for memory management and continuous batching for increasing throughput. For popular models, vLLM has been shown to increase throughput by a multiple of 2 to 4. With Apache Beam, you can serve models with vLLM and scale that serving with just a few lines of code.\n",
+ "[vLLM](https://github.com/vllm-project/vllm) is a fast and user-friendly library for LLM inference and serving. vLLM optimizes LLM inference with mechanisms like PagedAttention for memory management and continuous batching for increasing throughput. For popular models, vLLM has been shown to increase throughput by a multiple of 2 to 4. With Apache Beam, you can serve models with vLLM and scale that serving with just a few lines of code.\n",
"\n",
"This notebook demonstrates how to run machine learning inference by using vLLM and GPUs in three ways:\n",
"\n",