You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@rocketmq.apache.org by "Aias00 (via GitHub)" <gi...@apache.org> on 2026/08/05 02:49:14 UTC
[I] [Studio][Bug][Track3] Bound OpenAI-compatible LLM response and SSE payload sizes [rocketmq-dashboard]
Aias00 opened a new issue, #1008:
URL: https://github.com/apache/rocketmq-dashboard/issues/1008
## Problem
`OpenAiCompatibleLlmClient` reads provider responses without any size limit:
- `complete` and `listModels` use `HttpResponse.BodyHandlers.ofString()`.
- A failed streaming request calls `InputStream.readAllBytes()`.
- SSE parsing accumulates every `data:` line for an event and has no per-event or cumulative response budget.
A malformed or unexpectedly large upstream response can therefore allocate excessive memory and delay the Studio server.
## Expected behavior
- Apply documented limits to regular completion/model responses, streaming error bodies, individual SSE events, and the cumulative streamed response.
- Stop reading as soon as a limit is exceeded and return a structured `llm.provider.response_too_large` error.
- Keep normal OpenAI-compatible completion and SSE behavior unchanged within the limits.
## Scope
Track 3 / AI Native. This complements, but does not duplicate, the timeout, concurrency, and CLI process hardening in #940.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Studio][Bug][Track3] Bound OpenAI-compatible LLM response and SSE payload sizes [rocketmq-dashboard]
Posted by "Aias00 (via GitHub)" <gi...@apache.org>.
Aias00 commented on issue #1008:
URL: https://github.com/apache/rocketmq-dashboard/issues/1008#issuecomment-5192549053
Closing this Track 3 / AI Native issue because I am narrowing subsequent work to Track 1 / Control Plane.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Studio][Bug][Track3] Bound OpenAI-compatible LLM response and SSE payload sizes [rocketmq-dashboard]
Posted by "RockteMQ-AI (via GitHub)" <gi...@apache.org>.
RockteMQ-AI commented on issue #1008:
URL: https://github.com/apache/rocketmq-dashboard/issues/1008#issuecomment-5190968475
**Issue Evaluation**
Category: `bug` | Status: **Confirmed**
The reported issue has been verified against the current codebase.
**Root Cause:** `OpenAiCompatibleLlmClient` reads upstream LLM provider responses without any size limit — `complete()` and `listModels()` use `HttpResponse.BodyHandlers.ofString()`, streaming error paths call `InputStream.readAllBytes()`, and SSE parsing accumulates `data:` lines without per-event or cumulative budgets. A malformed or unexpectedly large upstream response can allocate excessive memory and stall the Studio server.
**Impact:** Studio server stability — a single misbehaving LLM provider response can cause OOM or severe memory pressure.
**Severity:** medium
**Suggested fix:**
- Apply configurable size limits to regular completion/model responses, streaming error bodies, individual SSE events, and cumulative streamed responses.
- Stop reading and return a structured `llm.provider.response_too_large` error when a limit is exceeded.
- Keep normal OpenAI-compatible behavior unaffected for responses within limits.
---
*Automated evaluation by RockteMQ-AI*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Studio][Bug][Track3] Bound OpenAI-compatible LLM response and SSE payload sizes [rocketmq-dashboard]
Posted by "Aias00 (via GitHub)" <gi...@apache.org>.
Aias00 closed issue #1008: [Studio][Bug][Track3] Bound OpenAI-compatible LLM response and SSE payload sizes
URL: https://github.com/apache/rocketmq-dashboard/issues/1008
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org