You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "avichaym (via GitHub)" <gi...@apache.org> on 2026/02/09 14:56:08 UTC
[I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
avichaym opened a new issue, #523:
URL: https://github.com/apache/flink-agents/issues/523
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/flink-agents/issues) and found nothing similar.
### Description
## Motivation
Flink Agents currently supports Ollama, OpenAI, Anthropic (direct), and Azure AI as chat model providers, and Ollama/OpenAI for embeddings. There is no integration for Amazon Bedrock, which is the primary LLM gateway for AWS customers.
## Proposed Changes
Add two new integration modules:
- **Chat model** (`integrations/chat-models/bedrock/`) — Uses the Bedrock Converse API with native tool calling support. SigV4 auth via `DefaultCredentialsProvider`. Supports all Bedrock models accessible via Converse API (Claude, Llama, Mistral, Titan, etc.)
- **Embedding model** (`integrations/embedding-models/bedrock/`) — Uses Titan Text Embeddings V2 via InvokeModel. Batch `embed(List<String>)` parallelizes via configurable thread pool (`embed_concurrency` parameter, default 4).
I have a working implementation with unit tests ready to submit as a PR.
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
Posted by "buenzlidominik (via GitHub)" <gi...@apache.org>.
buenzlidominik commented on issue #523:
URL: https://github.com/apache/flink-agents/issues/523#issuecomment-4234151577
Thank you very much for this work @xintongsong @avichaym! I'm super excited to use it.
Is the documentation still missing? As I really need this feature, I could help if there's no time to write it on your side?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
Posted by "xintongsong (via GitHub)" <gi...@apache.org>.
xintongsong commented on issue #523:
URL: https://github.com/apache/flink-agents/issues/523#issuecomment-3874751733
Thanks for offering the contribution, @avichaym. The proposal sounds good to me. I've assigned you to the ticket. Please move ahead.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
Posted by "avichaym (via GitHub)" <gi...@apache.org>.
avichaym commented on issue #523:
URL: https://github.com/apache/flink-agents/issues/523#issuecomment-4244137641
@buenzlidominik , @xintongsong
Hi , sorry for the very delayed response (current geo-political situation in Israel shifted my focus and i forgot about the docs part , so thanks for the reminder) .
I have a few working demo examples and can add the docs in the coming days . @buenzlidominik you can reach me in the flink slack , my user is 'marciano avichay', i can send you some working examples to unblock you in the meantime.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
Posted by "buenzlidominik (via GitHub)" <gi...@apache.org>.
buenzlidominik commented on issue #523:
URL: https://github.com/apache/flink-agents/issues/523#issuecomment-4249720228
Hi @avichaym
Sorry to hear that. I hope everything improves soon and thanks for following up despite the difficult circumstances.
That would be fantastic, I'll write you in Slack.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
Posted by "xintongsong (via GitHub)" <gi...@apache.org>.
xintongsong closed issue #523: [Feature] Add Amazon Bedrock integration for chat models and embedding models
URL: https://github.com/apache/flink-agents/issues/523
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
Posted by "xintongsong (via GitHub)" <gi...@apache.org>.
xintongsong commented on issue #523:
URL: https://github.com/apache/flink-agents/issues/523#issuecomment-4003022791
@avichaym Before closing this issue, we need to update the documents w.r.t. the new model supports. Would you like to also work on that?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add Amazon Bedrock integration for chat models and embedding models [flink-agents]
Posted by "xintongsong (via GitHub)" <gi...@apache.org>.
xintongsong commented on issue #523:
URL: https://github.com/apache/flink-agents/issues/523#issuecomment-4253234978
@avichaym, sorry to hear that. I hope you stay safe.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org