[jira] [Assigned] (HDDS-14817) Multi-LLM Provider Support with Intelligent Routing

["Arafat Khan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDDS-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arafat Khan reassigned HDDS-14817:
----------------------------------

    Assignee: Arafat Khan

> Multi-LLM Provider Support with Intelligent Routing
> ---------------------------------------------------
>
>                 Key: HDDS-14817
>                 URL: https://issues.apache.org/jira/browse/HDDS-14817
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: Arafat Khan
>            Assignee: Arafat Khan
>            Priority: Major
>
> Customers differ in which AI services they are contracted to use some run on Azure OpenAI, others on Anthropic, and others still on Google Cloud. This JIRA ensures the Recon AI Assistant is not tied to a single vendor by building out a pluggable provider model and adding native support for OpenAI and Anthropic alongside Gemini. It introduces a smart routing layer that automatically determines which AI provider to use based on the model the user selects so if a user picks a GPT model, it routes to OpenAI; if they pick Claude, it routes to Anthropic. Administrators can also set a cluster-wide default provider. The result is a flexible, provider-agnostic assistant that works within whatever AI ecosystem an organization already has in place.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org