You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Mao Jiayi (Jira)" <ji...@apache.org> on 2026/08/18 10:27:00 UTC

[jira] [Created] (FLINK-40411) Introduce an OpenAI-compatible model client for Flink CDC Pipeline

Mao Jiayi created FLINK-40411:
---------------------------------

             Summary: Introduce an OpenAI-compatible model client for Flink CDC Pipeline
                 Key: FLINK-40411
                 URL: https://issues.apache.org/jira/browse/FLINK-40411
             Project: Flink
          Issue Type: New Feature
          Components: Flink CDC
            Reporter: Mao Jiayi


h3. Motivation

FLINK-39568 introduced the generic AI model client API and the {{AI_COMPLETE}} and {{AI_EMBED}} functions. This issue adds a concrete OpenAI-compatible model client so that Flink CDC Pipeline jobs can use model services exposing OpenAI-compatible completion and embedding APIs.

h3. Scope

* Add an independent {{openai-compatible}} model module discovered through the Factory SPI.
* Support configurable model name, endpoint, and API key.
* Support configurable system and user prompts and input text, including English and Chinese.
* Support common request parameters such as temperature, top-p, token limits, penalties, response format, additional headers, and additional body properties.
* Support text completion and text embedding.
* Support retry, backoff, response validation, and error handling.
* Package the required client dependencies and ensure that the model provider JAR is available to TaskManagers.
* Add English and Chinese documentation.

h3. Compatibility

The OpenAI-compatible client is added alongside the existing legacy model API. This issue does not remove or migrate the legacy API.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)