[jira] [Created] (FLINK-38572) Support controlling randomness and format of Chat Model Function

["Yunfeng Zhou (Jira)" <ji...@apache.org>]

Yunfeng Zhou created FLINK-38572:
------------------------------------

             Summary: Support controlling randomness and format of Chat Model Function
                 Key: FLINK-38572
                 URL: https://issues.apache.org/jira/browse/FLINK-38572
             Project: Flink
          Issue Type: Improvement
          Components: Library / Machine Learning
    Affects Versions: 2.2.0
            Reporter: Yunfeng Zhou


In order to better support controlling the randomness and format of Chat Model Function, we propose to pass the following OpenAI API parameters through model function parameter.

* presence-penalty: Number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics.
* n: How many chat completion choices to generate for each input message.
* seed: the random seed to generate results
* response-format: The format of the response, e.g., 'text' or 'json_object'.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)