[jira] [Created] (FLINK-40692) [Model] Use default model version from server when no version is defined in model config

["Danish (Jira)" <ji...@apache.org>]

Danish created FLINK-40692:
------------------------------

             Summary: [Model] Use default model version from server when no version is defined in model config
                 Key: FLINK-40692
                 URL: https://issues.apache.org/jira/browse/FLINK-40692
             Project: Flink
          Issue Type: Improvement
            Reporter: Danish


When we don't define `model-version` in `CREATE MODEL` SQL, it tends to create URL with `version: latest`. i.e.

https://\{model endpoint}/v2/models/\{model name}/versions/latest/infer

 

This is not necessarily the case for all model servers in KServe protocol and it fails for them. The protocol defines that if there is no version defined, we fall back to using the default model defined by the server itself. i.e. the url does not contain any version info

https://\{model endpoint}/v2/models/\{model name}/infer

The server model can define either the latest or any other model version to be used when no version is mentioned using server side policies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)