You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@apisix.apache.org by "leekari5548 (via GitHub)" <gi...@apache.org> on 2025/08/06 07:14:03 UTC

[I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

leekari5548 opened a new issue, #12492:
URL: https://github.com/apache/apisix/issues/12492

   ### Description
   
   The "Include LLM Information in Access Log" feature doesn't seem to be working.
   
   https://apisix.apache.org/docs/apisix/plugins/ai-proxy/#include-llm-information-in-access-log
   
   ### Environment
   
   - APISIX version (run `apisix version`): 3.13.0
   - Operating system (run `uname -a`):
   - OpenResty / Nginx version (run `openresty -V` or `nginx -V`):
   - etcd version, if relevant (run `curl http://127.0.0.1:9090/v1/server_info`):
   - APISIX Dashboard version, if relevant:
   - Plugin runner version, for issues related to plugin runners:
   - LuaRocks version, for installation issues (run `luarocks --version`):
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "kayx23 (via GitHub)" <gi...@apache.org>.
kayx23 commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3166647210

   @nic-6443 please help confirm if this effort will be continued? https://github.com/apache/apisix/pull/12042


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "leekari5548 (via GitHub)" <gi...@apache.org>.
leekari5548 commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3158516910

   APISIX Image: `apache/apisix:3.13.0-debian`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "kayx23 (via GitHub)" <gi...@apache.org>.
kayx23 commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3166641975

   It seems that these variables are not yet supported in APISIX. We will confirm soon if these variables will be added or the example should be removed from the docs. Thanks for reporting.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "SkyeYoung (via GitHub)" <gi...@apache.org>.
SkyeYoung commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3177406720

   Hello, this feature is not yet ready. The corresponding documentation has been removed. You can test again after the feature is completed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "SkyeYoung (via GitHub)" <gi...@apache.org>.
SkyeYoung commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3159040075

   I used the same apisix image as you and tried it out, and it did indeed reproduce the issue.
   
   <img width="605" height="355" alt="Image" src="https://github.com/user-attachments/assets/5d190fe5-e805-40f1-9161-63960005c586" />
   
   It seems there are some discrepancies between the documentation and the functionality.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "SkyeYoung (via GitHub)" <gi...@apache.org>.
SkyeYoung closed issue #12492: The "Include LLM Information in Access Log" feature doesn't seem to be working.
URL: https://github.com/apache/apisix/issues/12492


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "SkyeYoung (via GitHub)" <gi...@apache.org>.
SkyeYoung commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3166358305

   @Baoyuantop Yes, I checked. In fact, the configuration the user pointed out is exactly the one in the APISIX documentation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "leekari5548 (via GitHub)" <gi...@apache.org>.
leekari5548 commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3158479258

   Using the following configuration:
   ```yml
   nginx_config:
     http:
       access_log_format: "$remote_addr - $remote_user [$time_local] $http_host \"$request_line\" $status $body_bytes_sent $request_time \"$http_referer\" \"$http_user_agent\" $upstream_addr $upstream_status $upstream_response_time \"$upstream_scheme://$upstream_host$upstream_uri\" \"$apisix_request_id\" \"$request_type\" \"$llm_time_to_first_token\" \"$llm_model\" \"$llm_prompt_tokens\" \"$llm_completion_tokens\""
   ```
   The APISIX-3.13.0 Docker image fails to start, with the error content shown in the image:
   
   <img width="667" height="507" alt="Image" src="https://github.com/user-attachments/assets/9eb9f0a9-ecc8-4602-8f86-82108f122089" />
   
   After commenting out access_log_format, logs are collected using the clickhouse-logger with the following configuration:
   ```json
   {
     "database": "default",
     "endpoint_addrs": [
       "http://host.docker.internal:8123/"
     ],
     "format": {
       "args": "$args",
       "body_bytes_sent": "$body_bytes_sent",
       "bytes_sent": "$bytes_sent",
       "connection": "$connection",
       "connection_requests": "$connection_requests",
       "content_length": "$content_length",
       "content_type": "$content_type",
       "hostname": "$hostname",
       "http_authorization": "$http_authorization",
       "http_referer": "$http_referer",
       "http_user_agent": "$http_user_agent",
       "http_x_forwarded_for": "$http_x_forwarded_for",
       "http_x_real_ip": "$http_x_real_ip",
       "llm_completion_tokens": "$llm_completion_tokens",
       "llm_model": "$llm_model",
       "llm_prompt_tokens": "$llm_prompt_tokens",
       "llm_time_to_first_token": "$llm_time_to_first_token",
       "pid": "$pid",
       "proxy_protocol_addr": "$proxy_protocol_addr",
       "proxy_protocol_port": "$proxy_protocol_port",
       "remote_addr": "$remote_addr",
       "remote_port": "$remote_port",
       "remote_user": "$remote_user",
       "request_body": "$request_body",
       "request_id": "$request_id",
       "request_length": "$request_length",
       "request_method": "$request_method",
       "request_time": "$request_time",
       "request_uri": "$request_uri",
       "sent_http_content_length": "$sent_http_content_length",
       "sent_http_content_type": "$sent_http_content_type",
       "sent_http_location": "$sent_http_location",
       "sent_http_server": "$sent_http_server",
       "server_protocol": "$server_protocol",
       "status": "$status",
       "time_iso8601": "$time_iso8601"
     },
     "logtable": "apisix_logs",
     "password": "123456",
     "user": "default"
   }
   ```
   There is no LLM-related data in ClickHouse.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "SkyeYoung (via GitHub)" <gi...@apache.org>.
SkyeYoung commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3157782448

   Hello, may I ask if you can provide the minimum environment and steps to reproduce?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "Baoyuantop (via GitHub)" <gi...@apache.org>.
Baoyuantop commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3166335746

   @SkyeYoung, have you confirmed that document https://apisix.apache.org/docs/apisix/plugins/ai-proxy/ doesn't actually work?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] The "Include LLM Information in Access Log" feature doesn't seem to be working. [apisix]

Posted by "Baoyuantop (via GitHub)" <gi...@apache.org>.
Baoyuantop commented on issue #12492:
URL: https://github.com/apache/apisix/issues/12492#issuecomment-3166361861

   @kayx23 Please help check this document.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@apisix.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org