You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jorge Esteban Quilcate Otoya (Jira)" <ji...@apache.org> on 2023/07/03 12:14:00 UTC

[jira] [Created] (KAFKA-15142) Add Client Metadata to RemoteStorageFetchInfo

Jorge Esteban Quilcate Otoya created KAFKA-15142:
----------------------------------------------------

             Summary: Add Client Metadata to RemoteStorageFetchInfo
                 Key: KAFKA-15142
                 URL: https://issues.apache.org/jira/browse/KAFKA-15142
             Project: Kafka
          Issue Type: Improvement
          Components: core
            Reporter: Jorge Esteban Quilcate Otoya
            Assignee: Jorge Esteban Quilcate Otoya


Once Tiered Storage is deployed, it will be important to understand how remote data is accessed and what consumption patterns emerge on each deployment.

To do this, tiered storage logs/metrics could provide more context about which client is fetching which partition/offset range and when.

At the moment, Client metadata is not propagated to the tiered-storage framework. To fix this, {{RemoteStorageFetchInfo}} can be extended with {{Optional[ClientMetadata]}} available on {{{}FetchParams{}}}, and have this bits of data available to improve the logging/metrics when fetching.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)