[jira] [Updated] (SOLR-18062) CrossDC - support arbitrary Kafka properties

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SOLR-18062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SOLR-18062:
----------------------------------
    Labels: pull-request-available  (was: )

> CrossDC - support arbitrary Kafka properties
> --------------------------------------------
>
>                 Key: SOLR-18062
>                 URL: https://issues.apache.org/jira/browse/SOLR-18062
>             Project: Solr
>          Issue Type: Improvement
>          Components: module - crossDC
>    Affects Versions: 10.0
>            Reporter: Andrzej Bialecki
>            Assignee: Andrzej Bialecki
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Currently a strictly controlled subset of Kafka properties is supported in CrossDC Producer and Consumer. However, this limits the possibility of adding other Kafka properties related to performance tuning, connectivity etc. There are literally hundreds of these properties, some varying between Kafka versions.
> This ticket will add a generic mechanism to pass-through arbitrary Kafka properties. The proposed mechanism is the following:
>  * environment variables starting with {{KAFKA_}} will be stripped of the prefix, lowercased and replace underscores with dots.
>  * system properties starting with {{kafka.}} will be stripped of the prefix.
> Properties collected this way from env vars and sys props will be added to {{KafkaCrossDcConf}} and returned in {{KafkaCrossDcConf.getAdditionalProperties()}} which is used during configuration of Kafka consumers and producers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org