[jira] [Created] (SOLR-18062) CrossDC - support arbitrary Kafka properties

["Andrzej Bialecki (Jira)" <ji...@apache.org>]

Andrzej Bialecki created SOLR-18062:
---------------------------------------

             Summary: CrossDC - support arbitrary Kafka properties
                 Key: SOLR-18062
                 URL: https://issues.apache.org/jira/browse/SOLR-18062
             Project: Solr
          Issue Type: Improvement
          Components: module - crossDC
    Affects Versions: 10.0
            Reporter: Andrzej Bialecki
            Assignee: Andrzej Bialecki


Currently a strictly controlled subset of Kafka properties is supported in CrossDC Producer and Consumer. However, this limits the possibility of adding other Kafka properties related to performance tuning, connectivity etc. There are literally hundreds of these properties, some varying between Kafka versions.

This ticket will add a generic mechanism to pass-through arbitrary Kafka properties. The proposed mechanism is the following:
 * environment variables starting with {{KAFKA_}} will be stripped of the prefix, lowercased and replace underscores with dots.
 * system properties starting with {{kafka.}} will be stripped of the prefix.

Properties collected this way from env vars and sys props will be added to {{KafkaCrossDcConf}} and returned in {{KafkaCrossDcConf.getAdditionalProperties()}} which is used during configuration of Kafka consumers and producers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org