You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "arnabnandy7 (via GitHub)" <gi...@apache.org> on 2026/10/04 12:54:00 UTC
[PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
arnabnandy7 opened a new pull request, #23698:
URL: https://github.com/apache/kafka/pull/23698
KAFKA-21178: This change introduces the dynamically reconfigurable broker configuration `compression.disabled.types`, which allows administrators to reject new client writes that use selected compression types. Supported values are `gzip`, `snappy`, `lz4`, and `zstd`; the default is an empty list to preserve existing behavior.
The restriction applies to both the compression type supplied by the producer and the final compression type selected by the broker through `compression.type`. Validation occurs before record decompression. Replication and reads of existing records remain unaffected, allowing brokers to retain and replicate historical data that uses a disabled compression type.
The configuration is broker-only and cannot be overridden at the topic level. Dynamic updates are propagated to existing logs without requiring a broker restart. Rejected produce requests return `UNSUPPORTED_COMPRESSION_TYPE`.
Documentation for the new configuration and its dynamic update behavior is included.
Testing includes:
- Unit coverage for rejecting each supported producer compression type.
- Unit coverage for rejecting a broker-selected disabled compression type.
- Unit coverage confirming replication accepts disabled compression types.
- Configuration parsing and invalid-value validation.
- Dynamic log-configuration propagation.
- Produce-path integration coverage for dynamic updates in both isolated and combined KRaft clusters.
The targeted storage, configuration, and integration tests pass.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "mimaison (via GitHub)" <gi...@apache.org>.
mimaison commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6018866778
This is adding a new configuration, so it requires a Kafka Improvement Proposal. See https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals for details about the process
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "mimaison (via GitHub)" <gi...@apache.org>.
mimaison commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6060359671
Thanks for opening a KIP.
I moved it under the right page. You need to name it correctly, it should be `KIP-<NUMBER>`, you can find the next available number on https://cwiki.apache.org/confluence/spaces/KAFKA/pages/50859233/Kafka+Improvement+Proposals. Once you pick a number, make sure to update that page and update the next number.
Then follow the other steps from the [Process](https://cwiki.apache.org/confluence/spaces/KAFKA/pages/50859233/Kafka+Improvement+Proposals#KafkaImprovementProposals-Process) section, start DISCUSS thread, etc
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "arnabnandy7 (via GitHub)" <gi...@apache.org>.
arnabnandy7 commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6059462964
> I've approved your account request. It's currently pending creation, that may take a few days.
@mimaison [KIP](https://cwiki.apache.org/confluence/spaces/KAFKA/pages/451979375/Allow+Brokers+to+Disable+Compression+Types+for+Client+Writes) added.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6183646803
A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the `triage` label
should be removed to prevent this automation from happening again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "arnabnandy7 (via GitHub)" <gi...@apache.org>.
arnabnandy7 commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6215150527
@mimaison started discussion at https://lists.apache.org/thread.html/ldh6vovtb7913gn48gsz7kcm0wk32xpv
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "mimaison (via GitHub)" <gi...@apache.org>.
mimaison commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6023081491
I've approved your account request. It's currently pending creation, that may take a few days.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "arnabnandy7 (via GitHub)" <gi...@apache.org>.
arnabnandy7 commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6021840805
> This is adding a new configuration, so it requires a Kafka Improvement Proposal. See https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals for details about the process
@mimaison unfortunately they're not approving my request of creating account in confluence, although I have access to Kafka jira.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "arnabnandy7 (via GitHub)" <gi...@apache.org>.
arnabnandy7 commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6061416736
> Thanks for opening a KIP.
>
> I moved it under the right page. You need to name it correctly, it should be `KIP-<NUMBER>`, you can find the next available number on https://cwiki.apache.org/confluence/spaces/KAFKA/pages/50859233/Kafka+Improvement+Proposals. Once you pick a number, make sure to update that page and update the next number.
>
> Then follow the other steps from the [Process](https://cwiki.apache.org/confluence/spaces/KAFKA/pages/50859233/Kafka+Improvement+Proposals#KafkaImprovementProposals-Process) section, start DISCUSS thread, etc
@mimaison thanks I understood
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-21178: Allow disabling compression types for client writes [kafka]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #23698:
URL: https://github.com/apache/kafka/pull/23698#issuecomment-6331866501
A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the `triage` label
should be removed to prevent this automation from happening again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org