You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Nikolay Izhikov (Jira)" <ji...@apache.org> on 2020/11/17 16:14:00 UTC

[jira] [Created] (KAFKA-10732) API to ensure Records policy on the broker

Nikolay Izhikov created KAFKA-10732:
---------------------------------------

             Summary: API to ensure Records policy on the broker
                 Key: KAFKA-10732
                 URL: https://issues.apache.org/jira/browse/KAFKA-10732
             Project: Kafka
          Issue Type: Improvement
            Reporter: Nikolay Izhikov
            Assignee: Nikolay Izhikov


During the adoption of Kafka in large enterprises, it's important to guarantee data in some topic conforms to the specific format.

When data are written and read by the different applications developed by the different teams it's hard to guarantee data format using only custom SerDe, because malicious applications can use different SerDe.

The data format can be enforced only on the broker side.

I propose to introduce the new public interface for it RecordsPolicy:

{noformat}
public interface RecordsPolicy extends Configurable, AutoCloseable {
   void validate(String topic, Records records) throws PolicyViolationException;
}
{noformat}

and a two new configuration options:

* {{records.policy.class.name: String}} - sets class name of the implementation of RecordsPolicy for the specific topic.
* {{records.policy.enabled: Boolean}}  - enable or disable records policy for the topic





--
This message was sent by Atlassian Jira
(v8.3.4#803005)