You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Randall Hauch (JIRA)" <ji...@apache.org> on 2018/02/02 17:21:00 UTC
[jira] [Created] (KAFKA-6525) Connect should allow pluggable
encryption for records
Randall Hauch created KAFKA-6525:
------------------------------------
Summary: Connect should allow pluggable encryption for records
Key: KAFKA-6525
URL: https://issues.apache.org/jira/browse/KAFKA-6525
Project: Kafka
Issue Type: New Feature
Components: KafkaConnect
Reporter: Randall Hauch
The Connect framework does not easily support pluggable encryption and decryption mechanisms. It is possible to use custom Converters to encrypt/decrypt individual keys and values when the encryption metadata (keys, algorithm, etc.) can be specified in the Converter. or when the key and/or value are _wrapped_ to include the metadata.
However, if the encryption metadata is to be stored as headers, then as of AK 1.1 Connect does have support for using headers in connectors and SMTs, but not Converters.
We should make it easier to plug encryption and decryption mechanisms into Connect. Since we're moving to Java 8, one approach might be to change the Converter interface to add a default methods that also supply the headers (and maybe the whole record).
An alternative is to define a new plugin interface that can be used to filter/transform/map the entire source and sink records. Here's we'd actually call this for source connectors before the Converter, and for sink connectors after the Converter is called.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)