[jira] [Created] (EAGLE-54) Encoding match between Kafka serialization and Eagle deserialization

["Edward Zhang (JIRA)" <ji...@apache.org>]

Edward Zhang created EAGLE-54:
---------------------------------

             Summary: Encoding match between Kafka serialization and Eagle deserialization
                 Key: EAGLE-54
                 URL: https://issues.apache.org/jira/browse/EAGLE-54
             Project: Eagle
          Issue Type: Improvement
            Reporter: Edward Zhang
            Priority: Minor


For various audit logs, Kafka serializes log with String type into bytes, and Eagle deserializes bytes into String. Kafka supports to configure serialization class by specifying kafka.serializer.StringEncoder and encoding type. But Eagle lack the mechanism to deserialize with configuration of encoding, today it does not have issue as it by default uses UTF-8 both. But it is more graceful for Eagle to expose encoding configuration to be aligned with Kafka.

https://github.com/apache/kafka/blob/b62f8ea43b6d5307f7274fbe8b7984dd5ee22239/core/src/main/scala/kafka/serializer/Encoder.scala

https://github.com/apache/incubator-eagle/blob/bf35ede03a55df9c851669e16c59049f696e0b6d/eagle-security/eagle-security-hdfs-auditlog/src/main/java/org/apache/eagle/security/auditlog/HdfsAuditLogKafkaDeserializer.java



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)