You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Shanthoosh Venkataraman (JIRA)" <ji...@apache.org> on 2019/04/26 02:30:00 UTC

[jira] [Created] (SAMZA-2176) Ignore the configurations with serialized null values from coordinator stream.

Shanthoosh Venkataraman created SAMZA-2176:
----------------------------------------------

             Summary: Ignore the configurations with serialized null values from coordinator stream.
                 Key: SAMZA-2176
                 URL: https://issues.apache.org/jira/browse/SAMZA-2176
             Project: Samza
          Issue Type: Bug
            Reporter: Shanthoosh Venkataraman
            Assignee: Shanthoosh Venkataraman


Samza stores the metadata of the job into a log-compacted kafka topic called coordinator stream.

Due to some operational issue, we converted the serialized null value into bytes and stored them as messages in the coordinator stream. These keys will not be log-compacted by kafka, since they're not actually null messages. 

As a part of JIRA, we propose to ignore these configurations with serialized-null values and hold keys only with non-null values from coordinator-stream in ApplicationMaster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)