You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Daniel Halperin (JIRA)" <ji...@apache.org> on 2016/04/25 17:01:12 UTC

[jira] [Created] (BEAM-223) KafkaIO: don't use SerializableCoder

Daniel Halperin created BEAM-223:
------------------------------------

             Summary: KafkaIO: don't use SerializableCoder
                 Key: BEAM-223
                 URL: https://issues.apache.org/jira/browse/BEAM-223
             Project: Beam
          Issue Type: Bug
          Components: sdk-java-extensions
            Reporter: Daniel Halperin
            Assignee: Raghu Angadi


Reuven says:

{quote}
I noticed that we're using SerializableCoder for the checkpoint mark in KafkaIO. This is generally highly discouraged in streaming pipelines. Partially because it's inefficient, but more importantly because Java serialization is not guaranteed to be stable. If a user updates their pipeline, the new pipeline may not be able to decode the existing checkpoint marks; this will either cause exceptions to be thrown, or data loss.
{quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)