You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Chris Riccomini (JIRA)" <ji...@apache.org> on 2014/07/02 22:50:26 UTC

[jira] [Commented] (SAMZA-59) Support dropping messages on serde failures

    [ https://issues.apache.org/jira/browse/SAMZA-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050697#comment-14050697 ] 

Chris Riccomini commented on SAMZA-59:
--------------------------------------

Posted feedback on the RB.

Could we make the change in SystemProduers, as well, for the producer side? (serdeManager.toBytes(envelope))

> Support dropping messages on serde failures
> -------------------------------------------
>
>                 Key: SAMZA-59
>                 URL: https://issues.apache.org/jira/browse/SAMZA-59
>             Project: Samza
>          Issue Type: Bug
>          Components: container
>            Reporter: Chris Riccomini
>            Assignee: Yan Fang
>         Attachments: SAMZA-59.patch
>
>
> Samza uses the Serde interface to serialize and deserialize messages when producing and sending them.
> Right now, if a Serde is unable to (de)serialize a message, it has no choice but to throw an exception, or put some non-standard surrogate object in the message envelope's key/value fields. If an exception is throws, the whole container fails.
> We should make it possible for Serdes to signal to Samza that they were unable to (de)serialize the message in question, and add configuration to Samza to be able to drop these messages rather than throwing an exception.



--
This message was sent by Atlassian JIRA
(v6.2#6252)