You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Ufuk Celebi (JIRA)" <ji...@apache.org> on 2016/02/22 14:26:18 UTC

[jira] [Created] (FLINK-3462) Add position and magic number checks to record (de)serializers

Ufuk Celebi created FLINK-3462:
----------------------------------

             Summary: Add position and magic number checks to record (de)serializers
                 Key: FLINK-3462
                 URL: https://issues.apache.org/jira/browse/FLINK-3462
             Project: Flink
          Issue Type: Improvement
            Reporter: Ufuk Celebi


In order to improve the debugging experience in case of serialization errors, we can add further sanity checks to the deserializers:

- Check expected position in buffer in order to ensure that record boundaries are not crossed within a buffer or bytes left unconsumed.
- Add magic number to record serializer and deserializer in order to check byte corruption. We currently only have this on a per buffer level.

We will be able to use these checks to improve the error messages.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)