You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Joe McDonnell (JIRA)" <ji...@apache.org> on 2018/02/20 17:50:00 UTC

[jira] [Created] (IMPALA-6543) Limit RowBatch serialization size to INT_MAX

Joe McDonnell created IMPALA-6543:
-------------------------------------

             Summary: Limit RowBatch serialization size to INT_MAX
                 Key: IMPALA-6543
                 URL: https://issues.apache.org/jira/browse/IMPALA-6543
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
    Affects Versions: Impala 2.11.0, Impala 2.12.0
            Reporter: Joe McDonnell
            Assignee: Joe McDonnell


A RowBatch does not support serializing an uncompressed size of greater than INT_MAX. The serialization format relies on tuple offsets of type of int32, so they cannot address greater than INT_MAX.

On debug builds, a DCHECK in SerializeInternal() fires when the size exceeds INT_MAX. On release builds, LZ4's limitation of INT_MAX on the size of uncompressed size avoids any issue. The serialization codepath should protect itself and avoid this issue on debug builds.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)