You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "jun wang (Jira)" <ji...@apache.org> on 2022/11/11 04:07:00 UTC

[jira] [Created] (ARROW-18309) [Go] delta_bit_packing Decode may panic

jun wang created ARROW-18309:
--------------------------------

             Summary: [Go] delta_bit_packing Decode may panic
                 Key: ARROW-18309
                 URL: https://issues.apache.org/jira/browse/ARROW-18309
             Project: Apache Arrow
          Issue Type: Bug
          Components: Go
    Affects Versions: 9.0.0
         Environment: all release version
            Reporter: jun wang
             Fix For: 9.0.1
         Attachments: @timestamp.data

[https://github.com/apache/arrow/blob/master/go/parquet/internal/encoding/delta_bit_packing.go]

The  DeltaBitPackInt32 and DeltaBitPackInt64 Decode method did not use d.nvals subtract decoded number at end, which lead streaming decode panic. 

Also, when copy the decoded value to out, the end value should be 
shared_utils.MinInt(int(d.valsPerMini), start + len(out))

When encode 68610 timestamp data, and decode 1024 value a batch, we encounter the panic



--
This message was sent by Atlassian Jira
(v8.20.10#820010)