[I] [Go][Parquet] Inconsistency in RowGroup 'total byte size' field values between implementations [arrow]

["abbit (via GitHub)" <gi...@apache.org>]

abbit opened a new issue, #44205:
URL: https://github.com/apache/arrow/issues/44205

   ### Describe the usage question you have. Please include as many useful details as  possible.
   
   
   `parquet.thrift` in parquet-format  repo describes `RowGroup` `total_byte_size` field meaning [as](https://github.com/apache/parquet-format/blob/737ea12e56357e83b14fd3e27ef274145beed399/src/main/thrift/parquet.thrift#L920C7-L920C76)
   > Total byte size of all the uncompressed column data in this row group
   
   This is also the case for C++ implementation of parquet in this repo.
   
   But in case of Go implementation `total_byte_size` is described [as](https://github.com/apache/arrow/blob/dca9f58effd8d8b45cef2d648cddeb6a75c155e2/go/parquet/metadata/row_group.go#L62C4-L62C60)
   > TotalByteSize is the total size of this rowgroup on disk
   
   The difference between these values can be large, when compression is applied to column chunks.
   
   My question is: Is that intentional inconsistency with format definition and other implementations? And if so, why does this distinction has been made?
   
   ### Component(s)
   
   Go, Parquet


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Go][Parquet] Inconsistency in RowGroup 'total byte size' field values between implementations [arrow]

["abbit (via GitHub)" <gi...@apache.org>]

abbit closed issue #44205: [Go][Parquet] Inconsistency in RowGroup 'total byte size' field values between implementations
URL: https://github.com/apache/arrow/issues/44205


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org