You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "anirudhsr (via GitHub)" <gi...@apache.org> on 2023/05/18 21:09:01 UTC

[GitHub] [arrow] anirudhsr commented on issue #35678: [Python][Parquet][PyArrow] Cannot save footer files outside the parquet file

anirudhsr commented on issue #35678:
URL: https://github.com/apache/arrow/issues/35678#issuecomment-1553648482

   I tried inspecting the columnChunkMetadata as per the Parquet Thrift documentation: https://github.com/apache/parquet-format/blob/master/Encryption.md#43-key-metadata
   
   and I do not see the keyValueMetadata value:
   ```
   <pyarrow._parquet.ColumnChunkMetaData object at 0x1122fbe20>
     file_offset: 114
     file_path: 
     physical_type: INT64
     num_values: 3
     path_in_schema: a
     is_stats_set: True
     statistics:
       <pyarrow._parquet.Statistics object at 0x112314040>
         has_min_max: True
         min: 1
         max: 3
         null_count: 0
         distinct_count: 0
         num_values: 3
         physical_type: INT64
         logical_type: None
         converted_type (legacy): NONE
     compression: SNAPPY
     encodings: ('RLE_DICTIONARY', 'PLAIN', 'RLE')
     has_dictionary_page: True
     dictionary_page_offset: 4
     data_page_offset: 41
     total_compressed_size: 110
     total_uncompressed_size: 109
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org