You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by p_...@yahoo.com.INVALID on 2022/04/14 05:20:35 UTC

Writing min/max for rowgroup to Parquet

HI All,
I am writing parquet files but when I read metadata using parquet-tools I don’t see any min/max for any type of variables.
Is there any specific configuration that needs to be turned on for the same.
Regards,
Piyush

Re: Writing min/max for rowgroup to Parquet

Posted by "Miller, Tim" <th...@amazon.com.INVALID>.

Can you provide more information about how you're writing the files?

Also, does this help?
https://stackoverflow.com/questions/41700231/spark-parquet-statisticsmin-max-integration

On 4/14/22, 8:42 PM, "p_agarwal@yahoo.com.INVALID" <p_...@yahoo.com.INVALID> wrote:

    CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.



    HI All,
    I am writing parquet files but when I read metadata using parquet-tools I don’t see any min/max for any type of variables.
    Is there any specific configuration that needs to be turned on for the same.
    Regards,
    Piyush