You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@parquet.apache.org by "felipepessoto (via GitHub)" <gi...@apache.org> on 2024/12/17 23:05:30 UTC
[I] How to disable statistics in version 1.13.1? [parquet-java]
felipepessoto opened a new issue, #3103:
URL: https://github.com/apache/parquet-java/issues/3103
### Describe the usage question you have. Please include as many useful details as possible.
I found these two PRs to disable statistics, but they are available only in 1.15+
https://github.com/apache/parquet-java/pull/2989
https://github.com/apache/parquet-java/pull/3056
Is there any other way to disable statistics in 1.13.1?
### Component(s)
Core
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] How to disable statistics in version 1.13.1? [parquet-java]
Posted by "felipepessoto (via GitHub)" <gi...@apache.org>.
felipepessoto closed issue #3103: How to disable statistics in version 1.13.1?
URL: https://github.com/apache/parquet-java/issues/3103
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] How to disable statistics in version 1.13.1? [parquet-java]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #3103:
URL: https://github.com/apache/parquet-java/issues/3103#issuecomment-2550078380
Thanks for reporting this! You're right, those mentioned commits are not ported to legacy branches. Could you use the version 1.15.0?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] How to disable statistics in version 1.13.1? [parquet-java]
Posted by "felipepessoto (via GitHub)" <gi...@apache.org>.
felipepessoto commented on issue #3103:
URL: https://github.com/apache/parquet-java/issues/3103#issuecomment-2550418532
I can't because I'm using Spark 3.5.
I was wondering if possible to somehow disable stats in 1.13.1, even if it is more complex than just setting a flag.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] How to disable statistics in version 1.13.1? [parquet-java]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #3103:
URL: https://github.com/apache/parquet-java/issues/3103#issuecomment-2550442105
I agree with you that it seems impossible to disable stats in the past. Therefore I made those PRs to fix them. Perhaps you may want to set `parquet.statistics.truncate.length` and `parquet.columnindex.truncate.length` to 0 to disable stats of `BYTE_ARRAY` type.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] How to disable statistics in version 1.13.1? [parquet-java]
Posted by "felipepessoto (via GitHub)" <gi...@apache.org>.
felipepessoto commented on issue #3103:
URL: https://github.com/apache/parquet-java/issues/3103#issuecomment-2557895492
Thanks. I've set `parquet.statistics.truncate.length` to 1. The `parquet.columnindex.truncate.length` I wasn't sure how it works but using the `parquet.statistics.truncate.length` also worked for byte array
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org