You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "pitrou (via GitHub)" <gi...@apache.org> on 2025/01/11 17:11:22 UTC
[I] [C++][Parquet] Enable size statistics by default [arrow]
pitrou opened a new issue, #45227:
URL: https://github.com/apache/arrow/issues/45227
### Describe the enhancement requested
Now that https://github.com/apache/arrow/pull/45202 , the overhead of computing and writing out the size statistics seems sufficiently negligible that we should probably enable it by default. This may allow performance improvements in readers when they are updated to take advantage of the information.
### Component(s)
C++, Parquet
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #45227:
URL: https://github.com/apache/arrow/issues/45227#issuecomment-2585759831
> What about page index (which not yet enabled by default)?
The benchmark enables it when PageAndColumnChunk is selected, right?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #45227:
URL: https://github.com/apache/arrow/issues/45227#issuecomment-2604165553
Issue resolved by pull request 45249
https://github.com/apache/arrow/pull/45249
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #45227:
URL: https://github.com/apache/arrow/issues/45227#issuecomment-2585345074
@wgtmac @mapleFU
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #45227:
URL: https://github.com/apache/arrow/issues/45227#issuecomment-2585760836
The benchmark enable page index in all cases. Should I change it to add a baseline with page index disabled?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac closed issue #45227: [C++][Parquet] Enable size statistics by default
URL: https://github.com/apache/arrow/issues/45227
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #45227:
URL: https://github.com/apache/arrow/issues/45227#issuecomment-2585761303
> The benchmark enables page index in all cases. Should I change it to add a baseline with page index disabled?
Ah, that could be informative indeed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #45227:
URL: https://github.com/apache/arrow/issues/45227#issuecomment-2585762524
OK, I will add it this week.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++][Parquet] Enable size statistics by default [arrow]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #45227:
URL: https://github.com/apache/arrow/issues/45227#issuecomment-2585753788
What about page index (which not yet enabled by default)? Or do we enable SizeStatisticsLevel::ColumnChunk by default for now?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org