You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2023/01/06 13:19:24 UTC
[GitHub] [arrow-rs] crepererum opened a new issue, #3476: CLI to "rewrite" parquet files
crepererum opened a new issue, #3476:
URL: https://github.com/apache/arrow-rs/issues/3476
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Sometimes I wonder what different settings (compression, row group size, page size, ...) do to a parquet file (in terms of size, number of row groups / pages, performance).
**Describe the solution you'd like**
Have a CLI that takes a parquet file and writes it again w/ different settings. The resulting file can then be inspected by our other CLI tools like [`parquet-layout`](https://github.com/apache/arrow-rs/blob/master/parquet/src/bin/parquet-layout.rs).
**Describe alternatives you've considered**
Always require user code to perform these kind of experiments.
**Additional context**
\-
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #3476: CLI to "rewrite" parquet files
Posted by GitBox <gi...@apache.org>.
tustvold closed issue #3476: CLI to "rewrite" parquet files
URL: https://github.com/apache/arrow-rs/issues/3476
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #3476: CLI to "rewrite" parquet files
Posted by GitBox <gi...@apache.org>.
tustvold commented on issue #3476:
URL: https://github.com/apache/arrow-rs/issues/3476#issuecomment-1381538955
`label_issue.py` automatically added labels {'parquet'} from #3477
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] crepererum commented on issue #3476: CLI to "rewrite" parquet files
Posted by GitBox <gi...@apache.org>.
crepererum commented on issue #3476:
URL: https://github.com/apache/arrow-rs/issues/3476#issuecomment-1373617844
I'm working on this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org