You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/12/21 16:17:11 UTC
[GitHub] [arrow] andygrove opened a new pull request #8980: ARROW-10999: Use signed ints for TPC-H schema
andygrove opened a new pull request #8980:
URL: https://github.com/apache/arrow/pull/8980
The TPC-H parquet files generated by the benchmark crate could not be read by Apache Spark because they used unsigned ints, which Spark does not support (JVM only has signed ints).
I would like to use the same data sets for benchmarking DataFusion, Apache Spark, and other tools, so have changed the schema to use signed ints.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] andygrove commented on pull request #8980: ARROW-10999: [Rust] [Benchmarks] Use signed ints for TPC-H schema
Posted by GitBox <gi...@apache.org>.
andygrove commented on pull request #8980:
URL: https://github.com/apache/arrow/pull/8980#issuecomment-749076478
@seddonm1 fyi
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #8980: ARROW-10999: [Rust] [Benchmarks] Use signed ints for TPC-H schema
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #8980:
URL: https://github.com/apache/arrow/pull/8980#issuecomment-749069735
https://issues.apache.org/jira/browse/ARROW-10999
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao closed pull request #8980: ARROW-10999: [Rust] [Benchmarks] Use signed ints for TPC-H schema
Posted by GitBox <gi...@apache.org>.
jorgecarleitao closed pull request #8980:
URL: https://github.com/apache/arrow/pull/8980
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] seddonm1 commented on pull request #8980: ARROW-10999: [Rust] [Benchmarks] Use signed ints for TPC-H schema
Posted by GitBox <gi...@apache.org>.
seddonm1 commented on pull request #8980:
URL: https://github.com/apache/arrow/pull/8980#issuecomment-749152922
Makes total sense and not sure how I missed it.
I was hoping we would be able to wait for Decimal type to be fully implemented before doing the result testing (comparison against TPC-H known output) but if that is too far away I can implement with the current Float64 precision (and it's many decimal places)?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] Dandandan commented on pull request #8980: ARROW-10999: [Rust] [Benchmarks] Use signed ints for TPC-H schema
Posted by GitBox <gi...@apache.org>.
Dandandan commented on pull request #8980:
URL: https://github.com/apache/arrow/pull/8980#issuecomment-749083780
Curious for the benchmark results too!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org