You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/10/20 13:27:50 UTC
[GitHub] [arrow] pitrou commented on pull request #8494: ARROW-10328: [C++] Vendor fast_float number parsing library
pitrou commented on pull request #8494:
URL: https://github.com/apache/arrow/pull/8494#issuecomment-712849550
Before:
* Parsing raw values:
```
FloatParsing<FloatType> 39763 ns 39758 ns 52350 items_per_second=25.152M/s
FloatParsing<DoubleType> 29812 ns 29808 ns 68765 items_per_second=33.5483M/s
```
* CSV converter performance:
```
FloatConversion 199539 ns 199508 ns 3498 items_per_second=40.0986M/s
```
* Reading a CSV file of floating-point numbers (single-threaded):
```
276 MB (10000000 rows) in 1.543 s. => 179 MB/s.
276 MB (10000000 rows) in 1.481 s. => 186 MB/s.
276 MB (10000000 rows) in 1.492 s. => 185 MB/s.
276 MB (10000000 rows) in 1.469 s. => 188 MB/s.
276 MB (10000000 rows) in 1.471 s. => 188 MB/s.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org