You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by GitBox <gi...@apache.org> on 2021/03/15 23:59:09 UTC
[GitHub] [systemds] Baunsgaard commented on pull request #1200: [MINOR] CSV parsing optimization byparsing hashfunction
Baunsgaard commented on pull request #1200:
URL: https://github.com/apache/systemds/pull/1200#issuecomment-799840317
Before these changes the parsing of MNIST took ~1.2 sec because of inefficient parsing of strings and NaN special handling.
Unfortunately this PRs implementation is not as fast as SystemML 1.0 which is able to parse MNIST
in 0.8 sec on average (i did verify with repeated executions of various kinds). I did try to use exactly the old code but in our
current system this only perform to 1 sec.
Current:


Old:


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org