You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/05/16 06:37:52 UTC

[GitHub] [arrow-datafusion] jorgecarleitao commented on pull request #68: Experimenting with arrow2

jorgecarleitao commented on pull request #68:
URL: https://github.com/apache/arrow-datafusion/pull/68#issuecomment-841776668


   An update on this: most functionality has now been migrated. So far this results in a +1k -1.8k change.
   
   There are some things missing:
   
   * the `ScalarValue`, which imo currently has some hacks around it that we need to handle
   * `prettyprint`, which is not in arrow2 yet.
   * parquet and CSV read and write, as arrow2's has a different API to enable parallelism (e.g. see [the guide](https://jorgecarleitao.github.io/arrow2/io/parquet_read.html#parallelism-decoupling-of-cpu-from-io))
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org