You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/05/17 23:33:58 UTC

[GitHub] [arrow] westonpace commented on a change in pull request #10118: ARROW-12468: [Python][R] Expose ScannerBuilder::UseAsync to Python & R

westonpace commented on a change in pull request #10118:
URL: https://github.com/apache/arrow/pull/10118#discussion_r633931273



##########
File path: python/pyarrow/_dataset.pyx
##########
@@ -2746,6 +2746,10 @@ cdef class Scanner(_Weakrefable):
     use_threads : bool, default True
         If enabled, then maximum parallelism will be used determined by
         the number of available CPU cores.
+    use_async : bool, default False
+        If enabled, the an async scanner will be used that should offer
+        better performance with high-latency/highly-parallel filesystems
+        (e.g. S3)

Review comment:
       > Though, we could pack all the non-C(++) arguments into a single kwargs.
   
   I don't know what you mean by this.  Do you mean taking all these arguments and putting them into some kind of `ScanOptions` class?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org