You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/04/07 18:59:34 UTC

[GitHub] [arrow] lidavidm edited a comment on pull request #9589: ARROW-11797: [C++][Dataset] Provide batch stream Scanner methods

lidavidm edited a comment on pull request #9589:
URL: https://github.com/apache/arrow/pull/9589#issuecomment-815150156


   I've updated this in case we change how to proceed with ARROW-7001:
   - Rebased against master
   - Added Python/R deprecation warnings for Scan(), since either way, we're planning to remove ScanTask in 5.0
   - Changed the iterator so that scan tasks are materialized and executed iteratively, to better handle larger-than-memory datasets
   - Removed `Scan(visitor)` to reduce API surface (we can add it if the need comes up)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org