You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2021/07/08 04:19:00 UTC
[jira] [Updated] (ARROW-13287) [C++] [Dataset]
FileSystemDataset::Write should use an async scan
[ https://issues.apache.org/jira/browse/ARROW-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weston Pace updated ARROW-13287:
--------------------------------
Fix Version/s: 6.0.0
> [C++] [Dataset] FileSystemDataset::Write should use an async scan
> -----------------------------------------------------------------
>
> Key: ARROW-13287
> URL: https://issues.apache.org/jira/browse/ARROW-13287
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Weston Pace
> Assignee: Weston Pace
> Priority: Major
> Fix For: 6.0.0
>
>
> I was testing pulling a dataset from S3 and saving it to a local (possibly re partitioned) copy. Ideally I would do this with an async scan but it fails with "This scanner does not support the legacy Scan() method" because FileSystemDataset::Write is still using Scan.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)