You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Todd Farmer (Jira)" <ji...@apache.org> on 2022/07/12 14:05:03 UTC

[jira] [Assigned] (ARROW-8163) [C++][Dataset] Allow FileSystemDataset's file list to be lazy

     [ https://issues.apache.org/jira/browse/ARROW-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Farmer reassigned ARROW-8163:
----------------------------------

    Assignee:     (was: Ben Kietzman)

This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.

> [C++][Dataset] Allow FileSystemDataset's file list to be lazy
> -------------------------------------------------------------
>
>                 Key: ARROW-8163
>                 URL: https://issues.apache.org/jira/browse/ARROW-8163
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>    Affects Versions: 0.16.0
>            Reporter: Ben Kietzman
>            Priority: Major
>              Labels: dataset
>
> A FileSystemDataset currently requires a full listing of files it contains on construction, so a scan cannot start until all files in the dataset are discovered. Instead it would be ideal if a large dataset could be constructed with a lazy file listing so that scans can start immediately.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)