[jira] [Created] (ARROW-17318) [C++][Dataset] Support async streaming interface for getting fragments in Dataset

["Pavel Solodovnikov (Jira)" <ji...@apache.org>]

Pavel Solodovnikov created ARROW-17318:
------------------------------------------

             Summary: [C++][Dataset] Support async streaming interface for getting fragments in Dataset
                 Key: ARROW-17318
                 URL: https://issues.apache.org/jira/browse/ARROW-17318
             Project: Apache Arrow
          Issue Type: Sub-task
            Reporter: Pavel Solodovnikov
            Assignee: Pavel Solodovnikov


Add `GetFragmentsAsync()` and `GetFragmentsAsyncImpl()` functions to the generic `Dataset` interface, which allows to produce fragments in a streamed fashion.

This is one of the prerequisites for making `FileSystemDataset` to support lazy fragment processing, which, in turn, can be used to start scan operations without waiting for the entire dataset to be discovered.

To aid the transition process of moving to async implementation in `Dataset`/`AsyncScanner` code, a default implementation for `GetFragmentsAsyncImpl()` should be provided (yielding a VectorGenerator over the fragments vector, which is stored by every implementation of Dataset interface at the moment).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)