[jira] [Created] (ARROW-8283) [C++/Python][Dataset] Non-existent files are silently dropped in pa.dataset.FileSystemDataset

["Uwe Korn (Jira)" <ji...@apache.org>]

Uwe Korn created ARROW-8283:
-------------------------------

             Summary: [C++/Python][Dataset] Non-existent files are silently dropped in pa.dataset.FileSystemDataset
                 Key: ARROW-8283
                 URL: https://issues.apache.org/jira/browse/ARROW-8283
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++ - Dataset, Python
            Reporter: Uwe Korn


When passing a list of files to the constructor of {{pyarrow.dataset.FileSystemData}}, all files that don't exist are silently dropped immediately (i.e. no fragments are created for them).

Instead, I would expect that fragments will be created for them but an error is thrown when one tries to read the fragment with the non-existent file.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)