[jira] [Commented] (ARROW-6615) [C++] Add filtering option to fs::Selector

["Antoine Pitrou (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-6615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933723#comment-16933723 ] 

Antoine Pitrou commented on ARROW-6615:
---------------------------------------

If the filtering is done on the local end, then it's not very useful to integrate it in selector (all filesystems then have to implement it).

If it helps avoid recursing into uninteresting directories then it can help, but does that happen often?

> [C++] Add filtering option to fs::Selector
> ------------------------------------------
>
>                 Key: ARROW-6615
>                 URL: https://issues.apache.org/jira/browse/ARROW-6615
>             Project: Apache Arrow
>          Issue Type: New Feature
>            Reporter: Francois Saint-Jacques
>            Priority: Major
>
> It would convenient if Selector could support file path filtering, either via a regex or globbing applied to the path.
> This is semi required for filtering file in Dataset to properly apply the file format.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)