You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ramki Balakrishnan (Jira)" <ji...@apache.org> on 2021/01/18 15:45:00 UTC

[jira] [Commented] (AIRFLOW-4085) Support wildcards in FileSensor

    [ https://issues.apache.org/jira/browse/AIRFLOW-4085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267376#comment-17267376 ] 

Ramki Balakrishnan commented on AIRFLOW-4085:
---------------------------------------------

But the FileSensor is looking for the file "my_data_2019-03-01*.csv", even though the file my_data_2019-03-01T13_45_03.csv is available. can you please check ? 

> Support wildcards in FileSensor
> -------------------------------
>
>                 Key: AIRFLOW-4085
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4085
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib
>            Reporter: Matthew Livesey
>            Priority: Minor
>             Fix For: 2.0.0
>
>
> When using FileSensor, it is necessary to specify the exact path of the file or folder to be sensed.
> There are use cases where the exact file name may not be known. For example if a file is delivered daily, but includes the full timestamp of file creation in the name, such as
> {code:java}
> my_data_2019-03-01T13_45_03.csv
> {code}
> I would like the FileSensor to sense with a file path such as
> {code:java}
> my_data_2019-03-01*.csv{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)