You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ramki Balakrishnan (Jira)" <ji...@apache.org> on 2021/01/18 15:45:00 UTC
[jira] [Commented] (AIRFLOW-4085) Support wildcards in FileSensor
[ https://issues.apache.org/jira/browse/AIRFLOW-4085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267376#comment-17267376 ]
Ramki Balakrishnan commented on AIRFLOW-4085:
---------------------------------------------
But the FileSensor is looking for the file "my_data_2019-03-01*.csv", even though the file my_data_2019-03-01T13_45_03.csv is available. can you please check ?
> Support wildcards in FileSensor
> -------------------------------
>
> Key: AIRFLOW-4085
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4085
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib
> Reporter: Matthew Livesey
> Priority: Minor
> Fix For: 2.0.0
>
>
> When using FileSensor, it is necessary to specify the exact path of the file or folder to be sensed.
> There are use cases where the exact file name may not be known. For example if a file is delivered daily, but includes the full timestamp of file creation in the name, such as
> {code:java}
> my_data_2019-03-01T13_45_03.csv
> {code}
> I would like the FileSensor to sense with a file path such as
> {code:java}
> my_data_2019-03-01*.csv{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)