[jira] [Commented] (AIRFLOW-3317) FTP Sensor fails immediately when file doesn't exist

["jack (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16731302#comment-16731302 ] 

jack commented on AIRFLOW-3317:
-------------------------------

[~rolando.tribo]

Please post your Sensor code.

You probably have {color:#032f62}fail_on_transient_errors{color}=True when it should be False.

https://github.com/apache/incubator-airflow/blob/master/airflow/contrib/sensors/ftp_sensor.py#L52

> FTP Sensor fails immediately when file doesn't exist
> ----------------------------------------------------
>
>                 Key: AIRFLOW-3317
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3317
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: contrib
>    Affects Versions: 1.10.0
>            Reporter: Rolando Bernabe Tribo
>            Priority: Major
>
> FTP Sensor outright fails when file does not exist in the FTP server.
> {code:java}
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.6/site-packages/airflow/models.py", line 1633, in _run_raw_task
>     result = task_copy.execute(context=context)
>   File "/usr/local/lib/python3.6/site-packages/airflow/sensors/base_sensor_operator.py", line 68, in execute
>     while not self.poke(context):
>   File "/usr/local/lib/python3.6/site-packages/airflow/contrib/sensors/ftp_sensor.py", line 56, in poke
>     raise e
>   File "/usr/local/lib/python3.6/site-packages/airflow/contrib/sensors/ftp_sensor.py", line 52, in poke
>     hook.get_mod_time(self.path)
>   File "/usr/local/lib/python3.6/site-packages/airflow/contrib/hooks/ftp_hook.py", line 234, in get_mod_time
>     ftp_mdtm = conn.sendcmd('MDTM ' + path)
>   File "/usr/local/lib/python3.6/ftplib.py", line 273, in sendcmd
>     return self.getresp()
>   File "/usr/local/lib/python3.6/ftplib.py", line 246, in getresp
>     raise error_perm(resp)
> ftplib.error_perm: 550 The system cannot find the file specified. 
> [2018-11-08 21:34:45,123] {{models.py:1756}} INFO - Marking task as UP_FOR_RETRY{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)