[GitHub] [airflow] notatallshaw-work commented on issue #26531: Add FTPOperator and FTPSOperator

[GitBox <gi...@apache.org>]

notatallshaw-work commented on issue #26531:
URL: https://github.com/apache/airflow/issues/26531#issuecomment-1252791074

   FYI at a previous company I implemented such operators and at a bare minimum I found it important to at least check the size of the file transferred was the same as the remote server reported: https://docs.python.org/3/library/ftplib.html#ftplib.FTP.size. In my experience FTP was more susceptible to things going wrong midtransfer.
   
   I also implemented other integrity checks such as seeing if the server supported HASH algorithms, but I found that supporting such features like that required a bit of battle testing against many different types of FTP servers as you could get very unexpected results (such as saying they supported it but only ever returning 0, or providing the result with an additional prefix or postfix string).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org