You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "potiuk (via GitHub)" <gi...@apache.org> on 2023/02/19 15:13:44 UTC
[GitHub] [airflow] potiuk commented on pull request #29156: Add to provider.FTP possibility to use file-like objects.
potiuk commented on PR #29156:
URL: https://github.com/apache/airflow/pull/29156#issuecomment-1436014426
I agree with @Taragolis - that passing file-like objects in FileTransferOperator is not going to work. Each operator when executing will run in its own process/interpreter and there is simply no way to pass the file-like object to it.
Closing, unless there will be some explanation - maybe we are wrong and there is something we both completely miss. @Draqun - if you can explain it, please do.
The way how you should do what you want is different - you could implement File-lilke objects in Hooks and then use TaskFlow approach as desrribed in my blog post here: https://medium.com/apache-airflow/generic-airflow-transfers-made-easy-5fe8e5e7d2c2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org