You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/06/22 12:27:33 UTC
[GitHub] [airflow] raphaelauv opened a new issue, #24602: LocalExecutor run Async operators without a trigger process
raphaelauv opened a new issue, #24602:
URL: https://github.com/apache/airflow/issues/24602
### Description
Currently the LocalExecutor can't run Async operators it need a triggerer process
### Use case/motivation
LocalExecutor "should" be a fully airflow working process without needing another process to run tasks
It would keep airflow simpler for entry users and small deployments
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #24602: LocalExecutor run Async operators without a triggerer process
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #24602:
URL: https://github.com/apache/airflow/issues/24602#issuecomment-1163046519
What do you think about `airflow standalone`command? Is it meer your requirements?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #24602: LocalExecutor run Async operators without a triggerer process
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #24602:
URL: https://github.com/apache/airflow/issues/24602#issuecomment-1163173264
I think it's wrong. We should instead make standalone a fully-production ready solution. Merging Triggerer into Scheduler is a bad idea.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #24602: LocalExecutor run Async operators without a triggerer process
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #24602: LocalExecutor run Async operators without a triggerer process
URL: https://github.com/apache/airflow/issues/24602
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv commented on issue #24602: LocalExecutor run Async operators without a triggerer process
Posted by GitBox <gi...@apache.org>.
raphaelauv commented on issue #24602:
URL: https://github.com/apache/airflow/issues/24602#issuecomment-1163054659
`airflow standalone` is more for starting a local airflow , nothing close to a production setup.
`LocalExecutor` is perfectly prod ready and enough for anyone only running operators triggering operations in external solutions and not having needs for elastic scaling ( because not big amount of tasks )
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] uranusjr commented on issue #24602: LocalExecutor run Async operators without a triggerer process
Posted by GitBox <gi...@apache.org>.
uranusjr commented on issue #24602:
URL: https://github.com/apache/airflow/issues/24602#issuecomment-1163039224
This sounds nice, but quite impossible unless we either put the triggerer loop in a thread/subprocess (not easy), or rewrite the entire executor in async (much harder). It’d be a cool project to work on though.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org