You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/01/02 19:47:07 UTC
[GitHub] [airflow] aelzeiny opened a new pull request #7011: Fargate Executor
aelzeiny opened a new pull request #7011: Fargate Executor
URL: https://github.com/apache/airflow/pull/7011
An AWS Fargate Executor that runs every task on a new Fargate Instance. The instance launches an Airflow Docker Container (i.e: Puckel's Airflow Docker), executes the task generated by the scheduler, then reaches the container reaches a timely demise.
If the exit code of the
- container is anything other than 0 the task fails.
- If the boto3 API calls to Fargate fails 3 times _consecutively_, then the task fails.
- If the executor is unable to call out to the Fargate task (due to internet connectivity issues or incorrect IAM roles) then the task fails.
Otherwise the task succeeds.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [airflow] aelzeiny closed pull request #7011: Fargate Executor
Posted by GitBox <gi...@apache.org>.
aelzeiny closed pull request #7011: Fargate Executor
URL: https://github.com/apache/airflow/pull/7011
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services