You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/04/15 18:22:00 UTC
[jira] [Commented] (AIRFLOW-6245) Allow custom waiters for AWS
batch jobs
[ https://issues.apache.org/jira/browse/AIRFLOW-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322389#comment-17322389 ]
ASF GitHub Bot commented on AIRFLOW-6245:
-----------------------------------------
dazza-codes commented on pull request #6811:
URL: https://github.com/apache/airflow/pull/6811#issuecomment-820637051
In https://issues.apache.org/jira/browse/AIRFLOW-6245 - this work is attached to a 2.0.0 release. How can we request that this is included in the next 1.x release?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> Allow custom waiters for AWS batch jobs
> ---------------------------------------
>
> Key: AIRFLOW-6245
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6245
> Project: Apache Airflow
> Issue Type: Improvement
> Components: aws
> Affects Versions: 1.10.6
> Reporter: Darren Weber
> Assignee: Darren Weber
> Priority: Minor
> Labels: AWS, aws-batch
> Fix For: 2.0.0
>
>
> The botocore waiter for AWS batch jobs has not been merged and released for several years, i.e.
> - [https://github.com/boto/botocore/pull/1307]
> While working on this Airflow issue, I've also pushed up a PR on botocore to use a default waiter with exponential backoff and add an option to use a custom function for the delays between polling status, see
> - [https://github.com/boto/botocore/issues/1915]
> - [https://github.com/boto/botocore/pull/1921]
>
> For Airflow, adopt something from botocore PR-1307 as an example to create a default batch job waiter in Airflow. As a guide to creating a custom waiter, see
> - [https://www.2ndwatch.com/blog/use-waiters-boto3-write/]
> - [https://boto3.amazonaws.com/v1/documentation/api/latest/guide/clients.html#waiters]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)