You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Saurabh Dhupar (Jira)" <ji...@apache.org> on 2020/02/25 06:36:00 UTC

[jira] [Assigned] (AIRFLOW-5178) AWS Batch Operator improvement to support batch job parameters

     [ https://issues.apache.org/jira/browse/AIRFLOW-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Saurabh Dhupar reassigned AIRFLOW-5178:
---------------------------------------

    Assignee: Saurabh Dhupar

> AWS Batch Operator improvement to support batch job parameters
> --------------------------------------------------------------
>
>                 Key: AIRFLOW-5178
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5178
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: aws, operators
>    Affects Versions: 1.10.4
>            Reporter: Tim Mottershead
>            Assignee: Saurabh Dhupar
>            Priority: Major
>              Labels: gsoc, gsoc2020, mentor, newbie
>
> AWSBatchOperator does not currently support AWS Batch Job parameters.
> When creating an AWS Batch Job Definition and when submitting a job to AWS Batch, it's possible to define and supply job parameters. Most of our AWS Batch jobs take parameters but we are not able to pass them using the AWSBatchOperator.
> In order to support batch job parameters, a new argument to __init__(self) could be added called *job_parameters*, saved to an instance variable and supplied to self.client.submit_job() in the execute() method:
> {code}
> self.client.submit_job(
> jobName=self.job_name,
> jobQueue=self.job_queue,
> jobDefinition=self.job_definition,
> containerOverrides=self.overrides,
> parameters=self.job_parameters)
> {code}
> See https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html#Batch.Client.submit_job



--
This message was sent by Atlassian Jira
(v8.3.4#803005)