You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Jarek Potiuk (Jira)" <ji...@apache.org> on 2020/01/19 23:05:00 UTC

[jira] [Updated] (AIRFLOW-5178) AWS Batch Operator improvement to support batch job parameters

     [ https://issues.apache.org/jira/browse/AIRFLOW-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Potiuk updated AIRFLOW-5178:
----------------------------------
    Labels: gsoc gsoc2020 mentor newbie  (was: newbie)

> AWS Batch Operator improvement to support batch job parameters
> --------------------------------------------------------------
>
>                 Key: AIRFLOW-5178
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5178
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: aws, operators
>    Affects Versions: 1.10.4
>            Reporter: Tim Mottershead
>            Priority: Major
>              Labels: gsoc, gsoc2020, mentor, newbie
>
> AWSBatchOperator does not currently support AWS Batch Job parameters.
> When creating an AWS Batch Job Definition and when submitting a job to AWS Batch, it's possible to define and supply job parameters. Most of our AWS Batch jobs take parameters but we are not able to pass them using the AWSBatchOperator.
> In order to support batch job parameters, a new argument to __init__(self) could be added called *job_parameters*, saved to an instance variable and supplied to self.client.submit_job() in the execute() method:
> {code}
> self.client.submit_job(
> jobName=self.job_name,
> jobQueue=self.job_queue,
> jobDefinition=self.job_definition,
> containerOverrides=self.overrides,
> parameters=self.job_parameters)
> {code}
> See https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/batch.html#Batch.Client.submit_job



--
This message was sent by Atlassian Jira
(v8.3.4#803005)