You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Radek Strnad (JIRA)" <ji...@apache.org> on 2018/12/07 10:35:00 UTC

[jira] [Commented] (AIRFLOW-2722) ECSOperator requires network configuration parameter when FARGATE launch type is used

    [ https://issues.apache.org/jira/browse/AIRFLOW-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16712624#comment-16712624 ] 

Radek Strnad commented on AIRFLOW-2722:
---------------------------------------

I can confirm that Fargate instances work after fixing AIRFLOW-3074.
{code:title=Sample ECSOperator}
ECSOperator(
        task_id='task-id',
        task_definition='task-definition',
        launch_type='FARGATE',
        cluster='fargate-cluster-name',
        region_name='eu-east-1',
        network_configuration={
                'awsvpcConfiguration': {
                        'subnets': ['subnet-xxx', 'subnet-yyy', 'subnet-zzz'],
                        'securityGroups': ['sg-aaabbbccc'],
                        'assignPublicIp': 'ENABLED'
                }
        },
        dag=dag
    )
{code}
Please refer [Airflow|https://airflow.readthedocs.io/en/stable/integration.html?highlight=aws%20ecs#ecsoperator] and [Boto3|https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.html#ECS.Client.run_task] for documentation.

> ECSOperator requires network configuration parameter when FARGATE launch type is used
> -------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-2722
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2722
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: aws
>    Affects Versions: 2.0.0
>            Reporter: Craig Forster
>            Priority: Major
>
> The 'FARGATE' launch type was added in AIRFLOW-2435, however when using that launch mode the following error is returned:
> {noformat}
> Network Configuration must be provided when networkMode 'awsvpc' is specified.
> {noformat}
> Fargate-launched tasks use the "awsvpc" networking type, and as per the [boto3 documentation|http://boto3.readthedocs.io/en/latest/reference/services/ecs.html#ECS.Client.run_task] for run_task:
> {quote}This parameter is required for task definitions that use the awsvpc network mode to receive their own Elastic Network Interface, and it is not supported for other network modes.
> {quote}
> As it's currently implemented, the Fargate launch type is unusable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)