You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Roster (Jira)" <ji...@apache.org> on 2020/04/14 07:33:00 UTC

[jira] [Closed] (AIRFLOW-4955) Enforce Connections & Pools

     [ https://issues.apache.org/jira/browse/AIRFLOW-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Roster closed AIRFLOW-4955.
---------------------------
    Resolution: Done

> Enforce Connections & Pools
> ---------------------------
>
>                 Key: AIRFLOW-4955
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4955
>             Project: Apache Airflow
>          Issue Type: Wish
>          Components: core
>    Affects Versions: 2.0.0
>            Reporter: Roster
>            Priority: Major
>
> Airflow allows Polls and Connection yet the integration between them is up to the user.
> We have 40+ users who upload DAGs. It's impossible to manully enforce that if user choose to use Connection "X_y_Z" then he must also use Pool "X_Y_Z_P".
> We would love a feature where in the Connection you can associate it to a Pool. So whenever the user is specifying this connection in Operator/Hook he must also specify the Pool - Otherwise the Operator will fail! 
> Or even better save the trouble of having the users to manually specify the pool in the Operator - and stack up the tasks in the pool by itself.
> I'm not asking to change the current behavior of Pools. This can be an extension of the current behavior. Think of it like queues... The user who writing operator doesn't need to specify to which worker queue the tasks will go. Airflow handle it for him. then why not with Connections and Pools? 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)