You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Jarek Potiuk <ja...@potiuk.com> on 2022/06/29 16:51:06 UTC

[ANNOUNCEMENT] Provider dependencies management moved to "provider.yaml" files

Hey!

Whoever develops a provider, and wants to change/update dependencies,
I just merged a PR that moves management of provider dependencies to
where they belong - ie the “provider.yaml” of this provider (at least
until they are in the same repo as airflow this is the best place),

If you were used to editing setup.py for that - not any more. The
setup.py is only for Airflow and its non-provider extras.

I updated (a little) Provider’s contributing docs here:
https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#provider-packages
- and you can easily see how all providers keep their dependencies in
the provider.yaml files.

This brings us a bit closer to discussion about splitting providers
from the main repo (which is inevitably coming).

The PR is here: https://github.com/apache/airflow/pull/24672

As a bonus we also have this nice, automatically generated json file
https://github.com/apache/airflow/blob/main/generated/provider_dependencies.json
 listing all providers and showing direct dependencies of the
providers in a single place, which is even better than previous
setup.py which had a lot of indirection.

J.