You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "amoghrajesh (via GitHub)" <gi...@apache.org> on 2026/02/23 07:13:32 UTC
[I] Migrate remaining provider connection UI metadata to YAML [airflow]
amoghrajesh opened a new issue, #62345:
URL: https://github.com/apache/airflow/issues/62345
### Body
## Background
As part of decoupling connection form UI metadata from runtime hook imports,
we are migrating `ui-field-behaviour` and `conn-fields` from Python hook
methods (`get_ui_field_behaviour()` / `get_connection_form_widgets()`) into
declarative `provider.yaml` files.
This allows `ProvidersManager` to load connection form metadata without
importing hook classes, improving startup performance and separating UI
concerns from runtime execution.
### Progress so far
- Phase 1 — Google, Amazon, Microsoft Azure, Hashicorp, Databricks, Snowflake (PR: https://github.com/apache/airflow/pull/62011)
- Phase 2 — git, ssh, sftp, docker, cncf/kubernetes, standard, grpc, opensearch, datadog, influxdb (PR: https://github.com/apache/airflow/pull/62109)
- Phase 3 — slack, discord, pagerduty, opsgenie, smtp, telegram, apprise (PR: https://github.com/apache/airflow/pull/62165)
## Remaining Providers
## Remaining providers
| Provider | # Connection Types | Claimed by |
|---|---|---|
| `airbyte` | 1 | |
| `alibaba` | 4 | |
| `apache/hive` | 3 | |
| `apache/iceberg` | 1 | |
| `apache/kafka` | 1 | |
| `apache/spark` | 4 | |
| `arangodb` | 1 | |
| `asana` | 1 | |
| `cloudant` | 1 | |
| `cohere` | 1 | |
| `github` | 1 | |
| `jdbc` | 1 | |
| `jenkins` | 1 | |
| `mongo` | 1 | |
| `openai` | 1 | |
| `openfaas` | 1 | |
| `pinecone` | 1 | |
| `postgres` | 1 | |
| `qdrant` | 1 | |
| `redis` | 1 | |
| `salesforce` | 1 | |
| `samba` | 1 | |
| `teradata` | 1 | |
| `trino` | 1 | |
| `weaviate` | 1 | |
| `yandex` | 1 | |
| `ydb` | 1 | |
| `zendesk` | 1 | |
> **To claim a provider:** leave a comment saying you're working on it to avoid duplicate work.
## How to contribute?
Follow https://github.com/apache/airflow/blob/main/contributing-docs/23_provider_hook_migration_to_yaml.rst broadly.
- But in short you can do this in an venv with all airflow deps installed as per: https://github.com/apache/airflow/blob/main/contributing-docs/03a_contributors_quick_start_beginners.rst (cd into airflow repo and `uv sync --all-packages` should do the trick)
- `python scripts/tools/generate_yaml_format_for_hooks.py --provider <name>`
Example:
`python scripts/tools/generate_yaml_format_for_hooks.py --provider mongo`
The script will print `ui-field-behaviour` and/or `conn-fields` for each connection type defined in the provider.
- Do not use the `update-yaml` flag, manually make edits to the provider.yml to avoid errors
- If you want to quickly verify if it works at runtime, try running this snippet:
```python
from airflow.providers.<name>.get_provider_info import get_provider_info
for ct in get_provider_info().get('connection-types', []):
print(
ct.get('connection-type'),
'ui:', 'ui-field-behaviour' in ct,
'conn-fields:', list(ct.get('conn-fields', {}).keys())
)
```
Once all the above instructions are done, open a PR with title: `Migrate <name> connection UI metadata to YAML`
### Committer
- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "yjaw (via GitHub)" <gi...@apache.org>.
yjaw commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3947111182
I will take `arangodb`, `asana` and `cloudant`. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "wjddn279 (via GitHub)" <gi...@apache.org>.
wjddn279 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3943118489
I want to do task related to `apache/iceberg` and `apache/kafka`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "henry3260 (via GitHub)" <gi...@apache.org>.
henry3260 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3943761966
I want to take zendesk, ydb and weaviate .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "ahilashsasidharan (via GitHub)" <gi...@apache.org>.
ahilashsasidharan commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3951461688
Hi, I'd like to work on `openfaas`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "Eason09053360 (via GitHub)" <gi...@apache.org>.
Eason09053360 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3943431436
Hi, I would like to take `jdbc`, `jenkins`, and `airbyte`. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "fat-catTW (via GitHub)" <gi...@apache.org>.
fat-catTW commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4052977502
I'll work on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3950063557
I'd like to work on `yandex`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4053030612
Thanks @fat-catTW !!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "yuseok89 (via GitHub)" <gi...@apache.org>.
yuseok89 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3943106008
I'll take `github`, `openai` and `redis`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3949787251
Thanks folks, if i have reacted to your messages and added you in the issue desc, you are good to go!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "keisuke-kawamura (via GitHub)" <gi...@apache.org>.
keisuke-kawamura commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3950251794
I'd like to work on the `samba` provider. Could you please assign it to me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "justinpakzad (via GitHub)" <gi...@apache.org>.
justinpakzad commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3955245018
I'd like to work on `pinecone`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "haseebmalik18 (via GitHub)" <gi...@apache.org>.
haseebmalik18 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3943130337
Hi, I'd like to take `postgres`,`mongo`, `salesforce`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4066462949
The work is completed, thank you everyone who was involved in this work!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh closed issue #62345: Migrate remaining provider connection UI metadata to YAML
URL: https://github.com/apache/airflow/issues/62345
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4053025115
Thanks @fat-catTW !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "Srabasti (via GitHub)" <gi...@apache.org>.
Srabasti commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3956072745
Can you please assign teradata to me?
TIA!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "anishgirianish (via GitHub)" <gi...@apache.org>.
anishgirianish commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3947601486
> Hi, I'd like to take `apache/spark`, `apache/hive`, and `alibaba.`
- apache/spark: #62381
- apache/hive: #62380
- alibaba: #62379
Would appreciate a review when you get a chance. cc @amoghrajesh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "sjyangkevin (via GitHub)" <gi...@apache.org>.
sjyangkevin commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3945030519
I would like to take `cohere`, `trino`. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "anishgirianish (via GitHub)" <gi...@apache.org>.
anishgirianish commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-3943111049
Hi, I'd like to take `apache/spark` and `apache/hive`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4030968747
Hello folks, I was on leave last week, will catch up on reviews today / tomorrow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4038406987
It's amazing that only 3 are pending!
Gentle nudge to yandex (@Prab-27), ydb (@henry3260), cloudant (PR up already)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4052957604
OOPS !! I won’t be able to handle` yandex` provider - feel free to pick it up if interested
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Migrate remaining provider connection UI metadata to YAML [airflow]
Posted by "Srabasti (via GitHub)" <gi...@apache.org>.
Srabasti commented on issue #62345:
URL: https://github.com/apache/airflow/issues/62345#issuecomment-4019744359
https://github.com/apache/airflow/issues/62345#issuecomment-3956072745
All green - ready for review Cc: @amoghrajesh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org