You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "dineshmarimu2 (via GitHub)" <gi...@apache.org> on 2025/09/29 06:35:47 UTC
[I] Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error [airflow]
dineshmarimu2 opened a new issue, #56194:
URL: https://github.com/apache/airflow/issues/56194
### Apache Airflow version
3.1.0
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
I migrated from Airflow 3.0.4 to 3.1 with Python 3.12.
I use a Helm 1.18.0 for deployment to AKS in Azure cloud.
I use GitDagBundle for syncing my DAGs with our Git repository. This was working well in Airflow 3.x versions till 3.0.4 and I could verify that this works even in 3.0.6.
After upgrading my Helm deployment to Airflow 3.1.0, my dags no longer sync with Git and the last sync had the timestamp before upgrading to 3.1.0.
Reparsing DAG on the UI had no effect.
Executing `airflow dags reserialize` in shell of dag-processor resulted in a error which stated that 'host url for the git_connection was missing'.
I tried deleting and recreating the connection on the UI and the error stayed.
Finally downgraded db to 3.0.6 and deployed 3.0.6 and everything worked well as before
### What you think should happen instead?
Airflow 3.1.0's git sync with GitDagBundle should work normally without any changes to my dag_bundle_config_list setting in values.yaml
### How to reproduce
Deploy Airflow with Helm 1.18.0 in AKS with the following config for GitDagBUndle in values.yaml
```
config:
dag_processor:
dag_bundle_config_list: '[{"name": "skynet_dags","classpath": "airflow.providers.git.bundles.git.GitDagBundle","kwargs": { "git_conn_id": "git_dags_conn", "subdir": "dags", "tracking_ref": "development","refresh_interval": 30}}]'
```
Create a git connection in the UI after deployment with the name git_dags_conn.
Verify if changes to dags are synced in the UI's code tab
### Operating System
Ubuntu linux
### Versions of Apache Airflow Providers
This is my image
```
FROM apache/airflow:3.1.04-python3.12
RUN pip install --no-cache-dir apache-airflow-providers-cncf-kubernetes==10.5.0 \
&& pip install --no-cache-dir pandas==2.1.4 \
&& pip install --no-cache-dir openpyxl==3.1.5
```
I use an older version of pandas as a particular feature I need is buggy in the newer versions
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
I use the Airflow official Helm chart with suitable modifications for our deplyoment
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error [airflow]
Posted by "hadtinfo (via GitHub)" <gi...@apache.org>.
hadtinfo commented on issue #56194:
URL: https://github.com/apache/airflow/issues/56194#issuecomment-3446186190
https://www.astronomer.io/docs/astro/dag-bundles you can try this tutorial
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error [airflow]
Posted by "adrian-edbert (via GitHub)" <gi...@apache.org>.
adrian-edbert commented on issue #56194:
URL: https://github.com/apache/airflow/issues/56194#issuecomment-3363927616
possible duplicate of https://github.com/apache/airflow/issues/56165
you can try the workaround listed there with explicitly adding the `repo_url` on `git dag bundle` config on `airflow.cfg` to see if it works for your case
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error [airflow]
Posted by "maxcotec (via GitHub)" <gi...@apache.org>.
maxcotec commented on issue #56194:
URL: https://github.com/apache/airflow/issues/56194#issuecomment-3353852837
for me, it happened on Airflow v3.0.4. And when i tried deploying on prod, which was using old fernet-key (which was supported by airflow v2.10.4, Airflow 3 wasn't happy with the old key. I had to provide a valid Fernet key (urlsafe base64, 32-byte key → 44-char string)
i got the hint by running thi snippet;
from airflow.sdk import Connection as TaskSDKConnection
conn = TaskSDKConnection.get(conn_id=<YOUR_CONN_NAME_HERE>)
the above code threw error about fernet-key. Hope this may help someone.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error [airflow]
Posted by "dineshmarimu2 (via GitHub)" <gi...@apache.org>.
dineshmarimu2 closed issue #56194: Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error
URL: https://github.com/apache/airflow/issues/56194
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error [airflow]
Posted by "dineshmarimu2 (via GitHub)" <gi...@apache.org>.
dineshmarimu2 commented on issue #56194:
URL: https://github.com/apache/airflow/issues/56194#issuecomment-3359414654
I upgraded from 3.0.4 and even tried resetting the connection, but the problem persisted even with the new connection created. @maxcotec how did you change the existing fernet key without having to reset all your variables and connections?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Using Gitdagbundle with git connection in the UI doesn't sync dags anymore. Reserialization throws a 'host url is missing in the git connection' error [airflow]
Posted by "dineshmarimu2 (via GitHub)" <gi...@apache.org>.
dineshmarimu2 commented on issue #56194:
URL: https://github.com/apache/airflow/issues/56194#issuecomment-3370991190
Thanks for pointing to this issue and the thread @adrian-edbert. I could get my git connection to work with the workaround provided there in the thread, i.e., updae the repo_url and secrets in airflow config.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org