[D] Change Redis brokerUrl [airflow]

["jeff-cook (via GitHub)" <gi...@apache.org>]

GitHub user jeff-cook created a discussion: Change Redis brokerUrl

We have installed airflow with helm `1.18.0` using the redis default config. We are looking at switching to an external redis instance so we can get metrics. 

However I see this comment that it can't be changed. 

```yaml
data:
  # Note: brokerUrl can only be set during install, not upgrade
  brokerUrl: ~
```  

Is there a process to update the `brokerUrl`?  Example does the database and all the PVCs need to be deleted?

GitHub link: https://github.com/apache/airflow/discussions/61886

----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org

Re: [D] Change Redis brokerUrl [airflow]

["mkzung (via GitHub)" <gi...@apache.org>]

GitHub user mkzung added a comment to the discussion: Change Redis brokerUrl

No need to touch the database or the PVCs. Put the URL in your own Secret and set `data.brokerUrlSecretName`.

The note is there because `<release>-broker-url` is a [`pre-install` hook](https://github.com/apache/airflow/blob/48ae6af196270e51ee9e9af853cacf474633c60b/chart/templates/secrets/redis-secrets.yaml#L58-L89), rendered on install and never on upgrade, so changing `data.brokerUrl` later does nothing.

```bash
kubectl create secret generic airflow-broker-url \
  --from-literal=connection='redis://:PASSWORD@my-redis.example.com:6379/0'
```

```yaml
redis:
  enabled: false
data:
  brokerUrlSecretName: airflow-broker-url   # key must be "connection"
```

With `helm template` on chart 1.18.0 every `AIRFLOW__CELERY__BROKER_URL` then reads your secret and the Redis StatefulSet is gone. Helm won't delete the old secret or the Redis PVC, and let the queue drain before switching.


GitHub link: https://github.com/apache/airflow/discussions/61886#discussioncomment-19102426

----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org