[jira] [Created] (AIRFLOW-546) How to configure broker_url and multiple hosts for failover (rabbitmq) properly?

["Olaf Krische (JIRA)" <ji...@apache.org>]

Olaf Krische created AIRFLOW-546:
------------------------------------

             Summary: How to configure broker_url and multiple hosts for failover (rabbitmq) properly?
                 Key: AIRFLOW-546
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-546
             Project: Apache Airflow
          Issue Type: Bug
          Components: celery
    Affects Versions: Airflow 1.7.1.3
         Environment: Linux big14 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt25-2+deb8u3 (2016-07-02) x86_64 GNU/Linux
            Reporter: Olaf Krische


I try to extend the broker_url settings, as described on the celery homepage, so that i can have more than one host to choose from, if one fails:

* http://docs.celeryproject.org/en/latest/configuration.html#conf-broker-settings

{code}
broker_url = ['amqp://user:password@rmq01::5672//','amqp://user:password@rmq02::5672//']
{code}

This does not work. lower/uppercase, i tried both. Also not in conjunction with BROKER_FAILOVER_STRATEGY. I get the same error as in AIRFLOW-37 . 

How does airflow pass this configuration through to celery? The normal config works:

{code}
broker_url = amqp://user:password@rmq01::5672//
{code}

Versions are also up to date:

{code}
ads@app01:~/airflow$ pip list | grep -E 'airflow|celery'
airflow (1.7.1.3)
celery (3.1.24)
{code}

Any ideas?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)