[jira] [Created] (AIRFLOW-1645) librabbitmq 1.6.1 is incompatibe with celery 4.1

["Christoph Hösler (JIRA)" <ji...@apache.org>]

Christoph Hösler created AIRFLOW-1645:
-----------------------------------------

             Summary: librabbitmq 1.6.1 is incompatibe with celery 4.1
                 Key: AIRFLOW-1645
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1645
             Project: Apache Airflow
          Issue Type: Bug
          Components: celery
    Affects Versions: 1.8.2
            Reporter: Christoph Hösler
            Priority: Minor


After installing airflow in a bitnami/minideb docker container with Python 2.7.13 using
{code}pip install "apache-airflow[celery, mysql, rabbitmq, crypto, s3, hdfs, druid] == 1.8.2"{code}, I ran it in distributed mode on kubernetes with the celery executor backed by rabbitmq. I was unable to execute any task and found the following warning in the worker log:
{code}
Received and deleted unknown message. Wrong destinaton?
{code}

I seems to be the issue reported [here|https://github.com/celery/librabbitmq/issues/93]. Uninstalling librabbitmq and installing "amqp == 2.2.2" resolves it as suggested [here|https://github.com/celery/celery/issues/3675].

Maybe you want to adjust the default dependencies of airflow accordingly.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)