You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/07/03 02:33:31 UTC

[GitHub] [airflow] tsugumi-sys commented on a diff in pull request #24019: Add celery broker configuration example using Amazon SQS

tsugumi-sys commented on code in PR #24019:
URL: https://github.com/apache/airflow/pull/24019#discussion_r912421111


##########
docs/apache-airflow/executor/celery.rst:
##########
@@ -26,6 +26,17 @@ to work, you need to setup a Celery backend (**RabbitMQ**, **Redis**, ...) and
 change your ``airflow.cfg`` to point the executor parameter to
 ``CeleryExecutor`` and provide the related Celery settings.
 
+If you use Amazon SQS as a Celery broker, set environment variables like this:
+
+.. code-block:: bash
+
+    export AIRFLOW__CELERY__BROKER_URL=sqs://@your_sqs_host
+
+    # Celery's environment variables.
+    export AWS_ACCESS_KEY_ID=your_aws_access_key_id
+    export AWS_SECRET_ACCESS_KEY=your_aws_secret_access_key
+    export AWS_DEFAULT_REGION=your_aws_region

Review Comment:
   I turn the `AIRFLOW__CELERY__WORKER_ENABLE_REMOTE_CONTROL` True and False but new queues are not created...



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org