You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/10/16 14:36:34 UTC
[GitHub] [airflow] turbaszek opened a new issue #11580: Support Airflow deployment with clustered Redis
turbaszek opened a new issue #11580:
URL: https://github.com/apache/airflow/issues/11580
**Description**
Currently, if users try to use Redis in a clustered way (for example using AWS ElastiCache cluster with multiple nodes) they may get the following error:
```
ResponseError: CROSSSLOT Keys in request don't hash to the same slot
```
This error occurs because keys must be in the same hash slot and not just the same node. Similar problems can be also observed when running flower.
**Use case / motivation**
Support Redis in clustered mode or provide information that it is not supported.
**Related Issues**
https://stackoverflow.com/questions/45215164/airflow-crossslot-keys-in-request-dont-hash-to-the-same-slot-error-using-aws-el/48123036
https://gitter.im/apache/incubator-airflow?at=5a4fe070b48e8c3566a54db9
https://aws.amazon.com/premiumsupport/knowledge-center/elasticache-crossslot-keys-error-redis/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] benbauer89 commented on issue #11580: Support Airflow deployment with clustered Redis
Posted by GitBox <gi...@apache.org>.
benbauer89 commented on issue #11580:
URL: https://github.com/apache/airflow/issues/11580#issuecomment-710107323
The default in terraform for **redis_group_parameter_group_name** is `"default.redis5.0.cluster.on"`
https://registry.terraform.io/modules/Flaconi/microservice/aws/2.6.0?tab=inputs
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org