You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by GitBox <gi...@apache.org> on 2020/04/23 11:14:59 UTC
[GitHub] [incubator-superset] thammaneni opened a new issue #9635: can we use redis-cluster for superset scheduling?
thammaneni opened a new issue #9635:
URL: https://github.com/apache/incubator-superset/issues/9635
Hi, i was using redis server for scheduling in superset. due to some scheduling functionality issues i am trying to use redis-cluster. when configure scheduling with redis-cluster, celery worker is throwing an error as like below. i need to some suggestions here for superset scheduling which is best in redis, redis-cluster or rabitmq ? Thanks.
Worker log for redis-cluster:
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] bsergean commented on issue #9635: can we use redis-cluster for superset scheduling?
Posted by GitBox <gi...@apache.org>.
bsergean commented on issue #9635:
URL: https://github.com/apache/incubator-superset/issues/9635#issuecomment-620475195
This redis client (used by celery it seems, probably redis-py) does not seem to support the redis cluster protocol. You could use a new project called [redis-cluster-proxy](https://github.com/RedisLabs/redis-cluster-proxy) to workaround that. You would install it 'in front' of your cluster.
You can also ask / research on the kombu github project whether they support redis-cluster.
(I wrote a tool to play with redis cluster if you're interested in trying it -> https://machinezone.github.io/rcc/cluster_testbed/)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] thammaneni commented on issue #9635: can we use redis-cluster for superset scheduling?
Posted by GitBox <gi...@apache.org>.
thammaneni commented on issue #9635:
URL: https://github.com/apache/incubator-superset/issues/9635#issuecomment-625138947
Thanks basergean.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org