[GitHub] [airflow] msumit commented on pull request #12733: WIP: RedisXCom backend

[GitBox <gi...@apache.org>]

msumit commented on pull request #12733:
URL: https://github.com/apache/airflow/pull/12733#issuecomment-737209891


   @turbaszek thanks for the comments. I just wanted to see how easy or difficult is to write a custom XCom backend and Redis backend seems to be a good start. To be frank I could not find much info on this topic except [this](https://airflow.apache.org/docs/stable/concepts.html#custom-xcom-backend), which doesn't reveal much. 
   
   I won't mind discarding this PR as it was just some testing ground, but IMO even a Redis backend is a significant improvement over the DB based backend, as users would be able to store upto 512mbs of data vs some kbs at present. Also, it'll help as a blueprint on how to extend the BaseXCom to their needs. 
   
   Also, I'm not sure who is assigned to manage all other backported modules, AFAIK except some big SAAS companies, we (the community) would only be managing them, but I could be wrong here, so would love to hear from others. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org