You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@superset.apache.org by gi...@git.apache.org on 2017/10/03 06:16:30 UTC

[GitHub] Mogball opened a new pull request #3575: Feature: Task scheduling, e.g. Druid cluster refresh

Mogball opened a new pull request #3575: Feature: Task scheduling, e.g. Druid cluster refresh
URL: https://github.com/apache/incubator-superset/pull/3575
 
 
   Adds a task scheduling system using crontab expressions:
   
   ![Task scheduling GIF](https://media.giphy.com/media/3ohhwHwjbJkOENks2A/source.gif)
   
   - Tasks are configured using JSON, the specific task is determined by `type` and are implemented in `tasklist.py`
   - Tasks can be edited/removed whenever
   - Tasks run in the background and automatically restart with Superset
   - E.g. a crontab expression of `30 * * * *` will run on the 30th minute of each hour
   
   Currently implements `druid_cluster_refresh` task which will periodically refresh specified Druid Clusters. Task will force refresh by default or simply scan for new datasources if `refresh_all=false`.
   
   Also adds more control over Druid refreshing in the UI:
   <img width="229" alt="screen shot 2017-10-02 at 10 46 36 pm" src="https://user-images.githubusercontent.com/15016832/31111537-91d16e48-a7c3-11e7-9910-e2d3386f6d47.png">
   
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services