Scheduler

[Marco Costantini <ma...@rocketfncl.com>]

Hello team,

I'd like to create a scheduled report of a Saved Query. The documentation
says that I need to have an external scheduler such as Airflow to achieve
this goal. However, my Superset installation already seems to have a
scheduler in Celery.

Can someone help me understand the scenario better? Perhaps the
documentation is out-of-date?

Please and thank you,
Silvio Costantini.
RocketFNCL

Re: Scheduler

[Beto Dealmeida <ro...@dealmeida.net.INVALID>]

Hi, Marco!

Unfortunately the query scheduling functionality in Apache Superset is 
currently not self-contained. It only exposes a UI that allows users to 
attach metadata to a saved query. This metadata can then be queried by 
external systems (such as Airflow) to grab the query and run it 
periodically.

If you wish to use Celery for this purpose, you would have to create a 
custom task that checks for this metadata and runs the saved queries, 
which would require some additional work.

In my opinion, the best way forward would be to extend the Alerts & 
Reports functionality of Superset to include a third category, 
"Scheduled queries." This would be similar to how alerts run currently, 
so it should be easy to implement and much of the UI can be reused. 
Unfortunately, I do not have the bandwidth to work on this project, but 
I am happy to provide guidance and mentorship to someone who is 
interested in doing this work.

--Beto

On 2/22/23 12:55 PM, Marco Costantini wrote:
> Hello team,
>
> I'd like to create a scheduled report of a Saved Query. The documentation
> says that I need to have an external scheduler such as Airflow to achieve
> this goal. However, my Superset installation already seems to have a
> scheduler in Celery.
>
> Can someone help me understand the scenario better? Perhaps the
> documentation is out-of-date?
>
> Please and thank you,
> Silvio Costantini.
> RocketFNCL
>