You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@airflow.apache.org by David Klosowski <da...@thinknear.com> on 2017/06/06 17:49:53 UTC

Thoughts on Making Airflow follow a publish model VS poll

I was curious what the thoughts are regarding shifting Airflow to a publish
model from the poll model currently used by many of the sensors inheriting
from BaseSensorOperator.

It would prevent much of the polling that may take up quite a bit of
resources.

Thanks.

Regards,
David