You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/05/27 18:24:02 UTC

[GitHub] [airflow] YingboWang commented on pull request #5499: [AIRFLOW-3964][AIP-17] Build smart sensor

YingboWang commented on pull request #5499:
URL: https://github.com/apache/airflow/pull/5499#issuecomment-634854013


   Thanks @KevinYang21 for the comment. This PR description was updated with a high level architecture diagram and some charts for smart sensor impact after being deployed. 
   
   To cover operators not included in this PR:
   1. Define "poke_context_fields" as class attribute in the operator. "poke_context_fields" include all key names used for initializing a sensor object.
   2. In airflow.cfg, add new operator classname to [smart_sensor] sensors_enabled. All supported sensor classname should be comma separated. 
   3. Optional: if there are any corner case/restrictions on sensors that should be dump to smart sensor service, overwrite the "is_smart_sensor_compatible()" in operator class for rules. (example as named hive partition sensor) 
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org