[jira] [Created] (AIRFLOW-6685) Add operators to improve data quality testing on data workflows/pipelines

["alex l (Jira)" <ji...@apache.org>]

alex l created AIRFLOW-6685:
-------------------------------

             Summary: Add operators to improve data quality testing on data workflows/pipelines
                 Key: AIRFLOW-6685
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6685
             Project: Apache Airflow
          Issue Type: New Feature
          Components: operators
    Affects Versions: 2.0.0
            Reporter: alex l
            Assignee: alex l


Adding plugins to allow better data quality testing within a dag. This includes 3 operators:
 * BaseDataQualityOperator
 ** contains shared attributes and methods that data quality check operators utilize
 ** a base class that can be used to create other dq operators
 * DataQualityThresholdCheckOperator
 ** will check a single value, sql result against a threshold range, and will fail a task if it is outside this range.
 * DataQulaityThresholdSQLCheckOperator
 ** Similar to DataQualityThresholdCheckOperator, but thresholds are sql-evaluated values, for dynamic threshold ranging.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)