You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2021/09/01 16:13:17 UTC
[airflow] branch v2-2-test updated (97f0065 -> fe34582)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch v2-2-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 97f0065 Show all import_errors from zip files (#17759)
add 806f06b Fixed numeric list (#17813)
add c203e77 Show import errors in DAG views (#17818)
add 06e53f2 Chart: configurable number of retention days for log groomers (#17764)
add 96f7e3f Increase width for Run column (#17817)
add a759499 Update INTHEWILD.md (#17832)
add 45e61a9 Only show import errors for DAGs a user can access (#17835)
add ea49c96 Fix typos in docs & ``bug_report`` template (#17809)
add 7e93828 (docs): update README.md (#17806)
add bfdda08 Improve graph view load time for dags with open groups (#17821)
add 933d863 Fix broken MSSQL test (#17797)
add e18b6a6 Avoid redirect loop for users with no permissions (#17838)
add 41632e0 Fix provider.yaml errors due to exit(0) in test (#17858)
add a2fd67d Update to Celery 5 (#17397)
add 275e0d1 Sane detection of the host/port in entrypoint prod (#17847)
add 83f1f07 Fix log links on graph TI modal (#17862)
add 87769db Allow omission of `initial_node_count` if `node_pools` is specified (#17820)
add aa5952e Gcp ai hyperparameter tuning (#17790)
add 4990176 Move setting of project ID after activating service account (#17866)
add eec757d Add Brent to Committers list (#17873)
add 220678d Allow google-auth < 3 and google-api-core < 3 (#17671)
add 4d48305 Convert issue templates into forms (#17855)
add 0abbd2d Secrets backend failover (#16404)
add 890bd43 Add an Amazon EMR on EKS provider package (#16766)
add 997c31c ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)
add 606b697 Add Brent to ``CODEOWNERS`` (#17877)
add 95279bd Add back deleted comment (#17884)
add e4d3da1 fix wrong documents around upgrade-check.rst (#17903)
add d0bc11f replace to contributing quick start guide (#17908)
add 42e13e1 Remove all deprecation warnings in providers (#17900)
add 07405e6 [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)
add 24aa34b Fixed button size in "Actions" group. (#17902)
add b5da846 Fix missing Data Fusion sensor integration (#17914)
add e9bf127 Add doc warning about connections added via envvars (#17915)
add 332406d BugFix: ``TimeSensorAsync`` returns a naive datetime (#17875)
add a3f9c69 Fix ``DagRunState`` enum query for ``MySQLdb`` driver (#17886)
add 653c13e Fix broken XCOM in EKSPodOperator (#17918)
add 4a0711c Fix `TestSecurity.test_current_user_has_permissions` (#17916)
add 18cc31c Add issue form template for Helm Chat (#17917)
add 1d71441 Fix saving last choice of backend and other flags between breeze runs (#17913)
add da99c3f HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)
add 0a68588 Add August 2021 Provider's documentation (#17890)
add 098765e Allow setting specific cwd for BashOperator (#17751)
add 9028a78 Separate Managed Services for Airflow (#17926)
add 3fc57de Allow custom timetable as a DAG argument (#17414)
add 2aa443f Update error message to guide the user into self-help mostly (#17929)
add 27c1150 Always upgrade to newer dependencies in main (#17939)
add 5350cc2 Example xcom update (#17749)
add eda8a51 Fix docs about login for hdfs connections (#17936)
add dd8b04d Fix grammar in `traceback.html` (#17942)
add a29503e Fix instantiating Vault Secret Backend during configuration (#17935)
add eebfeec Update docker.rst (#17882)
add 1aca908 Adds Github Oauth example with team based authorization (#17896)
add 9befaee Fixing bug which restricted the visibility of ImportErrors (#17924)
add 5007806 Add possibility to run DAGs from system tests and see DAGs logs (#17868)
add 887ef6b Add Next Run to UI (#17732)
add 601f22c Refactor BranchDayOfWeekOperator, DayOfWeekSensor (#17940)
add 226a2b8 Queue support for DaskExecutor using Dask Worker Resources (#16829)
add 9c19f0d Improve MySqlToHiveOperator tests (#17958)
add ee93935 Only show Pause/Unpause tooltip on hover (#17957)
add fac06a1 Add robots.txt and X-Robots-Tag header (#17946)
add fbdb688 Fix passing Jinja templates in ``DateTimeSensor`` (#17959)
add 16b47ce Invalidate Vault cached prop when not authenticated (#17387)
add fe34582 New google operator: SQLToGoogleSheetsOperator (#17887)
No new revisions were added by this update.
Summary of changes:
.github/CODEOWNERS | 4 +-
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 133 +++++
.../ISSUE_TEMPLATE/airflow_doc_issue_report.yml | 68 +++
.../airflow_helmchart_bug_report.yml | 133 +++++
.../airflow_providers_bug_report.yml | 211 ++++++++
.github/ISSUE_TEMPLATE/bug_report.md | 66 ---
.github/ISSUE_TEMPLATE/feature_request.md | 42 --
.github/ISSUE_TEMPLATE/feature_request.yml | 58 +++
.github/ISSUE_TEMPLATE/~free_form.yml | 16 +
.pre-commit-config.yaml | 6 +-
BREEZE.rst | 8 +-
CONTRIBUTING.rst | 6 +-
CONTRIBUTORS_QUICK_START.rst | 2 +-
INTHEWILD.md | 1 +
README.md | 90 ++--
TESTING.rst | 2 +-
airflow/__init__.py | 1 +
airflow/api/common/experimental/mark_tasks.py | 8 +-
airflow/cli/commands/celery_command.py | 49 +-
airflow/configuration.py | 16 +-
airflow/example_dags/example_xcom.py | 34 ++
airflow/executors/dask_executor.py | 17 +-
airflow/hooks/subprocess.py | 20 +-
airflow/jobs/backfill_job.py | 2 +-
airflow/models/connection.py | 17 +-
airflow/models/dag.py | 92 ++--
airflow/models/dagrun.py | 4 +-
airflow/models/taskinstance.py | 7 +-
airflow/models/variable.py | 15 +-
airflow/operators/bash.py | 11 +
airflow/operators/weekday.py | 19 +-
airflow/providers/airbyte/CHANGELOG.rst | 18 +-
airflow/providers/airbyte/provider.yaml | 1 +
airflow/providers/amazon/CHANGELOG.rst | 40 +-
.../amazon/aws/example_dags/example_emr_eks_job.py | 81 +++
.../providers/amazon/aws/hooks/emr_containers.py | 205 ++++++++
.../amazon/aws/operators/dms_create_task.py | 2 -
.../amazon/aws/operators/dms_delete_task.py | 2 -
.../amazon/aws/operators/dms_describe_tasks.py | 2 -
.../amazon/aws/operators/dms_start_task.py | 2 -
.../amazon/aws/operators/dms_stop_task.py | 2 -
airflow/providers/amazon/aws/operators/eks.py | 2 +-
.../amazon/aws/operators/emr_containers.py | 145 ++++++
airflow/providers/amazon/aws/sensors/dms_task.py | 3 -
.../aws/sensors/{athena.py => emr_containers.py} | 52 +-
airflow/providers/amazon/provider.yaml | 19 +
airflow/providers/apache/beam/CHANGELOG.rst | 15 +
airflow/providers/apache/beam/provider.yaml | 1 +
airflow/providers/apache/cassandra/CHANGELOG.rst | 18 +
airflow/providers/apache/cassandra/provider.yaml | 1 +
airflow/providers/apache/drill/CHANGELOG.rst | 15 +
airflow/providers/apache/drill/operators/drill.py | 2 -
airflow/providers/apache/drill/provider.yaml | 1 +
airflow/providers/apache/druid/CHANGELOG.rst | 16 +-
airflow/providers/apache/druid/provider.yaml | 1 +
airflow/providers/apache/hdfs/CHANGELOG.rst | 21 +
airflow/providers/apache/hdfs/provider.yaml | 1 +
airflow/providers/apache/hive/CHANGELOG.rst | 20 +-
airflow/providers/apache/hive/hooks/hive.py | 3 +-
airflow/providers/apache/hive/provider.yaml | 1 +
airflow/providers/apache/kylin/CHANGELOG.rst | 15 +
airflow/providers/apache/kylin/provider.yaml | 1 +
airflow/providers/apache/livy/CHANGELOG.rst | 21 +
airflow/providers/apache/livy/provider.yaml | 1 +
airflow/providers/apache/pig/CHANGELOG.rst | 15 +
airflow/providers/apache/pig/provider.yaml | 1 +
airflow/providers/apache/pinot/CHANGELOG.rst | 14 +
airflow/providers/apache/pinot/provider.yaml | 1 +
airflow/providers/apache/spark/CHANGELOG.rst | 17 +
airflow/providers/apache/spark/provider.yaml | 1 +
airflow/providers/apache/sqoop/CHANGELOG.rst | 15 +-
airflow/providers/apache/sqoop/provider.yaml | 1 +
airflow/providers/asana/CHANGELOG.rst | 23 +
airflow/providers/asana/provider.yaml | 1 +
airflow/providers/cloudant/CHANGELOG.rst | 13 +
airflow/providers/cloudant/provider.yaml | 1 +
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 12 +-
.../backcompat/backwards_compat_converters.py | 6 +-
airflow/providers/databricks/CHANGELOG.rst | 16 +
airflow/providers/databricks/provider.yaml | 1 +
airflow/providers/datadog/CHANGELOG.rst | 14 +
airflow/providers/datadog/provider.yaml | 1 +
airflow/providers/dingding/CHANGELOG.rst | 15 +
airflow/providers/dingding/provider.yaml | 1 +
airflow/providers/discord/CHANGELOG.rst | 13 +
airflow/providers/discord/provider.yaml | 1 +
airflow/providers/docker/CHANGELOG.rst | 20 +-
airflow/providers/docker/provider.yaml | 1 +
airflow/providers/elasticsearch/CHANGELOG.rst | 21 +-
airflow/providers/elasticsearch/provider.yaml | 1 +
airflow/providers/exasol/CHANGELOG.rst | 18 +
airflow/providers/exasol/hooks/exasol.py | 8 +-
airflow/providers/exasol/provider.yaml | 1 +
airflow/providers/facebook/CHANGELOG.rst | 13 +
airflow/providers/facebook/provider.yaml | 1 +
airflow/providers/ftp/CHANGELOG.rst | 16 +
airflow/providers/ftp/provider.yaml | 1 +
airflow/providers/google/CHANGELOG.rst | 34 +-
.../cloud/example_dags/example_automl_tables.py | 8 +-
.../example_dags/example_azure_fileshare_to_gcs.py | 2 +-
.../cloud/example_dags/example_bigquery_dts.py | 2 +-
.../example_dags/example_bigquery_operations.py | 44 +-
.../cloud/example_dags/example_bigquery_queries.py | 42 +-
.../cloud/example_dags/example_bigquery_sensors.py | 14 +-
.../example_dags/example_bigquery_to_bigquery.py | 2 +-
.../google/cloud/example_dags/example_bigtable.py | 2 +-
.../cloud/example_dags/example_cloud_build.py | 2 +-
.../example_dags/example_cloud_memorystore.py | 4 +-
.../google/cloud/example_dags/example_cloud_sql.py | 2 +-
.../cloud/example_dags/example_cloud_sql_query.py | 2 +-
.../example_cloud_storage_transfer_service_gcp.py | 2 +-
.../google/cloud/example_dags/example_compute.py | 2 +-
.../cloud/example_dags/example_compute_igm.py | 2 +-
.../cloud/example_dags/example_compute_ssh.py | 2 +-
.../cloud/example_dags/example_datacatalog.py | 4 +-
.../google/cloud/example_dags/example_dataflow.py | 59 +--
.../example_dags/example_dataflow_flex_template.py | 2 +-
.../cloud/example_dags/example_dataflow_sql.py | 2 +-
.../cloud/example_dags/example_datafusion.py | 36 +-
.../google/cloud/example_dags/example_dataprep.py | 2 +-
.../google/cloud/example_dags/example_dataproc.py | 24 +-
.../google/cloud/example_dags/example_datastore.py | 4 +-
.../google/cloud/example_dags/example_dlp.py | 8 +-
.../example_dags/example_facebook_ads_to_gcs.py | 14 +-
.../google/cloud/example_dags/example_functions.py | 2 +-
.../google/cloud/example_dags/example_gcs.py | 4 +-
.../example_gcs_timespan_file_transform.py | 2 +-
.../cloud/example_dags/example_gcs_to_bigquery.py | 2 +-
.../cloud/example_dags/example_gcs_to_gcs.py | 2 +-
.../cloud/example_dags/example_gcs_to_local.py | 2 +-
.../cloud/example_dags/example_gcs_to_sftp.py | 2 +-
.../cloud/example_dags/example_gdrive_to_gcs.py | 6 +-
.../example_dags/example_kubernetes_engine.py | 2 +-
.../cloud/example_dags/example_life_sciences.py | 2 +-
.../cloud/example_dags/example_local_to_gcs.py | 2 +-
.../google/cloud/example_dags/example_mlengine.py | 39 +-
.../cloud/example_dags/example_mysql_to_gcs.py | 2 +-
.../cloud/example_dags/example_natural_language.py | 2 +-
.../cloud/example_dags/example_postgres_to_gcs.py | 2 +-
.../cloud/example_dags/example_presto_to_gcs.py | 66 ++-
.../google/cloud/example_dags/example_pubsub.py | 4 +-
.../google/cloud/example_dags/example_s3_to_gcs.py | 2 +-
.../example_dags/example_salesforce_to_gcs.py | 14 +-
.../cloud/example_dags/example_sftp_to_gcs.py | 2 +-
.../cloud/example_dags/example_sheets_to_gcs.py | 2 +-
.../google/cloud/example_dags/example_spanner.py | 2 +-
.../cloud/example_dags/example_speech_to_text.py | 2 +-
.../cloud/example_dags/example_stackdriver.py | 2 +-
.../google/cloud/example_dags/example_tasks.py | 2 +-
.../cloud/example_dags/example_text_to_speech.py | 2 +-
.../google/cloud/example_dags/example_translate.py | 2 +-
.../cloud/example_dags/example_translate_speech.py | 2 +-
.../cloud/example_dags/example_trino_to_gcs.py | 66 ++-
.../example_dags/example_video_intelligence.py | 2 +-
.../google/cloud/example_dags/example_vision.py | 6 +-
.../google/cloud/example_dags/example_workflows.py | 2 +-
airflow/providers/google/cloud/hooks/datafusion.py | 7 +-
airflow/providers/google/cloud/hooks/dataproc.py | 22 +-
.../providers/google/cloud/operators/bigquery.py | 26 +-
.../providers/google/cloud/operators/datafusion.py | 31 +-
.../providers/google/cloud/operators/dataproc.py | 6 +-
.../google/cloud/operators/kubernetes_engine.py | 28 +-
.../providers/google/cloud/operators/mlengine.py | 10 +
.../providers/google/cloud/sensors/datafusion.py | 125 +++++
airflow/providers/google/cloud/sensors/dataproc.py | 2 +-
.../google/cloud/transfers/bigquery_to_mssql.py | 2 -
.../google/cloud/utils/mlengine_operator_utils.py | 8 +-
.../firebase/example_dags/example_firestore.py | 34 +-
.../google/leveldb/example_dags/example_leveldb.py | 2 +-
.../example_dags/example_analytics.py | 2 +-
.../example_dags/example_campaign_manager.py | 2 +-
.../example_dags/example_display_video.py | 6 +-
.../example_dags/example_search_ads.py | 2 +-
airflow/providers/google/provider.yaml | 8 +
.../suite/example_dags/example_gcs_to_sheets.py | 2 +-
.../google/suite/example_dags/example_sheets.py | 2 +-
.../example_dags/example_sql_to_sheets.py} | 24 +-
.../{gcs_to_sheets.py => sql_to_sheets.py} | 107 ++--
airflow/providers/grpc/CHANGELOG.rst | 16 +
airflow/providers/grpc/provider.yaml | 1 +
airflow/providers/hashicorp/CHANGELOG.rst | 23 +
.../hashicorp/_internal_client/vault_client.py | 19 +-
airflow/providers/hashicorp/provider.yaml | 1 +
airflow/providers/hashicorp/secrets/vault.py | 14 +-
airflow/providers/http/CHANGELOG.rst | 18 +
airflow/providers/http/provider.yaml | 1 +
airflow/providers/imap/CHANGELOG.rst | 13 +
airflow/providers/imap/provider.yaml | 1 +
airflow/providers/jdbc/CHANGELOG.rst | 20 +
airflow/providers/jdbc/provider.yaml | 1 +
airflow/providers/jenkins/CHANGELOG.rst | 15 +-
airflow/providers/jenkins/provider.yaml | 1 +
airflow/providers/jira/CHANGELOG.rst | 16 +
airflow/providers/jira/provider.yaml | 1 +
airflow/providers/microsoft/azure/CHANGELOG.rst | 16 +-
airflow/providers/microsoft/azure/provider.yaml | 2 +-
airflow/providers/microsoft/mssql/CHANGELOG.rst | 16 +
airflow/providers/microsoft/mssql/provider.yaml | 1 +
airflow/providers/microsoft/psrp/provider.yaml | 13 +-
airflow/providers/microsoft/winrm/CHANGELOG.rst | 15 +
airflow/providers/microsoft/winrm/provider.yaml | 1 +
airflow/providers/mongo/CHANGELOG.rst | 18 +
airflow/providers/mongo/provider.yaml | 1 +
airflow/providers/mysql/CHANGELOG.rst | 16 +-
airflow/providers/mysql/provider.yaml | 1 +
airflow/providers/neo4j/CHANGELOG.rst | 20 +
airflow/providers/neo4j/provider.yaml | 1 +
airflow/providers/odbc/CHANGELOG.rst | 16 +
airflow/providers/odbc/provider.yaml | 1 +
airflow/providers/opsgenie/CHANGELOG.rst | 17 +
airflow/providers/opsgenie/provider.yaml | 1 +
airflow/providers/oracle/CHANGELOG.rst | 15 +
airflow/providers/oracle/provider.yaml | 1 +
airflow/providers/pagerduty/CHANGELOG.rst | 14 +
airflow/providers/pagerduty/provider.yaml | 1 +
airflow/providers/papermill/CHANGELOG.rst | 13 +
airflow/providers/papermill/provider.yaml | 1 +
airflow/providers/plexus/CHANGELOG.rst | 14 +
airflow/providers/plexus/provider.yaml | 1 +
airflow/providers/postgres/CHANGELOG.rst | 22 +-
airflow/providers/postgres/provider.yaml | 1 +
airflow/providers/presto/CHANGELOG.rst | 17 +
airflow/providers/presto/provider.yaml | 1 +
airflow/providers/qubole/CHANGELOG.rst | 17 +
airflow/providers/qubole/provider.yaml | 1 +
airflow/providers/redis/CHANGELOG.rst | 14 +
airflow/providers/redis/provider.yaml | 1 +
airflow/providers/salesforce/CHANGELOG.rst | 18 +
airflow/providers/salesforce/provider.yaml | 1 +
airflow/providers/samba/CHANGELOG.rst | 19 +
airflow/providers/samba/provider.yaml | 1 +
airflow/providers/segment/CHANGELOG.rst | 17 +
airflow/providers/segment/provider.yaml | 1 +
airflow/providers/sendgrid/CHANGELOG.rst | 15 +
airflow/providers/sendgrid/provider.yaml | 1 +
airflow/providers/sftp/CHANGELOG.rst | 16 +-
airflow/providers/sftp/provider.yaml | 1 +
airflow/providers/singularity/CHANGELOG.rst | 16 +
.../example_dags/example_singularity.py | 2 +-
airflow/providers/singularity/provider.yaml | 1 +
airflow/providers/slack/CHANGELOG.rst | 22 +
airflow/providers/slack/provider.yaml | 1 +
airflow/providers/snowflake/CHANGELOG.rst | 16 +-
airflow/providers/snowflake/provider.yaml | 1 +
airflow/providers/sqlite/CHANGELOG.rst | 21 +
airflow/providers/sqlite/provider.yaml | 1 +
airflow/providers/ssh/CHANGELOG.rst | 17 +-
airflow/providers/ssh/provider.yaml | 1 +
airflow/providers/tableau/CHANGELOG.rst | 16 +-
airflow/providers/tableau/provider.yaml | 1 +
airflow/providers/telegram/CHANGELOG.rst | 13 +
airflow/providers/telegram/provider.yaml | 1 +
airflow/providers/trino/CHANGELOG.rst | 17 +
airflow/providers/trino/provider.yaml | 1 +
airflow/providers/vertica/CHANGELOG.rst | 16 +
airflow/providers/vertica/provider.yaml | 1 +
airflow/providers/yandex/CHANGELOG.rst | 24 +
airflow/providers/yandex/provider.yaml | 1 +
airflow/providers/zendesk/CHANGELOG.rst | 15 +
airflow/providers/zendesk/provider.yaml | 1 +
airflow/sensors/date_time.py | 15 +-
airflow/sensors/time_sensor.py | 7 +-
airflow/sensors/weekday.py | 17 +-
airflow/serialization/schema.json | 12 +-
airflow/serialization/serialized_objects.py | 102 +++-
airflow/timetables/base.py | 61 ++-
airflow/timetables/interval.py | 234 ++++++++-
airflow/timetables/schedules.py | 207 --------
airflow/timetables/simple.py | 56 +-
airflow/utils/module_loading.py | 5 +
airflow/utils/state.py | 3 +
airflow/utils/weekday.py | 25 +
airflow/www/app.py | 3 +
airflow/www/auth.py | 18 +-
.../www/extensions/init_robots.py | 31 +-
airflow/www/security.py | 6 +
airflow/www/static/js/dag.js | 20 +-
airflow/www/static/js/dags.js | 41 +-
airflow/www/static/js/datetime_utils.js | 5 +-
airflow/www/static/js/graph.js | 20 +-
airflow/www/static/js/task_instances.js | 21 +-
airflow/www/static/robots.txt | 2 +
airflow/www/templates/airflow/dag.html | 12 +-
airflow/www/templates/airflow/dags.html | 43 +-
.../{no_roles.html => no_roles_permissions.html} | 2 +-
airflow/www/templates/airflow/traceback.html | 19 +-
airflow/www/utils.py | 10 +
airflow/www/views.py | 159 ++++--
breeze | 6 +-
.../templates/scheduler/scheduler-deployment.yaml | 5 +
chart/templates/workers/worker-deployment.yaml | 5 +
chart/tests/test_scheduler.py | 30 ++
chart/tests/test_worker.py | 30 ++
chart/values.schema.json | 10 +
chart/values.yaml | 4 +
dev/import_all_classes.py | 37 +-
dev/provider_packages/prepare_provider_packages.py | 435 +++++++++-------
docs/apache-airflow-providers-airbyte/commits.rst | 16 +-
docs/apache-airflow-providers-airbyte/index.rst | 8 +-
docs/apache-airflow-providers-alibaba/commits.rst | 21 +-
docs/apache-airflow-providers-alibaba/index.rst | 22 +-
docs/apache-airflow-providers-amazon/commits.rst | 27 +
docs/apache-airflow-providers-amazon/index.rst | 38 +-
.../operators/emr_eks.rst | 79 +++
.../commits.rst | 17 +-
.../apache-airflow-providers-apache-beam/index.rst | 8 +-
.../commits.rst | 20 +-
.../index.rst | 4 +-
.../commits.rst | 14 +
.../index.rst | 4 +-
.../commits.rst | 16 +-
.../index.rst | 8 +-
.../commits.rst | 19 +-
.../connections.rst | 4 +-
.../apache-airflow-providers-apache-hdfs/index.rst | 4 +-
.../commits.rst | 16 +-
.../apache-airflow-providers-apache-hive/index.rst | 8 +-
.../commits.rst | 17 +-
.../index.rst | 4 +-
.../commits.rst | 27 +-
.../apache-airflow-providers-apache-livy/index.rst | 8 +-
.../commits.rst | 17 +-
docs/apache-airflow-providers-apache-pig/index.rst | 4 +-
.../commits.rst | 16 +-
.../index.rst | 4 +-
.../commits.rst | 19 +-
.../index.rst | 4 +-
.../commits.rst | 15 +-
.../index.rst | 4 +-
docs/apache-airflow-providers-asana/commits.rst | 27 +-
docs/apache-airflow-providers-asana/index.rst | 17 +-
docs/apache-airflow-providers-cloudant/commits.rst | 15 +-
docs/apache-airflow-providers-cloudant/index.rst | 4 +-
.../commits.rst | 18 +-
docs/apache-airflow-providers-databricks/index.rst | 6 +-
docs/apache-airflow-providers-datadog/commits.rst | 16 +-
docs/apache-airflow-providers-datadog/index.rst | 4 +-
docs/apache-airflow-providers-dingding/commits.rst | 17 +-
docs/apache-airflow-providers-dingding/index.rst | 8 +-
docs/apache-airflow-providers-discord/commits.rst | 15 +-
docs/apache-airflow-providers-discord/index.rst | 8 +-
docs/apache-airflow-providers-docker/commits.rst | 14 +
docs/apache-airflow-providers-docker/index.rst | 4 +-
.../commits.rst | 26 +
.../index.rst | 4 +-
docs/apache-airflow-providers-exasol/commits.rst | 16 +-
docs/apache-airflow-providers-exasol/index.rst | 4 +-
docs/apache-airflow-providers-facebook/commits.rst | 15 +-
docs/apache-airflow-providers-facebook/index.rst | 4 +-
docs/apache-airflow-providers-ftp/commits.rst | 18 +-
docs/apache-airflow-providers-ftp/index.rst | 4 +-
docs/apache-airflow-providers-google/commits.rst | 24 +
docs/apache-airflow-providers-google/index.rst | 12 +-
.../operators/cloud/bigquery.rst | 17 -
.../operators/cloud/datafusion.rst | 26 +-
.../{gcs_to_sheets.rst => sql_to_sheets.rst} | 21 +-
docs/apache-airflow-providers-grpc/commits.rst | 18 +-
docs/apache-airflow-providers-grpc/index.rst | 12 +-
.../apache-airflow-providers-hashicorp/commits.rst | 20 +-
docs/apache-airflow-providers-hashicorp/index.rst | 8 +-
docs/apache-airflow-providers-http/commits.rst | 21 +-
docs/apache-airflow-providers-http/index.rst | 15 +-
docs/apache-airflow-providers-imap/commits.rst | 15 +-
docs/apache-airflow-providers-imap/index.rst | 4 +-
docs/apache-airflow-providers-jdbc/commits.rst | 18 +-
docs/apache-airflow-providers-jdbc/index.rst | 4 +-
docs/apache-airflow-providers-jenkins/commits.rst | 13 +
docs/apache-airflow-providers-jenkins/index.rst | 4 +-
docs/apache-airflow-providers-jira/commits.rst | 18 +-
docs/apache-airflow-providers-jira/index.rst | 4 +-
.../commits.rst | 14 +
.../index.rst | 8 +-
.../commits.rst | 18 +-
.../index.rst | 4 +-
.../commits.rst | 24 +-
.../index.rst | 34 ++
.../commits.rst | 17 +-
.../index.rst | 4 +-
docs/apache-airflow-providers-mongo/commits.rst | 16 +-
docs/apache-airflow-providers-mongo/index.rst | 6 +-
docs/apache-airflow-providers-mysql/commits.rst | 14 +
docs/apache-airflow-providers-mysql/index.rst | 16 +-
docs/apache-airflow-providers-neo4j/commits.rst | 18 +-
docs/apache-airflow-providers-neo4j/index.rst | 4 +-
docs/apache-airflow-providers-odbc/commits.rst | 18 +-
docs/apache-airflow-providers-odbc/index.rst | 4 +-
docs/apache-airflow-providers-opsgenie/commits.rst | 18 +-
docs/apache-airflow-providers-opsgenie/index.rst | 8 +-
docs/apache-airflow-providers-oracle/commits.rst | 19 +-
docs/apache-airflow-providers-oracle/index.rst | 4 +-
.../apache-airflow-providers-pagerduty/commits.rst | 16 +-
docs/apache-airflow-providers-pagerduty/index.rst | 4 +-
.../apache-airflow-providers-papermill/commits.rst | 15 +-
docs/apache-airflow-providers-papermill/index.rst | 4 +-
docs/apache-airflow-providers-plexus/commits.rst | 15 +-
docs/apache-airflow-providers-plexus/index.rst | 4 +-
docs/apache-airflow-providers-postgres/commits.rst | 16 +
docs/apache-airflow-providers-postgres/index.rst | 8 +-
docs/apache-airflow-providers-presto/commits.rst | 18 +-
docs/apache-airflow-providers-presto/index.rst | 4 +-
docs/apache-airflow-providers-qubole/commits.rst | 19 +-
docs/apache-airflow-providers-qubole/index.rst | 4 +-
docs/apache-airflow-providers-redis/commits.rst | 15 +-
docs/apache-airflow-providers-redis/index.rst | 4 +-
.../commits.rst | 16 +-
docs/apache-airflow-providers-salesforce/index.rst | 8 +-
docs/apache-airflow-providers-samba/commits.rst | 16 +-
docs/apache-airflow-providers-samba/index.rst | 4 +-
docs/apache-airflow-providers-segment/commits.rst | 18 +-
docs/apache-airflow-providers-segment/index.rst | 4 +-
docs/apache-airflow-providers-sendgrid/commits.rst | 16 +-
docs/apache-airflow-providers-sendgrid/index.rst | 4 +-
docs/apache-airflow-providers-sftp/commits.rst | 15 +-
docs/apache-airflow-providers-sftp/index.rst | 8 +-
.../commits.rst | 18 +-
.../apache-airflow-providers-singularity/index.rst | 4 +-
docs/apache-airflow-providers-slack/commits.rst | 20 +-
docs/apache-airflow-providers-slack/index.rst | 8 +-
.../apache-airflow-providers-snowflake/commits.rst | 14 +
docs/apache-airflow-providers-snowflake/index.rst | 8 +-
docs/apache-airflow-providers-sqlite/commits.rst | 19 +-
docs/apache-airflow-providers-sqlite/index.rst | 4 +-
docs/apache-airflow-providers-ssh/commits.rst | 16 +-
docs/apache-airflow-providers-ssh/index.rst | 4 +-
docs/apache-airflow-providers-tableau/commits.rst | 14 +
docs/apache-airflow-providers-tableau/index.rst | 4 +-
docs/apache-airflow-providers-telegram/commits.rst | 15 +-
docs/apache-airflow-providers-telegram/index.rst | 4 +-
docs/apache-airflow-providers-trino/commits.rst | 18 +-
docs/apache-airflow-providers-trino/index.rst | 4 +-
docs/apache-airflow-providers-vertica/commits.rst | 18 +-
docs/apache-airflow-providers-vertica/index.rst | 4 +-
docs/apache-airflow-providers-yandex/commits.rst | 20 +-
docs/apache-airflow-providers-yandex/index.rst | 6 +-
docs/apache-airflow-providers-zendesk/commits.rst | 16 +-
docs/apache-airflow-providers-zendesk/index.rst | 4 +-
docs/apache-airflow/executor/dask.rst | 6 +-
docs/apache-airflow/executor/debug.rst | 1 +
docs/apache-airflow/howto/connection.rst | 6 +
docs/apache-airflow/project.rst | 1 +
docs/apache-airflow/security/webserver.rst | 107 ++++
docs/apache-airflow/start/docker.rst | 2 +-
docs/apache-airflow/upgrade-check.rst | 15 +-
scripts/ci/libraries/_initialization.sh | 1 -
scripts/ci/libraries/_script_init.sh | 2 +
.../pre_commit_check_provider_yaml_files.py | 25 +-
scripts/ci/selective_ci_checks.sh | 1 +
scripts/in_container/prod/entrypoint_prod.sh | 25 +-
setup.py | 19 +-
tests/always/test_project_structure.py | 46 +-
tests/bats/bats_utils.bash | 2 +
tests/cli/commands/test_celery_command.py | 86 +--
tests/core/test_configuration.py | 37 ++
tests/executors/test_celery_executor.py | 18 +-
tests/executors/test_dask_executor.py | 72 ++-
tests/jobs/test_backfill_job.py | 3 +-
tests/models/test_dag.py | 10 +-
tests/operators/test_bash.py | 35 +-
tests/operators/test_weekday.py | 30 +-
.../amazon/aws/hooks/test_emr_containers.py | 57 ++
.../amazon/aws/operators/test_emr_containers.py | 136 +++++
.../amazon/aws/sensors/test_emr_containers.py | 72 +++
.../amazon/aws/sensors/test_s3_keys_unchanged.py | 13 +-
.../amazon/aws/transfers/test_s3_to_sftp.py | 11 +-
.../amazon/aws/transfers/test_sftp_to_s3.py | 11 +-
tests/providers/apache/hive/hooks/test_hive.py | 9 +-
.../apache/hive/transfers/test_mysql_to_hive.py | 576 ++++++---------------
.../google/cloud/hooks/test_bigquery_system.py | 4 +
.../google/cloud/hooks/test_kms_system.py | 6 +
.../cloud/hooks/test_secret_manager_system.py | 6 +
.../cloud/log/test_gcs_task_handler_system.py | 2 +
.../log/test_stackdriver_task_handler_system.py | 11 +-
.../google/cloud/operators/test_automl_system.py | 12 +
.../google/cloud/operators/test_bigtable_system.py | 3 +
.../cloud/operators/test_cloud_sql_system.py | 9 +
.../test_cloud_storage_transfer_service_system.py | 6 +
.../cloud/operators/test_datacatalog_system.py | 6 +
.../google/cloud/operators/test_dataflow_system.py | 4 +
.../google/cloud/operators/test_datafusion.py | 32 ++
.../cloud/operators/test_datafusion_system.py | 2 +
.../google/cloud/operators/test_dataprep_system.py | 1 +
.../google/cloud/operators/test_dlp_system.py | 6 +
.../cloud/operators/test_functions_system.py | 6 +
.../cloud/operators/test_kubernetes_engine.py | 59 ++-
.../operators/test_kubernetes_engine_system.py | 6 +
.../google/cloud/operators/test_mlengine.py | 40 ++
.../google/cloud/operators/test_mlengine_utils.py | 25 +-
.../operators/test_natural_language_system.py | 6 +
.../google/cloud/operators/test_pubsub_system.py | 6 +
.../google/cloud/operators/test_spanner_system.py | 3 +
.../cloud/operators/test_stackdriver_system.py | 6 +
.../google/cloud/operators/test_tasks_system.py | 6 +
.../cloud/operators/test_translate_system.py | 6 +
.../operators/test_video_intelligence_system.py | 2 +-
.../cloud/operators/test_workflows_system.py | 6 +
.../cloud/secrets/test_secret_manager_system.py | 4 +
.../google/cloud/sensors/test_datafusion.py | 75 +++
tests/providers/google/cloud/sensors/test_gcs.py | 12 +-
.../test_azure_fileshare_to_gcs_system.py | 6 +
.../transfers/test_bigquery_to_bigquery_system.py | 6 +
.../transfers/test_facebook_ads_to_gcs_system.py | 6 +
.../cloud/transfers/test_gcs_to_bigquery_system.py | 6 +
.../transfers/test_salesforce_to_gcs_system.py | 6 +
.../cloud/utils/test_mlengine_operator_utils.py | 44 +-
.../leveldb/operators/test_leveldb_system.py | 6 +
.../operators/test_analytics_system.py | 6 +
.../google/suite/operators/test_sheets_system.py | 6 +
.../google/suite/transfers/test_sql_to_sheets.py | 65 +++
.../_internal_client/test_vault_client.py | 27 +
tests/providers/sftp/operators/test_sftp.py | 11 +-
tests/providers/ssh/operators/test_ssh.py | 12 +-
tests/sensors/test_date_time.py | 12 +-
tests/sensors/test_time_sensor.py | 22 +-
tests/sensors/test_weekday_sensor.py | 21 +-
tests/serialization/test_dag_serialization.py | 108 +++-
.../task/task_runner/test_standard_task_runner.py | 56 +-
tests/test_utils/gcp_system_helpers.py | 4 +-
tests/test_utils/mock_process.py | 23 +-
tests/test_utils/timetables.py | 17 +
tests/utils/{test_types.py => test_state.py} | 19 +-
tests/utils/test_weekday.py | 44 ++
tests/www/test_security.py | 21 +
tests/www/views/test_views_acl.py | 34 +-
tests/www/views/test_views_base.py | 52 +-
tests/www/views/test_views_home.py | 187 +++++++
.../www/views/test_views_robots.py | 8 +-
526 files changed, 7775 insertions(+), 2339 deletions(-)
create mode 100644 .github/ISSUE_TEMPLATE/airflow_bug_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_doc_issue_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_helmchart_bug_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_providers_bug_report.yml
delete mode 100644 .github/ISSUE_TEMPLATE/bug_report.md
delete mode 100644 .github/ISSUE_TEMPLATE/feature_request.md
create mode 100644 .github/ISSUE_TEMPLATE/feature_request.yml
create mode 100644 .github/ISSUE_TEMPLATE/~free_form.yml
create mode 100644 airflow/providers/amazon/aws/example_dags/example_emr_eks_job.py
create mode 100644 airflow/providers/amazon/aws/hooks/emr_containers.py
create mode 100644 airflow/providers/amazon/aws/operators/emr_containers.py
copy airflow/providers/amazon/aws/sensors/{athena.py => emr_containers.py} (61%)
create mode 100644 airflow/providers/google/cloud/sensors/datafusion.py
copy airflow/providers/google/{cloud/example_dags/example_sheets_to_gcs.py => suite/example_dags/example_sql_to_sheets.py} (67%)
copy airflow/providers/google/suite/transfers/{gcs_to_sheets.py => sql_to_sheets.py} (56%)
delete mode 100644 airflow/timetables/schedules.py
copy tests/dags/test_logging_in_dag.py => airflow/www/extensions/init_robots.py (58%)
create mode 100644 airflow/www/static/robots.txt
rename airflow/www/templates/airflow/{no_roles.html => no_roles_permissions.html} (96%)
create mode 100644 docs/apache-airflow-providers-amazon/operators/emr_eks.rst
copy docs/apache-airflow-providers-google/operators/transfer/{gcs_to_sheets.rst => sql_to_sheets.rst} (68%)
create mode 100644 tests/providers/amazon/aws/hooks/test_emr_containers.py
create mode 100644 tests/providers/amazon/aws/operators/test_emr_containers.py
create mode 100644 tests/providers/amazon/aws/sensors/test_emr_containers.py
create mode 100644 tests/providers/google/cloud/sensors/test_datafusion.py
create mode 100644 tests/providers/google/suite/transfers/test_sql_to_sheets.py
copy tests/utils/{test_types.py => test_state.py} (76%)
create mode 100644 tests/www/views/test_views_home.py
copy airflow/cli/commands/version_command.py => tests/www/views/test_views_robots.py (82%)