You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2021/02/27 16:41:11 UTC
[airflow] tag providers-mysql/1.0.2rc1 updated (a615aaa -> 589d6de)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag providers-mysql/1.0.2rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag providers-mysql/1.0.2rc1 was modified! ***
from a615aaa (commit)
to 589d6de (commit)
from a615aaa Added Intellischool (#14330)
add f288da5 Fix various typos (#14335)
add 003a549 Remove redundant parentheses from Python file (#14336)
add 1b82c24 Docs: Corrected code example description (#14339)
add 49952e7 Fixes failing test_views tests. (#14341)
add 82cb041 Attempts to stabilize and improve speed of static checks (#14332)
add a7e4266 Refactor GoogleDriveToGCSOperator to use common methods (#14276)
add d524cec Implements generation of separate constraints for core and providers (#14227)
add 79ffe03 Fix spelling (#14343)
add beed530 Separate resources parameter for kerberos sidecar (#14342)
add ca35bd7 By default PIP will install all packages in .local folder (#14125)
add cc9827d Fix some tests failures after pylint fixes (#14350)
add 6019c78 Pprint default args and wrap (#14345)
add a48bedf Fix spelling in "ignorable" (#14348)
add 0891a8e Split webserver config from configmap (#14353)
add 3a046fa Remove testfixtures module that is only used once (#14318)
add b7d9c34 Fix caching of python images during builds (#14347)
add dd5c5d9 Remove duplicated clean_db function for ImportErrors (#14296)
add 6c6b77a Fix permission error on non-POSIX filesystem (#13121)
add e363ac1 Fixed URL typo for Intellischool (#14372)
add 25fa309 Easy switching between GitHub Container Registries (#14120)
add 4fb943c Fix grammar in production-deployment.rst (#14386)
add b995127 Fix typo in docker.rst (#14389)
add c281979 Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)
add 4c35955 Add Ephraim to Committers List (#14397)
add 277f7c9 Add Ephraim as a Code Owner for the Stable REST API (#14401)
add 809b4f9 Unique pod name (#14186)
add f70257f Add Cross reference for Accessing Task Context in TaskFlow API (#14405)
add 3dc762c Sort Committers via their names instead of usernames (#14403)
add 0d6cae4 Avoid using threads in S3 remote logging uplod (#14414)
add 352b970 correct email-config.rst path (#14408)
add 3125a70 Add cross-reference for Context Dictionary (#14428)
add e121812 Replace deprecated doc links to the correct one (#14429)
add f3bc8ab Pre-commit cache is tied to a specific python version (#14430)
add 8021597 Pin moto to <2 (#14433)
add fe31137 Upgrade to newer dependencies only set when setup changed for PR (#14437)
add c069e64 Improve boring-cyborg file (#14442)
add f763b7c Make TaskInstance.pool_slots not nullable with a default of 1 (#14406)
add 5bfa0f1 BugFix: Fix remote log in azure storage blob displays in one line (#14313)
add c4da66c Add PATH to basic_static_checks. (#14451)
add 5a3207e Add Snowflake provider to boring cyborg automation (#14432)
add 7f79b12 Further Improvements to boring cyborg file (#14444)
add ab72b05 Fix pylint pre-commit checks when only todo files are changed (#14453)
add 45e72ca Add Tableau provider separate from Salesforce Provider (#14030)
add 258ec5d Fix logging error with task error when JSON logging is enabled (#14456)
add 997a009 Gracefully handle missing start_date and end_date for DagRun (#14452)
add 64cf2ae Fixes date command in breeze build-image to work on MacOS (#14458)
add 21f2974 Fix crash when user clicks on "Task Instance Details" caused by start_date being None (#14416)
add c71f707 Make airflow dags show command display TaskGroup (#14269)
add 4455f14 Fix failing docs build on Master (#14465)
add 2b5d4e3 Unable to trigger backfill or manual jobs with Kubernetes executor. (#14160)
add 40a3e33 Rendering of IMAGES.rst was broken due to wrong header (#14471)
add e05ba51 Speed up tests by moving app instantiation to class method (#14329)
add 31acf95 Add plugins endpoint to the REST API (#14280)
add b16b9ee Don't create unittest.cfg when not running in unit test mode (#14420)
add 59c459f BugFix: Serialize max_retry_delay as a timedelta (#14436)
add 09f9677 Fix missing HTTPS on link (#14479)
add cfa1071 Updates docs to include docker resource requirements for quickstart (#14464)
add 0aa597e Fix statsd metrics not sending when using daemon mode (#14454)
add 8c5e618 Fix spelling (#14472)
add 554ef43 Use click for building prepare_provider_packages.py CLI (#14480)
add 11d03d2 Add Azure Data Factory hook (#11015)
add 8ad2f9c Removes DigitalOcean from INTHEWILD.md (#14488)
add 4a54292 Log all breeze output to a file automatically (#14470)
add aa28e4e Adds --dry-run-docker flag to just print the docker commands (#14468)
add 33214d9 Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)
add 3eceb26 Fix broken docs build on Master (#14496)
add 77f5629 Update docs about tableau and salesforce provider (#14495)
add bfef559 Corrects order of argument in docstring in GCSHook.download method (#14497)
add 13854c3 Adding support to put extra arguments for Glue Job. (#14027)
add ffc68bc Allow your own Docker production image to be verified by bash script (#14224)
add 0ecebad Add docs about supported logging levels (#14507)
add afb3432 Replace Stale Bot with Stale Github Action (#14494)
add 50a1504 Fix spellings (#14483)
add f9cc775 Fix breeze redirect on macOS (#14506)
add 589d6de Prepare to release the next wave of providers: (#14487)
No new revisions were added by this update.
Summary of changes:
.dockerignore | 1 +
.github/CODEOWNERS | 3 +-
.github/boring-cyborg.yml | 99 ++-
.github/stale.yml | 72 ---
.github/workflows/build-images-workflow-run.yml | 8 +-
.github/workflows/ci.yml | 146 ++++-
.github/workflows/scheduled_quarantined.yml | 5 +-
.../provider.yaml => .github/workflows/stale.yml | 43 +-
.pre-commit-config.yaml | 31 +-
BREEZE.rst | 132 +++-
CI.rst | 126 +++-
CONTRIBUTING.rst | 77 ++-
Dockerfile | 18 +-
Dockerfile.ci | 16 +-
IMAGES.rst | 71 +-
INSTALL | 10 +-
INTHEWILD.md | 3 +-
README.md | 2 +-
UPDATING.md | 4 +-
.../endpoints/plugin_endpoint.py} | 36 +-
airflow/api_connexion/openapi/v1.yaml | 100 ++-
airflow/api_connexion/schemas/plugin_schema.py | 54 ++
airflow/cli/cli_parser.py | 4 +-
airflow/cli/commands/plugins_command.py | 27 +-
airflow/cli/commands/webserver_command.py | 2 +-
airflow/config_templates/config.yml | 8 +-
airflow/config_templates/default_airflow.cfg | 8 +-
airflow/configuration.py | 293 ++++++---
.../example_external_task_marker_dag.py | 2 +-
airflow/example_dags/tutorial_taskflow_api_etl.py | 2 +-
airflow/executors/celery_executor.py | 6 +-
airflow/jobs/backfill_job.py | 1 +
airflow/kubernetes/refresh_config.py | 3 +-
.../8646922c8a04_change_default_pool_slots_to_1.py | 93 +++
.../versions/cf5dc11e79ad_drop_user_and_chart.py | 2 +-
airflow/models/baseoperator.py | 9 +-
airflow/models/dag.py | 2 +-
airflow/models/dagbag.py | 6 +-
airflow/models/dagrun.py | 10 +-
airflow/models/taskinstance.py | 12 +-
airflow/operators/druid_check_operator.py | 2 +-
airflow/operators/sql.py | 198 +++---
airflow/plugins_manager.py | 34 +
airflow/providers/amazon/ADDITIONAL_INFO.md | 9 +
.../amazon/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 14 +
.../providers/amazon/BACKPORT_PROVIDER_README.md | 26 +-
airflow/providers/amazon/CHANGELOG.rst | 11 +
airflow/providers/amazon/aws/hooks/glue.py | 9 +-
airflow/providers/amazon/aws/hooks/s3.py | 20 +-
.../amazon/aws/log/cloudwatch_task_handler.py | 6 +-
.../providers/amazon/aws/log/s3_task_handler.py | 8 +-
airflow/providers/amazon/aws/operators/glue.py | 5 +
airflow/providers/amazon/provider.yaml | 1 +
.../apache/{hive => beam}/ADDITIONAL_INFO.md | 5 +-
.../beam/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 8 +
.../apache/beam/BACKPORT_PROVIDER_README.md | 18 +-
airflow/providers/apache/beam/CHANGELOG.rst | 9 +
airflow/providers/apache/beam/provider.yaml | 1 +
.../{sftp => apache/druid}/ADDITIONAL_INFO.md | 4 +-
.../druid/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 29 +
.../apache/druid/BACKPORT_PROVIDER_README.md | 60 +-
airflow/providers/apache/druid/CHANGELOG.rst | 8 +
airflow/providers/apache/druid/hooks/druid.py | 2 +
.../apache/druid/operators/druid_check.py | 78 +--
airflow/providers/apache/druid/provider.yaml | 4 +
airflow/providers/apache/hive/ADDITIONAL_INFO.md | 6 +
.../hive/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../apache/hive/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/apache/hive/CHANGELOG.rst | 9 +
airflow/providers/apache/hive/provider.yaml | 1 +
.../spark}/ADDITIONAL_INFO.md | 4 +-
.../spark/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 28 +
.../apache/spark/BACKPORT_PROVIDER_README.md | 39 +-
airflow/providers/apache/spark/CHANGELOG.rst | 9 +
airflow/providers/apache/spark/provider.yaml | 1 +
.../providers/cncf/kubernetes/ADDITIONAL_INFO.md | 7 +
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 10 +
.../cncf/kubernetes/BACKPORT_PROVIDER_README.md | 20 +-
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 9 +
.../cncf/kubernetes/operators/kubernetes_pod.py | 2 +-
airflow/providers/cncf/kubernetes/provider.yaml | 1 +
airflow/providers/dependencies.json | 3 +
.../{elasticsearch => dingding}/ADDITIONAL_INFO.md | 4 +-
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 30 +
.../providers/dingding/BACKPORT_PROVIDER_README.md | 41 +-
airflow/providers/dingding/CHANGELOG.rst | 8 +
.../dingding/example_dags/example_dingding.py | 6 +-
airflow/providers/dingding/provider.yaml | 1 +
airflow/providers/docker/ADDITIONAL_INFO.md | 6 +
.../docker/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/docker/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/docker/CHANGELOG.rst | 8 +
airflow/providers/docker/provider.yaml | 1 +
airflow/providers/elasticsearch/ADDITIONAL_INFO.md | 7 +
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../elasticsearch/BACKPORT_PROVIDER_README.md | 17 +-
airflow/providers/elasticsearch/CHANGELOG.rst | 8 +
airflow/providers/elasticsearch/provider.yaml | 1 +
.../exasol/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/exasol/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/exasol/CHANGELOG.rst | 8 +
airflow/providers/exasol/provider.yaml | 1 +
airflow/providers/google/ADDITIONAL_INFO.md | 19 +
.../google/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 23 +
.../providers/google/BACKPORT_PROVIDER_README.md | 50 +-
airflow/providers/google/CHANGELOG.rst | 22 +
.../google/cloud/example_dags/example_dlp.py | 31 +
.../google/cloud/example_dags/example_gcs.py | 40 ++
.../cloud/example_dags/example_life_sciences.py | 4 +-
airflow/providers/google/cloud/hooks/gcs.py | 4 +-
.../providers/google/cloud/operators/bigquery.py | 43 +-
.../providers/google/cloud/operators/compute.py | 2 +-
.../providers/google/cloud/operators/functions.py | 1 +
.../google/cloud/transfers/gdrive_to_gcs.py | 60 +-
.../providers/google/cloud/transfers/sql_to_gcs.py | 2 +-
.../google/common/utils/id_token_credentials.py | 4 +-
airflow/providers/google/provider.yaml | 3 +-
.../{elasticsearch => http}/ADDITIONAL_INFO.md | 4 +-
.../http/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
airflow/providers/http/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/http/CHANGELOG.rst | 9 +
airflow/providers/http/provider.yaml | 1 +
.../{openfaas => jenkins}/ADDITIONAL_INFO.md | 4 +-
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 30 +
.../providers/jenkins/BACKPORT_PROVIDER_README.md | 45 +-
airflow/providers/jenkins/CHANGELOG.rst | 8 +
airflow/providers/jenkins/provider.yaml | 1 +
.../hive => microsoft/azure}/ADDITIONAL_INFO.md | 10 +-
.../azure/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 10 +
.../microsoft/azure/BACKPORT_PROVIDER_README.md | 41 +-
airflow/providers/microsoft/azure/CHANGELOG.rst | 13 +
.../microsoft/azure/hooks/azure_data_factory.py | 716 +++++++++++++++++++++
airflow/providers/microsoft/azure/hooks/wasb.py | 2 +-
.../microsoft/azure/log/wasb_task_handler.py | 16 +-
airflow/providers/microsoft/azure/provider.yaml | 9 +
airflow/providers/mysql/ADDITIONAL_INFO.md | 8 +-
.../mysql/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 8 +
.../providers/mysql/BACKPORT_PROVIDER_README.md | 19 +-
airflow/providers/mysql/CHANGELOG.rst | 8 +
airflow/providers/mysql/provider.yaml | 1 +
.../{elasticsearch => neo4j}/ADDITIONAL_INFO.md | 4 +-
.../neo4j/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/neo4j/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/neo4j/CHANGELOG.rst | 9 +
airflow/providers/neo4j/provider.yaml | 1 +
airflow/providers/openfaas/ADDITIONAL_INFO.md | 6 +
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/openfaas/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/openfaas/CHANGELOG.rst | 9 +
airflow/providers/openfaas/provider.yaml | 1 +
airflow/providers/papermill/ADDITIONAL_INFO.md | 7 +
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../papermill/BACKPORT_PROVIDER_README.md | 17 +-
airflow/providers/papermill/CHANGELOG.rst | 9 +
airflow/providers/papermill/provider.yaml | 1 +
airflow/providers/presto/ADDITIONAL_INFO.md | 6 +
.../presto/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/presto/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/presto/CHANGELOG.rst | 8 +
airflow/providers/presto/provider.yaml | 1 +
.../providers/{sftp => qubole}/ADDITIONAL_INFO.md | 4 +-
.../qubole/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 30 +
.../providers/qubole/BACKPORT_PROVIDER_README.md | 41 +-
airflow/providers/qubole/CHANGELOG.rst | 8 +
airflow/providers/qubole/operators/qubole.py | 10 +-
airflow/providers/qubole/operators/qubole_check.py | 124 ++--
airflow/providers/qubole/provider.yaml | 1 +
.../{mysql => salesforce}/ADDITIONAL_INFO.md | 9 +
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 28 +
.../salesforce/BACKPORT_PROVIDER_README.md | 96 ++-
airflow/providers/salesforce/CHANGELOG.rst | 17 +
airflow/providers/salesforce/hooks/tableau.py | 104 +--
.../operators/tableau_refresh_workbook.py | 88 +--
airflow/providers/salesforce/provider.yaml | 5 +-
.../salesforce/sensors/tableau_job_status.py | 68 +-
airflow/providers/sendgrid/ADDITIONAL_INFO.md | 6 +
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/sendgrid/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/sendgrid/CHANGELOG.rst | 8 +
airflow/providers/sendgrid/provider.yaml | 1 +
airflow/providers/sftp/ADDITIONAL_INFO.md | 6 +
.../sftp/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
airflow/providers/sftp/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/sftp/CHANGELOG.rst | 9 +
airflow/providers/sftp/provider.yaml | 1 +
airflow/providers/slack/ADDITIONAL_INFO.md | 10 +-
.../slack/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 8 +
.../providers/slack/BACKPORT_PROVIDER_README.md | 21 +-
airflow/providers/slack/CHANGELOG.rst | 9 +
airflow/providers/slack/provider.yaml | 1 +
airflow/providers/snowflake/ADDITIONAL_INFO.md | 6 +
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../snowflake/BACKPORT_PROVIDER_README.md | 19 +-
airflow/providers/snowflake/CHANGELOG.rst | 9 +
airflow/providers/snowflake/provider.yaml | 1 +
airflow/providers/sqlite/ADDITIONAL_INFO.md | 6 +
.../sqlite/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/sqlite/BACKPORT_PROVIDER_README.md | 16 +-
airflow/providers/sqlite/CHANGELOG.rst | 9 +
airflow/providers/sqlite/provider.yaml | 1 +
airflow/providers/ssh/ADDITIONAL_INFO.md | 6 +
.../ssh/BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 8 +
airflow/providers/ssh/BACKPORT_PROVIDER_README.md | 17 +-
airflow/providers/ssh/CHANGELOG.rst | 8 +
airflow/providers/ssh/provider.yaml | 1 +
.../{exasol => tableau}/ADDITIONAL_INFO.md | 6 +-
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 7 +
.../providers/tableau/BACKPORT_PROVIDER_README.md | 114 ++++
.../{apache/beam => tableau}/CHANGELOG.rst | 0
.../providers/tableau}/__init__.py | 0
.../providers/tableau/example_dags}/__init__.py | 0
.../example_tableau_refresh_workbook.py | 4 +-
.../providers/tableau/hooks}/__init__.py | 0
.../{salesforce => tableau}/hooks/tableau.py | 0
.../providers/tableau/operators}/__init__.py | 0
.../operators/tableau_refresh_workbook.py | 4 +-
airflow/providers/{slack => tableau}/provider.yaml | 31 +-
.../providers/tableau/sensors}/__init__.py | 0
.../sensors/tableau_job_status.py | 2 +-
.../BACKPORT_PROVIDER_CHANGES_2021.03.03.md | 15 +
.../providers/telegram/BACKPORT_PROVIDER_README.md | 105 +++
airflow/providers/telegram/CHANGELOG.rst | 8 +
airflow/providers/telegram/provider.yaml | 1 +
airflow/serialization/schema.json | 1 +
airflow/serialization/serialized_objects.py | 3 +-
airflow/settings.py | 2 +-
airflow/stats.py | 28 +-
airflow/ti_deps/dep_context.py | 2 +-
airflow/ti_deps/deps/base_ti_dep.py | 6 +-
airflow/ti_deps/deps/dag_ti_slots_available_dep.py | 2 +-
airflow/ti_deps/deps/dag_unpaused_dep.py | 2 +-
airflow/ti_deps/deps/dagrun_exists_dep.py | 2 +-
airflow/ti_deps/deps/dagrun_id_dep.py | 2 +-
.../ti_deps/deps/exec_date_after_start_date_dep.py | 2 +-
airflow/ti_deps/deps/not_in_retry_period_dep.py | 2 +-
airflow/ti_deps/deps/not_previously_skipped_dep.py | 2 +-
airflow/ti_deps/deps/pool_slots_available_dep.py | 2 +-
airflow/ti_deps/deps/prev_dagrun_dep.py | 2 +-
airflow/ti_deps/deps/ready_to_reschedule.py | 2 +-
airflow/ti_deps/deps/runnable_exec_date_dep.py | 2 +-
airflow/ti_deps/deps/task_concurrency_dep.py | 2 +-
airflow/ti_deps/deps/task_not_running_dep.py | 2 +-
airflow/ti_deps/deps/trigger_rule_dep.py | 2 +-
airflow/ti_deps/deps/valid_state_dep.py | 2 +-
airflow/utils/db.py | 2 +-
airflow/utils/dot_renderer.py | 120 +++-
airflow/utils/log/file_task_handler.py | 5 +-
airflow/utils/weekday.py | 1 +
airflow/www/extensions/init_jinja_globals.py | 4 +-
airflow/www/extensions/init_views.py | 2 +-
airflow/www/static/js/datetime_utils.js | 2 +-
airflow/www/static/js/gantt_chart_d3v2.js | 6 +-
airflow/www/templates/airflow/dag_details.html | 2 +-
airflow/www/templates/airflow/task.html | 2 +-
airflow/www/views.py | 8 +-
breeze | 157 ++++-
breeze-complete | 10 +-
chart/README.md | 6 +-
chart/templates/configmaps/configmap.yaml | 5 -
.../templates/configmaps/webserver-configmap.yaml | 33 +-
.../templates/webserver/webserver-deployment.yaml | 8 +-
chart/templates/workers/worker-deployment.yaml | 2 +-
chart/tests/test_kerberos.py | 30 +
chart/tests/test_statsd.py | 2 +-
chart/tests/test_webserver_deployment.py | 18 +
chart/values.schema.json | 3 +
chart/values.yaml | 7 +
dev/README_RELEASE_BACKPORT_PROVIDER_PACKAGES.md | 2 +-
dev/provider_packages/README.md | 17 +-
dev/provider_packages/prepare_provider_packages.py | 257 ++++----
docs/apache-airflow-providers-amazon/commits.rst | 21 +-
docs/apache-airflow-providers-amazon/index.rst | 13 +-
...ecrets-manaager.rst => aws-secrets-manager.rst} | 0
.../commits.rst | 21 +-
.../apache-airflow-providers-apache-beam/index.rst | 11 +-
.../commits.rst | 20 +-
.../index.rst | 10 +-
.../commits.rst | 14 +-
.../apache-airflow-providers-apache-hive/index.rst | 11 +-
.../commits.rst | 20 +-
.../index.rst | 11 +-
.../commits.rst | 17 +-
.../index.rst | 11 +-
docs/apache-airflow-providers-dingding/commits.rst | 20 +-
docs/apache-airflow-providers-dingding/index.rst | 10 +-
docs/apache-airflow-providers-docker/commits.rst | 14 +-
docs/apache-airflow-providers-docker/index.rst | 10 +-
.../commits.rst | 14 +-
.../index.rst | 10 +-
docs/apache-airflow-providers-exasol/commits.rst | 20 +-
docs/apache-airflow-providers-exasol/index.rst | 10 +-
docs/apache-airflow-providers-google/commits.rst | 30 +-
docs/apache-airflow-providers-google/index.rst | 24 +-
.../operators/cloud/data_loss_prevention.rst | 17 +-
.../operators/cloud/dataflow.rst | 2 +-
.../operators/cloud/gcs.rst | 62 +-
docs/apache-airflow-providers-http/commits.rst | 14 +-
docs/apache-airflow-providers-http/index.rst | 11 +-
docs/apache-airflow-providers-jenkins/commits.rst | 20 +-
docs/apache-airflow-providers-jenkins/index.rst | 10 +-
.../commits.rst | 17 +-
.../index.rst | 18 +-
docs/apache-airflow-providers-mysql/commits.rst | 15 +-
docs/apache-airflow-providers-mysql/index.rst | 10 +-
docs/apache-airflow-providers-neo4j/commits.rst | 11 +
docs/apache-airflow-providers-neo4j/index.rst | 11 +-
docs/apache-airflow-providers-openfaas/commits.rst | 20 +-
docs/apache-airflow-providers-openfaas/index.rst | 11 +-
.../apache-airflow-providers-papermill/commits.rst | 20 +-
docs/apache-airflow-providers-papermill/index.rst | 11 +-
docs/apache-airflow-providers-presto/commits.rst | 20 +-
docs/apache-airflow-providers-presto/index.rst | 10 +-
docs/apache-airflow-providers-qubole/commits.rst | 20 +-
docs/apache-airflow-providers-qubole/index.rst | 10 +-
.../commits.rst | 20 +-
docs/apache-airflow-providers-salesforce/index.rst | 38 +-
docs/apache-airflow-providers-sendgrid/commits.rst | 14 +-
docs/apache-airflow-providers-sendgrid/index.rst | 10 +-
docs/apache-airflow-providers-sftp/commits.rst | 15 +-
docs/apache-airflow-providers-sftp/index.rst | 11 +-
docs/apache-airflow-providers-slack/commits.rst | 21 +-
docs/apache-airflow-providers-slack/index.rst | 11 +-
.../apache-airflow-providers-snowflake/commits.rst | 14 +-
docs/apache-airflow-providers-snowflake/index.rst | 14 +-
docs/apache-airflow-providers-sqlite/commits.rst | 20 +-
docs/apache-airflow-providers-sqlite/index.rst | 11 +-
docs/apache-airflow-providers-ssh/commits.rst | 15 +-
docs/apache-airflow-providers-ssh/index.rst | 10 +-
.../commits.rst | 16 +-
.../index.rst | 32 +-
docs/apache-airflow-providers-telegram/commits.rst | 20 +-
docs/apache-airflow-providers-telegram/index.rst | 10 +-
docs/apache-airflow/concepts.rst | 7 +
docs/apache-airflow/extra-packages-ref.rst | 477 +++++++-------
docs/apache-airflow/installation.rst | 75 ++-
docs/apache-airflow/production-deployment.rst | 7 +-
docs/apache-airflow/project.rst | 69 +-
docs/apache-airflow/start/docker.rst | 4 +-
docs/conf.py | 6 +-
docs/exts/airflow_intersphinx.py | 4 +
docs/exts/docs_build/docs_builder.py | 4 +-
docs/exts/docs_build/github_action_utils.py | 2 +-
.../integration-logos/azure/Azure Data Factory.svg | 1 +
docs/integration-logos/tableau/tableau.png | Bin 0 -> 4142 bytes
docs/spelling_wordlist.txt | 7 +-
pylintrc | 4 +-
pylintrc => pylintrc-tests | 11 +-
scripts/ci/docker-compose/_docker.env | 2 +
scripts/ci/docker-compose/local.yml | 1 +
scripts/ci/images/ci_build_dockerhub.sh | 4 +-
scripts/ci/images/ci_prepare_ci_image_on_ci.sh | 2 +-
scripts/ci/images/ci_verify_ci_image.sh | 21 +-
scripts/ci/images/ci_verify_prod_image.sh | 180 +-----
scripts/ci/images/ci_wait_for_all_prod_images.sh | 1 +
scripts/ci/kubernetes/ci_run_kubernetes_tests.sh | 4 +-
scripts/ci/libraries/_all_libs.sh | 2 +
scripts/ci/libraries/_build_images.sh | 57 +-
scripts/ci/libraries/_initialization.sh | 33 +-
scripts/ci/libraries/_local_mounts.sh | 1 +
scripts/ci/libraries/_push_pull_remove_images.sh | 256 ++++----
scripts/ci/libraries/_start_end.sh | 22 +-
scripts/ci/libraries/_verbosity.sh | 9 +-
.../_verify_image.sh} | 136 ++--
.../ci/pre_commit/pre_commit_breeze_cmd_line.sh | 7 +-
.../ci/pre_commit/pre_commit_check_order_setup.py | 35 +-
.../pre_commit_check_setup_extra_packages_ref.py | 77 +--
scripts/ci/selective_ci_checks.sh | 21 +-
scripts/ci/static_checks/pylint.sh | 15 +-
.../ci/static_checks/run_basic_static_checks.sh | 6 +-
scripts/ci/static_checks/run_static_checks.sh | 6 +-
.../verify_docker_image.sh} | 50 +-
scripts/docker/compile_www_assets.sh | 2 +
scripts/docker/install_additional_dependencies.sh | 2 +
scripts/docker/install_airflow.sh | 2 +
.../docker/install_airflow_from_latest_master.sh | 2 +
.../docker/install_from_docker_context_files.sh | 6 +-
scripts/docker/install_mysql.sh | 1 +
scripts/in_container/_in_container_utils.sh | 50 +-
scripts/in_container/run_generate_constraints.sh | 40 +-
.../run_install_and_test_provider_packages.sh | 4 +-
.../run_prepare_provider_documentation.sh | 6 +-
.../in_container/run_prepare_provider_packages.sh | 5 +-
scripts/in_container/run_pylint.sh | 4 +-
setup.py | 114 +++-
tests/airflow_pylint/disable_checks_for_tests.py | 65 --
tests/airflow_pylint/do_not_use_asserts.py | 44 --
tests/always/test_project_structure.py | 6 +-
tests/api/common/experimental/test_mark_tasks.py | 2 +-
.../endpoints/test_plugin_endpoint.py | 182 ++++++
tests/api_connexion/schemas/test_plugin_schema.py | 87 +++
tests/api_connexion/test_error_handling.py | 2 +-
tests/cli/commands/test_task_command.py | 8 +-
tests/core/test_configuration.py | 13 +-
tests/core/test_core_to_contrib.py | 2 +-
tests/core/test_logging_config.py | 5 +-
tests/core/test_providers_manager.py | 2 +
tests/core/test_stats.py | 1 +
tests/deprecated_classes.py | 2 +-
tests/jobs/test_backfill_job.py | 17 +
tests/jobs/test_local_task_job.py | 6 +-
tests/jobs/test_scheduler_job.py | 10 +-
tests/kubernetes/test_pod_generator.py | 2 +-
tests/models/test_dag.py | 4 +-
tests/models/test_dagcode.py | 2 +-
tests/models/test_taskinstance.py | 35 +-
tests/operators/test_python.py | 2 +-
tests/operators/test_sql.py | 137 ++--
tests/plugins/test_plugin.py | 2 +-
tests/providers/amazon/aws/hooks/test_glacier.py | 65 +-
.../amazon/aws/hooks/test_lambda_function.py | 2 +-
tests/providers/amazon/aws/hooks/test_s3.py | 10 +
.../amazon/aws/log/test_cloudwatch_task_handler.py | 6 +-
.../amazon/aws/log/test_s3_task_handler.py | 5 +-
tests/providers/amazon/aws/sensors/test_s3_key.py | 1 +
.../apache/druid/operators/test_druid_check.py | 65 --
tests/providers/apache/hive/hooks/test_hive.py | 1 +
.../apache/spark/hooks/test_spark_submit.py | 4 +-
.../apache/spark/operators/test_spark_submit.py | 6 +-
tests/providers/dingding/hooks/test_dingding.py | 6 +-
.../providers/google/cloud/hooks/test_bigquery.py | 2 +
.../google/cloud/hooks/test_compute_ssh.py | 2 +-
.../providers/google/cloud/hooks/test_dataflow.py | 14 +-
tests/providers/google/cloud/hooks/test_gcs.py | 8 +-
.../google/cloud/hooks/test_speech_to_text.py | 2 +-
.../google/cloud/hooks/test_stackdriver.py | 1 +
.../cloud/log/test_stackdriver_task_handler.py | 8 +-
.../google/cloud/operators/test_bigquery.py | 45 +-
.../operators/test_cloud_sql_system_helper.py | 4 +-
.../cloud/operators/test_compute_system_helper.py | 4 +-
.../google/cloud/operators/test_dataflow.py | 2 +-
.../google/cloud/operators/test_datafusion.py | 18 +-
.../google/cloud/operators/test_dlp_system.py | 4 +
.../google/cloud/operators/test_gcs_system.py | 4 +
.../cloud/operators/test_natural_language.py | 4 +-
.../google/cloud/sensors/test_dataflow.py | 2 +-
.../google/cloud/transfers/test_gdrive_to_gcs.py | 60 +-
.../google/cloud/transfers/test_gdrive_to_local.py | 9 +-
.../marketing_platform/hooks/test_display_video.py | 2 +-
.../operators/test_display_video.py | 2 +-
tests/providers/google/suite/hooks/test_sheets.py | 2 +-
.../azure/hooks/test_azure_data_factory.py | 439 +++++++++++++
.../microsoft/azure/log/test_wasb_task_handler.py | 10 +-
.../qubole/operators/test_qubole_check.py | 67 +-
tests/providers/qubole/sensors/test_qubole.py | 2 +-
.../providers/salesforce/hooks/test_salesforce.py | 2 +-
tests/providers/sendgrid/utils/test_emailer.py | 8 +-
.../snowflake/transfers/test_snowflake_to_slack.py | 2 +-
.../tableau/hooks}/__init__.py | 0
.../{salesforce => tableau}/hooks/test_tableau.py | 32 +-
.../hooks => tableau/operators}/__init__.py | 0
.../operators/test_tableau_refresh_workbook.py | 26 +-
.../{zendesk/hooks => tableau/sensors}/__init__.py | 0
.../sensors/test_tableau_job_status.py | 16 +-
tests/sensors/test_smart_sensor_operator.py | 8 +-
tests/serialization/test_dag_serialization.py | 4 +
tests/test_utils/config.py | 2 +
tests/test_utils/db.py | 5 -
tests/test_utils/perf/dags/elastic_dag.py | 3 +-
tests/test_utils/perf/sql_queries.py | 2 +-
.../deps/test_dag_ti_slots_available_dep.py | 1 +
tests/ti_deps/deps/test_dag_unpaused_dep.py | 1 +
tests/ti_deps/deps/test_dagrun_exists_dep.py | 1 +
tests/ti_deps/deps/test_dagrun_id_dep.py | 1 +
tests/ti_deps/deps/test_not_in_retry_period_dep.py | 1 +
.../ti_deps/deps/test_pool_slots_available_dep.py | 2 +
tests/ti_deps/deps/test_prev_dagrun_dep.py | 1 +
tests/ti_deps/deps/test_ready_to_reschedule_dep.py | 1 +
tests/ti_deps/deps/test_runnable_exec_date_dep.py | 3 +-
tests/ti_deps/deps/test_task_concurrency.py | 1 +
tests/ti_deps/deps/test_task_not_running_dep.py | 1 +
tests/ti_deps/deps/test_trigger_rule_dep.py | 1 +
tests/ti_deps/deps/test_valid_state_dep.py | 1 +
tests/utils/test_dot_renderer.py | 101 ++-
tests/www/test_views.py | 30 +-
474 files changed, 7633 insertions(+), 2895 deletions(-)
delete mode 100644 .github/stale.yml
copy airflow/providers/elasticsearch/provider.yaml => .github/workflows/stale.yml (53%)
copy airflow/{providers/elasticsearch/provider.yaml => api_connexion/endpoints/plugin_endpoint.py} (50%)
create mode 100644 airflow/api_connexion/schemas/plugin_schema.py
create mode 100644 airflow/migrations/versions/8646922c8a04_change_default_pool_slots_to_1.py
create mode 100644 airflow/providers/amazon/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/apache/{hive => beam}/ADDITIONAL_INFO.md (81%)
create mode 100644 airflow/providers/apache/beam/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{sftp => apache/druid}/ADDITIONAL_INFO.md (90%)
create mode 100644 airflow/providers/apache/druid/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/apache/hive/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{elasticsearch => apache/spark}/ADDITIONAL_INFO.md (89%)
create mode 100644 airflow/providers/apache/spark/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/cncf/kubernetes/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{elasticsearch => dingding}/ADDITIONAL_INFO.md (89%)
create mode 100644 airflow/providers/dingding/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/docker/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/elasticsearch/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/exasol/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/google/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{elasticsearch => http}/ADDITIONAL_INFO.md (89%)
create mode 100644 airflow/providers/http/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{openfaas => jenkins}/ADDITIONAL_INFO.md (89%)
create mode 100644 airflow/providers/jenkins/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{apache/hive => microsoft/azure}/ADDITIONAL_INFO.md (82%)
create mode 100644 airflow/providers/microsoft/azure/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/microsoft/azure/hooks/azure_data_factory.py
create mode 100644 airflow/providers/mysql/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{elasticsearch => neo4j}/ADDITIONAL_INFO.md (89%)
create mode 100644 airflow/providers/neo4j/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/openfaas/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/papermill/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/presto/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{sftp => qubole}/ADDITIONAL_INFO.md (90%)
create mode 100644 airflow/providers/qubole/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
copy airflow/providers/{mysql => salesforce}/ADDITIONAL_INFO.md (82%)
create mode 100644 airflow/providers/salesforce/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/sendgrid/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/sftp/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/slack/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/snowflake/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/sqlite/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/ssh/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
rename airflow/providers/{exasol => tableau}/ADDITIONAL_INFO.md (91%)
create mode 100644 airflow/providers/tableau/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/tableau/BACKPORT_PROVIDER_README.md
copy airflow/providers/{apache/beam => tableau}/CHANGELOG.rst (100%)
copy {tests/www/api/experimental => airflow/providers/tableau}/__init__.py (100%)
rename {tests/airflow_pylint => airflow/providers/tableau/example_dags}/__init__.py (100%)
rename airflow/providers/{salesforce => tableau}/example_dags/example_tableau_refresh_workbook.py (92%)
copy {tests/www/api/experimental => airflow/providers/tableau/hooks}/__init__.py (100%)
copy airflow/providers/{salesforce => tableau}/hooks/tableau.py (100%)
copy {tests/providers/zendesk/hooks => airflow/providers/tableau/operators}/__init__.py (100%)
copy airflow/providers/{salesforce => tableau}/operators/tableau_refresh_workbook.py (95%)
copy airflow/providers/{slack => tableau}/provider.yaml (60%)
copy {tests/providers/zendesk/hooks => airflow/providers/tableau/sensors}/__init__.py (100%)
copy airflow/providers/{salesforce => tableau}/sensors/tableau_job_status.py (96%)
create mode 100644 airflow/providers/telegram/BACKPORT_PROVIDER_CHANGES_2021.03.03.md
create mode 100644 airflow/providers/telegram/BACKPORT_PROVIDER_README.md
copy airflow/operators/druid_check_operator.py => chart/templates/configmaps/webserver-configmap.yaml (58%)
rename docs/apache-airflow-providers-amazon/secrets-backends/{aws-secrets-manaager.rst => aws-secrets-manager.rst} (100%)
copy docs/{apache-airflow-providers-apache-beam => apache-airflow-providers-tableau}/commits.rst (77%)
copy docs/{apache-airflow-providers-salesforce => apache-airflow-providers-tableau}/index.rst (82%)
create mode 100644 docs/integration-logos/azure/Azure Data Factory.svg
create mode 100644 docs/integration-logos/tableau/tableau.png
copy pylintrc => pylintrc-tests (98%)
copy scripts/ci/{images/ci_verify_prod_image.sh => libraries/_verify_image.sh} (50%)
mode change 100755 => 100644
copy scripts/ci/{static_checks/run_basic_static_checks.sh => tools/verify_docker_image.sh} (53%)
delete mode 100644 tests/airflow_pylint/disable_checks_for_tests.py
delete mode 100644 tests/airflow_pylint/do_not_use_asserts.py
create mode 100644 tests/api_connexion/endpoints/test_plugin_endpoint.py
create mode 100644 tests/api_connexion/schemas/test_plugin_schema.py
delete mode 100644 tests/providers/apache/druid/operators/test_druid_check.py
create mode 100644 tests/providers/microsoft/azure/hooks/test_azure_data_factory.py
copy tests/{www/api/experimental => providers/tableau/hooks}/__init__.py (100%)
rename tests/providers/{salesforce => tableau}/hooks/test_tableau.py (81%)
copy tests/providers/{zendesk/hooks => tableau/operators}/__init__.py (100%)
rename tests/providers/{salesforce => tableau}/operators/test_tableau_refresh_workbook.py (80%)
copy tests/providers/{zendesk/hooks => tableau/sensors}/__init__.py (100%)
rename tests/providers/{salesforce => tableau}/sensors/test_tableau_job_status.py (84%)