You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by bi...@apache.org on 2021/11/01 05:01:13 UTC
[airflow] branch forked_suprocess_log updated (3491489 -> 2226914)
This is an automated email from the ASF dual-hosted git repository.
binh pushed a change to branch forked_suprocess_log
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard 3491489 Update airflow/task/task_runner/standard_task_runner.py
discard 421e1eb Flush stdout before replace it with pipe
discard bf34a6c fixup! fixup! Redirect forked process output to logger
discard 21c1d3c fixup! Redirect forked process output to logger
discard 89859d5 Redirect forked process output to logger
add 507bca5 Skip failing for undefined variables in MacOS (#15744)
add 231d104 Enforce READ COMMITTED isolation when using mysql (#15714)
add 30eeac7 [Oracle] Add port to DSN (#15589)
add 7933aaf Use "apache/airflow" repository as source of constraints (#15746)
add 41930fd extra docker-py update to resolve docker op issues (#15731)
add feddc51 Add missing docstring params (#15741)
add 350fd62 Remove redundant character escape from regex (#15740)
add 00336ad Small changes on "DAGs and Tasks documentation" (#14853)
add 3711a29 Fix argument ordering and type of bucket and object (#15738)
add 9c8391a Fix spelling (#15699)
add f122e28 Update `SimpleHttpOperator` to take auth object (#15605)
add e7293b0 Mark test_mark_success_on_success_callback as quarantined (#15756)
add dab10d9 MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)
add 25caeda Remove unused dependency (#15762)
add 3edcd12 Update croniter to 1.0.x series (#15769)
add 34cf525 Clean up unnecessary Airflow config in helm chart (#15729)
add cbc3cb8 Add integration test for other executors in kubernetes cluster (#15695)
add 996965a Feature qubole hook support headers (#15683)
add 533f202 Unset PIP_USER in prod entrypoint. (#15774)
add 74c1ce0 Add resolution to force dependencies to use patched version of lodash (#15777)
add 1543bb7 Fixed type annotations in DAG decorator (#15778)
add c8ef3a3 Fix OdbcHook handling of port (#15772)
add 303c89f Return output of last task from task_group wrapper. (#15779)
add 6690758 Bump stylelint to remove vulnerable sub-dependency (#15784)
add c9fc587 Update Flask App Builder limit to recently released 3.3 (#15792)
add 4b473a1 Pin `itsdangerous` to < 2 (#15804)
add 6d64cc5 Chart: Allow setting annotations on Airflow pods & `Configmap` (#15238)
add 43b6657 Expand date provider for new UI (#15725)
add 892ea66 Chart: Use `v2-0-stable` branch for `git-sync` (#15809)
add 5581631 Chart: Rename `dashboard` to `Webserver` in Installation Notes (#15808)
add 8137d1e Update Openapi generator version (#15816)
add caddbf3 Chart: Avoid `git-sync` sidecar on Websever when Airflow>=2.0.0 (#15814)
add 6f956dc Allow S3ToSnowflakeOperator to omit schema (#15817)
add 1edef28 Refactor tests/www/test_views.py (Part 2/2) (#15719)
add ea7e64f Relax required version for `python-telegram-bot` (#15776)
add d78f8c5 Remove unused constant in serialization code (#15824)
add 8ab9c0c Ensure that task preceeding a PythonVirtualenvOperator doesn't fail (#15822)
add 717dcfd Improve feedback message after installing or upgrading airflow with helm chart (#15820)
add 1316f69 Add download links to provider documentation (#15739)
add 8799b9f Migrate dag js (#15823)
add 2a8bae9 Build chart parameter docs from `values.schema.json` (#15827)
add c493b4d Rename docs fields in chart values schema (#15828)
add 37d549b Save pod name to xcom for KubernetesPodOperator (#15755)
add 51e54cb Improve test coverage of task_command.py FIXES: #15524 (#15760)
add 634c12d Keep confirmDeleteDag inline html (#15836)
add 1467046 CloudwatchTaskHandler reads timestamp from Cloudwatch events (#15173)
add bcfa0cb Make DAG dependency detector configurable (#15829)
add e84fb58 Fixes building pre-2.1 Airflow images from 2.1 Dockerfiles. (#15802)
add 758ad90 Move `airflowLocalSettings` to be a top level chart param (#15838)
add 7eeb362 Explicitly point Jinja2 documentation to 2.11.x (#15847)
add 1646dff Support extra env vars on gitsync containers (#15842)
add 3f0a904 Add back-compat shim for BranchDateTimeOperator rename (#15849)
add 6f5f4dc Revert "Add back-compat shim for BranchDateTimeOperator rename (#15849)" (#15853)
add b8868fa Fix modal import in graph.js (#15852)
add 6d9fc3e Fix docstring formatting on ``SlackHook`` (#15840)
add 0893166 Set `airflowPodAnnotations` on Flower and `KuberneteExecutor` workers (#15859)
add 8ecc835 Remove unused licenses: `python-nvd3` & `python-slugify` (#15860)
add 3152f21 Check chart labels on all objects (#15686)
add 71425cd Remove unused licenses from LICENSE (#15863)
add b77fff7 Make Helm Chart ready for release (#15864)
add 6f646fd Add support for listing user objects. (#15862)
add 2180608 Default `resultBackendConnection` to `metadataConnection` (#15861)
add ec39857 Add more metadata to `Chart.yaml` (#15866)
add b08f95a Update Instructions to Install Chart from source (#15868)
add 12b2cac Fix static check (#15869)
add 38ecbd6 Move common pitfall documentation to Airflow docs (#15183)
add 41d7de3 Fix pause/unpause Dag on dag view (#15865)
add 512f396 Dev: Update command to install ``setuptools-build-subpackage`` (#15872)
add 96e2915 Fix missing mkdir for hadoop dockerfile (#15871)
add 83b50d3 New production guide for helm chart docs (#15867)
add dcb8932 Update KylinHook docstring (#15602)
add 6b46af1 Relax the version constraint of rich (#15531)
add 3919ee6 Fix `task_instance_mutation_hook` when importing airflow.models.dagrun (#15851)
add b90bb6e Docs: Fix examples values in docs (#15878)
add 13bb50c Revert "Docs: Fix examples values in docs (#15878)" (#15880)
add 3e38814 Better multiline string formatting for chart docs (#15881)
add d3f7c53 Add v2.1 changelog (#15811)
add ed35818 Fix docs spelling errors (#15884)
add 31894fa Update installation page (#15737)
add bb115da Get rid of requests as core dependency (#15781)
add c7da390 Detect 🚧 as a WIP PR (#15893)
add 821ea6f Fix spacing in ``AwsBatchWaitersHook`` docstring (#15839)
add ac3454e Fix 500 error from updateTaskInstancesState API endpoint when `dry_run` not passed (#15889)
add 12995cf Replace DockerOperator's 'volumes' arg for 'mounts' (#15843)
add 57f6635 Use 'authentication backend' instead of executor in the section about authentication backends. (#15894)
add abcd487 Add optional result handler to database hooks (#15581)
add fe0600c Faster helm unit tests (#15874)
add b2de542 Enforce formatting on helm chart json schema files (#15895)
add 162e320 Add Asana Provider (#14521)
add b7d1ea9 Add Airflow Standalone command (#15826)
add 6309fb7 Add missing word to release docs. (#15898)
add a73ba4b fix modal actions (#15896)
add d88d117 Fix task search function in Graph view (#15901)
add 811f05f Also check chart schema when the schema itself changes (#15902)
add 2a7298d Use different executors for Helm Chart tests in CI (#15791)
add 7ea1b84 Ensure that secrets are masked no matter what logging config is in use (#15899)
add 70cf5c2 Set unique name on ``pre-commit`` hook and update schema (#15903)
add 2cbaff0 Update example `KubernetesExecutor` `git-sync` pod template file (#15904)
add c844ff7 Fix colon spacing in ``AzureDataExplorerHook`` docstring (#15841)
add 180df03 Add missing License details for ``Connexion`` (#15906)
add 5724fd8 Remove Version suffix for SVN while releasing (#15905)
add 208b0c7 Add proper rat-excludes and missing licence (#15908)
add 0c2848c Prep for 2.1.0 release (#15913)
add 2b8dc22 Add support cli delete user by email (#15873)
add 1f5d7f4 Update version to next dev version (#15916)
add 4295845 Sandbox templates (#15912)
add 6f8c204 fix dag dependency search (#15924)
add 20f3639 Add `template_fields` to `S3ToSnowflake` operator (#15926)
add 76a80bb Move plyvel to google provider extra (#15812)
add 6f1c6fe Remove the `set -x` in mypy check producing verbose output (#15932)
add 89bef91 Add usage for --package-filter option (#15918)
add e1cdad0 Improve Helm Chart Git-Sync documentation (#15937)
add b709619 Updates branches and branch documentation after 2.1.0rc1 (#15528)
add cd27124 Correctly implement autocomplete early return (#15940)
add 89b7b71 Fix broken link (#15911)
add 858f93c add version life cycle table (#15936)
add 6fd6712 Chart: Add warning about missing ``knownHosts`` (#15950)
add e01b4e6 Mount DAGs read only when using ``gitsync`` (#15953)
add 2be7f90 Update Helm Chart docs for 1.0.0 release (#15957)
add 5bd6ea7 Add Badge for Artifact Hub (#15958)
add 7106269 Fix typo in production guide for HelmChart (#15966)
add deececc Fail tasks in scheduler when executor reports they failed (#15929)
add ce778d3 Add memory usage warning in quick-start documentation (#15967)
add a51a100 Produce less output from breeze when VERBOSE_COMMANDS is set (#15970)
add 733bec9 Bug Fix Pod-Template Affinity Ignored due to empty Affinity K8S Object (#15787)
add 18b2c6d Removes unnecessary function call (#15956)
add fabe8a2 Chart: Remove ``git-sync``: ``root`` and ``dest`` params (#15955)
add 85b2ccb Add `KubernetesPodOperat` `pod-template-file` jinja template support (#15942)
add aa4713e Use api version only in GoogleAdsHook not operators (#15266)
add bb43e06 Add more tests for the kubernetes executor (#15992)
add 9875f64 `loadBalancerIP` and `annotations` for both Flower and Webserver (#15972)
add 8084cfb Chart: ``gitsync`` Clean Up for ``KubernetesExecutor`` (#15925)
add ee470e1 Fix failing spelling check on Master (#15998)
add 476d0f6 Bump pyupgrade v2.13.0 to v2.18.1 (#15991)
add 8f9538e Add Docs for ``default_pool`` slots (#15997)
add b66b54c Add proper link for wheel packages in docs. (#15999)
add 5dfda56 Improvements for Docker Image docs (#14843)
add 9b5bdca Fix flower serviceAccount created without flower enable (#16011)
add 2684097 Brings back testing providers against 2.1.0 (#16006)
add ce358b2 Handle special characters in password sfor Helm Chart (#16004)
add 74821c8 Add Helm Chart to apache-airflow docs (#16014)
add 31375bb Chart: Fix Elasticsearch secret created without Elasticsearch enabled (#16015)
add 2bac05e Always return a response in TI's ``action_clear`` view (#15980)
add 335fa10 Ability to test connections from UI or API (#15795)
add 5dd0802 Removes arrow higher limits for plexus provider (#16026)
add c288957 Fix auto-refresh in tree view When webserver ui is not in ``/`` (#16018)
add fcde212 Make scripts/ci/libraries Google Shell Guide Compliant (#15973)
add afa1723 Remove TaskInstance.log_filepath attribute (#15217)
add 9f7c67f Unprotect "main" branch (#16046)
add 2f77633 Don't die when masking `log.exception` when there is no exception (#16047)
add 3db347e Introduce compat shim airflow.compat.functools (#15969)
add 9c98a60 Streamline Build Images workflow using new GitHub Actions features (#15944)
add 8814a59 Ensure that we don't try to mask empty string in logs (#16057)
add d612495 Enforce js linting for current ui in pre-commit (#15858)
add 4aaa8df Chart: Add both airflow and extra annotations to jobs (#16058)
add 62fe325 Add collapsible import errors (#16072)
add 44345f3 Support ``strategy``/``updateStrategy`` on scheduler (#16069)
add f2aa9b5 set max tree width to 1200px (#16067)
add 77ff78f Remove ``dags.gitSync.excludeWebserver`` from chart ``values.schema.json`` (#16070)
add 0686968 Add Connections, Variables and Env Vars to Helm Chart docs (#16059)
add 15b1243 Chart: Template ``airflowLocalSettings`` and ``webserver.webserverConfig`` (#16074)
add f2b7d05 Improve compatibility with mssql (#9973)
add add7490 Parse recently modified files even if just parsed (#16075)
add 6af963c Modify return value check in python virtualenv jinja template (#16049)
add c90284d Configurable resources for git-sync sidecar (#16080)
add 6ae9aee pass wait_for_done parameter down to _DataflowJobsController (#15541)
add e006a2e Add close/open indicator for import dag errors (#16073)
add faf4caf A bunch of web UI backend tests (#15993)
add 8676885 Fix bigquery type error when export format is parquet (#16027)
add 2c17257 Chart: Add ``extraInitContainers`` to scheduler/webserver/workers (#16098)
add 71ef2f2 Chart: Fix ``PgBouncer`` exporter sidecar (#16099)
add 0f8f66e Restores apply_defaults import in base_sensor_operator (#16040)
add 904709d Check synctatic correctness for code-snippets (#16005)
add 6d268ab Properly remove user for test_create_user (#15981)
add aeb93f8 fix: restore parameters support when sql passed to SnowflakeHook as str (#16102)
add 5fbc86f Remove the `not-allow-trailing-slash` rule on S3_hook (#15609)
add 436e0d0 add mssql health check (#16103)
add cdc9f1a Fill the "job_id" field for `airflow task run` without `--local`/`--raw` for KubeExecutor (#16108)
add 9d06ee8 Fix apply defaults for task decorator (#16085)
add 65519ab Fixes problem where conf variable was used before initialization (#16088)
add 2c6b003 Updated table component (#15805)
add 10ed42a Fix hooks extended from http hook (#16109)
add 3beae71 Add ``.gitattributes`` for ignoring tests files in ``git archive`` (#16122)
add 23e4391 Update Chart version to ``1.1.0-rc1`` (#16124)
add 4c50110 Fix Typo: ``RedctableItem`` -> ``RedactableItem`` (#16119)
add 4ea78f8 Chart: Add extra ini config to ``pgbouncer`` (#16120)
add 9c80bfb Add Helm Chart Release Guide (#16121)
add a7e1f7a Add mssql db check before starting tests (#16134)
add a2bd872 Chart: Allow ``webserver.base_url`` to be templated (#16126)
add 6fd9c01 Pins docutils to <0.17 until breaking behaviour is fixed (#16133)
add b605987 Removes unnecessary packages from setup_requires (#16139)
add 595374a Move images needed only during CI to `airflow-ci` DockerHub (#16116)
add e7d3fa2 Chart: Adds support for custom command and args (#16153)
add 8d16638 remove retry for now (#16150)
add 2de0692 Added Kayzen to INTHEWILD.md (#16154)
add f75dd7a Fix Celery executor getting stuck randomly because of reset_signals in multiprocessing (#15989)
add 2bca8a5 Fix dag.clear() to set multiple dags to running when necessary (#15382)
add 6b2524f Marking success/failed automatically clears failed downstream tasks (#13037)
add a0e6a84 Treat `AirflowSensorTimeout` as immediate failure without retrying (#12058)
add a27e930 Add updated-name wrappers for built-in FAB methods. (#16077)
add 7c976f9 Fix failing static check (#16162)
add 4bdf46d Mark `test_send_tas_to_celery_hang` as quarantined (#16169)
add 19eb7ef Cattrs 1.7.0 released by the end of May 2021 break lineage usage (#16173)
add e113752 Fix: Unnecessary downloads in ``GCSToLocalFilesystemOperator`` (#16171)
add 58337cc Chart Docs: Separate section for Guides (#16175)
add b7d1039 Bump ``pre-commit`` hooks (#16174)
add 99d1535 Fix: GCS To BigQuery source_object (#16160)
add 62f0410 Wait for successful airflow-init service completion (#16180)
add 19a9fc5 CI: Remove ``sleep`` from Static Check Step (#16178)
add f47e10c Fixes failing static checks after recent pre-commit upgrade (#16183)
add 61cddb3 Fix loading CI images from new `airflow-ci` location (#16187)
add 352fefa Uses bind volume instead of docker volume for MSSQL docker in tmpfs (#16159)
add eb85c9d Replace deprecated ``dag.sub_dag`` with ``dag.partial_subset`` (#16179)
add 3f0d4e8 Fix docs for ``dag_concurrency`` (#16177)
add 54019e8 Update the Python client version (#16191)
add 8505d2f Fix typo. (#16192)
add 1e64702 Rename the main branch of the Airflow repo to be `main` (#16149)
add dd386c8 Format more dates with timezone (#16129)
add 289f44a Fixed tests failing after switching to `main` branch (#16197)
add 65ee91d call resource based fab methods. (#16190)
add d245992 Adding extra requirements for build and runtime of the PROD image. (#16170)
add 9fcdf3d Fix S3 Select payload join (#16189)
add a44779a Update local variable names. (#16212)
add 62178ed Chart: Adds labels to Kubernetes worker pods (#16203)
add 29409ac Fix typo in docker-stack documentation (#16221)
add d05900b Add transparency for unsupported connection type (#16220)
add 2f16757 Bug Pod Template File Values Ignored (#16095)
add 04454d5 Chart: Only mount DAGs in webserver when required (#16229)
add cefa46a Doc: Add page containing list of Database Migrations (#16181)
add 29a3cbf Small improvements for README.md files (#16244)
add 5e09926 Update .github/boring-cyborg.yml (#16259)
add 75c91b4 Add test_connection method to Airbyte hook (#16236)
add 9f9ff10 Remove unused internal function left over form Scheduler HA work (#16269)
add 71de801 Ignore airflow/_vendor for building python API docs (#16270)
add 3d0e16d Fix broken CI (#16265)
add 014edbc Add pre-commit hook for Boring Cyborg (#16260)
add 879e5d2 Use f-string in custom operator docs (#16250)
add fc821a8 Chart: Update the default Airflow Version to ``2.1.0`` (#16273)
add 9c792ea Doc: Use correct version in Chart docs (#16277)
add c4e9c01 Fix Helm git sync secrets typo (#16278)
add c046c49 Add Clicksign to INTHEWILD.md (#16272)
add 3bdcd1a Docs: Fix url for ``Elasticsearch`` (#16275)
add 6736290 Update target branch in `boring-cyborg` for `checkUpToDate` (#16274)
add 0319c79 Run Kubernetes integration tests when Helm Chart is changed (#16276)
add 363477f Don't run migration for adhoc command (#16255)
add 7744f05 Improve argument handling in entrypoint_prod.sh (#16258)
add ef83f73 feat: Helm chart adding minReplicaCount to the Keda worker-kedaautoscaler.yaml (#16262)
add a47a254 Add support for extra parameters to samba client (#16115)
add db63de6 Chart: Fix updating from ``KubernetesExecutor`` to ``CeleryExecutor`` (#16242)
add 57bd6fb Don't fail to log if we can't redact something (#16118)
add bff213e Fixed wrong value of store-dag-code default (#16093)
add 9c94b72 Updated documentation for June 2021 provider release (#16294)
add 5c7d758 Docs: Fix creating a connection docs (#16312)
add 29b7f79 fix wasb remote logging when blob already exists (#16280)
add 78c4f1a Fix a couple typos in the docs (#16321)
add ebc03c6 Fix Dag Details start date bug (#16206)
add a19cc0a Use updated _get_all_non_dag_permissions method. (#16317)
add 4ea8f9c Bump pylint CI step to 60m timeout (#16335)
add 5631093 Docs: Fix ``flask-ouathlib`` to ``flask-oauthlib`` in Upgrading docs (#16320)
add 143d21c Chart: Update the ``appVersion`` to 2.1.0 in ``Chart.yaml`` (#16337)
add 2aed146 Chart docs: Fix ``extrasecrets`` example (#16305)
add 5132610 Use DAG_ACTIONS constant. (#16232)
add 2016447 Chart: Always deploy a ``gitsync`` init container (#16339)
add 36651be Chart: Support job level annotations; fix jobs scheduling config (#16331)
add 24d2ce1 Chart: ``podAntiAffinity`` for scheduler, webserver, and workers (#16315)
add 59c6720 Add Wisr to INTHEWILD.md (#16360)
add 408bd26 Run mini scheduler in LocalTaskJob during task exit (#16289)
add 6e9e562 Make task ID on legend have enough width and width of line chart to be 100%. (#15915)
add 9351e2a Depreciate private_key_pass in SFTPHook conn extra and rename to private_key_passphrase (#14028)
add 9ba796e Make REST API List DAGs endpoint consistent with UI/CLI behaviour (#16318)
add 491c835 Docs: Change 10 minutes to 100 minutes in ``worker_refresh_interval`` (#16369)
add 11cf6f3 Swap out calls to find_permission_view_menu for get_permission wrapper. (#16377)
add f2315bf Fix broken static checks from #15915 (#16378)
add dbeec89 Refactor: `SKIPPED` shouldn't be logged again as `SUCCESS`. (#14822)
add 70bf1b1 Fix normalize-url vulnerability (#16375)
add 7432c4d Fix TI success/failure links (#16233)
add 002075a Fix CLI connections import and migrate logic from secrets to Connection model (#15425)
add 69a1a73 Calendar UI improvements (#16226)
add 4ef804f Correctly set `dag.fileloc` when using the `@dag` decorator (#16384)
add 01e546b Removes quotes for _PIP_ADDITIONAL_REQUIREMENTS (#16382)
add c863044 Remove deprecated import form within test zip file. (#16390)
add 29b23be Look for the correct flash message on failure (#16385)
add 5fdf746 Use resource and action names. (#16380)
add 4300731 Add `passphrase` and `private_key` to default sensitive fileld names (#16392)
add 86b9d3b Remove old test dag that is out of place (#16391)
add 5cd0bf7 Support remote logging in elasticsearch with filebeat 7 (#14625)
add f073d1b Update permission migrations to use new naming scheme. (#16400)
add 92ba9ee Quarantine a flaky test (#16402)
add e3b3c1f Don't show stale Serialized DAGs if they are deleted in DB (#16368)
add e975e86 Don't run tests for deprecated method on DAG class (#16397)
add 0c80a7d Fixes AzureFileShare connection extras (#16388)
add 70cfe01 Sanitize end of line character when loading token from a file (vault) (#16407)
add 7f8f75e Add BigQueryToMsSqlOperator (#15422)
add d99afc3 postgres_hook_aws_conn_id (#16100)
add 30708b5 Add support of capacity provider strategy for ECSOperator (#15848)
add 643f3c3 fix: AwsGlueJobOperator change order of args for load_file (#16216)
add 15ff238 Validate retries value on init for better errors (#16415)
add 6f9c0ce Clean Markdown with dedent to respect indents (#16414)
add 9cd7930 Update copy command for s3 to redshift (#16241)
add 8a4cfd7 OdbcHook returns None. Related to #15016 issue. (#15510)
add 001dc22 Remove assignment that assigns a variable to itself (#16413)
add b272f9c fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026)
add 3c5cc42 Fix deprecation warnings location in google provider (#16403)
add d2448a6 Add rules describing SemVer approach for various Airflow packages. (#16422)
add 4752fb3 Fix issue with parsing error logs in the KPO (#15638)
add 943292b Queue tasks with higher priority and earlier execution_date first. (#15210)
add 5c86e3d Make SparkSqlHook use Connection (#15794)
add 6087a09 add num_runs query param for tree refresh (#16437)
add c6e043f generate go client with latest openapi generator template (#16411)
add 9526a24 Adding `only_active` parameter to /dags endpoint (#14306)
add 3f84d3d Fix spellcheck failure (#16445)
add f18e4ba yarn audit (#16440)
add ce28bc5 Disable Pylint member check for ``tests/decorators/test_python.py`` (#16443)
add 643e46c Added ability for Snowflake to attribute usage to Airflow by adding an application parameter (#16420)
add e8d3de8 Add ElasticSearch Connection Doc (#16436)
add 1fba540 More documentation update for June providers release (#16405)
add 8a9c337 Remove class references in changelogs (#16454)
add 608dd0d Fix formatting and missing import (#16455)
add e31e515 Fix external elasticsearch logs link (#16357)
add cc3c13c Fix templated default/example values in config ref docs (#16442)
add 3f674bd Add missing tests for snowflake changes (#16463)
add 0fa4d83 Handle missing/null serialized DAG dependencies (#16393)
add 147bcec Correctly handle None returns from Query.scalar() (#16345)
add cbf8001 Synchronizes updated changelog after buggfix release (#16464)
add d1d02b6 Switch to built-in data structures in SecretsMasker (#16424)
add 5e12b3d Remove support jinja templated log_id in elasticsearch (#16465)
add 35e1f68 Chart: Allow configuration of pod resources in helm chart (#16425)
add c158d4c Update link to match what is in pre-commit (#16408)
add f167585 fix: change graph focus to top of view instead of center (#16484)
add 247ba31 Fix Elasticsearch external log link with ``json_format`` (#16467)
add bf238aa Fix description on scheduler.livenessprobe.periodSeconds (#16486)
add f2c79b2 Backfill: Don't create a DagRun if no tasks match task regex (#16461)
add a68075f Rename DAG concurrency settings for easier understanding (#16267)
add 36dc6a8 Make job name check optional in SageMakerTrainingOperator (#16327)
add 3cf67be Support non-https elasticsearch external links (#16489)
add d326149 Fix typo in elasticearch frontend docs (#16490)
add 4c9735f Fix unsuccessful KubernetesPod final_state call when `is_delete_operator_pod=True` (#15490)
add b11166b Checks-out missing commits on selective checks (#16470)
add 6236e7e Use resource and action names. (#16410)
add 26b3440 Update `airflow tasks *` commands to lookup TaskInstances from DagRun Table (#16030)
add 1c82b4d Fix S3ToFTPOperator (#13796)
add e72e529 Convert port value to a number before calling test connection (#16497)
add 31481ab We don't need to build against Python 2.7 or 3.5 anymore (#16433)
add 621ef76 Docs: update ``ci.yml`` link in TESTING.rst (#16496)
add 2011da2 Add means to Duplicate connections from UI (#15574)
add 7453d3e Avoid recursing too deep when redacting logs (#16491)
add e8a099d Fix broken build image build after removing Py2.7/3.5 builds (#16509)
add 0c65519 Docs: Fix API verb from ``POST`` to ``PATCH`` (#16511)
add a76a67c Exclude Yarn.lock to be built into python wheel (#16494)
add d53371b Bugfix: Allow clearing tasks with just ``dag_id`` and empty ``subdir`` (#16513)
add 3834df6 Fix DAG run state not updated while DAG is paused (#16343)
add 2278d4f Revert "Exclude Yarn.lock to be built into python wheel (#16494)" (#16518)
add 0bdf89c Fix package version in ``LICENSE`` file (#16514)
add a7738cf Chart: Support ``extraContainers`` and ``extraVolumes`` in flower (#16515)
add cf404b4 Update Watchtower version to 1.0.6 (#16469)
add 6092545 Don't fail the build if we cant run `apt clean` (#16510)
add 087556f Allow null value for operator field in task_instance schema(REST API) (#16516)
add fa953ba Add docs index to README.md (#16495)
add db10c68 Add AWS DMS replication task operators (#15850)
add bbc627a Prepares documentation for rc2 release of Providers (#16501)
add df1220a Update docs on setting up SMTP (#16523)
add d87ab6d Fix bug in mark TI success api (#16524)
add 8a090dc Stop showing output of a parallel job once it has finished. (#16528)
add 28e285e Updating the DAG docstring to include render_template_as_native_obj (#16534)
add 609620a Fetch Helm Chart inventory from remote cache (#16535)
add 3d8ba64 Add ``extra_headers`` argument to ``LivyHook`` and ``LivyOperator`` (#16512)
add 83b23ad Add undocumented parameters to ``LivyOperator`` and ``LivyHook`` docstrings (#16542)
add 0bb1a42 Added new pipeline example for the tutorial docs (#16084)
add 2d85a95 Prepare for Python 3.9 support (#16536)
add 9e49693 Improve hints for reproducing tests (#16545)
add 15baf73 update example_jenkins_job_trigger.py (#16532)
add 1e56420 Cleans up pre-commits a little (#16547)
add f40d555 Adds automated generation of provider issue to track test progress (#16419)
add 3e018c1 Add selective permissions for GitHub Tokens (#16546)
add d429701 added explanation for virtualenv vs docker (#16549)
add df8a877 Make custom JSON encoder support Decimal (#16383)
add 6b0dfec update README.md with 1.10 in EOL state (#16556)
add f9786d4 Tree View UI for larger DAGs & more consistent spacing in Tree View (#16522)
add 79494a6 Clean up MSSQL data directories at the end of each CI run (#16503)
add 9f92786 Switches to manually building docker images (#16570)
add 19ed074 Use safe get with AWS DMS describe replication tasks (#16540)
add 61fdf84 Add test connection method to http hook (#16568)
add c6ac2ad Update Year in Providers NOTICE file and fix branch name (#16576)
add e5e59b4 Remove limitation for elasticsearch library (#16553)
add 90f0088 Fix Orphaned tasks stuck in CeleryExecutor as running (#16550)
add 96f7643 Fix tasks in an infinite slots pool were never scheduled (#15247)
add 2a59de3 Redact conn secrets in webserver logs (#16579)
add b7f1257 Docs: Fix Taskflow API docs (#16574)
add aa79bfe Exclude ``yarn.lock`` from built Python wheel file (#16577)
add eeb97cf Fix pylint error in tests/ (#16585)
add 01c9818 Ensure that `dag_run.conf` is a dict (#15057)
add f7aebeb Switch to GitHub Container Registry by default (#16586)
add 5b0acfe Add back-compat layer to clear_task_instances (#16582)
add 7af18ac Remove Shell scripts under ``airflow/www`` from releases (#16588)
add 129fc61 Always install sphinx_airflow_theme from pypi (#16594)
add 18cb0bb Don't crash attempting to mask secrets in dict with non-string keys (#16601)
add e19dfe2 Switch back temporarily to deprecated package registry (#16603)
add 3ebfd1e Fix label_when_reviewed_workflow_run permissions (#16596)
add c5e9141 Drop support for Helm 2 (#16575)
add c8d0b0e TaskGroup add default_args (#16557)
add c2af5e3 Fix file name to verify release packages (#16605)
add 8217db8 Chart: Support for overriding webserver and flower service ports (#16572)
add 1aa5e20 UPDATING.md for changes included in 2.1.1 (#16615)
add 86c2091 Fix ``AttributeError``: ``datetime.timezone`` object has no attribute ``name`` (#16599)
add 3ee916e Add schema as DbApiHook instance attribute (#16521)
add 2ab2cbf Update Boto3 API calls in ECSOperator (#16050)
add 4aec25a fix(smart_sensor): Unbound variable errors (#14774)
add c8a628a Set Process title for Worker when using ``LocalExecutor`` (#16623)
add 50e334d Add support for non-RSA type key for SFTP hook (#16314)
add a2a58d2 Reduce log messages for happy path (#16626)
add 6bf18f1 Refactor `dag.clear` method (#16086)
add 962c5f4 Chart: Add more clear docs for setting `pod_template_file.yaml` (#16632)
add 2543c74 AWS DataSync cancel task on exception (#11011) (#16589)
add d181604 Remove SQLAlchemy <1.4 constraint (#16630)
add 86d0a96 commiting dagPickle session when the airflow tasks run --ship-dag --interactive command is executed FIXES: 15748 (#15890)
add fd7e6e1 Rename test_cycle to check_cycle (#16617)
add ffb1fca Fix multiple issues in Microsoft AzureContainerInstancesOperator (#15634)
add 5d5268f Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
add 88ee2aa Move DagFileProcessor and DagFileProcessorProcess out of scheduler_job.py (#16581)
add ab2db0a Allow ssh connection to breeze container for remote development (#16621) (#16639)
add 1b2535e Set process title for ``serve-logs`` and ``LocalExecutor`` (#16644)
add caf0a84 Add support for managed identity in WASB hook (#16628)
add 6fc0cc8 Update airflow/hooks/dbapi.py (#16629)
add 5117aaa Fix failing pylint checks (#16656)
add ce44b62 Add Python 3.9 support (#15515)
add 4022746 Add type annotations to setup.py (#16658)
add b8a9e9f Fix permissions for CodeQL workflows (#16660)
add d450976 Docs: Fix rendering of ``PYTHONPATH`` values (#16664)
add c79bbb2 Remove duplicated/overlapping tests around render_k8s_pod_yaml (#16642)
add 24b2187 Add Changelog updates for 2.1.1 (#16665)
add 6d3c6f6 Chart: Apply worker's node assigning settings to Pod Template File (#16663)
add 1a532eb Add new committers: ``Jed`` and ``TP`` (#16671)
add 6d6eae3 Remove upstart from docs (#16672)
add 5628c81 This change adds test for changing different executors in helm chart upgrade (#16394)
add b2e2fc1 Fix spelling issues introduced when adding Tzu (#16673)
add d17e2bc Chart: Fix overriding node assigning settings on Worker Deployment (#16670)
add 6f445e6 Update release documentation for elasticsearch (#16662)
add 70cee15 Docs: Added new pipeline example for the tutorial docs (#16548)
add 3a57d9f Bump ``sphinxcontrib-spelling`` and minor improvements (#16675)
add 5851c6c Bump Airflow version to 2.1.0 in docs (#16677)
add 2625007 Rearrange ``README.md`` to make it easy for first-time users (#16679)
add c975d4c Fix "Invalid JSON configuration, must be a dict" (#16648)
add 9d24863 Refactor: added type annotation (#16668)
add 5306dc5 Fix TI success confirm page (#16650)
add 2833c2b Add Wise to INTHEWILD.md (#16683)
add 0d80383 AWS Hook - allow IDP HTTP retry (#12639) (#16612)
add 98c12d4 Add preparation of images as part of RC preparation process (#16674)
add f0b3345 Fix calculating duration in tree view (#16695)
add 7077fb1 prefer consistent casing (#16693)
add 622b4f4 Refactor usage of unneeded function call (#16653)
add 866a601 Removes pylint from our toolchain (#16682)
add 977da8d Separate out coverage files for different executors (#16689)
add 9d6ae60 Updating task dependencies (#16624)
add 57dcac2 bump dnspython (#16698)
add 5034414 AIP-39: Handle DAG scheduling with timetables (#15397)
add d3ba80a Add conn to jinja template context (#16686)
add cbd2b33 Note that AWS and Astronomer.io have provided funding for the CI machines (#16702)
add 1963000 Remove duplicated try, there is already a try in create_session (#16701)
add 0c95db5 Fix direct use of cached_property module. (#16710)
add 4b14d93 Adjust sizes of CI sponsor logos to look more similar (#16707)
add 648abc1 Change default airflow version in Dockerfile (#16714)
add 42b74a7 Add ``jedcunningham`` to ``INTHEWILD`` (#16723)
add 7857a9b Fix ``CeleryKubernetesExecutor`` (#16700)
add a417251 Minor link correction in breeze docs (#16724)
add df06a71 Adding missing word to welcome message (#16726)
add e3f5eb9 Chart: fix labels on cleanup serviceaccount (#16722)
add 8e2a0bc Chart: refactor webserver and flower networkpolicy (#16619)
add a2d6aa0 Fix unchecked indexing in _build_metrics (#16744)
add 8b41c2e Logging and returning info about query execution SnowflakeHook (#15736)
add fa81105 fix: instance name env var (#16749)
add e40c5a2 Fix timing out tests for public GitHub Runners. (#16750)
add 39c8a9c ensure task is skipped if missing sla (#16719)
add 258691a Breeze should work with new docker-compose fallback (#16743)
add 2285ee9 Only allow webserver to request from the worker log server (#16754)
add 7777d4f Correctly load openssh-gerenated private keys in SSHHook (#16756)
add cad8542 Remove remaining Pylint disables (#16760)
add 6b7f3f0 Add more CODEOWNERS (#16761)
add 9d17027 Validate type of `priority_weight` during parsing (#16765)
add 0b43b6b Have UI and POST /task_instances_state API endpoint have same behaviour (#16539)
add d56a2b4 Switches to ghcr.io container registry (#16775)
add 81be82b Remove redundant logging in SFTP Hook (#16704)
add d1d04fe Mask value if the key is ``token`` (#16474)
add 554a239 Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
add f063a8f Update default image as ``2.1.1`` for Helm Chart (#16785)
add 371ea19 Update ``click`` to 8.x (#16779)
add 4c5376b Fix release date for 2.1.1 (#16788)
add ffe8fab Added select_query to the templated fields in RedshiftToS3Operator (#16767)
add a2dc01b SSHHook: Using correct hostname for host_key when using non-default ssh port (#15964)
add 5399f91 Removes coverage from kubernetes tests (#16794)
add b251d22 Remove legacy GitHub Packages (#16776)
add 772e6ad Require approval for merging to ``v2-*-stable`` branches (#16819)
add 33af2b1 Update TaskGroup typing (#16811)
add 81fde58 Remove AbstractDagFileProcessorProcess from dag processing (#16816)
add 0632ecf BugFix: Correctly handle custom `deps` and `task_group` during DAG Serialization (#16734)
add ad185db Chart: Allow using krb5.conf with ``CeleryExecutor`` (#16822)
add 6611ffd Add 'queued' state to DagRun (#16401)
add 1eed6b4 Add Aneesh Joseph as Airflow Committer (#16835)
add 8885fc1 Chart: warn when using default logging with KubernetesExecutor (#16784)
add b5ef3c8 Add changelog updates for 2.1.2 (#16838)
add f40ade4 When a task instance fails with exception, log it (#16805)
add 6c06c5d Change whimsy url since Airflow is a TLP (#16841)
add 4421023 Clarify the role of commits history (#16840)
add f0df184 Update AWS Base hook to use refreshable credentials (#16770) (#16771)
add 2b7c596 Add State types for tasks and DAGs (#15285)
add faffaec Don't check execution_date in refresh_from_db (#16809)
add feea380 Fix impersonation issue with LocalTaskJob (#16852)
add 08f1865 Chart: Better comment and example for `podTemplate` (#16859)
add 5a5f30f Add 'queued' to DagRunState (#16854)
add b0f7f91 Standardise dataproc location param to region (#16034)
add 5999cb9 Adding: Snowflake Role in snowflake provider hook (#16735)
add c3dd89c Improve graph view refresh (#16696)
add 12d48a8 Enable "Rebase and merge" button on PRs. (#16882)
add 1e1b212 Updating Airbyte example DAG to use XComArgs (#16867)
add 25d89c6 Prevent Redis access directly from host (#16885)
add 2b10680 Fix minor typo in configuration.py (#16832)
add db6acd9 Add a calendar field to choose the execution date of the DAG when triggering it (#16141)
add 01fb777 Fixing typos in GlacierToGCSOperator documentation (#16899)
add d83e5f2 Update changelog with Python 3.9 support.
add c3b8212 Added template_fields_renderers for MySQL Operator (#16914)
add fc917af Fix Minor Bugs in Apache Sqoop Hook and Operator (#16350)
add df0746e Allow disable SSL for TableauHook (#16365)
add 90c7c74 Remove not needed log line (#16925)
add d9f39bb Fix Airflow releasing guide (#16924)
add 7354d38 Avoid verification of images multiple times (#16928)
add e8e9a6d Remove cache for kubernetes tests (#16927)
add 9a1fc19 Fixed task instance retrieval in XCom view (#16923)
add 49f1dfd Docs: Better description for `pod_template_file` (#16861)
add d3f300f Fix wrong template_fields_renderers for AWS operators (#16820)
add b2c66e4 BugFix: Using `json` string in template_field causes issue with K8s Operators (#16930)
add ba97f5d Docs: Suggest use of Env vars instead of Airflow Vars in best practises doc (#16926)
add 543c31f Fix UPDATING.md (#16933)
add 2fea4cd Refactor: Remove processor_factory from DAG processing (#16659)
add dcc7fb5 Change the logic of None comparison in model_list template (#16893)
add af0598f Switch Breeze/CI to ghcr.io excusively (#16780)
add ecc5203 Adds warning about using dynamic installation of packages (#16935)
add 4d8fd37 Pulls latest images to build images in "Build Image" flow (#16948)
add 8808b64 AIRFLOW-5529 Add Apache Drill provider. (#16884)
add 83cb237 Fixed parsing issue of _docker.env file for docker-compose v2 (#16950)
add 789e0ea Add recursive flag to glob in filesystem sensor (#16894)
add f2bd15d Add Talkdesk as a user of airflow 😁 (#16947)
add 72781c0 Fixes passing variables via docker --env-file command (#16959)
add 0dd70de Remove duplicate line in ``UPDATING.md`` (#16955)
add eeb4573 Fixes typo in the name of file for Breeze docker compose env (#16971)
add 2cba553 Add CRST - The Transportation Solution, Inc to INTHEWILD.md (#16946)
add 9ff781a Fixed to check number key from jenkins response (#16963)
add a3f5c93 Update alias for field_mask in Google Memmcache (#16975)
add c46e841 Switch back http provider after requests removes LGPL dependency (#16974)
add fbfb08a Prevent running `airflow db init\upgrade` migrations and setup in parallel. (#16311)
add 3143f1a Move CI-integration images to ghcr.io (#16797)
add 9f8f81f Removes duplicated lines from generate constraints instructions (#16984)
add 7529546 Update chain() and cross_downstream() to support XComArgs (#16732)
add 6ab00bf Extended template_fields_renderers for MySQL provider (#16987)
add 97ae0f2 Errors out instead of trying to workaround buggy docker-compose v2 (#16989)
add 2d64c23 Updating command to run all tests on the last commit (#16997)
add 177dfbd Fix extras name in ``UPDATING.md`` (#16998)
add ded4beb Fix release guide when copying artifacts (#17001)
add 99e5307 Bump pre-commit hooks (#17000)
add d14a000 Remove extra forward slash in stackdriver address. (#16990)
add a5d7f9b Fix static checks after pre-commit upgrades (#17006)
add 16c55f1 Move docs about masking to a new page (#17007)
add fc0250f Allow attaching to previously launched task in ECSOperator (#16685)
add bc00415 Adds option to disable mounting temporary folder in DockerOperator (#16932)
add c164c5c Chart: Update the default Airflow version to ``2.1.2`` (#17013)
add 469d1cf Update Airflow version in ``README.md`` (#17009)
add cc33d7e Drop support for Airflow 1.10 in entrypoint_prod.sh and improve MSSQL compatibility (#17011)
add 53246eb Deprecate Tableau personal token authentication (#16916)
add b916b75 Prepare documentation for July release of providers. (#17015)
add 5897a42 Update Airflow version in docker stack documentation to 2.1.2 (#17017)
add 3645184 Fix bug and small improvements in scripts/tools/list-integrations.py (#17004)
add efd7b76 Control Triage Role users via `.asf.yaml` (#17028)
add 7f9cdc9 Dev: Bump stale action to v4 (#17025)
add 07e0a67 Fixes "development" and "rc" cross dependencies between providers (#17023)
add d02ded6 Fixed wrongly escaped characters in amazon's changelog (#17020)
add 2ce6e8d Fix minor issues in `UPDATING.md` (#17026)
add 49683e1 Chart: Update description for Helm chart to include 'official' (#17040)
add d9221df Updated clean-logs.sh (#16978)
add 60e2f94 Chart: Add instructions to run with Example DAGs (#17043)
add 1960e37 Chart: Remove hard-coded namespace in port-forward instructions (#17042)
add 9bc1353 Update CONTRIBUTING.rst and CONTRIBUTORS_QUICK_START.rst files with jq installation instructions (#17060)
add 675db5c Update .mailmap (#17059)
add 16564ca Fixes detection of version 2 of docker-compose (#17062)
add b076ac5 [FIX] Docker provider - retry docker in docker (#17061)
add 938510f Update INTHEWILD.md (#17058)
add d1e9d8c Update INTHEWILD.md (Adding Skai.io) (#17067)
add cda7833 Added docs & doc ref's for AWS transfer operators between SFTP & S3 (#16964)
add ab91520 Converts the specification of branch for pushes to be flexible (#17065)
add 126788a Switch test_scheduler_job.py from unittest to pytest style (#17053)
add 026ffe6 fix: dataprocpysparkjob project_id as self.project_id (#17075)
add 24d02bf Prepares documentation for RC2 release of Docker Provider (#17066)
add fbc945d Prevent running `airflow db init\upgrade` migrations and setup in parallel. (#17078)
add 1e2837a Improve executor validation in CLI (#17071)
add c1ff75e Support secret backends/airflow.cfg for celery broker in entrypoint_prod.sh (#17069)
add 8f77a54 removing try-catch block (#17081)
add bb1d79c Fixed template_fields_renderers for Amazon provider (#17087)
add 660027f Fixes UI assets compilation from PROD image built from sources (#17086)
add fea2911 AirbyteHook - Consider incomplete status (#16965)
add 636625f Add insert_args for support transfer replace (#15825)
add 1a0730a #16976 Add json.dumps() for templated fields objects: 'dict' and 'list' (#17082)
add a4af964 Translate non-ascii characters (#17057)
add a1d3b27 Parse template parameters field for MySQL operator (#17080)
add d268016 Chore: Some code cleanup in `airflow/utils/db.py` (#17090)
add 3234527 Adds oauth libraries to PROD docker image (#17093)
add 896f351 Add more typing to airflow.utils.helpers (#15582)
add 40595ae Fix static checks after merging #17093 (#17096)
add acb7a90 Fix error in Druid connection attribute retrieval (#17095)
add 3a2e162 Adds more explanatory message when SecretsMasker is not configured (#17101)
add 3939e84 Enable using custom pod launcher in Kubernetes Pod Operator (#16945)
add 9b3bfe6 Ensure a DAG is acyclic when running DAG.cli() (#17105)
add 7c0d8a2 Add Pytest fixture to create dag and dagrun and use it on local task job tests (#16889)
add 3a7c764 Fixing typo for render_template_as_native_obj (#17114)
add 960da8a Switch test_backfill_job.py from unittest to pytest style (#17112)
add eb3d685 Correct the :mod: documentation for s3_to_redshift_operator (#17115)
add 96fd413 Chart: Update postgres subchart to 10.5.3 (#17041)
add ef3c75d Fix bool conversion Verify parameter in Tableau Hook (#17125)
add 29b6be8 Refactored waiting function for Tableau Jobs (#17034)
add 038b87e Add missing changelog entry for 2.1.2 (#17136)
add 32582b5 Adding SalesforceToS3Operator to Amazon Provider (#17094)
add f44d7bd Made S3ToRedshiftOperator transaction safe (#17117)
add 8b100fc ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)
add d48b4e0 Simplify `default_args` in Kubernetes example DAGs (#16870)
add cb6fdd7 Warn on Webserver when using ``SQLite`` or ``SequentialExecutor`` (#17133)
add 3a263ab Doc: Recommend using same configs on all Airflow components (#17146)
add 7842de0 Chart: Create a random secret for Webserver's flask secret key (#17142)
add dc0d0b3 Chart Docs: Add single-line description for ``multiNamespaceMode`` (#17147)
add 6172b0e Chart: changelog for 1.1.0, add UPDATING to docs (#17149)
add 9f043cf Use dag_maker fixture in test_backfill_job.py (#17118)
add 1650efa Doc: Add hyperlinks to Github PRs for Chart Changelog (#17167)
add ccf3d45 Chart docs: note uid write permissions for existing pvc (#17170)
add c7ed265 Chart: Release 1.1.0 of Helm Chart (#17171)
add c6edde2 Update Helm Chart release guide (#17173)
add ad83fea Avoid logging in to GitHub Container Registry when not in CI (#17169)
add d72b363 Chart docs: better note for logs existing pvc permissions (#17177)
add 34478c2 Fix bug that log can't be shown when task runs failed (#16768)
add 9015132 Core: Enable the use of __init_subclass__ in subclasses of BaseOperator (#17027)
add 759c76d Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & ``external_executor_id`` (#17179)
add 88b5357 Fix typo in ``GoogleCloudStorageToBigQueryOperator`` (#17159)
add 82de4a8 Client-side filter dag dependencies (#16253)
add 1759288 API endpoint to create new user (#16609)
add 5be1286 Webserver: Unpause DAG on manual trigger (#16569)
add 81bd409 [CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183)
add f692fc9 Remove turbaszek from CODEOWNERS (#17189)
add 91f4d80 Updating Apache example DAGs to use XComArgs (#16869)
add 504294e Create virtualenv via python call (#17156)
add 8e94c1c Only allows supported field types to be used in custom connections (#17194)
add 45a49e0 Add dunnhumby to INTHEWILD.md (#17204)
add 763919d Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)
add 01a0aca Do not seek error file when it is closed (#17187)
add 29d8e7f Adding EdgeModifier support for chain() (#17099)
add f81ba62 Include exit code in AirflowException str when BashOperator fails. (#17151)
add e7bd82a Improve documentation and examples in example_asana.py (#15959)
add 966b250 Fix GCStoGCS operator with replace diabled and existing destination object (#16991)
add 5d22247 Google Ads Hook: Support newer versions of the google-ads library (#17160)
add 04ca4ec Remove locks for upgrades in mssql (#17213)
add babc425 Fixes statich check failures (#17218)
add d01cc94 Fixes several failing tests after broken main (#17222)
add 126fa076 Quarantine TestSchedulerJob.test_scheduler_verify_pool_full (#17225)
add 12c9053 Quarantine test_verify_integrity_if_dag_changed (#17227)
add 10350aa Do not fail-fast kubernetes tests (#17228)
add 48ca937 Remove/refactor default_args pattern for Microsoft example DAGs (#16873)
add 610366a US Bank added as Airflow User (#17215)
add 2de7793 Adds mssql version parameter to Breeze (#17234)
add cd3307f fix string encoding when using xcom / json (#13536)
add aaf44cc Updating miscellaneous Google example DAGs to use XComArgs (#16876)
add 448e50b Updating Google Cloud example DAGs to use XComArgs (#16875)
add a777537 Updating Jenkins example DAGs to use XComArgs (#16874)
add b10ed95 Updating Docker example DAGs to use XComArgs (#16871)
add 0dbd0f4 Remove/refactor default_args pattern for miscellaneous providers (#16872)
add 569659d Updating Amazon-AWS example DAGs to use XComArgs (#16868)
add 9504cb5 Be verbose about failure to import airflow_local_settings (#17195)
add 87f408b Prepares docs for Rc2 release of July providers (#17116)
add 997f7d0 Update spark_kubernetes.py (#17237)
add 938507f Chart: Bump version to ``1.2.0-rc1`` (#17245)
add ad396d0 Doc: Update Helm Chart 1.1.0 Release Date (#17244)
add 426f13d Fix Helm chart release guide (#17242)
add e0a4197 Improve postgres provider logging (#17214)
add 0801322 Dont use TaskInstance in CeleryExecutor.trigger_tasks (#16248)
add 00ffae8 Remove support for Airflow 1.10 cmds in entrypoint_prod.sh (#17248)
add b0b2591 Fix static checks (#17256)
add 4dc622d Prepares release for Salesforce provider (#17272)
add 2c19002 Chart: Add instructions to Update Helm Repo before upgrade (#17282)
add 4e2a94c Fix task retries when they receive sigkill and have retries and properly handle sigterm (#16301)
add 40419dd Fix running tasks with default_impersonation config (#17229)
add 430a0f9 Stop attempting to pull base python image when pulling commit hash (#17231)
add 3650448 Fix references link in Providers docs (#17286)
add 642d05b Fix typo in webserver.rst (#17288)
add 9cd5a97 Show serialization exceptions in DAG parsing log (#17277)
add 6c9eab3 Update warning about MariaDB and multiple schedulers (#17287)
add 667a45c Quarantine TestSchedulerJob.test_retry_still_in_executor (#17292)
add 96bd4a1 Do not use constraints when preparing venv for k8s tests on CI (#17290)
add 396f30f Uses current sources when running k8s tests (#17289)
add 6d7fa87 Updates to FlaskAppBuilder 3.3.2+ (#17208)
add 8e76f3c Doc: Strip unnecessary arguments from MariaDB JIRA URL (#17296)
add ac0c2d1 Doc: Fix a broken link in an ssh-related warning message (#17294)
add 53e9349 Fix breeze kind-cluster deploy failing with ECONREFUSED (#17293)
add 2dc7aa8 More optimized lazy-loading of provider information (#17304)
add d7a6856 deprecate dummy trigger rule infavor of always (#17144)
add d6e02dc Fix docs link for using SQLite as Metadata DB (#17308)
add 7b10b56 Grammar and clarity pass on documentation (#17318)
add fb3031a Fix race condition with dagrun callbacks (#16741)
add 1394dbe Remove DAG refresh buttons (#17263)
add 2020a54 docs: fix inconsistencies in configuration docs (#17317)
add 36bdfe8 Fix CLI 'kubernetes cleanup-pods' which fails on invalid label key (#17298)
add c384f9b GCP Secret Manager error handling for missing credentials (#17264)
add 78506e3 Fix typo in build_images (#17327)
add b814a58 Fix `airflow celery stop` to accept the pid file. (#17278)
add 892d167 Fix isort (#17330)
add 0f97b92 Fix failing celery test (#17337)
add 7bff44f Fix failing test on MSSQL (#17334)
add 213e337 Added 2RP Net name in INTHEWILD file (#17345)
add 76e6315 Added print statements for clarity in provider yaml checks (#17322)
add 1941f94 Handle connection parameters added to Extra and custom fields (#17269)
add 07fc450 Fix link (#17351)
add 00d823e Fix typo in AUTOMATICALLY GENERATED marker (#17335)
add 0e0e887 Introduce RESTARTING state (#16681)
add d2a43f3 Update best-practices.rst (#17357)
add b8abf14 Add Accenture to the INTHEWILD file (#17358)
add e8fc3ac Moves SchedulerJob initialization to within daemon context (#17157)
add 6cc2526 error early if virtualenv is missing (#15788)
add f53dace Switch to 'smbprotocol' library (#17273)
add 6ced504 Add Vodafone to the list of organisations using Airflow (#17359)
add b2ee9b7 Quarantine test_mark_success_on_success_callback (#17364)
add 80fc80a Fixes #16972 - Slugify role session name in AWS base hook (#17210)
add 8fa4a8b Update hasicorp-vault.rst to describe use of config (#17313)
add c52e4f3 Provide information about IRSA on EKS (#17283)
add 797b515 Update instructions to signify commands as breeze environment commands (#17366)
add 07c8ee0 Fixed SlackAPIFileOperator to upload file and file content (#17247)
add bab7c86 Fix timestamp test (#17365)
add 5c1e09c Improve `dag_maker` fixture (#17324)
add 7108898 make platform version as independent parameter of ECSOperator (#17281)
add 0e6e04e Adds compile_assets to INSTALL (#17377)
add e3089dd Add autoscaling subcluster support and remove defaults (#17033)
add 97428ef Fix messed-up changelog in 3 providers (#17380)
add 67cbb0f Enable specifying dictionary paths in `template_fields_renderers` (#17321)
add e544ffc Enhancement to bash scripts (#17098)
add b82bbe8 Example DAG-related updates for Apache Drill (#17384)
add bcf719b refactor: fixed type annotation for 'sql' param in PostgresOperator (#17331)
add 2c1880a Suggest to use secrets backend for variable when it contains sensitive data (#17319)
add d28efbf Improve AWS SQS Sensor (#16880) (#16904)
add ff75cbc New job update (#17386)
add 6895075 Fix quarantined/flaky tests in test_local_task_job.py (#17385)
add ac92b17 Remove /dagrun/create and disable edit form generated by F.A.B (#17376)
add ed99eaa Regression on pid reset to allow task start after heartbeat (#17333)
add e8e3b06 More touches on dag_maker fixture to create DagModel automatically (#17391)
add 4dae4ec refactor: fixed type annotation for 'sql' in MySqlOperator (#17388)
add a10eb61 doc: fixed docstring for sql param in Neo4jOperator (#17407)
add a4b6f1c Proper warning message when recorded PID is different from current PID (#17411)
add 9bed58e Support DAGS folder being in different location on scheduler and runners (#16860)
add 2321020 Improve diagnostics message when users have secret_key misconfigured (#17410)
add 2938acd Add timeout when asking whether to rebuild image (#17412)
add dfefc66 Optimize context sent for docker build (#17415)
add 537c254 Do not pull CI image for ownership fixing on first, fresh breeze run (#17419)
add 4348239 Increases timeout for helm chart builds (#17417)
add 4ee4199 Improve image building documentation for new users (#17409)
add 94b03f6 Optimizes structure of the Dockerfiles and use latest tools (#17418)
add 60848a6 Fix failing static checks in main (#17424)
add 4675539 Update emr.rst (#17420)
add 02586e3 Fixes some static check errors (#17432)
add 9665652 Updating INTHEWILD.md (PEXA) (#17427)
add 82bda99 Fix Google Cloud Operators docs (#17440)
add e478999 Quarantine test_process_sigterm_works_with_retries and test_task_sigkill_works_with_retries in TestLocalTaskJob (#17441)
add 1bd3a5c Switches to "/" convention in ghcr.io images (#17356)
add faf9f73 Handle and log exceptions raised during task callback (#17347)
add bb52098 Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406)
add 5c0e98c Adding JWT, IP filtering, and direct session login support for SalesforceHook (#17399)
add eb6af07 Add missing permissions to varimport (#17468)
add 82b876b Add ephraimbuddy to INTHEWILD (#17472)
add 3136f22 KEDA task count query should ignore k8s queue (#17433)
add ed1eac1 Disable Helm tests when branch is not main (#17457)
add cb0b895 Add Datatonic to INTHEWILD (#17483)
add d884a3d Remove trigger-dag-run with configuration from quarantine (#16818)
add 04b6559 Make schema in DBApiHook private (#17423)
add 75ca654 [AIRFLOW-17200] Add Alibaba Cloud OSS support (#17201)
add 793afaa Attempt to reduce flakiness of PythonVirtualeEnv test_airflow_context (#17486)
add 5790f72 Install providers from sources in prod image only on main (#17458)
add eec14b9 Ask for provider versions in bug reports (#17480)
add f5596d2 Update INTHEWILD.md (#17491)
add 69d2ed6 Add Microsoft PSRP provider (#17361)
add b311bc0 add deprecation notice for SubDagOperator (#17488)
add ef1b124 Use `dag_maker` fixture in models/test_taskinstance.py (#17425)
add d19e61a Improve breeze resource check (#17492)
add daece96 Use `dag_maker` in tests/core/test_core.py (#17462)
add 5df99d6 New generic tableau operator: TableauOperator (#16915)
add 763860c Better diagnostics and self-healing of docker-compose (#17484)
add fe74f46 Rearrange Dag parsing tests out of test_scheduler_job.py (#17504)
add 37cc115 Use pytest.param in pytest.mark.parametrized (#17505)
add 7dd11ab Remove superfulous chars from resource warning (#17503)
add c1e2af4 Add back missing permissions to UserModelView controls. (#17431)
add 76ddf0f Use `dag_maker` fixture in test_scheduler_job.py (#17265)
add 51bb610 Add Match.com to list of companies using Apache Airflow (#17518)
add 414dc17 Hard-remove parallell locks at cleanup (#17514)
add bd0a3d5 Remove hard-coded container name for trino (#17525)
add 19777f1 Decreases cassandra memory requirement during Integration tests (#17524)
add 82229b3 Add XCom.clear so it's hookable in custom XCom backend (#17405)
add 7dfc520 Doc: Add FAQ to speed up parsing with tons of dag files (#17519)
add 663f173 Update pre-commit hooks (#17530)
add fbddefe Fixed broken json_client (#17529)
add f424780 Ignores exception raised during closing SSH connection (#17528)
add dec1e9d Minor README fixes (#17532)
add 77c4325 Fixing ParamValidationError when executing load_file in Glue hooks/operators (#16012)
add 2ed5784 docs(celery): reworded, add actual multiple queues example (#17541)
add e6c61ca Add date format filters to Jinja environment (#17451)
add 719709b Skip PV's lost+found dir when cleaning logs (k8s) (#17547)
add 8bd748d Fix spelling in ``CeleryExecutor`` docs (#17553)
add b06d528 Don't cache Google Secret Manager client (#17539)
add ec5b4fe AIP-40: Add Deferrable "Async" Tasks (#15389)
add 3773224 Chart: Allow podTemplate to be templated (#17560)
add a1834ce Use dag_maker fixture in test_processor.py (#17506)
add 944dc32 Fix Invalid log order in ElasticsearchTaskHandler (#17551)
add 951006e Path correction in docs for airflow core (#17567)
add 4556828 AIP-39: DagRun.data_interval_start|end (#16352)
add 4598eb0 Quarantine test_mark_success_no_kill test (#17580)
add 9875757 Add Mongo projections to hook and transfer (#17379)
add b9109f8 Chart: Support ``extraContainers`` in k8s workers (#17562)
add e7eeaa6 Doc: Fix docstrings for ``MongoToS3Operator`` (#17588)
add 2c26b15 Make `pandas` an optional core dependency (#17575)
add 8b03d9d Fixed long delays in the Temporal trigger (#17564)
add 113bfdf Document overriding ``XCom.clear`` for data lifecycle management (#17589)
add e69c6a7 fix: filter condition of TaskInstance does not work #17535 (#17548)
add 60ddcd1 Rescue if a DagRun's DAG was removed from db (#17544)
add 7b4ce7b Run more than just basic checks on ``.pre-commit-config.yaml`` change (#17590)
add 2092988 Simplify 404 page (#17501)
add 57d60d2 Bump `mysql-connector-python` to latest version (#17596)
add 6b327c1 Remove redundant ``numpy`` dependency (#17594)
add f2a8a73 Remove redundant note on HTTP Provider (#17595)
add ba3d5b3 Add more ``project_urls`` for PyPI (#17598)
add d11d3e6 Use built-in ``cached_property`` on Python 3.8 for Asana provider (#17597)
add 7db43f7 Remove upper-limit on ``tenacity`` (#17593)
add 833e109 Improve validation of Group id (#17578)
add 88e3379 Fix MySQL database character set instruction (#17603)
add 4eff7a4 Simplify bug report template (#17561)
add 55b9b70 Fix ``triggerer`` query where limit is not supported in some MySQL version (#17601)
add bb3b319 Chart: Fix elasticsearch-secret template port default function (#17428)
add b7e5a24 Add cherry-pick notes to the release README (#17610)
add 721d4e7 Update documentation regarding Python 3.9 support (#17611)
add 1632c9f Add new LocalFilesystemToS3Operator under Amazon provider (#17168) (#17382)
add 6df3ee7 Fix redacting secrets in context exceptions. (#17618)
add bd4f0c3 Use gunicorn to serve logs generated by worker (#17591)
add 9b3ed1f Move worker_log_server_port option to the logging section (#17621)
add a40fe81 Switch Alibaba OSS tests to us-east-1 (#17616)
add efd4eb3 Fix spelling of Airflow (#17624)
add cff5f18 Improve cross-links to operators and hooks references (#17622)
add c96b152 Add Triggerer warning banner in UI (#17565)
add b5f7e9e Force emulation on ARM platforms for Docker (#17627)
add 934b76b Enhanced configure_environment.sh declared readonly varaible (#17619)
add 5a64c1c Do not delete running DAG from the UI (#17630)
add 517ffe9 Use new Sphinx Autodoc mock import path (#17634)
add 84de7c5 Open relative extra links in place (#17477)
add c645d7a Add root to tree refresh url (#17633)
add 2935be1 Fixed SlackAPIFileOperator to upload file and file content. (#17400)
add f38ebaf Make output from users cli command more consistent (#17642)
add 29aab64 Adds secrets backend/logging/auth information to provider yaml (#17625)
add 84df864 Fix wrong query on running tis (#17631)
add 1d3c729 Only run 2.2.0 providers commands for Airflow >= 2.2.0 (#17647)
add 0282f41 Forces rebuilding the image for cache pushing (#17635)
add e99624d Speed up tests that use BackfillJob (#17648)
add c22ed08 Chart: use serviceaccount template for log reader rolebinding (#17645)
add 808fb2a Add Changelog updates for 2.1.3 (#17644)
add 495535b Update pre-commit checks-flynt to 0.66 (#17672)
add dfdffa6 Fix link to generating constraints in BREEZE.rst (#17670)
add 7c96800 Dev: Remove duplicate step to push Docker Image (#17674)
add 1cd3d8f Update docs on syncing forks (#17675)
add d8c0cfe Have the dag_maker fixture (optionally) give SerializedDAGs (#17577)
add 6868ca4 Avoid endless redirect loop when user has no roles (#17613)
add cbd9ad2 Remove the use of multiprocessing in TestLocalTaskJob and Improve Tests (#17581)
add 83a2858 Docs: Make ``DAG.is_active`` read-only in API (#17667)
add be9911c Renames main workflow to `Tests` (#17650)
add 4e59741 Remove legacy image convention (#17692)
add 9863811 Chart: fix running with uid 0 (#17688)
add 9b2e593 Fix sqlite hook - insert and replace functions (#17695)
add 9922287 Replace execution_date with run_id in airflow tasks run command (#16666)
add 0016007 hdfs provider: allow SSL webhdfs connections (#17637)
add c698204 Add steps for building release package without breeze. (#17702)
add 09828a5 docs(impersonation): update note so avoid misintrepretation (#17701)
add 79c1a0e Add ``Scribd`` to INTHEWILD.md (#17685)
add b6c20a8 docs(dagowner): describe dag owner more carefully (#17699)
add d5a6dc7 Minor doc formatting fix (#17704)
add 87e64fa Clearly document no breaking change for 2.1.2 and 2.1.3 (#17706)
add 32475fa Sync DB Migrations with Airflow 2.1.3 (#17703)
add 6040125 Adding support for multiple task-ids in the external task sensor (#17339)
add b99d029 Add `v2-*-stable` to codecov branches (#17707)
add fbf5163 Add a note about XCOMs push condition for K8sPodOperator docs (#17690)
add d26b862 Add optional SQL parameters in ``RedshiftToS3Operator`` (#17640)
add 3b41bb4 Doc: Replace deprecated param from docstrings (#17709)
add bee48f3 Implemented Basic EKS Integration (#16571)
add b68d193 Add error check for config_file parameter in GKEStartPodOperator (#17700)
add 95b2685 Use `dag_maker` fixture in some test files under tests/models (#17556)
add 8cdda20 Doc: Fix replacing Airflow version for Docker stack (#17711)
add 6ba538f Doc: Update Upgrade to 2 docs with Airflow 1.10.x EOL dates (#17710)
add 4da4c18 Add support for configs, secrets, networks and replicas for DockerSwarmOperator (#17474)
add b5e6661 Improve description of Python compatibility approach (#17721)
add 02fbe44 Fix instructions of release to get proper path in shasum file (#17716)
add 76ed2a4 Import Hooks lazily individually in providers manager (#17682)
add 50771e0 Do not let create_dagrun overwrite explicit run_id (#17728)
add 35a6c30 Rename ``task_concurrency`` to ``max_active_tis_per_dag`` (#17708)
add e107891 Extend init_containers defined in pod_override (#17537)
add 12709bf Added table to view providers in Airflow ui under admin tab (#15385)
add 35b8f50 Make sure "podcution-readiness` of docker-compose is well explained (#17731)
add af9dc8b Remove ``[core] store_dag_code`` & use DB to get Dag Code (#16342)
add f654db8 Fix clean-logs after improper skipping of lost+found (#17739)
add 83678b6 Fix comment in Helm Chart for worker ``logGroomerSidecar`` (#17742)
add 8fde9a4 Rename ``none_failed_or_skipped`` by ``none_failed_min_one_success`` trigger rule (#17683)
add 65684dd Add logical_date to OpenAPI DAGRun schema (#17122)
add 5d90bcb Remove Marshmallow schema warnings (#17753)
add 22e87b3 Separate infer_data_interval for data interval timetables (#17755)
add 00dc3c4 Chart: Add loadBalancerSourceRanges in webserver and flower services (#17666)
add 4fb184b Add links to provider's documentation (#17736)
add ebf3b4a Bump `pip` version to `21.2.4` (#17746)
add e21b54a Ensure ``DateTimeTrigger`` receives a datetime object (#17747)
add d04aa13 [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137)
add 02a33b5 Fetching and logging livy session logs for LivyOperrator (#17393)
add d39ca78 Add triggerer to `docker-compose.yaml` file (#17745)
add c4d043d Fix failing main spellcheck build (#17761)
add 3b99225 Chart docs: Format ``loadBalancerSourceRanges`` using code-block (#17763)
add 73d2b72 Fix using XCom with ``KubernetesPodOperator`` (#17760)
add c7f37a9 make the providers operators/hooks reference much more usable (#17768)
add 11c5ce3 Improve pre-commit documentation (#17770)
add 6511ce7 Fix ``TimeSensorAsync`` (#17748)
add ccaff5a Automatically use utf8mb3_general_ci collation for mysql (#17729)
add 4ced69b Remove deprecated metrics from metrics.rst (#17772)
add 6301faa Enable Connection creation from Vault parameters (#15013)
add 5f159cb Ensure that airflow modules are not imported too early in conftest (#17779)
add ffb81ea Improve dag/task concurrency check (#17786)
add 1a929f7 Fix dag_processing.last_duration metric random holes (#17769)
add 32bfb2f Add Triggerer to Helm Chart (#17743)
add d97e50f Fix failing Helm Chart docs test (#17789)
add cb9f0bd Move Model collation args tests to correct folder (#17791)
add a0ce41c Add warning about https configuration in SimpleHttpOperator (#17783)
add 6fdfa09 Chart: Update the default Airflow version to ``2.1.3`` (#17794)
add 39a8b2c Update ``README.md`` to point to Airflow 2.1.3 (#17793)
add 3a7a65c feat: Add Loadsmart in the list of companies using it (#17792)
add be75dcd Update description about the new ``connection-types`` provider meta-data
add bcc7665 Improve discoverability of Provider packages' functionality
add 36c5fd3 Move instriuctions of constraint/image refreshing to dev
add 0264fea Remove airflow dependency from http provider
add 41e3a91 Fix missing whitespace in ``apply_default`` deprecation message (#17799)
add bb5602c Prepare release for Kubernetes Provider (#17798)
add 3d96ad6 Add pre/post execution hooks (#17576)
add 5019916 Fix: Mysql 5.7 id utf8mb3 (#14535)
add c32ab51 Use one interpreter for Airflow and gunicorn (#17805)
add 48b37dc Fixes unbound variable during remote image check in Breeze (#17807)
add 83167a6 API documentation spelling fix (#17811)
add c4fd84a fix EXTRA_LOGGER_NAMES param and related docs (#17808)
add 98d45cb Improves documentation about modules management (#17757)
add 97f0065 Show all import_errors from zip files (#17759)
add 806f06b Fixed numeric list (#17813)
add c203e77 Show import errors in DAG views (#17818)
add 06e53f2 Chart: configurable number of retention days for log groomers (#17764)
add 96f7e3f Increase width for Run column (#17817)
add a759499 Update INTHEWILD.md (#17832)
add 45e61a9 Only show import errors for DAGs a user can access (#17835)
add ea49c96 Fix typos in docs & ``bug_report`` template (#17809)
add 7e93828 (docs): update README.md (#17806)
add bfdda08 Improve graph view load time for dags with open groups (#17821)
add 933d863 Fix broken MSSQL test (#17797)
add e18b6a6 Avoid redirect loop for users with no permissions (#17838)
add 41632e0 Fix provider.yaml errors due to exit(0) in test (#17858)
add a2fd67d Update to Celery 5 (#17397)
add 275e0d1 Sane detection of the host/port in entrypoint prod (#17847)
add 83f1f07 Fix log links on graph TI modal (#17862)
add 87769db Allow omission of `initial_node_count` if `node_pools` is specified (#17820)
add aa5952e Gcp ai hyperparameter tuning (#17790)
add 4990176 Move setting of project ID after activating service account (#17866)
add eec757d Add Brent to Committers list (#17873)
add 220678d Allow google-auth < 3 and google-api-core < 3 (#17671)
add 4d48305 Convert issue templates into forms (#17855)
add 0abbd2d Secrets backend failover (#16404)
add 890bd43 Add an Amazon EMR on EKS provider package (#16766)
add 997c31c ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)
add 606b697 Add Brent to ``CODEOWNERS`` (#17877)
add 95279bd Add back deleted comment (#17884)
add e4d3da1 fix wrong documents around upgrade-check.rst (#17903)
add d0bc11f replace to contributing quick start guide (#17908)
add 42e13e1 Remove all deprecation warnings in providers (#17900)
add 07405e6 [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)
add 24aa34b Fixed button size in "Actions" group. (#17902)
add b5da846 Fix missing Data Fusion sensor integration (#17914)
add e9bf127 Add doc warning about connections added via envvars (#17915)
add 332406d BugFix: ``TimeSensorAsync`` returns a naive datetime (#17875)
add a3f9c69 Fix ``DagRunState`` enum query for ``MySQLdb`` driver (#17886)
add 653c13e Fix broken XCOM in EKSPodOperator (#17918)
add 4a0711c Fix `TestSecurity.test_current_user_has_permissions` (#17916)
add 18cc31c Add issue form template for Helm Chat (#17917)
add 1d71441 Fix saving last choice of backend and other flags between breeze runs (#17913)
add da99c3f HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)
add 0a68588 Add August 2021 Provider's documentation (#17890)
add 098765e Allow setting specific cwd for BashOperator (#17751)
add 9028a78 Separate Managed Services for Airflow (#17926)
add 3fc57de Allow custom timetable as a DAG argument (#17414)
add 2aa443f Update error message to guide the user into self-help mostly (#17929)
add 27c1150 Always upgrade to newer dependencies in main (#17939)
add 5350cc27 Example xcom update (#17749)
add eda8a51 Fix docs about login for hdfs connections (#17936)
add dd8b04d Fix grammar in `traceback.html` (#17942)
add a29503e Fix instantiating Vault Secret Backend during configuration (#17935)
add eebfeec Update docker.rst (#17882)
add 1aca908 Adds Github Oauth example with team based authorization (#17896)
add 9befaee Fixing bug which restricted the visibility of ImportErrors (#17924)
add 5007806 Add possibility to run DAGs from system tests and see DAGs logs (#17868)
add 887ef6b Add Next Run to UI (#17732)
add 601f22c Refactor BranchDayOfWeekOperator, DayOfWeekSensor (#17940)
add 226a2b8 Queue support for DaskExecutor using Dask Worker Resources (#16829)
add 9c19f0d Improve MySqlToHiveOperator tests (#17958)
add ee93935 Only show Pause/Unpause tooltip on hover (#17957)
add fac06a1 Add robots.txt and X-Robots-Tag header (#17946)
add fbdb688 Fix passing Jinja templates in ``DateTimeSensor`` (#17959)
add 16b47ce Invalidate Vault cached prop when not authenticated (#17387)
add fe34582 New google operator: SQLToGoogleSheetsOperator (#17887)
add 0791719 Add support for kinit options [-f|-F] and [-a|-A] (#17816)
add 683fbd4 Fix Clear task instances endpoint resets all DAG runs bug (#17961)
add fdbb798 Making spelling of "TaskFlow" consistent in docs (#17968)
add 6914091 Update max_tis_per_query to better render on the webpage (#17971)
add 9a0c10b deduplicate running jobs on BigQueryInsertJobOperator (#17496)
add 4d52207 Add missing menu access for dag dependencies and configurations pages (#17450)
add 617fed9 Chart: Make cleanup cronjob cmd/args configurable (#17970)
add 7c4d317 Delete unnecessary parameters in EKSPodOperator (#17960)
add d67133c Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs (#16866)
add bec006e Fix constraint generation properly (#17964)
add 430976c Fix max_active_runs not allowing moving of queued dagruns to running (#17945)
add ab76581 Add DAG run endpoint for marking a dagrun success or failed(#17839)
add f727635 Fix blank dag dependencies view (#17990)
add ca4f99d Serialize the template_ext attribute to show it in UI (#17985)
add 1e1b3de Fix grammar in local.rst (#18001)
add 7b3a5f9 Hide variable import form if user lacks permission (#18000)
add 6db73a6 Reduce number of lines in "monitoring job" parallel group (#17995)
add 48316b9 Make EMR cluster visible to all users note (#17557)
add 31b15c9 Applied permissions to self._error_file (#15947)
add be7efb1 Require timetable class be registered via plugin (#17989)
add bff5806 Summarize test failures at the end of CI run (#18008)
add b6a962c Logs task launch exception in StandardTaskRunner (#17967)
add 2cace94 Implement API endpoint for DAG deletion (#17980)
add bcd81f2 Add Spark to the EMR cluster for the job flow examples (#17563)
add ace2374 Fix failed tests from run_as_user+error_file changes (#18013)
add a88115e Allow specifying multiple URLs via the CORS config option (#17941)
add 9c64419 Fix unexpected bug in exiting hook context manager (#18014)
add 0fe0b06 Adding missing init file in example_dags directory (#18019)
add decaaeb Fix spelling error causing tests to fail on main (#18021)
add 867e930 AwsBaseHook make `client_type` & `resource_type` optional params for `get_client_type` & `get_resource_type` (#17987)
add 21348c1 fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)
add fd5d657 Update release notes for 3 extra providers released (#18018)
add b486a0e Adds capability of Warnings for incompatible community providers (#18020)
add a0a05ff Adds example showing the ES_hook (#17944)
add 16a17f7 Fix building docs in `main` builds (#18035)
add 6898a2f Add Python2 to installed packages (#18037)
add fe7efca Opmitise LoggingMixin.log (#17280)
add 1be3ef6 Improve the description of how to handle dynamic task generation (#17963)
add bfad233 Fix providers tests in main branch with eager upgrades (#18040)
add 952fa57 Suppress stat stderr output when we have fallback (#18044)
add 0c2f71e Revert "Opmitise LoggingMixin.log (#17280)" (#18047)
add 022b4e0 Fix building documentation broken by upgrade of dnspython (#18046)
add 944dcfb Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)
add 873d4d1 Optimize imports of Providers Manager (#18052)
add 64d2f54 Do not fail KubernetesPodOperator tasks if log reading fails (#17649)
add 1bfb572 Build CI images for the merge result of a PR, not the tip of the PR (#18060)
add 0dba2e0 Revert "Build CI images for the merge result of a PR, not the tip of the PR (#18060)" (#18063)
add 5d2b056 Fix Neo4jHook to get the query response (#18007)
add 77d50a1 Add missing "be" in documentation (#18059)
add 79d8557 Added Jagex to the list of companies using Apache Airflow (#18058)
add b658a42 Change id collation for MySQL to case-sensitive (#18072)
add 13e7d4a Adding CI check to verify __init__.py file exists in providers' example_dags dirs (#18076)
add b8d06e8 Fix KubernetesPodOperator reattach when not deleting pods (#18070)
add 29a395c Chart: fix webserver secret key update (#18079)
add cc0e740 Update non-working example in documentation (#18067)
add 9496235 Reapply "Build CI images for the merge result of a PR, not the tip of the PR (#18060)" (#18086)
add ff64fe8 Allow filtering DAGS by tags in the REST API (#18090)
add 3fe948a sftp_to_s3 stream file option (#17609)
add d6e48cd Fixes incorrect parameter passed to views (#18083) (#18085)
add a1d9172 Limit colorlog version (6.x is incompatible) (#18099)
add 5f3d2cd Chart: Fix minor Triggerer issues (#18105)
add 6acb9e1 Adds LoggingMixins to BaseTrigger (#18106)
add 43f595f Advises the kernel to not cache log files generated by Airflow (#18054)
add ebbe2b4 Fix DagRun execution order from queued to running not being properly followed (#18061)
add 28de326 Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109)
add 0eb41b5 Limit the number of queued dagruns created by the Scheduler (#18065)
add cee48c3 Update wasb.rst (#18117)
add 80eb809 Check for missing DagRun rows for "downstream" tables before migrating DB (#17030)
add afd4ba6 Fix constraints generation scripts. (#18094)
add 9c7ae4d added TUD to INTHEWILD.md (#18123)
add 47e8fa6 Add "packaging" to core requirements (#18122)
add feb0a4b Change XCom class methods to accept run_id argument (#18084)
add 046f02e fix misspelling (#18121)
add 2fd3f27 Make next_dagrun_info take a data interval (#18088)
add c9d2946 Fix deprecation error message rather than silencing it (#18126)
add f97ddf1 Fix Sentry handler from LocalTaskJob causing error (#18119)
add 2767781 Update version added fields in airflow/config_templates/config.yml (#18128)
add cfb602a Fix ``BigQuery`` data extraction in ``BigQueryToMySqlOperator`` (#18073)
add 969b239 Test coverage on the autocomplete view (#15943)
add 6e10131 Simplify s3 ``unify_bucket_name_and_key`` (#17325)
add b879550 Aws secrets manager backend (#17448)
add 1945494 Adding ``TaskGroup`` support in ``BaseOperator.chain()`` (#17456)
add a897076 Add Snowflake operators based on SQL Checks (#17741)
add e6cb2f7 ECSOperator returns last logs when ECS task fails (#17209)
add b8926ee Add a note about no back-compat guarantees for experimental features (#18139)
add 0e3b06b Mark passing pre/post execute callbacks to operators as experimental. (#18140)
add 68d99bc [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook (#17236)
add 0df31cd Change from dynamic date to fixed date in examples (#18071)
add 3d4bfdc Add missing __init__.py files for some test packages (#18142)
add 975a4e0 Fix quarentine tests affected by AIP-39 (#18141)
add d491afb Doc: Minor wording tweaks (#18148)
add 42c835f Fix typo in StandardTaskRunning log message (#18149)
add 491d818 Fix bad repository name in pre-commit config (#18151)
add 9e13e45 Fixes warm shutdown for celery worker. (#18068)
add 476ae0e Fixing Vault AppRole authentication with CONN_URI (#18064)
add 692d744 Fixed log view for deferred tasks (#18154)
add db5ac64 Reorder migrations to be compatible with 2.1.4 (#18153)
add a3c4784 Add C2FO to ``INTHEWILD.md`` (#18157)
add a773794 Make auto refresh interval configurable (#18107)
add 2776e08 Fix Airflow version for `[logging] worker_log_server_port` (#18158)
add 9140ad8 Use parameters instead of params (#18143)
add 723eeb4 Add script that validate version fields in config.yaml (#18130)
add f34893a Remove limits for dnspython (#18162)
add 4ee8f82 Allow users to submit issues for 2.2.0beta1 (#18165)
add 8593d7f Improves quick-start docker-compose warnings and documentation (#18164)
add 3d6c86c Fix spelling mistake in documentation (#18167)
add 3e3c48a Apply parent dag permissions to subdags. (#18160)
add 0b2b711 Allow publishing Docker images with more pre-release versions (#18170)
add f9969c1 Separate Installing from sources section and add more details (#18171)
add db72f40 Remove redundant single quote from Breeze build image script (#18173)
add e2d069f Set task state to failed when pod is DELETED while running (#18095)
add 29af57b Fix usage of ``range(len())`` to ``enumerate`` (#18174)
add 15a9945 Update various pre-commits (#18176)
add d7aed84 Add note about params on trigger DAG page (#18166)
add a6c9f95 Fix typo in task fail migration (#18180)
add 1cf7240 Remove Brent from Collaborators (#18182)
add f222aad Fix broken link in ``dev/REFRESHING_CI_CACHE.md`` (#18181)
add 9d05b32 Doc: Use ``closer.lua`` script for downloading sources (#18179)
add 42bbeb0 Fix minor issues in Airflow release guide (#18177)
add 0239776 Deprecate default pod name in EKSPodOperator (#18036)
add 2f1ed34 sets encoding to utf-8 by default while reading task logs (#17965)
add 0c43e68 Automatically create section when migrating config (#16814)
add 1cb456c Add official download page for providers (#18187)
add 1fdde76 Fix typo in decorator test (#18191)
add d6e7c45 Adding Variable.update method and improving detection of variable key collisions (#18159)
add ec79da0 Doc: Improve installing from sources (#18194)
add 81ebd78 Added upsert method on S3ToRedshift operator (#18027)
add d119ae8 Rename LocalToAzureDataLakeStorageOperator to LocalFilesystemToADLSOperator (#18168)
add 8ae2bb9 Fix error when create external table using table resource (#17998)
add d3d847a Swap dag import error dropdown icons (#18207)
add 2474f89 Migrate Google Cloud Build from Discovery API to Python SDK (#18184)
add 9c8f7ac Add heartbeat to TriggererJob (#18129)
add 9d49772 BugFix: Wipe ``next_kwargs`` and ``next_method`` on task failure (#18210)
add 3b2b7e7 Upgrade ``importlib-resources`` version (#18209)
add dd313a5 Omit ``airflow._vendor`` package in coverage report (#18221)
add b7f366c Fix failing main due to #18209 (#18215)
add ca45bba Chart: Allow running and waiting for DB Migrations using default image (#18218)
add 27144bd Doc change: XCOM / Taskflow (#18212)
add fe6a769 Add some basic metrics to the Triggerer (#18214)
add 23a68fa Advanced Params using json-schema (#17100)
add a9776d3 Remove loading dots even when last run data is empty (#18230)
add 7a19124 Return explicit error on user-add for duplicated email (#18224)
add 37ca990 Don't check for `__init__.py` under pycache folders. (#18238)
add 778be79 Fix example dag of PostgresOperator (#18236)
add c73004d Revert Changes to ``importlib-resources`` (#18250)
add 292751c Make sure create_user arguments are keyword-ed (#18248)
add 67fddbf Improves installing from sources pages for all components (#18251)
add 848f206 Reduce lengths of the name, username and email fields for this test (#18263)
add 2d4f3cb Adding missing `replace` param in docstring (#18241)
add 9f7c10b Fix deleting of zipped Dags in Serialized Dag Table (#18243)
add e7925d8 Fix external_executor_id not being set for manually run jobs (#17207)
add 9a7243a Sort adopted tasks in _check_for_stalled_adopted_tasks method (#18208)
add 902aeb7 Fix DB session handling in XCom.set. (#18240)
add b0e91f6 Fix dag_run FK check in pre-db upgrade (#18266)
add 55649f3 Add ``triggerer`` to ``./breeze start-airflow`` command (#18259)
add 9ed87e5 show next run if not none (#18273)
add 686c3d7 remove all reference to date in dropdown tests (#18271)
add 29d700d Add metrics docs for triggerer metrics (#18254)
add 184f394 Use try/except when closing temporary file in task_runner (#18269)
add 671de3f Improved log handling for zombie tasks (#18277)
add ed10edd Silence warnings in tests from using SubDagOperator (#18275)
add c313feb Fix web view rendering errors without a DAG run (#18244)
add 21d53ed Fix provider test acessing importlib-resources (#18228)
add f8ba475 Make `XCom.get_one` return full, not abbreviated values (#18274)
add 2dac083 Fixed wasb hook attempting to create container when getting a blob client (#18287)
add 73044af Chart: Use stable API versions where available (#17211)
add 0527624 Chart: Fix applying labels on Triggerer (#18299)
add 8692cbf Fix Chart doc build (#18302)
add 3ddb389 Run Docs build when updating `chart/UPDATING.rst` (#18303)
add 5e9a877 Add information about differencies of deps in eager-upgrade (#18293)
add 475fcd1 Added Bentego to INTHEWILD.md (#18301)
add 246e5b4 Pass exception to ``run_finished_callback`` for Debug Executor (#17983)
add 7e132a0 Fix spelling on chart docs (#18308)
add 11621ce Build docs when chart changelog or values schema changes (#18307)
add 3f493be Add 2.2.0b1 changelog (#18205)
add 18fef9b Fix mini scheduler not respecting wait_for_downstream (#18310)
add 4308a8c Refactor installation pages (#18282)
add 516d6d8 Chart: Ability to access http k8s via multiple hostnames (#18257)
add d7a8a8f Chart: less fragile webserver deployment tests (#18332)
add ca97178 Fix mini scheduler not respecting ``wait_for_downstream`` dep (#18338)
add 0b7b133 Move DB call out of ``DatabricksHook.__init__`` (#18339)
add 9a63bf2 Graceful scheduler shutdown on error (#18092)
add 7b1196b Fix kinesis test (#18337)
add bfe7726 Added more automation on latest version (#18335)
add 87e9865 Fix breeze failing breeze on missing docker config (#18330)
add d9c0e15 Dag bulk_sync_to_db dag_tag only remove not exists (#8231)
add 410e6d7 Initial commit (#18203)
add a54f8d6 Remove 2017-latest from supported MSSQL versions (#18345)
add 7458f1e Remove check for at least one schema in GCSToBigquery (#18150)
add 50e2e6e Explain sentry default environment variable for subprocess hook (#18346)
add 27088c4 Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)
add 4cd190c ECSOperator realtime logging (#17626)
add 2b62a75 fix get_connections deprecation warning in webhdfs hook (#18331)
add dcfa14d add sla_miss_callback section to the documentation (#18305)
add dc94ee2 Improve coverage for airflow.security.kerberos module (#18258)
add e81f14b Deactivating DAGs which have been removed from files (#17121)
add e25eea0 Inclusive Language (#18349)
add 94749b0 Do not display resource statistics during parallell jobs (#18344)
add c0fbe3a Fix broken static check on main (#18351)
add c56ce29 Chart: Update the default Airflow version to ``2.1.4`` (#18354)
add 59b3c5c Doc: Fix broken ``asc`` download link (#18350)
add e5b6f36 Fix links in releasing guide (#18352)
add 7d0df1f Update version added field in config after 2.1.4 release (#18355)
add 7e7304e Add Changelog and other 2.1.4 details (#18353)
add 11e3453 Creating ADF pipeline run operator, sensor + ADF custom conn fields (#17885)
add 14b3e66 Improve coverage for airflow.cli package (#18220)
add 1008d8b Set default branch in codecov.yml (#18361)
add f382a79 Add support for templated fields in PapermillOperator (#18357)
add f76eaec Fix random deadlocks in MSSQL database (#18362)
add d1f3d8e Show Triggers table in Webserver (#17876)
add a01c08b Don't permanently add zip DAGs to ``sys.path`` (#18384)
add bada372 Fix stuck "queued" tasks in KubernetesExecutor (#18152)
add a9772cf Add a Docker Taskflow decorator (#15330)
add ef0ff3f Added example JSON for airflow pools import (#18376)
add 18d7e1e Fix BigQuery system test (#18373)
add c686241 Display alert messages on dashboard from local settings (#18284)
add e8667b6 Add PGBouncer recommendation in "setup-database' doc. (#18399)
add ab7acfd Production-level support for MSSQL (#18382)
add a8184e4 Stop using docker manifest to check for image presence (#17883)
add d856b79 Always draw borders if task instance state is null or undefined (#18033)
add 060345c Add docs for AIP 39: Timetables (#17552)
add 43bd351 Add common parameter to example URI for MSSQL (#18404)
add a91d9a7 Labels on job templates (#18403)
add d4662ab Add ODBC extra for the production image (#18407)
add 5f07675 Update boto3 to <1.19 (#18389)
add 44f601e Properly handle ti state difference between executor and scheduler (#17819)
add 7808be7 Make Kubernetes job description fit on one log line (#18377)
add eed2ef6 Explain scheduler fine-tuning better (#18356)
add f74d0ab Require can_edit on DAG privileges to modify TaskInstances and DagRuns (#16634)
add a5afd1b Update 2.2.0 changelog for b2 (#18417)
add bbb5fe2 Fix ``docker-stack`` docs build (#18419)
add a99e9b5 Add Opus Interactive to INTHEWILD (#18423)
add edee250 Add driver parameter for MsSQL URL for production image in docs (#18426)
add 92e7759 Chart Doc: Delete extra space in adding connections doc (#18424)
add cbb1f5a add extraContainers for migrateDatabaseJob (#18379)
add bfc78d1 Fix image retagging when pulling the images (#18433)
add 1849d4d Switch to latest version of PGBouncer-Exporter (#18429)
add 414f41e Custom timetable must return aware datetimes (#18420)
add 13a558d Add cascade to DagRun/TaskInstance relationship (#18434)
add 56d1765 Properly fix dagrun update state endpoint (#18370)
add d50cfd1 Fix task instance url in webserver utils (#18418)
add 3db4656 Protect agains images not being pulled properly (#18435)
add 7e7fa62 Limit azure-storage-blob due to breaking changes in 12.9.0 (#18443)
add 716c635 Doc: Fix remote name in Airflow publishing guide (#18451)
add 7924249 Avoid importing DAGs during clean DB installation (#18450)
add 6dbeb82 Allow users to submit bugs for 2.2.0b2 (#18452)
add c1f34bd Remove unnecessary css state colors (#18461)
add deb01dd Fix task group tooltip (#18406)
add 0359fc1 Add fixing of ownership also for sources in Breeze (#18464)
add 2a3cbab Cope with `@task.docker` decorated function not returning anything (#18463)
add 0e58de7 Bring back version to docker-compose files (#18472)
add 958b679 Revert "Fix task instance url in webserver utils" and fix properly (#18444)
add 9bf0ed2 Restore 'filename' to template_fields (#18466)
add a5439ee Add index to the dataset name to have separate dataset for each example DAG (#18459)
add 1ef41be Correctly select ``DagRun.execution_date`` from db (#18421)
add a74c94c Added Zalando to ``INTHEWILD.md`` (#18480)
add e81c7df Remove redundant ``session.commit()`` in migration (#18453)
add 381a839 Update best practices around deleting a task (#18483)
add 7006068 Doc: Fix example timetable for AIP-39 howto (#18475)
add 7ce29f5 Docs: Fix grammar in ``docs/apache-airflow/start/docker.rst`` (#18484)
add df13147 Chart: warn when webserver secret key isn't set (#18306)
add 1d2924c Proper handling of Account URL custom conn field in AzureBatchHook (#18456)
add 6609e9a Add start date to ``trigger_dagrun`` operator (#18226)
add 56a69b7 Pin ``google-cloud-dataproc`` to ``<2.6.0`` due to removal of ``v1beta2`` client (#18486)
add 3857aa8 Implement test to detect actions that are missing required security decorator. (#18467)
add 18e91bc Don't use flash for "same-page" UI messages. (#18462)
add 96f09b1 Add more informative messages when rebuilding the image (#18496)
add ac4acf9 Increase timeouts for setup/teardown in pytest (#18505)
add be82001 Add missing email type of connection (#18502)
add 8c2e329 Add ok.ru into the list of airflow users (#18507)
add 7ecca70 Add Pathstream to INTHEWILD.md (#18508)
add 6982a29 Add missing type of tests to breeze. (#18504)
add f1ea87a Chart: 1.2.0 changelog (#18510)
add 97d6892 Rename AzureDataLakeStorage to ADLS (#18493)
add da15121 Improve guidance to users telling them what to do on import timeout (#18478)
add 31c7ef5 Add setting up using VS Code (#15631)
add 2f44f0b 18400 chart custom pod annotations (#18481)
add c1578fb Improve error message for BranchPythonOperator when no task_id to follow (#18471)
add 4648446 Removing redundant relabeling of password conn field (#18386)
add f37c360 Add Dcard to the list of companies using Airflow (#18521)
add 7b7661a Fixed naming in the Spark Connection Extra field (#18469)
add e50dc9e Added notification to solve "docker-credential-service-error" (#18524)
add 7c9aba5 Inherit `AirflowNotFound` from `connextion.NotFound` for better readability (#18523)
add 29493d2 Add Slack operators how-to guide (#18525)
add 2643345 Add guide for Apache Druid operators (#18527)
add dc3bf42 Fix running helm tests in parallel (#18533)
add 932c3b5 Improve isolation of MSSQL files (#18538)
add fa1a088 Remove workaround for docker-compose-failures (#18539)
add 387c43f Fix intermittent orphan test (#18530)
add 391da64 Excludes rightfullhy unlicensed files from chart from RAT check (#18547)
add a458fcc Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)
add 2fadf3c Fix kubernetes engine system test (#18548)
add 892c5fc Add package filter info to Breeze build docs (#18550)
add 80ae70c Fix ``DetachedInstanceError`` when dag_run attrs are accessed from ti (#18499)
add de9b02f Updating the Elasticsearch example DAG to use the TaskFlow API (#18565)
add 1e5d5e3 Allow core Triggerer loops to yield control (#18552)
add 4281e51 Doc: Fix typo in Triggerer docs (#18560)
add 34396ad Fetch PR labels from API for Build Images workflow (#18572)
add 273e9b2 Give MSSQL container more time to start up (#18476)
add b0a2977 Fix flaky redis tests (#18537)
add 1ac63cd Fix rendering nested task fields (#18516)
add 806e4bc Adding `task_group` to the BaseOperator docstring (#18564)
add 45e8191 Allow airflow standard images to run in openshift utilising the official helm chart #18136 (#18147)
add 4f3aa43 Change location of bucket creation for Datastore (#18569)
add 2fbd238 Update s3_list.py (#18561)
add 48d4c5d Move FABs base Security Manager into Airflow. (#16647)
add d0cc912 Operator help code optimisation (#18571)
add 24e57d6 Add in Bidnamic to INTHEWILD.md (#18589)
add c747bce Influxdb Hook (#17068)
add 1b42766 Add Macquarie Group to the list of companies using Airflow (#18591)
add 05fb915 Fixing flaky test that fails when run with other test that leave a trace (#18586)
add 2187008 Small typo in JdbcOperator (#18593)
add f467a8e Only show the task modal if it is a valid instance (#18570)
add ca93ff4 Fix errors upgrading from Airflow 1.10.15 (#18573)
add 90cb45b De-dup and reorganize render template tests (#18432)
add 461ec4c Bugfix: dag_bag.get_dag should not raise exception (#18554)
add 9279c44 Fix part of Google system tests (#18494)
add d50c7ec Fix helm chart links in source install guide (#18588)
add 9133ff4 Chart docs: Update webserver secret key reference configuration (#18595)
add ffd3cbd Add helm chart 1.2.0 to chart bug issue template (#18609)
add e845275 Updating the InfluxDB example DAG to use the TaskFlow API (#18596)
add ef037e7 Static start_date and default arg cleanup for misc. provider example DAGs (#18597)
add 0a8abbf Fix spelling of execution. (#18594)
add afec743 Spelling fix (#18606)
add 26680d4 fix setting task nodes class names (#18607)
add 057cc0a Add in before_send config option to sentry integration (#18261)
add d2bdf05 Check docker-compose version in breeze (#18536)
add 324aca4 Improve how UI handles datetimes (#18611)
add 339eb0a Update helm chart release docs (#18612)
add 1763180 Fix helm chart unittests on public runners (#18553)
add 8a1437e Refresh credentials for long-running pods on EKS (#17951)
add 0e887dc Change label from area:docs to kind:documentation (#18624)
add 0199c5d Bugfix: Don't warn on using ``LocalExecutor`` (#18625)
add 6e2a317 Fix `retry_exponential_backoff` divide by zero error when retry delay is zero (#17003)
add c974917 Add multiple roles when creating users (#18617)
add 6ef96a9 Fix typo in comments (#18626)
add abdede8 fix exception string of BranchPythonOperator (#18623)
add b8ce5f0 Revert "Fix intermittent orphan test (#18530)" (#18631)
add b858b98 Combine changelog entires for AIPs 39 and 40 in to a single row (#18633)
add 4f16163 Adding a default conn ID value for Apache Cassandra sensors (#18620)
add ef71c35 Added VLMedia to INTHEWILD (#18636)
add 33bdd3d Updating ADX conn docs to reflect new custom fields (#18132)
add 840ea3e Update documentation for September providers release (#18613)
add d0ffd31 Fix flaky test `test_set_dag_runs_action` (#18618)
add d79f506 Add default weight rule configuration option (#18627)
add 5db757a Update changelog for changes since 2.2.0b2 (#18639)
add b6aa8d5 Fix typo change GitHyb to GitHub (#18640)
add db2d73d Retry deadlocked transactions on deleting old rendered task fields (#18616)
add 932a225 Add muldelete action to TaskInstanceModelView (#18438)
add 0a37be3 Add region to Snowflake URI. (#18650)
add d74e677 Make AirflowDateTimePickerWidget a required field (#18602)
add 3e409fa Fix section formatting in the "Customizing the UI" docs page (#18658)
add 87dc63b Remove empty doc from influxdb provider (#18647)
add 8dfb6a7 Fix stop_airflow typos in CONTRIBUTORS_QUICK_START.rst (#18656)
add 4f9b097 Patch `utcnow` in retry delay test (#18343)
add af4a5e0 Remove cargo-culted local in-page ToCs (#18668)
add 2f88009 Fix error on triggering a dag that doesn't exist using dagrun_conf (#18655)
add 1213386 Support all Unix wildcards in S3KeySensor (#18211)
add 3172be0 Check the allowed values for the logging level (#18651)
add 10421c6 update azure cosmos version (#18663)
add 2bcd674 Added Viscovery to the list of companies using Apache Airflow (#18683)
add c8485a8 Revert "update azure cosmos version (#18663)" (#18694)
add 3a59a85 Correcting text in core extenders docs (#18661)
add 6d504b4 Expanding docs on client auth for AzureKeyVaultBackend (#18659)
add 7efee00 Typo in docs/apache-airflow/installation/index.rst (#18689)
add f8c31b5 Add max_ingestion_time to DruidOperator docstring (#18693)
add 8fa976e Add formatDateTime back into ti log (#18700)
add 86bf2a2 Simplify strings previously split across lines (#18679)
add 2630341 Fix compatibility issues with docker-compose 2 (#18725)
add 0355d3f Fix eager-upgrade builds for Airflow main. (#18719)
add c596ef4 Add example DAG using TimeDeltaSensorAsync (#18728)
add cc52548 Dockerfile: Fix env variable typo ``_AIRFLOW_WWW_USER_LASTNME`` (#18727)
add 385b4a4 Add ``DaskExecutor`` queue handling change to ``UPDATING.md`` (#18720)
add 181ac36 update azure cosmos to latest version (#18695)
add a834dee Ensure task_instance exists before running update on its state(REST API) (#18642)
add 6b71eac Renaming variables to be consistent with code logic (#18685)
add b0442f3 Handle timetable exception in ``DAG.next_dagrun_info`` (#18729)
add 29aa7f0 Properly set start_date for cleared tasks (#18708)
add 016f55c Pretty print diff for order checks (#18686)
add 537963f update minimum version of sshtunnel to 0.3.2 (#18684)
add 5f7fc59 Add google-ads limitation to eager upgrade (#18741)
add 12763f1 Add additional dependency for postgres extra for amazon provider (#18737)
add 1b75f91 Fix changelog for Azure Provider (#18736)
add 57bb47f Updates link to "stable" URLs for providers "installing from sources" (#18735)
add 4e10c25 Rename ``processor_poll_interval`` to ``scheduler_idle_sleep_time`` (#18704)
add cf1f6e1 Fix typos in IMAGES.rst, README_RELEASE_PROVIDER_PACKAGES.md and REFRESHING_CI_CACHE.md (#18751)
add 1697617 Don't ignore legacy `concurrency` dag parameter (#18730)
add 760bf6e Adds an s3 list prefixes operator (#17145)
add 2c2bbb5 Fix "Test" connection button when app not mounted at `/` (#18750)
add 958860f Remove AIRFLOW_GID from Docker images (#18747)
add 9eae83c Remove eagerloading when querying for TI (#18706)
add a192b4a Chart: Mount DAGs in triggerer (#18753)
add 767a4f5 ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)
add 2a6cadb Small improvements for Airflow UI (#18715)
add c9bf5f3 Coerce datetime to pendulum for timetable (#18522)
add cf27419 Fix Pendulum 1.x references in documentation (#18766)
add a36e7ba Make REST API patch user endpoint work the same way as the UI (#18757)
add 72e49ad Amazon SQS Example (#18760)
add cdb34a4 Quarantine iest_no_orphan_process_will_be_left (#18778)
add 43f334f Move docker decorator example dag to docker provider (#18739)
add 5306a60 Bump pre-commits: `black` and `pyupgrade` (#18782)
add cfc2e1b Always run at least one backfill from BackfillJob (#18742)
add e351ead Change the color for deferred status to mediumpurple (#18414)
add 32947a4 Fix deprecated default for ``fab_logging_level`` to ``WARNING`` (#18783)
add dc45f97 Adds CeleryKubernetesExecutor check to AirflowBaseView.run (#18441)
add 63ca12c Open src and dst in binary for samba copy (#18752)
add 38c6cf9 AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)
add 28284a3 Amazon Athena Example (#18785)
add e15e79b Adds Hacktoberfest label to participate in Hacktoberfest 2021 (#18781)
add 9a5ac14 Fix bug that backfill job fail to run when there are tasks run into reschedue state (#17305)
add cfa8fe2 UI: Fix alignment of Delete Button (#18795)
add 6bc0f87 Properly handle verify parameter in TrinoHook (#18791)
add 6103b26 Stabilize flaky test_extra_operator_links_not_loaded_in_scheduler_loop (#18796)
add 20df60d Dataflow Operators - use project and location from job in on_kill method. (#18699)
add 8d7340b Stabilize flaky test_do_schedule_max_active_runs_dag_timed_out (#18531)
add c10442e Backport fix to allow pickling of Loggers to Python 3.6 (#18798)
add 24f549c Docs: Move part of timetable guide to concepts (#18786)
add 953f226 Update changelog with more changes since 2.2.0b2 (#18780)
add b70fded Fix flaky test_external_task_marker_cyclic_deep test (#18802)
add 5bc64fb Update instructions to create Airflow release (#18809)
add cdaa9aa Accept custom run ID in ``TriggerDagRunOperator`` (#18788)
add f909ff5 Update changelog to the latest (#18811)
add 8e56ed2 Enable FTPToS3Operator to transfer several files (#17937)
add 39359b9 Add standard hook fields to pagerdutyHook to make hook show up in UI (#18763)
add 4c9964c Install only devel packages (#18815)
add e6c56c4 Ensure that dag_id, run_id and execution_date are non-null on DagRun (#18804)
add e0af0b9 AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)
add e286ee6 Add unittest for #17305 (#18806)
add 42dc076 Remove unnecessary string concatenations in AirflowException messages (#18817)
add e9a72a4 Add SalesforceApexRestOperator (#18819)
add 73a858f Update ``dagbag_size`` documentation (#18824)
add 1a35644 Add emr cluster link (#18691)
add cf98586 Update documentation about bundle extras (#18828)
add 069acde Fix wrong Postgres search_path set up instructions (#17600)
add 9344c34 Enable AWS Secrets Manager backend to retrieve conns using different fields (#18764)
add ea8f478 Add AWS Fargate profile support (#18645)
add a680e87 Prepare documentation for RC2 Amazon Provider release for September (#18830)
add b8efdac Add last items to changelog before 2.2.0rc1 (#18837)
add 22768ff Removed duplicated code on S3ToRedshiftOperator (#18671)
add 1df9a51 Add RedshiftSQLHook, RedshiftSQLOperator (#18447)
add b9517f3 Fixing tests that leave traces (users) (#18690)
add f248a21 Remove duplicate code on dbapi hook (#18821)
add 3ddb365 Duplicate Connection: Added logic to query if a connection id exists before creating one (#18161)
add 4da9392 Added Parimatch Tech into userlist (#18848)
add d17ae60 Handle leading slash in samba path (#18847)
add 420367d add more type hints in CeleryKubernetesExecutor (#18219)
add c3c5ad2 Increase timeout of the job pushing to GitHub registry (#18856)
add aee48cc Quarantine maintain_hear_rate test (#18860)
add be37cad Update bug template to 2.2.0rc1 (#18861)
add fd45f5f Fix occassional deadloc on MSSQL test DagMaker cleanup (#18857)
add 8cb3518 Attempt to fix flaky timeout test (#18862)
add 36e39f6 Check min docker version (#18869)
add 34e09cc Strips suffixes from docker version (#18871)
add 232f7d1 fix get_connections deprecation warn in hivemetastore hook (#18854)
add b9fff8c Add MSSQL variables to dc_ci script (#18873)
add 1d7cfdb Remove extra postgres dependency from AWS Provider (#18844)
add 862ad04 Adds Bwtech and Inter Platform Inc. to the list of companies using Apache Airflow (#18876)
add 3053603 Change the contact person for Clover (#18884)
add 4115b84 Ignore License check in ``airflow/www/static/robots.txt`` (#18886)
add d6c8730 Adds back documentation about context usage in Python/@task (#18868)
add 223f055 Fix failing static check (#18890)
add 9526c7a Fix failing static check (#18891)
add d27dffd Group PATCH DAGrun together with other DAGRun endpoints (#18885)
add eae7b2e Doc: Add Callbacks Section to Logging & Monitoring (#18842)
add d59be1e refactor connection tests (#18881)
add d425f89 Release 2.2.0 (#18892)
add ec31b20 breeze setup-autocomplete zshrc reload (#18893)
add 176165d Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807)
add 6f03529 Fix occasional cleartask failures (#18859)
add ab5b2bf Workaround docker-compose-v2 env passing (#18887)
add 9c2eb9d Remove deprecated usage of init_role() from API (#18820)
add d23e071 Chart: Update default Airflow version to `2.2.0` (#18898)
add cb9d142 Update version added field in config after 2.2.0 release (#18899)
add a05f0c3 Fix comparision of docker versions (#18902)
add 7d3b6b5 Remove adding of "test-run" variables to dc_ci script (#18903)
add 3154935 Remove the docker timeout workaround (#18872)
add bc19ae7 Stabilize occasional test_logging_head_error_request failures (#18858)
add b4321de Updating explicit arg example in TaskFlow API tutorial doc (#18907)
add 509d4d3 Handle occasional segfaults despites tests succeding (#18863)
add ce0b64e Fix --github-image-id flag for Breeze (#18882)
add 5d9e5f6 Decrease likelihood of memory issue in CI (#18852)
add 923f5a5 Make a separate hook for interacting with the Pagerduty Events API (#18784)
add 758530d Chart: Make PgBouncer cmd/args configurable (#18910)
add 7a28ee3 Fix occasional external task sensor tests (#18853)
add f22c834 Add information about keepalives for managed Postgres (#18850)
add c8b86e6 Add more information to PodLauncher timeout error (#17953)
add a59775b Revert "Fix --github-image-id flag for Breeze (#18882)" (#18923)
add c4f5233 Bump chart version to `1.3.0-dev` (#18919)
add 2f38c6f Fix typos ``build.rst`` (#18935)
add e6a6908 Chart: Use python 3.7 by default; support disabling triggerer (#18920)
add 0131726 Doc: grammar check - remove a word (#18914)
add 42ea951 Clean test_user once assert is complete (#18865)
add 829f19f Updating core example DAGs to use TaskFlow API where applicable (#18562)
add 23c8e54 Switch default version of Python to 3.7 (#18922)
add a90878c Don't bake ENV and _cmd into tmp config for non-sudo (#18772)
add 688b973 Fix occassionally failing timeout test (#18947)
add a256af0 Update modules_management.rst (#18948)
add b2045d6 Add more type hints to PodLauncher (#18928)
add d4a3d2b Adding feature in bash operator to append the user defined env variable to system env variable (#18944)
add f0e2143 Check python version before starting triggerer (#18926)
add 306d060 Add ``semver`` to devel deps (#18818)
add 73fcbb0 Refactor SSHOperator so a subclass can run many commands (#10874) (#17378)
add a6be597 Test kubernetes refresh config (#18563)
add 47c5973 Fix XCom.delete error in Airflow 2.2.0 (#18956)
add eb2c7af Changes related to PR #16634 (#18644)
add 8e19ed6 Add description about `not a directory` errors in WSL2 (#18976)
add 0a82a42 Fix --github-image-id flag for Breeze (#18882) (#18946)
add d5aebf1 Align the default version with Facebook business SDK (#18883)
add 1edcd42 Sentry before send fallback (#18980)
add 52cc84c Row lock TI query in SchedulerJob._process_executor_events (#18975)
add 2ba722d Fix typo in ``tutorial.rst`` (#18983)
add f967ca9 Try to move "dangling" rows in upgradedb (#18953)
add 141d9f2 Adds Pendulum 1.x -> 2.x upgrade documentation (#18955)
add 1571f80 Add pre-commit hook for common misspelling check in files (#18964)
add 2966e3c BugFix: Null execution date on insert to ``task_fail`` violating NOT NULL (#18979)
add cc627b3 Add decription on how you can customize image entrypoint (#18915)
add fb00240 Update CSV ingest code for tutorial (#18960)
add 3f6d9b6 Handle case of nonexistent file when preparing file path queue (#18998)
add 258451c MySQLToS3Operator add support for parquet format (#18755)
add 406b38b Replace default api_version of FacebookAdsReportToGcsOperator (#18996)
add 3545a2c CI: Increase parallel test timeout for Helm Chart tests (#18993)
add 5c3e453 Fix BigQueryToMsSqlOperator documentation (#18995)
add b814ab4 CLI: Fail ``backfill`` command before loading DAGs if missing args (#18994)
add 866c764 Chart: Increase default liveness probe timeout (#19003)
add 5061f52 Fix typos in ``CHANGELOG.txt`` (#19012)
add 6032159 Upgrade old DAG/task param format when deserializing from the DB (#18986)
add d937beb Doc: Restoring additional context in Slack operators how-to guide (#18985)
add ee8e0b3 Minor grammar tweaks in docs (#19013)
add de98976 Add pandas requirements for providers that use pandas (#18997)
add 603a3b2 Skip updating constraints when only datetime changes (#19023)
add 80b5e65 Remove unnecessary string concatenations in AirflowException in s3_to_hive.py (#19026)
add a418fd9 Use google cloud credentials when executing beam command in subprocess (#18992)
add 86a2a19 More f-strings (#18855)
add e5422f0 Removing redundant max_tis_per_query initialisation on SchedulerJob (#19020)
add 8858309 Workaround libstdcpp TLS error (#19010)
add 0e95b57 Google provider catch invalid secret name (#18790)
add 614de56 Rename execution date in forms and tables (#19063)
add d5a029e Document `hdfs_namenode_principal` for HDFS connections (#18987)
add 8745fb9 Fix: Add taskgroup tooltip to graph view (#19083)
add 4548199 Relax packaging requirement (#19087)
add fe28902 Add docker-compose explanation to conn localhost (#19076)
add ee4fb07 Allow Param to support a default value of ``None`` (#19034)
add 5c79495 Add dataroots to Airflow users (#19074)
add eb5cae0 Rename trigger page label to Logical Date (#19061)
add 2179964 Updating TaskGroup unit test to handle new tooltip (#19089)
add 561610b Adding dag_id_pattern parameter to the /dags endpoint (#18924)
add 8d703ae Ensure task state doesn't change when marked as failed/success/skipped (#19095)
add 25a50bb Change `ds`, `ts`, etc. back to use logical date (#19088)
add 326e2b1 Fix wrong commands in docs/breeze
add d75cf4d Don't install SQLAlchemy/Pendulum adapters for other DBs (#18745)
add cc3b062 Update taskinstance REST API schema to include dag_run_id field (#19105)
add ceb2b53 Static start_date and default arg cleanup for Microsoft providers example DAGs (#19062)
add 5dc375a Prevent scheduler crash when serialized dag is missing (#19113)
add 05eea00 Fix catchup by limiting queued dagrun creation using max_active_runs (#18897)
add 91a12a7 [Minor] Fix padding on home page (#19025)
add e6fcf77 Hide tooltip when next run is none (#19112)
add 55eb525 Add Pinterest to Airflow users list (#19117)
add c14aed3 Warn about unsupported Python 3.10 (#19060)
add 3928eec Update "Release Airflow" doc (#19111)
add 4fae04a Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879)
add e4888a0 Remove distutils usages for Python 3.10 (#19064)
add ed40c4b Move away from legacy importlib.resources API (#19091)
add 0a68506 Update docstring to let users use `node_selector` (#19057)
add 34e586a Add sensor default timeout config (#19119)
add 9ad8d2e Update virtualenv guide to use correct constraints file (#19141)
add f5ad26d Fixup string concatenations (#19099)
add 3a93ad1 Chart: Fix `extraEnvFrom` examples (#19144)
add 829f90a Fix queued dag runs changes catchup=False behaviour (#19130)
add 6deebec Consolidate method names between Airflow Security Manager and FAB default (#18726)
add 1159133 Crerate TI context with data interval compat layer (#19148)
add 205219c Add test for interval timetable catchup=False (#19145)
add 324c31c add detailed information to logging when a dag or a task finishes. (#19097)
add 4d1f14a Navigate directly to DAG when selecting from search typeahead list (#18991)
add d9192a5 Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052)
add be2e109 Update INTWILD.md to add Retailink (#19115)
add 90b15e9 Added Wayfair to the list of companies using Apache Airflow (#19162)
add 10e2a88 Adds Sprylab as user "in the wild" (#19159)
add d3ac010 Add TriggererJob to jobs check command (#19179)
add f47d7b9 Allow specifying extras when using breeze initialize_local_virtualenv (#19178)
add 1fb4729 Remove incorrect type comment in Swagger2Specification._set_defaults classmethod (#19065)
add d709094 Fix breeze docker version parsing (#19182)
add 6ad837c Add migration job resources (#19175)
add fe998a4 Fix airflow jobs check cmd for TriggererJob (#19185)
add 559d607 Faster PostgreSQL db migration to Airflow 2.2 (#19166)
add 8a0d6c2 Clear ti.next_method and ti.next_kwargs on task finish (#19183)
add 51dc83e Add role export/import to cli tools (#18916)
add acfb7b5 Add test_connection method for Snowflake Hook (#19041)
add a1cb20b Add a fix on Ubuntu 20.04 for mysql_config not found error (#19184)
add 5616dcb Add DagRun.logical_date as a property (#19198)
add aa1aa99 Fix static checks (#19200)
add d53d4f9 Moving the example tag a little bit up to include the part where you specify the snowflake_conn_id (#19180)
add 81c24e2 Allow Airflow UI to create worker pod via Clear > Run (#18272)
add 33a52fa Update to correctly resolve 'PostgresOperator' (#19212)
add cdbb481 Fix Unexpected commit error in schedulerjob (#19213)
add 726a151 Fix bug in Dataflow hook when no jobs are returned (#18981)
add 77c9268 Removes hard-coding of /tmp filesystem cache (#19208)
add d426b46 Chart: Add labels to jobs created by cleanup pods (#19225)
add f83099c Doc: Improve tutorial documentation and code (#19186)
add 7ecf29f Fix hard-coded /tmp directory in CloudSQL Hook (#19229)
add eba1b68 Update dataflow.py (#19231)
add efdfd15 Dev: Clarify file naming in release verification doc (#19233)
add 3c08c02 Move validation of templated input params to run after the context init (#19048)
add 61d0093 Added sas_token var to BlobServiceClient return. Updated tests (#19234)
add df46549 Create CommandExecutor for raising an exception in case of error during cmd execution (#17651)
add 8dfc3ca Add release date for when an endpoint/field is added in the REST API (#19203)
add b49b81a Fix release check script (#19238)
add bce8883 sqlite_default has been hard-coded to /tmp, usegettempdir instead, (#19255)
add d51c149 Edit permalinks in OpenApi description file (#19244)
add 20847fd Add value to "namespaceId" of query (#19163)
add 83eb80d SFTP hook to prefer the SSH paramiko key over the key file path (#18988)
add 60fade2 Rename variable `serialize_dag` to `serialized_dag` (#19265)
add e4aa377 Update BigQueryCreateExternalTableOperator doc and parameters (#18676)
add c955078 Added theScore to the list of companies using Apache Airflow (#19253)
add fd569e7 #19223 add mongo_db param to MongoSensor (#19276)
add 55abc2f Support query timeout as an argument in CassandraToGCSOperator (#18927)
add 8f5c222 Modify doc contributing (#19124)
add 4c5de7f Grammar mistake (#19283)
add e76a69b Fix MySQL db migration with default encoding/collation (#19268)
add b5df0f9 pyenv related docs added, warning message in breeze initialize-local-virtualenv command (#19100)
add 04e5fef docs: reorder imports in tutorials 🎨 (#19035)
add 04458b6 Updating Apache HDFS title in index doc (#19169)
add 45c70f3 Add support of placement in the DockerSwarmOperator (#18990)
add e0aa36e Add explicit session parameter in PoolSlotsAvailableDep (#18875)
add aa6c951 Fix task instance modal in gantt view (#19258)
add 73b0ea1 Update BaseOperator type hints for retry_delay, max_retry_delay, dag. (#19142)
add 6a3f837 Remove redundant Union of one item (#19297)
add 0649688 Typo fix in TESTING.rst (#19216)
add 1543dc2 Fixing ses email backend (#18042)
add 8e124ae Skip triggerer in 'breeze start-airflow' if on 3.6 (#19305)
add 2fdcb8a Clarify rat test guidance in release check docs (#19296)
add 2dfe85d Expanding ``.output`` operator property information in TaskFlow tutorial doc (#19214)
add e6ce871 Use fab models (#19121)
add b12503e Add 2.2.1 to readme, changelog, updating, etc (#19318)
add 9929fb9 change pyenv url readme, more specific (#19319)
add 2197e4b Correctly handle get_pty attribute if command passed as XComArg or template (#19323)
add d9567eb Prepare documentation for October Provider's release (#19321)
add 98d9067 Switch default Python version to 3.7 (#19317)
add f961ae0 Fix various typos (#19316)
add dff3074 Add missing parameter documentation for "timetable" (#19282)
add 454ca2f add mongo_db param to function doc string (#19280)
add 82f4b6a Pre commit spellcheck fix (#19301)
add b8131d5 More friendly output of the airflow plugins command + add timetables (#19298)
add a355213 Chart: add resources for cleanup and createuser jobs (#19263)
add a3c9956 Add support of `path` parameter for GCloud Storage Transfer Service operators (#17446)
add 1600f1d Remove duplicated entries in changelog (#19331)
add 4bb1317 Update known warnings for Python 3.7 (#19333)
add 4fc7374 Redirect forked process output to logger
add e48e527 fixup! Redirect forked process output to logger
add 77f1d89 fixup! fixup! Redirect forked process output to logger
add 95c1387 Flush stdout before replace it with pipe
add 2226914 Update airflow/task/task_runner/standard_task_runner.py
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3491489)
\
N -- N -- N refs/heads/forked_suprocess_log (2226914)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 21 +-
.coveragerc | 1 +
.dockerignore | 6 +-
.editorconfig | 3 +
.gitattributes | 3 +
.github/CODEOWNERS | 15 +-
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 136 +
.../ISSUE_TEMPLATE/airflow_doc_issue_report.yml | 68 +
.../airflow_helmchart_bug_report.yml | 135 +
.../airflow_providers_bug_report.yml | 213 +
.github/ISSUE_TEMPLATE/bug_report.md | 89 -
.github/ISSUE_TEMPLATE/feature_request.md | 42 -
.github/ISSUE_TEMPLATE/feature_request.yml | 58 +
.github/ISSUE_TEMPLATE/~free_form.yml | 16 +
.github/PULL_REQUEST_TEMPLATE.md | 4 +-
.github/actions/cancel-workflow-runs | 1 -
.github/boring-cyborg.yml | 41 +-
.github/mergeable.yml | 2 +-
.github/workflows/build-images-workflow-run.yml | 562 ---
.github/workflows/build-images.yml | 351 ++
.github/workflows/ci.yml | 591 ++-
.github/workflows/codeql-analysis.yml | 14 +-
.github/workflows/label_when_reviewed.yml | 1 -
.../workflows/label_when_reviewed_workflow_run.yml | 13 +-
.github/workflows/repo_sync.yml | 36 -
.github/workflows/stale.yml | 7 +-
.gitignore | 4 +-
.gitmodules | 3 -
.mailmap | 2 +
.pre-commit-config.yaml | 267 +-
.rat-excludes | 21 +-
BREEZE.rst | 415 +-
CHANGELOG.txt | 769 +++-
CI.rst | 906 ++--
COMMITTERS.rst | 6 +-
CONTRIBUTING.rst | 243 +-
CONTRIBUTORS_QUICK_START.rst | 1047 ++++-
Dockerfile | 139 +-
Dockerfile.ci | 110 +-
IMAGES.rst | 263 +-
INSTALL | 54 +-
INTHEWILD.md | 50 +-
LICENSE | 15 +-
LOCAL_VIRTUALENV.rst | 26 +-
MANIFEST.in | 3 +-
NOTICE | 12 +-
PULL_REQUEST_WORKFLOW.rst | 24 +-
README.md | 223 +-
STATIC_CODE_CHECKS.rst | 501 ++-
TESTING.rst | 111 +-
UPDATING.md | 455 ++-
airflow/__init__.py | 19 +-
airflow/__main__.py | 10 +-
.../.gitignore => airflow/_vendor/__init__.py | 0
airflow/_vendor/connexion/__init__.py | 48 +
airflow/_vendor/connexion/__main__.py | 3 +
airflow/_vendor/connexion/apis/__init__.py | 1 +
airflow/_vendor/connexion/apis/abstract.py | 446 ++
airflow/_vendor/connexion/apis/aiohttp_api.py | 394 ++
airflow/_vendor/connexion/apis/flask_api.py | 310 ++
airflow/_vendor/connexion/apis/flask_utils.py | 81 +
airflow/_vendor/connexion/apps/__init__.py | 1 +
airflow/_vendor/connexion/apps/abstract.py | 249 ++
airflow/_vendor/connexion/apps/aiohttp_app.py | 95 +
airflow/_vendor/connexion/apps/flask_app.py | 138 +
airflow/_vendor/connexion/cli.py | 210 +
.../_vendor/connexion/decorators/__init__.py | 0
.../connexion/decorators/coroutine_wrappers.py | 53 +
airflow/_vendor/connexion/decorators/decorator.py | 51 +
airflow/_vendor/connexion/decorators/metrics.py | 54 +
airflow/_vendor/connexion/decorators/parameter.py | 123 +
airflow/_vendor/connexion/decorators/produces.py | 49 +
airflow/_vendor/connexion/decorators/response.py | 112 +
airflow/_vendor/connexion/decorators/security.py | 341 ++
.../_vendor/connexion/decorators/uri_parsing.py | 329 ++
airflow/_vendor/connexion/decorators/validation.py | 386 ++
airflow/_vendor/connexion/exceptions.py | 142 +
airflow/_vendor/connexion/handlers.py | 85 +
airflow/_vendor/connexion/http_facts.py | 15 +
airflow/_vendor/connexion/json_schema.py | 114 +
airflow/_vendor/connexion/jsonifier.py | 57 +
airflow/_vendor/connexion/lifecycle.py | 41 +
airflow/_vendor/connexion/mock.py | 47 +
airflow/_vendor/connexion/operations/__init__.py | 8 +
airflow/_vendor/connexion/operations/abstract.py | 445 ++
airflow/_vendor/connexion/operations/compat.py | 3 +
airflow/_vendor/connexion/operations/openapi.py | 380 ++
airflow/_vendor/connexion/operations/secure.py | 164 +
airflow/_vendor/connexion/operations/swagger2.py | 310 ++
airflow/_vendor/connexion/options.py | 144 +
airflow/_vendor/connexion/problem.py | 42 +
airflow/_vendor/connexion/resolver.py | 192 +
airflow/_vendor/connexion/setup.cfg | 7 +
airflow/_vendor/connexion/setup.py | 119 +
airflow/_vendor/connexion/spec.py | 262 ++
airflow/_vendor/connexion/utils.py | 250 ++
airflow/api/auth/backend/basic_auth.py | 10 +-
airflow/api/auth/backend/default.py | 8 +-
airflow/api/auth/backend/deny_all.py | 9 +-
airflow/api/auth/backend/kerberos_auth.py | 11 +-
airflow/api/client/api_client.py | 4 +-
airflow/api/client/json_client.py | 6 +-
airflow/api/common/experimental/delete_dag.py | 13 +-
airflow/api/common/experimental/mark_tasks.py | 29 +-
airflow/api/common/experimental/trigger_dag.py | 21 +-
.../api_connexion/endpoints/connection_endpoint.py | 31 +-
airflow/api_connexion/endpoints/dag_endpoint.py | 59 +-
.../api_connexion/endpoints/dag_run_endpoint.py | 80 +-
airflow/api_connexion/endpoints/health_endpoint.py | 2 +-
airflow/api_connexion/endpoints/log_endpoint.py | 16 +-
.../endpoints/role_and_permission_endpoint.py | 31 +-
.../endpoints/task_instance_endpoint.py | 86 +-
airflow/api_connexion/endpoints/user_endpoint.py | 135 +-
airflow/api_connexion/exceptions.py | 2 +-
airflow/api_connexion/openapi/v1.yaml | 526 ++-
airflow/api_connexion/parameters.py | 15 +-
airflow/api_connexion/schemas/common_schema.py | 4 +-
airflow/api_connexion/schemas/connection_schema.py | 11 +-
airflow/api_connexion/schemas/dag_run_schema.py | 68 +-
airflow/api_connexion/schemas/dag_schema.py | 24 +-
airflow/api_connexion/schemas/error_schema.py | 2 +-
.../schemas/role_and_permission_schema.py | 21 +-
.../api_connexion/schemas/task_instance_schema.py | 105 +-
airflow/api_connexion/schemas/task_schema.py | 7 +
airflow/api_connexion/schemas/user_schema.py | 2 +-
airflow/api_connexion/security.py | 2 +-
airflow/cli/cli_parser.py | 132 +-
airflow/cli/commands/celery_command.py | 70 +-
airflow/cli/commands/connection_command.py | 30 +-
airflow/cli/commands/dag_command.py | 103 +-
airflow/cli/commands/info_command.py | 8 +-
airflow/cli/commands/kubernetes_command.py | 25 +-
airflow/cli/commands/plugins_command.py | 2 +-
airflow/cli/commands/pool_command.py | 2 +-
airflow/cli/commands/provider_command.py | 48 +-
airflow/cli/commands/role_command.py | 52 +-
airflow/cli/commands/scheduler_command.py | 34 +-
airflow/cli/commands/standalone_command.py | 283 ++
airflow/cli/commands/sync_perm_command.py | 4 +-
airflow/cli/commands/task_command.py | 194 +-
airflow/cli/commands/triggerer_command.py | 55 +
airflow/cli/commands/user_command.py | 98 +-
airflow/cli/commands/variable_command.py | 4 +-
airflow/cli/commands/webserver_command.py | 26 +-
airflow/cli/simple_table.py | 7 +-
.../zendesk/hooks => airflow/compat}/__init__.py | 0
airflow/compat/asyncio.py | 25 +
airflow/compat/functools.py | 33 +
airflow/compat/functools.pyi | 27 +
airflow/config_templates/airflow_local_settings.py | 8 +-
airflow/config_templates/config.yml | 352 +-
airflow/config_templates/default_airflow.cfg | 149 +-
airflow/config_templates/default_celery.py | 5 +-
airflow/config_templates/default_test.cfg | 4 +-
.../config_templates/default_webserver_config.py | 10 +-
airflow/configuration.py | 160 +-
airflow/contrib/hooks/aws_athena_hook.py | 1 -
airflow/contrib/hooks/aws_datasync_hook.py | 1 -
airflow/contrib/hooks/aws_dynamodb_hook.py | 1 -
airflow/contrib/hooks/aws_firehose_hook.py | 1 -
airflow/contrib/hooks/aws_glue_catalog_hook.py | 1 -
airflow/contrib/hooks/aws_hook.py | 1 -
airflow/contrib/hooks/aws_lambda_hook.py | 1 -
airflow/contrib/hooks/aws_logs_hook.py | 1 -
airflow/contrib/hooks/aws_sns_hook.py | 1 -
airflow/contrib/hooks/aws_sqs_hook.py | 1 -
.../contrib/hooks/azure_container_instance_hook.py | 1 -
.../contrib/hooks/azure_container_registry_hook.py | 1 -
.../contrib/hooks/azure_container_volume_hook.py | 1 -
airflow/contrib/hooks/azure_cosmos_hook.py | 1 -
airflow/contrib/hooks/azure_data_lake_hook.py | 1 -
airflow/contrib/hooks/azure_fileshare_hook.py | 1 -
airflow/contrib/hooks/bigquery_hook.py | 1 -
airflow/contrib/hooks/cassandra_hook.py | 1 -
airflow/contrib/hooks/cloudant_hook.py | 1 -
airflow/contrib/hooks/databricks_hook.py | 1 -
airflow/contrib/hooks/datadog_hook.py | 1 -
airflow/contrib/hooks/datastore_hook.py | 1 -
airflow/contrib/hooks/dingding_hook.py | 1 -
airflow/contrib/hooks/discord_webhook_hook.py | 1 -
airflow/contrib/hooks/emr_hook.py | 1 -
airflow/contrib/hooks/fs_hook.py | 1 -
airflow/contrib/hooks/ftp_hook.py | 1 -
airflow/contrib/hooks/gcp_bigtable_hook.py | 1 -
airflow/contrib/hooks/gcp_cloud_build_hook.py | 1 -
airflow/contrib/hooks/gcp_dlp_hook.py | 1 -
airflow/contrib/hooks/gcp_mlengine_hook.py | 1 -
airflow/contrib/hooks/gcp_natural_language_hook.py | 1 -
airflow/contrib/hooks/gcp_pubsub_hook.py | 1 -
airflow/contrib/hooks/gcp_tasks_hook.py | 1 -
airflow/contrib/hooks/gcp_translate_hook.py | 1 -
.../contrib/hooks/gcp_video_intelligence_hook.py | 1 -
airflow/contrib/hooks/gcp_vision_hook.py | 1 -
airflow/contrib/hooks/gdrive_hook.py | 1 -
airflow/contrib/hooks/grpc_hook.py | 1 -
airflow/contrib/hooks/imap_hook.py | 1 -
airflow/contrib/hooks/jenkins_hook.py | 1 -
airflow/contrib/hooks/jira_hook.py | 1 -
airflow/contrib/hooks/mongo_hook.py | 1 -
airflow/contrib/hooks/openfaas_hook.py | 1 -
airflow/contrib/hooks/opsgenie_alert_hook.py | 1 -
airflow/contrib/hooks/pagerduty_hook.py | 1 -
airflow/contrib/hooks/pinot_hook.py | 1 -
airflow/contrib/hooks/qubole_check_hook.py | 1 -
airflow/contrib/hooks/qubole_hook.py | 1 -
airflow/contrib/hooks/redis_hook.py | 1 -
airflow/contrib/hooks/redshift_hook.py | 1 -
airflow/contrib/hooks/sagemaker_hook.py | 1 -
airflow/contrib/hooks/salesforce_hook.py | 1 -
airflow/contrib/hooks/segment_hook.py | 1 -
airflow/contrib/hooks/sftp_hook.py | 1 -
airflow/contrib/hooks/slack_webhook_hook.py | 1 -
airflow/contrib/hooks/snowflake_hook.py | 1 -
airflow/contrib/hooks/spark_jdbc_hook.py | 1 -
airflow/contrib/hooks/spark_sql_hook.py | 1 -
airflow/contrib/hooks/spark_submit_hook.py | 1 -
airflow/contrib/hooks/sqoop_hook.py | 1 -
airflow/contrib/hooks/ssh_hook.py | 1 -
airflow/contrib/hooks/vertica_hook.py | 1 -
airflow/contrib/hooks/wasb_hook.py | 1 -
airflow/contrib/hooks/winrm_hook.py | 1 -
airflow/contrib/operators/adls_list_operator.py | 23 +-
airflow/contrib/operators/aws_athena_operator.py | 1 -
.../contrib/operators/aws_sqs_publish_operator.py | 1 -
airflow/contrib/operators/awsbatch_operator.py | 1 -
.../azure_container_instances_operator.py | 1 -
airflow/contrib/operators/azure_cosmos_operator.py | 1 -
.../contrib/operators/bigquery_check_operator.py | 1 -
airflow/contrib/operators/bigquery_get_data.py | 1 -
airflow/contrib/operators/bigquery_operator.py | 1 -
airflow/contrib/operators/bigquery_to_bigquery.py | 1 -
.../operators/bigquery_to_mysql_operator.py | 1 -
airflow/contrib/operators/databricks_operator.py | 1 -
airflow/contrib/operators/dingding_operator.py | 1 -
.../contrib/operators/discord_webhook_operator.py | 1 -
airflow/contrib/operators/docker_swarm_operator.py | 1 -
airflow/contrib/operators/druid_operator.py | 1 -
airflow/contrib/operators/dynamodb_to_s3.py | 1 -
airflow/contrib/operators/ecs_operator.py | 1 -
.../contrib/operators/emr_add_steps_operator.py | 1 -
.../operators/emr_create_job_flow_operator.py | 1 -
.../operators/emr_terminate_job_flow_operator.py | 1 -
airflow/contrib/operators/file_to_wasb.py | 27 +-
airflow/contrib/operators/gcp_bigtable_operator.py | 1 -
.../contrib/operators/gcp_cloud_build_operator.py | 1 -
airflow/contrib/operators/gcp_dlp_operator.py | 1 -
airflow/contrib/operators/gcp_tasks_operator.py | 1 -
.../contrib/operators/gcp_translate_operator.py | 1 -
.../operators/gcp_translate_speech_operator.py | 3 +-
.../operators/gcp_video_intelligence_operator.py | 1 -
airflow/contrib/operators/gcp_vision_operator.py | 2 +-
airflow/contrib/operators/gcs_to_bq.py | 4 +-
.../operators/gcs_to_gcs_transfer_operator.py | 2 -
.../contrib/operators/gcs_to_gdrive_operator.py | 1 -
airflow/contrib/operators/grpc_operator.py | 1 -
airflow/contrib/operators/hive_to_dynamodb.py | 1 -
.../operators/imap_attachment_to_s3_operator.py | 1 -
.../operators/jenkins_job_trigger_operator.py | 1 -
airflow/contrib/operators/jira_operator.py | 1 -
.../contrib/operators/kubernetes_pod_operator.py | 1 -
airflow/contrib/operators/mongo_to_s3.py | 1 -
.../contrib/operators/opsgenie_alert_operator.py | 1 -
.../oracle_to_azure_data_lake_transfer.py | 1 -
.../contrib/operators/oracle_to_oracle_transfer.py | 1 -
airflow/contrib/operators/qubole_check_operator.py | 1 -
airflow/contrib/operators/qubole_operator.py | 1 -
.../contrib/operators/redis_publish_operator.py | 1 -
.../contrib/operators/s3_copy_object_operator.py | 1 -
.../operators/s3_delete_objects_operator.py | 1 -
airflow/contrib/operators/s3_list_operator.py | 1 -
airflow/contrib/operators/s3_to_gcs_operator.py | 1 -
.../operators/s3_to_gcs_transfer_operator.py | 1 -
airflow/contrib/operators/s3_to_sftp_operator.py | 1 -
.../contrib/operators/sagemaker_base_operator.py | 1 -
.../sagemaker_endpoint_config_operator.py | 1 -
.../operators/sagemaker_endpoint_operator.py | 1 -
.../contrib/operators/sagemaker_model_operator.py | 1 -
.../operators/sagemaker_training_operator.py | 1 -
.../operators/sagemaker_transform_operator.py | 1 -
.../contrib/operators/sagemaker_tuning_operator.py | 1 -
.../operators/segment_track_event_operator.py | 1 -
airflow/contrib/operators/sftp_operator.py | 1 -
airflow/contrib/operators/sftp_to_s3_operator.py | 1 -
.../contrib/operators/slack_webhook_operator.py | 1 -
airflow/contrib/operators/snowflake_operator.py | 1 -
airflow/contrib/operators/sns_publish_operator.py | 1 -
airflow/contrib/operators/spark_jdbc_operator.py | 1 -
airflow/contrib/operators/spark_sql_operator.py | 1 -
airflow/contrib/operators/spark_submit_operator.py | 1 -
airflow/contrib/operators/sqoop_operator.py | 1 -
airflow/contrib/operators/ssh_operator.py | 1 -
airflow/contrib/operators/vertica_operator.py | 1 -
airflow/contrib/operators/vertica_to_mysql.py | 1 -
.../contrib/operators/wasb_delete_blob_operator.py | 1 -
airflow/contrib/operators/winrm_operator.py | 1 -
airflow/contrib/secrets/aws_secrets_manager.py | 1 -
airflow/contrib/secrets/aws_systems_manager.py | 1 -
airflow/contrib/secrets/azure_key_vault.py | 1 -
airflow/contrib/secrets/gcp_secrets_manager.py | 1 -
airflow/contrib/secrets/hashicorp_vault.py | 1 -
airflow/contrib/sensors/aws_athena_sensor.py | 1 -
.../sensors/aws_glue_catalog_partition_sensor.py | 1 -
.../contrib/sensors/aws_redshift_cluster_sensor.py | 1 -
airflow/contrib/sensors/aws_sqs_sensor.py | 1 -
airflow/contrib/sensors/azure_cosmos_sensor.py | 1 -
airflow/contrib/sensors/bash_sensor.py | 1 -
airflow/contrib/sensors/cassandra_record_sensor.py | 1 -
airflow/contrib/sensors/cassandra_table_sensor.py | 1 -
airflow/contrib/sensors/celery_queue_sensor.py | 1 -
airflow/contrib/sensors/datadog_sensor.py | 1 -
airflow/contrib/sensors/emr_base_sensor.py | 1 -
airflow/contrib/sensors/emr_job_flow_sensor.py | 1 -
airflow/contrib/sensors/emr_step_sensor.py | 1 -
airflow/contrib/sensors/file_sensor.py | 1 -
airflow/contrib/sensors/ftp_sensor.py | 1 -
airflow/contrib/sensors/hdfs_sensor.py | 3 -
airflow/contrib/sensors/imap_attachment_sensor.py | 1 -
airflow/contrib/sensors/jira_sensor.py | 1 -
airflow/contrib/sensors/mongo_sensor.py | 1 -
airflow/contrib/sensors/pubsub_sensor.py | 1 -
airflow/contrib/sensors/python_sensor.py | 1 -
airflow/contrib/sensors/qubole_sensor.py | 1 -
airflow/contrib/sensors/redis_key_sensor.py | 1 -
airflow/contrib/sensors/redis_pub_sub_sensor.py | 1 -
airflow/contrib/sensors/sagemaker_base_sensor.py | 1 -
.../contrib/sensors/sagemaker_endpoint_sensor.py | 1 -
.../contrib/sensors/sagemaker_training_sensor.py | 1 -
.../contrib/sensors/sagemaker_transform_sensor.py | 1 -
airflow/contrib/sensors/sagemaker_tuning_sensor.py | 1 -
airflow/contrib/sensors/sftp_sensor.py | 1 -
airflow/contrib/sensors/wasb_sensor.py | 1 -
airflow/contrib/sensors/weekday_sensor.py | 1 -
airflow/contrib/task_runner/cgroup_task_runner.py | 1 -
airflow/contrib/utils/gcp_field_sanitizer.py | 1 -
airflow/contrib/utils/gcp_field_validator.py | 1 -
.../log/task_handler_with_custom_formatter.py | 1 -
airflow/contrib/utils/mlengine_operator_utils.py | 1 -
.../contrib/utils/mlengine_prediction_summary.py | 1 -
airflow/contrib/utils/weekday.py | 1 -
.../hooks => airflow/dag_processing}/__init__.py | 0
airflow/dag_processing/manager.py | 1149 ++++++
airflow/dag_processing/processor.py | 668 +++
airflow/decorators/__init__.py | 141 +-
airflow/decorators/base.py | 27 +-
airflow/decorators/python.py | 42 +-
airflow/decorators/python_virtualenv.py | 47 +-
airflow/decorators/task_group.py | 9 +-
.../provider-2.0.0.yaml.schema.json | 199 -
airflow/example_dags/example_bash_operator.py | 12 +-
.../example_branch_datetime_operator.py | 13 +-
.../example_branch_day_of_week_operator.py | 11 +-
airflow/example_dags/example_branch_labels.py | 11 +-
airflow/example_dags/example_branch_operator.py | 16 +-
.../example_branch_python_dop_operator_3.py | 13 +-
airflow/example_dags/example_complex.py | 9 +-
airflow/example_dags/example_dag_decorator.py | 14 +-
.../example_dags/example_kubernetes_executor.py | 102 +-
.../example_kubernetes_executor_config.py | 213 +-
airflow/example_dags/example_latest_only.py | 5 +-
.../example_latest_only_with_trigger.py | 5 +-
airflow/example_dags/example_nested_branch_dag.py | 15 +-
.../example_passing_params_via_test_command.py | 33 +-
airflow/example_dags/example_python_operator.py | 54 +-
.../example_dags/example_short_circuit_operator.py | 12 +-
airflow/example_dags/example_skip_dag.py | 24 +-
airflow/example_dags/example_task_group.py | 6 +-
.../example_dags/example_task_group_decorator.py | 7 +-
.../example_time_delta_sensor_async.py | 39 +
.../example_dags/example_trigger_controller_dag.py | 8 +-
airflow/example_dags/example_trigger_target_dag.py | 22 +-
airflow/example_dags/example_xcom.py | 82 +-
airflow/example_dags/example_xcomargs.py | 27 +-
airflow/example_dags/libs/helper.py | 3 +-
.../example_dags/plugins}/__init__.py | 0
airflow/example_dags/plugins/workday.py | 90 +
airflow/example_dags/subdags/subdag.py | 6 +-
airflow/example_dags/test_utils.py | 1 -
airflow/example_dags/tutorial.py | 15 +-
airflow/example_dags/tutorial_etl_dag.py | 6 +-
airflow/example_dags/tutorial_taskflow_api_etl.py | 13 +-
.../tutorial_taskflow_api_etl_virtualenv.py | 44 +-
airflow/exceptions.py | 54 +-
airflow/executors/base_executor.py | 2 +-
airflow/executors/celery_executor.py | 92 +-
airflow/executors/celery_kubernetes_executor.py | 18 +-
airflow/executors/dask_executor.py | 17 +-
airflow/executors/debug_executor.py | 14 +-
airflow/executors/kubernetes_executor.py | 125 +-
airflow/executors/local_executor.py | 28 +-
airflow/hooks/S3_hook.py | 3 +-
airflow/hooks/base.py | 5 +-
airflow/hooks/base_hook.py | 1 -
airflow/hooks/dbapi.py | 94 +-
airflow/hooks/dbapi_hook.py | 1 -
airflow/hooks/docker_hook.py | 1 -
airflow/hooks/druid_hook.py | 1 -
airflow/hooks/filesystem.py | 4 +-
airflow/hooks/hdfs_hook.py | 1 -
airflow/hooks/hive_hooks.py | 1 -
airflow/hooks/http_hook.py | 1 -
airflow/hooks/jdbc_hook.py | 1 -
airflow/hooks/mssql_hook.py | 1 -
airflow/hooks/mysql_hook.py | 1 -
airflow/hooks/oracle_hook.py | 1 -
airflow/hooks/pig_hook.py | 1 -
airflow/hooks/postgres_hook.py | 1 -
airflow/hooks/presto_hook.py | 1 -
airflow/hooks/samba_hook.py | 1 -
airflow/hooks/slack_hook.py | 1 -
airflow/hooks/sqlite_hook.py | 1 -
airflow/hooks/subprocess.py | 26 +-
airflow/hooks/webhdfs_hook.py | 1 -
airflow/hooks/zendesk_hook.py | 1 -
airflow/jobs/__init__.py | 9 +-
airflow/jobs/backfill_job.py | 159 +-
airflow/jobs/base_job.py | 18 +-
airflow/jobs/local_task_job.py | 135 +-
airflow/jobs/scheduler_job.py | 1254 ++----
airflow/jobs/triggerer_job.py | 416 ++
airflow/kubernetes/kube_client.py | 7 +-
airflow/kubernetes/kube_config.py | 7 +-
airflow/kubernetes/kubernetes_helper_functions.py | 29 +-
airflow/kubernetes/pod.py | 7 +-
airflow/kubernetes/pod_generator.py | 56 +-
airflow/kubernetes/pod_generator_deprecated.py | 2 +-
airflow/kubernetes/pod_launcher.py | 4 +-
airflow/kubernetes/pod_runtime_info_env.py | 2 +-
.../git_sync_template.yaml | 28 +-
airflow/kubernetes/refresh_config.py | 8 +-
airflow/kubernetes/volume.py | 2 +-
airflow/kubernetes/volume_mount.py | 2 +-
airflow/lineage/__init__.py | 4 +-
airflow/lineage/backend.py | 2 +-
airflow/lineage/entities.py | 5 +-
airflow/logging_config.py | 49 +-
airflow/macros/__init__.py | 1 -
airflow/migrations/env.py | 9 -
...6b6f902_increase_length_of_fab_ab_view_menu_.py | 7 +-
.../versions/03bc53e68815_add_sm_dag_index.py | 4 +-
.../versions/05f30312d566_merge_heads.py | 4 +-
...5d12_add_max_active_runs_column_to_dagmodel_.py | 59 +
.../0a2a5b66e19d_add_task_reschedule_table.py | 12 +-
.../0e2a74e0fc9f_add_time_zone_awareness.py | 4 +-
...dfa7_add_dag_id_state_index_on_dag_run_table.py | 4 +-
.../versions/13eb55f81627_for_compatibility.py | 4 +-
...ta_interval_start_end_to_dagmodel_and_dagrun.py | 77 +
.../versions/1507a7289a2f_create_is_encrypted.py | 4 +-
...cfc09e3_add_is_encrypted_column_to_variable_.py | 4 +-
.../migrations/versions/1b38cef5b76e_add_dagrun.py | 10 +-
.../versions/211e584da130_add_ti_state_index.py | 4 +-
...30d7c24_add_executor_config_to_task_instance.py | 4 +-
.../2c6edca13270_resource_based_permissions.py | 30 +-
.../versions/2e541a1dcfed_task_duration.py | 4 +-
.../versions/2e82aab8ef20_rename_user_table.py | 4 +-
...d44a_rename_concurrency_column_in_dag_table_.py | 56 +
...338e90f54d61_more_logging_into_task_isntance.py | 4 +-
...7a1ff4_add_kubernetes_resource_checkpointing.py | 4 +-
.../versions/40e67319e3a9_dagrun_config.py | 4 +-
.../versions/41f5f12752f8_add_superuser_field.py | 4 +-
.../versions/4446e08588_dagrun_start_end.py | 4 +-
...236f1_add_fractional_seconds_to_mysql_tables.py | 8 +-
.../versions/502898887f84_adding_extra_to_log.py | 4 +-
...0_fix_mssql_exec_date_rendered_task_instance.py | 8 +-
.../versions/52d714495f0_job_id_indices.py | 4 +-
...54bebd308c5f_add_trigger_table_and_task_info.py | 69 +
.../561833c1c74b_add_password_column_to_user.py | 4 +-
...73d9401f_add_description_field_to_connection.py | 2 +-
...7aae_fix_description_field_in_connection_to_.py | 8 +-
.../64de9cddf6c9_add_task_fails_journal_table.py | 6 +-
...867_change_datetime_to_datetime2_6_on_mssql_.py | 6 +-
.../versions/7939bcff74ba_add_dagtags_table.py | 4 +-
.../7b2661a43ba3_taskinstance_keyed_to_dagrun.py | 440 ++
...8c147f_remove_can_read_permission_on_config_.py | 16 +-
.../83f031fd9f1c_improve_mssql_compatibility.py | 255 ++
.../849da589634d_prefix_dag_permissions.py | 94 +-
...15af_add_rendered_task_instance_fields_table.py | 12 +-
.../856955da8476_fix_sqlite_foreign_key.py | 2 +-
.../8646922c8a04_change_default_pool_slots_to_1.py | 7 +-
...0d1215c0_add_kubernetes_scheduler_uniqueness.py | 4 +-
...d48763f6d53_add_unique_constraint_to_conn_id.py | 4 +-
...1e647c8_task_reschedule_fk_on_cascade_delete.py | 4 +-
.../versions/947454bf1dff_add_ti_job_id_index.py | 4 +-
.../versions/952da73b5eff_add_dag_code_table.py | 4 +-
.../versions/9635ae0956e7_index_faskfail.py | 41 -
.../versions/9635ae0956e7_index_taskfail.py | 41 +
...93827b8_add_queued_at_column_to_dagrun_table.py | 49 +
...606e2_add_scheduling_decision_to_dagrun_and_.py | 39 +-
...ad25_resource_based_permissions_for_default_.py | 48 +-
...67d16b_add_pool_slots_field_to_task_instance.py | 4 +-
.../versions/b0125267960b_merge_heads.py | 4 +-
.../b25a55525161_increase_length_of_pool_name.py | 4 +-
...cfc896_add_a_column_to_track_the_encryption_.py | 4 +-
...13e_add_notification_sent_column_to_sla_miss.py | 4 +-
.../bbf4a7ad0465_remove_id_column_from_xcom.py | 65 +-
...3e6c56_make_xcom_value_column_a_large_binary.py | 4 +-
.../bf00311e1990_add_index_to_taskinstance.py | 4 +-
.../versions/c8ffec048a3b_add_fields_to_dag.py | 4 +-
...623dc7_add_max_tries_column_to_task_instance.py | 13 +-
...26fe78_add_index_on_state_dag_id_for_queued_.py | 52 +
.../versions/cf5dc11e79ad_drop_user_and_chart.py | 4 +-
.../d2ae31099d61_increase_text_size_for_mysql.py | 8 +-
.../d38e04c12aa2_add_serialized_dag_table.py | 16 +-
.../versions/dd25f486b8ea_add_idx_log_dag.py | 4 +-
.../dd4ecb8fbee3_add_schedule_interval_to_dag.py | 4 +-
.../e38be357a868_update_schema_for_smart_sensor.py | 16 +-
.../versions/e3a246e0dc1_current_schema.py | 16 +-
...4a3141f0_make_xcom_pkey_columns_non_nullable.py | 76 +
...ac86c_change_field_in_dagcode_to_mediumtext_.py | 8 +-
.../f23433877c24_fix_mysql_not_null_constraint.py | 4 +-
.../versions/f2ca10b85618_add_dag_stats_table.py | 8 +-
airflow/models/__init__.py | 4 +-
airflow/models/base.py | 13 +
airflow/models/baseoperator.py | 500 ++-
airflow/models/connection.py | 99 +-
airflow/models/crypto.py | 4 +-
airflow/models/dag.py | 1596 +++++---
airflow/models/dagbag.py | 115 +-
airflow/models/dagcode.py | 21 +-
airflow/models/dagparam.py | 47 +-
airflow/models/dagpickle.py | 2 +-
airflow/models/dagrun.py | 248 +-
airflow/models/errors.py | 2 +-
airflow/models/param.py | 226 +
airflow/models/pool.py | 8 +-
airflow/models/renderedtifields.py | 34 +-
airflow/models/serialized_dag.py | 56 +-
airflow/models/skipmixin.py | 87 +-
airflow/models/taskinstance.py | 1150 ++++--
airflow/models/taskreschedule.py | 45 +-
airflow/models/trigger.py | 193 +
airflow/models/variable.py | 110 +-
airflow/models/xcom.py | 151 +-
airflow/models/xcom_arg.py | 2 +-
airflow/mypy/plugin/decorators.py | 8 +-
airflow/operators/bash.py | 41 +-
airflow/operators/bash_operator.py | 1 -
airflow/operators/branch_operator.py | 1 -
airflow/operators/dagrun_operator.py | 1 -
airflow/operators/docker_operator.py | 1 -
airflow/operators/druid_check_operator.py | 1 -
airflow/operators/dummy_operator.py | 1 -
airflow/operators/email.py | 6 +-
airflow/operators/email_operator.py | 1 -
airflow/operators/gcs_to_s3.py | 1 -
airflow/operators/generic_transfer.py | 6 +-
airflow/operators/google_api_to_s3_transfer.py | 8 +-
airflow/operators/hive_operator.py | 1 -
airflow/operators/hive_stats_operator.py | 1 -
airflow/operators/hive_to_druid.py | 1 -
airflow/operators/hive_to_mysql.py | 1 -
airflow/operators/hive_to_samba_operator.py | 1 -
airflow/operators/http_operator.py | 1 -
airflow/operators/jdbc_operator.py | 1 -
airflow/operators/latest_only.py | 18 +-
airflow/operators/latest_only_operator.py | 1 -
airflow/operators/mssql_operator.py | 1 -
airflow/operators/mysql_operator.py | 1 -
airflow/operators/oracle_operator.py | 1 -
airflow/operators/papermill_operator.py | 1 -
airflow/operators/pig_operator.py | 1 -
airflow/operators/postgres_operator.py | 1 -
airflow/operators/presto_check_operator.py | 3 +-
airflow/operators/presto_to_mysql.py | 1 -
airflow/operators/python.py | 59 +-
airflow/operators/python_operator.py | 1 -
airflow/operators/s3_file_transform_operator.py | 1 -
airflow/operators/s3_to_redshift_operator.py | 2 +-
airflow/operators/slack_operator.py | 1 -
airflow/operators/sql.py | 24 +-
airflow/operators/sqlite_operator.py | 1 -
airflow/operators/subdag.py | 32 +-
airflow/operators/subdag_operator.py | 1 -
airflow/operators/trigger_dagrun.py | 32 +-
airflow/operators/weekday.py | 19 +-
airflow/plugins_manager.py | 87 +-
airflow/provider.yaml.schema.json | 74 +-
airflow/provider_info.schema.json | 57 +-
.../providers/airbyte/.latest-doc-only-change.txt | 1 +
airflow/providers/airbyte/CHANGELOG.rst | 59 +
.../example_dags/example_airbyte_trigger_job.py | 19 +-
airflow/providers/airbyte/hooks/airbyte.py | 29 +-
airflow/providers/airbyte/provider.yaml | 12 +-
.../providers/alibaba/.latest-doc-only-change.txt | 1 +
airflow/providers/{trino => alibaba}/CHANGELOG.rst | 0
.../providers/alibaba}/__init__.py | 0
.../providers/alibaba/cloud}/__init__.py | 0
.../alibaba/cloud/example_dags}/__init__.py | 0
.../cloud/example_dags/example_oss_bucket.py | 37 +
.../cloud/example_dags/example_oss_object.py | 59 +
.../providers/alibaba/cloud/hooks}/__init__.py | 0
airflow/providers/alibaba/cloud/hooks/oss.py | 307 ++
.../providers/alibaba/cloud/operators}/__init__.py | 0
airflow/providers/alibaba/cloud/operators/oss.py | 221 +
.../providers/alibaba/cloud/sensors}/__init__.py | 0
airflow/providers/alibaba/cloud/sensors/oss_key.py | 93 +
airflow/providers/alibaba/provider.yaml | 58 +
airflow/providers/amazon/CHANGELOG.rst | 194 +-
.../amazon/aws/example_dags/example_athena.py | 150 +
.../aws/example_dags/example_dms_full_load_task.py | 103 +
.../amazon/aws/example_dags/example_ecs_fargate.py | 16 +-
.../aws/example_dags/example_eks_templated.py | 124 +
.../example_eks_with_fargate_in_one_step.py | 98 +
.../example_eks_with_fargate_profile.py | 122 +
.../example_eks_with_nodegroup_in_one_step.py | 92 +
.../example_dags/example_eks_with_nodegroups.py | 126 +
.../amazon/aws/example_dags/example_emr_eks_job.py | 81 +
.../example_emr_job_flow_automatic_steps.py | 26 +-
.../example_emr_job_flow_manual_steps.py | 32 +-
.../example_google_api_to_s3_transfer_advanced.py | 19 +-
.../amazon/aws/example_dags/example_local_to_s3.py | 42 +
.../amazon/aws/example_dags/example_redshift.py | 68 +
.../amazon/aws/example_dags/example_s3_bucket.py | 11 +-
.../aws/example_dags/example_s3_to_redshift.py | 39 +-
.../amazon/aws/example_dags/example_s3_to_sftp.py | 43 +
.../aws/example_dags/example_salesforce_to_s3.py | 71 +
.../amazon/aws/example_dags/example_sftp_to_s3.py | 42 +
.../amazon/aws/example_dags/example_sqs.py | 85 +
airflow/providers/amazon/aws/hooks/athena.py | 8 +-
airflow/providers/amazon/aws/hooks/aws_dynamodb.py | 1 -
airflow/providers/amazon/aws/hooks/base_aws.py | 223 +-
airflow/providers/amazon/aws/hooks/batch_client.py | 20 +-
.../providers/amazon/aws/hooks/batch_waiters.py | 20 +-
airflow/providers/amazon/aws/hooks/datasync.py | 6 +-
airflow/providers/amazon/aws/hooks/dms.py | 214 +
airflow/providers/amazon/aws/hooks/eks.py | 646 +++
.../providers/amazon/aws/hooks/emr_containers.py | 205 +
airflow/providers/amazon/aws/hooks/glue.py | 15 +-
airflow/providers/amazon/aws/hooks/glue_crawler.py | 7 +-
airflow/providers/amazon/aws/hooks/redshift.py | 124 +-
airflow/providers/amazon/aws/hooks/s3.py | 40 +-
airflow/providers/amazon/aws/hooks/sagemaker.py | 10 +-
airflow/providers/amazon/aws/hooks/ses.py | 4 +-
.../amazon/aws/log/cloudwatch_task_handler.py | 24 +-
.../providers/amazon/aws/log/s3_task_handler.py | 10 +-
airflow/providers/amazon/aws/operators/athena.py | 19 +-
airflow/providers/amazon/aws/operators/batch.py | 29 +-
airflow/providers/amazon/aws/operators/datasync.py | 41 +-
.../amazon/aws/operators/dms_create_task.py | 112 +
.../amazon/aws/operators/dms_delete_task.py | 66 +
.../amazon/aws/operators/dms_describe_tasks.py | 62 +
.../amazon/aws/operators/dms_start_task.py | 84 +
.../amazon/aws/operators/dms_stop_task.py | 62 +
airflow/providers/amazon/aws/operators/ecs.py | 261 +-
airflow/providers/amazon/aws/operators/eks.py | 693 ++++
.../amazon/aws/operators/emr_add_steps.py | 1 +
.../amazon/aws/operators/emr_containers.py | 145 +
.../amazon/aws/operators/emr_create_job_flow.py | 26 +-
airflow/providers/amazon/aws/operators/glue.py | 43 +-
airflow/providers/amazon/aws/operators/redshift.py | 73 +
.../amazon/aws/operators/s3_bucket_tagging.py | 1 +
.../amazon/aws/operators/s3_file_transform.py | 2 +-
airflow/providers/amazon/aws/operators/s3_list.py | 2 +-
.../amazon/aws/operators/s3_list_prefixes.py | 97 +
.../amazon/aws/operators/sagemaker_base.py | 6 +-
.../amazon/aws/operators/sagemaker_training.py | 34 +-
airflow/providers/amazon/aws/operators/sns.py | 2 +-
airflow/providers/amazon/aws/operators/sqs.py | 7 +-
.../amazon/aws/secrets/secrets_manager.py | 139 +-
airflow/providers/amazon/aws/sensors/dms_task.py | 117 +
airflow/providers/amazon/aws/sensors/eks.py | 243 ++
.../providers/amazon/aws/sensors/emr_containers.py | 93 +
airflow/providers/amazon/aws/sensors/s3_key.py | 6 +-
.../amazon/aws/sensors/s3_keys_unchanged.py | 4 +-
airflow/providers/amazon/aws/sensors/s3_prefix.py | 26 +-
.../providers/amazon/aws/sensors/sagemaker_base.py | 2 +-
airflow/providers/amazon/aws/sensors/sqs.py | 135 +-
.../amazon/aws/transfers/dynamodb_to_s3.py | 24 +-
.../providers/amazon/aws/transfers/exasol_to_s3.py | 2 +-
.../providers/amazon/aws/transfers/ftp_to_s3.py | 113 +-
.../providers/amazon/aws/transfers/gcs_to_s3.py | 2 +-
.../amazon/aws/transfers/hive_to_dynamodb.py | 2 +-
.../providers/amazon/aws/transfers/local_to_s3.py | 112 +
.../providers/amazon/aws/transfers/mongo_to_s3.py | 17 +-
.../providers/amazon/aws/transfers/mysql_to_s3.py | 75 +-
.../amazon/aws/transfers/redshift_to_s3.py | 40 +-
.../providers/amazon/aws/transfers/s3_to_ftp.py | 19 +-
.../amazon/aws/transfers/s3_to_redshift.py | 86 +-
.../providers/amazon/aws/transfers/s3_to_sftp.py | 4 +
.../amazon/aws/transfers/salesforce_to_s3.py | 143 +
.../providers/amazon/aws/transfers/sftp_to_s3.py | 19 +-
.../providers/amazon/aws/utils/eks_get_token.py | 69 +
airflow/providers/amazon/aws/utils/emailer.py | 3 +-
airflow/providers/amazon/provider.yaml | 100 +-
.../apache/beam/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/beam/CHANGELOG.rst | 62 +-
airflow/providers/apache/beam/README.md | 10 +-
airflow/providers/apache/beam/hooks/beam.py | 4 +-
airflow/providers/apache/beam/operators/beam.py | 60 +-
airflow/providers/apache/beam/provider.yaml | 6 +
.../apache/cassandra/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/cassandra/CHANGELOG.rst | 52 +
.../example_dags/example_cassandra_dag.py | 5 -
.../providers/apache/cassandra/hooks/cassandra.py | 2 +-
airflow/providers/apache/cassandra/provider.yaml | 12 +-
.../providers/apache/cassandra/sensors/record.py | 9 +-
.../providers/apache/cassandra/sensors/table.py | 4 +-
airflow/providers/apache/drill/CHANGELOG.rst | 40 +
.../providers/apache/drill}/__init__.py | 0
.../apache/drill/example_dags}/__init__.py | 0
.../apache/drill/example_dags/example_drill_dag.py | 40 +
.../providers/apache/drill/hooks}/__init__.py | 0
airflow/providers/apache/drill/hooks/drill.py | 89 +
.../providers/apache/drill/operators}/__init__.py | 0
airflow/providers/apache/drill/operators/drill.py | 69 +
airflow/providers/apache/drill/provider.yaml | 54 +
.../apache/druid/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/druid/CHANGELOG.rst | 52 +
.../apache/druid/example_dags}/__init__.py | 0
.../apache/druid/example_dags/example_druid_dag.py | 52 +
airflow/providers/apache/druid/hooks/druid.py | 2 +-
airflow/providers/apache/druid/operators/druid.py | 2 +
airflow/providers/apache/druid/provider.yaml | 16 +-
.../apache/druid/transfers/hive_to_druid.py | 4 +-
.../apache/hdfs/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/hdfs/CHANGELOG.rst | 57 +
airflow/providers/apache/hdfs/hooks/hdfs.py | 2 +-
airflow/providers/apache/hdfs/hooks/webhdfs.py | 47 +-
airflow/providers/apache/hdfs/provider.yaml | 12 +-
airflow/providers/apache/hdfs/sensors/hdfs.py | 2 +-
.../apache/hive/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/hive/CHANGELOG.rst | 73 +
.../hive/example_dags/example_twitter_README.md | 2 +-
.../hive/example_dags/example_twitter_dag.py | 152 +-
airflow/providers/apache/hive/hooks/hive.py | 57 +-
airflow/providers/apache/hive/operators/hive.py | 1 -
.../providers/apache/hive/operators/hive_stats.py | 2 +-
airflow/providers/apache/hive/provider.yaml | 20 +-
.../apache/hive/transfers/mssql_to_hive.py | 3 +-
.../apache/hive/transfers/mysql_to_hive.py | 2 +-
.../providers/apache/hive/transfers/s3_to_hive.py | 8 +-
.../apache/kylin/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/kylin/CHANGELOG.rst | 39 +
.../apache/kylin/example_dags/example_kylin_dag.py | 70 +-
airflow/providers/apache/kylin/hooks/kylin.py | 2 +
.../providers/apache/kylin/operators/kylin_cube.py | 5 +-
airflow/providers/apache/kylin/provider.yaml | 5 +
.../apache/livy/.latest-doc-only-change.txt | 1 +
airflow/providers/apache/livy/CHANGELOG.rst | 40 +
airflow/providers/apache/livy/hooks/livy.py | 87 +-
airflow/providers/apache/livy/operators/livy.py | 15 +-
airflow/providers/apache/livy/provider.yaml | 11 +-
.../apache/pig/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/pig/CHANGELOG.rst | 38 +
.../apache/pig/example_dags/example_pig.py | 5 -
airflow/providers/apache/pig/provider.yaml | 11 +-
.../apache/pinot/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/pinot/CHANGELOG.rst | 37 +
airflow/providers/apache/pinot/hooks/pinot.py | 4 +-
airflow/providers/apache/pinot/provider.yaml | 5 +
.../apache/spark/.latest-doc-only-change.txt | 1 +
airflow/providers/apache/spark/CHANGELOG.rst | 41 +
.../apache/spark/example_dags/example_spark_dag.py | 5 -
airflow/providers/apache/spark/hooks/spark_jdbc.py | 2 -
.../apache/spark/hooks/spark_jdbc_script.py | 2 -
airflow/providers/apache/spark/hooks/spark_sql.py | 44 +-
.../providers/apache/spark/hooks/spark_submit.py | 33 +-
.../providers/apache/spark/operators/spark_jdbc.py | 2 -
.../providers/apache/spark/operators/spark_sql.py | 9 +-
.../apache/spark/operators/spark_submit.py | 2 -
airflow/providers/apache/spark/provider.yaml | 15 +-
airflow/providers/apache/sqoop/CHANGELOG.rst | 52 +
airflow/providers/apache/sqoop/hooks/sqoop.py | 20 +-
airflow/providers/apache/sqoop/operators/sqoop.py | 8 +-
airflow/providers/apache/sqoop/provider.yaml | 12 +-
.../providers/asana/.latest-doc-only-change.txt | 1 +
airflow/providers/asana/CHANGELOG.rst | 47 +
airflow/providers/{neo4j => asana}/README.md | 0
.../providers/asana}/__init__.py | 0
.../providers/asana/example_dags}/__init__.py | 0
.../providers/asana/example_dags/example_asana.py | 91 +
.../providers/asana/hooks}/__init__.py | 0
airflow/providers/asana/hooks/asana.py | 286 ++
.../providers/asana/operators}/__init__.py | 0
airflow/providers/asana/operators/asana_tasks.py | 170 +
airflow/providers/asana/provider.yaml | 53 +
airflow/providers/celery/CHANGELOG.rst | 34 +
airflow/providers/celery/provider.yaml | 6 +
airflow/providers/cloudant/CHANGELOG.rst | 36 +
airflow/providers/cloudant/provider.yaml | 11 +-
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 103 +
.../backcompat/backwards_compat_converters.py | 8 +-
.../providers/cncf/kubernetes/backcompat/volume.py | 2 +-
.../kubernetes/example_dags/example_kubernetes.py | 12 +-
.../example_dags/example_spark_kubernetes.py | 22 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 66 +-
.../cncf/kubernetes/operators/spark_kubernetes.py | 5 +-
airflow/providers/cncf/kubernetes/provider.yaml | 14 +-
.../cncf/kubernetes/utils/pod_launcher.py | 89 +-
.../databricks/.latest-doc-only-change.txt | 2 +-
airflow/providers/databricks/CHANGELOG.rst | 50 +
.../databricks/example_dags/example_databricks.py | 13 +-
airflow/providers/databricks/hooks/databricks.py | 8 +-
.../providers/databricks/operators/databricks.py | 2 -
airflow/providers/databricks/provider.yaml | 12 +-
.../providers/datadog/.latest-doc-only-change.txt | 2 +-
airflow/providers/datadog/CHANGELOG.rst | 38 +
airflow/providers/datadog/hooks/datadog.py | 1 -
airflow/providers/datadog/provider.yaml | 5 +
airflow/providers/dependencies.json | 3 +-
.../providers/dingding/.latest-doc-only-change.txt | 2 +-
airflow/providers/dingding/CHANGELOG.rst | 44 +
.../dingding/example_dags/example_dingding.py | 25 +-
airflow/providers/dingding/hooks/dingding.py | 8 +-
airflow/providers/dingding/provider.yaml | 12 +
airflow/providers/discord/CHANGELOG.rst | 41 +
airflow/providers/discord/hooks/discord_webhook.py | 5 +
airflow/providers/discord/provider.yaml | 12 +
airflow/providers/docker/CHANGELOG.rst | 118 +
.../providers/docker/decorators}/__init__.py | 0
airflow/providers/docker/decorators/docker.py | 289 ++
.../docker/example_dags/example_docker.py | 18 +-
.../example_dags/example_docker_copy_data.py | 57 +-
.../docker/example_dags/example_docker_swarm.py | 14 +-
.../tutorial_taskflow_api_etl_docker_virtualenv.py | 111 +
airflow/providers/docker/operators/docker.py | 211 +-
airflow/providers/docker/operators/docker_swarm.py | 49 +-
airflow/providers/docker/provider.yaml | 18 +-
.../elasticsearch/.latest-doc-only-change.txt | 1 +
airflow/providers/elasticsearch/CHANGELOG.rst | 87 +
.../elasticsearch/example_dags}/__init__.py | 0
.../example_dags/example_elasticsearch_query.py | 50 +
.../providers/elasticsearch/hooks/elasticsearch.py | 3 +-
.../providers/elasticsearch/log/es_task_handler.py | 98 +-
airflow/providers/elasticsearch/provider.yaml | 18 +-
airflow/providers/exasol/CHANGELOG.rst | 40 +
airflow/providers/exasol/hooks/exasol.py | 8 +-
airflow/providers/exasol/provider.yaml | 11 +-
airflow/providers/facebook/CHANGELOG.rst | 43 +
airflow/providers/facebook/ads/hooks/ads.py | 9 +-
airflow/providers/facebook/provider.yaml | 13 +-
airflow/providers/ftp/.latest-doc-only-change.txt | 1 +
airflow/providers/ftp/CHANGELOG.rst | 36 +
airflow/providers/ftp/hooks/ftp.py | 19 +-
airflow/providers/ftp/provider.yaml | 8 +-
airflow/providers/google/CHANGELOG.rst | 262 +-
airflow/providers/google/ads/hooks/ads.py | 135 +-
airflow/providers/google/ads/operators/ads.py | 10 +-
.../providers/google/ads/transfers/ads_to_gcs.py | 10 +-
.../_internal_client/secret_manager_client.py | 11 +-
.../example_automl_nl_text_classification.py | 12 +-
.../example_automl_nl_text_extraction.py | 13 +-
.../example_automl_nl_text_sentiment.py | 13 +-
.../cloud/example_dags/example_automl_tables.py | 53 +-
.../example_dags/example_automl_translation.py | 13 +-
...ple_automl_video_intelligence_classification.py | 13 +-
.../example_automl_video_intelligence_tracking.py | 13 +-
.../example_automl_vision_classification.py | 13 +-
.../example_automl_vision_object_detection.py | 13 +-
.../example_dags/example_azure_fileshare_to_gcs.py | 23 +-
.../cloud/example_dags/example_bigquery_dts.py | 22 +-
.../example_dags/example_bigquery_operations.py | 47 +-
.../cloud/example_dags/example_bigquery_queries.py | 91 +-
.../cloud/example_dags/example_bigquery_sensors.py | 14 +-
.../example_dags/example_bigquery_to_bigquery.py | 2 +-
.../example_dags/example_bigquery_to_mssql.py | 69 +
.../google/cloud/example_dags/example_bigtable.py | 6 +-
.../cloud/example_dags/example_cloud_build.py | 172 +-
.../example_dags/example_cloud_memorystore.py | 14 +-
.../google/cloud/example_dags/example_cloud_sql.py | 69 +-
.../cloud/example_dags/example_cloud_sql_query.py | 4 +-
.../example_cloud_storage_transfer_service_aws.py | 4 -
.../example_cloud_storage_transfer_service_gcp.py | 2 +-
.../google/cloud/example_dags/example_compute.py | 2 +-
.../cloud/example_dags/example_compute_igm.py | 2 +-
.../cloud/example_dags/example_compute_ssh.py | 2 +-
.../cloud/example_dags/example_datacatalog.py | 54 +-
.../google/cloud/example_dags/example_dataflow.py | 75 +-
.../example_dags/example_dataflow_flex_template.py | 2 +-
.../cloud/example_dags/example_dataflow_sql.py | 2 +-
.../cloud/example_dags/example_datafusion.py | 56 +-
.../google/cloud/example_dags/example_dataprep.py | 2 +-
.../google/cloud/example_dags/example_dataproc.py | 32 +-
.../google/cloud/example_dags/example_datastore.py | 61 +-
.../google/cloud/example_dags/example_dlp.py | 8 +-
.../example_dags/example_facebook_ads_to_gcs.py | 18 +-
.../google/cloud/example_dags/example_functions.py | 18 +-
.../google/cloud/example_dags/example_gcs.py | 7 +-
.../example_gcs_timespan_file_transform.py | 2 +-
.../cloud/example_dags/example_gcs_to_bigquery.py | 2 +-
.../cloud/example_dags/example_gcs_to_gcs.py | 2 +-
.../cloud/example_dags/example_gcs_to_local.py | 2 +-
.../cloud/example_dags/example_gcs_to_sftp.py | 2 +-
.../cloud/example_dags/example_gdrive_to_gcs.py | 6 +-
.../example_dags/example_kubernetes_engine.py | 4 +-
.../cloud/example_dags/example_life_sciences.py | 2 +-
.../cloud/example_dags/example_local_to_gcs.py | 2 +-
.../google/cloud/example_dags/example_mlengine.py | 46 +-
.../cloud/example_dags/example_mysql_to_gcs.py | 2 +-
.../cloud/example_dags/example_natural_language.py | 10 +-
.../cloud/example_dags/example_postgres_to_gcs.py | 2 +-
.../cloud/example_dags/example_presto_to_gcs.py | 66 +-
.../google/cloud/example_dags/example_pubsub.py | 22 +-
.../google/cloud/example_dags/example_s3_to_gcs.py | 9 +-
.../example_dags/example_salesforce_to_gcs.py | 14 +-
.../cloud/example_dags/example_sftp_to_gcs.py | 2 +-
.../cloud/example_dags/example_sheets_to_gcs.py | 2 +-
.../google/cloud/example_dags/example_spanner.py | 2 +-
.../cloud/example_dags/example_speech_to_text.py | 2 +-
.../cloud/example_dags/example_stackdriver.py | 2 +-
.../google/cloud/example_dags/example_tasks.py | 7 +-
.../cloud/example_dags/example_text_to_speech.py | 2 +-
.../google/cloud/example_dags/example_translate.py | 2 +-
.../cloud/example_dags/example_translate_speech.py | 2 +-
.../cloud/example_dags/example_trino_to_gcs.py | 66 +-
.../example_dags/example_video_intelligence.py | 2 +-
.../google/cloud/example_dags/example_vision.py | 65 +-
.../google/cloud/example_dags/example_workflows.py | 17 +-
airflow/providers/google/cloud/hooks/automl.py | 2 +-
airflow/providers/google/cloud/hooks/bigquery.py | 78 +-
airflow/providers/google/cloud/hooks/bigtable.py | 1 -
.../providers/google/cloud/hooks/cloud_build.py | 623 ++-
.../google/cloud/hooks/cloud_memorystore.py | 18 +-
airflow/providers/google/cloud/hooks/cloud_sql.py | 87 +-
.../cloud/hooks/cloud_storage_transfer_service.py | 44 +-
airflow/providers/google/cloud/hooks/compute.py | 21 +-
.../providers/google/cloud/hooks/compute_ssh.py | 32 +-
.../providers/google/cloud/hooks/datacatalog.py | 6 +-
airflow/providers/google/cloud/hooks/dataflow.py | 101 +-
airflow/providers/google/cloud/hooks/datafusion.py | 38 +-
airflow/providers/google/cloud/hooks/dataprep.py | 2 +-
airflow/providers/google/cloud/hooks/dataproc.py | 252 +-
airflow/providers/google/cloud/hooks/datastore.py | 46 +-
airflow/providers/google/cloud/hooks/dlp.py | 6 +-
airflow/providers/google/cloud/hooks/functions.py | 14 +-
airflow/providers/google/cloud/hooks/gcs.py | 36 +-
airflow/providers/google/cloud/hooks/gdm.py | 14 +-
.../google/cloud/hooks/kubernetes_engine.py | 4 +-
.../providers/google/cloud/hooks/life_sciences.py | 9 +-
airflow/providers/google/cloud/hooks/mlengine.py | 31 +-
airflow/providers/google/cloud/hooks/pubsub.py | 23 +-
.../providers/google/cloud/hooks/secret_manager.py | 2 +-
airflow/providers/google/cloud/hooks/spanner.py | 6 +-
.../providers/google/cloud/hooks/text_to_speech.py | 6 +-
airflow/providers/google/cloud/hooks/vision.py | 17 +-
airflow/providers/google/cloud/hooks/workflows.py | 4 -
.../providers/google/cloud/log/gcs_task_handler.py | 11 +-
.../google/cloud/log/stackdriver_task_handler.py | 6 +-
airflow/providers/google/cloud/operators/automl.py | 6 +-
.../providers/google/cloud/operators/bigquery.py | 123 +-
.../providers/google/cloud/operators/bigtable.py | 10 +-
.../google/cloud/operators/cloud_build.py | 1030 ++++-
.../google/cloud/operators/cloud_memorystore.py | 2 +-
.../providers/google/cloud/operators/cloud_sql.py | 15 +-
.../operators/cloud_storage_transfer_service.py | 68 +-
.../providers/google/cloud/operators/compute.py | 4 +-
.../google/cloud/operators/datacatalog.py | 8 +-
.../providers/google/cloud/operators/dataflow.py | 219 +-
.../providers/google/cloud/operators/datafusion.py | 28 +-
.../providers/google/cloud/operators/dataproc.py | 154 +-
.../providers/google/cloud/operators/datastore.py | 2 +-
airflow/providers/google/cloud/operators/dlp.py | 2 +-
.../providers/google/cloud/operators/functions.py | 10 +-
airflow/providers/google/cloud/operators/gcs.py | 33 +-
.../google/cloud/operators/kubernetes_engine.py | 32 +-
.../providers/google/cloud/operators/mlengine.py | 20 +-
airflow/providers/google/cloud/operators/pubsub.py | 5 +-
.../providers/google/cloud/operators/spanner.py | 6 +-
.../google/cloud/operators/stackdriver.py | 2 -
airflow/providers/google/cloud/operators/tasks.py | 2 +-
.../providers/google/cloud/operators/workflows.py | 4 -
.../google/cloud/secrets/secret_manager.py | 28 +-
.../providers/google/cloud/sensors/datafusion.py | 135 +
airflow/providers/google/cloud/sensors/dataproc.py | 28 +-
airflow/providers/google/cloud/sensors/gcs.py | 41 +-
airflow/providers/google/cloud/sensors/pubsub.py | 2 +-
.../google/cloud/transfers/adls_to_gcs.py | 4 +-
.../cloud/transfers/azure_fileshare_to_gcs.py | 15 +-
.../google/cloud/transfers/bigquery_to_bigquery.py | 2 +-
.../google/cloud/transfers/bigquery_to_gcs.py | 2 +-
.../google/cloud/transfers/bigquery_to_mssql.py | 157 +
.../google/cloud/transfers/bigquery_to_mysql.py | 12 +-
.../google/cloud/transfers/cassandra_to_gcs.py | 32 +-
.../google/cloud/transfers/facebook_ads_to_gcs.py | 32 +-
.../google/cloud/transfers/gcs_to_bigquery.py | 15 +-
.../providers/google/cloud/transfers/gcs_to_gcs.py | 25 +-
.../google/cloud/transfers/gcs_to_local.py | 10 +-
.../google/cloud/transfers/gcs_to_sftp.py | 3 +-
.../google/cloud/transfers/gdrive_to_gcs.py | 12 +-
.../google/cloud/transfers/mysql_to_gcs.py | 17 +-
.../google/cloud/transfers/oracle_to_gcs.py | 2 +-
.../providers/google/cloud/transfers/s3_to_gcs.py | 23 +-
.../google/cloud/transfers/salesforce_to_gcs.py | 2 +-
.../google/cloud/transfers/sftp_to_gcs.py | 2 +-
.../providers/google/cloud/transfers/sql_to_gcs.py | 14 +-
.../google/cloud/utils/credentials_provider.py | 13 +-
.../google/cloud/utils/field_sanitizer.py | 2 +-
.../google/cloud/utils/field_validator.py | 55 +-
airflow/providers/google/cloud/utils/helpers.py | 24 +
.../google/cloud/utils/mlengine_operator_utils.py | 37 +-
.../cloud/utils/mlengine_prediction_summary.py | 30 +-
.../google/common/auth_backend/google_openid.py | 2 +-
.../providers/google/common/hooks/base_google.py | 24 +-
.../providers/google/config_templates}/__init__.py | 0
.../firebase/example_dags/example_firestore.py | 34 +-
.../providers/google/firebase/hooks/firestore.py | 8 +-
.../google/leveldb/example_dags/example_leveldb.py | 7 +-
.../example_dags/example_analytics.py | 2 +-
.../example_dags/example_campaign_manager.py | 2 +-
.../example_dags/example_display_video.py | 28 +-
.../example_dags/example_search_ads.py | 10 +-
.../google/marketing_platform/hooks/analytics.py | 14 +-
.../marketing_platform/hooks/campaign_manager.py | 24 +-
.../marketing_platform/hooks/display_video.py | 44 +-
.../google/marketing_platform/hooks/search_ads.py | 16 +-
.../operators/campaign_manager.py | 2 +-
.../marketing_platform/operators/display_video.py | 29 +-
airflow/providers/google/provider.yaml | 47 +-
.../suite/example_dags/example_gcs_to_sheets.py | 2 +-
.../google/suite/example_dags/example_sheets.py | 4 +-
.../suite/example_dags/example_sql_to_sheets.py | 40 +
airflow/providers/google/suite/hooks/drive.py | 12 +-
airflow/providers/google/suite/hooks/sheets.py | 25 +-
.../google/suite/transfers/gcs_to_gdrive.py | 2 +-
.../google/suite/transfers/sql_to_sheets.py | 138 +
airflow/providers/grpc/.latest-doc-only-change.txt | 1 +
airflow/providers/grpc/CHANGELOG.rst | 35 +
airflow/providers/grpc/hooks/grpc.py | 9 +-
airflow/providers/grpc/provider.yaml | 11 +-
.../hashicorp/.latest-doc-only-change.txt | 1 +
airflow/providers/hashicorp/CHANGELOG.rst | 65 +
.../hashicorp/_internal_client/vault_client.py | 29 +-
airflow/providers/hashicorp/hooks/vault.py | 30 +-
airflow/providers/hashicorp/provider.yaml | 15 +-
airflow/providers/hashicorp/secrets/vault.py | 56 +-
airflow/providers/http/.latest-doc-only-change.txt | 2 +-
airflow/providers/http/CHANGELOG.rst | 47 +
.../providers/http/example_dags/example_http.py | 21 +-
airflow/providers/http/hooks/http.py | 27 +-
airflow/providers/http/operators/http.py | 10 +-
airflow/providers/http/provider.yaml | 8 +-
airflow/providers/imap/CHANGELOG.rst | 37 +
airflow/providers/imap/provider.yaml | 8 +-
.../providers/influxdb/.latest-doc-only-change.txt | 1 +
airflow/providers/influxdb/CHANGELOG.rst | 26 +
.../providers/influxdb}/__init__.py | 0
.../providers/influxdb/example_dags}/__init__.py | 0
.../influxdb/example_dags/example_influxdb.py | 57 +
.../providers/influxdb}/hooks/__init__.py | 0
airflow/providers/influxdb/hooks/influxdb.py | 163 +
airflow/providers/influxdb/provider.yaml | 37 +
airflow/providers/jdbc/.latest-doc-only-change.txt | 2 +-
airflow/providers/jdbc/CHANGELOG.rst | 44 +
.../jdbc/example_dags/example_jdbc_queries.py | 18 +-
airflow/providers/jdbc/operators/jdbc.py | 4 +-
airflow/providers/jdbc/provider.yaml | 11 +-
.../providers/jenkins/.latest-doc-only-change.txt | 2 +-
airflow/providers/jenkins/CHANGELOG.rst | 66 +
.../example_dags/example_jenkins_job_trigger.py | 40 +-
airflow/providers/jenkins/hooks/jenkins.py | 9 +-
.../jenkins/operators/jenkins_job_trigger.py | 11 +-
airflow/providers/jenkins/provider.yaml | 13 +-
airflow/providers/jira/.latest-doc-only-change.txt | 1 +
airflow/providers/jira/CHANGELOG.rst | 35 +
airflow/providers/jira/provider.yaml | 11 +-
airflow/providers/jira/sensors/jira.py | 4 +-
airflow/providers/microsoft/azure/CHANGELOG.rst | 139 +
.../azure/example_dags/example_adf_run_pipeline.py | 69 +
.../azure/example_dags/example_adls_delete.py | 14 +-
.../example_dags/example_azure_blob_to_gcs.py | 23 +-
.../example_azure_container_instances.py | 15 +-
.../azure/example_dags/example_azure_cosmosdb.py | 20 +-
.../azure/example_dags/example_file_to_wasb.py | 32 -
.../azure/example_dags/example_fileshare.py | 14 +-
.../azure/example_dags/example_local_to_adls.py | 14 +-
.../azure/example_dags/example_local_to_wasb.py | 36 +
airflow/providers/microsoft/azure/hooks/adx.py | 78 +-
.../providers/microsoft/azure/hooks/azure_batch.py | 37 +-
.../azure/hooks/azure_container_instance.py | 5 +
.../azure/hooks/azure_container_volume.py | 59 +-
.../microsoft/azure/hooks/azure_cosmos.py | 6 +-
.../microsoft/azure/hooks/azure_data_factory.py | 771 +---
.../microsoft/azure/hooks/azure_fileshare.py | 90 +-
.../microsoft/azure/hooks/data_factory.py | 854 ++++
airflow/providers/microsoft/azure/hooks/wasb.py | 44 +-
.../microsoft/azure/log/wasb_task_handler.py | 8 +-
.../providers/microsoft/azure/operators/adls.py | 102 +
.../microsoft/azure/operators/adls_delete.py | 55 +-
.../microsoft/azure/operators/adls_list.py | 57 +-
.../microsoft/azure/operators/azure_batch.py | 20 +-
.../azure/operators/azure_container_instances.py | 22 +-
.../microsoft/azure/operators/data_factory.py | 174 +
.../microsoft/azure/operators/wasb_delete_blob.py | 2 +-
airflow/providers/microsoft/azure/provider.yaml | 60 +-
.../microsoft/azure/secrets/azure_key_vault.py | 10 +
.../microsoft/azure/sensors/data_factory.py | 75 +
airflow/providers/microsoft/azure/sensors/wasb.py | 2 +-
.../microsoft/azure/transfers/file_to_wasb.py | 59 +-
.../microsoft/azure/transfers/local_to_adls.py | 23 +-
.../microsoft/azure/transfers/local_to_wasb.py | 72 +
.../azure/transfers/oracle_to_azure_data_lake.py | 1 -
.../microsoft/mssql/.latest-doc-only-change.txt | 2 +-
airflow/providers/microsoft/mssql/CHANGELOG.rst | 35 +
airflow/providers/microsoft/mssql/hooks/mssql.py | 16 +-
airflow/providers/microsoft/mssql/provider.yaml | 11 +-
airflow/providers/microsoft/psrp/CHANGELOG.rst | 36 +
.../providers/microsoft/psrp}/__init__.py | 0
.../providers/microsoft/psrp/hooks}/__init__.py | 0
airflow/providers/microsoft/psrp/hooks/psrp.py | 118 +
.../microsoft/psrp/operators}/__init__.py | 0
airflow/providers/microsoft/psrp/operators/psrp.py | 66 +
airflow/providers/microsoft/psrp/provider.yaml | 45 +
.../microsoft/winrm/.latest-doc-only-change.txt | 1 +
airflow/providers/microsoft/winrm/CHANGELOG.rst | 34 +
.../microsoft/winrm/example_dags/example_winrm.py | 12 +-
airflow/providers/microsoft/winrm/hooks/winrm.py | 3 +-
.../providers/microsoft/winrm/operators/winrm.py | 8 +-
airflow/providers/microsoft/winrm/provider.yaml | 5 +
airflow/providers/mongo/CHANGELOG.rst | 53 +
airflow/providers/mongo/hooks/mongo.py | 29 +-
airflow/providers/mongo/provider.yaml | 12 +-
airflow/providers/mongo/sensors/mongo.py | 8 +-
.../providers/mysql/.latest-doc-only-change.txt | 2 +-
airflow/providers/mysql/CHANGELOG.rst | 57 +
.../providers/mysql/example_dags/example_mysql.py | 15 +-
airflow/providers/mysql/hooks/mysql.py | 14 +-
airflow/providers/mysql/operators/mysql.py | 17 +-
airflow/providers/mysql/provider.yaml | 12 +-
.../providers/mysql/transfers/presto_to_mysql.py | 2 +-
.../providers/mysql/transfers/trino_to_mysql.py | 2 +-
.../providers/mysql/transfers/vertica_to_mysql.py | 9 +-
.../providers/neo4j/.latest-doc-only-change.txt | 2 +-
airflow/providers/neo4j/CHANGELOG.rst | 55 +
.../providers/neo4j/example_dags/example_neo4j.py | 13 +-
airflow/providers/neo4j/hooks/neo4j.py | 11 +-
airflow/providers/neo4j/operators/neo4j.py | 4 +-
airflow/providers/neo4j/provider.yaml | 13 +-
airflow/providers/odbc/.latest-doc-only-change.txt | 2 +-
airflow/providers/odbc/CHANGELOG.rst | 66 +
airflow/providers/odbc/hooks/odbc.py | 17 +-
airflow/providers/odbc/provider.yaml | 11 +-
.../providers/openfaas/.latest-doc-only-change.txt | 2 +-
airflow/providers/openfaas/CHANGELOG.rst | 22 +
airflow/providers/openfaas/hooks/openfaas.py | 2 +-
airflow/providers/openfaas/provider.yaml | 4 +
.../providers/opsgenie/.latest-doc-only-change.txt | 1 +
airflow/providers/opsgenie/CHANGELOG.rst | 41 +
airflow/providers/opsgenie/hooks/opsgenie_alert.py | 5 +
.../providers/opsgenie/operators/opsgenie_alert.py | 1 -
airflow/providers/opsgenie/provider.yaml | 12 +
.../providers/oracle/.latest-doc-only-change.txt | 2 +-
airflow/providers/oracle/CHANGELOG.rst | 43 +
airflow/providers/oracle/hooks/oracle.py | 39 +-
airflow/providers/oracle/operators/oracle.py | 6 +-
airflow/providers/oracle/provider.yaml | 11 +-
.../providers/oracle/transfers/oracle_to_oracle.py | 1 -
.../pagerduty/.latest-doc-only-change.txt | 2 +-
airflow/providers/pagerduty/CHANGELOG.rst | 50 +
airflow/providers/pagerduty/hooks/pagerduty.py | 95 +-
.../providers/pagerduty/hooks/pagerduty_events.py | 162 +
airflow/providers/pagerduty/provider.yaml | 12 +
.../papermill/.latest-doc-only-change.txt | 2 +-
airflow/providers/papermill/CHANGELOG.rst | 58 +
.../papermill/example_dags/example_papermill.py | 32 +-
airflow/providers/papermill/operators/papermill.py | 13 +-
airflow/providers/papermill/provider.yaml | 6 +
.../providers/plexus/.latest-doc-only-change.txt | 2 +-
airflow/providers/plexus/CHANGELOG.rst | 42 +
.../plexus/example_dags/example_plexus.py | 10 +-
airflow/providers/plexus/hooks/plexus.py | 6 +-
airflow/providers/plexus/operators/job.py | 8 +-
airflow/providers/plexus/provider.yaml | 5 +
.../providers/postgres/.latest-doc-only-change.txt | 1 +
airflow/providers/postgres/CHANGELOG.rst | 78 +
.../postgres/example_dags/example_postgres.py | 24 +-
airflow/providers/postgres/hooks/postgres.py | 37 +-
airflow/providers/postgres/operators/postgres.py | 5 +-
airflow/providers/postgres/provider.yaml | 15 +-
.../providers/presto/.latest-doc-only-change.txt | 2 +-
airflow/providers/presto/CHANGELOG.rst | 39 +
airflow/providers/presto/hooks/presto.py | 10 +-
airflow/providers/presto/provider.yaml | 11 +-
.../providers/qubole/.latest-doc-only-change.txt | 2 +-
airflow/providers/qubole/CHANGELOG.rst | 43 +-
.../qubole/example_dags/example_qubole.py | 63 +-
airflow/providers/qubole/hooks/qubole.py | 8 +-
airflow/providers/qubole/hooks/qubole_check.py | 4 +-
airflow/providers/qubole/operators/qubole_check.py | 10 +-
airflow/providers/qubole/provider.yaml | 12 +-
airflow/providers/qubole/sensors/qubole.py | 14 +-
airflow/providers/redis/CHANGELOG.rst | 37 +
airflow/providers/redis/provider.yaml | 11 +-
.../salesforce/.latest-doc-only-change.txt | 1 +
airflow/providers/salesforce/CHANGELOG.rst | 62 +
.../example_dags/example_salesforce_apex_rest.py | 35 +
airflow/providers/salesforce/hooks/salesforce.py | 106 +-
airflow/providers/salesforce/hooks/tableau.py | 1 -
.../salesforce/operators/salesforce_apex_rest.py | 66 +
.../operators/tableau_refresh_workbook.py | 1 -
airflow/providers/salesforce/provider.yaml | 18 +-
.../salesforce/sensors/tableau_job_status.py | 1 -
airflow/providers/samba/CHANGELOG.rst | 59 +
airflow/providers/samba/hooks/samba.py | 235 +-
airflow/providers/samba/provider.yaml | 12 +-
.../providers/segment/.latest-doc-only-change.txt | 2 +-
airflow/providers/segment/CHANGELOG.rst | 40 +
.../segment/operators/segment_track_event.py | 1 -
airflow/providers/segment/provider.yaml | 11 +-
.../providers/sendgrid/.latest-doc-only-change.txt | 2 +-
airflow/providers/sendgrid/CHANGELOG.rst | 37 +
airflow/providers/sendgrid/provider.yaml | 2 +
airflow/providers/sendgrid/utils/emailer.py | 2 +-
airflow/providers/sftp/CHANGELOG.rst | 70 +
airflow/providers/sftp/hooks/sftp.py | 26 +-
airflow/providers/sftp/operators/sftp.py | 5 +-
airflow/providers/sftp/provider.yaml | 14 +-
.../singularity/.latest-doc-only-change.txt | 1 +
airflow/providers/singularity/CHANGELOG.rst | 35 +
.../example_dags/example_singularity.py | 30 +-
.../providers/singularity/operators/singularity.py | 2 +-
airflow/providers/singularity/provider.yaml | 5 +
.../providers/slack/.latest-doc-only-change.txt | 2 +-
airflow/providers/slack/CHANGELOG.rst | 72 +
.../providers/slack/example_dags}/__init__.py | 0
.../providers/slack/example_dags/example_slack.py | 47 +
airflow/providers/slack/hooks/slack.py | 10 +-
airflow/providers/slack/hooks/slack_webhook.py | 6 +-
airflow/providers/slack/operators/slack.py | 68 +-
airflow/providers/slack/operators/slack_webhook.py | 1 -
airflow/providers/slack/provider.yaml | 15 +
airflow/providers/snowflake/CHANGELOG.rst | 87 +
.../snowflake/example_dags/example_snowflake.py | 23 +-
airflow/providers/snowflake/hooks/snowflake.py | 78 +-
airflow/providers/snowflake/operators/snowflake.py | 325 +-
airflow/providers/snowflake/provider.yaml | 14 +-
.../snowflake/transfers/s3_to_snowflake.py | 45 +-
.../snowflake/transfers/snowflake_to_slack.py | 2 +-
.../providers/sqlite/.latest-doc-only-change.txt | 2 +-
airflow/providers/sqlite/CHANGELOG.rst | 43 +
.../providers/sqlite/example_dags/create_table.sql | 24 +
.../sqlite/example_dags/example_sqlite.py | 44 +-
airflow/providers/sqlite/hooks/sqlite.py | 34 +
airflow/providers/sqlite/operators/sqlite.py | 4 +-
airflow/providers/sqlite/provider.yaml | 8 +-
airflow/providers/ssh/CHANGELOG.rst | 88 +
airflow/providers/ssh/hooks/ssh.py | 118 +-
airflow/providers/ssh/operators/ssh.py | 235 +-
airflow/providers/ssh/provider.yaml | 14 +-
.../providers/tableau/.latest-doc-only-change.txt | 2 +-
airflow/providers/tableau/CHANGELOG.rst | 67 +
.../tableau/example_dags/example_tableau.py | 64 +
.../example_tableau_refresh_workbook.py | 24 +-
airflow/providers/tableau/hooks/tableau.py | 89 +-
airflow/providers/tableau/operators/tableau.py | 144 +
.../tableau/operators/tableau_refresh_workbook.py | 66 +-
airflow/providers/tableau/provider.yaml | 16 +-
.../tableau/sensors/tableau_job_status.py | 21 +-
.../providers/telegram/.latest-doc-only-change.txt | 2 +-
airflow/providers/telegram/CHANGELOG.rst | 36 +
.../telegram/example_dags/example_telegram.py | 14 +-
airflow/providers/telegram/hooks/telegram.py | 4 +-
airflow/providers/telegram/provider.yaml | 5 +
.../providers/trino/.latest-doc-only-change.txt | 1 +
airflow/providers/trino/CHANGELOG.rst | 47 +
airflow/providers/trino/hooks/trino.py | 21 +-
airflow/providers/trino/provider.yaml | 12 +-
.../providers/vertica/.latest-doc-only-change.txt | 2 +-
airflow/providers/vertica/CHANGELOG.rst | 39 +
airflow/providers/vertica/hooks/vertica.py | 2 +-
airflow/providers/vertica/provider.yaml | 11 +-
.../providers/yandex/.latest-doc-only-change.txt | 2 +-
airflow/providers/yandex/CHANGELOG.rst | 49 +
.../example_dags/example_yandexcloud_dataproc.py | 17 +-
airflow/providers/yandex/hooks/yandex.py | 6 +-
.../providers/yandex/hooks/yandexcloud_dataproc.py | 4 +-
.../yandex/operators/yandexcloud_dataproc.py | 105 +-
airflow/providers/yandex/provider.yaml | 11 +-
.../providers/zendesk/.latest-doc-only-change.txt | 2 +-
airflow/providers/zendesk/CHANGELOG.rst | 38 +
airflow/providers/zendesk/hooks/zendesk.py | 1 -
airflow/providers/zendesk/provider.yaml | 5 +
airflow/providers_manager.py | 641 ++-
airflow/secrets/base_secrets.py | 2 +-
airflow/secrets/environment_variables.py | 1 -
airflow/secrets/local_filesystem.py | 2 +-
airflow/secrets/metastore.py | 2 -
airflow/security/kerberos.py | 30 +-
airflow/security/permissions.py | 9 +-
airflow/security/utils.py | 10 +-
airflow/sensors/base.py | 34 +-
airflow/sensors/base_sensor_operator.py | 1 -
airflow/sensors/bash.py | 2 +-
airflow/sensors/date_time.py | 29 +-
airflow/sensors/date_time_sensor.py | 1 -
airflow/sensors/external_task.py | 58 +-
airflow/sensors/external_task_sensor.py | 1 -
airflow/sensors/filesystem.py | 8 +-
airflow/sensors/hdfs_sensor.py | 1 -
airflow/sensors/hive_partition_sensor.py | 1 -
airflow/sensors/http_sensor.py | 1 -
airflow/sensors/metastore_partition_sensor.py | 1 -
airflow/sensors/named_hive_partition_sensor.py | 1 -
airflow/sensors/s3_key_sensor.py | 1 -
airflow/sensors/s3_prefix_sensor.py | 1 -
airflow/sensors/smart_sensor.py | 56 +-
airflow/sensors/sql.py | 2 +-
airflow/sensors/sql_sensor.py | 1 -
airflow/sensors/time_delta.py | 30 +-
airflow/sensors/time_delta_sensor.py | 1 -
airflow/sensors/time_sensor.py | 30 +
airflow/sensors/web_hdfs_sensor.py | 1 -
airflow/sensors/weekday.py | 17 +-
airflow/sentry.py | 42 +-
airflow/serialization/enums.py | 1 +
airflow/serialization/json_schema.py | 3 +-
airflow/serialization/schema.json | 13 +-
airflow/serialization/serialized_objects.py | 272 +-
airflow/settings.py | 124 +-
airflow/smart_sensor_dags/smart_sensor_group.py | 2 +-
airflow/stats.py | 32 +-
airflow/task/task_runner/__init__.py | 2 +-
airflow/task/task_runner/base_task_runner.py | 22 +-
airflow/task/task_runner/cgroup_task_runner.py | 4 +-
airflow/task/task_runner/standard_task_runner.py | 15 +-
airflow/templates.py | 66 +
airflow/ti_deps/dep_context.py | 22 +-
airflow/ti_deps/deps/dag_ti_slots_available_dep.py | 6 +-
airflow/ti_deps/deps/dagrun_exists_dep.py | 27 +-
airflow/ti_deps/deps/dagrun_id_dep.py | 11 +-
.../ti_deps/deps/exec_date_after_start_date_dep.py | 12 +-
airflow/ti_deps/deps/not_in_retry_period_dep.py | 8 +-
airflow/ti_deps/deps/not_previously_skipped_dep.py | 4 +-
airflow/ti_deps/deps/pool_slots_available_dep.py | 2 +-
airflow/ti_deps/deps/prev_dagrun_dep.py | 57 +-
airflow/ti_deps/deps/ready_to_reschedule.py | 8 +-
airflow/ti_deps/deps/runnable_exec_date_dep.py | 25 +-
airflow/ti_deps/deps/task_concurrency_dep.py | 4 +-
airflow/ti_deps/deps/task_not_running_dep.py | 2 +-
airflow/ti_deps/deps/trigger_rule_dep.py | 83 +-
airflow/ti_deps/deps/valid_state_dep.py | 6 +-
.../hooks => airflow/timetables}/__init__.py | 0
airflow/timetables/base.py | 189 +
airflow/timetables/interval.py | 300 ++
airflow/timetables/simple.py | 96 +
.../zendesk/hooks => airflow/triggers}/__init__.py | 0
airflow/triggers/base.py | 100 +
airflow/triggers/temporal.py | 78 +
airflow/triggers/testing.py | 52 +
airflow/typing_compat.py | 12 +-
airflow/ui/.env.example | 17 +
airflow/ui/docs/CONTRIBUTING.md | 4 +-
airflow/ui/package.json | 2 +
airflow/ui/src/api/index.ts | 23 +-
.../ui/src/components/AppContainer/AppHeader.tsx | 14 +-
.../components/AppContainer/TimezoneDropdown.tsx | 16 +-
airflow/ui/src/components/Table.tsx | 187 +
airflow/ui/src/interfaces/react-table-config.d.ts | 145 +
airflow/ui/src/providers/DateProvider.tsx | 87 +
airflow/ui/src/providers/TimezoneProvider.tsx | 67 -
airflow/ui/src/providers/auth/PrivateRoute.tsx | 6 +-
airflow/ui/src/views/Docs.tsx | 1 +
airflow/ui/src/views/Pipelines/PipelinesTable.tsx | 120 +-
airflow/ui/src/views/Pipelines/Row.tsx | 141 +-
airflow/ui/test/Login.test.tsx | 6 -
airflow/ui/test/Pipelines.test.tsx | 26 +-
airflow/ui/test/TimezoneDropdown.test.tsx | 27 +-
airflow/ui/tsconfig.json | 2 +-
airflow/ui/yarn.lock | 12 +
airflow/utils/callback_requests.py | 7 +-
airflow/utils/cli.py | 24 +-
airflow/utils/cli_action_loggers.py | 6 +-
airflow/utils/compression.py | 3 +-
airflow/utils/configuration.py | 14 +-
airflow/utils/dag_cycle_tester.py | 26 +-
airflow/utils/dag_processing.py | 1218 ------
airflow/utils/dates.py | 63 +-
airflow/utils/db.py | 274 +-
airflow/utils/decorators.py | 6 +-
airflow/utils/docs.py | 5 +
airflow/utils/edgemodifier.py | 2 +-
airflow/utils/email.py | 10 +-
airflow/utils/event_scheduler.py | 2 +-
airflow/utils/file.py | 12 +-
airflow/utils/helpers.py | 58 +-
airflow/utils/json.py | 20 +-
airflow/utils/log/cloudwatch_task_handler.py | 1 -
airflow/utils/log/es_task_handler.py | 1 -
airflow/utils/log/file_processor_handler.py | 5 +-
airflow/utils/log/file_task_handler.py | 46 +-
airflow/utils/log/gcs_task_handler.py | 1 -
airflow/utils/log/json_formatter.py | 1 -
airflow/utils/log/log_reader.py | 13 +-
airflow/utils/log/logging_mixin.py | 14 +-
airflow/utils/log/non_caching_file_handler.py | 46 +
airflow/utils/log/s3_task_handler.py | 1 -
airflow/utils/log/secrets_masker.py | 140 +-
airflow/utils/log/stackdriver_task_handler.py | 1 -
.../log/task_handler_with_custom_formatter.py | 2 +-
airflow/utils/log/wasb_task_handler.py | 1 -
airflow/utils/module_loading.py | 5 +
airflow/utils/operator_helpers.py | 52 +-
airflow/utils/operator_resources.py | 4 +-
airflow/utils/orm_event_handlers.py | 8 +-
airflow/utils/platform.py | 2 +-
airflow/utils/process_utils.py | 25 +-
airflow/utils/python_virtualenv.py | 3 +-
airflow/utils/python_virtualenv_script.jinja2 | 19 +-
airflow/utils/serve_logs.py | 100 +-
airflow/utils/session.py | 43 +-
airflow/utils/sqlalchemy.py | 48 +-
airflow/utils/state.py | 187 +-
airflow/utils/strings.py | 16 +-
airflow/utils/task_group.py | 43 +-
airflow/utils/timeout.py | 4 +-
airflow/utils/timezone.py | 13 +
airflow/utils/trigger_rule.py | 2 +
airflow/utils/types.py | 2 +-
airflow/utils/weekday.py | 26 +-
airflow/utils/weight_rule.py | 4 +-
airflow/utils/yaml.py | 2 +-
airflow/www/.eslintrc | 5 +-
airflow/www/api/experimental/endpoints.py | 24 +-
airflow/www/app.py | 14 +-
airflow/www/auth.py | 21 +-
airflow/www/decorators.py | 18 +-
airflow/www/extensions/init_jinja_globals.py | 3 +-
airflow/www/extensions/init_manifest_files.py | 4 +-
airflow/www/extensions/init_robots.py | 35 +
airflow/www/extensions/init_views.py | 27 +-
.../hooks => airflow/www/fab_security}/__init__.py | 0
airflow/www/fab_security/manager.py | 1861 +++++++++
.../www/fab_security/sqla}/__init__.py | 0
airflow/www/fab_security/sqla/manager.py | 618 +++
airflow/www/fab_security/sqla/models.py | 202 +
airflow/www/forms.py | 74 +-
airflow/www/gunicorn_config.py | 6 +-
airflow/www/package.json | 28 +-
airflow/www/security.py | 371 +-
airflow/www/static/css/calendar.css | 2 +-
airflow/www/static/css/dags.css | 8 +-
airflow/www/static/css/flash.css | 29 +
airflow/www/static/css/graph.css | 49 +-
airflow/www/static/css/main.css | 36 -
airflow/www/static/css/tree.css | 51 +-
airflow/www/static/js/calendar.js | 12 +-
airflow/www/static/js/circles.js | 127 -
airflow/www/static/js/connection_form.js | 177 +-
airflow/www/static/js/dag.js | 290 ++
airflow/www/static/js/dag_code.js | 2 +
airflow/www/static/js/dag_dependencies.js | 73 +-
airflow/www/static/js/dags.js | 72 +-
airflow/www/static/js/datetime_utils.js | 21 +-
airflow/www/static/js/duration_chart.js | 2 +
airflow/www/static/js/gantt.js | 7 +-
airflow/www/static/js/graph.js | 217 +-
airflow/www/static/js/main.js | 52 +-
airflow/www/static/js/meta_value.js | 2 +
airflow/www/static/js/task.js | 34 +
airflow/www/static/js/task_instance.js | 27 -
airflow/www/static/js/task_instances.js | 40 +-
airflow/www/static/js/ti_log.js | 10 +-
airflow/www/static/js/tree.js | 134 +-
airflow/www/static/js/trigger.js | 2 +
airflow/www/static/js/variable_edit.js | 2 +
airflow/www/static/robots.txt | 2 +
airflow/www/templates/airflow/_messages.html | 30 +
airflow/www/templates/airflow/circles.html | 39 -
airflow/www/templates/airflow/confirm.html | 12 +-
airflow/www/templates/airflow/conn_create.html | 6 +
airflow/www/templates/airflow/conn_edit.html | 6 +
airflow/www/templates/airflow/dag.html | 312 +-
.../www/templates/airflow/dag_dependencies.html | 7 +-
airflow/www/templates/airflow/dag_details.html | 23 +-
airflow/www/templates/airflow/dags.html | 159 +-
airflow/www/templates/airflow/graph.html | 11 +-
airflow/www/templates/airflow/main.html | 20 +-
airflow/www/templates/airflow/model_list.html | 2 +-
.../templates/airflow/no_roles_permissions.html | 37 +
airflow/www/templates/airflow/not_found.html | 35 +
airflow/www/templates/airflow/providers.html | 49 +
airflow/www/templates/airflow/task.html | 31 +-
airflow/www/templates/airflow/task_instance.html | 6 +-
airflow/www/templates/airflow/traceback.html | 19 +-
airflow/www/templates/airflow/tree.html | 23 +-
airflow/www/templates/airflow/trigger.html | 25 +-
airflow/www/templates/airflow/variable_list.html | 2 +
airflow/www/templates/appbuilder/flash.html | 31 +-
airflow/www/utils.py | 183 +-
airflow/www/views.py | 1708 +++++---
airflow/www/webpack.config.js | 4 +-
airflow/www/widgets.py | 6 +-
airflow/www/yarn.lock | 4322 ++++++++------------
breeze | 512 ++-
breeze-complete | 52 +-
chart/.gitignore | 3 +
chart/.helmignore | 3 +
chart/CHANGELOG.txt | 117 +
chart/Chart.lock | 6 +
chart/Chart.yaml | 25 +-
chart/INSTALL | 14 +
{provider_packages => chart}/LICENSE | 0
chart/NOTICE | 6 +
chart/README.md | 15 +-
chart/UPDATING.rst | 113 +
chart/files/pod-template-file.kubernetes-helm-yaml | 76 +-
chart/requirements.lock | 6 -
chart/requirements.yaml | 22 -
chart/templates/NOTES.txt | 118 +-
chart/templates/_helpers.yaml | 78 +-
chart/templates/check-values.yaml | 11 +
chart/templates/cleanup/cleanup-cronjob.yaml | 21 +-
.../templates/cleanup/cleanup-serviceaccount.yaml | 2 +-
chart/templates/configmaps/configmap.yaml | 12 +-
.../templates/configmaps/webserver-configmap.yaml | 2 +-
chart/templates/flower/flower-deployment.yaml | 19 +-
chart/templates/flower/flower-ingress.yaml | 39 +-
chart/templates/flower/flower-networkpolicy.yaml | 13 +-
chart/templates/flower/flower-service.yaml | 21 +-
chart/templates/flower/flower-serviceaccount.yaml | 3 +-
.../jobs/create-user-job-serviceaccount.yaml | 1 +
chart/templates/jobs/create-user-job.yaml | 23 +-
.../jobs/migrate-database-job-serviceaccount.yaml | 1 +
chart/templates/jobs/migrate-database-job.yaml | 28 +-
.../templates/pgbouncer/pgbouncer-deployment.yaml | 13 +-
.../pgbouncer/pgbouncer-poddisruptionbudget.yaml | 4 +
.../pgbouncer/pgbouncer-serviceaccount.yaml | 1 +
.../templates/rbac/pod-log-reader-rolebinding.yaml | 2 +-
.../security-context-constraint-rolebinding.yaml | 86 +
chart/templates/redis/redis-serviceaccount.yaml | 1 +
.../templates/scheduler/scheduler-deployment.yaml | 59 +-
.../scheduler/scheduler-poddisruptionbudget.yaml | 4 +
.../scheduler/scheduler-serviceaccount.yaml | 1 +
chart/templates/secrets/elasticsearch-secret.yaml | 6 +-
chart/templates/secrets/fernetkey-secret.yaml | 1 +
.../secrets/metadata-connection-secret.yaml | 7 +-
.../templates/secrets/pgbouncer-config-secret.yaml | 2 +
.../templates/secrets/pgbouncer-stats-secret.yaml | 4 +-
chart/templates/secrets/redis-secrets.yaml | 15 +-
.../secrets/result-backend-connection-secret.yaml | 12 +-
.../secrets/webserver-secret-key-secret.yaml | 39 +
chart/templates/statsd/statsd-serviceaccount.yaml | 1 +
.../templates/triggerer/triggerer-deployment.yaml | 205 +
.../triggerer/triggerer-serviceaccount.yaml | 41 +
.../templates/webserver/webserver-deployment.yaml | 54 +-
chart/templates/webserver/webserver-ingress.yaml | 70 +-
.../webserver/webserver-networkpolicy.yaml | 13 +-
chart/templates/webserver/webserver-service.yaml | 17 +-
.../webserver/webserver-serviceaccount.yaml | 1 +
chart/templates/workers/worker-deployment.yaml | 63 +-
chart/templates/workers/worker-kedaautoscaler.yaml | 6 +-
chart/templates/workers/worker-serviceaccount.yaml | 1 +
chart/tests/helm_template_generator.py | 58 +-
chart/tests/test_airflow_common.py | 125 +
chart/tests/test_annotations.py | 347 +-
chart/tests/test_basic_helm_chart.py | 123 +-
chart/tests/test_cleanup_pods.py | 95 +
chart/tests/test_configmap.py | 115 +
chart/tests/test_create_user_job.py | 79 +
chart/tests/test_elasticsearch_secret.py | 115 +
chart/tests/test_flower.py | 254 +-
chart/tests/test_git_sync_scheduler.py | 47 +-
chart/tests/test_git_sync_webserver.py | 91 +-
chart/tests/test_git_sync_worker.py | 38 +
chart/tests/test_ingress_flower.py | 69 +-
chart/tests/test_ingress_web.py | 66 +-
chart/tests/test_keda.py | 50 +-
chart/tests/test_metadata_connection_secret.py | 18 +
chart/tests/test_migrate_database_job.py | 137 +-
chart/tests/test_pdb_pgbouncer.py | 35 +
chart/tests/test_pdb_scheduler.py | 35 +
chart/tests/test_pgbouncer.py | 146 +-
chart/tests/test_pod_template_file.py | 251 +-
chart/tests/test_rbac.py | 36 +
chart/tests/test_redis.py | 17 +-
.../tests/test_result_backend_connection_secret.py | 64 +-
chart/tests/test_scc_rolebinding.py | 116 +
chart/tests/test_scheduler.py | 285 +-
chart/tests/test_triggerer.py | 321 ++
chart/tests/test_webserver.py | 632 +++
chart/tests/test_webserver_deployment.py | 267 --
chart/tests/test_worker.py | 323 +-
chart/values.schema.json | 2489 +++++++++--
chart/values.yaml | 543 ++-
chart/values_schema.schema.json | 93 +
clients/README.md | 8 +
clients/gen/common.sh | 2 +-
clients/gen/go.sh | 4 +-
clients/gen/python.sh | 2 +-
codecov.yml | 17 +-
confirm | 8 +-
dags/test_dag.py | 37 -
dev/PROVIDER_PACKAGE_DETAILS.md | 2 +-
dev/README_RELEASE_AIRFLOW.md | 308 +-
dev/README_RELEASE_AIRFLOW_UPGRADE_CHECK.md | 37 +-
dev/README_RELEASE_HELM_CHART.md | 629 +++
dev/README_RELEASE_PROVIDER_PACKAGES.md | 105 +-
dev/REFRESHING_CI_CACHE.md | 94 +
dev/airflow-github | 16 +-
dev/airflow-license | 2 +-
dev/check_files.py | 165 +-
dev/import_all_classes.py | 39 +-
.../CHANGELOG_TEMPLATE.rst.jinja2 | 51 +
.../PROVIDER_INDEX_TEMPLATE.rst.jinja2 | 15 +-
.../PROVIDER_ISSUE_TEMPLATE.md.jinja2 | 35 +
.../PROVIDER_README_TEMPLATE.rst.jinja2 | 14 +-
dev/provider_packages/README.md | 109 +-
dev/provider_packages/SETUP_TEMPLATE.py.jinja2 | 11 +-
.../UPDATE_CHANGELOG_TEMPLATE.rst.jinja2 | 29 +
dev/provider_packages/prepare_provider_packages.py | 1048 +++--
dev/provider_packages/remove_old_releases.py | 10 +-
dev/refresh_images.sh | 38 +
dev/requirements.txt | 6 +
dev/retag_docker_images.py | 76 +
dev/send_email.py | 4 +-
dev/validate_version_added_fields_in_config.py | 120 +
docs/README.rst | 18 +-
docs/apache-airflow-providers-airbyte/commits.rst | 47 +
docs/apache-airflow-providers-airbyte/index.rst | 118 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-alibaba/commits.rst | 42 +
.../connections/alibaba.rst | 55 +
docs/apache-airflow-providers-alibaba/index.rst | 85 +
.../installing-providers-from-sources.rst | 18 +
.../operators/index.rst | 26 +
.../operators/oss.rst | 51 +
.../apache-airflow-providers-alibaba/redirects.txt | 1 +
docs/apache-airflow-providers-amazon/commits.rst | 154 +-
.../connections/aws.rst | 23 +
.../connections/index.rst | 28 +
.../connections/redshift.rst | 136 +
.../img/aws-secrets-manager.png | Bin 0 -> 28060 bytes
docs/apache-airflow-providers-amazon/index.rst | 160 +-
.../installing-providers-from-sources.rst | 18 +
.../logging/cloud-watch-task-handlers.rst | 2 +-
.../logging/s3-task-handler.rst | 2 +-
.../operators/_partials/prerequisite_tasks.rst | 2 +-
.../operators/athena.rst | 57 +
.../operators/datasync.rst | 4 -
.../operators/dms.rst | 91 +
.../operators/ecs.rst | 4 -
.../operators/eks.rst | 202 +
.../operators/emr.rst | 10 +-
.../operators/emr_eks.rst | 75 +
.../operators/google_api_to_s3_transfer.rst | 4 -
.../operators/imap_attachment_to_s3.rst | 4 -
.../operators/redshift.rst | 96 +
.../operators/s3.rst | 4 -
.../operators/s3_to_redshift.rst | 4 -
.../operators/salesforce_to_s3.rst | 49 +
.../operators/sqs_publish.rst | 54 +
.../operators/transfer/glacier_to_gcs.rst | 4 +-
.../operators/transfer/s3_to_sftp.rst | 42 +
.../operators/transfer/sftp_to_s3.rst | 40 +
docs/apache-airflow-providers-amazon/redirects.txt | 1 -
.../secrets-backends/aws-secrets-manager.rst | 79 +-
.../commits.rst | 44 +
.../apache-airflow-providers-apache-beam/index.rst | 117 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 57 +-
.../index.rst | 50 +-
.../installing-providers-from-sources.rst | 18 +
.../operators.rst | 4 -
.../commits.rst | 54 +
.../connections/drill.rst | 44 +
.../index.rst | 86 +
.../installing-providers-from-sources.rst | 18 +
.../operators.rst | 46 +
.../commits.rst | 61 +-
.../index.rst | 68 +-
.../installing-providers-from-sources.rst | 18 +
.../operators.rst | 48 +
.../commits.rst | 58 +-
.../connections.rst | 10 +-
.../apache-airflow-providers-apache-hdfs/index.rst | 52 +-
.../installing-providers-from-sources.rst | 18 +
.../operators.rst | 5 -
.../commits.rst | 66 +
.../connections/hiveserver2.rst | 2 +-
.../apache-airflow-providers-apache-hive/index.rst | 83 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 45 +-
.../index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 37 +-
.../apache-airflow-providers-apache-livy/index.rst | 62 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 46 +-
docs/apache-airflow-providers-apache-pig/index.rst | 40 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 44 +-
.../index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 39 +-
.../connections/spark.rst | 8 +-
.../index.rst | 67 +-
.../installing-providers-from-sources.rst | 18 +
.../operators.rst | 4 -
.../commits.rst | 61 +-
.../index.rst | 38 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-asana/commits.rst | 59 +
.../connections/asana.rst | 31 +
docs/apache-airflow-providers-asana/index.rst | 91 +
.../installing-providers-from-sources.rst | 18 +
.../operators/asana.rst | 88 +
docs/apache-airflow-providers-celery/commits.rst | 32 +-
docs/apache-airflow-providers-celery/index.rst | 52 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-cloudant/commits.rst | 43 +-
docs/apache-airflow-providers-cloudant/index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 91 +-
.../index.rst | 93 +-
.../installing-providers-from-sources.rst | 18 +
.../operators.rst | 8 +-
.../commits.rst | 56 +-
docs/apache-airflow-providers-databricks/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-datadog/commits.rst | 46 +-
docs/apache-airflow-providers-datadog/index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-dingding/commits.rst | 40 +-
docs/apache-airflow-providers-dingding/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-discord/commits.rst | 43 +-
docs/apache-airflow-providers-discord/index.rst | 41 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-docker/commits.rst | 81 +-
docs/apache-airflow-providers-docker/index.rst | 85 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 68 +-
.../connections/elasticsearch.rst | 73 +
.../index.rst | 85 +-
.../installing-providers-from-sources.rst | 18 +
.../logging.rst | 102 -
.../logging/index.rst | 102 +
.../redirects.txt | 1 +
docs/apache-airflow-providers-exasol/commits.rst | 38 +-
docs/apache-airflow-providers-exasol/index.rst | 62 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-facebook/commits.rst | 38 +
docs/apache-airflow-providers-facebook/index.rst | 47 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-ftp/commits.rst | 38 +-
docs/apache-airflow-providers-ftp/index.rst | 46 +-
.../installing-providers-from-sources.rst | 18 +
.../api-auth-backend/google-openid.rst | 2 +-
docs/apache-airflow-providers-google/commits.rst | 148 +-
.../connections/gcp.rst | 4 +-
.../example-dags.rst | 14 +-
docs/apache-airflow-providers-google/index.rst | 272 +-
.../installing-providers-from-sources.rst | 18 +
.../logging/gcs.rst | 2 +-
.../logging/index.rst | 4 +-
.../logging/stackdriver.rst | 4 +-
.../operators/_partials/prerequisite_tasks.rst | 2 +-
.../operators/ads.rst | 4 -
.../operators/cloud/automl.rst | 7 -
.../operators/cloud/bigquery.rst | 21 -
.../operators/cloud/bigquery_dts.rst | 6 -
.../operators/cloud/bigtable.rst | 5 -
.../operators/cloud/cloud_build.rst | 344 +-
.../operators/cloud/cloud_memorystore.rst | 4 -
.../cloud/cloud_memorystore_memcached.rst | 4 -
.../operators/cloud/cloud_sql.rst | 4 -
.../cloud/cloud_storage_transfer_service.rst | 4 -
.../operators/cloud/compute.rst | 4 -
.../operators/cloud/compute_ssh.rst | 4 -
.../operators/cloud/data_loss_prevention.rst | 4 -
.../operators/cloud/datacatalog.rst | 4 -
.../operators/cloud/dataflow.rst | 4 -
.../operators/cloud/datafusion.rst | 30 +-
.../operators/cloud/dataprep.rst | 6 +-
.../operators/cloud/dataproc.rst | 6 +-
.../operators/cloud/datastore.rst | 4 -
.../operators/cloud/functions.rst | 4 -
.../operators/cloud/gcs.rst | 11 +-
.../operators/cloud/index.rst | 2 +-
.../operators/cloud/kubernetes_engine.rst | 4 -
.../operators/cloud/life_sciences.rst | 5 -
.../operators/cloud/mlengine.rst | 4 -
.../operators/cloud/natural_language.rst | 4 -
.../operators/cloud/pubsub.rst | 4 -
.../operators/cloud/spanner.rst | 4 -
.../operators/cloud/stackdriver.rst | 4 -
.../operators/cloud/translate.rst | 4 -
.../operators/cloud/translate_speech.rst | 4 -
.../operators/cloud/video_intelligence.rst | 4 -
.../operators/cloud/vision.rst | 4 -
.../operators/cloud/workflows.rst | 22 +-
.../operators/firebase/firestore.rst | 4 -
.../operators/leveldb/leveldb.rst | 9 +-
.../operators/marketing_platform/analytics.rst | 5 -
.../marketing_platform/campaign_manager.rst | 5 -
.../operators/marketing_platform/display_video.rst | 4 -
.../operators/marketing_platform/index.rst | 2 +-
.../operators/marketing_platform/search_ads.rst | 4 -
.../operators/suite/sheets.rst | 5 -
.../operators/transfer/facebook_ads_to_gcs.rst | 4 -
.../operators/transfer/gcs_to_gdrive.rst | 5 -
.../operators/transfer/gcs_to_local.rst | 5 -
.../operators/transfer/gcs_to_sftp.rst | 5 -
.../operators/transfer/gcs_to_sheets.rst | 4 -
.../operators/transfer/gdrive_to_gcs.rst | 5 -
.../operators/transfer/gdrive_to_local.rst | 5 -
.../operators/transfer/local_to_gcs.rst | 5 -
.../operators/transfer/mysql_to_gcs.rst | 5 -
.../operators/transfer/oracle_to_gcs.rst | 5 -
.../operators/transfer/s3_to_gcs.rst | 4 -
.../operators/transfer/salesforce_to_gcs.rst | 4 -
.../operators/transfer/sftp_to_gcs.rst | 5 -
.../operators/transfer/sheets_to_gcs.rst | 4 -
.../operators/transfer/sql_to_sheets.rst | 45 +
.../google-cloud-secret-manager-backend.rst | 4 +-
docs/apache-airflow-providers-grpc/commits.rst | 34 +-
docs/apache-airflow-providers-grpc/index.rst | 55 +-
.../installing-providers-from-sources.rst | 18 +
.../apache-airflow-providers-hashicorp/commits.rst | 47 +
docs/apache-airflow-providers-hashicorp/index.rst | 60 +-
.../installing-providers-from-sources.rst | 18 +
.../secrets-backends/hashicorp-vault.rst | 91 +-
docs/apache-airflow-providers-http/commits.rst | 46 +-
docs/apache-airflow-providers-http/index.rst | 59 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-http/operators.rst | 21 +
docs/apache-airflow-providers-imap/commits.rst | 45 +-
.../connections/imap.rst | 2 +-
docs/apache-airflow-providers-imap/index.rst | 38 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-influxdb/commits.rst | 41 +
.../connections/influxdb.rst | 49 +
docs/apache-airflow-providers-influxdb/index.rst | 102 +
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-jdbc/commits.rst | 48 +-
.../connections/jdbc.rst | 2 +-
docs/apache-airflow-providers-jdbc/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-jdbc/operators.rst | 20 +-
docs/apache-airflow-providers-jenkins/commits.rst | 66 +-
docs/apache-airflow-providers-jenkins/index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-jira/commits.rst | 43 +-
docs/apache-airflow-providers-jira/index.rst | 54 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 97 +-
.../connections/adf.rst | 30 +-
.../connections/adx.rst | 55 +-
.../connections/azure_batch.rst | 22 +-
.../connections/azure_container_volume.rst | 75 +
.../connections/azure_fileshare.rst | 80 +
.../connections/wasb.rst | 18 +-
.../index.rst | 117 +-
.../installing-providers-from-sources.rst | 18 +
.../logging.rst | 55 -
.../logging/index.rst | 55 +
.../operators/_partials/prerequisite_tasks.rst | 2 +-
.../operators/adf_run_pipeline.rst | 53 +
.../operators/adls.rst | 11 +-
.../operators/azure_blob_to_gcs.rst | 8 +-
.../operators/local_to_adls.rst | 11 +-
.../redirects.txt | 1 +
.../secrets-backends/azure-key-vault.rst | 7 +
.../commits.rst | 37 +-
.../index.rst | 58 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 53 +
.../index.rst | 79 +
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 36 +-
.../index.rst | 70 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-mongo/commits.rst | 54 +-
docs/apache-airflow-providers-mongo/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-mysql/commits.rst | 54 +-
docs/apache-airflow-providers-mysql/index.rst | 83 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-neo4j/commits.rst | 50 +-
docs/apache-airflow-providers-neo4j/index.rst | 56 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-odbc/commits.rst | 48 +-
.../connections/odbc.rst | 4 +-
docs/apache-airflow-providers-odbc/index.rst | 47 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-openfaas/commits.rst | 23 +-
docs/apache-airflow-providers-openfaas/index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-opsgenie/commits.rst | 33 +-
docs/apache-airflow-providers-opsgenie/index.rst | 59 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-oracle/commits.rst | 40 +-
.../connections/oracle.rst | 32 +-
docs/apache-airflow-providers-oracle/index.rst | 57 +-
.../installing-providers-from-sources.rst | 18 +
.../apache-airflow-providers-pagerduty/commits.rst | 54 +-
docs/apache-airflow-providers-pagerduty/index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
.../apache-airflow-providers-papermill/commits.rst | 49 +-
docs/apache-airflow-providers-papermill/index.rst | 62 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-plexus/commits.rst | 43 +-
docs/apache-airflow-providers-plexus/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-postgres/commits.rst | 72 +-
docs/apache-airflow-providers-postgres/index.rst | 50 +-
.../installing-providers-from-sources.rst | 18 +
.../operators/postgres_operator_howto_guide.rst | 54 +-
docs/apache-airflow-providers-presto/commits.rst | 39 +-
docs/apache-airflow-providers-presto/index.rst | 47 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-qubole/commits.rst | 45 +-
docs/apache-airflow-providers-qubole/index.rst | 59 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-redis/commits.rst | 44 +-
docs/apache-airflow-providers-redis/index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 54 +
.../connections/salesforce.rst | 86 +-
docs/apache-airflow-providers-salesforce/index.rst | 63 +-
.../installing-providers-from-sources.rst | 18 +
.../operators/index.rst | 26 +
.../operators/salesforce_apex_rest.rst | 39 +
docs/apache-airflow-providers-samba/commits.rst | 54 +-
docs/apache-airflow-providers-samba/index.rst | 49 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-segment/commits.rst | 47 +-
docs/apache-airflow-providers-segment/index.rst | 39 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-sendgrid/commits.rst | 33 +-
docs/apache-airflow-providers-sendgrid/index.rst | 48 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-sftp/commits.rst | 59 +-
.../connections/sftp.rst | 13 +-
docs/apache-airflow-providers-sftp/index.rst | 81 +-
.../installing-providers-from-sources.rst | 18 +
.../commits.rst | 32 +-
.../apache-airflow-providers-singularity/index.rst | 60 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-slack/commits.rst | 57 +-
docs/apache-airflow-providers-slack/index.rst | 78 +-
.../installing-providers-from-sources.rst | 18 +
.../operators/slack_operator_howto_guide.rst | 38 +
.../apache-airflow-providers-snowflake/commits.rst | 80 +-
docs/apache-airflow-providers-snowflake/index.rst | 75 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-sqlite/commits.rst | 41 +-
docs/apache-airflow-providers-sqlite/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-sqlite/operators.rst | 2 +-
docs/apache-airflow-providers-ssh/commits.rst | 75 +
.../connections/ssh.rst | 14 +-
docs/apache-airflow-providers-ssh/index.rst | 74 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-tableau/commits.rst | 67 +-
.../connections/tableau.rst | 11 +-
docs/apache-airflow-providers-tableau/index.rst | 37 +-
.../installing-providers-from-sources.rst | 18 +
.../apache-airflow-providers-tableau/operators.rst | 74 +
docs/apache-airflow-providers-telegram/commits.rst | 36 +-
docs/apache-airflow-providers-telegram/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-trino/commits.rst | 41 +
docs/apache-airflow-providers-trino/index.rst | 45 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-vertica/commits.rst | 47 +-
docs/apache-airflow-providers-vertica/index.rst | 39 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-yandex/commits.rst | 51 +-
docs/apache-airflow-providers-yandex/index.rst | 51 +-
.../installing-providers-from-sources.rst | 18 +
docs/apache-airflow-providers-yandex/operators.rst | 2 +-
docs/apache-airflow-providers-zendesk/commits.rst | 44 +-
docs/apache-airflow-providers-zendesk/index.rst | 47 +-
.../installing-providers-from-sources.rst | 18 +
.../core-extensions/auth-backends.rst | 34 +
.../core-extensions/connections.rst | 35 +
.../core-extensions/extra-links.rst | 34 +
.../core-extensions/index.rst | 29 +
.../core-extensions/logging.rst | 28 +
.../core-extensions/secrets-backends.rst | 36 +
.../howto/create-update-providers.rst | 49 +-
docs/apache-airflow-providers/index.rst | 244 +-
.../installing-from-pypi.rst | 42 +
.../installing-from-sources.rst | 119 +
.../operators-and-hooks-ref/apache.rst | 8 +-
.../operators-and-hooks-ref/aws.rst | 8 +-
.../operators-and-hooks-ref/azure.rst | 8 +-
.../operators-and-hooks-ref/google.rst | 12 +-
.../operators-and-hooks-ref/index.rst | 4 +-
.../operators-and-hooks-ref/protocol.rst | 8 +-
.../operators-and-hooks-ref/services.rst | 8 +-
.../operators-and-hooks-ref/software.rst | 8 +-
docs/apache-airflow/backport-providers.rst | 115 -
docs/apache-airflow/best-practices.rst | 497 ++-
docs/apache-airflow/concepts/connections.rst | 14 +-
docs/apache-airflow/concepts/dags.rst | 105 +-
docs/apache-airflow/concepts/deferring.rst | 163 +
docs/apache-airflow/concepts/index.rst | 4 +
docs/apache-airflow/concepts/operators.rst | 84 +-
docs/apache-airflow/concepts/overview.rst | 6 +-
docs/apache-airflow/concepts/params.rst | 63 +
docs/apache-airflow/concepts/pools.rst | 24 +-
docs/apache-airflow/concepts/priority-weight.rst | 61 +
docs/apache-airflow/concepts/scheduler.rst | 247 +-
docs/apache-airflow/concepts/smart-sensors.rst | 6 +
docs/apache-airflow/concepts/taskflow.rst | 5 +-
docs/apache-airflow/concepts/tasks.rst | 91 +-
docs/apache-airflow/concepts/timetable.rst | 50 +
docs/apache-airflow/concepts/xcoms.rst | 2 +
docs/apache-airflow/configurations-ref.rst | 5 +
docs/apache-airflow/dag-run.rst | 84 +-
docs/apache-airflow/dag-serialization.rst | 4 +-
docs/apache-airflow/deprecated-rest-api-ref.rst | 2 +-
docs/apache-airflow/executor/celery.rst | 8 +-
docs/apache-airflow/executor/dask.rst | 6 +-
docs/apache-airflow/executor/debug.rst | 10 +-
docs/apache-airflow/executor/kubernetes.rst | 2 +-
docs/apache-airflow/extra-packages-ref.rst | 48 +-
docs/apache-airflow/faq.rst | 311 +-
docs/apache-airflow/howto/add-dag-tags.rst | 6 +-
docs/apache-airflow/howto/connection.rst | 111 +-
.../howto/create-custom-decorator.rst | 120 +
docs/apache-airflow/howto/custom-operator.rst | 126 +-
.../howto/customize-dag-ui-page-instance-name.rst | 55 -
.../howto/customize-state-colors-ui.rst | 75 -
docs/apache-airflow/howto/customize-ui.rst | 167 +
docs/apache-airflow/howto/define_extra_link.rst | 51 +-
docs/apache-airflow/howto/email-config.rst | 32 +-
docs/apache-airflow/howto/index.rst | 6 +-
docs/apache-airflow/howto/operator/bash.rst | 21 +-
.../howto/operator/external_task_sensor.rst | 3 +-
docs/apache-airflow/howto/operator/python.rst | 4 +-
docs/apache-airflow/howto/run-with-upstart.rst | 44 -
docs/apache-airflow/howto/set-config.rst | 6 +
docs/apache-airflow/howto/set-up-database.rst | 108 +-
docs/apache-airflow/howto/timetable.rst | 285 ++
docs/apache-airflow/howto/variable.rst | 1 +
docs/apache-airflow/img/calendar.png | Bin 0 -> 58726 bytes
docs/apache-airflow/img/code.png | Bin 240101 -> 169890 bytes
docs/apache-airflow/img/dag_doc.png | Bin 0 -> 40094 bytes
docs/apache-airflow/img/gantt.png | Bin 71033 -> 70606 bytes
docs/apache-airflow/img/graph.png | Bin 110218 -> 128870 bytes
docs/apache-airflow/img/new_tutorial-1.png | Bin 0 -> 51356 bytes
docs/apache-airflow/img/new_tutorial-2.png | Bin 0 -> 19179 bytes
docs/apache-airflow/img/task_doc.png | Bin 0 -> 245714 bytes
docs/apache-airflow/img/task_lifecycle_diagram.png | Bin 135225 -> 58659 bytes
.../img/template_field_renderer_path.png | Bin 0 -> 64442 bytes
docs/apache-airflow/img/tree.png | Bin 177465 -> 139707 bytes
docs/apache-airflow/img/ui-alert-message.png | Bin 0 -> 7909 bytes
docs/apache-airflow/index.rst | 11 +-
docs/apache-airflow/installation.rst | 330 --
docs/apache-airflow/installation/dependencies.rst | 92 +
docs/apache-airflow/installation/index.rst | 317 ++
.../installation/installing-from-pypi.rst | 204 +
.../installation/installing-from-sources.rst | 155 +
docs/apache-airflow/installation/prerequisites.rst | 45 +
.../installation/setting-up-the-database.rst | 32 +
.../installation/supported-versions.rst | 67 +
docs/apache-airflow/kubernetes.rst | 12 +-
docs/apache-airflow/lineage.rst | 33 +-
.../logging-monitoring/callbacks.rst | 81 +
.../logging-monitoring/check-health.rst | 8 +-
docs/apache-airflow/logging-monitoring/errors.rst | 34 +-
docs/apache-airflow/logging-monitoring/index.rst | 1 +
.../logging-monitoring/logging-tasks.rst | 28 +-
docs/apache-airflow/logging-monitoring/metrics.rst | 16 +-
docs/apache-airflow/macros-ref.rst | 126 -
docs/apache-airflow/migrations-ref.rst | 220 +
docs/apache-airflow/modules_management.rst | 357 +-
docs/apache-airflow/operators-and-hooks-ref.rst | 7 +-
docs/apache-airflow/pipeline_example.csv | 96 +
docs/apache-airflow/plugins.rst | 77 +-
docs/apache-airflow/production-deployment.rst | 8 +-
docs/apache-airflow/project.rst | 4 +
docs/apache-airflow/python-api-ref.rst | 11 +
docs/apache-airflow/redirects.txt | 8 +
docs/apache-airflow/release-process.rst | 17 +-
docs/apache-airflow/security/access-control.rst | 43 +-
docs/apache-airflow/security/api.rst | 10 +-
docs/apache-airflow/security/flower.rst | 4 -
docs/apache-airflow/security/index.rst | 2 -
docs/apache-airflow/security/kerberos.rst | 26 +-
docs/apache-airflow/security/secrets/fernet.rst | 5 +-
docs/apache-airflow/security/secrets/index.rst | 63 +-
.../security/secrets/mask-sensitive-values.rst | 79 +
.../security/secrets/secrets-backend/index.rst | 32 +-
docs/apache-airflow/security/webserver.rst | 115 +-
docs/apache-airflow/security/workload.rst | 12 +-
docs/apache-airflow/start/airflow.sh | 6 +-
docs/apache-airflow/start/docker-compose.yaml | 151 +-
docs/apache-airflow/start/docker.rst | 155 +-
docs/apache-airflow/start/index.rst | 2 +-
docs/apache-airflow/start/local.rst | 56 +-
.../static/{jira-links.js => gh-jira-links.js} | 0
docs/apache-airflow/templates-ref.rst | 182 +
docs/apache-airflow/timezone.rst | 58 +-
docs/apache-airflow/tutorial.rst | 239 +-
docs/apache-airflow/tutorial_taskflow_api.rst | 251 +-
docs/apache-airflow/ui.rst | 13 +-
docs/apache-airflow/upgrade-check.rst | 218 -
docs/apache-airflow/upgrading-from-1-10/index.rst | 1213 ++++++
.../upgrading-from-1-10/upgrade-check.rst | 215 +
docs/apache-airflow/upgrading-to-2.rst | 1214 ------
docs/apache-airflow/usage-cli.rst | 2 +-
docs/build_docs.py | 109 +-
docs/conf.py | 226 +-
docs/docker-stack/build-arg-ref.rst | 121 +-
docs/docker-stack/build.rst | 267 +-
.../customizing/add-build-essential-custom.sh | 4 +-
.../docker-examples/customizing/custom-sources.sh | 4 +-
.../customizing/github-different-repository.sh | 8 +-
.../docker-examples/customizing/github-main.sh | 31 +
.../docker-examples/customizing/github-master.sh | 31 -
.../customizing/github-v2-0-test.sh | 31 -
.../customizing/github-v2-1-test.sh | 31 +
.../customizing/pypi-dev-runtime-deps.sh | 4 +-
.../customizing/pypi-extras-and-deps.sh | 4 +-
.../customizing/pypi-selected-version.sh | 4 +-
.../docker-examples/customizing/stable-airflow.sh | 4 +-
.../extending/add-apt-packages/Dockerfile | 2 +-
.../add-build-essential-extend/Dockerfile | 2 +-
.../extending/add-providers/Dockerfile | 20 +
.../extending/add-pypi-packages/Dockerfile | 2 +-
.../extending/embedding-dags/Dockerfile | 2 +-
.../extending/writable-directory/Dockerfile | 2 +-
.../restricted/restricted_environments.sh | 11 +-
.../docker-images-recipes/hadoop.Dockerfile | 1 +
docs/docker-stack/entrypoint.rst | 352 +-
docs/docker-stack/index.rst | 52 +-
docs/docker-stack/recipes.rst | 4 +-
docs/exts/__init__.py | 1 -
docs/exts/airflow_intersphinx.py | 16 +-
docs/exts/auth_backend.rst.jinja2 | 27 +
docs/exts/connections.rst.jinja2 | 27 +
docs/exts/docroles.py | 12 +-
docs/exts/docs_build/__init__.py | 1 -
docs/exts/docs_build/dev_index_generator.py | 2 +-
.../exts/docs_build/dev_index_template.html.jinja2 | 2 +-
docs/exts/docs_build/docs_builder.py | 15 +-
docs/exts/docs_build/errors.py | 3 +-
docs/exts/docs_build/fetch_inventories.py | 21 +-
docs/exts/docs_build/helm_chart_utils.py | 32 +
docs/exts/docs_build/lint_checks.py | 8 +-
docs/exts/docs_build/run_patched_sphinx.py | 3 +-
docs/exts/docs_build/spelling_checks.py | 3 +-
docs/exts/docs_build/third_party_inventories.py | 3 +-
docs/exts/exampleinclude.py | 22 +-
docs/exts/extra_files_with_substitutions.py | 21 +-
docs/exts/extra_links.rst.jinja2 | 27 +
docs/exts/logging.rst.jinja2 | 29 +
docs/exts/operators_and_hooks_ref.py | 251 +-
docs/exts/providers_packages_ref.py | 2 +-
docs/exts/removemarktransform.py | 5 +-
docs/exts/secret_backend.rst.jinja2 | 27 +
docs/exts/sphinx_script_update.py | 9 +-
docs/exts/substitution_extensions.py | 4 +-
.../adding-connections-and-variables.rst | 85 +
docs/helm-chart/airflow-configuration.rst | 2 +-
docs/helm-chart/changelog.rst | 23 +
docs/helm-chart/external-redis.rst | 33 -
docs/helm-chart/index.rst | 27 +-
.../installing-helm-chart-from-sources.rst | 129 +
docs/helm-chart/keda.rst | 4 +-
docs/helm-chart/manage-dags-files.rst | 78 +-
docs/helm-chart/manage-logs.rst | 15 +-
docs/helm-chart/parameters-ref.rst | 589 +--
docs/helm-chart/production-guide.rst | 260 ++
docs/helm-chart/quick-start.rst | 154 +-
.../setting-resources-for-containers.rst | 66 +
.../static/gh-jira-links.js} | 0
docs/helm-chart/updating.rst | 18 +
docs/helm-chart/using-additional-containers.rst | 43 +-
docs/installing-providers-from-sources.rst | 157 +
.../alibaba/cloud/alibabacloud-oss.png | Bin 0 -> 4968 bytes
docs/integration-logos/apache/drill.png | Bin 0 -> 40173 bytes
.../aws/AWS-Database-Migration-Service_64@5x.png | Bin 0 -> 150946 bytes
...azon-Elastic-Kubernetes-Service_light-bg@4x.png | Bin 0 -> 12199 bytes
.../Postgress.png => postgres/Postgres.png} | Bin
docs/publish_docs.py | 13 +-
docs/spelling_wordlist.txt | 180 +-
hooks/build | 28 -
hooks/push | 25 -
images/CI.png | Bin 243004 -> 0 bytes
images/ci/CI.png | Bin 243004 -> 0 bytes
images/ci/pull_request_ci_flow.md5 | 2 +-
images/ci/pull_request_ci_flow.mermaid | 138 +-
images/ci/pull_request_ci_flow.png | Bin 191467 -> 192880 bytes
images/ci/push_ci_flow.md5 | 2 +-
images/ci/push_ci_flow.mermaid | 135 +-
images/ci/push_ci_flow.png | Bin 205098 -> 200048 bytes
images/ci/scheduled_ci_flow.md5 | 2 +-
images/ci/scheduled_ci_flow.mermaid | 123 +-
images/ci/scheduled_ci_flow.png | Bin 197719 -> 171588 bytes
images/quick_start/vscode_add_configuration_1.png | Bin 0 -> 86990 bytes
images/quick_start/vscode_add_configuration_2.png | Bin 0 -> 74910 bytes
images/quick_start/vscode_add_configuration_3.png | Bin 0 -> 90964 bytes
images/quick_start/vscode_add_env_variable.png | Bin 0 -> 69923 bytes
images/quick_start/vscode_click_on_clone.png | Bin 0 -> 49157 bytes
images/quick_start/vscode_clone.png | Bin 0 -> 43746 bytes
images/quick_start/vscode_creating_branch_1.png | Bin 0 -> 96114 bytes
images/quick_start/vscode_creating_branch_2.png | Bin 0 -> 7916 bytes
images/vscode_add_pytest_settings.png | Bin 0 -> 51247 bytes
images/vscode_configure_python_tests.png | Bin 0 -> 78770 bytes
images/vscode_install_python_extension.png | Bin 0 -> 119090 bytes
images/vscode_run_tests.png | Bin 0 -> 118344 bytes
images/vscode_select_pytest_framework.png | Bin 0 -> 72694 bytes
kubernetes_tests/test_base.py | 209 +
kubernetes_tests/test_kubernetes_executor.py | 206 +-
kubernetes_tests/test_kubernetes_pod_operator.py | 44 +-
.../test_kubernetes_pod_operator_backcompat.py | 51 +-
kubernetes_tests/test_other_executors.py | 89 +
licenses/LICENSE-connexion.txt | 9 +
licenses/LICENSE-python-nvd3.txt | 24 -
licenses/LICENSE-python-slugify.txt | 21 -
metastore_browser/hive_metastore.py | 4 +-
provider_packages/INSTALL | 2 +-
provider_packages/NOTICE | 2 +-
pylintrc | 597 ---
pylintrc-tests | 606 ---
pytest.ini | 2 +
scripts/ci/constraints/ci_branch_constraints.sh | 8 +-
scripts/ci/constraints/ci_commit_constraints.sh | 5 +-
scripts/ci/docker-compose/_docker.env | 3 +-
.../docker-compose/backend-mssql-bind-volume.yml | 28 +
.../docker-compose/backend-mssql-docker-volume.yml | 22 +
scripts/ci/docker-compose/backend-mssql-port.yml | 22 +
scripts/ci/docker-compose/backend-mssql.yml | 54 +
scripts/ci/docker-compose/backend-mysql-port.yml | 2 +-
scripts/ci/docker-compose/backend-mysql.yml | 4 +-
.../ci/docker-compose/backend-postgres-port.yml | 2 +-
scripts/ci/docker-compose/backend-postgres.yml | 2 +-
scripts/ci/docker-compose/backend-sqlite-port.yml | 2 +-
scripts/ci/docker-compose/backend-sqlite.yml | 2 +-
scripts/ci/docker-compose/base.yml | 61 +-
scripts/ci/docker-compose/files.yml | 2 +-
scripts/ci/docker-compose/forward-credentials.yml | 4 +-
scripts/ci/docker-compose/ga.yml | 2 +-
.../ci/docker-compose/integration-cassandra.yml | 5 +-
scripts/ci/docker-compose/integration-kerberos.yml | 4 +-
scripts/ci/docker-compose/integration-mongo.yml | 2 +-
scripts/ci/docker-compose/integration-openldap.yml | 4 +-
scripts/ci/docker-compose/integration-pinot.yml | 2 +-
scripts/ci/docker-compose/integration-rabbitmq.yml | 2 +-
scripts/ci/docker-compose/integration-redis.yml | 2 +-
scripts/ci/docker-compose/integration-statsd.yml | 2 +-
scripts/ci/docker-compose/integration-trino.yml | 5 +-
scripts/ci/docker-compose/local-all-sources.yml | 2 +-
scripts/ci/docker-compose/local-prod.yml | 37 -
scripts/ci/docker-compose/local.yml | 4 +-
.../ci/docker-compose/mssql_create_airflow_db.sql | 21 +
scripts/ci/docker-compose/remove-sources.yml | 2 +-
.../ci/dockerfiles/apache-rat/build_and_push.sh | 11 +-
scripts/ci/dockerfiles/bats/build_and_push.sh | 11 +-
.../dockerfiles/krb5-kdc-server/build_and_push.sh | 11 +-
scripts/ci/dockerfiles/stress/build_and_push.sh | 12 +-
scripts/ci/dockerfiles/trino/Dockerfile | 2 +-
scripts/ci/dockerfiles/trino/build_and_push.sh | 13 +-
scripts/ci/images/ci_build_dockerhub.sh | 145 -
scripts/ci/images/ci_prepare_ci_image_on_ci.sh | 25 +-
scripts/ci/images/ci_prepare_prod_image_on_ci.sh | 33 +-
scripts/ci/images/ci_push_ci_images.sh | 4 +-
scripts/ci/images/ci_push_production_images.sh | 4 +-
scripts/ci/images/ci_run_prod_image_test.sh | 8 +-
.../ci_test_examples_of_prod_image_building.sh | 4 +-
.../images/ci_wait_for_and_verify_all_ci_images.sh | 5 +-
.../ci_wait_for_and_verify_all_prod_images.sh | 4 +
.../ci/images/ci_wait_for_and_verify_ci_image.sh | 29 +-
.../ci/images/ci_wait_for_and_verify_prod_image.sh | 26 +-
scripts/ci/kubernetes/ci_run_helm_upgrade.sh | 30 +
scripts/ci/kubernetes/ci_run_kubernetes_tests.sh | 23 +-
...tup_cluster_and_deploy_airflow_to_kubernetes.sh | 1 +
..._cluster_and_run_kubernetes_tests_single_job.sh | 16 +
...lusters_and_run_kubernetes_tests_in_parallel.sh | 78 +-
...cluster_with_different_executors_in_parallel.sh | 35 +
..._cluster_with_different_executors_single_job.sh | 70 +
scripts/ci/libraries/_all_libs.sh | 2 -
scripts/ci/libraries/_build_images.sh | 491 +--
scripts/ci/libraries/_docker_engine_resources.sh | 69 +-
scripts/ci/libraries/_initialization.sh | 203 +-
scripts/ci/libraries/_kind.sh | 142 +-
scripts/ci/libraries/_local_mounts.sh | 2 -
scripts/ci/libraries/_md5sum.sh | 110 +-
scripts/ci/libraries/_parallel.sh | 126 +-
scripts/ci/libraries/_parameters.sh | 29 +-
scripts/ci/libraries/_push_pull_remove_images.sh | 390 +-
scripts/ci/libraries/_pylint.sh | 35 -
scripts/ci/libraries/_runs.sh | 38 +-
scripts/ci/libraries/_sanity_checks.sh | 16 +-
scripts/ci/libraries/_script_init.sh | 15 +-
scripts/ci/libraries/_spinner.sh | 32 +-
scripts/ci/libraries/_start_end.sh | 8 +-
scripts/ci/libraries/_testing.sh | 2 +-
scripts/ci/libraries/_traps.sh | 11 +-
scripts/ci/libraries/_verify_image.sh | 89 +
scripts/ci/openapi/client_codegen_diff.sh | 2 +-
scripts/ci/pre_commit/pre_commit_boring_cyborg.py | 57 +
.../pre_commit_check_extras_have_providers.py | 4 +-
.../pre_commit_check_order_dockerfile_extras.py | 107 +
.../ci/pre_commit/pre_commit_check_order_setup.py | 26 +-
.../pre_commit_check_provider_yaml_files.py | 60 +-
...it_check_providers_subpackages_all_have_init.py | 54 +
.../pre_commit_check_setup_extra_packages_ref.py | 2 +-
scripts/ci/pre_commit/pre_commit_ci_build.sh | 1 -
scripts/ci/pre_commit/pre_commit_flake8.sh | 3 +-
scripts/ci/pre_commit/pre_commit_insert_extras.py | 2 +-
scripts/ci/pre_commit/pre_commit_json_schema.py | 21 +-
.../pre_commit/pre_commit_migration_documented.py | 67 +
scripts/ci/pre_commit/pre_commit_mypy.sh | 3 +-
scripts/ci/pre_commit/pre_commit_pylint.sh | 25 -
.../ci/pre_commit/pre_commit_update_versions.py | 61 +
scripts/ci/pre_commit/pre_commit_yaml_to_cfg.py | 8 +-
.../ci_install_and_test_provider_packages.sh | 2 +-
.../ci_prepare_provider_documentation.sh | 2 +-
scripts/ci/pylint_todo.txt | 5 -
scripts/ci/selective_ci_checks.sh | 52 +-
scripts/ci/static_checks/bats_tests.sh | 7 +-
scripts/ci/static_checks/check_license.sh | 2 +-
scripts/ci/static_checks/eslint.sh | 31 -
.../ci/static_checks/in_container_bats_tests.sh | 4 +-
scripts/ci/static_checks/mypy.sh | 2 +-
scripts/ci/static_checks/pylint.sh | 56 -
scripts/ci/static_checks/refresh_pylint_todo.sh | 33 -
scripts/ci/static_checks/ui_lint.sh | 31 +
scripts/ci/static_checks/www_lint.sh | 31 +
scripts/ci/testing/ci_run_airflow_testing.sh | 45 +-
scripts/ci/testing/ci_run_quarantined_tests.sh | 3 +-
.../ci_run_single_airflow_test_in_docker.sh | 148 +-
scripts/ci/testing/summarize_junit_failures.py | 125 +
scripts/ci/tools/build_dockerhub.sh | 61 +
scripts/ci/tools/ci_clear_tmp.sh | 34 -
scripts/ci/tools/ci_fix_ownership.sh | 40 -
scripts/ci/tools/ci_free_space_on_ci.sh | 32 -
scripts/ci/tools/fix_ownership.sh | 44 +
scripts/ci/tools/free_space.sh | 36 +
scripts/ci/tools/prepare_prod_docker_images.sh | 45 +
scripts/docker/common.sh | 10 +
scripts/docker/compile_www_assets.sh | 9 +-
scripts/docker/install_additional_dependencies.sh | 13 +-
scripts/docker/install_airflow.sh | 8 +-
...install_airflow_dependencies_from_branch_tip.sh | 58 +
scripts/docker/install_airflow_from_branch_tip.sh | 55 -
.../docker/install_from_docker_context_files.sh | 4 +-
scripts/docker/install_mssql.sh | 36 +
scripts/docker/install_mysql.sh | 9 +-
scripts/docker/install_pip_version.sh | 40 +
scripts/in_container/_in_container_utils.sh | 173 +-
scripts/in_container/airflow_ci.cfg | 1 +
scripts/in_container/bin/install_aws.sh | 2 +-
scripts/in_container/bin/install_az.sh | 2 +-
scripts/in_container/bin/install_gcloud.sh | 2 +-
scripts/in_container/bin/install_imgcat.sh | 2 +-
scripts/in_container/bin/install_java.sh | 2 +-
scripts/in_container/bin/install_kubectl.sh | 2 +-
scripts/in_container/bin/install_terraform.sh | 2 +-
scripts/in_container/bin/run_tmux | 6 +
scripts/in_container/check_environment.sh | 5 +-
scripts/in_container/check_junitxml_result.py | 49 +
scripts/in_container/configure_environment.sh | 4 +-
scripts/in_container/entrypoint_ci.sh | 16 +-
.../prod/airflow_scheduler_autorestart.sh | 8 +-
scripts/in_container/prod/clean-logs.sh | 13 +-
scripts/in_container/prod/entrypoint_prod.sh | 109 +-
scripts/in_container/refresh_pylint_todo.sh | 21 -
scripts/in_container/run_ci_tests.sh | 11 +
scripts/in_container/run_clear_tmp.sh | 21 -
scripts/in_container/run_generate_constraints.sh | 49 +-
.../run_install_and_test_provider_packages.sh | 101 +-
scripts/in_container/run_mypy.sh | 2 -
.../in_container/run_prepare_airflow_packages.sh | 26 +-
.../run_prepare_provider_documentation.sh | 59 +-
.../in_container/run_prepare_provider_packages.sh | 28 +-
scripts/in_container/run_pylint.sh | 49 -
scripts/in_container/run_resource_check.sh | 69 +
scripts/in_container/run_tmux_welcome.sh | 2 +-
.../in_container/update_quarantined_test_status.py | 8 +-
scripts/tools/generate-integrations-json.py | 3 -
scripts/tools/list-integrations.py | 14 +-
scripts/upstart/README | 33 -
scripts/upstart/airflow-flower.conf | 34 -
scripts/upstart/airflow-scheduler.conf | 38 -
scripts/upstart/airflow-webserver.conf | 34 -
scripts/upstart/airflow-worker.conf | 34 -
setup.cfg | 63 +-
setup.py | 272 +-
tests/always/test_project_structure.py | 52 +-
tests/api/auth/backend/test_basic_auth.py | 2 +-
tests/api/client/test_local_client.py | 8 +-
tests/api/common/experimental/test_delete_dag.py | 47 +-
tests/api/common/experimental/test_mark_tasks.py | 47 +-
tests/api_connexion/conftest.py | 8 +
.../endpoints/test_connection_endpoint.py | 42 +
tests/api_connexion/endpoints/test_dag_endpoint.py | 193 +-
.../endpoints/test_dag_run_endpoint.py | 273 +-
.../endpoints/test_dag_source_endpoint.py | 119 +-
.../endpoints/test_event_log_endpoint.py | 194 +-
.../endpoints/test_extra_link_endpoint.py | 11 +-
.../endpoints/test_import_error_endpoint.py | 2 +-
tests/api_connexion/endpoints/test_log_endpoint.py | 82 +-
.../endpoints/test_role_and_permission_endpoint.py | 25 +-
.../api_connexion/endpoints/test_task_endpoint.py | 29 +-
.../endpoints/test_task_instance_endpoint.py | 254 +-
.../api_connexion/endpoints/test_user_endpoint.py | 468 ++-
.../api_connexion/endpoints/test_xcom_endpoint.py | 2 +-
.../schemas/test_connection_schema.py | 18 +
tests/api_connexion/schemas/test_dag_run_schema.py | 22 +-
tests/api_connexion/schemas/test_dag_schema.py | 15 +-
tests/api_connexion/schemas/test_error_schema.py | 2 +-
.../api_connexion/schemas/test_event_log_schema.py | 74 +-
.../schemas/test_role_and_permission_schema.py | 2 +-
.../schemas/test_task_instance_schema.py | 62 +-
tests/api_connexion/schemas/test_task_schema.py | 11 +-
tests/api_connexion/schemas/test_user_schema.py | 2 +-
tests/api_connexion/test_basic_auth.py | 2 +-
tests/bats/bats_utils.bash | 2 +
tests/bats/breeze/test_breeze_complete.bats | 24 +-
tests/build_provider_packages_dependencies.py | 24 +-
tests/cli/commands/test_celery_command.py | 237 +-
tests/cli/commands/test_connection_command.py | 66 +-
tests/cli/commands/test_dag_command.py | 60 +-
tests/cli/commands/test_info_command.py | 31 +-
tests/cli/commands/test_kerberos_command.py | 102 +
tests/cli/commands/test_kubernetes_command.py | 8 +-
tests/cli/commands/test_plugins_command.py | 66 +-
tests/cli/commands/test_role_command.py | 28 +-
.../cli/commands/test_rotate_fernet_key_command.py | 113 +
tests/cli/commands/test_scheduler_command.py | 17 +
tests/cli/commands/test_task_command.py | 340 +-
tests/cli/commands/test_triggerer_command.py | 46 +
tests/cli/commands/test_user_command.py | 136 +-
tests/cli/commands/test_webserver_command.py | 59 +-
tests/cli/test_cli_parser.py | 34 +
tests/cluster_policies/__init__.py | 4 +-
tests/conftest.py | 399 +-
tests/core/test_config_templates.py | 2 +
tests/core/test_configuration.py | 117 +-
tests/core/test_core.py | 453 +-
tests/core/test_core_to_contrib.py | 3 +-
tests/core/test_impersonation_tests.py | 4 +-
tests/core/test_logging_config.py | 9 +-
tests/core/test_providers_manager.py | 368 +-
tests/core/test_sentry.py | 103 +-
tests/core/test_settings.py | 10 +-
tests/core/test_sqlalchemy_config.py | 5 +
tests/core/test_templates.py | 56 +
.../zendesk/hooks => dag_processing}/__init__.py | 0
tests/dag_processing/test_manager.py | 903 ++++
tests/dag_processing/test_processor.py | 660 +++
tests/dags/subdir1/test_ignore_this.py | 2 +-
tests/dags/test_clear_subdag.py | 16 +-
tests/dags/test_impersonation_subdag.py | 9 +-
tests/dags/test_mark_success.py | 4 +-
tests/dags/test_on_failure_callback.py | 2 +-
tests/dags/test_subdag.py | 14 +-
tests/dags/test_zip_invalid_cron.zip | Bin 1389 -> 913 bytes
tests/dags_corrupted/README.md | 3 +-
tests/decorators/test_python.py | 75 +-
tests/decorators/test_python_virtualenv.py | 28 +-
tests/deprecated_classes.py | 4 +-
tests/executors/test_base_executor.py | 87 +-
tests/executors/test_celery_executor.py | 147 +-
tests/executors/test_dask_executor.py | 81 +-
tests/executors/test_kubernetes_executor.py | 86 +-
tests/executors/test_local_executor.py | 10 +-
tests/hooks/test_dbapi.py | 52 +-
tests/hooks/test_subprocess.py | 4 +-
tests/jobs/test_backfill_job.py | 477 ++-
tests/jobs/test_base_job.py | 7 +-
tests/jobs/test_local_task_job.py | 820 ++--
tests/jobs/test_scheduler_job.py | 4098 ++++++++-----------
tests/jobs/test_triggerer_job.py | 331 ++
tests/kubernetes/kube_config | 37 +
tests/kubernetes/pod.yaml | 2 +-
tests/kubernetes/test_pod_generator.py | 12 +-
tests/kubernetes/test_refresh_config.py | 73 +-
tests/lineage/test_lineage.py | 40 +-
tests/models/__init__.py | 2 +-
tests/models/test_base.py | 47 +
tests/models/test_baseoperator.py | 392 +-
tests/models/test_cleartasks.py | 244 +-
tests/models/test_connection.py | 41 +-
tests/models/test_dag.py | 605 ++-
tests/models/test_dagbag.py | 115 +-
tests/models/test_dagcode.py | 10 -
tests/models/test_dagparam.py | 120 -
tests/models/test_dagrun.py | 112 +-
tests/models/test_param.py | 259 ++
tests/models/test_pool.py | 92 +-
tests/models/test_renderedtifields.py | 201 +-
tests/models/test_serialized_dag.py | 24 +-
tests/models/test_skipmixin.py | 45 +-
tests/models/test_taskinstance.py | 1749 ++++----
tests/models/test_timestamp.py | 71 +-
tests/models/test_trigger.py | 126 +
tests/models/test_variable.py | 59 +-
tests/models/test_xcom.py | 243 +-
tests/models/test_xcom_arg.py | 63 +-
tests/operators/test_bash.py | 66 +-
tests/operators/test_email.py | 2 +-
tests/operators/test_generic_transfer.py | 47 +
tests/operators/test_latest_only_operator.py | 3 +-
tests/operators/test_python.py | 197 +-
tests/operators/test_sql.py | 1 -
tests/operators/test_subdag_operator.py | 147 +-
tests/operators/test_trigger_dagrun.py | 51 +-
tests/operators/test_weekday.py | 32 +-
tests/plugins/test_plugin.py | 7 +
tests/plugins/test_plugins_manager.py | 32 +-
tests/providers/airbyte/hooks/test_airbyte.py | 33 +-
.../{zendesk/hooks => alibaba}/__init__.py | 0
.../{zendesk/hooks => alibaba/cloud}/__init__.py | 0
.../{zendesk => alibaba/cloud}/hooks/__init__.py | 0
tests/providers/alibaba/cloud/hooks/test_oss.py | 68 +
.../hooks => alibaba/cloud/operators}/__init__.py | 0
.../providers/alibaba/cloud/operators/test_oss.py | 126 +
.../hooks => alibaba/cloud/sensors}/__init__.py | 0
.../alibaba/cloud/sensors/test_oss_key.py | 93 +
.../hooks => alibaba/cloud/utils}/__init__.py | 0
tests/providers/alibaba/cloud/utils/test_utils.py | 41 +
.../aws/config_templates}/__init__.py | 0
tests/providers/amazon/aws/hooks/conftest.py | 1 -
tests/providers/amazon/aws/hooks/test_base_aws.py | 372 +-
.../amazon/aws/hooks/test_batch_client.py | 1 -
.../amazon/aws/hooks/test_batch_waiters.py | 2 -
tests/providers/amazon/aws/hooks/test_datasync.py | 2 +-
tests/providers/amazon/aws/hooks/test_dms_task.py | 211 +
tests/providers/amazon/aws/hooks/test_eks.py | 1324 ++++++
.../amazon/aws/hooks/test_emr_containers.py | 57 +
tests/providers/amazon/aws/hooks/test_glue.py | 6 +-
.../amazon/aws/hooks/test_glue_crawler.py | 5 +-
tests/providers/amazon/aws/hooks/test_kinesis.py | 21 +-
tests/providers/amazon/aws/hooks/test_redshift.py | 70 +-
tests/providers/amazon/aws/hooks/test_s3.py | 52 +-
.../aws/infrastructure}/__init__.py | 0
.../example_s3_to_redshift}/__init__.py | 0
.../amazon/aws/log/test_cloudwatch_task_handler.py | 58 +-
.../amazon/aws/log/test_s3_task_handler.py | 30 +-
.../providers/amazon/aws/operators/test_athena.py | 16 +-
tests/providers/amazon/aws/operators/test_batch.py | 1 -
.../amazon/aws/operators/test_datasync.py | 62 +-
.../amazon/aws/operators/test_dms_create_task.py | 84 +
.../amazon/aws/operators/test_dms_delete_task.py | 55 +
.../aws/operators/test_dms_describe_tasks.py | 97 +
.../amazon/aws/operators/test_dms_start_task.py | 59 +
.../amazon/aws/operators/test_dms_stop_task.py | 55 +
tests/providers/amazon/aws/operators/test_ecs.py | 395 +-
tests/providers/amazon/aws/operators/test_eks.py | 272 ++
.../amazon/aws/operators/test_eks_system.py | 58 +
.../amazon/aws/operators/test_emr_add_steps.py | 61 +-
.../amazon/aws/operators/test_emr_containers.py | 136 +
.../aws/operators/test_emr_create_job_flow.py | 66 +-
.../amazon/aws/operators/test_glacier_system.py | 2 +-
tests/providers/amazon/aws/operators/test_glue.py | 52 +-
.../amazon/aws/operators/test_redshift.py | 44 +
.../amazon/aws/operators/test_s3_delete_objects.py | 4 +-
.../amazon/aws/operators/test_s3_list_prefixes.py | 44 +
.../aws/operators/test_sagemaker_training.py | 52 +-
tests/providers/amazon/aws/operators/test_sqs.py | 9 +-
.../hooks => amazon/aws/secrets}/__init__.py | 0
.../amazon/aws/secrets/test_secrets_manager.py | 56 +-
.../providers/amazon/aws/sensors/test_dms_task.py | 70 +
tests/providers/amazon/aws/sensors/test_eks.py | 184 +
.../amazon/aws/sensors/test_emr_containers.py | 72 +
tests/providers/amazon/aws/sensors/test_s3_key.py | 19 +-
.../amazon/aws/sensors/test_s3_keys_unchanged.py | 13 +-
.../providers/amazon/aws/sensors/test_s3_prefix.py | 50 +-
tests/providers/amazon/aws/sensors/test_sqs.py | 189 +-
.../amazon/aws/transfers/test_dynamodb_to_s3.py | 2 +-
.../amazon/aws/transfers/test_ftp_to_s3.py | 99 +-
.../amazon/aws/transfers/test_local_to_s3.py | 94 +
.../amazon/aws/transfers/test_mongo_to_s3.py | 11 +-
.../amazon/aws/transfers/test_mysql_to_s3.py | 39 +-
.../amazon/aws/transfers/test_redshift_to_s3.py | 90 +-
.../amazon/aws/transfers/test_s3_to_redshift.py | 278 +-
.../amazon/aws/transfers/test_s3_to_sftp.py | 24 +-
.../amazon/aws/transfers/test_salesforce_to_s3.py | 120 +
.../amazon/aws/transfers/test_sftp_to_s3.py | 27 +-
.../amazon/aws/utils/eks_test_constants.py | 246 ++
tests/providers/amazon/aws/utils/eks_test_utils.py | 267 ++
.../amazon/aws/utils/test_eks_get_token.py | 85 +
tests/providers/amazon/aws/utils/test_emailer.py | 42 +-
tests/providers/apache/beam/hooks/test_beam.py | 12 +-
tests/providers/apache/beam/operators/test_beam.py | 1 +
.../apache/cassandra/hooks/test_cassandra.py | 2 +-
.../apache/cassandra/sensors/test_record.py | 10 +
.../apache/cassandra/sensors/test_table.py | 6 +
.../apache/drill}/__init__.py | 0
.../apache/drill/hooks}/__init__.py | 0
tests/providers/apache/drill/hooks/test_drill.py | 84 +
.../apache/drill/operators}/__init__.py | 0
.../providers/apache/drill/operators/test_drill.py | 63 +
tests/providers/apache/druid/hooks/test_druid.py | 6 +-
.../providers/apache/druid/operators/test_druid.py | 99 +-
tests/providers/apache/hdfs/hooks/test_webhdfs.py | 82 +-
tests/providers/apache/hive/hooks/test_hive.py | 48 +-
tests/providers/apache/hive/operators/test_hive.py | 11 +-
.../apache/hive/operators/test_hive_stats.py | 16 +-
.../apache/hive/transfers/test_hive_to_mysql.py | 9 +
.../apache/hive/transfers/test_hive_to_samba.py | 9 +
.../apache/hive/transfers/test_mssql_to_hive.py | 22 +-
.../apache/hive/transfers/test_mysql_to_hive.py | 583 +--
.../apache/hive/transfers/test_s3_to_hive.py | 10 +-
.../apache/kylin/operators/test_kylin_cube.py | 5 +-
tests/providers/apache/livy/hooks/test_livy.py | 33 +-
tests/providers/apache/livy/operators/test_livy.py | 45 +-
tests/providers/apache/pinot/hooks/test_pinot.py | 6 +-
.../providers/apache/spark/hooks/test_spark_sql.py | 25 +-
.../apache/spark/hooks/test_spark_submit.py | 109 +-
.../apache/spark/operators/test_spark_submit.py | 5 +-
tests/providers/apache/sqoop/hooks/test_sqoop.py | 34 +-
.../providers/apache/sqoop/operators/test_sqoop.py | 2 +
.../experimental => providers/asana}/__init__.py | 0
.../asana/hooks}/__init__.py | 0
tests/providers/asana/hooks/test_asana.py | 242 ++
.../asana/operators}/__init__.py | 0
.../providers/asana/operators/test_asana_system.py | 31 +
.../providers/asana/operators/test_asana_tasks.py | 102 +
.../kubernetes/operators/test_kubernetes_pod.py | 200 +-
.../cncf/kubernetes/utils/test_pod_launcher.py | 53 +-
tests/providers/dingding/hooks/test_dingding.py | 2 +-
.../discord/hooks/test_discord_webhook.py | 2 +-
.../hooks => docker/decorators}/__init__.py | 0
tests/providers/docker/decorators/test_docker.py | 108 +
tests/providers/docker/hooks/test_docker.py | 8 +-
tests/providers/docker/operators/test_docker.py | 227 +-
.../docker/operators/test_docker_swarm.py | 66 +-
.../elasticsearch/hooks/test_elasticsearch.py | 4 +-
.../elasticsearch/log/elasticmock/__init__.py | 2 +-
.../log/elasticmock/fake_elasticsearch.py | 32 +-
.../elasticsearch/log/test_es_task_handler.py | 286 +-
tests/providers/exasol/hooks/test_exasol.py | 6 +-
tests/providers/google/ads/hooks/test_ads.py | 14 +-
.../hooks => google/ads/operators}/__init__.py | 0
tests/providers/google/ads/operators/test_ads.py | 8 +-
.../google/ads/transfers/test_ads_to_gcs.py | 8 +-
.../_internal_client/test_secret_manager_client.py | 18 +-
tests/providers/google/cloud/hooks/test_automl.py | 2 +-
.../providers/google/cloud/hooks/test_bigquery.py | 17 +-
.../google/cloud/hooks/test_bigquery_system.py | 4 +
.../google/cloud/hooks/test_cloud_build.py | 382 +-
.../google/cloud/hooks/test_cloud_memorystore.py | 34 +-
.../providers/google/cloud/hooks/test_cloud_sql.py | 63 +-
.../hooks/test_cloud_storage_transfer_service.py | 23 +-
tests/providers/google/cloud/hooks/test_compute.py | 1 -
.../google/cloud/hooks/test_datacatalog.py | 87 +-
.../providers/google/cloud/hooks/test_dataflow.py | 81 +-
.../google/cloud/hooks/test_datafusion.py | 14 +-
.../providers/google/cloud/hooks/test_dataprep.py | 18 +-
.../providers/google/cloud/hooks/test_dataproc.py | 317 +-
.../providers/google/cloud/hooks/test_datastore.py | 20 +-
tests/providers/google/cloud/hooks/test_dlp.py | 42 +-
.../providers/google/cloud/hooks/test_functions.py | 12 +-
tests/providers/google/cloud/hooks/test_gcs.py | 18 +-
tests/providers/google/cloud/hooks/test_gdm.py | 2 +-
tests/providers/google/cloud/hooks/test_kms.py | 6 +-
.../google/cloud/hooks/test_kms_system.py | 6 +
.../google/cloud/hooks/test_kubernetes_engine.py | 4 +-
.../google/cloud/hooks/test_life_sciences.py | 11 +-
.../providers/google/cloud/hooks/test_mlengine.py | 12 +-
.../google/cloud/hooks/test_natural_language.py | 2 +-
tests/providers/google/cloud/hooks/test_pubsub.py | 12 +-
.../google/cloud/hooks/test_secret_manager.py | 1 -
.../cloud/hooks/test_secret_manager_system.py | 6 +
.../google/cloud/hooks/test_stackdriver.py | 10 +-
tests/providers/google/cloud/hooks/test_vision.py | 13 +-
.../providers/google/cloud/hooks/test_workflows.py | 2 +-
.../google/cloud/log/test_gcs_task_handler.py | 75 +-
.../cloud/log/test_gcs_task_handler_system.py | 2 +
.../cloud/log/test_stackdriver_task_handler.py | 165 +-
.../log/test_stackdriver_task_handler_system.py | 11 +-
.../google/cloud/operators/test_automl_system.py | 12 +
.../google/cloud/operators/test_bigquery.py | 152 +-
.../google/cloud/operators/test_bigtable_system.py | 3 +
.../google/cloud/operators/test_cloud_build.py | 406 +-
.../cloud/operators/test_cloud_build_system.py | 6 +-
.../operators/test_cloud_build_system_helper.py | 8 +-
.../google/cloud/operators/test_cloud_sql.py | 19 +-
.../cloud/operators/test_cloud_sql_system.py | 9 +
.../operators/test_cloud_sql_system_helper.py | 44 +-
.../test_cloud_storage_transfer_service.py | 233 +-
.../test_cloud_storage_transfer_service_system.py | 6 +
.../google/cloud/operators/test_compute.py | 79 +-
.../cloud/operators/test_compute_system_helper.py | 4 +-
.../cloud/operators/test_datacatalog_system.py | 6 +
.../google/cloud/operators/test_dataflow.py | 23 +-
.../google/cloud/operators/test_dataflow_system.py | 7 +-
.../google/cloud/operators/test_datafusion.py | 44 +
.../cloud/operators/test_datafusion_system.py | 2 +
.../google/cloud/operators/test_dataprep_system.py | 7 +-
.../google/cloud/operators/test_dataproc.py | 629 +--
.../cloud/operators/test_datastore_system.py | 2 +-
tests/providers/google/cloud/operators/test_dlp.py | 2 +-
.../google/cloud/operators/test_dlp_system.py | 8 +-
.../cloud/operators/test_functions_system.py | 6 +
.../cloud/operators/test_gcs_system_helper.py | 13 +-
.../cloud/operators/test_kubernetes_engine.py | 79 +-
.../operators/test_kubernetes_engine_system.py | 6 +
.../google/cloud/operators/test_mlengine.py | 84 +-
.../google/cloud/operators/test_mlengine_utils.py | 25 +-
.../operators/test_natural_language_system.py | 6 +
.../google/cloud/operators/test_pubsub.py | 2 +-
.../google/cloud/operators/test_pubsub_system.py | 6 +
.../google/cloud/operators/test_spanner.py | 14 +-
.../google/cloud/operators/test_spanner_system.py | 3 +
.../google/cloud/operators/test_speech_to_text.py | 6 +-
.../cloud/operators/test_stackdriver_system.py | 6 +
.../google/cloud/operators/test_tasks_system.py | 6 +
.../cloud/operators/test_translate_system.py | 6 +
.../operators/test_video_intelligence_system.py | 2 +-
.../cloud/operators/test_workflows_system.py | 6 +
.../cloud/secrets/test_secret_manager_system.py | 4 +
.../google/cloud/sensors/test_datafusion.py | 103 +
.../google/cloud/sensors/test_dataproc.py | 55 +-
tests/providers/google/cloud/sensors/test_gcs.py | 12 +-
.../providers/google/cloud/sensors/test_pubsub.py | 2 +-
.../google/cloud/transfers/test_adls_to_gcs.py | 4 +-
.../cloud/transfers/test_azure_fileshare_to_gcs.py | 12 +-
.../test_azure_fileshare_to_gcs_system.py | 12 +-
.../transfers/test_bigquery_to_bigquery_system.py | 6 +
.../cloud/transfers/test_bigquery_to_mssql.py | 51 +
.../cloud/transfers/test_bigquery_to_mysql.py | 15 +-
.../cloud/transfers/test_cassandra_to_gcs.py | 6 +
.../cloud/transfers/test_facebook_ads_to_gcs.py | 11 +-
.../transfers/test_facebook_ads_to_gcs_system.py | 6 +
.../google/cloud/transfers/test_gcs_to_bigquery.py | 75 +-
.../cloud/transfers/test_gcs_to_bigquery_system.py | 6 +
.../google/cloud/transfers/test_gcs_to_gcs.py | 22 +-
.../google/cloud/transfers/test_gcs_to_local.py | 43 +
.../google/cloud/transfers/test_gcs_to_sftp.py | 1 -
.../google/cloud/transfers/test_mssql_to_gcs.py | 2 +-
.../google/cloud/transfers/test_mysql_to_gcs.py | 15 +-
.../google/cloud/transfers/test_oracle_to_gcs.py | 4 +-
.../google/cloud/transfers/test_postgres_to_gcs.py | 2 +-
.../google/cloud/transfers/test_presto_to_gcs.py | 4 +-
.../transfers/test_salesforce_to_gcs_system.py | 6 +
.../google/cloud/transfers/test_sftp_to_gcs.py | 1 -
.../google/cloud/transfers/test_sql_to_gcs.py | 9 +-
.../google/cloud/transfers/test_trino_to_gcs.py | 4 +-
.../google/cloud/utils/gcp_authenticator.py | 10 +-
tests/providers/google/cloud/utils/test_helpers.py | 25 +
.../cloud/utils/test_mlengine_operator_utils.py | 44 +-
.../common/auth_backend/test_google_openid.py | 2 +-
.../google/common/hooks/test_base_google.py | 4 +-
.../leveldb/operators/test_leveldb_system.py | 6 +
.../operators/test_analytics_system.py | 6 +
.../operators/test_display_video.py | 6 +-
.../google/suite/operators/test_sheets_system.py | 6 +
.../google/suite/transfers/test_sql_to_sheets.py | 65 +
tests/providers/grpc/hooks/test_grpc.py | 18 +-
.../_internal_client/test_vault_client.py | 46 +-
tests/providers/hashicorp/hooks/test_vault.py | 44 +-
tests/providers/hashicorp/secrets/test_vault.py | 43 +
tests/providers/http/hooks/test_http.py | 16 +
tests/providers/http/sensors/test_http.py | 70 +-
tests/providers/imap/hooks/test_imap.py | 10 +-
.../{zendesk/hooks => influxdb}/__init__.py | 0
.../{zendesk => influxdb}/hooks/__init__.py | 0
tests/providers/influxdb/hooks/test_influxdb.py | 88 +
tests/providers/jdbc/hooks/test_jdbc.py | 2 +-
.../{zendesk => jenkins}/hooks/__init__.py | 0
tests/providers/jira/hooks/test_jira.py | 2 +-
tests/providers/jira/sensors/test_jira.py | 2 +-
tests/providers/microsoft/azure/hooks/test_adx.py | 30 +-
.../microsoft/azure/hooks/test_azure_batch.py | 23 +-
.../azure/hooks/test_azure_container_volume.py | 33 +-
.../azure/hooks/test_azure_data_factory.py | 61 +-
.../microsoft/azure/hooks/test_azure_fileshare.py | 132 +-
tests/providers/microsoft/azure/hooks/test_wasb.py | 57 +-
.../microsoft/azure/log/test_wasb_task_handler.py | 57 +-
.../microsoft/azure/operators/test_adls_delete.py | 6 +-
.../microsoft/azure/operators/test_adls_list.py | 6 +-
.../microsoft/azure/operators/test_adx.py | 24 +-
.../microsoft/azure/operators/test_azure_batch.py | 25 +-
.../operators/test_azure_container_instances.py | 92 +-
.../azure/operators/test_azure_data_factory.py | 177 +
.../hooks => microsoft/azure/secrets}/__init__.py | 0
.../azure/sensors/test_azure_data_factory.py | 76 +
.../microsoft/azure/transfers/test_file_to_wasb.py | 63 -
.../azure/transfers/test_file_to_wasb_system.py | 48 -
.../azure/transfers/test_local_to_adls.py | 10 +-
.../azure/transfers/test_local_to_wasb.py | 63 +
.../azure/transfers/test_local_to_wasb_system.py | 48 +
.../mssql/operators}/__init__.py | 0
.../microsoft/psrp}/__init__.py | 0
.../microsoft/psrp/hooks}/__init__.py | 0
tests/providers/microsoft/psrp/hooks/test_psrp.py | 71 +
.../microsoft/psrp/operators}/__init__.py | 0
.../microsoft/psrp/operators/test_psrp.py | 55 +
tests/providers/mongo/hooks/test_mongo.py | 20 +-
tests/providers/mongo/sensors/test_mongo.py | 14 +
tests/providers/mysql/hooks/test_mysql.py | 6 +-
tests/providers/mysql/operators/test_mysql.py | 20 +-
tests/providers/neo4j/hooks/test_neo4j.py | 109 +-
tests/providers/neo4j/operators/test_neo4j.py | 31 +-
.../providers/{zendesk/hooks => odbc}/__init__.py | 0
.../providers/{zendesk => odbc}/hooks/__init__.py | 0
tests/providers/odbc/hooks/test_odbc.py | 12 +-
.../opsgenie/hooks/test_opsgenie_alert.py | 2 +-
tests/providers/oracle/hooks/test_oracle.py | 28 +-
tests/providers/oracle/operators/test_oracle.py | 10 +-
tests/providers/pagerduty/hooks/test_pagerduty.py | 107 +-
.../pagerduty/hooks/test_pagerduty_events.py | 54 +
.../papermill/operators/test_papermill.py | 24 +
.../{zendesk => plexus}/hooks/__init__.py | 0
tests/providers/postgres/hooks/test_postgres.py | 31 +-
tests/providers/presto/hooks/test_presto.py | 2 +-
tests/providers/qubole/hooks/test_qubole.py | 43 +-
tests/providers/qubole/operators/test_qubole.py | 101 +-
.../qubole/operators/test_qubole_check.py | 1 -
.../providers/redis/sensors/test_redis_pub_sub.py | 8 +-
.../providers/salesforce/hooks/test_salesforce.py | 242 +-
.../operators/test_salesforce_apex_rest.py | 49 +
tests/providers/samba/hooks/test_samba.py | 188 +-
tests/providers/sftp/hooks/test_sftp.py | 52 +-
tests/providers/sftp/operators/test_sftp.py | 424 +-
tests/providers/slack/hooks/test_slack_webhook.py | 10 +-
tests/providers/slack/operators/test.csv | 1 +
tests/providers/slack/operators/test_slack.py | 44 +-
tests/providers/snowflake/hooks/test_snowflake.py | 238 +-
.../snowflake/operators/test_snowflake.py | 37 +-
.../snowflake/transfers/test_s3_to_snowflake.py | 31 +-
tests/providers/sqlite/hooks/test_sqlite.py | 24 +-
tests/providers/ssh/hooks/test_ssh.py | 315 +-
tests/providers/ssh/operators/test_ssh.py | 238 +-
.../{zendesk/hooks => tableau}/__init__.py | 0
tests/providers/tableau/hooks/test_tableau.py | 219 +-
tests/providers/tableau/operators/test_tableau.py | 165 +
.../operators/test_tableau_refresh_workbook.py | 23 +-
.../tableau/sensors/test_tableau_job_status.py | 13 +-
tests/providers/trino/hooks/test_trino.py | 152 +-
tests/providers/vertica/hooks/test_vertica.py | 2 +-
.../yandex/hooks/test_yandexcloud_dataproc.py | 2 +-
.../yandex/operators/test_yandexcloud_dataproc.py | 31 +-
tests/security/test_kerberos.py | 312 +-
tests/sensors/test_base.py | 272 +-
tests/sensors/test_date_time.py | 13 +-
tests/sensors/test_external_task_sensor.py | 408 +-
tests/sensors/test_filesystem.py | 21 +
tests/sensors/test_python.py | 6 +-
tests/sensors/test_smart_sensor_operator.py | 12 +-
tests/sensors/test_time_sensor.py | 22 +-
tests/sensors/test_timeout_sensor.py | 2 +-
tests/sensors/test_weekday_sensor.py | 21 +-
tests/serialization/test_dag_serialization.py | 491 ++-
tests/task/task_runner/test_base_task_runner.py | 54 +
.../task/task_runner/test_standard_task_runner.py | 56 +-
tests/task/task_runner/test_task_runner.py | 5 +-
tests/test_utils/amazon_system_helpers.py | 5 +-
tests/test_utils/api_connexion_utils.py | 43 +-
tests/test_utils/asserts.py | 2 +-
tests/test_utils/azure_system_helpers.py | 32 +-
tests/test_utils/db.py | 4 +
tests/test_utils/fake_datetime.py | 2 +-
tests/test_utils/gcp_system_helpers.py | 16 +-
tests/test_utils/hdfs_utils.py | 2 +-
tests/test_utils/logging_command_executor.py | 48 +-
tests/test_utils/mock_executor.py | 5 +-
tests/test_utils/mock_operators.py | 12 +-
tests/test_utils/mock_plugins.py | 1 +
tests/test_utils/mock_process.py | 23 +-
tests/test_utils/perf/dags/elastic_dag.py | 5 +-
tests/test_utils/perf/perf_kit/__init__.py | 24 +-
tests/test_utils/perf/perf_kit/memory.py | 2 +-
tests/test_utils/perf/perf_kit/python.py | 2 +-
tests/test_utils/perf/perf_kit/sqlalchemy.py | 38 +-
.../perf/scheduler_dag_execution_timing.py | 37 +-
tests/test_utils/perf/scheduler_ops_metrics.py | 2 +-
tests/test_utils/permissions.py | 29 +-
tests/test_utils/remote_user_api_auth_backend.py | 2 +-
tests/test_utils/reset_warning_registry.py | 6 +-
tests/test_utils/system_tests_class.py | 10 +-
tests/test_utils/timetables.py | 50 +
tests/test_utils/www.py | 2 +-
tests/ti_deps/deps/fake_models.py | 8 +-
.../deps/test_dag_ti_slots_available_dep.py | 4 +-
tests/ti_deps/deps/test_dag_unpaused_dep.py | 2 +-
tests/ti_deps/deps/test_dagrun_exists_dep.py | 5 +-
tests/ti_deps/deps/test_dagrun_id_dep.py | 9 +-
tests/ti_deps/deps/test_not_in_retry_period_dep.py | 2 +-
.../deps/test_not_previously_skipped_dep.py | 177 +-
.../ti_deps/deps/test_pool_slots_available_dep.py | 5 +-
tests/ti_deps/deps/test_prev_dagrun_dep.py | 200 +-
tests/ti_deps/deps/test_ready_to_reschedule_dep.py | 6 +-
tests/ti_deps/deps/test_runnable_exec_date_dep.py | 75 +-
tests/ti_deps/deps/test_task_concurrency.py | 6 +-
tests/ti_deps/deps/test_task_not_running_dep.py | 2 +-
tests/ti_deps/deps/test_trigger_rule_dep.py | 168 +-
tests/ti_deps/deps/test_valid_state_dep.py | 2 +-
.../zendesk/hooks => timetables}/__init__.py | 0
tests/timetables/test_interval_timetable.py | 74 +
tests/timetables/test_workday_timetable.py | 104 +
tests/triggers/test_temporal.py | 92 +
tests/utils/log/test_log_reader.py | 179 +-
tests/utils/log/test_secrets_masker.py | 108 +-
tests/utils/test_dag_cycle.py | 16 +-
tests/utils/test_dag_processing.py | 712 ----
tests/utils/test_db.py | 6 +
tests/utils/test_dot_renderer.py | 87 +-
tests/utils/test_edgemodifier.py | 10 +-
tests/utils/test_email.py | 14 +
tests/utils/test_helpers.py | 106 +-
tests/utils/test_json.py | 8 +
tests/utils/test_log_handlers.py | 70 +-
tests/utils/test_module_loading.py | 2 +-
tests/utils/test_process_utils.py | 4 +-
tests/utils/test_python_virtualenv.py | 11 +-
tests/utils/test_retries.py | 4 +-
tests/utils/test_serve_logs.py | 108 +-
tests/utils/test_state.py | 58 +
tests/utils/test_task_group.py | 71 +-
.../test_task_handler_with_custom_formatter.py | 14 +-
tests/utils/test_trigger_rule.py | 4 +-
tests/utils/test_weekday.py | 44 +
.../www/api/experimental/test_dag_runs_endpoint.py | 4 +-
tests/www/api/experimental/test_endpoints.py | 28 +-
tests/www/test_app.py | 2 +
tests/www/test_security.py | 149 +-
tests/www/test_utils.py | 36 +
tests/www/test_views.py | 2632 ------------
tests/www/views/conftest.py | 19 +-
tests/www/views/test_views.py | 192 +-
tests/www/views/test_views_acl.py | 858 ++++
tests/www/views/test_views_base.py | 390 ++
tests/www/views/test_views_blocked.py | 84 +
tests/www/views/test_views_connection.py | 126 +
tests/www/views/test_views_custom_user_views.py | 199 +
tests/www/views/test_views_dagrun.py | 248 +-
tests/www/views/test_views_decorators.py | 76 +-
tests/www/views/test_views_extra_links.py | 110 +-
tests/www/views/test_views_graph_gantt.py | 206 +
tests/www/views/test_views_home.py | 246 ++
tests/www/views/test_views_log.py | 426 ++
tests/www/views/test_views_pool.py | 72 +-
tests/www/views/test_views_rendered.py | 111 +-
tests/www/views/test_views_robots.py | 21 +
tests/www/views/test_views_task_norun.py | 50 +
tests/www/views/test_views_tasks.py | 813 ++++
tests/www/views/test_views_trigger_dag.py | 68 +-
tests/www/views/test_views_variable.py | 84 +-
2927 files changed, 122443 insertions(+), 50490 deletions(-)
create mode 100644 .gitattributes
create mode 100644 .github/ISSUE_TEMPLATE/airflow_bug_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_doc_issue_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_helmchart_bug_report.yml
create mode 100644 .github/ISSUE_TEMPLATE/airflow_providers_bug_report.yml
delete mode 100644 .github/ISSUE_TEMPLATE/bug_report.md
delete mode 100644 .github/ISSUE_TEMPLATE/feature_request.md
create mode 100644 .github/ISSUE_TEMPLATE/feature_request.yml
create mode 100644 .github/ISSUE_TEMPLATE/~free_form.yml
delete mode 160000 .github/actions/cancel-workflow-runs
delete mode 100644 .github/workflows/build-images-workflow-run.yml
create mode 100644 .github/workflows/build-images.yml
delete mode 100644 .github/workflows/repo_sync.yml
copy scripts/ci/docker-compose/empty/.gitignore => airflow/_vendor/__init__.py (100%)
create mode 100755 airflow/_vendor/connexion/__init__.py
create mode 100644 airflow/_vendor/connexion/__main__.py
create mode 100644 airflow/_vendor/connexion/apis/__init__.py
create mode 100644 airflow/_vendor/connexion/apis/abstract.py
create mode 100644 airflow/_vendor/connexion/apis/aiohttp_api.py
create mode 100644 airflow/_vendor/connexion/apis/flask_api.py
create mode 100644 airflow/_vendor/connexion/apis/flask_utils.py
create mode 100644 airflow/_vendor/connexion/apps/__init__.py
create mode 100644 airflow/_vendor/connexion/apps/abstract.py
create mode 100644 airflow/_vendor/connexion/apps/aiohttp_app.py
create mode 100644 airflow/_vendor/connexion/apps/flask_app.py
create mode 100644 airflow/_vendor/connexion/cli.py
copy scripts/ci/docker-compose/empty/.gitignore => airflow/_vendor/connexion/decorators/__init__.py (100%)
create mode 100644 airflow/_vendor/connexion/decorators/coroutine_wrappers.py
create mode 100644 airflow/_vendor/connexion/decorators/decorator.py
create mode 100644 airflow/_vendor/connexion/decorators/metrics.py
create mode 100644 airflow/_vendor/connexion/decorators/parameter.py
create mode 100644 airflow/_vendor/connexion/decorators/produces.py
create mode 100644 airflow/_vendor/connexion/decorators/response.py
create mode 100644 airflow/_vendor/connexion/decorators/security.py
create mode 100644 airflow/_vendor/connexion/decorators/uri_parsing.py
create mode 100644 airflow/_vendor/connexion/decorators/validation.py
create mode 100644 airflow/_vendor/connexion/exceptions.py
create mode 100644 airflow/_vendor/connexion/handlers.py
create mode 100644 airflow/_vendor/connexion/http_facts.py
create mode 100644 airflow/_vendor/connexion/json_schema.py
create mode 100644 airflow/_vendor/connexion/jsonifier.py
create mode 100644 airflow/_vendor/connexion/lifecycle.py
create mode 100644 airflow/_vendor/connexion/mock.py
create mode 100644 airflow/_vendor/connexion/operations/__init__.py
create mode 100644 airflow/_vendor/connexion/operations/abstract.py
create mode 100644 airflow/_vendor/connexion/operations/compat.py
create mode 100644 airflow/_vendor/connexion/operations/openapi.py
create mode 100644 airflow/_vendor/connexion/operations/secure.py
create mode 100644 airflow/_vendor/connexion/operations/swagger2.py
create mode 100644 airflow/_vendor/connexion/options.py
create mode 100644 airflow/_vendor/connexion/problem.py
create mode 100644 airflow/_vendor/connexion/resolver.py
create mode 100644 airflow/_vendor/connexion/setup.cfg
create mode 100755 airflow/_vendor/connexion/setup.py
create mode 100644 airflow/_vendor/connexion/spec.py
create mode 100644 airflow/_vendor/connexion/utils.py
create mode 100644 airflow/cli/commands/standalone_command.py
create mode 100644 airflow/cli/commands/triggerer_command.py
copy {tests/providers/zendesk/hooks => airflow/compat}/__init__.py (100%)
create mode 100644 airflow/compat/asyncio.py
create mode 100644 airflow/compat/functools.py
create mode 100644 airflow/compat/functools.pyi
copy {tests/providers/zendesk/hooks => airflow/dag_processing}/__init__.py (100%)
create mode 100644 airflow/dag_processing/manager.py
create mode 100644 airflow/dag_processing/processor.py
delete mode 100644 airflow/deprecated_schemas/provider-2.0.0.yaml.schema.json
create mode 100644 airflow/example_dags/example_time_delta_sensor_async.py
copy {tests/providers/zendesk/hooks => airflow/example_dags/plugins}/__init__.py (100%)
create mode 100644 airflow/example_dags/plugins/workday.py
create mode 100644 airflow/jobs/triggerer_job.py
create mode 100644 airflow/migrations/versions/092435bf5d12_add_max_active_runs_column_to_dagmodel_.py
create mode 100644 airflow/migrations/versions/142555e44c17_add_data_interval_start_end_to_dagmodel_and_dagrun.py
create mode 100644 airflow/migrations/versions/30867afad44a_rename_concurrency_column_in_dag_table_.py
create mode 100644 airflow/migrations/versions/54bebd308c5f_add_trigger_table_and_task_info.py
create mode 100644 airflow/migrations/versions/7b2661a43ba3_taskinstance_keyed_to_dagrun.py
create mode 100644 airflow/migrations/versions/83f031fd9f1c_improve_mssql_compatibility.py
delete mode 100644 airflow/migrations/versions/9635ae0956e7_index_faskfail.py
create mode 100644 airflow/migrations/versions/9635ae0956e7_index_taskfail.py
create mode 100644 airflow/migrations/versions/97cdd93827b8_add_queued_at_column_to_dagrun_table.py
create mode 100644 airflow/migrations/versions/ccde3e26fe78_add_index_on_state_dag_id_for_queued_.py
create mode 100644 airflow/migrations/versions/e9304a3141f0_make_xcom_pkey_columns_non_nullable.py
create mode 100644 airflow/models/param.py
create mode 100644 airflow/models/trigger.py
create mode 100644 airflow/providers/airbyte/.latest-doc-only-change.txt
create mode 100644 airflow/providers/alibaba/.latest-doc-only-change.txt
copy airflow/providers/{trino => alibaba}/CHANGELOG.rst (100%)
copy {tests/www/api/experimental => airflow/providers/alibaba}/__init__.py (100%)
copy {tests/www/api/experimental => airflow/providers/alibaba/cloud}/__init__.py (100%)
copy {tests/www/api/experimental => airflow/providers/alibaba/cloud/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/alibaba/cloud/example_dags/example_oss_bucket.py
create mode 100644 airflow/providers/alibaba/cloud/example_dags/example_oss_object.py
copy {tests/www/api/experimental => airflow/providers/alibaba/cloud/hooks}/__init__.py (100%)
create mode 100644 airflow/providers/alibaba/cloud/hooks/oss.py
copy {tests/providers/zendesk/hooks => airflow/providers/alibaba/cloud/operators}/__init__.py (100%)
create mode 100644 airflow/providers/alibaba/cloud/operators/oss.py
copy {tests/providers/zendesk/hooks => airflow/providers/alibaba/cloud/sensors}/__init__.py (100%)
create mode 100644 airflow/providers/alibaba/cloud/sensors/oss_key.py
create mode 100644 airflow/providers/alibaba/provider.yaml
create mode 100644 airflow/providers/amazon/aws/example_dags/example_athena.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_dms_full_load_task.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_templated.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_with_fargate_in_one_step.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_with_fargate_profile.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_with_nodegroup_in_one_step.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_eks_with_nodegroups.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_emr_eks_job.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_local_to_s3.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_redshift.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_s3_to_sftp.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_salesforce_to_s3.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_sftp_to_s3.py
create mode 100644 airflow/providers/amazon/aws/example_dags/example_sqs.py
create mode 100644 airflow/providers/amazon/aws/hooks/dms.py
create mode 100644 airflow/providers/amazon/aws/hooks/eks.py
create mode 100644 airflow/providers/amazon/aws/hooks/emr_containers.py
create mode 100644 airflow/providers/amazon/aws/operators/dms_create_task.py
create mode 100644 airflow/providers/amazon/aws/operators/dms_delete_task.py
create mode 100644 airflow/providers/amazon/aws/operators/dms_describe_tasks.py
create mode 100644 airflow/providers/amazon/aws/operators/dms_start_task.py
create mode 100644 airflow/providers/amazon/aws/operators/dms_stop_task.py
create mode 100644 airflow/providers/amazon/aws/operators/eks.py
create mode 100644 airflow/providers/amazon/aws/operators/emr_containers.py
create mode 100644 airflow/providers/amazon/aws/operators/redshift.py
create mode 100644 airflow/providers/amazon/aws/operators/s3_list_prefixes.py
create mode 100644 airflow/providers/amazon/aws/sensors/dms_task.py
create mode 100644 airflow/providers/amazon/aws/sensors/eks.py
create mode 100644 airflow/providers/amazon/aws/sensors/emr_containers.py
create mode 100644 airflow/providers/amazon/aws/transfers/local_to_s3.py
create mode 100644 airflow/providers/amazon/aws/transfers/salesforce_to_s3.py
create mode 100644 airflow/providers/amazon/aws/utils/eks_get_token.py
create mode 100644 airflow/providers/apache/drill/CHANGELOG.rst
copy {tests/www/api/experimental => airflow/providers/apache/drill}/__init__.py (100%)
copy {tests/providers/zendesk/hooks => airflow/providers/apache/drill/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/apache/drill/example_dags/example_drill_dag.py
copy {tests/www/api/experimental => airflow/providers/apache/drill/hooks}/__init__.py (100%)
create mode 100644 airflow/providers/apache/drill/hooks/drill.py
copy {tests/www/api/experimental => airflow/providers/apache/drill/operators}/__init__.py (100%)
create mode 100644 airflow/providers/apache/drill/operators/drill.py
create mode 100644 airflow/providers/apache/drill/provider.yaml
copy {tests/www/api/experimental => airflow/providers/apache/druid/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/apache/druid/example_dags/example_druid_dag.py
create mode 100644 airflow/providers/apache/livy/.latest-doc-only-change.txt
create mode 100644 airflow/providers/apache/spark/.latest-doc-only-change.txt
create mode 100644 airflow/providers/asana/.latest-doc-only-change.txt
create mode 100644 airflow/providers/asana/CHANGELOG.rst
copy airflow/providers/{neo4j => asana}/README.md (100%)
copy {tests/www/api/experimental => airflow/providers/asana}/__init__.py (100%)
copy {tests/www/api/experimental => airflow/providers/asana/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/asana/example_dags/example_asana.py
copy {tests/www/api/experimental => airflow/providers/asana/hooks}/__init__.py (100%)
create mode 100644 airflow/providers/asana/hooks/asana.py
copy {tests/www/api/experimental => airflow/providers/asana/operators}/__init__.py (100%)
create mode 100644 airflow/providers/asana/operators/asana_tasks.py
create mode 100644 airflow/providers/asana/provider.yaml
copy {tests/www/api/experimental => airflow/providers/docker/decorators}/__init__.py (100%)
create mode 100644 airflow/providers/docker/decorators/docker.py
create mode 100644 airflow/providers/docker/example_dags/tutorial_taskflow_api_etl_docker_virtualenv.py
create mode 100644 airflow/providers/elasticsearch/.latest-doc-only-change.txt
copy {tests/providers/zendesk/hooks => airflow/providers/elasticsearch/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/elasticsearch/example_dags/example_elasticsearch_query.py
create mode 100644 airflow/providers/ftp/.latest-doc-only-change.txt
create mode 100644 airflow/providers/google/cloud/example_dags/example_bigquery_to_mssql.py
create mode 100644 airflow/providers/google/cloud/sensors/datafusion.py
create mode 100644 airflow/providers/google/cloud/transfers/bigquery_to_mssql.py
create mode 100644 airflow/providers/google/cloud/utils/helpers.py
copy {tests/providers/zendesk/hooks => airflow/providers/google/config_templates}/__init__.py (100%)
create mode 100644 airflow/providers/google/suite/example_dags/example_sql_to_sheets.py
create mode 100644 airflow/providers/google/suite/transfers/sql_to_sheets.py
create mode 100644 airflow/providers/grpc/.latest-doc-only-change.txt
create mode 100644 airflow/providers/hashicorp/.latest-doc-only-change.txt
create mode 100644 airflow/providers/influxdb/.latest-doc-only-change.txt
create mode 100644 airflow/providers/influxdb/CHANGELOG.rst
copy {tests/providers/zendesk/hooks => airflow/providers/influxdb}/__init__.py (100%)
copy {tests/providers/zendesk/hooks => airflow/providers/influxdb/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/influxdb/example_dags/example_influxdb.py
copy {tests/providers/zendesk => airflow/providers/influxdb}/hooks/__init__.py (100%)
create mode 100644 airflow/providers/influxdb/hooks/influxdb.py
create mode 100644 airflow/providers/influxdb/provider.yaml
create mode 100644 airflow/providers/jira/.latest-doc-only-change.txt
create mode 100644 airflow/providers/microsoft/azure/example_dags/example_adf_run_pipeline.py
delete mode 100644 airflow/providers/microsoft/azure/example_dags/example_file_to_wasb.py
create mode 100644 airflow/providers/microsoft/azure/example_dags/example_local_to_wasb.py
create mode 100644 airflow/providers/microsoft/azure/hooks/data_factory.py
create mode 100644 airflow/providers/microsoft/azure/operators/adls.py
create mode 100644 airflow/providers/microsoft/azure/operators/data_factory.py
create mode 100644 airflow/providers/microsoft/azure/sensors/data_factory.py
create mode 100644 airflow/providers/microsoft/azure/transfers/local_to_wasb.py
create mode 100644 airflow/providers/microsoft/psrp/CHANGELOG.rst
copy {tests/www/api/experimental => airflow/providers/microsoft/psrp}/__init__.py (100%)
copy {tests/www/api/experimental => airflow/providers/microsoft/psrp/hooks}/__init__.py (100%)
create mode 100644 airflow/providers/microsoft/psrp/hooks/psrp.py
copy {tests/www/api/experimental => airflow/providers/microsoft/psrp/operators}/__init__.py (100%)
create mode 100644 airflow/providers/microsoft/psrp/operators/psrp.py
create mode 100644 airflow/providers/microsoft/psrp/provider.yaml
create mode 100644 airflow/providers/microsoft/winrm/.latest-doc-only-change.txt
create mode 100644 airflow/providers/opsgenie/.latest-doc-only-change.txt
create mode 100644 airflow/providers/pagerduty/hooks/pagerduty_events.py
create mode 100644 airflow/providers/postgres/.latest-doc-only-change.txt
create mode 100644 airflow/providers/salesforce/.latest-doc-only-change.txt
create mode 100644 airflow/providers/salesforce/example_dags/example_salesforce_apex_rest.py
create mode 100644 airflow/providers/salesforce/operators/salesforce_apex_rest.py
create mode 100644 airflow/providers/singularity/.latest-doc-only-change.txt
copy {tests/providers/zendesk/hooks => airflow/providers/slack/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/slack/example_dags/example_slack.py
create mode 100644 airflow/providers/sqlite/example_dags/create_table.sql
create mode 100644 airflow/providers/tableau/example_dags/example_tableau.py
create mode 100644 airflow/providers/tableau/operators/tableau.py
create mode 100644 airflow/providers/trino/.latest-doc-only-change.txt
create mode 100644 airflow/templates.py
copy {tests/providers/zendesk/hooks => airflow/timetables}/__init__.py (100%)
create mode 100644 airflow/timetables/base.py
create mode 100644 airflow/timetables/interval.py
create mode 100644 airflow/timetables/simple.py
copy {tests/providers/zendesk/hooks => airflow/triggers}/__init__.py (100%)
create mode 100644 airflow/triggers/base.py
create mode 100644 airflow/triggers/temporal.py
create mode 100644 airflow/triggers/testing.py
create mode 100644 airflow/ui/src/components/Table.tsx
create mode 100644 airflow/ui/src/interfaces/react-table-config.d.ts
create mode 100644 airflow/ui/src/providers/DateProvider.tsx
delete mode 100644 airflow/ui/src/providers/TimezoneProvider.tsx
delete mode 100644 airflow/utils/dag_processing.py
create mode 100644 airflow/utils/log/non_caching_file_handler.py
create mode 100644 airflow/www/extensions/init_robots.py
copy {tests/providers/zendesk/hooks => airflow/www/fab_security}/__init__.py (100%)
create mode 100644 airflow/www/fab_security/manager.py
copy {tests/providers/zendesk/hooks => airflow/www/fab_security/sqla}/__init__.py (100%)
create mode 100644 airflow/www/fab_security/sqla/manager.py
create mode 100644 airflow/www/fab_security/sqla/models.py
delete mode 100644 airflow/www/static/js/circles.js
create mode 100644 airflow/www/static/js/dag.js
create mode 100644 airflow/www/static/js/task.js
delete mode 100644 airflow/www/static/js/task_instance.js
create mode 100644 airflow/www/static/robots.txt
create mode 100644 airflow/www/templates/airflow/_messages.html
delete mode 100644 airflow/www/templates/airflow/circles.html
create mode 100644 airflow/www/templates/airflow/no_roles_permissions.html
create mode 100644 airflow/www/templates/airflow/not_found.html
create mode 100644 airflow/www/templates/airflow/providers.html
create mode 100644 chart/CHANGELOG.txt
create mode 100644 chart/Chart.lock
create mode 100644 chart/INSTALL
copy {provider_packages => chart}/LICENSE (100%)
create mode 100644 chart/NOTICE
create mode 100644 chart/UPDATING.rst
delete mode 100644 chart/requirements.lock
delete mode 100644 chart/requirements.yaml
create mode 100644 chart/templates/rbac/security-context-constraint-rolebinding.yaml
create mode 100644 chart/templates/secrets/webserver-secret-key-secret.yaml
create mode 100644 chart/templates/triggerer/triggerer-deployment.yaml
create mode 100644 chart/templates/triggerer/triggerer-serviceaccount.yaml
create mode 100644 chart/tests/test_airflow_common.py
create mode 100644 chart/tests/test_configmap.py
create mode 100644 chart/tests/test_elasticsearch_secret.py
create mode 100644 chart/tests/test_pdb_pgbouncer.py
create mode 100644 chart/tests/test_pdb_scheduler.py
create mode 100644 chart/tests/test_scc_rolebinding.py
create mode 100644 chart/tests/test_triggerer.py
create mode 100644 chart/tests/test_webserver.py
delete mode 100644 chart/tests/test_webserver_deployment.py
create mode 100644 chart/values_schema.schema.json
delete mode 100644 dags/test_dag.py
create mode 100644 dev/README_RELEASE_HELM_CHART.md
create mode 100644 dev/REFRESHING_CI_CACHE.md
create mode 100644 dev/provider_packages/CHANGELOG_TEMPLATE.rst.jinja2
create mode 100644 dev/provider_packages/PROVIDER_ISSUE_TEMPLATE.md.jinja2
create mode 100644 dev/provider_packages/UPDATE_CHANGELOG_TEMPLATE.rst.jinja2
create mode 100755 dev/refresh_images.sh
create mode 100755 dev/retag_docker_images.py
create mode 100755 dev/validate_version_added_fields_in_config.py
create mode 100644 docs/apache-airflow-providers-airbyte/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-alibaba/commits.rst
create mode 100644 docs/apache-airflow-providers-alibaba/connections/alibaba.rst
create mode 100644 docs/apache-airflow-providers-alibaba/index.rst
create mode 100644 docs/apache-airflow-providers-alibaba/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-alibaba/operators/index.rst
create mode 100644 docs/apache-airflow-providers-alibaba/operators/oss.rst
create mode 100644 docs/apache-airflow-providers-alibaba/redirects.txt
create mode 100644 docs/apache-airflow-providers-amazon/connections/index.rst
create mode 100644 docs/apache-airflow-providers-amazon/connections/redshift.rst
create mode 100644 docs/apache-airflow-providers-amazon/img/aws-secrets-manager.png
create mode 100644 docs/apache-airflow-providers-amazon/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/athena.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/dms.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/eks.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/emr_eks.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/redshift.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/salesforce_to_s3.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/sqs_publish.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/transfer/s3_to_sftp.rst
create mode 100644 docs/apache-airflow-providers-amazon/operators/transfer/sftp_to_s3.rst
create mode 100644 docs/apache-airflow-providers-apache-beam/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-cassandra/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-drill/commits.rst
create mode 100644 docs/apache-airflow-providers-apache-drill/connections/drill.rst
create mode 100644 docs/apache-airflow-providers-apache-drill/index.rst
create mode 100644 docs/apache-airflow-providers-apache-drill/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-drill/operators.rst
create mode 100644 docs/apache-airflow-providers-apache-druid/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-druid/operators.rst
create mode 100644 docs/apache-airflow-providers-apache-hdfs/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-hive/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-kylin/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-livy/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-pig/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-pinot/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-spark/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-apache-sqoop/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-asana/commits.rst
create mode 100644 docs/apache-airflow-providers-asana/connections/asana.rst
create mode 100644 docs/apache-airflow-providers-asana/index.rst
create mode 100644 docs/apache-airflow-providers-asana/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-asana/operators/asana.rst
create mode 100644 docs/apache-airflow-providers-celery/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-cloudant/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-cncf-kubernetes/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-databricks/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-datadog/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-dingding/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-discord/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-docker/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-elasticsearch/connections/elasticsearch.rst
create mode 100644 docs/apache-airflow-providers-elasticsearch/installing-providers-from-sources.rst
delete mode 100644 docs/apache-airflow-providers-elasticsearch/logging.rst
create mode 100644 docs/apache-airflow-providers-elasticsearch/logging/index.rst
create mode 100644 docs/apache-airflow-providers-elasticsearch/redirects.txt
create mode 100644 docs/apache-airflow-providers-exasol/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-facebook/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-ftp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-google/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-google/operators/transfer/sql_to_sheets.rst
create mode 100644 docs/apache-airflow-providers-grpc/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-hashicorp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-http/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-imap/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-influxdb/commits.rst
create mode 100644 docs/apache-airflow-providers-influxdb/connections/influxdb.rst
create mode 100644 docs/apache-airflow-providers-influxdb/index.rst
create mode 100644 docs/apache-airflow-providers-influxdb/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-jdbc/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-jenkins/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-jira/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-microsoft-azure/connections/azure_container_volume.rst
create mode 100644 docs/apache-airflow-providers-microsoft-azure/connections/azure_fileshare.rst
create mode 100644 docs/apache-airflow-providers-microsoft-azure/installing-providers-from-sources.rst
delete mode 100644 docs/apache-airflow-providers-microsoft-azure/logging.rst
create mode 100644 docs/apache-airflow-providers-microsoft-azure/logging/index.rst
create mode 100644 docs/apache-airflow-providers-microsoft-azure/operators/adf_run_pipeline.rst
create mode 100644 docs/apache-airflow-providers-microsoft-mssql/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-microsoft-psrp/commits.rst
create mode 100644 docs/apache-airflow-providers-microsoft-psrp/index.rst
create mode 100644 docs/apache-airflow-providers-microsoft-psrp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-microsoft-winrm/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-mongo/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-mysql/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-neo4j/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-odbc/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-openfaas/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-opsgenie/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-oracle/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-pagerduty/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-papermill/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-plexus/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-postgres/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-presto/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-qubole/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-redis/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-salesforce/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-salesforce/operators/index.rst
create mode 100644 docs/apache-airflow-providers-salesforce/operators/salesforce_apex_rest.rst
create mode 100644 docs/apache-airflow-providers-samba/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-segment/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-sendgrid/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-sftp/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-singularity/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-slack/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-slack/operators/slack_operator_howto_guide.rst
create mode 100644 docs/apache-airflow-providers-snowflake/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-sqlite/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-ssh/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-tableau/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-tableau/operators.rst
create mode 100644 docs/apache-airflow-providers-telegram/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-trino/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-vertica/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-yandex/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers-zendesk/installing-providers-from-sources.rst
create mode 100644 docs/apache-airflow-providers/core-extensions/auth-backends.rst
create mode 100644 docs/apache-airflow-providers/core-extensions/connections.rst
create mode 100644 docs/apache-airflow-providers/core-extensions/extra-links.rst
create mode 100644 docs/apache-airflow-providers/core-extensions/index.rst
create mode 100644 docs/apache-airflow-providers/core-extensions/logging.rst
create mode 100644 docs/apache-airflow-providers/core-extensions/secrets-backends.rst
create mode 100644 docs/apache-airflow-providers/installing-from-pypi.rst
create mode 100644 docs/apache-airflow-providers/installing-from-sources.rst
delete mode 100644 docs/apache-airflow/backport-providers.rst
create mode 100644 docs/apache-airflow/concepts/deferring.rst
create mode 100644 docs/apache-airflow/concepts/params.rst
create mode 100644 docs/apache-airflow/concepts/priority-weight.rst
create mode 100644 docs/apache-airflow/concepts/timetable.rst
create mode 100644 docs/apache-airflow/howto/create-custom-decorator.rst
delete mode 100644 docs/apache-airflow/howto/customize-dag-ui-page-instance-name.rst
delete mode 100644 docs/apache-airflow/howto/customize-state-colors-ui.rst
create mode 100644 docs/apache-airflow/howto/customize-ui.rst
delete mode 100644 docs/apache-airflow/howto/run-with-upstart.rst
create mode 100644 docs/apache-airflow/howto/timetable.rst
create mode 100644 docs/apache-airflow/img/calendar.png
create mode 100644 docs/apache-airflow/img/dag_doc.png
create mode 100644 docs/apache-airflow/img/new_tutorial-1.png
create mode 100644 docs/apache-airflow/img/new_tutorial-2.png
create mode 100644 docs/apache-airflow/img/task_doc.png
create mode 100644 docs/apache-airflow/img/template_field_renderer_path.png
create mode 100644 docs/apache-airflow/img/ui-alert-message.png
delete mode 100644 docs/apache-airflow/installation.rst
create mode 100644 docs/apache-airflow/installation/dependencies.rst
create mode 100644 docs/apache-airflow/installation/index.rst
create mode 100644 docs/apache-airflow/installation/installing-from-pypi.rst
create mode 100644 docs/apache-airflow/installation/installing-from-sources.rst
create mode 100644 docs/apache-airflow/installation/prerequisites.rst
create mode 100644 docs/apache-airflow/installation/setting-up-the-database.rst
create mode 100644 docs/apache-airflow/installation/supported-versions.rst
create mode 100644 docs/apache-airflow/logging-monitoring/callbacks.rst
delete mode 100644 docs/apache-airflow/macros-ref.rst
create mode 100644 docs/apache-airflow/migrations-ref.rst
create mode 100644 docs/apache-airflow/pipeline_example.csv
create mode 100644 docs/apache-airflow/security/secrets/mask-sensitive-values.rst
copy docs/apache-airflow/static/{jira-links.js => gh-jira-links.js} (100%)
create mode 100644 docs/apache-airflow/templates-ref.rst
delete mode 100644 docs/apache-airflow/upgrade-check.rst
create mode 100644 docs/apache-airflow/upgrading-from-1-10/index.rst
create mode 100644 docs/apache-airflow/upgrading-from-1-10/upgrade-check.rst
delete mode 100644 docs/apache-airflow/upgrading-to-2.rst
create mode 100755 docs/docker-stack/docker-examples/customizing/github-main.sh
delete mode 100755 docs/docker-stack/docker-examples/customizing/github-master.sh
delete mode 100755 docs/docker-stack/docker-examples/customizing/github-v2-0-test.sh
create mode 100755 docs/docker-stack/docker-examples/customizing/github-v2-1-test.sh
create mode 100644 docs/docker-stack/docker-examples/extending/add-providers/Dockerfile
create mode 100644 docs/exts/auth_backend.rst.jinja2
create mode 100644 docs/exts/connections.rst.jinja2
create mode 100644 docs/exts/docs_build/helm_chart_utils.py
create mode 100644 docs/exts/extra_links.rst.jinja2
create mode 100644 docs/exts/logging.rst.jinja2
create mode 100644 docs/exts/secret_backend.rst.jinja2
create mode 100644 docs/helm-chart/adding-connections-and-variables.rst
create mode 100644 docs/helm-chart/changelog.rst
delete mode 100644 docs/helm-chart/external-redis.rst
create mode 100644 docs/helm-chart/installing-helm-chart-from-sources.rst
create mode 100644 docs/helm-chart/production-guide.rst
create mode 100644 docs/helm-chart/setting-resources-for-containers.rst
rename docs/{apache-airflow/static/jira-links.js => helm-chart/static/gh-jira-links.js} (100%)
create mode 100644 docs/helm-chart/updating.rst
create mode 100644 docs/installing-providers-from-sources.rst
create mode 100644 docs/integration-logos/alibaba/cloud/alibabacloud-oss.png
create mode 100644 docs/integration-logos/apache/drill.png
create mode 100644 docs/integration-logos/aws/AWS-Database-Migration-Service_64@5x.png
create mode 100644 docs/integration-logos/aws/Amazon-Elastic-Kubernetes-Service_light-bg@4x.png
rename docs/integration-logos/{postgress/Postgress.png => postgres/Postgres.png} (100%)
delete mode 100755 hooks/build
delete mode 100755 hooks/push
delete mode 100644 images/CI.png
delete mode 100644 images/ci/CI.png
create mode 100644 images/quick_start/vscode_add_configuration_1.png
create mode 100644 images/quick_start/vscode_add_configuration_2.png
create mode 100644 images/quick_start/vscode_add_configuration_3.png
create mode 100644 images/quick_start/vscode_add_env_variable.png
create mode 100644 images/quick_start/vscode_click_on_clone.png
create mode 100644 images/quick_start/vscode_clone.png
create mode 100644 images/quick_start/vscode_creating_branch_1.png
create mode 100644 images/quick_start/vscode_creating_branch_2.png
create mode 100755 images/vscode_add_pytest_settings.png
create mode 100755 images/vscode_configure_python_tests.png
create mode 100755 images/vscode_install_python_extension.png
create mode 100755 images/vscode_run_tests.png
create mode 100755 images/vscode_select_pytest_framework.png
create mode 100644 kubernetes_tests/test_base.py
create mode 100644 kubernetes_tests/test_other_executors.py
create mode 100644 licenses/LICENSE-connexion.txt
delete mode 100644 licenses/LICENSE-python-nvd3.txt
delete mode 100644 licenses/LICENSE-python-slugify.txt
delete mode 100644 pylintrc
delete mode 100644 pylintrc-tests
create mode 100644 scripts/ci/docker-compose/backend-mssql-bind-volume.yml
create mode 100644 scripts/ci/docker-compose/backend-mssql-docker-volume.yml
create mode 100644 scripts/ci/docker-compose/backend-mssql-port.yml
create mode 100644 scripts/ci/docker-compose/backend-mssql.yml
delete mode 100644 scripts/ci/docker-compose/local-prod.yml
create mode 100644 scripts/ci/docker-compose/mssql_create_airflow_db.sql
delete mode 100755 scripts/ci/images/ci_build_dockerhub.sh
create mode 100755 scripts/ci/kubernetes/ci_run_helm_upgrade.sh
create mode 100755 scripts/ci/kubernetes/ci_upgrade_cluster_with_different_executors_in_parallel.sh
create mode 100755 scripts/ci/kubernetes/ci_upgrade_cluster_with_different_executors_single_job.sh
delete mode 100644 scripts/ci/libraries/_pylint.sh
create mode 100755 scripts/ci/pre_commit/pre_commit_boring_cyborg.py
create mode 100755 scripts/ci/pre_commit/pre_commit_check_order_dockerfile_extras.py
create mode 100755 scripts/ci/pre_commit/pre_commit_check_providers_subpackages_all_have_init.py
create mode 100755 scripts/ci/pre_commit/pre_commit_migration_documented.py
delete mode 100755 scripts/ci/pre_commit/pre_commit_pylint.sh
create mode 100755 scripts/ci/pre_commit/pre_commit_update_versions.py
delete mode 100644 scripts/ci/pylint_todo.txt
delete mode 100755 scripts/ci/static_checks/eslint.sh
delete mode 100755 scripts/ci/static_checks/pylint.sh
delete mode 100755 scripts/ci/static_checks/refresh_pylint_todo.sh
create mode 100755 scripts/ci/static_checks/ui_lint.sh
create mode 100755 scripts/ci/static_checks/www_lint.sh
create mode 100755 scripts/ci/testing/summarize_junit_failures.py
create mode 100755 scripts/ci/tools/build_dockerhub.sh
delete mode 100755 scripts/ci/tools/ci_clear_tmp.sh
delete mode 100755 scripts/ci/tools/ci_fix_ownership.sh
delete mode 100755 scripts/ci/tools/ci_free_space_on_ci.sh
create mode 100755 scripts/ci/tools/fix_ownership.sh
create mode 100755 scripts/ci/tools/free_space.sh
create mode 100755 scripts/ci/tools/prepare_prod_docker_images.sh
create mode 100755 scripts/docker/install_airflow_dependencies_from_branch_tip.sh
delete mode 100755 scripts/docker/install_airflow_from_branch_tip.sh
create mode 100755 scripts/docker/install_mssql.sh
create mode 100755 scripts/docker/install_pip_version.sh
create mode 100755 scripts/in_container/check_junitxml_result.py
delete mode 100755 scripts/in_container/refresh_pylint_todo.sh
delete mode 100755 scripts/in_container/run_clear_tmp.sh
delete mode 100755 scripts/in_container/run_pylint.sh
create mode 100755 scripts/in_container/run_resource_check.sh
delete mode 100644 scripts/upstart/README
delete mode 100644 scripts/upstart/airflow-flower.conf
delete mode 100644 scripts/upstart/airflow-scheduler.conf
delete mode 100644 scripts/upstart/airflow-webserver.conf
delete mode 100644 scripts/upstart/airflow-worker.conf
create mode 100644 tests/cli/commands/test_kerberos_command.py
create mode 100644 tests/cli/commands/test_rotate_fernet_key_command.py
create mode 100644 tests/cli/commands/test_triggerer_command.py
create mode 100644 tests/core/test_templates.py
copy tests/{providers/zendesk/hooks => dag_processing}/__init__.py (100%)
create mode 100644 tests/dag_processing/test_manager.py
create mode 100644 tests/dag_processing/test_processor.py
create mode 100644 tests/jobs/test_triggerer_job.py
create mode 100644 tests/kubernetes/kube_config
create mode 100644 tests/models/test_base.py
delete mode 100644 tests/models/test_dagparam.py
create mode 100644 tests/models/test_param.py
create mode 100644 tests/models/test_trigger.py
copy tests/providers/{zendesk/hooks => alibaba}/__init__.py (100%)
copy tests/providers/{zendesk/hooks => alibaba/cloud}/__init__.py (100%)
copy tests/providers/{zendesk => alibaba/cloud}/hooks/__init__.py (100%)
create mode 100644 tests/providers/alibaba/cloud/hooks/test_oss.py
copy tests/providers/{zendesk/hooks => alibaba/cloud/operators}/__init__.py (100%)
create mode 100644 tests/providers/alibaba/cloud/operators/test_oss.py
copy tests/providers/{zendesk/hooks => alibaba/cloud/sensors}/__init__.py (100%)
create mode 100644 tests/providers/alibaba/cloud/sensors/test_oss_key.py
copy tests/providers/{zendesk/hooks => alibaba/cloud/utils}/__init__.py (100%)
create mode 100644 tests/providers/alibaba/cloud/utils/test_utils.py
copy tests/providers/{zendesk/hooks => amazon/aws/config_templates}/__init__.py (100%)
create mode 100644 tests/providers/amazon/aws/hooks/test_dms_task.py
create mode 100644 tests/providers/amazon/aws/hooks/test_eks.py
create mode 100644 tests/providers/amazon/aws/hooks/test_emr_containers.py
copy tests/providers/{zendesk/hooks => amazon/aws/infrastructure}/__init__.py (100%)
copy tests/providers/{zendesk/hooks => amazon/aws/infrastructure/example_s3_to_redshift}/__init__.py (100%)
create mode 100644 tests/providers/amazon/aws/operators/test_dms_create_task.py
create mode 100644 tests/providers/amazon/aws/operators/test_dms_delete_task.py
create mode 100644 tests/providers/amazon/aws/operators/test_dms_describe_tasks.py
create mode 100644 tests/providers/amazon/aws/operators/test_dms_start_task.py
create mode 100644 tests/providers/amazon/aws/operators/test_dms_stop_task.py
create mode 100644 tests/providers/amazon/aws/operators/test_eks.py
create mode 100644 tests/providers/amazon/aws/operators/test_eks_system.py
create mode 100644 tests/providers/amazon/aws/operators/test_emr_containers.py
create mode 100644 tests/providers/amazon/aws/operators/test_redshift.py
create mode 100644 tests/providers/amazon/aws/operators/test_s3_list_prefixes.py
copy tests/providers/{zendesk/hooks => amazon/aws/secrets}/__init__.py (100%)
create mode 100644 tests/providers/amazon/aws/sensors/test_dms_task.py
create mode 100644 tests/providers/amazon/aws/sensors/test_eks.py
create mode 100644 tests/providers/amazon/aws/sensors/test_emr_containers.py
create mode 100644 tests/providers/amazon/aws/transfers/test_local_to_s3.py
create mode 100644 tests/providers/amazon/aws/transfers/test_salesforce_to_s3.py
create mode 100644 tests/providers/amazon/aws/utils/eks_test_constants.py
create mode 100644 tests/providers/amazon/aws/utils/eks_test_utils.py
create mode 100644 tests/providers/amazon/aws/utils/test_eks_get_token.py
copy tests/{www/api/experimental => providers/apache/drill}/__init__.py (100%)
copy tests/{www/api/experimental => providers/apache/drill/hooks}/__init__.py (100%)
create mode 100644 tests/providers/apache/drill/hooks/test_drill.py
copy tests/{www/api/experimental => providers/apache/drill/operators}/__init__.py (100%)
create mode 100644 tests/providers/apache/drill/operators/test_drill.py
copy tests/{www/api/experimental => providers/asana}/__init__.py (100%)
copy tests/{www/api/experimental => providers/asana/hooks}/__init__.py (100%)
create mode 100644 tests/providers/asana/hooks/test_asana.py
copy tests/{www/api/experimental => providers/asana/operators}/__init__.py (100%)
create mode 100644 tests/providers/asana/operators/test_asana_system.py
create mode 100644 tests/providers/asana/operators/test_asana_tasks.py
copy tests/providers/{zendesk/hooks => docker/decorators}/__init__.py (100%)
create mode 100644 tests/providers/docker/decorators/test_docker.py
copy tests/providers/{zendesk/hooks => google/ads/operators}/__init__.py (100%)
create mode 100644 tests/providers/google/cloud/sensors/test_datafusion.py
create mode 100644 tests/providers/google/cloud/transfers/test_bigquery_to_mssql.py
create mode 100644 tests/providers/google/cloud/utils/test_helpers.py
create mode 100644 tests/providers/google/suite/transfers/test_sql_to_sheets.py
copy tests/providers/{zendesk/hooks => influxdb}/__init__.py (100%)
copy tests/providers/{zendesk => influxdb}/hooks/__init__.py (100%)
create mode 100644 tests/providers/influxdb/hooks/test_influxdb.py
copy tests/providers/{zendesk => jenkins}/hooks/__init__.py (100%)
create mode 100644 tests/providers/microsoft/azure/operators/test_azure_data_factory.py
copy tests/providers/{zendesk/hooks => microsoft/azure/secrets}/__init__.py (100%)
create mode 100644 tests/providers/microsoft/azure/sensors/test_azure_data_factory.py
delete mode 100644 tests/providers/microsoft/azure/transfers/test_file_to_wasb.py
delete mode 100644 tests/providers/microsoft/azure/transfers/test_file_to_wasb_system.py
create mode 100644 tests/providers/microsoft/azure/transfers/test_local_to_wasb.py
create mode 100644 tests/providers/microsoft/azure/transfers/test_local_to_wasb_system.py
copy tests/providers/{zendesk/hooks => microsoft/mssql/operators}/__init__.py (100%)
copy tests/{www/api/experimental => providers/microsoft/psrp}/__init__.py (100%)
copy tests/{www/api/experimental => providers/microsoft/psrp/hooks}/__init__.py (100%)
create mode 100644 tests/providers/microsoft/psrp/hooks/test_psrp.py
copy tests/{www/api/experimental => providers/microsoft/psrp/operators}/__init__.py (100%)
create mode 100644 tests/providers/microsoft/psrp/operators/test_psrp.py
copy tests/providers/{zendesk/hooks => odbc}/__init__.py (100%)
copy tests/providers/{zendesk => odbc}/hooks/__init__.py (100%)
create mode 100644 tests/providers/pagerduty/hooks/test_pagerduty_events.py
copy tests/providers/{zendesk => plexus}/hooks/__init__.py (100%)
create mode 100644 tests/providers/salesforce/operators/test_salesforce_apex_rest.py
create mode 100644 tests/providers/slack/operators/test.csv
copy tests/providers/{zendesk/hooks => tableau}/__init__.py (100%)
create mode 100644 tests/providers/tableau/operators/test_tableau.py
create mode 100644 tests/task/task_runner/test_base_task_runner.py
create mode 100644 tests/test_utils/timetables.py
copy tests/{providers/zendesk/hooks => timetables}/__init__.py (100%)
create mode 100644 tests/timetables/test_interval_timetable.py
create mode 100644 tests/timetables/test_workday_timetable.py
create mode 100644 tests/triggers/test_temporal.py
delete mode 100644 tests/utils/test_dag_processing.py
create mode 100644 tests/utils/test_state.py
delete mode 100644 tests/www/test_views.py
create mode 100644 tests/www/views/test_views_acl.py
create mode 100644 tests/www/views/test_views_base.py
create mode 100644 tests/www/views/test_views_blocked.py
create mode 100644 tests/www/views/test_views_custom_user_views.py
create mode 100644 tests/www/views/test_views_graph_gantt.py
create mode 100644 tests/www/views/test_views_home.py
create mode 100644 tests/www/views/test_views_log.py
create mode 100644 tests/www/views/test_views_robots.py
create mode 100644 tests/www/views/test_views_task_norun.py
create mode 100644 tests/www/views/test_views_tasks.py