You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by gi...@apache.org on 2021/01/11 03:34:53 UTC
[airflow] tag nightly-master updated (df09c3f -> 87a7557)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from df09c3f (commit)
to 87a7557 (commit)
from df09c3f Installed providers are initialized in subshell (#13270)
add a1e9195 add system test for azure local to adls operator (#13190)
add 6f246b0 Fix imagePullPolicy missing in tests (#13316)
add 6d6fe36 Updates IMAGES documentation to reflect Airflow 2.0 changes (#13312)
add 91acdbe Add pre-commit hook limiting hook name length (#13319)
add 8fed541 Rename PIP_VERSION to AIRFLOW_PIP_VERSION (#13320)
add f4745c8 Fix typo in example (#13321)
add c6d66cd Switch to Apache-owned GitHub actions (#13327)
add 98896e4 Also add codecov action to apache airflow repo (#13328)
add d41c6a4 Vastly improves usability of CI logs (#13323)
add 641f63c Prefer newer CLI syntax over legacy in helm chart (#13330)
add 4be27af Fix the behavior for deactivate the authentication option and documenting the process to do it (#13191)
add 09c6549 Add missing sqlite provider for production image (#13332)
add 1f71221 Support google-cloud-tasks>=2.0.0 (#13334)
add e35bdb9 json-merge-patch becomes optional library and has looser restrictions (#13175)
add 3b4290d Re-enables verification of production image (#13329)
add f7d354d Print better error message when tests fail (#13339)
add 04ec45f Add DataprocCreateWorkflowTemplateOperator (#13338)
add 13a9747 Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341)
add d23ac9b Adds missing LDAP "extra" dependencies to ldap provider. (#13308)
add 0d21457 Refactored setup.py to better reflect changes in providers (#13314)
add 82fa048 Production image can also be upgraded to newer dependencies (#13345)
add bafd258 Add Fleek Fashion to the list of Airflow users (#13372)
add 295d66f Fix Grammar in PIP warning (#13380)
add a4a3d3f Minor enhancements to Sensors docs (#13381)
add d5cf993 Fix typo in Open API docs (#13374)
add 1b94346 Bugfix: Sync Access Control defined in DAGs when running sync-perm (#13377)
add 57cbcf6 Fix broken link in PR Welcome message (#13386)
add 98f097e Add integration tests for Apache Pinot (#13195)
add 410ab89 Fix Apache Airflow icon link in Helm Chart (#13387)
add 8212247 Bump version to 2.1.0dev0 (#13382)
add fe45f1b Use 2.0.0 in Airflow docs & Breeze (#13379)
add d079b91 Disable persisting credentials in Github Action's checkout (#13389)
add b52d39f Improves documentation regarding providers and custom connections (#13375)
add dcedb81 Fix mallformed table in production-deployment.rst (#13395)
add 10be375 Simplify CeleryKubernetesExecutor tests (#13307)
add 406181d Add Parquet data type to BaseSQLToGCSOperator (#13359)
add cc9a19d Update celery.rst to fix broken links. (#13400)
add bd74eb0 Allow Tags on AWS Batch Job Submission (#13396)
add 85ac03f Update persists-credentials (#13401)
add a1f4938 Limit old versions of pinotdb to force update on CI (#13402)
add 028d8e8 Remove reference to scheduler run_duration param in docs (#13346)
add 07e7513 Fixed broken aws test_batch_job tests introduced by #13396 (#13406)
add d2964b0 Add example DAG & how-to guide for sqlite (#13196)
add 9de7127 Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337)
add 7e1d28b Warns politely, do not force run a long operation (#13313)
add 6700563 Set minimum SQLite version supported. (#13412)
add d202fd4 Adding documentation explaining "strange" URI required when using AWS… (#13355)
add f6a3c82 Enable interpretation of backslash escapes for colored message (#13418)
add 181d8b6 Developers Quick Guide (#13417)
add 57143d6 Allow ./run_tmux.sh script to run standalone (#13420)
add abf34b8 Kuba openfaas sync call (#13356)
add 43f150b Add last-commit example to static-check --help message. (#13411)
add 27c757d Fix environment checking for Apache Pinot (#13419)
add 09a2413 Improves documentation regarding providers and custom connections 2 (#13410)
add ae625b4 Change timeout s and disables reverse IP lookup for integrations (#13424)
add c674f81 Add verbose flag to ./build_docs.py (#13403)
add e436883 Removes pip download when installing from local packages (#13422)
add f7a1334 Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)
add 6e1a6ff Fixed failing pylint errors introduced in #13403 (#13429)
add f6518dd Generalize MLEngineStartTrainingJobOperator to custom images (#13318)
add 1016584 Fix pylint issues - broken master (#13427)
add 1fe83a4 Fix selective checks for changes outside of airflow .py files (#13430)
add 0909ddf Adds timeout to all curl commands (#13431)
add 3a73110 Add extras when installing prod image from packages (#13432)
add ac730c3 Improve style of code block on aws-ssm-parameter-store.rst (#13428)
add abcb087 fixup! Adds timeout to all curl commands (#13431) (#13435)
add ad0d3e1 fixup! Fixed failing pylint errors introduced in #13403 (#13429) (#13437)
add c33d2c0 Fix another pylint c-extension-no-member (#13438)
add bc6f5ea Install airflow and providers together from context files (#13441)
add 006107f Fix grammar in API docs (#13444)
add d6e1d7b Replace deprecated decorator (#13443)
add 4f494d4 Fix few typos (#13450)
add 5f81fc7 Fix: Remove password if in LDAP or CUSTOM mode HiveServer2Hook (#11767)
add 6ef23af Streamline & simplify __eq__ methods in models Dag and BaseOperator (#13449)
add 429e54c Add support for no-menu plugin views (#11742)
add 35e4a3b GitHub PROD image build is pushed to GitHub Registry. (#13442)
add 3a3e739 Fix insert_all method of BigQueryHook to support tables without schema (#13138)
add 4437137 Replace tests-only dependency - tzlocal (#13413)
add 523e2f4 Additional properties should be allowed in provider schema (#13440)
add 3341d21 Add docker health check to integrations (#13446)
add 59ccb7d Fix installation doc (#13462)
add b955e34 Remove unused dependency - contextdecorator (#13455)
add feb8405 Support google-cloud-datacatalog 3.0.0 (#13224)
add 43b2d33 Log migrations info in consisten way (#13458)
add 1500083 Rewrite handwritten argument parser in prepare_provider_packages.py (#13234)
add dd78ad0 Remove redundant word (#13466)
add 10c84b5 Upgrade pre-commit hooks (#13465)
add 891fb2d Fix typo in TaskGroup docstrings (#13475)
add 27449ba Replace dictionary creation with dictionary literal (#13474)
add 62b82fe Remove 'typing' dependency (#13472)
add c7d75ad Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482)
add 7d1ea4c Replace deprecated module and operator in example_tasks.py (#13473)
add e071834 Update supported Python version in LOCAL_VIRTUALENV.rst (#13468)
add 07670ec Fix webserver ingress annotations (#12619)
add f40b4ba Jeremiah Lowin has resigned from the Airflow project (#13486)
add 0fd5807 Add Vikram in the Airflow Committer's list (#13489)
add 003584b Fix failing backport packages test (#13497)
add b213dbe Check for minimum version of Sqlite (#13496)
add c2ead47 Chart: Add custom_airflow_environment to flower container (#12630)
add 4e479e1 Add S3KeySizeSensor (#13049)
add e7dbed2 Add docs about mocking variables and connections (#13502)
add 9c75ea3 Add How-To guide for PostgresOperator (#13281)
add f69405f Fix S3KeysUnchangedSensor so that template_fields work (#13490)
add cc79117 Add comprehensive tests for pod launcher role in helm chart (#13302)
add b2cb6ee Fix Azure Data Explorer Operator (#13520)
add 0e510b2 Add DAG Description Doc to Trigger UI Page (#13365)
add 8b82b77 Add docs about Flask CLI (#13500)
add 09c1e9a upgrade mysql-connector-python to 8.0.22 (#13370)
add 308f1d0 [AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)
add 5f29c70 Update chart README with section on Airflow configuration (#13519)
add ef2123c When "full tests needed" label is present, run all tests (#13538)
add 70290b9 Add python-daemon limit for python 3.8+ (#13540)
add b5d921b Remove thrift as a core dependency (#13471)
add 163514b Change the host in the example of using the API auth backend (#13548)
add 3998711 Fix known-hosts volume name (#13457)
add 8ab964e Separate nodeSelector logic of chart (#13508)
add 2fb6834 Replace deprecated module and operator in example_tasks.py (#13527)
add 992ac34 More verbose and less frequent image poll (#13555)
add ad64dfa Add NotFound response for DELETE methods in OpenAPI YAML (#13550)
add dc7d0a6 The check for image is now more robust (#13556)
add 6570df8 Optimises prod image preparation in CI (#13557)
add 52339a5 [AIRFLOW-7044] Host key can be specified via SSH connection extras. (#12944)
add 71bb9f2 Change render to render_template in plugins.rst (#13560)
add 0d8536c Optimize wait for prod images to be run after ci images (#13562)
add f969e69 Forces unistalling providers in editable mode. (#13439)
add 9ff87fc Little changes in How To Rebase a PR (#13564)
add 6bdba37 Fix capitalisation of boolean in config (#13569)
add 9ec9e55 Make docs clear that Auth can't be disabled for Stable API (#13568)
add f49f36b Removes provider-imposed requirements from setup.cfg (#13409)
add 94f39ae Adds information about PIP being the only official install tool (#13565)
add 7d36d8c Fix extraVolumeMounts of scheduler (#13509)
add 1b47950 Add Guidelines to become an Airflow Committer (#13236)
add 1ebc38c Use `yaml.full_load_all` instead of `yaml.load_all` (#13577)
add f1b71d2 Fix depcrecated K8S api (#13575)
add 77e0106 Fix image and add airflow config for cleanup pods (#13576)
add 52a5ecf Stop Log Spamming when `[core] lazy_load_plugins` is False (#13578)
add 9d6c748 Reduce the number of variables in Bash scripts (#13572)
add 753d25f Remove archived links from docs & add link for AIPs (#13580)
add f5e81c8 Fix link for Committers Requirement in README.md (#13581)
add 14f6af7 Fix Formatting and link for Installing Backport Providers (#13582)
add c7d003c Minor fixes in upgrading-to-2.rst (#13583)
add 6cbe269 Fix Link in Upgrading to 2.0 guide (#13584)
add 4f740db Minor grammar fix in OpenAPI YAML (#13586)
add 809ddcd Support external Redis in Helm Chart (#12010)
add 543194d Eager upgrade works also in editable mode. (#13589)
add 1d1ea52 Add classic installation scripts for additional tools (#13587)
add 5954ef5 Warn about precedence of env var when getting variables (#13501)
add 9331fa7 Fix code typo in logging-tasks.rst (#13594)
add 46edea3 Salesforce provider requires tableau (#13593)
add ef0f5cd Deprecate `tableau` extra (#13595)
add 87a7557 Display message and docs link when no plugins are loaded (#13599)
No new revisions were added by this update.
Summary of changes:
.github/boring-cyborg.yml | 2 +-
.github/workflows/build-images-workflow-run.yml | 178 +++-
.github/workflows/ci.yml | 167 +++-
.github/workflows/codeql-analysis.yml | 2 +
.../workflows/label_when_reviewed_workflow_run.yml | 19 +-
.github/workflows/repo_sync.yml | 4 +-
.github/workflows/scheduled_quarantined.yml | 4 +-
.pre-commit-config.yaml | 32 +-
BREEZE.rst | 119 ++-
CI.rst | 2 +-
CONTRIBUTING.rst | 221 ++++-
CONTRIBUTORS_QUICK_START.rst | 972 +++++++++++++++++++++
Dockerfile | 127 +--
Dockerfile.ci | 115 ++-
IMAGES.rst | 142 +--
INSTALL | 54 +-
INTHEWILD.md | 1 +
LOCAL_VIRTUALENV.rst | 36 +-
PULL_REQUEST_WORKFLOW.rst | 20 +-
README.md | 25 +-
STATIC_CODE_CHECKS.rst | 2 +
TESTING.rst | 2 +
UPDATING.md | 2 +-
airflow/api_connexion/openapi/v1.yaml | 16 +-
airflow/cli/commands/sync_perm_command.py | 4 +-
airflow/configuration.py | 14 +-
.../customized_form_field_behaviours.schema.json | 4 +-
.../provider-2.0.0.yaml.schema.json} | 4 -
.../2c6edca13270_resource_based_permissions.py | 5 +
...2da_increase_size_of_connection_extra_field_.py | 56 ++
airflow/models/baseoperator.py | 8 +-
airflow/models/connection.py | 2 +-
airflow/models/dag.py | 3 +-
airflow/models/variable.py | 12 +
airflow/plugins_manager.py | 2 +-
airflow/provider.yaml.schema.json | 12 +-
airflow/providers/amazon/README.md | 2 +-
airflow/providers/amazon/aws/hooks/batch_client.py | 4 +
airflow/providers/amazon/aws/hooks/s3.py | 16 +
airflow/providers/amazon/aws/operators/batch.py | 7 +
airflow/providers/amazon/aws/sensors/s3_key.py | 96 +-
.../amazon/aws/sensors/s3_keys_unchanged.py | 10 +-
.../providers/amazon/aws/transfers/mongo_to_s3.py | 10 +-
airflow/providers/apache/cassandra/README.md | 2 +-
airflow/providers/apache/druid/README.md | 2 +-
airflow/providers/apache/hdfs/README.md | 2 +-
airflow/providers/apache/hive/README.md | 2 +-
airflow/providers/apache/hive/hooks/hive.py | 9 +-
airflow/providers/apache/kylin/README.md | 2 +-
airflow/providers/apache/livy/README.md | 2 +-
airflow/providers/apache/pig/README.md | 2 +-
airflow/providers/apache/pinot/README.md | 2 +-
airflow/providers/apache/spark/README.md | 2 +-
airflow/providers/apache/sqoop/README.md | 2 +-
airflow/providers/celery/README.md | 2 +-
airflow/providers/cloudant/README.md | 2 +-
airflow/providers/cncf/kubernetes/README.md | 2 +-
airflow/providers/databricks/README.md | 2 +-
airflow/providers/datadog/README.md | 2 +-
airflow/providers/dingding/README.md | 2 +-
airflow/providers/discord/README.md | 2 +-
airflow/providers/docker/README.md | 2 +-
airflow/providers/elasticsearch/README.md | 2 +-
airflow/providers/exasol/README.md | 2 +-
airflow/providers/facebook/README.md | 2 +-
airflow/providers/ftp/README.md | 2 +-
airflow/providers/google/ADDITIONAL_INFO.md | 1 +
airflow/providers/google/README.md | 2 +-
.../cloud/example_dags/example_bigquery_dts.py | 20 +-
.../cloud/example_dags/example_bigquery_queries.py | 2 +-
.../google/cloud/example_dags/example_dataproc.py | 32 +-
.../google/cloud/example_dags/example_tasks.py | 4 +-
airflow/providers/google/cloud/hooks/bigquery.py | 10 +-
.../providers/google/cloud/hooks/bigquery_dts.py | 45 +-
.../google/cloud/operators/bigquery_dts.py | 12 +-
.../providers/google/cloud/operators/dataproc.py | 67 +-
.../providers/google/cloud/operators/mlengine.py | 92 +-
.../providers/google/cloud/sensors/bigquery_dts.py | 35 +-
.../google/cloud/transfers/oracle_to_gcs.py | 2 +-
.../providers/google/cloud/transfers/sql_to_gcs.py | 40 +-
airflow/providers/grpc/README.md | 2 +-
airflow/providers/hashicorp/README.md | 2 +-
airflow/providers/http/README.md | 2 +-
airflow/providers/imap/README.md | 2 +-
airflow/providers/jdbc/README.md | 2 +-
airflow/providers/jenkins/README.md | 2 +-
airflow/providers/jira/README.md | 2 +-
airflow/providers/microsoft/azure/README.md | 2 +-
.../azure/example_dags/example_local_to_adls.py | 10 +-
airflow/providers/microsoft/azure/operators/adx.py | 10 +-
airflow/providers/microsoft/mssql/README.md | 2 +-
airflow/providers/microsoft/winrm/README.md | 2 +-
airflow/providers/mongo/README.md | 2 +-
airflow/providers/mysql/ADDITIONAL_INFO.md | 24 +
airflow/providers/mysql/README.md | 2 +-
airflow/providers/odbc/README.md | 2 +-
airflow/providers/openfaas/README.md | 2 +-
airflow/providers/openfaas/hooks/openfaas.py | 18 +-
airflow/providers/opsgenie/README.md | 2 +-
airflow/providers/oracle/README.md | 2 +-
airflow/providers/pagerduty/README.md | 2 +-
airflow/providers/papermill/README.md | 2 +-
airflow/providers/plexus/README.md | 2 +-
airflow/providers/postgres/README.md | 2 +-
.../providers/postgres/example_dags}/__init__.py | 0
.../postgres/example_dags/example_postgres.py | 81 ++
airflow/providers/postgres/provider.yaml | 4 +-
airflow/providers/presto/README.md | 2 +-
airflow/providers/qubole/README.md | 2 +-
airflow/providers/redis/README.md | 2 +-
airflow/providers/salesforce/README.md | 2 +-
airflow/providers/samba/README.md | 2 +-
airflow/providers/segment/README.md | 2 +-
airflow/providers/sendgrid/README.md | 2 +-
airflow/providers/sftp/README.md | 2 +-
airflow/providers/sftp/hooks/sftp.py | 6 +
airflow/providers/singularity/README.md | 2 +-
airflow/providers/slack/README.md | 2 +-
airflow/providers/snowflake/README.md | 2 +-
airflow/providers/sqlite/README.md | 2 +-
.../providers/sqlite/example_dags}/__init__.py | 0
.../sqlite/example_dags/example_sqlite.py | 70 ++
airflow/providers/sqlite/operators/sqlite.py | 12 +-
airflow/providers/sqlite/provider.yaml | 3 +
airflow/providers/ssh/README.md | 2 +-
airflow/providers/ssh/hooks/ssh.py | 18 +-
airflow/providers/telegram/README.md | 2 +-
airflow/providers/vertica/README.md | 2 +-
airflow/providers/yandex/README.md | 2 +-
airflow/providers/zendesk/README.md | 2 +-
airflow/providers_manager.py | 6 +-
airflow/utils/log/file_processor_handler.py | 3 +-
airflow/utils/log/logging_mixin.py | 3 +-
airflow/utils/task_group.py | 2 +-
...ed.sh => ask_for_recompile_assets_if_needed.sh} | 14 +-
airflow/www/compile_assets.sh | 5 +
airflow/www/extensions/init_views.py | 10 +-
airflow/www/security.py | 4 +-
airflow/www/templates/airflow/plugin.html | 46 +-
airflow/www/templates/airflow/trigger.html | 2 +
airflow/www/views.py | 7 +-
breeze | 85 +-
breeze-complete | 10 +-
chart/Chart.yaml | 2 +-
chart/README.md | 108 ++-
chart/files/pod-template-file.kubernetes-helm-yaml | 4 +-
chart/templates/_helpers.yaml | 2 +-
chart/templates/check-values.yaml | 51 ++
chart/templates/cleanup/cleanup-cronjob.yaml | 20 +-
chart/templates/create-user-job.yaml | 11 +-
chart/templates/flower/flower-deployment.yaml | 12 +-
chart/templates/flower/flower-ingress.yaml | 6 +-
chart/templates/flower/flower-networkpolicy.yaml | 14 +-
chart/templates/migrate-database-job.yaml | 11 +-
.../templates/pgbouncer/pgbouncer-deployment.yaml | 9 +-
chart/templates/rbac/pod-launcher-rolebinding.yaml | 8 +-
chart/templates/redis/redis-networkpolicy.yaml | 2 +-
chart/templates/redis/redis-service.yaml | 2 +-
chart/templates/redis/redis-statefulset.yaml | 11 +-
.../templates/scheduler/scheduler-deployment.yaml | 15 +-
chart/templates/secrets/redis-secrets.yaml | 18 +-
chart/templates/statsd/statsd-deployment.yaml | 9 +-
.../templates/webserver/webserver-deployment.yaml | 9 +-
chart/templates/webserver/webserver-ingress.yaml | 16 +-
.../webserver/webserver-networkpolicy.yaml | 14 +-
chart/templates/workers/worker-deployment.yaml | 11 +-
chart/templates/workers/worker-networkpolicy.yaml | 2 +-
chart/tests/helm_template_generator.py | 4 +-
chart/tests/test_basic_helm_chart.py | 29 +-
chart/tests/test_cleanup_pods.py | 68 ++
chart/tests/test_git_sync_scheduler.py | 25 +
...es_pod_launcher_role.py => test_ingress_web.py} | 20 +-
chart/tests/test_pod_launcher_role.py | 50 ++
chart/tests/test_pod_template_file.py | 35 +
chart/tests/test_redis.py | 230 +++++
chart/values.schema.json | 151 +++-
chart/values.yaml | 56 +-
.../PROVIDER_README_TEMPLATE.md.jinja2 | 2 +-
dev/provider_packages/build_source_package.sh | 2 +-
dev/provider_packages/prepare_provider_packages.py | 367 +++++---
.../refactor_provider_packages.py | 13 +
dev/remove_artifacts.sh | 3 +-
.../secrets-backends/aws-ssm-parameter-store.rst | 12 +
.../operators/cloud/dataproc.rst | 24 +
docs/apache-airflow-providers-postgres/index.rst | 9 +-
.../operators/postgres_operator_howto_guide.rst | 181 ++++
.../{index.rst => connections/sqlite.rst} | 27 +-
docs/apache-airflow-providers-sqlite/index.rst | 13 +
docs/apache-airflow-providers-sqlite/operators.rst | 75 ++
docs/apache-airflow-providers-sqlite/redirects.txt | 1 +
.../connections/ssh.rst | 6 +-
docs/apache-airflow-providers/index.rst | 161 +++-
docs/apache-airflow/best-practices.rst | 63 +-
docs/apache-airflow/concepts.rst | 70 +-
docs/apache-airflow/executor/celery.rst | 4 +-
docs/apache-airflow/extra-packages-ref.rst | 411 ++++-----
docs/apache-airflow/howto/connection.rst | 21 +-
docs/apache-airflow/installation.rst | 54 +-
.../logging-monitoring/logging-tasks.rst | 2 +-
docs/apache-airflow/plugins.rst | 29 +-
docs/apache-airflow/production-deployment.rst | 133 +--
docs/apache-airflow/project.rst | 11 +-
docs/apache-airflow/security/api.rst | 6 +-
docs/apache-airflow/security/webserver.rst | 8 +
docs/apache-airflow/start.rst | 2 +-
docs/apache-airflow/upgrade-check.rst | 2 +-
docs/apache-airflow/upgrading-to-2.rst | 17 +-
docs/build_docs.py | 18 +-
docs/exts/docs_build/docs_builder.py | 27 +-
docs/spelling_wordlist.txt | 4 +
images/quick_start/add Interpreter.png | Bin 0 -> 118539 bytes
images/quick_start/add_configuration.png | Bin 0 -> 97805 bytes
images/quick_start/add_env_variable.png | Bin 0 -> 86158 bytes
images/quick_start/airflow_clone.png | Bin 0 -> 175230 bytes
images/quick_start/airflow_fork.png | Bin 0 -> 44861 bytes
images/quick_start/ci_tests.png | Bin 0 -> 74167 bytes
images/quick_start/click_on_clone.png | Bin 0 -> 28944 bytes
images/quick_start/creating_branch_1.png | Bin 0 -> 32659 bytes
images/quick_start/creating_branch_2.png | Bin 0 -> 17802 bytes
images/quick_start/local_airflow.png | Bin 0 -> 21976 bytes
images/quick_start/mysql_connection.png | Bin 0 -> 99933 bytes
images/quick_start/pr1.png | Bin 0 -> 59941 bytes
images/quick_start/pr2.png | Bin 0 -> 57712 bytes
images/quick_start/pr3.png | Bin 0 -> 163389 bytes
images/quick_start/pycharm_clone.png | Bin 0 -> 25074 bytes
images/quick_start/start_airflow_tmux.png | Bin 0 -> 212341 bytes
kubernetes_tests/test_kubernetes_pod_operator.py | 2 +
.../test_kubernetes_pod_operator_backcompat.py | 1 +
.../ci/build_airflow/ci_build_airflow_package.sh | 5 +-
scripts/ci/constraints/ci_generate_constraints.sh | 2 +-
scripts/ci/docker-compose/_docker.env | 1 +
scripts/ci/docker-compose/backend-mysql.yml | 11 +-
scripts/ci/docker-compose/backend-postgres.yml | 10 +-
.../ci/docker-compose/integration-cassandra.yml | 11 +-
scripts/ci/docker-compose/integration-kerberos.yml | 18 +-
scripts/ci/docker-compose/integration-mongo.yml | 11 +-
scripts/ci/docker-compose/integration-openldap.yml | 11 +-
...integration-redis.yml => integration-pinot.yml} | 24 +-
scripts/ci/docker-compose/integration-presto.yml | 9 +-
scripts/ci/docker-compose/integration-rabbitmq.yml | 11 +-
scripts/ci/docker-compose/integration-redis.yml | 11 +-
scripts/ci/dockerfiles/presto/entrypoint.sh | 4 +-
scripts/ci/docs/ci_docs.sh | 2 +-
scripts/ci/images/ci_build_dockerhub.sh | 7 +-
scripts/ci/images/ci_prepare_ci_image_on_ci.sh | 4 +-
scripts/ci/images/ci_prepare_prod_image_on_ci.sh | 15 +-
scripts/ci/images/ci_verify_ci_image.sh | 17 +-
scripts/ci/images/ci_verify_prod_image.sh | 160 +++-
scripts/ci/images/ci_wait_for_ci_image.sh | 8 +-
scripts/ci/images/ci_wait_for_prod_image.sh | 9 +-
scripts/ci/kubernetes/ci_run_kubernetes_tests.sh | 121 +--
...tup_cluster_and_deploy_airflow_to_kubernetes.sh | 2 +-
scripts/ci/libraries/_build_airflow_packages.sh | 4 +-
scripts/ci/libraries/_build_images.sh | 148 ++--
scripts/ci/libraries/_initialization.sh | 233 ++---
scripts/ci/libraries/_kind.sh | 61 +-
scripts/ci/libraries/_md5sum.sh | 5 +
scripts/ci/libraries/_parameters.sh | 4 +-
scripts/ci/libraries/_permissions.sh | 10 +-
scripts/ci/libraries/_push_pull_remove_images.sh | 37 +-
scripts/ci/libraries/_repeats.sh | 4 +-
scripts/ci/libraries/_runs.sh | 11 +-
scripts/ci/libraries/_sanity_checks.sh | 10 +-
scripts/ci/libraries/_script_init.sh | 14 +
scripts/ci/libraries/_start_end.sh | 27 +
.../pre_commit_check_extras_have_providers.py | 69 +-
.../ci/pre_commit/pre_commit_check_order_setup.py | 129 ++-
.../pre_commit_check_pre_commit_hook_names.py | 61 ++
.../ci/pre_commit/pre_commit_check_pre_commits.sh | 8 +-
.../pre_commit_check_setup_extra_packages_ref.py | 272 ++++--
scripts/ci/pre_commit/pre_commit_mermaid.sh | 2 +-
.../ci_install_and_test_provider_packages.sh | 5 +-
.../ci_prepare_provider_packages.sh | 4 +-
.../ci_prepare_provider_readmes.sh | 4 +-
scripts/ci/selective_ci_checks.sh | 133 ++-
scripts/ci/static_checks/check_license.sh | 6 +-
scripts/ci/testing/ci_run_airflow_testing.sh | 90 +-
scripts/docker/compile_www_assets.sh | 50 ++
scripts/docker/install_additional_dependencies.sh | 52 ++
scripts/docker/install_airflow.sh | 88 ++
.../docker/install_airflow_from_latest_master.sh | 58 ++
.../docker/install_from_docker_context_files.sh | 106 +++
scripts/docker/install_mysql.sh | 50 +-
scripts/in_container/_in_container_utils.sh | 58 +-
scripts/in_container/bin/install_gcloud.sh | 67 ++
.../in_container/bin/install_imgcat.sh | 25 +-
scripts/in_container/bin/install_java.sh | 61 ++
.../bin/install_kubectl.sh} | 45 +-
.../bin/install_terraform.sh} | 49 +-
scripts/in_container/check_environment.sh | 54 +-
scripts/in_container/entrypoint_ci.sh | 20 +-
scripts/in_container/prod/entrypoint_prod.sh | 20 +-
scripts/in_container/run_ci_tests.sh | 6 +-
scripts/in_container/run_cli_tool.sh | 35 +-
scripts/in_container/run_generate_constraints.sh | 2 +-
.../run_install_and_test_provider_packages.sh | 174 ++--
scripts/in_container/run_mypy.sh | 2 +
.../in_container/run_prepare_provider_packages.sh | 255 +++---
.../in_container/run_prepare_provider_readme.sh | 9 +-
scripts/in_container/run_tmux.sh | 68 +-
scripts/in_container/run_tmux_welcome.sh | 2 +-
setup.cfg | 19 +-
setup.py | 742 ++++++++--------
tests/always/test_project_structure.py | 1 -
tests/build_provider_packages_dependencies.py | 4 +-
tests/cli/commands/test_sync_perm_command.py | 25 +-
tests/executors/test_celery_kubernetes_executor.py | 265 +++---
tests/models/test_variable.py | 20 +-
tests/plugins/test_plugin.py | 2 +
tests/plugins/test_plugins_manager.py | 22 +-
tests/providers/amazon/aws/hooks/test_s3.py | 12 +
tests/providers/amazon/aws/hooks/test_sagemaker.py | 4 +-
tests/providers/amazon/aws/operators/test_batch.py | 4 +
tests/providers/amazon/aws/sensors/test_s3_key.py | 43 +-
.../amazon/aws/sensors/test_s3_keys_unchanged.py | 12 +
.../amazon/aws/transfers/test_mongo_to_s3.py | 30 +-
tests/providers/apache/pinot/hooks/test_pinot.py | 12 +
.../kubernetes/operators/test_spark_kubernetes.py | 8 +-
.../kubernetes/sensors/test_spark_kubernetes.py | 26 +-
.../providers/google/cloud/hooks/test_bigquery.py | 7 +-
.../google/cloud/hooks/test_bigquery_dts.py | 39 +-
.../google/cloud/operators/test_bigquery_dts.py | 37 +-
.../google/cloud/operators/test_dataproc.py | 39 +
.../google/cloud/operators/test_mlengine.py | 48 +-
.../google/cloud/sensors/test_bigquery_dts.py | 39 +-
.../google/cloud/transfers/test_oracle_to_gcs.py | 2 +-
.../google/cloud/transfers/test_sql_to_gcs.py | 110 ++-
.../microsoft/azure/operators/test_adx.py | 33 +-
.../azure/transfers/test_local_to_adls_system.py | 48 +
tests/providers/openfaas/hooks/test_openfaas.py | 28 +
.../postgres/operators/test_postgres_system.py | 23 +-
tests/providers/sftp/hooks/test_sftp.py | 41 +-
tests/providers/ssh/hooks/test_ssh.py | 93 ++
tests/www/test_app.py | 9 +-
tests/www/test_security.py | 49 ++
tests/www/test_views.py | 3 +-
336 files changed, 8413 insertions(+), 2972 deletions(-)
create mode 100644 CONTRIBUTORS_QUICK_START.rst
copy airflow/{provider.yaml.schema.json => deprecated_schemas/provider-2.0.0.yaml.schema.json} (96%)
create mode 100644 airflow/migrations/versions/449b4072c2da_increase_size_of_connection_extra_field_.py
create mode 100644 airflow/providers/mysql/ADDITIONAL_INFO.md
copy {tests/providers/zendesk/hooks => airflow/providers/postgres/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/postgres/example_dags/example_postgres.py
copy {tests/www/api/experimental => airflow/providers/sqlite/example_dags}/__init__.py (100%)
create mode 100644 airflow/providers/sqlite/example_dags/example_sqlite.py
rename airflow/www/{compile_assets_if_needed.sh => ask_for_recompile_assets_if_needed.sh} (79%)
create mode 100644 chart/templates/check-values.yaml
create mode 100644 chart/tests/test_cleanup_pods.py
rename chart/tests/{test_celery_kubernetes_pod_launcher_role.py => test_ingress_web.py} (58%)
create mode 100644 chart/tests/test_pod_launcher_role.py
create mode 100644 chart/tests/test_redis.py
create mode 100644 docs/apache-airflow-providers-postgres/operators/postgres_operator_howto_guide.rst
copy docs/apache-airflow-providers-sqlite/{index.rst => connections/sqlite.rst} (67%)
create mode 100644 docs/apache-airflow-providers-sqlite/operators.rst
create mode 100644 docs/apache-airflow-providers-sqlite/redirects.txt
create mode 100644 images/quick_start/add Interpreter.png
create mode 100644 images/quick_start/add_configuration.png
create mode 100644 images/quick_start/add_env_variable.png
create mode 100644 images/quick_start/airflow_clone.png
create mode 100644 images/quick_start/airflow_fork.png
create mode 100644 images/quick_start/ci_tests.png
create mode 100644 images/quick_start/click_on_clone.png
create mode 100644 images/quick_start/creating_branch_1.png
create mode 100644 images/quick_start/creating_branch_2.png
create mode 100644 images/quick_start/local_airflow.png
create mode 100644 images/quick_start/mysql_connection.png
create mode 100644 images/quick_start/pr1.png
create mode 100644 images/quick_start/pr2.png
create mode 100644 images/quick_start/pr3.png
create mode 100644 images/quick_start/pycharm_clone.png
create mode 100644 images/quick_start/start_airflow_tmux.png
copy scripts/ci/docker-compose/{integration-redis.yml => integration-pinot.yml} (74%)
create mode 100755 scripts/ci/pre_commit/pre_commit_check_pre_commit_hook_names.py
create mode 100755 scripts/docker/compile_www_assets.sh
create mode 100755 scripts/docker/install_additional_dependencies.sh
create mode 100755 scripts/docker/install_airflow.sh
create mode 100755 scripts/docker/install_airflow_from_latest_master.sh
create mode 100755 scripts/docker/install_from_docker_context_files.sh
create mode 100755 scripts/in_container/bin/install_gcloud.sh
copy airflow/www/compile_assets.sh => scripts/in_container/bin/install_imgcat.sh (62%)
create mode 100755 scripts/in_container/bin/install_java.sh
copy scripts/{ci/libraries/_build_airflow_packages.sh => in_container/bin/install_kubectl.sh} (50%)
mode change 100644 => 100755
copy scripts/{ci/libraries/_script_init.sh => in_container/bin/install_terraform.sh} (50%)
create mode 100644 tests/providers/microsoft/azure/transfers/test_local_to_adls_system.py
copy airflow/www/compile_assets.sh => tests/providers/postgres/operators/test_postgres_system.py (60%)
mode change 100755 => 100644