You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by gi...@apache.org on 2020/12/23 03:11:33 UTC
[airflow] tag nightly-master updated (cddbf81 -> 93e4787)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from cddbf81 (commit)
to 93e4787 (commit)
from cddbf81 Fix Google BigQueryHook method get_schema() (#13136)
add 23f27c1 Add system tests for CloudKMSHook (#13122)
add 33e0a70 Fix typo in provider name - Oracle (#13147)
add 6cf76d7 Fix typo in pip upgrade command :( (#13148)
add f5c4b24 The default value in chart should be 2.0.0 (#13125)
add 625576a Fix spelling (#13135)
add d3ddfd1 Add Airflow 2.0.0 to requirements table (#13140)
add 7dc7f85 Fix Headings in CONTRIBUTING.rst (#13120)
add c26366e Use generic information in UpdateMask component (#13146)
add 1be20c6 Bump datatables.net from 1.10.21 to 1.10.22 in /airflow/www (#13143)
add 101d561 Fix invalid provider name - Apache Kylin (#13157)
add d2b60ca Minor style fix in docs/extra-packages-ref (#13159)
add 4191116 Add missing version information to recently added configs (#13161)
add 2e28ab6 Remove duplicate pre-commit checks (#13167)
add ff9fb36 Sync Updating Guide with 2.0.0 (#13168)
add 8e99ed6 Replace deprecated dummy operator path in test_zip.zip (#13172)
add 5cf2fbf Fix typos in TESTING.rst (#13169)
add ef8f414 Filter DagRuns with Task Instances in removed State while Scheduling (#13165)
add 2c9c557 Stop sending Callback Requests if no callbacks are defined on DAG (#13163)
add 4fe9304 User werkzeug's own type conversion for request args (#13184)
add 4ad1acc Display alternative tooltip when a Task has yet to run (no TI) (#13162)
add 23a4787 Use new logging options on values.yaml (#13173)
add 81fed80 Add documentation about webserver_config.py (#13155)
add 0ec4998 Update pylint to 2.6.0 (#13174)
add 49f104b Remove unused libraries - flask-swagger, funcsigs (#13178)
add 4aba9c5 Fix brokend master (#13201)
add a9d562e Fix parenthesis preventing Keda ScaledObject creation (#13183)
add 883cd4d Make function purpose clearer in example_kubernetes_executor example dag (#13216)
add cb69145 Bump dompurify from 2.0.12 to 2.2.6 in /airflow/www (#13164)
add a3cc78d Update chart readme to remove astronomer references (#13210)
add 925153f Add Mutt Data to INTHEWILD.md (#13227)
add 97eee35 Fix typos and minor simplification in TESTING.rst (#13194)
add f95b1c9 Add regional support to dataproc workflow template operators (#12907)
add 9c0a5df Update minimum cattrs version (#13223)
add 484f95f Fix QueuedLocalWorker crashing with EOFError (#13215)
add 872350b Add note block to 2.x migration docs (#13094)
add 9a1d382 Support google-cloud-datacatalog>=1.0.0 (#13097)
add b26b0df Update compatibility with google-cloud-kms>=2.0 (#13124)
add 8c00ec8 Support google-cloud-pubsub>=2.0.0 (#13127)
add 6409858 specify constraint key type & drop auto fkey referred to users tables (#13239)
add c44092f Reset PIP version after eager upgrade (#13251)
add d752d92 Flower should be enabled for CeleryKubernetesExecutor (#13248)
add 962fc97 Bump datatables JS to 1.10.23 (#13253)
add 18df31d skip entrypoint load if provider has already been loaded from local source (#13245)
add 9042a58 Add more operators to example DAGs for Cloud Tasks (#13235)
add 0b626c8 Support google-cloud-redis>=2.0.0 (#13117)
add eda399b Fix link to Airflow master branch documentation (#13179)
add a48bc83 Describe which Python versions are supported. (#13259)
add aa00e9b Add Artelys to the list of Airflow users (#13261)
add 93e4787 Allow PID file path to be relative when daemonize a process (scheduler, kerberos, etc) (#13232)
No new revisions were added by this update.
Summary of changes:
.pre-commit-config.yaml | 13 --
CHANGELOG.txt | 6 +-
CONTRIBUTING.rst | 10 +-
Dockerfile.ci | 4 +-
IMAGES.rst | 2 +-
INSTALL | 2 +-
INTHEWILD.md | 2 +
LOCAL_VIRTUALENV.rst | 4 +-
README.md | 36 +++-
TESTING.rst | 140 ++++++-------
UPDATING.md | 11 +-
airflow/api_connexion/openapi/v1.yaml | 4 +-
airflow/cli/cli_parser.py | 4 +-
airflow/config_templates/config.yml | 10 +-
.../config_templates/default_webserver_config.py | 11 +
.../example_dags/example_kubernetes_executor.py | 9 +-
airflow/executors/local_executor.py | 10 +-
airflow/jobs/scheduler_job.py | 2 +-
.../versions/cf5dc11e79ad_drop_user_and_chart.py | 3 +-
airflow/models/dagrun.py | 6 +-
airflow/providers/amazon/README.md | 2 +-
airflow/providers/amazon/aws/hooks/batch_client.py | 2 +-
airflow/providers/apache/cassandra/README.md | 2 +-
airflow/providers/apache/druid/README.md | 2 +-
airflow/providers/apache/hdfs/README.md | 2 +-
airflow/providers/apache/hive/README.md | 2 +-
airflow/providers/apache/kylin/README.md | 2 +-
airflow/providers/apache/kylin/provider.yaml | 2 +-
airflow/providers/apache/livy/README.md | 2 +-
airflow/providers/apache/pig/README.md | 2 +-
airflow/providers/apache/pinot/README.md | 2 +-
airflow/providers/apache/spark/README.md | 2 +-
airflow/providers/apache/sqoop/README.md | 2 +-
airflow/providers/celery/README.md | 2 +-
airflow/providers/cloudant/README.md | 2 +-
airflow/providers/cncf/kubernetes/README.md | 2 +-
airflow/providers/databricks/README.md | 2 +-
airflow/providers/datadog/README.md | 2 +-
airflow/providers/dingding/README.md | 2 +-
airflow/providers/discord/README.md | 2 +-
airflow/providers/docker/README.md | 2 +-
airflow/providers/elasticsearch/README.md | 2 +-
airflow/providers/exasol/README.md | 2 +-
airflow/providers/facebook/README.md | 2 +-
airflow/providers/ftp/README.md | 2 +-
airflow/providers/google/ADDITIONAL_INFO.md | 64 ++++++
airflow/providers/google/README.md | 2 +-
.../example_dags/example_cloud_memorystore.py | 4 +-
.../google/cloud/example_dags/example_tasks.py | 97 ++++++++-
.../google/cloud/hooks/cloud_memorystore.py | 144 ++++++++++----
.../providers/google/cloud/hooks/datacatalog.py | 6 +-
airflow/providers/google/cloud/hooks/dataproc.py | 16 +-
airflow/providers/google/cloud/hooks/kms.py | 23 ++-
airflow/providers/google/cloud/hooks/pubsub.py | 81 ++++----
.../google/cloud/operators/cloud_memorystore.py | 11 +-
airflow/providers/google/cloud/operators/pubsub.py | 3 +-
airflow/providers/google/cloud/operators/tasks.py | 4 +-
airflow/providers/google/cloud/sensors/pubsub.py | 3 +-
airflow/providers/grpc/README.md | 2 +-
airflow/providers/hashicorp/README.md | 2 +-
airflow/providers/http/README.md | 2 +-
airflow/providers/imap/README.md | 2 +-
airflow/providers/jdbc/README.md | 2 +-
airflow/providers/jenkins/README.md | 2 +-
airflow/providers/jira/README.md | 2 +-
airflow/providers/microsoft/azure/README.md | 2 +-
airflow/providers/microsoft/mssql/README.md | 2 +-
airflow/providers/microsoft/winrm/README.md | 2 +-
airflow/providers/mongo/README.md | 2 +-
airflow/providers/mysql/README.md | 2 +-
airflow/providers/odbc/README.md | 2 +-
airflow/providers/openfaas/README.md | 2 +-
airflow/providers/opsgenie/README.md | 2 +-
airflow/providers/oracle/README.md | 2 +-
airflow/providers/oracle/provider.yaml | 2 +-
airflow/providers/pagerduty/README.md | 2 +-
airflow/providers/papermill/README.md | 2 +-
airflow/providers/plexus/README.md | 2 +-
airflow/providers/postgres/README.md | 2 +-
airflow/providers/presto/README.md | 2 +-
airflow/providers/qubole/README.md | 2 +-
airflow/providers/redis/README.md | 2 +-
airflow/providers/salesforce/README.md | 2 +-
airflow/providers/samba/README.md | 2 +-
airflow/providers/segment/README.md | 2 +-
airflow/providers/sendgrid/README.md | 2 +-
airflow/providers/sftp/README.md | 2 +-
airflow/providers/singularity/README.md | 2 +-
airflow/providers/slack/README.md | 2 +-
airflow/providers/snowflake/README.md | 2 +-
airflow/providers/sqlite/README.md | 2 +-
airflow/providers/ssh/README.md | 2 +-
airflow/providers/telegram/README.md | 2 +-
airflow/providers/vertica/README.md | 2 +-
airflow/providers/yandex/README.md | 2 +-
airflow/providers/zendesk/README.md | 2 +-
airflow/providers_manager.py | 2 +
airflow/utils/cli.py | 3 +
airflow/www/package.json | 4 +-
airflow/www/static/js/task-instances.js | 13 ++
airflow/www/templates/airflow/graph.html | 3 +
airflow/www/views.py | 35 +---
airflow/www/yarn.lock | 24 +--
chart/README.md | 19 +-
chart/templates/workers/worker-kedaautoscaler.yaml | 2 +-
chart/tests/helm_template_generator.py | 7 +-
chart/tests/test_keda.py | 57 ++++++
chart/values.yaml | 12 +-
.../PROVIDER_README_TEMPLATE.md.jinja2 | 2 +-
docs/README.rst | 2 +-
docs/apache-airflow/extra-packages-ref.rst | 6 +-
docs/apache-airflow/installation.rst | 21 +-
docs/apache-airflow/security/webserver.rst | 47 ++++-
docs/apache-airflow/start.rst | 2 +-
docs/apache-airflow/upgrade-check.rst | 2 +-
docs/apache-airflow/upgrading-to-2.rst | 8 +
pylintrc | 2 +-
.../pre_commit_check_provider_yaml_files.py | 8 +
setup.cfg | 4 +-
setup.py | 10 +-
tests/always/test_project_structure.py | 10 -
tests/dags/test_zip.zip | Bin 2977 -> 3307 bytes
tests/jobs/test_scheduler_job.py | 91 ++++++++-
tests/operators/test_python.py | 3 -
.../google/cloud/hooks/test_cloud_memorystore.py | 57 +++---
.../providers/google/cloud/hooks/test_dataproc.py | 39 ++--
tests/providers/google/cloud/hooks/test_kms.py | 40 ++--
.../google/cloud/hooks/test_kms_system.py | 104 ++++++++++
tests/providers/google/cloud/hooks/test_pubsub.py | 221 +++++++++++----------
.../cloud/operators/test_cloud_memorystore.py | 4 +-
.../google/cloud/operators/test_pubsub.py | 16 +-
.../providers/google/cloud/operators/test_tasks.py | 97 ++++++---
.../providers/google/cloud/sensors/test_pubsub.py | 16 +-
.../google/cloud/utils/gcp_authenticator.py | 1 +
tests/test_utils/gcp_system_helpers.py | 3 +
tests/utils/test_cli_util.py | 17 ++
136 files changed, 1268 insertions(+), 619 deletions(-)
create mode 100644 airflow/providers/google/ADDITIONAL_INFO.md
create mode 100644 chart/tests/test_keda.py
create mode 100644 tests/providers/google/cloud/hooks/test_kms_system.py