You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by di...@apache.org on 2021/02/05 18:11:00 UTC
[airflow] branch fix-env-from-1-10 updated (eeb3833 -> c1f5768)
This is an automated email from the ASF dual-hosted git repository.
dimberman pushed a change to branch fix-env-from-1-10
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard eeb3833 fix pod test
discard 25d3afc simplify pod_mutation_backcompat
discard b7df326 KubernetesExecutor overrides should only append to lists
add 3869ed2 Do not allow yanked version of Airflow in upgrade-check tool (#13160)
add a1f5b08 Fix "airflow db upgrade" to upgrade db as intended (#13267)
add 022f9e2 Moved boto3 limitation to snowflake (#13286)
add 748d05f Fix Jinja undefined upgrade check for non-templated objects (#13373)
add e6eb5e7 Add upgrade check option to list checks (#13392)
add 8ea0a38 Update URL for docs (#13561)
add ee88f5f KubernetesExecutor should accept images from executor_config (#13074)
add fb84ebe Created CustomExecutorsRequireFullPathRule class (#13678)
add b4de6be Scheduler should acknowledge active runs properly (#13803)
add 5d642a3 Bugfix: Unable to import Airflow plugins on Python 3.8 (#12859)
add f9c5a7f Requirements shoudl be removed. Sufficient time passed.
add efca0c0 Enable PIP check for both CI and PROD image (#12664)
add c89d2f5 Improve wording of selective checks comments (#12701)
add 2ee3cfd User-friendly output of Breeze and CI scripts (#12735)
add c4e4f4b Fix chart jobs delete policy for improved idempotency (#12646)
add aff9f15 Artifacts in Github Action have a short retention period (#12793)
add 57ba578 Adds airflow as viable docker command in official image (#12878)
add fa8b833 Clarifies version args for installing 1.10 in Docker (#12875)
add 8f3379f Builds prod images on DockerHub from packages (#12908)
add 7921d98 Apply labels to Docker images in a single instruction (#12931)
add 908bf3a Update CI to run tests againt v2-0-test branch (#10891)
add 28a8706 Update CI to run tests againt v2-0-test branch (#10891)
add 9ed745a Update Dockerfile.ci (#12988)
add 5671964 Update Dockerfile (#12987)
add fdd971a Add changes from 1.10.14 (#12993)
add 6ab4864 Changes release image preparation to use PyPI packages (#12990)
add baa832c Fix gpg verification command (#13035)
add d926698 Install airflow and providers from dist and verifies them (#13033)
add be46665 Fixes image building in DockerHub (#13039)
add 5b17a82 Allows to install Airflow in Breeze from PIP with configurable extras (#13055)
add 3624fe1 Add identity pre-commit hook (#13089)
add b52283e Production images on CI are now built from packages (#12685)
add f613005 Skip identity pre-commit in ci and always display it first
add 60ac8df Include airflow/contrib/executors in the dist package
add 5441f9c Reset PIP version after eager upgrade (#13251)
add 7ae912d Click should be limited for Python 2.7
add ba3b8ef Default python version is used when building image
add d25b6c5 The default value in chart should be 2.0.0 (#13125)
add 40f5f04 Use new logging options on values.yaml (#13173)
add f9993c4 Fix parenthesis preventing Keda ScaledObject creation (#13183)
add e305cc8 Update chart readme to remove astronomer references (#13210)
add 9efe9a6 Allow webserver to read pod logs directly (#12598)
add 68630dc Switch to Apache-owned GitHub actions (#13327)
add 1c17b79 Also add codecov action to apache airflow repo (#13328)
add 8be1872 Disable persisting credentials in Github Action's checkout (#13389)
add d581281 Run "third party" github actions from submodules instead (#13514)
add 7a3bf15 Fix test for Airflow docs (#13561)
add 800e630 Fix test broken by #13392
add 07f6f30 StreamLogWriter: Provide (no-op) close method (#10885)
add 48daabc Ensure all statsd timers use millisecond values. (#10633)
add 3de7036 Add clearer exception for read failures in macro plugin upgrade check (#13371)
add 4672602 Restores accidentally removed kerberos authenttication
add dc73f34 Remove UndefinedJinjaVariableRule
add 6373a5e Upgrade tool: skip bad file test for Python 2.7 (#13981)
add fe767e6 Update Mongodb inventory URL to fix docs build (#13939) (#13991)
add df0ee79 Created rule for SparkJDBCOperator class conn_id (#13798)
add bdae805 Treat default value in HostnameCallable rule as good one (#13670)
add 8c239b7 Created DatabaseVersionCheckRule class (#13955)
add 28a6a08 [kubernetes_generate_dag_yaml] - Fix dag yaml generate func (#13816)
add e89756f KubernetesExecutor overrides should only append to lists
add 2073bd3 simplify pod_mutation_backcompat
add c1f5768 fix pod test
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (eeb3833)
\
N -- N -- N refs/heads/fix-env-from-1-10 (c1f5768)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.dockerignore | 3 +-
.github/actions/cancel-workflow-runs | 1 +
.github/actions/checks-action | 1 +
.github/actions/codecov-action | 1 +
.github/actions/configure-aws-credentials | 1 +
.github/actions/get-workflow-origin | 1 +
.github/actions/github-push-action | 1 +
.github/actions/label-when-approved-action | 1 +
.github/workflows/build-images-workflow-run.yml | 68 +-
.github/workflows/ci.yml | 107 +-
.github/workflows/codeql-analysis.yml | 2 +
.github/workflows/delete_old_artifacts.yml | 31 -
.../workflows/label_when_reviewed_workflow_run.yml | 49 +-
.github/workflows/scheduled_quarantined.yml | 5 +-
.gitmodules | 21 +
.pre-commit-config.yaml | 9 +-
BREEZE.rst | 220 ++-
CI.rst | 27 +-
CONTRIBUTING.rst | 14 +-
Dockerfile | 120 +-
Dockerfile.ci | 41 +-
IMAGES.rst | 73 +-
LOCAL_VIRTUALENV.rst | 25 +
README.md | 27 +-
STATIC_CODE_CHECKS.rst | 2 +
airflow/bin/cli.py | 7 +-
.../contrib/executors}/__init__.py | 0
airflow/jobs/scheduler_job.py | 1 +
airflow/kubernetes/pod_generator.py | 8 +-
airflow/models/dagbag.py | 4 +-
airflow/models/dagrun.py | 2 +-
airflow/models/taskinstance.py | 2 +-
airflow/upgrade/checker.py | 24 +-
airflow/upgrade/rules/__init__.py | 4 +-
.../upgrade/rules/airflow_macro_plugin_removed.py | 11 +-
.../custom_executors_require_full_path_rule.py | 43 +
airflow/upgrade/rules/hostname_callable_rule.py | 7 +-
.../postgres_mysql_sqlite_version_upgrade_check.py | 58 +
.../rules/spark_jdbc_operator_conn_id_rule.py | 44 +
airflow/upgrade/rules/undefined_jinja_varaibles.py | 153 --
airflow/upgrade/setup.cfg | 2 +-
airflow/utils/dag_processing.py | 4 +-
airflow/utils/log/logging_mixin.py | 8 +
airflow/www/app.py | 4 +-
airflow/www_rbac/app.py | 4 +-
breeze | 232 ++-
breeze-complete | 22 +-
chart/README.md | 39 +-
chart/templates/create-user-job.yaml | 2 +-
chart/templates/migrate-database-job.yaml | 2 +-
...launcher-role.yaml => pod-log-reader-role.yaml} | 16 +-
...inding.yaml => pod-log-reader-rolebinding.yaml} | 21 +-
chart/templates/workers/worker-kedaautoscaler.yaml | 2 +-
chart/tests/helm_template_generator.py | 7 +-
chart/tests/test_basic_helm_chart.py | 4 +-
chart/tests/test_keda.py | 57 +
chart/values.schema.json | 4 +
chart/values.yaml | 13 +-
codecov.yml | 72 +
dev/README.md | 1511 +-------------------
dev/README_RELEASE_AIRFLOW.md | 733 ++++++++++
docker-context-files/README.md | 2 +-
docs/conf.py | 5 +-
docs/production-deployment.rst | 274 ++--
requirements/REMOVE.md | 22 -
requirements/requirements-python2.7.txt | 343 -----
requirements/requirements-python3.5.txt | 326 -----
requirements/requirements-python3.6.txt | 333 -----
requirements/requirements-python3.7.txt | 330 -----
requirements/requirements-python3.8.txt | 329 -----
requirements/setup-2.7.md5 | 1 -
requirements/setup-3.5.md5 | 1 -
requirements/setup-3.6.md5 | 1 -
requirements/setup-3.7.md5 | 1 -
requirements/setup-3.8.md5 | 1 -
.../ci_build_airflow_package.sh} | 12 +-
scripts/ci/constraints/ci_branch_constraints.sh | 2 +
.../ci/{libraries => docker-compose}/_docker.env | 50 +-
scripts/ci/docker-compose/base.yml | 43 +-
scripts/ci/docker-compose/files.yml | 1 +
scripts/ci/docker-compose/local-prod.yml | 9 +-
scripts/ci/docker-compose/local.yml | 1 -
scripts/ci/images/ci_build_dockerhub.sh | 103 +-
scripts/ci/images/ci_prepare_prod_image_on_ci.sh | 15 +-
scripts/ci/images/ci_verify_ci_image.sh | 6 +-
scripts/ci/images/ci_verify_prod_image.sh | 19 +-
scripts/ci/images/ci_wait_for_ci_image.sh | 17 +
scripts/ci/images/ci_wait_for_prod_image.sh | 18 +
scripts/ci/libraries/_all_libs.sh | 2 +
.../_build_airflow_packages.sh} | 41 +-
scripts/ci/libraries/_build_images.sh | 249 ++--
scripts/ci/libraries/_initialization.sh | 112 +-
scripts/ci/libraries/_kind.sh | 30 +-
scripts/ci/libraries/_local_mounts.sh | 1 -
scripts/ci/libraries/_parameters.sh | 18 +-
scripts/ci/libraries/_push_pull_remove_images.sh | 38 +-
scripts/ci/libraries/_repeats.sh | 13 +-
scripts/ci/libraries/_runs.sh | 17 +-
scripts/ci/libraries/_sanity_checks.sh | 68 +-
.../ci/pre_commit/pre_commit_check_pre_commits.sh | 40 +-
scripts/ci/pre_commit/pre_commit_mermaid.sh | 6 +-
scripts/ci/selective_ci_checks.sh | 8 +-
scripts/ci/static_checks/check_license.sh | 17 +-
scripts/ci/testing/ci_run_airflow_testing.sh | 5 +-
scripts/ci/tools/ci_clear_tmp.sh | 2 +-
scripts/ci/tools/ci_fix_ownership.sh | 2 +-
scripts/in_container/_in_container_script_init.sh | 6 +-
scripts/in_container/_in_container_utils.sh | 287 +++-
scripts/in_container/check_environment.sh | 57 +-
scripts/in_container/configure_environment.sh | 3 -
scripts/in_container/entrypoint_ci.sh | 71 +-
scripts/in_container/entrypoint_exec.sh | 3 +
scripts/in_container/prod/entrypoint_prod.sh | 22 +-
scripts/in_container/run_ci_tests.sh | 83 +-
scripts/in_container/run_cli_tool.sh | 20 +-
scripts/in_container/run_system_tests.sh | 2 +
setup.py | 7 +-
tests/bats/breeze/test_breeze_complete.bats | 8 +
tests/bats/breeze/test_breeze_params.bats | 17 +-
tests/bats/in_container/test_in_container.bats | 2 +
tests/kubernetes/test_pod_generator.py | 91 +-
.../rules/test_airflow_macro_plugin_removed.py | 54 +-
tests/upgrade/rules/test_base_rule.py | 16 +
...test_custom_executors_require_full_path_rule.py | 53 +
..._postgres_mysql_sqlite_version_upgrade_check.py | 115 ++
...ark_jdbc_operator_conn_id_default_name_rule.py} | 35 +-
.../rules/test_undefined_jinja_varaibles.py | 194 ---
tests/upgrade/test_formattes.py | 5 +-
tests/utils/test_logging_mixin.py | 7 +
tests/www_rbac/test_views.py | 4 +-
130 files changed, 3456 insertions(+), 4618 deletions(-)
create mode 160000 .github/actions/cancel-workflow-runs
create mode 160000 .github/actions/checks-action
create mode 160000 .github/actions/codecov-action
create mode 160000 .github/actions/configure-aws-credentials
create mode 160000 .github/actions/get-workflow-origin
create mode 160000 .github/actions/github-push-action
create mode 160000 .github/actions/label-when-approved-action
delete mode 100644 .github/workflows/delete_old_artifacts.yml
create mode 100644 .gitmodules
copy {tests/www_rbac/api/experimental => airflow/contrib/executors}/__init__.py (100%)
create mode 100644 airflow/upgrade/rules/custom_executors_require_full_path_rule.py
create mode 100644 airflow/upgrade/rules/postgres_mysql_sqlite_version_upgrade_check.py
create mode 100644 airflow/upgrade/rules/spark_jdbc_operator_conn_id_rule.py
delete mode 100644 airflow/upgrade/rules/undefined_jinja_varaibles.py
copy chart/templates/rbac/{pod-launcher-role.yaml => pod-log-reader-role.yaml} (84%)
copy chart/templates/rbac/{pod-cleanup-rolebinding.yaml => pod-log-reader-rolebinding.yaml} (71%)
create mode 100644 chart/tests/test_keda.py
create mode 100644 codecov.yml
create mode 100644 dev/README_RELEASE_AIRFLOW.md
delete mode 100644 requirements/REMOVE.md
delete mode 100644 requirements/requirements-python2.7.txt
delete mode 100644 requirements/requirements-python3.5.txt
delete mode 100644 requirements/requirements-python3.6.txt
delete mode 100644 requirements/requirements-python3.7.txt
delete mode 100644 requirements/requirements-python3.8.txt
delete mode 100644 requirements/setup-2.7.md5
delete mode 100644 requirements/setup-3.5.md5
delete mode 100644 requirements/setup-3.6.md5
delete mode 100644 requirements/setup-3.7.md5
delete mode 100644 requirements/setup-3.8.md5
copy scripts/ci/{static_checks/helm_lint.sh => build_airflow/ci_build_airflow_package.sh} (79%)
rename scripts/ci/{libraries => docker-compose}/_docker.env (76%)
copy scripts/ci/{static_checks/mypy.sh => libraries/_build_airflow_packages.sh} (54%)
mode change 100755 => 100644
create mode 100644 tests/upgrade/rules/test_custom_executors_require_full_path_rule.py
create mode 100644 tests/upgrade/rules/test_postgres_mysql_sqlite_version_upgrade_check.py
copy tests/upgrade/rules/{test_conn_type_is_not_nullable.py => test_spark_jdbc_operator_conn_id_default_name_rule.py} (50%)
delete mode 100644 tests/upgrade/rules/test_undefined_jinja_varaibles.py