You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by je...@apache.org on 2021/11/16 23:13:49 UTC
[airflow] annotated tag helm-chart/1.3.0rc1 updated (127f669 -> 0f1eeac)
This is an automated email from the ASF dual-hosted git repository.
jedcunningham pushed a change to annotated tag helm-chart/1.3.0rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag helm-chart/1.3.0rc1 was modified! ***
from 127f669 (tag)
to 0f1eeac (tag)
tagging 6dfc939833fd3dc477b3971d965ba142d3b8bd77 (commit)
replaces helm-chart/1.1.0rc1
by Jed Cunningham
on Tue Nov 16 16:11:38 2021 -0700
- Log -----------------------------------------------------------------
Apache Airflow Helm Chart 1.3.0rc1
-----BEGIN PGP SIGNATURE-----
iQIzBAABCAAdFiEEceQtGocRZ+vS1BcnvVKfeQM9slAFAmGUOrUACgkQvVKfeQM9
slBaQRAAnLvFPFY0NBSSpE81oOSKYO6P/MambLnFgDcI+Gq7b4BL4n3jSzfSvlBU
GL/3Af1T6yQmh/n2qYcPI85wBtrZ2vE9uUW0V6GnoIRJp7WL5rjGqn4LH4rhTKkA
i0lVq9RC/GynEXRWToPsqEOYwErZbG6I7dWgj1/g7FlhZ1a/1JeW2k2YosL9hnue
HutjubI+QaMa4G4GSvsZYuKhT9EVR6LMiJGslkbU3bojizkudCDVVVRuPksYnZxG
0cCc9FKux/4Fvd9BVc5TdqSGoSL7Y//5fj4c0VYuXhxP4UYP2AcpjqwAvk9YPU9C
gpgWBFGqxyMVxANs+b25RjI7KHS1MqHtq4/uFuhJrWfkEuS9mbwtM+tA9LbXiG/v
JcWsczcnelo98vjpvQ2OcF3N/sjyB0uUHSE6/Ukt+P33RivFwS9W8ycTIRh7WKbF
w2/lwyNZ5C0nNy/JbJ9Mk0s9v50c9iYbep0YgmckP7HQMt9Aagbf26hT/Mjxw/nP
3JDLAz4fGVPkCyQJuhG45xyHsw3IfoHwFw5mHZQMkbtE1EtoOBuT9LsJVmUUHYtu
ZUNvJm+IQpUlp9Cq7p6JVvwK7Gk32Qn53783s7zFYeZTH6ctDe+C8rFW7AfijEj/
FCMM65/9MQN7JO3MvssysNBh61tzbzypKW7UQHnmsG1vu2CEz3E=
=gpJQ
-----END PGP SIGNATURE-----
-----------------------------------------------------------------------
omit c27fa93 Chart: Bump version to 1.3.0
omit d3d2a38 Add Changelog for Airflow Chart 1.3.0 (#19417)
omit 8512e05 Fix serialization of Params with set data type (#19267)
omit 4b0aeb9 Allow specifying kerberos keytab in the chart (#19054)
omit c96789b Fix log timezone in task log view (#19342) (#19401)
omit 35f3bf8 Chart: Allow disabling the Helm hooks in the helm chart (#18776)
omit 3c45c12 Fix moving of dangling TaskInstance rows for SQL Server (#19425)
omit 247d217 Chart: Use strict k8s schemas for template validation (#19379)
omit f421409 Fix typos in warnings, docstrings, exceptions (#19424)
omit 5cd8085 Add DruidOperator template_fields_renderers fields (#19420)
omit 5a113f3 Add documentation for RC2 release of Amazon provider for October (#19413)
omit e99c14e Fix field relabeling when switching between conn types (#19411)
omit 72679be Simplify "invalid TI state" message (#19029)
omit c6aed34 Fix --disable-mssql-client-installation error (#19295)
omit 96dd703 fix SagemakerProcessingOperator ThrottlingException (#19195)
omit eb12bb2 Task should fail immediately when pod is unprocessable (#19359)
omit 490a382 Ensure ``catchup=False`` is used in example dags (#19396)
omit e54ee6e Use ``execution_date`` to check for existing ``DagRun`` for ``TriggerDagRunOperator`` (#18968)
omit a3266ba Doc: Fix typos in variable and comments (#19349)
omit a373ca3 Fix downgrade for a DB Migration (#19390)
omit 059b390 Adding more Apache Airflow versions (#19392)
omit a1632ed Fix Toggle Wrap on DAG code page (#19211)
omit eace410 Improve Kubernetes Executor docs (#19339)
omit 2709153 Fix message on "Mark as" confirmation page (#19363)
omit ae04488 Cleanup of start_date and default arg use for Apache example DAGs (#18657)
omit 5c15704 Check if job object is None before calling .is_alive() (#19380)
omit 6148ddd Fix S3ToRedshiftOperator (#19358)
omit 338822b Fix PostgresHook import in tutorial (#19374)
omit 38d329b Only mark SchedulerJobs as failed, not any jobs (#19375)
omit e57c742 Tests: Refactor ``LoggingCommandExecutor`` to use subprocess devnull (#19354)
omit b18b2e5 Add Note to SLA regarding schedule_interval (#19173)
omit 37767c1 Fix hidden tooltip position (#19261)
omit 7b293c5 Make scripts/in_container/check_environment.sh Google Shell Guide Compliant (#19350)
omit 79b4bc9 Removes unused state transitions to handle auto-changing view permissions. (#19153)
omit 4299751 Enable mouse mode by default in start_airflow tmux session (#19325)
omit dc4dcaa Bugfix: Check next run exists before reading data interval (#19307)
new 6c6a1ff Add Changelog for Airflow Chart 1.3.0 (#19417)
new 1156e53 Chart: Bump version to 1.3.0
new 6dfc939 Fixup helm chart 1.3.0 changelog
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
annotated tag are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (127f669)
\
N -- N -- N refs/tags/helm-chart/1.3.0rc1 (0f1eeac)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../airflow_providers_bug_report.yml | 4 +-
BREEZE.rst | 12 --
airflow/api/common/experimental/trigger_dag.py | 6 +-
airflow/cli/commands/standalone_command.py | 5 +-
airflow/cli/commands/task_command.py | 16 +-
airflow/dag_processing/processor.py | 25 ++--
.../example_external_task_marker_dag.py | 4 +-
airflow/executors/kubernetes_executor.py | 10 +-
airflow/jobs/scheduler_job.py | 1 -
.../7b2661a43ba3_taskinstance_keyed_to_dagrun.py | 6 +-
airflow/models/dag.py | 15 +-
airflow/models/dagrun.py | 65 +++-----
airflow/models/param.py | 4 +-
airflow/models/variable.py | 2 +-
airflow/providers/amazon/CHANGELOG.rst | 5 -
airflow/providers/amazon/aws/hooks/sagemaker.py | 10 --
.../amazon/aws/operators/sagemaker_processing.py | 16 +-
airflow/providers/amazon/aws/sensors/sqs.py | 2 +-
.../amazon/aws/transfers/s3_to_redshift.py | 25 ++--
.../apache/beam/example_dags/example_beam.py | 34 ++---
.../example_dags/example_cassandra_dag.py | 26 ++--
.../apache/drill/example_dags/example_drill_dag.py | 6 +-
.../apache/druid/example_dags/example_druid_dag.py | 12 +-
airflow/providers/apache/druid/operators/druid.py | 1 -
.../hive/example_dags/example_twitter_dag.py | 6 +-
.../apache/kylin/example_dags/example_kylin_dag.py | 8 +-
.../apache/livy/example_dags/example_livy.py | 21 ++-
.../apache/pig/example_dags/example_pig.py | 5 +-
.../apache/spark/example_dags/example_spark_dag.py | 6 +-
.../google/cloud/example_dags/example_s3_to_gcs.py | 3 +-
airflow/providers/google/cloud/hooks/bigquery.py | 6 +-
.../providers/google/cloud/operators/bigquery.py | 2 +-
.../azure/example_dags/example_fileshare.py | 7 +-
.../azure/example_dags/example_local_to_adls.py | 1 -
.../azure/example_dags/example_local_to_wasb.py | 1 -
airflow/serialization/schema.json | 22 +--
airflow/serialization/serialized_objects.py | 50 ++-----
airflow/ti_deps/deps/valid_state_dep.py | 7 +-
airflow/utils/db.py | 78 +++-------
airflow/utils/sqlalchemy.py | 2 +-
airflow/www/fab_security/manager.py | 148 ++++++++++++++++++
airflow/www/security.py | 2 +-
airflow/www/static/css/main.css | 9 --
airflow/www/static/js/connection_form.js | 2 +-
airflow/www/static/js/dag_code.js | 12 +-
airflow/www/static/js/ti_log.js | 5 +-
airflow/www/templates/airflow/_messages.html | 4 +-
airflow/www/templates/airflow/dags.html | 10 +-
airflow/www/templates/airflow/main.html | 6 +-
airflow/www/templates/appbuilder/flash.html | 2 +-
breeze | 6 +-
breeze-complete | 2 +-
chart/CHANGELOG.txt | 2 -
chart/templates/jobs/create-user-job.yaml | 15 +-
chart/templates/jobs/migrate-database-job.yaml | 15 +-
chart/templates/secrets/kerberos-keytab.yaml | 35 -----
chart/templates/workers/worker-deployment.yaml | 1 -
chart/tests/helm_template_generator.py | 11 +-
chart/tests/test_create_user_job.py | 8 -
chart/tests/test_flower.py | 14 +-
chart/tests/test_kerberos.py | 35 +----
chart/tests/test_migrate_database_job.py | 8 -
chart/tests/test_webserver.py | 14 +-
chart/values.schema.json | 18 ---
chart/values.yaml | 12 --
docs/apache-airflow-providers-amazon/commits.rst | 31 ++--
.../operators.rst | 19 ++-
docs/apache-airflow/concepts/tasks.rst | 4 -
docs/apache-airflow/executor/kubernetes.rst | 166 ++++++++-------------
docs/apache-airflow/howto/timetable.rst | 2 +-
docs/apache-airflow/tutorial.rst | 2 +-
docs/helm-chart/index.rst | 11 --
docs/spelling_wordlist.txt | 1 -
scripts/in_container/bin/run_tmux | 5 -
scripts/in_container/check_environment.sh | 58 ++++---
tests/api/common/experimental/test_trigger_dag.py | 6 +-
tests/executors/test_kubernetes_executor.py | 75 +++-------
tests/jobs/test_scheduler_job.py | 31 ----
tests/models/test_dag.py | 37 -----
tests/models/test_dagrun.py | 23 ---
tests/providers/amazon/aws/hooks/test_sagemaker.py | 20 ---
.../aws/operators/test_sagemaker_processing.py | 10 +-
.../amazon/aws/transfers/test_s3_to_redshift.py | 6 +-
tests/serialization/test_dag_serialization.py | 74 +--------
tests/test_utils/logging_command_executor.py | 11 +-
tests/www/views/test_views_tasks.py | 10 +-
86 files changed, 566 insertions(+), 969 deletions(-)
delete mode 100644 chart/templates/secrets/kerberos-keytab.yaml
[airflow] 01/03: Add Changelog for Airflow Chart 1.3.0 (#19417)
Posted by je...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
jedcunningham pushed a commit to annotated tag helm-chart/1.3.0rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 6c6a1ff43a4b3db60a949da1a26cdbfc38b65a96
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Fri Nov 5 19:38:00 2021 +0000
Add Changelog for Airflow Chart 1.3.0 (#19417)
(cherry picked from commit d3d2a38059a09635ebd0dda83167d404b1860c2a)
---
chart/CHANGELOG.txt | 40 ++++++++++++++++++++++++++++++++++++++++
1 file changed, 40 insertions(+)
diff --git a/chart/CHANGELOG.txt b/chart/CHANGELOG.txt
index 4fffc46..d04fe21 100644
--- a/chart/CHANGELOG.txt
+++ b/chart/CHANGELOG.txt
@@ -1,3 +1,43 @@
+Airflow Helm Chart 1.3.0, 2021-11-08
+------------------------------------
+
+New Features
+""""""""""""
+
+- Chart: Add resources for ``cleanup`` and ``createuser`` jobs (#19263)
+- Chart: Add labels to jobs created by cleanup pods (#19225)
+- Add migration job resources (#19175)
+- Allow custom pod annotations to all components (#18481)
+- Chart: Make PgBouncer cmd/args configurable (#18910)
+- Chart: Use python 3.7 by default; support disabling triggerer (#18920)
+- Chart: Allow disabling the Helm hooks in the helm chart (#18776)
+- Allow specifying kerberos keytab in the chart (#19054)
+
+Improvements
+""""""""""""
+
+- Chart: Increase default liveness probe timeout (#19003)
+- Chart: Mount DAGs in triggerer (#18753)
+
+Bug Fixes
+"""""""""
+
+- Allow Airflow UI to create worker pod via Clear > Run (#18272)
+- Allow airflow standard images to run in openshift utilising the official helm chart #18136 (#18147)
+
+Doc only changes
+""""""""""""""""
+
+- Chart: Fix `extraEnvFrom` examples (#19144)
+- Chart docs: Update webserver secret key reference configuration (#18595)
+- Fix helm chart links in source install guide (#18588)
+
+Misc
+""""
+- Chart: Update default Airflow version to ``2.2.1`` (#19326)
+- Modernize dockerfiles builds (#19327)
+- Chart: Use strict k8s schemas for template validation (#19379)
+
Airflow Helm Chart 1.2.0, 2021-09-28
------------------------------------
[airflow] 02/03: Chart: Bump version to 1.3.0
Posted by je...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
jedcunningham pushed a commit to annotated tag helm-chart/1.3.0rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 1156e5343b45d6397830be93e05253c79c1a47f9
Author: Jed Cunningham <66...@users.noreply.github.com>
AuthorDate: Fri Nov 5 13:43:24 2021 -0600
Chart: Bump version to 1.3.0
(cherry picked from commit c27fa93e5f5af118d263eeeb883a10e03785a16f)
---
chart/Chart.yaml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/chart/Chart.yaml b/chart/Chart.yaml
index 9087239..47c7781 100644
--- a/chart/Chart.yaml
+++ b/chart/Chart.yaml
@@ -19,7 +19,7 @@
---
apiVersion: v2
name: airflow
-version: 1.3.0-dev
+version: 1.3.0
appVersion: 2.2.1
description: The official Helm chart to deploy Apache Airflow, a platform to
programmatically author, schedule, and monitor workflows
[airflow] 03/03: Fixup helm chart 1.3.0 changelog
Posted by je...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
jedcunningham pushed a commit to annotated tag helm-chart/1.3.0rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 6dfc939833fd3dc477b3971d965ba142d3b8bd77
Author: Jed Cunningham <66...@users.noreply.github.com>
AuthorDate: Tue Nov 16 16:03:15 2021 -0700
Fixup helm chart 1.3.0 changelog
---
chart/CHANGELOG.txt | 2 --
1 file changed, 2 deletions(-)
diff --git a/chart/CHANGELOG.txt b/chart/CHANGELOG.txt
index d04fe21..94ece45 100644
--- a/chart/CHANGELOG.txt
+++ b/chart/CHANGELOG.txt
@@ -10,8 +10,6 @@ New Features
- Allow custom pod annotations to all components (#18481)
- Chart: Make PgBouncer cmd/args configurable (#18910)
- Chart: Use python 3.7 by default; support disabling triggerer (#18920)
-- Chart: Allow disabling the Helm hooks in the helm chart (#18776)
-- Allow specifying kerberos keytab in the chart (#19054)
Improvements
""""""""""""