You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2020/04/10 17:23:14 UTC

[airflow-site] 01/01: Add more info in 1.10.10 blogpost

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch add-more-info
in repository https://gitbox.apache.org/repos/asf/airflow-site.git

commit 3483b43325f771ccfe03fb61d0cc418a8b7f5f9f
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Fri Apr 10 18:22:29 2020 +0100

    Add more info in 1.10.10 blogpost
---
 .../site/content/en/blog/airflow-1.10.10/index.md  |  42 +++++++++++++++++++--
 .../en/blog/airflow-1.10.10/trigger-dag-conf.png   | Bin 0 -> 157871 bytes
 2 files changed, 39 insertions(+), 3 deletions(-)

diff --git a/landing-pages/site/content/en/blog/airflow-1.10.10/index.md b/landing-pages/site/content/en/blog/airflow-1.10.10/index.md
index 531240b..a004ca7 100644
--- a/landing-pages/site/content/en/blog/airflow-1.10.10/index.md
+++ b/landing-pages/site/content/en/blog/airflow-1.10.10/index.md
@@ -18,13 +18,14 @@ Airflow 1.10.10 contains 199 commits since 1.10.9 and includes 11 new features,
 * **Docs**: [https://airflow.apache.org/docs/1.10.10/](https://airflow.apache.org/docs/1.10.10/)
 * **Changelog**: [http://airflow.apache.org/docs/1.10.10/changelog.html](http://airflow.apache.org/docs/1.10.10/changelog.html)
 
-Some of the noteworthy new features (user-facing) are:
+Some of the noteworthy new features & improvements are:
 
 - [Allow user to chose timezone to use in the RBAC UI](https://github.com/apache/airflow/pull/8046)
 - [Add Production Docker image support](https://github.com/apache/airflow/pull/7832)
 - [Allow Retrieving Airflow Connections & Variables from various Secrets backend](http://airflow.apache.org/docs/1.10.10/howto/use-alternative-secrets-backend.html)
 - [Stateless Webserver using DAG Serialization](http://airflow.apache.org/docs/1.10.10/dag-serialization.html)
-
+- [Dummy Operators are no longer sent to executor](https://github.com/apache/airflow/pull/7880)
+- [Allow passing DagRun conf when triggering dags via UI](https://github.com/apache/airflow/pull/6256)
 
 ### Allow user to chose timezone to use in the RBAC UI
 
@@ -85,6 +86,41 @@ backend = airflow.contrib.secrets.hashicorp_vault.VaultBackend
 backend_kwargs = {"url": "http://127.0.0.1:8200", "connections_path": "connections", "variables_path": "variables", "mount_point": "airflow"}
 ```
 
+### Stateless Webserver using DAG Serialization
+
+The Webserver can now run without access to DAG Files when DAG Serialization is turned on.
+The 2 limitations we had in 1.10.7-1.10.9 (
+https://airflow.apache.org/docs/1.10.7/dag-serialization.html#limitations)
+have been resolved.
+
+The main advantage of this would be reduction in Webserver startup time for large number of DAGs.
+Without DAG Serialization all the DAGs are loaded in the DagBag during the
+Webserver startup.
+
+With DAG Serialization, an empty DagBag is created and
+Dags are loaded from DB only when needed (i.e. when a particular DAG is
+clicked on in the home page)
+
+Details: http://airflow.apache.org/docs/1.10.10/dag-serialization.html
+
+### Dummy Operators are no longer sent to executor
+
+The Dummy operators does not actually do any work and are mostly used for organizing/grouping tasks along
+with BranchPythonOperator.
+
+Previously, when using Kubernetes Executor, the executor would spin up a whole worker pod to execute a dummy task.
+With Airflow 1.10.10 tasks using Dummy Operators would be scheduled & evaluated by the Scheduler but not sent to the
+Executor. This should significantly improve execution time and resource usage.
+
+### Allow passing DagRun conf when triggering dags via UI
+
+When triggering a DAG from the CLI or the REST API, it s possible to pass configuration for the DAG run as a JSON blob.
+
+From Airflow 1.10.10, when a user clicks on Trigger Dag button, a new screen confirming the trigger request, and allowing the user to pass a JSON configuration
+blob would be show.
+
+**Screenshot**:
+![Allow passing DagRun conf when triggering dags via UI](trigger-dag-conf.png)
 
 ## Updating Guide
 
@@ -122,7 +158,7 @@ We strongly recommend users to use Python >= 3.6
 ### Use Airflow RBAC UI
 Airflow 1.10.10 ships with 2 UIs, the default is non-RBAC Flask-admin based UI and Flask-appbuilder based UI.
 
-The Flask-AppBuilder (FAB) based UI is allows Role-based Access Control and has more advanced features compared to
+The Flask-AppBuilder (FAB) based UI allows Role-based Access Control and has more advanced features compared to
 the legacy Flask-admin based UI. This UI can be enabled by setting `rbac=True` in `[webserver]` section in your `airflow.cfg`.
 
 Flask-admin based UI is deprecated and new features won't be ported to it. This UI will still be the default
diff --git a/landing-pages/site/content/en/blog/airflow-1.10.10/trigger-dag-conf.png b/landing-pages/site/content/en/blog/airflow-1.10.10/trigger-dag-conf.png
new file mode 100644
index 0000000..40f1f54
Binary files /dev/null and b/landing-pages/site/content/en/blog/airflow-1.10.10/trigger-dag-conf.png differ