You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2020/08/13 19:01:19 UTC
[airflow] branch v1-10-test updated (ccbe56a -> 9d905da)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from ccbe56a [AIRFLOW-6706] Lazy load operator extra links (#7327) (#10318)
new d344a1c Limit all google-cloud api to <2.0.0 (#10317)
new 046eb6a Add Syntax Highlights to code-blocks in docs/best-practices.rst (#10258)
new 12a5792 Create separate section for Cron Presets (#10247)
new 9d905da Fix link for the Jinja Project in docs/tutorial.rst (#10245)
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/best-practices.rst | 6 +++---
docs/dag-run.rst | 7 +++++--
docs/tutorial.rst | 2 +-
setup.py | 26 +++++++++++++-------------
4 files changed, 22 insertions(+), 19 deletions(-)
[airflow] 04/04: Fix link for the Jinja Project in
docs/tutorial.rst (#10245)
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 9d905da7d91ce98a2a881ca3bcbab992b57f032d
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Sat Aug 8 17:32:02 2020 +0100
Fix link for the Jinja Project in docs/tutorial.rst (#10245)
`http://jinja.pocoo.org/docs/dev/` -> `https://jinja.palletsprojects.com/`
(cherry picked from commit b989cea113d05f15ee08bb2c9a483bc07d3b1f07)
---
docs/tutorial.rst | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/tutorial.rst b/docs/tutorial.rst
index 926b149..d8890e4 100644
--- a/docs/tutorial.rst
+++ b/docs/tutorial.rst
@@ -127,7 +127,7 @@ otherwise Airflow will raise an exception.
Templating with Jinja
---------------------
Airflow leverages the power of
-`Jinja Templating <http://jinja.pocoo.org/docs/dev/>`_ and provides
+`Jinja Templating <https://jinja.palletsprojects.com/>`_ and provides
the pipeline author
with a set of built-in parameters and macros. Airflow also provides
hooks for the pipeline author to define their own parameters, macros and
[airflow] 03/04: Create separate section for Cron Presets (#10247)
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 12a57929d84c1181313d9842590510d54113f68e
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Sun Aug 9 10:23:12 2020 +0100
Create separate section for Cron Presets (#10247)
(cherry picked from commit 637a2c1d8b13efd47be19d3f0087bc7ab732b9a9)
---
docs/dag-run.rst | 7 +++++--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/docs/dag-run.rst b/docs/dag-run.rst
index 9ea79ea..2885710 100644
--- a/docs/dag-run.rst
+++ b/docs/dag-run.rst
@@ -28,7 +28,10 @@ a ``str``, or a ``datetime.timedelta`` object.
.. tip::
You can use an online editor for CRON expressions such as `Crontab guru <https://crontab.guru/>`_
-Alternatively, you can also use one of these cron "presets":
+Alternatively, you can also use one of these cron "presets".
+
+Cron Presets
+''''''''''''
+----------------+----------------------------------------------------------------+-----------------+
| preset | meaning | cron |
@@ -52,7 +55,7 @@ Alternatively, you can also use one of these cron "presets":
+----------------+----------------------------------------------------------------+-----------------+
Your DAG will be instantiated for each schedule along with a corresponding
-DAG Run entry in the database backend.
+DAG Run entry in the database backend.
.. note::
[airflow] 01/04: Limit all google-cloud api to <2.0.0 (#10317)
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit d344a1c8e08cab2324f2bf3cb759ee47e5eb9dba
Author: Jarek Potiuk <ja...@polidea.com>
AuthorDate: Thu Aug 13 13:58:02 2020 +0200
Limit all google-cloud api to <2.0.0 (#10317)
Google Cloud APIs introduced breaking changes in 2.0.0
(https://github.com/googleapis/python-container/blob/master/UPGRADING.md)
and they already caused a number of changes. We should (for now - before
we migrate to 2.0+ ) limit all our google-cloud deps to <2.0.0
Fixes #10316
(cherry picked from commit a74a7da2c4cd668357ac5e16f052e05b77064add)
---
setup.py | 26 +++++++++++++-------------
1 file changed, 13 insertions(+), 13 deletions(-)
diff --git a/setup.py b/setup.py
index e16b1cd..159a420 100644
--- a/setup.py
+++ b/setup.py
@@ -251,21 +251,21 @@ flask_oauth = [
]
gcp = [
'PyOpenSSL',
- 'google-api-python-client>=1.6.0, <2.0.0dev',
- 'google-auth>=1.0.0, <2.0.0dev',
+ 'google-api-python-client>=1.6.0, <2.0.0',
+ 'google-auth>=1.0.0, <2.0.0',
'google-auth-httplib2>=0.0.1',
- 'google-cloud-bigtable>=1.0.0',
- 'google-cloud-container>=0.1.1,<2.0',
- 'google-cloud-dlp>=0.11.0',
- 'google-cloud-language>=1.1.1',
- 'google-cloud-secret-manager>=0.2.0',
- 'google-cloud-spanner>=1.10.0',
- 'google-cloud-speech>=0.36.3',
- 'google-cloud-storage>=1.16',
+ 'google-cloud-bigtable>=1.0.0,<2.0.0',
+ 'google-cloud-container>=0.1.1,<2.0.0',
+ 'google-cloud-dlp>=0.11.0,<2.0.0',
+ 'google-cloud-language>=1.1.1,<2.0.0',
+ 'google-cloud-secret-manager>=0.2.0,<2.0.0',
+ 'google-cloud-spanner>=1.10.0,<2.0.0',
+ 'google-cloud-speech>=0.36.3,<2.0.0',
+ 'google-cloud-storage>=1.16,<2.0.0',
'google-cloud-texttospeech>=0.4.0,<2',
- 'google-cloud-translate>=1.3.3',
- 'google-cloud-videointelligence>=1.7.0',
- 'google-cloud-vision>=0.35.2',
+ 'google-cloud-translate>=1.3.3,<2.0.0',
+ 'google-cloud-videointelligence>=1.7.0,<2.0.0',
+ 'google-cloud-vision>=0.35.2,<2.0.0',
'grpcio-gcp>=0.2.2',
'pandas-gbq',
]
[airflow] 02/04: Add Syntax Highlights to code-blocks in
docs/best-practices.rst (#10258)
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 046eb6a6a77daf1e60063a796d9416221ecae3dd
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Sun Aug 9 12:18:58 2020 +0100
Add Syntax Highlights to code-blocks in docs/best-practices.rst (#10258)
(cherry picked from commit e0548706892216a2883afacd3dd00ca66add3d32)
---
docs/best-practices.rst | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/docs/best-practices.rst b/docs/best-practices.rst
index fe25977..2ffb052 100644
--- a/docs/best-practices.rst
+++ b/docs/best-practices.rst
@@ -261,7 +261,7 @@ Once you have changed the backend, airflow needs to create all the tables requir
Create an empty DB and give airflow's user the permission to ``CREATE/ALTER`` it.
Once that is done, you can run -
-.. code-block::
+.. code-block:: bash
airflow upgradedb
@@ -305,14 +305,14 @@ Airflow comes bundles with a default ``airflow.cfg`` configuration file.
You should use environment variables for configurations that change across deployments
e.g. metadata DB, password. You can do it using the format ``$AIRFLOW__{SECTION}__{KEY}``
-.. code-block::
+.. code-block:: bash
AIRFLOW__CORE__SQL_ALCHEMY_CONN=my_conn_id
AIRFLOW__WEBSERVER__BASE_URL=http://host:port
Some configurations such as Airflow Backend connection URI can be derived from bash commands as well:
-.. code-block::
+.. code-block:: ini
sql_alchemy_conn_cmd = bash_command_to_run