You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2021/04/09 20:36:40 UTC
[airflow] branch v2-0-test updated (f074bcf -> 0e2f295)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch v2-0-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from f074bcf Better compatibility/diagnostics for arbitrary UID in docker image (#15162)
new 4bb8876 Bugfix: resources in `executor_config` breaks Graph View in UI (#15199)
new dda7c5c Replace new url for Stable Airflow Docs (#15169)
new 0e2f295 Fix Providers doc (#15185)
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
UPDATING.md | 4 ++--
airflow/config_templates/config.yml | 2 +-
airflow/config_templates/default_airflow.cfg | 2 +-
airflow/utils/json.py | 2 +-
.../operators/azure_blob_to_gcs.rst | 2 +-
docs/apache-airflow-providers/index.rst | 2 +-
6 files changed, 7 insertions(+), 7 deletions(-)
[airflow] 01/03: Bugfix: resources in `executor_config` breaks
Graph View in UI (#15199)
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v2-0-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 4bb8876ecb9547862e6134f83293f39dded7c9c2
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Mon Apr 5 12:41:29 2021 +0100
Bugfix: resources in `executor_config` breaks Graph View in UI (#15199)
closes https://github.com/apache/airflow/issues/14327
When using `KubernetesExecutor` and the task as follows:
```python
PythonOperator(
task_id=f"sync_{table_name}",
python_callable=sync_table,
provide_context=True,
op_kwargs={"table_name": table_name},
executor_config={"KubernetesExecutor": {"request_cpu": "1"}},
retries=5,
dag=dag,
)
```
it breaks the UI as settings resources in such a way is only there
for backwards compatibility.
This commits fixes it.
(cherry picked from commit 7b577c35e241182f3f3473ca02da197f1b5f7437)
---
airflow/utils/json.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/airflow/utils/json.py b/airflow/utils/json.py
index 45dda75..8e22408 100644
--- a/airflow/utils/json.py
+++ b/airflow/utils/json.py
@@ -66,7 +66,7 @@ class AirflowJsonEncoder(JSONEncoder):
obj, (np.float_, np.float16, np.float32, np.float64, np.complex_, np.complex64, np.complex128)
):
return float(obj)
- elif k8s is not None and isinstance(obj, k8s.V1Pod):
+ elif k8s is not None and isinstance(obj, (k8s.V1Pod, k8s.V1ResourceRequirements)):
from airflow.kubernetes.pod_generator import PodGenerator
return PodGenerator.serialize_pod(obj)
[airflow] 03/03: Fix Providers doc (#15185)
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v2-0-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 0e2f29512881ef24f6761e7314bebeeee9acf600
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Sun Apr 4 16:12:58 2021 +0100
Fix Providers doc (#15185)
`pip pip install -e /path/to/my-package` -> `pip install -e /path/to/my-package`
(cherry picked from commit dc969685011938f0fb692c36918a7f0feb26472a)
---
docs/apache-airflow-providers/index.rst | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/apache-airflow-providers/index.rst b/docs/apache-airflow-providers/index.rst
index 222112f..81e02fa 100644
--- a/docs/apache-airflow-providers/index.rst
+++ b/docs/apache-airflow-providers/index.rst
@@ -248,7 +248,7 @@ When running airflow with your provider package, there will be (at least) three
together with the related files (e.g. ``dags`` folder)
* The ``apache-airflow`` package
* Your own ``myproviderpackage`` package that is independent of ``apache-airflow`` or your airflow installation, which
- can be a local Python package (that you install via ``pip pip install -e /path/to/my-package``), a normal pip package
+ can be a local Python package (that you install via ``pip install -e /path/to/my-package``), a normal pip package
(``pip install myproviderpackage``), or any other type of Python package
In the ``myproviderpackage`` package you need to add the entry point and provide the appropriate metadata as described above.
[airflow] 02/03: Replace new url for Stable Airflow Docs (#15169)
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v2-0-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit dda7c5c7e32d0b0b87026d2a0f78b6911fcd673e
Author: Kaxil Naik <ka...@gmail.com>
AuthorDate: Sun Apr 4 16:13:34 2021 +0100
Replace new url for Stable Airflow Docs (#15169)
`https://airflow.apache.org/docs/stable/` -> `https://airflow.apache.org/docs/apache-airflow/stable`
(cherry picked from commit 64b00896d905abcf1fbae195a29b81f393319c5f)
---
UPDATING.md | 4 ++--
airflow/config_templates/config.yml | 2 +-
airflow/config_templates/default_airflow.cfg | 2 +-
.../operators/azure_blob_to_gcs.rst | 2 +-
4 files changed, 5 insertions(+), 5 deletions(-)
diff --git a/UPDATING.md b/UPDATING.md
index d024d51..7966f58 100644
--- a/UPDATING.md
+++ b/UPDATING.md
@@ -204,7 +204,7 @@ from my_plugin import MyOperator
The name under `airflow.operators.` was the plugin name, where as in the second example it is the python module name where the operator is defined.
-See https://airflow.apache.org/docs/stable/howto/custom-operator.html for more info.
+See https://airflow.apache.org/docs/apache-airflow/stable/howto/custom-operator.html for more info.
### Importing Hooks via plugins is no longer supported
@@ -222,7 +222,7 @@ from my_plugin import MyHook
It is still possible (but not required) to "register" hooks in plugins. This is to allow future support for dynamically populating the Connections form in the UI.
-See https://airflow.apache.org/docs/stable/howto/custom-operator.html for more info.
+See https://airflow.apache.org/docs/apache-airflow/stable/howto/custom-operator.html for more info.
### Adding Operators and Sensors via plugins is no longer supported
diff --git a/airflow/config_templates/config.yml b/airflow/config_templates/config.yml
index c53a6ca..32694e4 100644
--- a/airflow/config_templates/config.yml
+++ b/airflow/config_templates/config.yml
@@ -718,7 +718,7 @@
- name: auth_backend
description: |
How to authenticate users of the API. See
- https://airflow.apache.org/docs/stable/security.html for possible values.
+ https://airflow.apache.org/docs/apache-airflow/stable/security.html for possible values.
("airflow.api.auth.backend.default" allows all requests for historic reasons)
version_added: ~
type: string
diff --git a/airflow/config_templates/default_airflow.cfg b/airflow/config_templates/default_airflow.cfg
index 8e3ebf0..7685457 100644
--- a/airflow/config_templates/default_airflow.cfg
+++ b/airflow/config_templates/default_airflow.cfg
@@ -384,7 +384,7 @@ fail_fast = False
enable_experimental_api = False
# How to authenticate users of the API. See
-# https://airflow.apache.org/docs/stable/security.html for possible values.
+# https://airflow.apache.org/docs/apache-airflow/stable/security.html for possible values.
# ("airflow.api.auth.backend.default" allows all requests for historic reasons)
auth_backend = airflow.api.auth.backend.deny_all
diff --git a/docs/apache-airflow-providers-microsoft-azure/operators/azure_blob_to_gcs.rst b/docs/apache-airflow-providers-microsoft-azure/operators/azure_blob_to_gcs.rst
index 11daa03..7b13097 100644
--- a/docs/apache-airflow-providers-microsoft-azure/operators/azure_blob_to_gcs.rst
+++ b/docs/apache-airflow-providers-microsoft-azure/operators/azure_blob_to_gcs.rst
@@ -31,7 +31,7 @@ Please follow Azure
to do it.
TOKEN should be added to the Connection in Airflow in JSON format, Login and Password as plain text.
-You can check `how to do such connection <https://airflow.apache.org/docs/stable/howto/connection/index.html#editing-a-connection-with-the-ui>`_.
+You can check `how to do such connection <https://airflow.apache.org/docs/apache-airflow/stable/howto/connection/index.html#editing-a-connection-with-the-ui>`_.
See following example.
Set values for these fields: