You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2020/12/31 20:23:53 UTC
[airflow] branch master updated: Adding documentation explaining "strange" URI required when using AWS… (#13355)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new d202fd4 Adding documentation explaining "strange" URI required when using AWS… (#13355)
d202fd4 is described below
commit d202fd47fa5025bd6ea3296f9a731b40acac52e5
Author: Kuba Tyszko <ku...@lbl.pl>
AuthorDate: Thu Dec 31 12:23:42 2020 -0800
Adding documentation explaining "strange" URI required when using AWS… (#13355)
---
.../secrets-backends/aws-ssm-parameter-store.rst | 10 ++++++++++
docs/spelling_wordlist.txt | 1 +
2 files changed, 11 insertions(+)
diff --git a/docs/apache-airflow-providers-amazon/secrets-backends/aws-ssm-parameter-store.rst b/docs/apache-airflow-providers-amazon/secrets-backends/aws-ssm-parameter-store.rst
index c1d7072..3d06525 100644
--- a/docs/apache-airflow-providers-amazon/secrets-backends/aws-ssm-parameter-store.rst
+++ b/docs/apache-airflow-providers-amazon/secrets-backends/aws-ssm-parameter-store.rst
@@ -58,6 +58,16 @@ Optionally you can supply a profile name to reference aws profile, e.g. defined
The value of the SSM parameter must be the :ref:`connection URI representation <generating_connection_uri>`
of the connection object.
+In some cases, URI's you will need stored in Secrets Manager may not be intuitive, for example when using HTTP / HTTPS or SPARK, you may need URI's that will look like this:
+
+http://https%3A%2F%2Fexample.com
+
+spark://spark%3A%2F%2Fspark-master-0.spark-master.spark:7077
+
+This is a known situation, where schema and protocol parts of the URI are independent and in some cases, need to be specified explicitly.
+
+See https://github.com/apache/airflow/pull/10256 and https://github.com/apache/airflow/issues/10913 for more detailed discussion that led to this documentation update. This may get resolved in the future.
+
Storing and Retrieving Variables
""""""""""""""""""""""""""""""""
diff --git a/docs/spelling_wordlist.txt b/docs/spelling_wordlist.txt
index 5e01212..c3fea3b 100644
--- a/docs/spelling_wordlist.txt
+++ b/docs/spelling_wordlist.txt
@@ -1204,6 +1204,7 @@ sourceUploadUrl
sparkApplication
sparkcmd
sparksql
+Fspark
spegno
spotahome
sql