You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2021/04/23 08:09:13 UTC
[airflow-site] branch fix-airflow-versions-in-docker-stack-docs
created (now 13b196e)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch fix-airflow-versions-in-docker-stack-docs
in repository https://gitbox.apache.org/repos/asf/airflow-site.git.
at 13b196e Updates version to 2.0.2 also in the docker-stack part
This branch includes the following new commits:
new 13b196e Updates version to 2.0.2 also in the docker-stack part
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[airflow-site] 01/01: Updates version to 2.0.2 also in the
docker-stack part
Posted by po...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch fix-airflow-versions-in-docker-stack-docs
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
commit 13b196ed8cf6b67693fcf9c86f2795bae762b5e0
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Fri Apr 23 10:08:13 2021 +0200
Updates version to 2.0.2 also in the docker-stack part
---
docs-archive/docker-stack/build-arg-ref.html | 4 +--
docs-archive/docker-stack/build.html | 40 ++++++++++++++--------------
docs-archive/docker-stack/recipes.html | 4 +--
3 files changed, 24 insertions(+), 24 deletions(-)
diff --git a/docs-archive/docker-stack/build-arg-ref.html b/docs-archive/docker-stack/build-arg-ref.html
index bcf4336..609a1a9 100644
--- a/docs-archive/docker-stack/build-arg-ref.html
+++ b/docs-archive/docker-stack/build-arg-ref.html
@@ -595,7 +595,7 @@ Those arguments are used when you want to customize the image. You can see some
<td><p>Base python image.</p></td>
</tr>
<tr class="row-odd"><td><p><code class="docutils literal notranslate"><span class="pre">AIRFLOW_VERSION</span></code></p></td>
-<td><p><code class="docutils literal notranslate"><span class="pre">2.0.1</span></code></p></td>
+<td><p><code class="docutils literal notranslate"><span class="pre">2.0.2</span></code></p></td>
<td><p>version of Airflow.</p></td>
</tr>
<tr class="row-even"><td><p><code class="docutils literal notranslate"><span class="pre">AIRFLOW_EXTRAS</span></code></p></td>
@@ -646,7 +646,7 @@ versions of <code class="docutils literal notranslate"><span class="pre">constra
2.0.* installation. In case of building
specific version you want to point it
to specific tag, for example
-<code class="docutils literal notranslate"><span class="pre">constraints-2.0.1</span></code>.
+<code class="docutils literal notranslate"><span class="pre">constraints-2.0.2</span></code>.
Auto-detected if empty.</p></td>
</tr>
</tbody>
diff --git a/docs-archive/docker-stack/build.html b/docs-archive/docker-stack/build.html
index 6fb7429..ef84de3 100644
--- a/docs-archive/docker-stack/build.html
+++ b/docs-archive/docker-stack/build.html
@@ -745,7 +745,7 @@ group for airflow user:</p>
<p>The following example adds <code class="docutils literal notranslate"><span class="pre">vim</span></code> to the airflow image.</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/extending/add-apt-packages/Dockerfile</span></p>
-<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.1</span>
+<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.2</span>
<span class="k">USER</span><span class="s"> root</span>
<span class="k">RUN</span> apt-get update <span class="se">\</span>
<span class="o">&&</span> apt-get install -y --no-install-recommends <span class="se">\</span>
@@ -763,7 +763,7 @@ group for airflow user:</p>
<p>The following example adds <code class="docutils literal notranslate"><span class="pre">lxml</span></code> python package from PyPI to the image.</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/extending/add-pypi-packages/Dockerfile</span></p>
-<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.1</span>
+<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.2</span>
<span class="k">RUN</span> pip install --no-cache-dir lxml
</pre></div>
</div>
@@ -775,7 +775,7 @@ group for airflow user:</p>
running the container.</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/extending/writable-directory/Dockerfile</span></p>
-<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.1</span>
+<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.2</span>
<span class="k">RUN</span> <span class="nb">umask</span> <span class="m">0002</span><span class="p">;</span> <span class="se">\</span>
mkdir -p ~/writeable-directory
</pre></div>
@@ -787,7 +787,7 @@ running the container.</p>
<p>The following example adds <code class="docutils literal notranslate"><span class="pre">mpi4py</span></code> package which requires both <code class="docutils literal notranslate"><span class="pre">build-essential</span></code> and <code class="docutils literal notranslate"><span class="pre">mpi</span> <span class="pre">compiler</span></code>.</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/extending/add-build-essential-extend/Dockerfile</span></p>
-<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.1</span>
+<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.2</span>
<span class="k">USER</span><span class="s"> root</span>
<span class="k">RUN</span> apt-get update <span class="se">\</span>
<span class="o">&&</span> apt-get install -y --no-install-recommends <span class="se">\</span>
@@ -808,7 +808,7 @@ size of the image in case you use "Customizing" rather than "Exte
<p>The following example adds <code class="docutils literal notranslate"><span class="pre">test_dag.py</span></code> to your image in the <code class="docutils literal notranslate"><span class="pre">/opt/airflow/dags</span></code> folder.</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/extending/embedding-dags/Dockerfile</span></p>
-<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.1</span>
+<div class="highlight-Dockerfile notranslate"><div class="highlight"><pre><span></span><span class="k">FROM</span> <span class="s">apache/airflow:2.0.2</span>
<span class="k">COPY</span> --chown<span class="o">=</span>airflow:root test_dag.py /opt/airflow/dags
</pre></div>
@@ -894,8 +894,8 @@ allows to build airflow image in an air-gaped environment.</p></li>
that it can be predictably installed, even if some new versions of Airflow dependencies are
released (or even dependencies of our dependencies!). The docker image and accompanying scripts
usually determine automatically the right versions of constraints to be used based on the Airflow
-version installed and Python version. For example 2.0.1 version of Airflow installed from PyPI
-uses constraints from <code class="docutils literal notranslate"><span class="pre">constraints-2.0.1</span></code> tag). However in some cases - when installing airflow from
+version installed and Python version. For example 2.0.2 version of Airflow installed from PyPI
+uses constraints from <code class="docutils literal notranslate"><span class="pre">constraints-2.0.2</span></code> tag). However in some cases - when installing airflow from
GitHub for example - you have to manually specify the version of constraints used, otherwise
it will default to the latest version of the constraints which might not be compatible with the
version of Airflow you use.</p>
@@ -911,7 +911,7 @@ of constraints that you manually prepared.</p>
<span id="image-build-pypi"></span><h3>Building from PyPI packages<a class="headerlink" href="#building-from-pypi-packages" title="Permalink to this headline">¶</a></h3>
<p>This is the basic way of building the custom images from sources.</p>
<p>The following example builds the production image in version <code class="docutils literal notranslate"><span class="pre">3.6</span></code> with latest PyPI-released Airflow,
-with default set of Airflow extras and dependencies. The <code class="docutils literal notranslate"><span class="pre">2.0.1</span></code> constraints are used automatically.</p>
+with default set of Airflow extras and dependencies. The <code class="docutils literal notranslate"><span class="pre">2.0.2</span></code> constraints are used automatically.</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/customizing/stable-airflow.sh</span></p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
@@ -919,24 +919,24 @@ with default set of Airflow extras and dependencies. The <code class="docutils l
</pre></div>
</div>
</div>
-<p>The following example builds the production image in version <code class="docutils literal notranslate"><span class="pre">3.7</span></code> with default extras from <code class="docutils literal notranslate"><span class="pre">2.0.1</span></code> PyPI
-package. The <code class="docutils literal notranslate"><span class="pre">2.0.1</span></code> constraints are used automatically.</p>
+<p>The following example builds the production image in version <code class="docutils literal notranslate"><span class="pre">3.7</span></code> with default extras from <code class="docutils literal notranslate"><span class="pre">2.0.2</span></code> PyPI
+package. The <code class="docutils literal notranslate"><span class="pre">2.0.2</span></code> constraints are used automatically.</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/customizing/pypi-selected-version.sh</span></p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
--build-arg <span class="nv">PYTHON_BASE_IMAGE</span><span class="o">=</span><span class="s2">"python:3.7-slim-buster"</span> <span class="se">\</span>
- --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.2"</span> <span class="se">\</span>
--tag <span class="s2">"</span><span class="k">$(</span>basename <span class="s2">"</span><span class="nv">$0</span><span class="s2">"</span><span class="k">)</span><span class="s2">"</span>
</pre></div>
</div>
</div>
<p>The following example builds the production image in version <code class="docutils literal notranslate"><span class="pre">3.8</span></code> with additional airflow extras
-(<code class="docutils literal notranslate"><span class="pre">mssql,hdfs</span></code>) from <code class="docutils literal notranslate"><span class="pre">2.0.1</span></code> PyPI package, and additional dependency (<code class="docutils literal notranslate"><span class="pre">oauth2client</span></code>).</p>
+(<code class="docutils literal notranslate"><span class="pre">mssql,hdfs</span></code>) from <code class="docutils literal notranslate"><span class="pre">2.0.2</span></code> PyPI package, and additional dependency (<code class="docutils literal notranslate"><span class="pre">oauth2client</span></code>).</p>
<div class="example-block-wrapper docutils container">
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/customizing/pypi-extras-and-deps.sh</span></p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
--build-arg <span class="nv">PYTHON_BASE_IMAGE</span><span class="o">=</span><span class="s2">"python:3.8-slim-buster"</span> <span class="se">\</span>
- --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.2"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_AIRFLOW_EXTRAS</span><span class="o">=</span><span class="s2">"mssql,hdfs"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_PYTHON_DEPS</span><span class="o">=</span><span class="s2">"oauth2client"</span> <span class="se">\</span>
--tag <span class="s2">"</span><span class="k">$(</span>basename <span class="s2">"</span><span class="nv">$0</span><span class="s2">"</span><span class="k">)</span><span class="s2">"</span>
@@ -948,7 +948,7 @@ package. The <code class="docutils literal notranslate"><span class="pre">2.0.1<
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/customizing/add-build-essential-custom.sh</span></p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
--build-arg <span class="nv">PYTHON_BASE_IMAGE</span><span class="o">=</span><span class="s2">"python:3.6-slim-buster"</span> <span class="se">\</span>
- --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.2"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_PYTHON_DEPS</span><span class="o">=</span><span class="s2">"mpi4py"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_DEV_APT_DEPS</span><span class="o">=</span><span class="s2">"libopenmpi-dev"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_RUNTIME_APT_DEPS</span><span class="o">=</span><span class="s2">"openmpi-common"</span> <span class="se">\</span>
@@ -963,7 +963,7 @@ have more complex dependencies to build.</p>
</div>
<div class="section" id="building-optimized-images">
<span id="image-build-optimized"></span><h3>Building optimized images<a class="headerlink" href="#building-optimized-images" title="Permalink to this headline">¶</a></h3>
-<p>The following example the production image in version <code class="docutils literal notranslate"><span class="pre">3.6</span></code> with additional airflow extras from <code class="docutils literal notranslate"><span class="pre">2.0.1</span></code>
+<p>The following example the production image in version <code class="docutils literal notranslate"><span class="pre">3.6</span></code> with additional airflow extras from <code class="docutils literal notranslate"><span class="pre">2.0.2</span></code>
PyPI package but it includes additional apt dev and runtime dependencies.</p>
<p>The dev dependencies are those that require <code class="docutils literal notranslate"><span class="pre">build-essential</span></code> and usually need to involve recompiling
of some python dependencies so those packages might require some additional DEV dependencies to be
@@ -975,7 +975,7 @@ The <code class="docutils literal notranslate"><span class="pre">jre-headless</s
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/customizing/pypi-dev-runtime-deps.sh</span></p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
--build-arg <span class="nv">PYTHON_BASE_IMAGE</span><span class="o">=</span><span class="s2">"python:3.6-slim-buster"</span> <span class="se">\</span>
- --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.2"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_AIRFLOW_EXTRAS</span><span class="o">=</span><span class="s2">"jdbc"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_PYTHON_DEPS</span><span class="o">=</span><span class="s2">"pandas"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_DEV_APT_DEPS</span><span class="o">=</span><span class="s2">"gcc g++"</span> <span class="se">\</span>
@@ -1074,7 +1074,7 @@ future-proof.</p>
<p class="example-header"><span class="example-title">docs/docker-stack/docker-examples/customizing/custom-sources.sh</span></p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . -f Dockerfile <span class="se">\</span>
--build-arg <span class="nv">PYTHON_BASE_IMAGE</span><span class="o">=</span><span class="s2">"python:3.7-slim-buster"</span> <span class="se">\</span>
- --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.2"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_AIRFLOW_EXTRAS</span><span class="o">=</span><span class="s2">"slack,odbc"</span> <span class="se">\</span>
--build-arg <span class="nv">ADDITIONAL_PYTHON_DEPS</span><span class="o">=</span><span class="s2">" \</span>
<span class="s2"> azure-storage-blob \</span>
@@ -1127,11 +1127,11 @@ to provide this library from you repository if you want to build Airflow image i
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>rm docker-context-files/*.whl docker-context-files/*.tar.gz docker-context-files/*.txt <span class="o">||</span> <span class="nb">true</span>
curl -Lo <span class="s2">"docker-context-files/constraints-3.7.txt"</span> <span class="se">\</span>
- https://raw.githubusercontent.com/apache/airflow/constraints-2.0.1/constraints-3.7.txt
+ https://raw.githubusercontent.com/apache/airflow/constraints-2.0.2/constraints-3.7.txt
pip download --dest docker-context-files <span class="se">\</span>
--constraint docker-context-files/constraints-3.7.txt <span class="se">\</span>
- <span class="s2">"apache-airflow[async,aws,azure,celery,dask,elasticsearch,gcp,kubernetes,postgres,redis,slack,ssh,statsd,virtualenv]==2.0.1"</span>
+ <span class="s2">"apache-airflow[async,aws,azure,celery,dask,elasticsearch,gcp,kubernetes,postgres,redis,slack,ssh,statsd,virtualenv]==2.0.2"</span>
</pre></div>
</div>
</div>
@@ -1166,7 +1166,7 @@ to the below:</p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
--build-arg <span class="nv">PYTHON_BASE_IMAGE</span><span class="o">=</span><span class="s2">"python:3.7-slim-buster"</span> <span class="se">\</span>
--build-arg <span class="nv">AIRFLOW_INSTALLATION_METHOD</span><span class="o">=</span><span class="s2">"apache-airflow"</span> <span class="se">\</span>
- --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="s2">"2.0.2"</span> <span class="se">\</span>
--build-arg <span class="nv">INSTALL_MYSQL_CLIENT</span><span class="o">=</span><span class="s2">"false"</span> <span class="se">\</span>
--build-arg <span class="nv">AIRFLOW_PRE_CACHED_PIP_PACKAGES</span><span class="o">=</span><span class="s2">"false"</span> <span class="se">\</span>
--build-arg <span class="nv">INSTALL_FROM_DOCKER_CONTEXT_FILES</span><span class="o">=</span><span class="s2">"true"</span> <span class="se">\</span>
diff --git a/docs-archive/docker-stack/recipes.html b/docs-archive/docker-stack/recipes.html
index aa207cd..75019af 100644
--- a/docs-archive/docker-stack/recipes.html
+++ b/docs-archive/docker-stack/recipes.html
@@ -626,7 +626,7 @@ You can also run these commands with BashOperator.</p>
</div>
<p>Then build a new image.</p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
- --build-arg <span class="nv">BASE_AIRFLOW_IMAGE</span><span class="o">=</span><span class="s2">"apache/airflow:2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">BASE_AIRFLOW_IMAGE</span><span class="o">=</span><span class="s2">"apache/airflow:2.0.2"</span> <span class="se">\</span>
-t my-airflow-image
</pre></div>
</div>
@@ -737,7 +737,7 @@ Below are the steps to take tools that are frequently used in Hadoop-world:</p>
</div>
<p>Then build a new image.</p>
<div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>docker build . <span class="se">\</span>
- --build-arg <span class="nv">BASE_AIRFLOW_IMAGE</span><span class="o">=</span><span class="s2">"apache/airflow:2.0.1"</span> <span class="se">\</span>
+ --build-arg <span class="nv">BASE_AIRFLOW_IMAGE</span><span class="o">=</span><span class="s2">"apache/airflow:2.0.2"</span> <span class="se">\</span>
-t my-airflow-image
</pre></div>
</div>