You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by fo...@apache.org on 2018/08/19 18:25:01 UTC
[incubator-airflow-ci] branch master created (now 4da4976)
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git.
at 4da4976 Cleanup repo to start with a minimal example
This branch includes the following new commits:
new 72f96a2 Initial commit
new 0153157 Update MySQL version
new b704050 Remove mysql server
new 5e4949c No servers
new fdf86ce Remove krb-kdc
new 5b520d6 Disable apt-get prompt
new 0d00ecc Fix pip issue
new f46462e Fix local image name
new b6e63c4 Pass --user flag to pip
new 6c9bdf0 Fix ci script indentation
new 7b3e28e Add krb libraries and services
new f6c17fc Add unzip
new d738640 Install sudo
new 200fc29 Remove krb5 services from base image
new 3ea95b6 Set up locale
new 62b4ef6 Install Hadoop, Hive and MiniCluster
new 0b9c308 Syntax fix
new 43ec14b Create folders recursively
new 465bc73 Install openssh-server
new 24d57a0 Set JAVA_HOME
new feca835 Optimize image size
new 40f9562 Add python support libraries
new a0ad519 Fix hive dir permissions
new e11c1b8 Fix command format
new 4cfb326 Python 3
new 9b0eadf Install gcc and python-dev
new 5500e8c Install g++
new 509764c Add python3 development headers
new 617b363 Use `airflow` as default user
new 87132fe Set up workdir
new e777bcd Add sasl2 libraries for HiveServer2 authentication
new d22ef23 Add python3 support libraries and stop installing tox
new 13c7157 Add hive bin dir to path
new 4da4976 Cleanup repo to start with a minimal example
The 34 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[incubator-airflow-ci] 28/34: Add python3 development headers
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 509764cab14977d8c15aae2ff6996061b2ce895b
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Mon May 21 20:58:23 2018 +1000
Add python3 development headers
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index fca6890..e930823 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -46,6 +46,7 @@ RUN apt-get update && apt-get install --no-install-recommends -y \
gcc \
g++ \
python-dev \
+ python3-dev \
python-pip \
python3-pip \
python-setuptools \
[incubator-airflow-ci] 23/34: Fix hive dir permissions
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit a0ad5197a8d263265f088e4646938344534e6644
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sun May 20 11:34:29 2018 +1000
Fix hive dir permissions
---
Dockerfile.base | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 9fb2c42..69e838f 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -36,7 +36,9 @@ ENV JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/
RUN mkdir ${HADOOP_HOME} && \
mkdir ${HIVE_HOME} && \
mkdir /tmp/minicluster && \
- mkdir -p /user/hive/warehouse
+ mkdir -p /user/hive/warehouse \
+ chmod -R 777 ${HIVE_HOME} \
+ chmod -R 777 /user/
RUN apt-get update && apt-get install --no-install-recommends -y \
openjdk-8-jdk \
[incubator-airflow-ci] 20/34: Set JAVA_HOME
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 24d57a092ce000c6b936b58b20b5ef63b61917df
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sun May 20 10:43:48 2018 +1000
Set JAVA_HOME
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index d1fb342..14bf277 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -31,6 +31,7 @@ ENV HADOOP_VERSION 2.6.0
ENV HADOOP_DISTRO=cdh
ENV HADOOP_HOME=/tmp/hadoop-${HADOOP_DISTRO}
ENV HIVE_HOME=/tmp/hive
+ENV JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/
RUN mkdir ${HADOOP_HOME} && \
mkdir ${HIVE_HOME} && \
[incubator-airflow-ci] 03/34: Remove mysql server
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit b7040509c4dc071c8b5061b3b26077899d9f568d
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 11:47:31 2018 +1000
Remove mysql server
---
Dockerfile.base | 1 -
1 file changed, 1 deletion(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index b66e39e..dba805f 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -29,7 +29,6 @@ RUN apt-get update && apt-get install -y \
slapd \
ldap-utils \
openssh-server \
- mysql-server-5.7 \
mysql-client-core-5.7 \
mysql-client-5.7 \
postgresql-client \
[incubator-airflow-ci] 33/34: Add hive bin dir to path
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 13c715794612056b17428b95746a0d7b817aeada
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue Jun 19 16:48:33 2018 +1000
Add hive bin dir to path
---
Dockerfile.base | 3 +++
1 file changed, 3 insertions(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index cad11fe..1b55b92 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -103,4 +103,7 @@ RUN adduser airflow && \
chmod 0440 /etc/sudoers.d/airflow
WORKDIR /home/airflow
+
+ENV PATH "$PATH:/tmp/hive/bin"
+
USER airflow
[incubator-airflow-ci] 08/34: Fix local image name
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit f46462ec9e836bf991e4fca67f7bc4cad0b9be3d
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 12:41:47 2018 +1000
Fix local image name
---
.travis.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.travis.yml b/.travis.yml
index 6acafbb..f2bbc59 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -28,7 +28,7 @@ jobs:
- stage: build airflow-testing docker image
script:
- echo "$DOCKER_PASSWORD" | docker login -u "$DOCKER_USERNAME" --password-stdin
- - docker build -f Dockerfile.base -t gerardo/airflow-testing .
+ - docker build -f Dockerfile.base -t airflow-testing .
- docker images
- docker tag airflow-testing $DOCKER_USERNAME/airflow-testing
- docker push $DOCKER_USERNAME/airflow-testing
[incubator-airflow-ci] 21/34: Optimize image size
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit feca835f6e0c83bce83f0e34ab8ba9a31cbfb212
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sun May 20 10:43:55 2018 +1000
Optimize image size
---
Dockerfile.base | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 14bf277..fbbf046 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -38,7 +38,7 @@ RUN mkdir ${HADOOP_HOME} && \
mkdir /tmp/minicluster && \
mkdir -p /user/hive/warehouse
-RUN apt-get update && apt-get install -y \
+RUN apt-get update && apt-get install --no-install-recommends -y \
openjdk-8-jdk \
wget curl \
python-pip \
@@ -58,7 +58,9 @@ RUN apt-get update && apt-get install -y \
openssh-server \
python-selinux \
locales \
- && sed -i 's/^# en_US.UTF-8 UTF-8$/en_US.UTF-8 UTF-8/g' /etc/locale.gen \
+ && rm -rf /var/lib/apt/lists/*
+
+RUN sed -i 's/^# en_US.UTF-8 UTF-8$/en_US.UTF-8 UTF-8/g' /etc/locale.gen \
&& locale-gen \
&& update-locale LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8
[incubator-airflow-ci] 09/34: Pass --user flag to pip
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit b6e63c4e746e82019dcfc4fd3a15f8314aebc4f0
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 12:42:33 2018 +1000
Pass --user flag to pip
---
Dockerfile.base | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index f6631f5..84a66a3 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -36,6 +36,6 @@ RUN apt-get update && apt-get install -y \
openssh-client \
python-selinux
-RUN pip install --upgrade pip && \
+RUN pip install --upgrade --user pip && \
hash -r pip && \
pip install tox codecov
[incubator-airflow-ci] 24/34: Fix command format
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit e11c1b85a2eff1ee5ddee3d0491f223708c62842
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sun May 20 11:41:09 2018 +1000
Fix command format
---
Dockerfile.base | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 69e838f..94ce950 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -36,8 +36,8 @@ ENV JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/
RUN mkdir ${HADOOP_HOME} && \
mkdir ${HIVE_HOME} && \
mkdir /tmp/minicluster && \
- mkdir -p /user/hive/warehouse \
- chmod -R 777 ${HIVE_HOME} \
+ mkdir -p /user/hive/warehouse && \
+ chmod -R 777 ${HIVE_HOME} && \
chmod -R 777 /user/
RUN apt-get update && apt-get install --no-install-recommends -y \
[incubator-airflow-ci] 05/34: Remove krb-kdc
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit fdf86ced365049ffc1f823695f09670a8c01fa24
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 12:06:17 2018 +1000
Remove krb-kdc
---
Dockerfile.base | 1 -
1 file changed, 1 deletion(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 4a0088f..86deee1 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -31,7 +31,6 @@ RUN apt-get update && apt-get install -y \
mysql-client-5.7 \
postgresql-client \
krb5-user \
- krb5-kdc \
openssh-client \
python-selinux
[incubator-airflow-ci] 02/34: Update MySQL version
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 0153157b6b9647584bfb4c2525f6ab41ee2f0e1d
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 11:42:51 2018 +1000
Update MySQL version
---
Dockerfile.base | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 11ad13d..b66e39e 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -29,9 +29,9 @@ RUN apt-get update && apt-get install -y \
slapd \
ldap-utils \
openssh-server \
- mysql-server-5.6 \
- mysql-client-core-5.6 \
- mysql-client-5.6 \
+ mysql-server-5.7 \
+ mysql-client-core-5.7 \
+ mysql-client-5.7 \
postgresql-client \
krb5-user \
krb5-kdc \
[incubator-airflow-ci] 17/34: Syntax fix
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 0b9c308c9fc45d7915a65c760c5e72cdfad3c538
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sat May 19 10:00:52 2018 +1000
Syntax fix
---
Dockerfile.base | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 95a2281..58d38d1 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -75,7 +75,7 @@ RUN cd /tmp && \
# Install MiniCluster
RUN cd /tmp && \
wget -q https://github.com/bolkedebruin/minicluster/releases/download/1.1/minicluster-1.1-SNAPSHOT-bin.zip && \
- unzip minicluster-1.1-SNAPSHOT-bin.zip -d /tmp
+ unzip minicluster-1.1-SNAPSHOT-bin.zip -d /tmp && \
rm minicluster-1.1-SNAPSHOT-bin.zip
RUN pip install --upgrade pip && \
[incubator-airflow-ci] 10/34: Fix ci script indentation
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 6c9bdf0ae4a86cefe3e7a42c37efb9a4ffe76369
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 12:49:12 2018 +1000
Fix ci script indentation
---
.travis.yml | 10 +++++-----
Dockerfile.base | 2 +-
2 files changed, 6 insertions(+), 6 deletions(-)
diff --git a/.travis.yml b/.travis.yml
index f2bbc59..d1008b2 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -27,8 +27,8 @@ jobs:
include:
- stage: build airflow-testing docker image
script:
- - echo "$DOCKER_PASSWORD" | docker login -u "$DOCKER_USERNAME" --password-stdin
- - docker build -f Dockerfile.base -t airflow-testing .
- - docker images
- - docker tag airflow-testing $DOCKER_USERNAME/airflow-testing
- - docker push $DOCKER_USERNAME/airflow-testing
+ - echo "$DOCKER_PASSWORD" | docker login -u "$DOCKER_USERNAME" --password-stdin
+ - docker build -f Dockerfile.base -t airflow-testing .
+ - docker images
+ - docker tag airflow-testing $DOCKER_USERNAME/airflow-testing
+ - docker push $DOCKER_USERNAME/airflow-testing
diff --git a/Dockerfile.base b/Dockerfile.base
index 84a66a3..f6631f5 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -36,6 +36,6 @@ RUN apt-get update && apt-get install -y \
openssh-client \
python-selinux
-RUN pip install --upgrade --user pip && \
+RUN pip install --upgrade pip && \
hash -r pip && \
pip install tox codecov
[incubator-airflow-ci] 12/34: Add unzip
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit f6c17fcfa73becbfa1754d33aed8bcd0df8353d6
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Wed May 2 16:16:28 2018 +1000
Add unzip
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index e0c0492..8c1c5d2 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -28,6 +28,7 @@ RUN apt-get update && apt-get install -y \
python-pip \
python3-pip \
git \
+ unzip \
ldap-utils \
mysql-client-core-5.7 \
mysql-client-5.7 \
[incubator-airflow-ci] 01/34: Initial commit
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 72f96a2f2b43ed17aa72a366244e1f7312fda004
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 11:34:39 2018 +1000
Initial commit
---
.travis.yml | 34 ++++++++++++++++++++++++++++++++++
Dockerfile.base | 44 ++++++++++++++++++++++++++++++++++++++++++++
README.md | 8 ++++++++
3 files changed, 86 insertions(+)
diff --git a/.travis.yml b/.travis.yml
new file mode 100644
index 0000000..6acafbb
--- /dev/null
+++ b/.travis.yml
@@ -0,0 +1,34 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+
+sudo: required
+dist: trusty
+
+services:
+ - docker
+
+jobs:
+ include:
+ - stage: build airflow-testing docker image
+ script:
+ - echo "$DOCKER_PASSWORD" | docker login -u "$DOCKER_USERNAME" --password-stdin
+ - docker build -f Dockerfile.base -t gerardo/airflow-testing .
+ - docker images
+ - docker tag airflow-testing $DOCKER_USERNAME/airflow-testing
+ - docker push $DOCKER_USERNAME/airflow-testing
diff --git a/Dockerfile.base b/Dockerfile.base
new file mode 100644
index 0000000..11ad13d
--- /dev/null
+++ b/Dockerfile.base
@@ -0,0 +1,44 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#
+
+# WARNING: THIS DOCKERFILE IS NOT INTENDED FOR PRODUCTION USE OR DEPLOYMENT. AT
+# THIS POINT, THIS IS ONLY INTENDED FOR USE IN AUTOMATED TESTS.
+
+FROM ubuntu:xenial
+
+RUN apt-get update && apt-get install -y \
+ openjdk-8-jdk \
+ wget curl \
+ python-pip \
+ python3-pip \
+ git \
+ slapd \
+ ldap-utils \
+ openssh-server \
+ mysql-server-5.6 \
+ mysql-client-core-5.6 \
+ mysql-client-5.6 \
+ postgresql-client \
+ krb5-user \
+ krb5-kdc \
+ krb5-admin-server \
+ openssh-client openssh-server \
+ python-selinux
+
+RUN pip install --upgrade pip && \
+ pip install tox \
+ codecov
diff --git a/README.md b/README.md
new file mode 100644
index 0000000..71d4263
--- /dev/null
+++ b/README.md
@@ -0,0 +1,8 @@
+# Apache Airflow Continuous Integration (CI) support repo
+
+The main purpose of this repository is to provide a number of Docker containers, so that [Travis CI](https://travis-ci.org/gerardo/incubator-airflow) is capable of building Airflow.
+
+
+## Background
+
+PENDING
[incubator-airflow-ci] 19/34: Install openssh-server
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 465bc73d9323c233a8858d6734fb5e8370327fa1
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sat May 19 18:08:54 2018 +1000
Install openssh-server
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index 777b771..d1fb342 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -54,6 +54,7 @@ RUN apt-get update && apt-get install -y \
libsasl2-dev \
krb5-user \
openssh-client \
+ openssh-server \
python-selinux \
locales \
&& sed -i 's/^# en_US.UTF-8 UTF-8$/en_US.UTF-8 UTF-8/g' /etc/locale.gen \
[incubator-airflow-ci] 18/34: Create folders recursively
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 43ec14b8b6682deb8845d35ab99a30a87781b138
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sat May 19 10:04:26 2018 +1000
Create folders recursively
---
Dockerfile.base | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 58d38d1..777b771 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -35,7 +35,7 @@ ENV HIVE_HOME=/tmp/hive
RUN mkdir ${HADOOP_HOME} && \
mkdir ${HIVE_HOME} && \
mkdir /tmp/minicluster && \
- mkdir /user/hive/warehouse
+ mkdir -p /user/hive/warehouse
RUN apt-get update && apt-get install -y \
openjdk-8-jdk \
[incubator-airflow-ci] 29/34: Use `airflow` as default user
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 617b3631ba826034120590e31a0523d316be081a
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 29 15:05:04 2018 +1000
Use `airflow` as default user
---
.gitignore | 1 +
Dockerfile.base | 8 ++++++++
2 files changed, 9 insertions(+)
diff --git a/.gitignore b/.gitignore
new file mode 100644
index 0000000..2c257d4
--- /dev/null
+++ b/.gitignore
@@ -0,0 +1 @@
+.tags
diff --git a/Dockerfile.base b/Dockerfile.base
index e930823..311f42e 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -20,6 +20,8 @@
FROM ubuntu:xenial
+USER root
+
ENV DEBIAN_FRONTEND noninteractive
ENV LANGUAGE en_US.UTF-8
ENV LANG en_US.UTF-8
@@ -93,3 +95,9 @@ RUN cd /tmp && \
RUN pip install --upgrade pip && \
hash -r pip && \
pip install tox codecov
+
+RUN adduser airflow && \
+ echo "airflow ALL=(ALL) NOPASSWD: ALL" > /etc/sudoers.d/airflow && \
+ chmod 0440 /etc/sudoers.d/airflow
+
+USER airflow
[incubator-airflow-ci] 27/34: Install g++
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 5500e8c0296bebba71d80d01d7f8f2be27041bef
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Mon May 21 08:11:21 2018 +1000
Install g++
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index 2dd5670..fca6890 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -44,6 +44,7 @@ RUN apt-get update && apt-get install --no-install-recommends -y \
openjdk-8-jdk \
wget curl \
gcc \
+ g++ \
python-dev \
python-pip \
python3-pip \
[incubator-airflow-ci] 32/34: Add python3 support libraries and
stop installing tox
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit d22ef2305169ebf418122558c105d9ff0fe35580
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Mon Jun 11 00:42:44 2018 +1000
Add python3 support libraries and stop installing tox
---
Dockerfile.base | 6 ++----
1 file changed, 2 insertions(+), 4 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index afd2c96..cad11fe 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -53,6 +53,8 @@ RUN apt-get update && apt-get install --no-install-recommends -y \
python3-pip \
python-setuptools \
python-pkg-resources \
+ python3-setuptools \
+ python3-pkg-resources \
git \
unzip \
sudo \
@@ -96,10 +98,6 @@ RUN cd /tmp && \
unzip minicluster-1.1-SNAPSHOT-bin.zip -d /tmp && \
rm minicluster-1.1-SNAPSHOT-bin.zip
-RUN pip install --upgrade pip && \
- hash -r pip && \
- pip install tox codecov
-
RUN adduser airflow && \
echo "airflow ALL=(ALL) NOPASSWD: ALL" > /etc/sudoers.d/airflow && \
chmod 0440 /etc/sudoers.d/airflow
[incubator-airflow-ci] 04/34: No servers
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 5e4949c784099e9d29a08f45c7aa65ee9625eebf
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 11:58:21 2018 +1000
No servers
---
Dockerfile.base | 5 +----
1 file changed, 1 insertion(+), 4 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index dba805f..4a0088f 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -26,16 +26,13 @@ RUN apt-get update && apt-get install -y \
python-pip \
python3-pip \
git \
- slapd \
ldap-utils \
- openssh-server \
mysql-client-core-5.7 \
mysql-client-5.7 \
postgresql-client \
krb5-user \
krb5-kdc \
- krb5-admin-server \
- openssh-client openssh-server \
+ openssh-client \
python-selinux
RUN pip install --upgrade pip && \
[incubator-airflow-ci] 14/34: Remove krb5 services from base image
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 200fc29a05c801fe6aba365ce0ccecbbcc6f19c9
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sat May 12 21:51:14 2018 +1000
Remove krb5 services from base image
---
Dockerfile.base | 2 --
1 file changed, 2 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index fe3e2fb..9341363 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -38,8 +38,6 @@ RUN apt-get update && apt-get install -y \
libkrb5-dev \
libsasl2-dev \
krb5-user \
- krb5-kdc \
- krb5-admin-server \
openssh-client \
python-selinux
[incubator-airflow-ci] 11/34: Add krb libraries and services
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 7b3e28ecbe91e662c153c33e42e740998fbcc848
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Wed May 2 15:56:39 2018 +1000
Add krb libraries and services
---
Dockerfile.base | 5 +++++
1 file changed, 5 insertions(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index f6631f5..e0c0492 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -31,8 +31,13 @@ RUN apt-get update && apt-get install -y \
ldap-utils \
mysql-client-core-5.7 \
mysql-client-5.7 \
+ libmysqlclient-dev \
postgresql-client \
+ libkrb5-dev \
+ libsasl2-dev \
krb5-user \
+ krb5-kdc \
+ krb5-admin-server \
openssh-client \
python-selinux
[incubator-airflow-ci] 25/34: Python 3
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 4cfb3269254493e9f195471deed72f6347bca1ce
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sun May 20 12:09:30 2018 +1000
Python 3
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index 94ce950..d1ea4de 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -44,6 +44,7 @@ RUN apt-get update && apt-get install --no-install-recommends -y \
openjdk-8-jdk \
wget curl \
python-pip \
+ python3-pip \
python-setuptools \
python-pkg-resources \
git \
[incubator-airflow-ci] 31/34: Add sasl2 libraries for HiveServer2
authentication
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit e777bcd047a3024518caee1b34469b0184999057
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Wed May 30 19:11:54 2018 +1000
Add sasl2 libraries for HiveServer2 authentication
---
Dockerfile.base | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index 9dfa673..afd2c96 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -67,6 +67,10 @@ RUN apt-get update && apt-get install --no-install-recommends -y \
openssh-client \
openssh-server \
python-selinux \
+ sasl2-bin \
+ libsasl2-2 \
+ libsasl2-dev \
+ libsasl2-modules \
locales \
&& rm -rf /var/lib/apt/lists/*
[incubator-airflow-ci] 16/34: Install Hadoop, Hive and MiniCluster
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 62b4ef62c53d5dbc3b0a09270f8c52b8245b78e7
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sat May 19 09:58:12 2018 +1000
Install Hadoop, Hive and MiniCluster
---
Dockerfile.base | 28 ++++++++++++++++++++++++++++
1 file changed, 28 insertions(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index dd0a220..95a2281 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -27,6 +27,16 @@ ENV LC_ALL en_US.UTF-8
ENV LC_CTYPE en_US.UTF-8
ENV LC_MESSAGES en_US.UTF-8
+ENV HADOOP_VERSION 2.6.0
+ENV HADOOP_DISTRO=cdh
+ENV HADOOP_HOME=/tmp/hadoop-${HADOOP_DISTRO}
+ENV HIVE_HOME=/tmp/hive
+
+RUN mkdir ${HADOOP_HOME} && \
+ mkdir ${HIVE_HOME} && \
+ mkdir /tmp/minicluster && \
+ mkdir /user/hive/warehouse
+
RUN apt-get update && apt-get install -y \
openjdk-8-jdk \
wget curl \
@@ -50,6 +60,24 @@ RUN apt-get update && apt-get install -y \
&& locale-gen \
&& update-locale LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8
+# Install Hadoop
+RUN cd /tmp && \
+ wget -q https://archive.cloudera.com/cdh5/cdh/5/hadoop-${HADOOP_VERSION}-cdh5.11.0.tar.gz && \
+ tar xzf hadoop-${HADOOP_VERSION}-cdh5.11.0.tar.gz --strip-components 1 -C $HADOOP_HOME && \
+ rm hadoop-${HADOOP_VERSION}-cdh5.11.0.tar.gz
+
+# Install Hive
+RUN cd /tmp && \
+ wget -q https://archive.cloudera.com/cdh5/cdh/5/hive-1.1.0-cdh5.11.0.tar.gz && \
+ tar xzf hive-1.1.0-cdh5.11.0.tar.gz --strip-components 1 -C $HIVE_HOME && \
+ rm hive-1.1.0-cdh5.11.0.tar.gz
+
+# Install MiniCluster
+RUN cd /tmp && \
+ wget -q https://github.com/bolkedebruin/minicluster/releases/download/1.1/minicluster-1.1-SNAPSHOT-bin.zip && \
+ unzip minicluster-1.1-SNAPSHOT-bin.zip -d /tmp
+ rm minicluster-1.1-SNAPSHOT-bin.zip
+
RUN pip install --upgrade pip && \
hash -r pip && \
pip install tox codecov
[incubator-airflow-ci] 30/34: Set up workdir
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 87132feacedea3876770e175e3ceeab25ea3164a
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 29 15:27:33 2018 +1000
Set up workdir
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index 311f42e..9dfa673 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -100,4 +100,5 @@ RUN adduser airflow && \
echo "airflow ALL=(ALL) NOPASSWD: ALL" > /etc/sudoers.d/airflow && \
chmod 0440 /etc/sudoers.d/airflow
+WORKDIR /home/airflow
USER airflow
[incubator-airflow-ci] 06/34: Disable apt-get prompt
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 5b520d64e3852f057059b135c3e06e28c9630f27
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 12:21:51 2018 +1000
Disable apt-get prompt
---
Dockerfile.base | 2 ++
1 file changed, 2 insertions(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index 86deee1..084c596 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -20,6 +20,8 @@
FROM ubuntu:xenial
+ENV DEBIAN_FRONTEND noninteractive
+
RUN apt-get update && apt-get install -y \
openjdk-8-jdk \
wget curl \
[incubator-airflow-ci] 26/34: Install gcc and python-dev
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 9b0eadf1cc62c02437a5b48f7f168bc0c3c47136
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Mon May 21 07:58:24 2018 +1000
Install gcc and python-dev
---
Dockerfile.base | 2 ++
1 file changed, 2 insertions(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index d1ea4de..2dd5670 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -43,6 +43,8 @@ RUN mkdir ${HADOOP_HOME} && \
RUN apt-get update && apt-get install --no-install-recommends -y \
openjdk-8-jdk \
wget curl \
+ gcc \
+ python-dev \
python-pip \
python3-pip \
python-setuptools \
[incubator-airflow-ci] 15/34: Set up locale
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 3ea95b6a137efa692454e62b4ae845dc7ba90eb0
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Thu May 17 18:58:53 2018 +1000
Set up locale
---
Dockerfile.base | 43 ++++++++++++++++++++++++++-----------------
1 file changed, 26 insertions(+), 17 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 9341363..dd0a220 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -21,25 +21,34 @@
FROM ubuntu:xenial
ENV DEBIAN_FRONTEND noninteractive
+ENV LANGUAGE en_US.UTF-8
+ENV LANG en_US.UTF-8
+ENV LC_ALL en_US.UTF-8
+ENV LC_CTYPE en_US.UTF-8
+ENV LC_MESSAGES en_US.UTF-8
RUN apt-get update && apt-get install -y \
- openjdk-8-jdk \
- wget curl \
- python-pip \
- python3-pip \
- git \
- unzip \
- sudo \
- ldap-utils \
- mysql-client-core-5.7 \
- mysql-client-5.7 \
- libmysqlclient-dev \
- postgresql-client \
- libkrb5-dev \
- libsasl2-dev \
- krb5-user \
- openssh-client \
- python-selinux
+ openjdk-8-jdk \
+ wget curl \
+ python-pip \
+ python3-pip \
+ git \
+ unzip \
+ sudo \
+ ldap-utils \
+ mysql-client-core-5.7 \
+ mysql-client-5.7 \
+ libmysqlclient-dev \
+ postgresql-client \
+ libkrb5-dev \
+ libsasl2-dev \
+ krb5-user \
+ openssh-client \
+ python-selinux \
+ locales \
+ && sed -i 's/^# en_US.UTF-8 UTF-8$/en_US.UTF-8 UTF-8/g' /etc/locale.gen \
+ && locale-gen \
+ && update-locale LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8
RUN pip install --upgrade pip && \
hash -r pip && \
[incubator-airflow-ci] 22/34: Add python support libraries
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 40f9562659565b314b7437f8f63a28e9d712581a
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sun May 20 11:23:40 2018 +1000
Add python support libraries
---
Dockerfile.base | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index fbbf046..9fb2c42 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -42,7 +42,8 @@ RUN apt-get update && apt-get install --no-install-recommends -y \
openjdk-8-jdk \
wget curl \
python-pip \
- python3-pip \
+ python-setuptools \
+ python-pkg-resources \
git \
unzip \
sudo \
[incubator-airflow-ci] 34/34: Cleanup repo to start with a minimal
example
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 4da497630622e23fac3ab222ba645eaf995fb62e
Author: Fokko Driesprong <fo...@godatadriven.com>
AuthorDate: Sun Aug 19 19:59:02 2018 +0200
Cleanup repo to start with a minimal example
---
.travis.yml | 34 -------
Dockerfile.base => Dockerfile | 0
LICENSE | 202 ++++++++++++++++++++++++++++++++++++++++++
3 files changed, 202 insertions(+), 34 deletions(-)
diff --git a/.travis.yml b/.travis.yml
deleted file mode 100644
index d1008b2..0000000
--- a/.travis.yml
+++ /dev/null
@@ -1,34 +0,0 @@
-#
-# Licensed to the Apache Software Foundation (ASF) under one
-# or more contributor license agreements. See the NOTICE file
-# distributed with this work for additional information
-# regarding copyright ownership. The ASF licenses this file
-# to you under the Apache License, Version 2.0 (the
-# "License"); you may not use this file except in compliance
-# with the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing,
-# software distributed under the License is distributed on an
-# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-# KIND, either express or implied. See the License for the
-# specific language governing permissions and limitations
-# under the License.
-#
-
-sudo: required
-dist: trusty
-
-services:
- - docker
-
-jobs:
- include:
- - stage: build airflow-testing docker image
- script:
- - echo "$DOCKER_PASSWORD" | docker login -u "$DOCKER_USERNAME" --password-stdin
- - docker build -f Dockerfile.base -t airflow-testing .
- - docker images
- - docker tag airflow-testing $DOCKER_USERNAME/airflow-testing
- - docker push $DOCKER_USERNAME/airflow-testing
diff --git a/Dockerfile.base b/Dockerfile
similarity index 100%
rename from Dockerfile.base
rename to Dockerfile
diff --git a/LICENSE b/LICENSE
new file mode 100644
index 0000000..9f71055
--- /dev/null
+++ b/LICENSE
@@ -0,0 +1,202 @@
+ Apache License
+ Version 2.0, January 2004
+ http://www.apache.org/licenses/
+
+TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+1. Definitions.
+
+ "License" shall mean the terms and conditions for use, reproduction,
+ and distribution as defined by Sections 1 through 9 of this document.
+
+ "Licensor" shall mean the copyright owner or entity authorized by
+ the copyright owner that is granting the License.
+
+ "Legal Entity" shall mean the union of the acting entity and all
+ other entities that control, are controlled by, or are under common
+ control with that entity. For the purposes of this definition,
+ "control" means (i) the power, direct or indirect, to cause the
+ direction or management of such entity, whether by contract or
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
+ outstanding shares, or (iii) beneficial ownership of such entity.
+
+ "You" (or "Your") shall mean an individual or Legal Entity
+ exercising permissions granted by this License.
+
+ "Source" form shall mean the preferred form for making modifications,
+ including but not limited to software source code, documentation
+ source, and configuration files.
+
+ "Object" form shall mean any form resulting from mechanical
+ transformation or translation of a Source form, including but
+ not limited to compiled object code, generated documentation,
+ and conversions to other media types.
+
+ "Work" shall mean the work of authorship, whether in Source or
+ Object form, made available under the License, as indicated by a
+ copyright notice that is included in or attached to the work
+ (an example is provided in the Appendix below).
+
+ "Derivative Works" shall mean any work, whether in Source or Object
+ form, that is based on (or derived from) the Work and for which the
+ editorial revisions, annotations, elaborations, or other modifications
+ represent, as a whole, an original work of authorship. For the purposes
+ of this License, Derivative Works shall not include works that remain
+ separable from, or merely link (or bind by name) to the interfaces of,
+ the Work and Derivative Works thereof.
+
+ "Contribution" shall mean any work of authorship, including
+ the original version of the Work and any modifications or additions
+ to that Work or Derivative Works thereof, that is intentionally
+ submitted to Licensor for inclusion in the Work by the copyright owner
+ or by an individual or Legal Entity authorized to submit on behalf of
+ the copyright owner. For the purposes of this definition, "submitted"
+ means any form of electronic, verbal, or written communication sent
+ to the Licensor or its representatives, including but not limited to
+ communication on electronic mailing lists, source code control systems,
+ and issue tracking systems that are managed by, or on behalf of, the
+ Licensor for the purpose of discussing and improving the Work, but
+ excluding communication that is conspicuously marked or otherwise
+ designated in writing by the copyright owner as "Not a Contribution."
+
+ "Contributor" shall mean Licensor and any individual or Legal Entity
+ on behalf of whom a Contribution has been received by Licensor and
+ subsequently incorporated within the Work.
+
+2. Grant of Copyright License. Subject to the terms and conditions of
+ this License, each Contributor hereby grants to You a perpetual,
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+ copyright license to reproduce, prepare Derivative Works of,
+ publicly display, publicly perform, sublicense, and distribute the
+ Work and such Derivative Works in Source or Object form.
+
+3. Grant of Patent License. Subject to the terms and conditions of
+ this License, each Contributor hereby grants to You a perpetual,
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+ (except as stated in this section) patent license to make, have made,
+ use, offer to sell, sell, import, and otherwise transfer the Work,
+ where such license applies only to those patent claims licensable
+ by such Contributor that are necessarily infringed by their
+ Contribution(s) alone or by combination of their Contribution(s)
+ with the Work to which such Contribution(s) was submitted. If You
+ institute patent litigation against any entity (including a
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
+ or a Contribution incorporated within the Work constitutes direct
+ or contributory patent infringement, then any patent licenses
+ granted to You under this License for that Work shall terminate
+ as of the date such litigation is filed.
+
+4. Redistribution. You may reproduce and distribute copies of the
+ Work or Derivative Works thereof in any medium, with or without
+ modifications, and in Source or Object form, provided that You
+ meet the following conditions:
+
+ (a) You must give any other recipients of the Work or
+ Derivative Works a copy of this License; and
+
+ (b) You must cause any modified files to carry prominent notices
+ stating that You changed the files; and
+
+ (c) You must retain, in the Source form of any Derivative Works
+ that You distribute, all copyright, patent, trademark, and
+ attribution notices from the Source form of the Work,
+ excluding those notices that do not pertain to any part of
+ the Derivative Works; and
+
+ (d) If the Work includes a "NOTICE" text file as part of its
+ distribution, then any Derivative Works that You distribute must
+ include a readable copy of the attribution notices contained
+ within such NOTICE file, excluding those notices that do not
+ pertain to any part of the Derivative Works, in at least one
+ of the following places: within a NOTICE text file distributed
+ as part of the Derivative Works; within the Source form or
+ documentation, if provided along with the Derivative Works; or,
+ within a display generated by the Derivative Works, if and
+ wherever such third-party notices normally appear. The contents
+ of the NOTICE file are for informational purposes only and
+ do not modify the License. You may add Your own attribution
+ notices within Derivative Works that You distribute, alongside
+ or as an addendum to the NOTICE text from the Work, provided
+ that such additional attribution notices cannot be construed
+ as modifying the License.
+
+ You may add Your own copyright statement to Your modifications and
+ may provide additional or different license terms and conditions
+ for use, reproduction, or distribution of Your modifications, or
+ for any such Derivative Works as a whole, provided Your use,
+ reproduction, and distribution of the Work otherwise complies with
+ the conditions stated in this License.
+
+5. Submission of Contributions. Unless You explicitly state otherwise,
+ any Contribution intentionally submitted for inclusion in the Work
+ by You to the Licensor shall be under the terms and conditions of
+ this License, without any additional terms or conditions.
+ Notwithstanding the above, nothing herein shall supersede or modify
+ the terms of any separate license agreement you may have executed
+ with Licensor regarding such Contributions.
+
+6. Trademarks. This License does not grant permission to use the trade
+ names, trademarks, service marks, or product names of the Licensor,
+ except as required for reasonable and customary use in describing the
+ origin of the Work and reproducing the content of the NOTICE file.
+
+7. Disclaimer of Warranty. Unless required by applicable law or
+ agreed to in writing, Licensor provides the Work (and each
+ Contributor provides its Contributions) on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+ implied, including, without limitation, any warranties or conditions
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+ PARTICULAR PURPOSE. You are solely responsible for determining the
+ appropriateness of using or redistributing the Work and assume any
+ risks associated with Your exercise of permissions under this License.
+
+8. Limitation of Liability. In no event and under no legal theory,
+ whether in tort (including negligence), contract, or otherwise,
+ unless required by applicable law (such as deliberate and grossly
+ negligent acts) or agreed to in writing, shall any Contributor be
+ liable to You for damages, including any direct, indirect, special,
+ incidental, or consequential damages of any character arising as a
+ result of this License or out of the use or inability to use the
+ Work (including but not limited to damages for loss of goodwill,
+ work stoppage, computer failure or malfunction, or any and all
+ other commercial damages or losses), even if such Contributor
+ has been advised of the possibility of such damages.
+
+9. Accepting Warranty or Additional Liability. While redistributing
+ the Work or Derivative Works thereof, You may choose to offer,
+ and charge a fee for, acceptance of support, warranty, indemnity,
+ or other liability obligations and/or rights consistent with this
+ License. However, in accepting such obligations, You may act only
+ on Your own behalf and on Your sole responsibility, not on behalf
+ of any other Contributor, and only if You agree to indemnify,
+ defend, and hold each Contributor harmless for any liability
+ incurred by, or claims asserted against, such Contributor by reason
+ of your accepting any such warranty or additional liability.
+
+END OF TERMS AND CONDITIONS
+
+APPENDIX: How to apply the Apache License to your work.
+
+ To apply the Apache License to your work, attach the following
+ boilerplate notice, with the fields enclosed by brackets "[]"
+ replaced with your own identifying information. (Don't include
+ the brackets!) The text should be enclosed in the appropriate
+ comment syntax for the file format. We also recommend that a
+ file or class name and description of purpose be included on the
+ same "printed page" as the copyright notice for easier
+ identification within third-party archives.
+
+Copyright [yyyy] [name of copyright owner]
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+
[incubator-airflow-ci] 13/34: Install sudo
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit d738640dd6526c5d8d4b4372b595421d084f02b7
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Sat May 12 21:37:11 2018 +1000
Install sudo
---
Dockerfile.base | 1 +
1 file changed, 1 insertion(+)
diff --git a/Dockerfile.base b/Dockerfile.base
index 8c1c5d2..fe3e2fb 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -29,6 +29,7 @@ RUN apt-get update && apt-get install -y \
python3-pip \
git \
unzip \
+ sudo \
ldap-utils \
mysql-client-core-5.7 \
mysql-client-5.7 \
[incubator-airflow-ci] 07/34: Fix pip issue
Posted by fo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-airflow-ci.git
commit 0d00eccc37b233f3d0fbad8ef9eed2cb94d8c7e1
Author: Gerardo Curiel <ge...@rea-group.com>
AuthorDate: Tue May 1 12:34:32 2018 +1000
Fix pip issue
---
Dockerfile.base | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/Dockerfile.base b/Dockerfile.base
index 084c596..f6631f5 100644
--- a/Dockerfile.base
+++ b/Dockerfile.base
@@ -37,5 +37,5 @@ RUN apt-get update && apt-get install -y \
python-selinux
RUN pip install --upgrade pip && \
- pip install tox \
- codecov
+ hash -r pip && \
+ pip install tox codecov