You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@ozone.apache.org by el...@apache.org on 2021/02/05 07:05:30 UTC
[ozone-docker-builder] branch master created (now 9709e25)
This is an automated email from the ASF dual-hosted git repository.
elek pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git.
at 9709e25 install latest git from source (#17)
This branch includes the following new commits:
new 7c6312b HDDS-1516. Docker definition of ozone build environment.
new bb8d16b HDDS-2232. ozone-build docker image is failing due to a missing entrypoint script
new af2a8c7 switch to centos7 (#9)
new 5048fe9 HDDS-2859. Hugo error should be propagated to build
new 6448d1b Retrigger build with empty commit.
new 862cd65 Trigger rebuild to get recent dependency updates:
new 0361b3b Trigger rebuild to get dependency update:
new c582430 trigger rebuild for c9a192553
new 86da433 Trigger new build with latest Ozone dependencies (8576072ba)
new 561de22 Trigger build for Ozone f046ebf20
new 13074cb Trigger build for Ozone 4b2dc09b6
new b41c9ec Trigger build for Ozone 072370b94
new 5da5381 Trigger build for Ozone 78255ddc7
new 87d5222 Trigger build for Ozone 73b87fd8f
new 453013c Trigger build for Ozone 798e00c97
new c7d48c1 Trigger build for Ozone f64bc6ed3
new 9709e25 install latest git from source (#17)
The 17 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 03/17: switch to centos7 (#9)
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit af2a8c7d13e21e057b4bad7a9ed88c12878b10ce
Author: Elek, Márton <el...@users.noreply.github.com>
AuthorDate: Thu Nov 14 01:57:12 2019 +0100
switch to centos7 (#9)
---
Dockerfile | 75 +++++++++++++++++++++++++++++++-------------------------------
1 file changed, 37 insertions(+), 38 deletions(-)
diff --git a/Dockerfile b/Dockerfile
index dd3636e..9349d1d 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -12,24 +12,22 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
-FROM docker:18.09.1
-RUN apk add --update --no-cache bash alpine-sdk maven jq grep openjdk8 py-pip rsync procps autoconf automake libtool findutils coreutils
-
-#Install real glibc
-RUN apk --no-cache add ca-certificates wget && \
- wget -q -O /etc/apk/keys/sgerrand.rsa.pub https://alpine-pkgs.sgerrand.com/sgerrand.rsa.pub && \
- wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/2.28-r0/glibc-2.28-r0.apk && \
- apk add glibc-2.28-r0.apk && \
- wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/2.28-r0/glibc-bin-2.28-r0.apk && \
- apk add glibc-bin-2.28-r0.apk && \
- wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/2.28-r0/glibc-i18n-2.28-r0.apk && \
- apk add glibc-i18n-2.28-r0.apk
+FROM centos:7.6.1810
+RUN yum -y install epel-release
+RUN yum -y install gcc gcc-c++ kernel-devel make autoconf automake libtool which \
+ java-1.8.0-openjdk-headless java-1.8.0-openjdk-devel\
+ docker \
+ python-pip \
+ file python-devel \
+ git \
+ jq \
+ sudo
#Install protobuf
+ENV LD_LIBRARY_PATH=/usr/lib
RUN mkdir -p /usr/local/src/ && \
cd /usr/local/src/ && \
- wget https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz && \
- tar xvf protobuf-2.5.0.tar.gz && \
+ curl -sL https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz | tar xz && \
cd protobuf-2.5.0 && \
./autogen.sh && \
./configure --prefix=/usr && \
@@ -47,40 +45,23 @@ RUN mkdir -p /opt && \
curl -sL 'https://www.apache.org/dyn/mirrors/mirrors.cgi?action=download&filename=/ant/binaries/apache-ant-1.10.7-bin.tar.gz' | tar -xz && \
mv apache-ant* /opt/ant
+#Install apache-maven
+RUN curl -sL 'https://www.apache.org/dyn/mirrors/mirrors.cgi?action=download&filename=maven/maven-3/3.6.2/binaries/apache-maven-3.6.2-bin.tar.gz' | tar -xz && \
+ mv apache-maven* /opt/maven
+
#Install docker-compose (for smoketests)
-RUN apk add --no-cache libffi-dev libressl-dev python-dev
RUN pip install --upgrade pip
RUN pip install docker-compose
-ENV PATH=$PATH:/opt/findbugs/bin
+ENV PATH=$PATH:/opt/findbugs/bin:/opt/maven/bin:/opt/ant/bin
#This is a dirty but powerful hack. We don't know which uid will be used inside the container.
#But for the kerberized unit test we need real users. We assume that the uid will be something
# between 1 and 5000 and generate all the required users in advance.
-RUN addgroup -g 1000 default && \
+RUN groupadd -g 1000 default && \
mkdir -p /home/user && \
chmod 777 /home/user && \
- for i in $(seq 1 5000); do adduser jenkins$i -u $i -G default -h /home/user -H -D; done
-
-#This is a very huge local maven cache. Usually the mvn repository is not safe to be
-#shared between builds as concurrent "mvn install" executions are not handled very well.
-#A simple workaround is to provide all the required 3rd party lib in the docker image
-#It will be cached by docker, and any additional dependency can be downloaded, artifacts
-#can be installed
-#
-#To be sure that we have no dev bits from this build, we will remove org.apache.hadoop files
-#from the local maven repository.
-USER jenkins1000
-RUN cd /tmp && \
- git clone --depth=1 https://github.com/apache/hadoop.git -b trunk && \
- cd /tmp/hadoop && \
- mvn package dependency:go-offline -DskipTests -f pom.ozone.xml && \
- rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
- rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
- rm -rf /tmp/hadoop && \
- find /home/user/.m2/repository -exec chmod o+wx {} \;
-
-USER root
+ for i in $(seq 1 5000); do adduser jenkins$i -u $i -g default -d /home/user -N; done
RUN echo "ALL ALL=(ALL) NOPASSWD: ALL" >> /etc/sudoers
@@ -99,4 +80,22 @@ RUN pip install robotframework
RUN curl -sL https://github.com/muquit/mailsend-go/releases/download/v1.0.5/mailsend-go_1.0.5_linux-64bit.tar.gz | tar zxf - && mv mailsend-go-dir/mailsend-go /usr/local/bin/ && rm -rf mailsend-go-dir
+RUN curl -L https://github.com/elek/flekszible/releases/download/v1.5.2/flekszible_1.5.2_Linux_x86_64.tar.gz | tar zx && mv flekszible /usr/local/bin && chmod +x /usr/local/bin/flekszible
+
USER jenkins1000
+
+#This is a very huge local maven cache. Usually the mvn repository is not safe to be
+#shared between builds as concurrent "mvn install" executions are not handled very well.
+#A simple workaround is to provide all the required 3rd party lib in the docker image
+#It will be cached by docker, and any additional dependency can be downloaded, artifacts
+#can be installed
+#
+#To be sure that we have no dev bits from this build, we will remove org.apache.hadoop files
+#from the local maven repository.
+
+RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop.git -b trunk && \
+ cd /tmp/hadoop && mvn -B package dependency:go-offline -DskipTests=true -f pom.ozone.xml && \
+ rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
+ rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
+ rm -rf /tmp/hadoop && \
+ find /home/user/.m2/repository -exec chmod go+wx {} \;
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 16/17: Trigger build for Ozone f64bc6ed3
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit c7d48c19f1522ce1c5836f53bac875dacc14bd48
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Fri Aug 28 13:49:46 2020 +0200
Trigger build for Ozone f64bc6ed3
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index efd2ddb..f22ee02 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 798e00c97
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: f64bc6ed3
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 14/17: Trigger build for Ozone 73b87fd8f
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 87d5222ad232191759aca649e84c836b588eb8b3
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Thu Jun 18 02:10:15 2020 +0200
Trigger build for Ozone 73b87fd8f
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index eea3774..6a9a0dc 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 78255ddc7
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 73b87fd8f
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 11/17: Trigger build for Ozone 4b2dc09b6
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 13074cbecef4690ea15de0eeceff1b7d7fbedf21
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Sat May 30 15:31:42 2020 +0200
Trigger build for Ozone 4b2dc09b6
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index e1b8e68..9da083e 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: f046ebf20
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 4b2dc09b6
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 12/17: Trigger build for Ozone 072370b94
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit b41c9ec69db85114c94cd417b019b8945f7a9433
Author: Elek Márton <el...@apache.org>
AuthorDate: Thu Jun 4 19:23:34 2020 +0200
Trigger build for Ozone 072370b94
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index 9da083e..5664900 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 4b2dc09b6
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 072370b94
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 02/17: HDDS-2232. ozone-build docker image
is failing due to a missing entrypoint script
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit bb8d16b7fdc03ea656982fbe6ee2f384435334c8
Author: Márton Elek <el...@apache.org>
AuthorDate: Tue Oct 29 16:07:03 2019 +0100
HDDS-2232. ozone-build docker image is failing due to a missing entrypoint script
---
Dockerfile | 31 +++++++++++++++++++++++--------
1 file changed, 23 insertions(+), 8 deletions(-)
diff --git a/Dockerfile b/Dockerfile
index ad8f9de..dd3636e 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -12,14 +12,18 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
-FROM docker:18.09.1-dind
-RUN apk add --update --no-cache bash alpine-sdk maven jq grep openjdk8 py-pip rsync procps autoconf automake libtool findutils
+FROM docker:18.09.1
+RUN apk add --update --no-cache bash alpine-sdk maven jq grep openjdk8 py-pip rsync procps autoconf automake libtool findutils coreutils
#Install real glibc
RUN apk --no-cache add ca-certificates wget && \
wget -q -O /etc/apk/keys/sgerrand.rsa.pub https://alpine-pkgs.sgerrand.com/sgerrand.rsa.pub && \
wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/2.28-r0/glibc-2.28-r0.apk && \
- apk add glibc-2.28-r0.apk
+ apk add glibc-2.28-r0.apk && \
+ wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/2.28-r0/glibc-bin-2.28-r0.apk && \
+ apk add glibc-bin-2.28-r0.apk && \
+ wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/2.28-r0/glibc-i18n-2.28-r0.apk && \
+ apk add glibc-i18n-2.28-r0.apk
#Install protobuf
RUN mkdir -p /usr/local/src/ && \
@@ -40,7 +44,7 @@ RUN mkdir -p /opt && \
#Install apache-ant
RUN mkdir -p /opt && \
- curl -sL 'https://www.apache.org/dyn/mirrors/mirrors.cgi?action=download&filename=/ant/binaries/apache-ant-1.10.5-bin.tar.gz' | tar -xz && \
+ curl -sL 'https://www.apache.org/dyn/mirrors/mirrors.cgi?action=download&filename=/ant/binaries/apache-ant-1.10.7-bin.tar.gz' | tar -xz && \
mv apache-ant* /opt/ant
#Install docker-compose (for smoketests)
@@ -70,7 +74,7 @@ USER jenkins1000
RUN cd /tmp && \
git clone --depth=1 https://github.com/apache/hadoop.git -b trunk && \
cd /tmp/hadoop && \
- mvn package dependency:go-offline -DskipTests -P hdds -pl :hadoop-ozone-dist -am && \
+ mvn package dependency:go-offline -DskipTests -f pom.ozone.xml && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop && \
@@ -79,9 +83,20 @@ RUN cd /tmp && \
USER root
RUN echo "ALL ALL=(ALL) NOPASSWD: ALL" >> /etc/sudoers
-ENV DOCKER_HOST=unix:///var/run/dockeri.sock
-ADD entrypoint.sh /usr/local/bin/entrypoint.sh
-ENTRYPOINT ["/usr/local/bin/entrypoint.sh"]
+RUN ln -s /home/user/.m2 /root/.m2
+#blockade test
+RUN pip install virtualenv && virtualenv /opt/blockade && /opt/blockade/bin/pip install pytest==2.8.7 blockade
+ENV PATH=$PATH:/opt/blockade/bin
+#kubectl
+RUN cd /usr/local/bin && \
+ curl -LO https://storage.googleapis.com/kubernetes-release/release/$(curl -s https://storage.googleapis.com/kubernetes-release/release/stable.txt)/bin/linux/amd64/kubectl && \
+ chmod +x ./kubectl
+
+RUN pip install robotframework
+
+RUN curl -sL https://github.com/muquit/mailsend-go/releases/download/v1.0.5/mailsend-go_1.0.5_linux-64bit.tar.gz | tar zxf - && mv mailsend-go-dir/mailsend-go /usr/local/bin/ && rm -rf mailsend-go-dir
+
+USER jenkins1000
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 09/17: Trigger new build with latest Ozone
dependencies (8576072ba)
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 86da43375e1187f6c873f71bba2d678a8130bbcc
Author: Elek Márton <el...@apache.org>
AuthorDate: Fri May 8 16:44:22 2020 +0200
Trigger new build with latest Ozone dependencies (8576072ba)
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index 318b8fa..1a8bdb9 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # c9a192553
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 8576072ba
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 05/17: Retrigger build with empty commit.
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 6448d1b5a2c2a396927d74211c2e5053edb82b9f
Author: Elek Márton <el...@apache.org>
AuthorDate: Sat Mar 14 22:40:36 2020 +0100
Retrigger build with empty commit.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 07/17: Trigger rebuild to get dependency
update:
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 0361b3ba11a0d8f22891a9db76bde1d1d85414d8
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Thu Apr 9 18:51:33 2020 +0200
Trigger rebuild to get dependency update:
* apache/hadoop-ozone@89c34b4e1 HDDS-3353. Remove unnecessary transitive hadoop-common dependencies on server side.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 01/17: HDDS-1516. Docker definition of ozone
build environment.
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 7c6312bc18c32ecc28f3cb71ba93e54278905989
Author: Márton Elek <el...@apache.org>
AuthorDate: Thu May 9 16:54:40 2019 +0200
HDDS-1516. Docker definition of ozone build environment.
---
Dockerfile | 87 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
README.md | 21 +++++++++++++++
2 files changed, 108 insertions(+)
diff --git a/Dockerfile b/Dockerfile
new file mode 100644
index 0000000..ad8f9de
--- /dev/null
+++ b/Dockerfile
@@ -0,0 +1,87 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+FROM docker:18.09.1-dind
+RUN apk add --update --no-cache bash alpine-sdk maven jq grep openjdk8 py-pip rsync procps autoconf automake libtool findutils
+
+#Install real glibc
+RUN apk --no-cache add ca-certificates wget && \
+ wget -q -O /etc/apk/keys/sgerrand.rsa.pub https://alpine-pkgs.sgerrand.com/sgerrand.rsa.pub && \
+ wget https://github.com/sgerrand/alpine-pkg-glibc/releases/download/2.28-r0/glibc-2.28-r0.apk && \
+ apk add glibc-2.28-r0.apk
+
+#Install protobuf
+RUN mkdir -p /usr/local/src/ && \
+ cd /usr/local/src/ && \
+ wget https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz && \
+ tar xvf protobuf-2.5.0.tar.gz && \
+ cd protobuf-2.5.0 && \
+ ./autogen.sh && \
+ ./configure --prefix=/usr && \
+ make && \
+ make install && \
+ protoc --version
+
+#Findbug install
+RUN mkdir -p /opt && \
+ curl -sL https://sourceforge.net/projects/findbugs/files/findbugs/3.0.1/findbugs-3.0.1.tar.gz/download | tar -xz && \
+ mv findbugs-* /opt/findbugs
+
+#Install apache-ant
+RUN mkdir -p /opt && \
+ curl -sL 'https://www.apache.org/dyn/mirrors/mirrors.cgi?action=download&filename=/ant/binaries/apache-ant-1.10.5-bin.tar.gz' | tar -xz && \
+ mv apache-ant* /opt/ant
+
+#Install docker-compose (for smoketests)
+RUN apk add --no-cache libffi-dev libressl-dev python-dev
+RUN pip install --upgrade pip
+RUN pip install docker-compose
+
+ENV PATH=$PATH:/opt/findbugs/bin
+
+#This is a dirty but powerful hack. We don't know which uid will be used inside the container.
+#But for the kerberized unit test we need real users. We assume that the uid will be something
+# between 1 and 5000 and generate all the required users in advance.
+RUN addgroup -g 1000 default && \
+ mkdir -p /home/user && \
+ chmod 777 /home/user && \
+ for i in $(seq 1 5000); do adduser jenkins$i -u $i -G default -h /home/user -H -D; done
+
+#This is a very huge local maven cache. Usually the mvn repository is not safe to be
+#shared between builds as concurrent "mvn install" executions are not handled very well.
+#A simple workaround is to provide all the required 3rd party lib in the docker image
+#It will be cached by docker, and any additional dependency can be downloaded, artifacts
+#can be installed
+#
+#To be sure that we have no dev bits from this build, we will remove org.apache.hadoop files
+#from the local maven repository.
+USER jenkins1000
+RUN cd /tmp && \
+ git clone --depth=1 https://github.com/apache/hadoop.git -b trunk && \
+ cd /tmp/hadoop && \
+ mvn package dependency:go-offline -DskipTests -P hdds -pl :hadoop-ozone-dist -am && \
+ rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
+ rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
+ rm -rf /tmp/hadoop && \
+ find /home/user/.m2/repository -exec chmod o+wx {} \;
+
+USER root
+
+RUN echo "ALL ALL=(ALL) NOPASSWD: ALL" >> /etc/sudoers
+ENV DOCKER_HOST=unix:///var/run/dockeri.sock
+
+ADD entrypoint.sh /usr/local/bin/entrypoint.sh
+ENTRYPOINT ["/usr/local/bin/entrypoint.sh"]
+
+
diff --git a/README.md b/README.md
new file mode 100644
index 0000000..34d20f2
--- /dev/null
+++ b/README.md
@@ -0,0 +1,21 @@
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# Apache Hadoop Ozone Build Environment
+
+This image contains all the required tool to build and test Apache Hadoop Ozone projects.
+
+
+
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 10/17: Trigger build for Ozone f046ebf20
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 561de2221e70a0b6ccd471dd644fb32abd2a68fe
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Mon May 18 10:22:35 2020 +0200
Trigger build for Ozone f046ebf20
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index 1a8bdb9..e1b8e68 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 8576072ba
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: f046ebf20
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 13/17: Trigger build for Ozone 78255ddc7
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 5da538191169ad502a6d8ad876fe91dc71b22e71
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Fri Jun 12 09:29:07 2020 +0200
Trigger build for Ozone 78255ddc7
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index 5664900..eea3774 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 072370b94
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 78255ddc7
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 17/17: install latest git from source (#17)
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 9709e25deb9c317f7b307a887156374d845ae6dd
Author: Doroszlai, Attila <64...@users.noreply.github.com>
AuthorDate: Mon Nov 16 11:46:14 2020 +0100
install latest git from source (#17)
---
Dockerfile | 16 ++++++++++++++--
1 file changed, 14 insertions(+), 2 deletions(-)
diff --git a/Dockerfile b/Dockerfile
index f22ee02..a88b82f 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -19,12 +19,24 @@ RUN yum -y install gcc gcc-c++ kernel-devel make autoconf automake libtool which
docker \
python-pip \
file python-devel \
- git \
+ curl-devel dh-autoreconf expat-devel getopt gettext-devel openssl-devel perl-devel zlib-devel \
jq \
sudo
-#Install protobuf
ENV LD_LIBRARY_PATH=/usr/lib
+
+# Install git
+RUN mkdir -p /usr/local/src/ && \
+ cd /usr/local/src/ && \
+ curl -sL https://www.kernel.org/pub/software/scm/git/git-2.29.2.tar.gz | tar xz && \
+ cd git-2.29.2 && \
+ make configure && \
+ ./configure --prefix=/usr && \
+ make all && \
+ make install && \
+ git --version
+
+#Install protobuf
RUN mkdir -p /usr/local/src/ && \
cd /usr/local/src/ && \
curl -sL https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz | tar xz && \
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 04/17: HDDS-2859. Hugo error should be
propagated to build
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 5048fe9e2657b60e59efe1a27faa4be2c6f514c0
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Fri Jan 10 20:17:42 2020 +0100
HDDS-2859. Hugo error should be propagated to build
Closes #10
---
Dockerfile | 8 +++++---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/Dockerfile b/Dockerfile
index 9349d1d..f8e221d 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -82,6 +82,8 @@ RUN curl -sL https://github.com/muquit/mailsend-go/releases/download/v1.0.5/mail
RUN curl -L https://github.com/elek/flekszible/releases/download/v1.5.2/flekszible_1.5.2_Linux_x86_64.tar.gz | tar zx && mv flekszible /usr/local/bin && chmod +x /usr/local/bin/flekszible
+RUN curl -LSs https://github.com/gohugoio/hugo/releases/download/v0.62.2/hugo_0.62.2_Linux-64bit.tar.gz | tar zxf - hugo && mv hugo /usr/local/bin/ && chmod +x /usr/local/bin/hugo
+
USER jenkins1000
#This is a very huge local maven cache. Usually the mvn repository is not safe to be
@@ -93,9 +95,9 @@ USER jenkins1000
#To be sure that we have no dev bits from this build, we will remove org.apache.hadoop files
#from the local maven repository.
-RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop.git -b trunk && \
- cd /tmp/hadoop && mvn -B package dependency:go-offline -DskipTests=true -f pom.ozone.xml && \
+RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b master && \
+ cd /tmp/hadoop-ozone && mvn -B package dependency:go-offline -DskipTests=true && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
- rm -rf /tmp/hadoop && \
+ rm -rf /tmp/hadoop-ozone && \
find /home/user/.m2/repository -exec chmod go+wx {} \;
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 06/17: Trigger rebuild to get recent
dependency updates:
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 862cd65ecade6079d485f02a268294797d9eb35e
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Wed Apr 8 11:16:44 2020 +0200
Trigger rebuild to get recent dependency updates:
* apache/hadoop-ozone@ad92019e8 HDDS-3312. Remove sever-side dependencies from hdds/ozone-common
* apache/hadoop-ozone@54580ecac HDDS-3351. Remove unnecessary dependency Curator. (#777)
* apache/hadoop-ozone@66614690a HDDS-3308. Update Ratis snapshot (#741)
* apache/hadoop-ozone@386baf1bd HDDS-3251. Bump version to 0.6.0-SNAPSHOT
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 15/17: Trigger build for Ozone 798e00c97
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit 453013c83e6929d2a469bd86f9e4288071f032f0
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Tue Jul 21 17:18:15 2020 +0200
Trigger build for Ozone 798e00c97
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index 6a9a0dc..efd2ddb 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 73b87fd8f
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # ozone master: 798e00c97
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org
[ozone-docker-builder] 08/17: trigger rebuild for c9a192553
Posted by el...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
elek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/ozone-docker-builder.git
commit c582430ef9908cbc5d7769b0ec9e36ab0d91acae
Author: Doroszlai, Attila <ad...@apache.org>
AuthorDate: Tue Apr 14 12:06:47 2020 +0200
trigger rebuild for c9a192553
---
Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/Dockerfile b/Dockerfile
index f8e221d..318b8fa 100644
--- a/Dockerfile
+++ b/Dockerfile
@@ -100,4 +100,4 @@ RUN cd /tmp && git clone --depth=1 https://github.com/apache/hadoop-ozone.git -b
rm -rf /home/user/.m2/repository/org/apache/hadoop/*hdds* && \
rm -rf /home/user/.m2/repository/org/apache/hadoop/*ozone* && \
rm -rf /tmp/hadoop-ozone && \
- find /home/user/.m2/repository -exec chmod go+wx {} \;
+ find /home/user/.m2/repository -exec chmod go+wx {} \; # c9a192553
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozone.apache.org
For additional commands, e-mail: commits-help@ozone.apache.org