You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/11/10 17:55:38 UTC
[GitHub] [airflow] potiuk opened a new issue #12263: Tagged Production image build fails in DockerHub
potiuk opened a new issue #12263:
URL: https://github.com/apache/airflow/issues/12263
Beta1 and Beta 2 were built manually as the scripts for building images in DockerHub ALMOST worked :). they failed on pulling tagged -build images.
```
Cloning into '.'...
Warning: Permanently added the RSA host key for IP address '140.82.114.4' to the list of known hosts.
Switched to a new branch '2.0.0b2'
Executing build hook...
DOCKER_REPO=index.docker.io/apache/airflow
DOCKERHUB_USER=apache
DOCKERHUB_REPO=airflow
DOCKER_TAG=2.0.0b2-python3.7
Detected PYTHON_MAJOR_MINOR_VERSION=3.7
+++ date +%s
++ START_SCRIPT_TIME=1605013728
++ build_images::determine_docker_cache_strategy
++ [[ -z '' ]]
++ [[ false == \t\r\u\e ]]
++ export DOCKER_CACHE=pulled
++ DOCKER_CACHE=pulled
++ readonly DOCKER_CACHE
++ verbosity::print_info
++ [[ false == \t\r\u\e ]]
++ verbosity::print_info 'Using pulled cache strategy for the build.'
++ [[ false == \t\r\u\e ]]
++ verbosity::print_info
++ [[ false == \t\r\u\e ]]
++ initialization::get_environment_for_builds_on_ci
++ [[ false == \t\r\u\e ]]
++ export CI_TARGET_REPO=apache/airflow
++ CI_TARGET_REPO=apache/airflow
++ export CI_TARGET_BRANCH=master
++ CI_TARGET_BRANCH=master
++ export CI_BUILD_ID=0
++ CI_BUILD_ID=0
++ export CI_JOB_ID=0
++ CI_JOB_ID=0
++ export CI_EVENT_TYPE=pull_request
++ CI_EVENT_TYPE=pull_request
++ export CI_REF=refs/head/master
++ CI_REF=refs/head/master
++ [[ false == \t\r\u\e ]]
++ build_images::get_docker_image_names
++ export PYTHON_BASE_IMAGE_VERSION=3.7
++ PYTHON_BASE_IMAGE_VERSION=3.7
++ export PYTHON_BASE_IMAGE=python:3.7-slim-buster
++ PYTHON_BASE_IMAGE=python:3.7-slim-buster
++ export AIRFLOW_CI_BASE_TAG=master-python3.7-ci
++ AIRFLOW_CI_BASE_TAG=master-python3.7-ci
++ export AIRFLOW_CI_IMAGE=apache/airflow:master-python3.7-ci
++ AIRFLOW_CI_IMAGE=apache/airflow:master-python3.7-ci
++ export AIRFLOW_CI_PYTHON_IMAGE=apache/airflow:python3.7-master
++ AIRFLOW_CI_PYTHON_IMAGE=apache/airflow:python3.7-master
++ export AIRFLOW_CI_IMAGE=apache/airflow:master-python3.7-ci
++ AIRFLOW_CI_IMAGE=apache/airflow:master-python3.7-ci
++ [[ 2.0.0b2-python3.7 == '' ]]
++ export AIRFLOW_PROD_BASE_TAG=2.0.0b2-python3.7
++ AIRFLOW_PROD_BASE_TAG=2.0.0b2-python3.7
++ export AIRFLOW_PROD_IMAGE=apache/airflow:2.0.0b2-python3.7
++ AIRFLOW_PROD_IMAGE=apache/airflow:2.0.0b2-python3.7
++ export AIRFLOW_PROD_BUILD_IMAGE=apache/airflow:2.0.0b2-python3.7-build
++ AIRFLOW_PROD_BUILD_IMAGE=apache/airflow:2.0.0b2-python3.7-build
++ export AIRFLOW_PROD_IMAGE_KUBERNETES=apache/airflow:2.0.0b2-python3.7-kubernetes
++ AIRFLOW_PROD_IMAGE_KUBERNETES=apache/airflow:2.0.0b2-python3.7-kubernetes
++ export AIRFLOW_PROD_IMAGE_DEFAULT=apache/airflow:master
++ AIRFLOW_PROD_IMAGE_DEFAULT=apache/airflow:master
++ export BUILT_CI_IMAGE_FLAG_FILE=/src/b3fpsnmwartmqn9f6rbzfxh/.build/master/.built_3.7
++ BUILT_CI_IMAGE_FLAG_FILE=/src/b3fpsnmwartmqn9f6rbzfxh/.build/master/.built_3.7
++ initialization::make_constants_read_only
++ readonly PYTHON_MAJOR_MINOR_VERSION
++ readonly WEBSERVER_HOST_PORT
++ readonly POSTGRES_HOST_PORT
++ readonly MYSQL_HOST_PORT
++ readonly HOST_USER_ID
++ readonly HOST_GROUP_ID
++ readonly HOST_AIRFLOW_SOURCES
++ readonly HOST_HOME
++ readonly HOST_OS
++ readonly ENABLE_KIND_CLUSTER
++ readonly KUBERNETES_MODE
++ readonly KUBERNETES_VERSION
++ readonly KIND_VERSION
++ readonly HELM_VERSION
++ readonly KUBECTL_VERSION
++ readonly BACKEND
++ readonly POSTGRES_VERSION
++ readonly MYSQL_VERSION
++ readonly MOUNT_LOCAL_SOURCES
++ readonly INSTALL_AIRFLOW_VERSION
++ readonly INSTALL_AIRFLOW_REFERENCE
++ readonly DB_RESET
++ readonly VERBOSE
++ readonly START_AIRFLOW
++ readonly PRODUCTION_IMAGE
++ readonly SKIP_BUILDING_PROD_IMAGE
++ readonly CI_BUILD_ID
++ readonly CI_JOB_ID
++ readonly IMAGE_TAG
++ readonly AIRFLOW_PRE_CACHED_PIP_PACKAGES
++ readonly INSTALL_AIRFLOW_VIA_PIP
++ readonly AIRFLOW_LOCAL_PIP_WHEELS
++ readonly AIRFLOW_CONSTRAINTS_REFERENCE
++ readonly AIRFLOW_CONSTRAINTS_LOCATION
++ readonly ADDITIONAL_AIRFLOW_EXTRAS
++ readonly ADDITIONAL_PYTHON_DEPS
++ readonly AIRFLOW_PRE_CACHED_PIP_PACKAGES
++ readonly DEV_APT_COMMAND
++ readonly DEV_APT_DEPS
++ readonly ADDITIONAL_DEV_APT_COMMAND
++ readonly ADDITIONAL_DEV_APT_DEPS
++ readonly ADDITIONAL_DEV_APT_ENV
++ readonly RUNTIME_APT_COMMAND
++ readonly RUNTIME_APT_DEPS
++ readonly ADDITIONAL_RUNTIME_APT_COMMAND
++ readonly ADDITIONAL_RUNTIME_APT_DEPS
++ readonly ADDITIONAL_RUNTIME_APT_ENV
++ readonly DOCKERHUB_USER
++ readonly DOCKERHUB_REPO
++ readonly DOCKER_CACHE
++ readonly USE_GITHUB_REGISTRY
++ readonly GITHUB_REGISTRY
++ readonly GITHUB_REGISTRY_WAIT_FOR_IMAGE
++ readonly GITHUB_REGISTRY_PULL_IMAGE_TAG
++ readonly GITHUB_REGISTRY_PUSH_IMAGE_TAG
++ readonly GITHUB_REPOSITORY
++ readonly GITHUB_TOKEN
++ readonly GITHUB_USERNAME
++ readonly FORWARD_CREDENTIALS
++ readonly USE_GITHUB_REGISTRY
++ readonly EXTRA_STATIC_CHECK_OPTIONS
++ readonly VERSION_SUFFIX_FOR_PYPI
++ readonly VERSION_SUFFIX_FOR_SVN
++ readonly PYTHON_BASE_IMAGE_VERSION
++ readonly PYTHON_BASE_IMAGE
++ readonly AIRFLOW_CI_BASE_TAG
++ readonly AIRFLOW_CI_IMAGE
++ readonly AIRFLOW_CI_IMAGE_DEFAULT
++ readonly AIRFLOW_PROD_BASE_TAG
++ readonly AIRFLOW_PROD_IMAGE
++ readonly AIRFLOW_PROD_BUILD_IMAGE
++ readonly AIRFLOW_PROD_IMAGE_KUBERNETES
++ readonly AIRFLOW_PROD_IMAGE_DEFAULT
++ readonly BUILT_CI_IMAGE_FLAG_FILE
++ readonly INIT_SCRIPT_FILE
++ traps::add_trap start_end::script_end EXIT HUP INT TERM
++ trap=start_end::script_end
++ shift
++ for signal in '"${@}"'
++ local handlers
+++ cut -f2 -d \'
+++ trap -p EXIT
++ handlers='rm -rf -- '
++ trap 'start_end::script_end;rm -rf -- ' EXIT
++ for signal in '"${@}"'
++ local handlers
+++ cut -f2 -d \'
+++ trap -p HUP
++ handlers='rm -rf -- '
++ trap 'start_end::script_end;rm -rf -- ' HUP
++ for signal in '"${@}"'
++ local handlers
+++ cut -f2 -d \'
+++ trap -p INT
++ handlers='rm -rf -- '
++ trap 'start_end::script_end;rm -rf -- ' INT
++ for signal in '"${@}"'
++ local handlers
+++ cut -f2 -d \'
+++ trap -p TERM
++ handlers='rm -rf -- '
++ trap 'start_end::script_end;rm -rf -- ' TERM
+ [[ 2.0.0b2-python3.7 == *python*-ci ]]
+ [[ 2.0.0b2-python3.7 == *python* ]]
+ echo
+ echo 'Building prod image'
Building prod image
+ echo
+ rm -rf /src/b3fpsnmwartmqn9f6rbzfxh/.build
+ build_images::prepare_prod_build
+ [[ -n '' ]]
+ [[ -n '' ]]
+ EXTRA_DOCKER_PROD_BUILD_FLAGS=("--build-arg" "AIRFLOW_CONSTRAINTS_REFERENCE=${DEFAULT_CONSTRAINTS_BRANCH}")
+ [[ 3.6 == \3\.\7 ]]
+ export DEFAULT_CI_IMAGE=
+ DEFAULT_CI_IMAGE=
+ export THE_IMAGE_TYPE=PROD
+ THE_IMAGE_TYPE=PROD
+ export 'IMAGE_DESCRIPTION=Airflow production'
+ IMAGE_DESCRIPTION='Airflow production'
+ export AIRFLOW_EXTRAS=async,aws,azure,celery,dask,elasticsearch,gcp,kubernetes,mysql,postgres,redis,slack,ssh,statsd,virtualenv
+ AIRFLOW_EXTRAS=async,aws,azure,celery,dask,elasticsearch,gcp,kubernetes,mysql,postgres,redis,slack,ssh,statsd,virtualenv
+ readonly AIRFLOW_EXTRAS
+ export AIRFLOW_IMAGE=apache/airflow:2.0.0b2-python3.7
+ AIRFLOW_IMAGE=apache/airflow:2.0.0b2-python3.7
+ readonly AIRFLOW_IMAGE
+ [[ false == \t\r\u\e ]]
+ AIRFLOW_BRANCH_FOR_PYPI_PRELOADING=master
+ sanity_checks::go_to_airflow_sources
+ verbosity::print_info
+ [[ false == \t\r\u\e ]]
+ pushd /src/b3fpsnmwartmqn9f6rbzfxh
+ verbosity::print_info
+ [[ false == \t\r\u\e ]]
++ pwd
+ verbosity::print_info 'Running in host in /src/b3fpsnmwartmqn9f6rbzfxh'
+ [[ false == \t\r\u\e ]]
+ verbosity::print_info
+ [[ false == \t\r\u\e ]]
+ build_images::build_prod_images
+ build_images::print_build_info
+ verbosity::print_info
+ [[ false == \t\r\u\e ]]
+ verbosity::print_info 'Airflow 2.0.0b2 Python: 3.7. Image description: Airflow production'
+ [[ false == \t\r\u\e ]]
+ verbosity::print_info
+ [[ false == \t\r\u\e ]]
+ [[ false == \t\r\u\e ]]
+ push_pull_remove_images::pull_prod_images_if_needed
+ [[ pulled == \p\u\l\l\e\d ]]
+ [[ false == \t\r\u\e ]]
+ [[ false == \t\r\u\e ]]
+ push_pull_remove_images::pull_image_if_not_present_or_forced apache/airflow:2.0.0b2-python3.7-build
+ local IMAGE_TO_PULL=apache/airflow:2.0.0b2-python3.7-build
+ local IMAGE_HASH
++ docker images -q apache/airflow:2.0.0b2-python3.7-build
+ IMAGE_HASH=
+ local PULL_IMAGE=false
+ [[ -z '' ]]
+ PULL_IMAGE=true
+ [[ true == \t\r\u\e ]]
+ echo
+ echo 'Pulling the image apache/airflow:2.0.0b2-python3.7-build'
Pulling the image apache/airflow:2.0.0b2-python3.7-build
+ echo
+ docker pull apache/airflow:2.0.0b2-python3.7-build
+ verbosity::store_exit_on_error_status
+ exit_on_error=false
+ [[ ehuxB == *e* ]]
+ exit_on_error=true
+ set +e
+ [[ false == \t\r\u\e ]]
+ [[ true == \f\a\l\s\e ]]
+ /usr/bin/docker pull apache/airflow:2.0.0b2-python3.7-build
++ tee -a /tmp/tmp.zuzptQhEPi/out.log
++ tee -a /tmp/tmp.zuzptQhEPi/out.log
Error response from daemon: manifest for apache/airflow:2.0.0b2-python3.7-build not found: manifest unknown: manifest unknown
+ res=1
+ [[ 1 == \0 ]]
+ [[ true == \f\a\l\s\e ]]
+ verbosity::restore_exit_on_error_status
+ [[ true == \t\r\u\e ]]
+ set -e
+ unset exit_on_error
+ return 1
+ start_end::script_end
+ local exit_code=1
+ [[ 1 != 0 ]]
+ [[ -f /tmp/tmp.zuzptQhEPi/out.log ]]
+ [[ true == \f\a\l\s\e ]]
+ [[ false == \t\r\u\e ]]
+ verbosity::print_info '###########################################################################################'
+ [[ false == \t\r\u\e ]]
+ verbosity::print_info ' EXITING WITH STATUS CODE 1'
+ [[ false == \t\r\u\e ]]
+ verbosity::print_info '###########################################################################################'
+ [[ false == \t\r\u\e ]]
+ [[ true == \t\r\u\e ]]
+ set +x
build hook failed! (1)
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #12263: Tagged Production image build fails in DockerHub
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #12263:
URL: https://github.com/apache/airflow/issues/12263
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org