You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Percy Camilo Triveño Aucahuasi (Jira)" <ji...@apache.org> on 2022/09/19 17:38:00 UTC
[jira] [Updated] (ARROW-17765) Archery docker: multiplatform support on arm64
[ https://issues.apache.org/jira/browse/ARROW-17765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Percy Camilo Triveño Aucahuasi updated ARROW-17765:
---------------------------------------------------
Attachment: with-buildx.txt.log.sh
> Archery docker: multiplatform support on arm64
> ----------------------------------------------
>
> Key: ARROW-17765
> URL: https://issues.apache.org/jira/browse/ARROW-17765
> Project: Apache Arrow
> Issue Type: Bug
> Components: Archery
> Reporter: Percy Camilo Triveño Aucahuasi
> Priority: Minor
> Attachments: with-buildx.txt.log.sh, without-buildx.txt.log.sh
>
>
> It seems right now is not possible to build/run arrow docker containers with arch=arm64 (the default platform is amd64)
> I tried first with this command:
>
> {code:java}
> ARCH=arm64 archery docker run conda-cpp-valgrind{code}
>
> and got this error:
>
> {code:java}
> [+] Running 0/1
> ⠿ conda Error 1.8s
> Pulling conda: Error response from daemon: manifest for apache/arrow-dev:arm64-conda not found: manifest unknown: manifest unknown
> [+] Running 0/1
> ⠿ conda-cpp Error 1.7s
> Pulling conda-cpp: Error response from daemon: manifest for apache/arrow-dev:arm64-conda-cpp not found: manifest unknown: manifest unknown
> [+] Building 1.1s (3/3) FINISHED
> => [internal] load build definition from conda.dockerfile 0.0s
> => => transferring dockerfile: 38B 0.0s
> => [internal] load .dockerignore 0.0s
> => => transferring context: 35B 0.0s
> => ERROR [internal] load metadata for docker.io/arm64/ubuntu:18.04 1.0s
> ------
> > [internal] load metadata for docker.io/arm64/ubuntu:18.04:
> ------
> failed to solve: rpc error: code = Unknown desc = failed to solve with frontend dockerfile.v0: failed to create LLB definition: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed
> Error: `docker-compose --file /arrow/docker-compose.yml build --build-arg BUILDKIT_INLINE_CACHE=1 conda` exited with a non-zero exit code 17, see the process log above.
> The docker-compose command was invoked with the following parameters:
> Defaults defined in .env:
> ALMALINUX: 8
> ALPINE_LINUX: 3.16
> ARCH: amd64
> ARCH_ALIAS: x86_64
> ARCH_SHORT: amd64
> ARROW_R_DEV: TRUE
> BUILDKIT_INLINE_CACHE: 1
> CLANG_TOOLS: 12
> COMPOSE_DOCKER_CLI_BUILD: 1
> CONAN: gcc10
> CUDA: 11.0.3
> DASK: latest
> DEBIAN: 11
> DEVTOOLSET_VERSION: -1
> DOCKER_BUILDKIT: 1
> DOCKER_VOLUME_PREFIX:
> DOTNET: 6.0
> FEDORA: 35
> GCC_VERSION:
> GO: 1.17
> HDFS: 3.2.1
> JDK: 8
> KARTOTHEK: latest
> LLVM: 13
> MAVEN: 3.5.4
> NODE: 16
> NUMBA: latest
> NUMPY: latest
> PANDAS: latest
> PYTHON: 3.8
> PYTHON_WHEEL_WINDOWS_IMAGE_REVISION: 2022-06-12
> R: 4.2
> REPO: apache/arrow-dev
> R_CUSTOM_CCACHE: false
> R_IMAGE: ubuntu-gcc-release
> R_ORG: rhub
> R_PRUNE_DEPS: FALSE
> R_TAG: latest
> SPARK: master
> STATICCHECK: v0.2.2
> TURBODBC: latest
> TZ: UTC
> UBUNTU: 20.04
> ULIMIT_CORE: -1
> VCPKG: 38bb87c
> Archery was called with:
> export ARCH=arm64
> {code}
>
> Then, I tried to use the docker buildx plugin with this command:
>
> {code:java}
> ARCH=arm64 archery docker run --using-docker-buildx conda-cpp-valgrind{code}
>
> and got this error:
>
> {code:java}
> Error response from daemon: manifest for apache/arrow-dev:arm64-conda not found: manifest unknown: manifest unknown
> docker pull apache/arrow-dev:arm64-conda exited with non-zero exit code 1
> Error response from daemon: manifest for apache/arrow-dev:arm64-conda-cpp not found: manifest unknown: manifest unknown
> docker pull apache/arrow-dev:arm64-conda-cpp exited with non-zero exit code 1
> [+] Building 0.0s (0/0)
> ERROR: cache export feature is currently not supported for docker driver. Please switch to a different driver (eg. "docker buildx create --use")
> Error: docker buildx build --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg arch=arm64 --cache-from type=registry,ref=apache/arrow-dev:arm64-conda-cache --cache-to type=registry,ref=apache/arrow-dev:arm64-conda-cache,mode=max --output type=docker -f /arrow/ci/docker/conda.dockerfile -t apache/arrow-dev:arm64-conda /arrow exited with non-zero exit code 1{code}
> My system env is:
>
> {code:java}
> uname -a
> Darwin MacBook-Pro.local 21.6.0 Darwin Kernel Version 21.6.0: Mon Aug 22 20:19:52 PDT 2022; root:xnu-8020.140.49~2/RELEASE_ARM64_T6000 arm64
>
> docker --version
> Docker version 20.10.17, build 100c701
> docker compose version
> Docker Compose version v2.10.2
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)