You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by GitBox <gi...@apache.org> on 2021/05/10 11:05:15 UTC
[GitHub] [kafka] chia7712 opened a new pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
chia7712 opened a new pull request #10661:
URL: https://github.com/apache/kafka/pull/10661
The following error happens on my mac m1 when building docker image for system tests.
```
Collecting pynacl
Using cached PyNaCl-1.4.0.tar.gz (3.4 MB)
Installing build dependencies ... error
ERROR: Command errored out with exit status 1:
command: /usr/bin/python3 /usr/local/lib/python3.8/dist-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-k867aac0/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.org/simple -- 'setuptools>=40.8.0' wheel 'cffi>=1.4.1; python_implementation != '"'"'PyPy'"'"''
cwd: None
Complete output (14 lines):
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/usr/local/lib/python3.8/dist-packages/pip/__main__.py", line 23, in <module>
from pip._internal.cli.main import main as _main # isort:skip # noqa
File "/usr/local/lib/python3.8/dist-packages/pip/_internal/cli/main.py", line 5, in <module>
import locale
File "/usr/lib/python3.8/locale.py", line 16, in <module>
import re
File "/usr/lib/python3.8/re.py", line 145, in <module>
class RegexFlag(enum.IntFlag):
AttributeError: module 'enum' has no attribute 'IntFlag'
----------------------------------------
ERROR: Command errored out with exit status 1: /usr/bin/python3 /usr/local/lib/python3.8/dist-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-k867aac0/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.org/simple -- 'setuptools>=40.8.0' wheel 'cffi>=1.4.1; python_implementation != '"'"'PyPy'"'"'' Check the logs for full command output.
```
There was a related issue: https://github.com/pypa/pip/pull/9689 and it is already fixed by https://github.com/pypa/pip/pull/9689 (included by pip 21.1.1). I test the pip 21.1.1 and it works well on mac m1.
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] vvcephei commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
vvcephei commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876782447
Hmm, I also hit that same error today.
It seems to have been caused because the image was running Debian 9, and the latest version of `python3` available in Debian 9 is 3.5, which only supports pip up to version 20. I confirmed this was the issue by getting a terminal on top of the errored image, downloading and compiling python 3.6, and running `python3.6 -m pip install -U pip=21.1.1`.
After running `docker system prune -a`, I see it's running Debian 10:
```
root@826557ee9546:/# cat /etc/issue
Debian GNU/Linux 10 \n \l
```
Building on the recent discussion here, maybe what's happening is that we had an older cached version of the openjdk:8 image, which limited the python version to 3.5, which in turn make it impossible to upgrade to pip 21.
Just wanted to provide more context. I assume others will hit the same thing. The solution is to run `docker system prune -a`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] lbradstreet commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
lbradstreet commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876523777
@chia7712 thanks for checking. Yes, my dockerfile was a bit modified. The unmodified run is:
```
Sending build context to Docker daemon 43.52kB
Step 1/54 : ARG jdk_version=openjdk:8
Step 2/54 : FROM $jdk_version
---> 09df0563bdfc
Step 3/54 : MAINTAINER Apache Kafka dev@kafka.apache.org
---> Using cache
---> abfbf85c6575
Step 4/54 : VOLUME ["/opt/kafka-dev"]
---> Using cache
---> d9178c554c16
Step 5/54 : ENV TZ="/usr/share/zoneinfo/America/Los_Angeles"
---> Using cache
---> 8245a50f89b4
Step 6/54 : ENV DEBIAN_FRONTEND noninteractive
---> Using cache
---> 6e41f5a58d78
Step 7/54 : ARG ducker_creator=default
---> Using cache
---> 9d39a84cd18d
Step 8/54 : LABEL ducker.creator=$ducker_creator
---> Using cache
---> 25fe89abca0c
Step 9/54 : RUN apt update && apt install -y sudo git netcat iptables rsync unzip wget curl jq coreutils openssh-server net-tools vim python3-pip python3-dev libffi-dev libssl-dev cmake pkg-config libfuse-dev iperf traceroute && apt-get -y clean
---> Using cache
---> 0b5597132e07
Step 10/54 : RUN python3 -m pip install -U pip==21.1.1;
---> [Warning] Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
---> Running in 0bae66304b96
Collecting pip==21.1.1
Could not find a version that satisfies the requirement pip==21.1.1 (from versions: 0.2, 0.2.1, 0.3, 0.3.1, 0.4, 0.5, 0.5.1, 0.6, 0.6.1, 0.6.2, 0.6.3, 0.7, 0.7.1, 0.7.2, 0.8, 0.8.1, 0.8.2, 0.8.3, 1.0, 1.0.1, 1.0.2, 1.1, 1.2, 1.2.1, 1.3, 1.3.1, 1.4, 1.4.1, 1.5, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 6.0, 6.0.1, 6.0.2, 6.0.3, 6.0.4, 6.0.5, 6.0.6, 6.0.7, 6.0.8, 6.1.0, 6.1.1, 7.0.0, 7.0.1, 7.0.2, 7.0.3, 7.1.0, 7.1.1, 7.1.2, 8.0.0, 8.0.1, 8.0.2, 8.0.3, 8.1.0, 8.1.1, 8.1.2, 9.0.0, 9.0.1, 9.0.2, 9.0.3, 10.0.0b1, 10.0.0b2, 10.0.0, 10.0.1, 18.0, 18.1, 19.0, 19.0.1, 19.0.2, 19.0.3, 19.1, 19.1.1, 19.2, 19.2.1, 19.2.2, 19.2.3, 19.3, 19.3.1, 20.0, 20.0.1, 20.0.2, 20.1b1, 20.1, 20.1.1, 20.2b1, 20.2, 20.2.1, 20.2.2, 20.2.3, 20.2.4, 20.3b1, 20.3, 20.3.1, 20.3.2, 20.3.3, 20.3.4)
No matching distribution found for pip==21.1.1
The command '/bin/sh -c python3 -m pip install -U pip==21.1.1;' returned a non-zero code: 1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] lbradstreet commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
lbradstreet commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876533410
> > @lbradstreet Could you share the ID of `openjdk:8` to me? the image id of `openjdk:8` in my env is `d61c96e2d100`
>
> I ran docker system prune before reporting this in case something was happening there.
>
> ```
> "Id": "sha256:09df0563bdfc760be1ce6f153f4fdb1950e8ccc9dbb298f8c76da38dc0cecfd6",
> "RepoTags": [
> "openjdk:8"
> ],
> "RepoDigests": [
> "openjdk@sha256:c58264860b32c8603ac125862d17b1d73896bceaa33c843c9a7163904786eb82"
> ],
> "Parent": "",
> "Comment": "",
> "Created": "2019-11-23T14:34:16.005709367Z",
> "Container": "1f98649c600b636393cc3d3cd8b594134fe979b85d122dc5fa41d4d8311de8b3",
> "ContainerConfig": {
> "Hostname": "",
> "Domainname": "",
> "User": "",
> "AttachStdin": false, "AttachStdout": false, "AttachStderr": false,
> "Tty": false,
> "OpenStdin": false,
> "StdinOnce": false,
> "Env": [
> "PATH=/usr/local/openjdk-8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
> "LANG=C.UTF-8",
> "JAVA_HOME=/usr/local/openjdk-8",
> "JAVA_VERSION=8u232",
> "JAVA_BASE_URL=https://github.com/AdoptOpenJDK/openjdk8-upstream-binaries/releases/download/jdk8u232-b09/OpenJDK8U-jdk_",
> "JAVA_URL_VERSION=8u232b09"
> ],
> ```
Maybe I didn't fully clear all images. I'll see if I can delete them in another way.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] chia7712 merged pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
chia7712 merged pull request #10661:
URL: https://github.com/apache/kafka/pull/10661
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] chia7712 commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
chia7712 commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876529435
@lbradstreet Could you share the ID of `openjdk:8` to me? the image id of `openjdk:8` in my env is `d61c96e2d100`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] chia7712 commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
chia7712 commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876514001
## build image on MacBook Air M1
<img width="1432" alt="截圖 2021-07-08 下午10 57 09" src="https://user-images.githubusercontent.com/6234750/124944605-09b02680-e040-11eb-9a97-14daa986e397.png">
## build image on iMac 27 intel
<img width="2032" alt="截圖 2021-07-08 下午10 58 29" src="https://user-images.githubusercontent.com/6234750/124945142-77f4e900-e040-11eb-92f4-25906def19c9.png">
@lbradstreet Please take a look at above screenshot. I don't observe the error you mentioned. BTW, the step `Step 10/68 ` is different from repo's docker file. Did you build image by other docker file?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] lbradstreet commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
lbradstreet commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876532382
> @lbradstreet Could you share the ID of `openjdk:8` to me? the image id of `openjdk:8` in my env is `d61c96e2d100`
I ran docker system prune before reporting this in case something was happening there.
```
"Id": "sha256:09df0563bdfc760be1ce6f153f4fdb1950e8ccc9dbb298f8c76da38dc0cecfd6",
"RepoTags": [
"openjdk:8"
],
"RepoDigests": [
"openjdk@sha256:c58264860b32c8603ac125862d17b1d73896bceaa33c843c9a7163904786eb82"
],
"Parent": "",
"Comment": "",
"Created": "2019-11-23T14:34:16.005709367Z",
"Container": "1f98649c600b636393cc3d3cd8b594134fe979b85d122dc5fa41d4d8311de8b3",
"ContainerConfig": {
"Hostname": "",
"Domainname": "",
"User": "",
"AttachStdin": false, "AttachStdout": false, "AttachStderr": false,
"Tty": false,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"PATH=/usr/local/openjdk-8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
"LANG=C.UTF-8",
"JAVA_HOME=/usr/local/openjdk-8",
"JAVA_VERSION=8u232",
"JAVA_BASE_URL=https://github.com/AdoptOpenJDK/openjdk8-upstream-binaries/releases/download/jdk8u232-b09/OpenJDK8U-jdk_",
"JAVA_URL_VERSION=8u232b09"
],
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] vvcephei commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
vvcephei commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876783256
Ah, and now I noticed that we've added a message to this effect in the script today: https://github.com/apache/kafka/pull/10995
Carry on :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] lbradstreet commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
lbradstreet commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876535817
@chia7712 sorry for the false alarm and thanks for checking that it worked on your side. The problem was that I should have run `docker system prune -a` rather than `docker system prune`. It's now working.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] chia7712 commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
chia7712 commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876500588
> are you using a different jdk base docker image version on your m1?
IIRC, I was using `openjdk:8`. Will retry it later :(
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] lbradstreet commented on pull request #10661: MINOR: upgrade pip from 20.2.2 to 21.1.1
Posted by GitBox <gi...@apache.org>.
lbradstreet commented on pull request #10661:
URL: https://github.com/apache/kafka/pull/10661#issuecomment-876496847
This is failing for me with:
```
Step 10/68 : RUN python3 -m pip install -U pip==21.1.1;
---> [Warning] Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
---> Running in 23f5e4d95ed4
Collecting pip==21.1.1
Could not find a version that satisfies the requirement pip==21.1.1 (from versions: 0.2, 0.2.1, 0.3, 0.3.1, 0.4, 0.5, 0.5.1, 0.6, 0.6.1, 0.6.2, 0.6.3, 0.7, 0.7.1, 0.7.2, 0.8, 0.8.1, 0.8.2, 0.8.3, 1.0, 1.0.1, 1.0.2, 1.1, 1.2, 1.2.1, 1.3, 1.3.1
, 1.4, 1.4.1, 1.5, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 6.0, 6.0.1, 6.0.2, 6.0.3, 6.0.4, 6.0.5, 6.0.6, 6.0.7, 6.0.8, 6.1.0, 6.1.1, 7.0.0, 7.0.1, 7.0.2, 7.0.3, 7.1.0, 7.1.1, 7.1.2, 8.0.0, 8.0.1, 8.0.2, 8.0.3, 8.1.0, 8.1.1, 8.1.2, 9.0.0, 9.0
.1, 9.0.2, 9.0.3, 10.0.0b1, 10.0.0b2, 10.0.0, 10.0.1, 18.0, 18.1, 19.0, 19.0.1, 19.0.2, 19.0.3, 19.1, 19.1.1, 19.2, 19.2.1, 19.2.2, 19.2.3, 19.3, 19.3.1, 20.0, 20.0.1, 20.0.2, 20.1b1, 20.1, 20.1.1, 20.2b1, 20.2, 20.2.1, 20.2.2, 20.2.3, 20.2.4,
20.3b1, 20.3, 20.3.1, 20.3.2, 20.3.3, 20.3.4)
No matching distribution found for pip==21.1.1
```
@chia7712 are you using a different jdk base docker image version on your m1?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org