You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by "SoWhat-ET (via GitHub)" <gi...@apache.org> on 2024/06/06 09:44:21 UTC
[I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
SoWhat-ET opened a new issue, #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-streampark/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### Java Version
1.8
### Scala Version
2.12.x
### StreamPark Version
2.1.4
### Flink Version
1.16.2
### deploy mode
None
### What happened
## 1 Deploying on K8S according to the official guide
https://github.com/apache/incubator-streampark/tree/release-2.1.4/helm#readme
## 2 Error occurred when trying to log in to the system and configure the Docker service.
Failed to validate Docker registry, error: org.apache.hc.client5.http.HttpHostConnectException: Connect to http://localhost:2375 [localhost/127.0.0.1] failed: Connection refused (Connection refused)
## 3 I looked up relevant information and asked the LLM:
Q:
Error encountered while configuring Docker repository after successful deployment：
`Failed to validate Docker registry, error: org.apache.hc.client5.http.HttpHostConnectException: Connect to [http://localhost:2375](vscode-file://vscode-app/Applications/Visual%20Studio%20Code.app/Contents/Resources/app/out/vs/code/electron-sandbox/workbench/workbench.html) [localhost/127.0.0.1] failed: Connection refused (Connection refused)`
是否需要修改`helm/streampark/values.yaml` 文件中的 `{ name: DOCKER_HOST, value: "tcp://localhost:2375" }`
A:
This configuration sets the environment variable DOCKER_HOST to tcp://localhost:2375, which means your application will try to connect to the Docker API on localhost:2375.
In Kubernetes, each Pod has its own network namespace, so localhost refers to the Pod itself, not the node. That's why your application can't find the Docker API on localhost:2375.
If you've enabled the Docker API on the node and want your application to access it, you need to change the value of DOCKER_HOST to the node's IP and Docker API port. For example, if your node's IP is 192.168.1.100, you can set the DOCKER_HOST value to tcp://192.168.1.100:2375.
Note that this is just an example. You need to replace 192.168.1.100 with your actual node IP.
Additionally, you need to make sure your application has permission to access the node's network. This might require setting hostNetwork: true in the Pod's specification.
Be aware that enabling the Docker API and using hostNetwork can pose security risks. You should ensure your network security and enable these options only in a trusted network.
## 4 I want to know if this is a bug or a configuration issue.
### Error Exception
```log
Failed to validate Docker registry, error: org.apache.hc.client5.http.HttpHostConnectException: Connect to http://localhost:2375 [localhost/127.0.0.1] failed: Connection refused (Connection refused)
```
### Screenshots
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!(您是否要贡献这个PR?)
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "617450941 (via GitHub)" <gi...@apache.org>.
617450941 commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2247261259
我的k8s 底层是docker的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "zzj-always (via GitHub)" <gi...@apache.org>.
zzj-always commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2233074428
同样的问题 ，我是在k8s上启动的streampark的pod，但是没有连接上我物理机上的docker服务
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "617450941 (via GitHub)" <gi...@apache.org>.
617450941 commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2247264700
2375不知道是什么端口来的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "lintingbin (via GitHub)" <gi...@apache.org>.
lintingbin commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2245132100
@SbloodyS docker login ${dockerUrl}可以执行成功，但是就是会报这个错误。进去容器里面看端口，也没有发现有2375的端口。2.0.0版本的时候k8s部署是成功的，也可以打镜像，升级到2.1.4后就报这个错误了。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "617450941 (via GitHub)" <gi...@apache.org>.
617450941 commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2247266840
试了那么多flink 作业平台 没一个好用的 不是这bug就是文档不全 无法正常使用
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "617450941 (via GitHub)" <gi...@apache.org>.
617450941 commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2247254048
k8s 上部署的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys closed issue #3742: [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster.
URL: https://github.com/apache/incubator-streampark/issues/3742
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "lintingbin (via GitHub)" <gi...@apache.org>.
lintingbin commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2247258213
可能是containerd不兼容的问题，我们目前的解决方案是自己在外部部署一个docker，开放2375的端口，把环境变量改成指向外部的这个docker。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "617450941 (via GitHub)" <gi...@apache.org>.
617450941 commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2247253298
2.1.4确实有这个问题
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "617450941 (via GitHub)" <gi...@apache.org>.
617450941 commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2247252233
2.1.4确实有这个问题
![Uploading image.png…]()
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] There was a malfunction with the Docker environment configuration feature when deploying Streampark on a k8s cluster. [incubator-streampark]
Posted by "zzj-always (via GitHub)" <gi...@apache.org>.
zzj-always commented on issue #3742:
URL: https://github.com/apache/incubator-streampark/issues/3742#issuecomment-2233070329
我在k8s上启动的一个streampark的pod，没有使用配置的docker的服务器
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org