You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/12/20 16:12:32 UTC
[GitHub] [airflow] solarcleanopanelai opened a new issue, #28496: GPU not recognized through DockerOperator
solarcleanopanelai opened a new issue, #28496:
URL: https://github.com/apache/airflow/issues/28496
### Apache Airflow Provider(s)
docker
### Versions of Apache Airflow Providers
_No response_
### Apache Airflow version
2.5.0-python3.7
### Operating System
Ubuntu 22.04.1 LTS
### Deployment
Docker-Compose
### Deployment details
Docker Compose version v2.13.0
`docker build . --tag extending_airflow_v2:latest && docker-compose up airflow-init && docker-compose up -d --no-deps --build airflow-webserver airflow-scheduler && docker-compose up`
docker-compose.yaml file:
[docker-compose.txt](https://github.com/apache/airflow/files/10270149/docker-compose.txt)
Dockerfile:
[Dockerfile.txt](https://github.com/apache/airflow/files/10270158/Dockerfile.txt)
### What happened
Hello, I'm facing a problem related to the DockerOperator.
### **Here is what I am trying to implement :**
I want to implement a DAG that start a docker container using this image: _ultralytics/yolov5:v7.0_
In order to run the python file train.py that use the nvidia gpu.
Then, I created this DAG (test):
So it works, **without the GPU**, that's the log:
[log-success-without-gpu.txt](https://github.com/apache/airflow/files/10269959/log-success-without-gpu.txt)
**But when I try to run with uncomment line 31 of my DAG (docker.py above) to have the device_request (theoretically that's find all gpus available).**
And here is the result:
[log-failed-with-gpu.txt](https://github.com/apache/airflow/files/10270028/log-failed-with-gpu.txt)
### **yolov5 Container tested localy and it work**
Into a command prompt:
`sudo docker run --ipc=host -it --gpus all ultralytics/yolov5:v7.0`
and
`python train.py`
See the result:
### What you think should happen instead
_No response_
### How to reproduce
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #28496: GPU not recognized through DockerOperator
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #28496:
URL: https://github.com/apache/airflow/issues/28496#issuecomment-1359641334
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #28496: GPU not recognized through DockerOperator
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #28496: GPU not recognized through DockerOperator
URL: https://github.com/apache/airflow/issues/28496
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org