You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "shahar1 (via GitHub)" <gi...@apache.org> on 2023/02/19 16:59:24 UTC
[GitHub] [airflow] shahar1 opened a new issue, #29613: Importing CreateCustomContainerTrainingJobOperator takes too much time
shahar1 opened a new issue, #29613:
URL: https://github.com/apache/airflow/issues/29613
### Apache Airflow version
Other Airflow 2 version (please specify below)
### What happened
When importing CreateCustomContainerTrainingJobOperator it seems to take 3-4 seconds just to import the module.
I ran `time python` for two DAG files - one with the import line and one without it. The import line is simple as follows:
``from airflow.providers.google.cloud.operators.vertex_ai.custom_job import CreateCustomContainerTrainingJobOperator``
The results of the comparison:
```
airflow@airflow-scheduler-##########-#####:~/gcs/dags$ time python dag_w_import.py
real 0m4.884s
user 0m4.668s
sys 0m1.425s
airflow@airflow-scheduler-##########-#####:~/gcs/dags$ time python same_dag_wo_import.py
real 0m1.484s
user 0m1.310s
sys 0m0.163s
```
### What you think should happen instead
The import of the module should be instant
### How to reproduce
Described above
### Operating System
Ubuntu 18.04.6 LTS
### Versions of Apache Airflow Providers
apache-airflow-providers-google==8.6.0
### Deployment
Google Cloud Composer
### Deployment details
composer-2.1.6-airflow-2.4.3
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #29613: Importing CreateCustomContainerTrainingJobOperator takes too much time
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #29613:
URL: https://github.com/apache/airflow/issues/29613#issuecomment-1436038316
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #29613: Importing CreateCustomContainerTrainingJobOperator takes too much time
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #29613: Importing CreateCustomContainerTrainingJobOperator takes too much time
URL: https://github.com/apache/airflow/issues/29613
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Taragolis commented on issue #29613: Importing CreateCustomContainerTrainingJobOperator takes too much time
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis commented on issue #29613:
URL: https://github.com/apache/airflow/issues/29613#issuecomment-1436057506
Check it locally, most of the time spend during this import:
`from google.cloud.aiplatform.models import Model`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org