You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/11/26 06:52:30 UTC

[GitHub] [airflow] karry-li-lego opened a new issue #19833: sql_alchemy_conn_cmd cause failed connect to backend database and fallback to sqlite

karry-li-lego opened a new issue #19833:
URL: https://github.com/apache/airflow/issues/19833


   ### Apache Airflow version
   
   2.2.2 (latest released)
   
   ### Operating System
   
   macOS 10.15.7
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-amazon       | 1.3.0
   apache-airflow-providers-apache-spark | 1.0.3
   apache-airflow-providers-celery       | 2.1.0
   apache-airflow-providers-ftp          | 1.0.1
   apache-airflow-providers-http         | 1.1.1
   apache-airflow-providers-imap         | 1.0.1
   apache-airflow-providers-mongo        | 2.1.0
   apache-airflow-providers-mysql        | 1.1.0
   apache-airflow-providers-postgres     | 2.0.0
   apache-airflow-providers-sqlite       | 1.0.2
   
   ### Deployment
   
   Virtualenv installation
   
   ### Deployment details
   
   Apache Airflow
   version                | 2.2.2
   executor               | CeleryExecutor
   task_logging_handler   | airflow.utils.log.file_task_handler.FileTaskHandler
   sql_alchemy_conn       | postgresql+psycopg2://airflow_user:airflow_pass@localhost:5432/airflow_db
   dags_folder            | /Users/**/airflow/dags
   plugins_folder         | /Users/**/airflow/plugins
   base_log_folder        | /Users/**/airflow/logs
   remote_base_log_folder |
   
   
   System info
   OS              | Mac OS
   architecture    | x86_64
   uname           | uname_result(system='Darwin', node='**', release='19.6.0', version='Darwin Kernel Version 19.6.0: Thu Sep 16 20:58:47 PDT 2021; root:xnu-6153.141.40.1~1/RELEASE_X86_64', machine='x86_64',
                   | processor='i386')
   locale          | (None, 'UTF-8')
   python_version  | 3.8.8 (default, Apr 13 2021, 12:59:45)  [Clang 10.0.0 ]
   python_location | /Users/**/opt/anaconda3/envs/airflow/bin/python
   
   
   Tools info
   git             | git version 2.24.3 (Apple Git-128)
   ssh             | OpenSSH_8.1p1, LibreSSL 2.7.3
   kubectl         | Client Version: v1.21.5
   gcloud          | NOT AVAILABLE
   cloud_sql_proxy | NOT AVAILABLE
   mysql           | mysql  Ver 8.0.27 for macos10.15 on x86_64 (Homebrew)
   sqlite3         | 3.35.4 2021-04-02 15:20:15 5d4c65779dab868b285519b19e4cf9d451d50c6048f06f653aa701ec212df45e
   psql            | psql (PostgreSQL) 14.1
   
   ### What happened
   
   if use sql_alchemy_conn_cmd param, then I will get this error when execute airflow info:
   Traceback (most recent call last):
     File "/Users/cnkarrli/opt/anaconda3/envs/airflow/bin/airflow", line 5, in <module>
       from airflow.__main__ import main
     File "/Users/cnkarrli/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/__init__.py", line 34, in <module>
       from airflow import settings
     File "/Users/cnkarrli/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/settings.py", line 35, in <module>
       from airflow.configuration import AIRFLOW_HOME, WEBSERVER_CONFIG, conf  # NOQA F401
     File "/Users/cnkarrli/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/configuration.py", line 1129, in <module>
       conf.validate()
     File "/Users/cnkarrli/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/configuration.py", line 224, in validate
       self._validate_config_dependencies()
     File "/Users/cnkarrli/opt/anaconda3/envs/airflow/lib/python3.8/site-packages/airflow/configuration.py", line 267, in _validate_config_dependencies
       raise AirflowConfigException(f"error: cannot use sqlite with the {self.get('core', 'executor')}")
   airflow.exceptions.AirflowConfigException: error: cannot use sqlite with the CeleryExecutor
   
   but if I use sql_alchemy_conn, everything is ok.
   
   ### What you expected to happen
   
   sql_alchemy_conn_cmd is work for airflow deploy.
   
   ### How to reproduce
   
   just use sql_alchemy_conn_cmd to set backend database.
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] karry-li-lego closed issue #19833: sql_alchemy_conn_cmd cause failed connect to backend database and fallback to sqlite

Posted by GitBox <gi...@apache.org>.
karry-li-lego closed issue #19833:
URL: https://github.com/apache/airflow/issues/19833


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #19833: sql_alchemy_conn_cmd cause failed connect to backend database and fallback to sqlite

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #19833:
URL: https://github.com/apache/airflow/issues/19833#issuecomment-979734957


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org