You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/17 13:24:24 UTC
[GitHub] [airflow] Geronium opened a new issue #18327: [error] airflow postgres
Geronium opened a new issue #18327:
URL: https://github.com/apache/airflow/issues/18327
### Apache Airflow version
2.1.2
### Operating System
Debian GNU/Linux 10 (buster)
### Versions of Apache Airflow Providers
airflow@airflow-webserver-54b99db477-fs46m:/opt/airflow$ pip freeze | grep providers
apache-airflow-providers-amazon==2.0.0
apache-airflow-providers-celery==2.0.0
apache-airflow-providers-cncf-kubernetes==2.0.0
apache-airflow-providers-docker==2.0.0
apache-airflow-providers-elasticsearch==2.0.2
apache-airflow-providers-ftp==2.0.0
apache-airflow-providers-google==4.0.0
apache-airflow-providers-grpc==2.0.0
apache-airflow-providers-hashicorp==2.0.0
apache-airflow-providers-http==2.0.0
apache-airflow-providers-imap==2.0.0
apache-airflow-providers-microsoft-azure==3.0.0
apache-airflow-providers-mysql==2.0.0
apache-airflow-providers-postgres==2.0.0
apache-airflow-providers-redis==2.0.0
apache-airflow-providers-sendgrid==2.0.0
apache-airflow-providers-sftp==2.0.0
apache-airflow-providers-slack==4.0.0
apache-airflow-providers-sqlite==2.0.0
apache-airflow-providers-ssh==2.0.0
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
just do a :
helm upgrade --debug --cleanup-on-fail --install airflow ./airflow.tgz --namespace airflow --create-namespace
### What happened
after the installation, i added an example of a dag inside the dag directory, and i don't saw this dag with the navigator
https://airflow.apache.org/docs/apache-airflow/stable/tutorial.html
so i done a db init
airflow@airflow-webserver-54b99db477-fs46m:/opt/airflow$ airflow db init
DB: postgresql://postgres:***@airflow-postgresql.airflow:5432/postgres?sslmode=disable
[2021-09-17 13:14:21,956] {db.py:692} INFO - Creating tables
INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
INFO [alembic.runtime.migration] Will assume transactional DDL.
Initialization done
after that i can saw my dag
but it disappear after something like 2 minutes
and i can saw in the logs of postgres this errors at the starting of the postgresql pod, i don't know if this is the reason of the disappearing of my dag
`[root] # kubectl logs airflow-postgresql-0 -n airflow
postgresql 12:26:27.57
postgresql 12:26:27.58 Welcome to the Bitnami postgresql container
postgresql 12:26:27.59 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-postgresql
postgresql 12:26:27.59 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-postgresql/issues
postgresql 12:26:27.60
postgresql 12:26:27.65 INFO ==> ** Starting PostgreSQL setup **
postgresql 12:26:27.69 INFO ==> Validating settings in POSTGRESQL_* env vars..
postgresql 12:26:27.71 INFO ==> Loading custom pre-init scripts...
postgresql 12:26:27.73 INFO ==> Initializing PostgreSQL database...
postgresql 12:26:27.80 INFO ==> pg_hba.conf file not detected. Generating it...
postgresql 12:26:27.81 INFO ==> Generating local authentication configuration
postgresql 12:26:29.04 INFO ==> Starting PostgreSQL in background...
postgresql 12:26:29.22 INFO ==> Changing password of postgres
postgresql 12:26:29.30 INFO ==> Configuring replication parameters
postgresql 12:26:29.39 INFO ==> Configuring fsync
postgresql 12:26:29.52 INFO ==> Loading custom scripts...
postgresql 12:26:29.54 INFO ==> Enabling remote connections
postgresql 12:26:29.58 INFO ==> Stopping PostgreSQL...
waiting for server to shut down.... done
server stopped
postgresql 12:26:29.71 INFO ==> ** PostgreSQL setup finished! **
postgresql 12:26:29.75 INFO ==> ** Starting PostgreSQL **
2021-09-17 12:26:29.784 GMT [1] LOG: pgaudit extension initialized
2021-09-17 12:26:29.785 GMT [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
2021-09-17 12:26:29.785 GMT [1] LOG: listening on IPv6 address "::", port 5432
2021-09-17 12:26:29.788 GMT [1] LOG: listening on Unix socket "/tmp/.s.PGSQL.5432"
2021-09-17 12:26:29.812 GMT [130] LOG: database system was shut down at 2021-09-17 12:26:29 GMT
2021-09-17 12:26:29.819 GMT [1] LOG: database system is ready to accept connections
2021-09-17 12:26:38.853 GMT [143] LOG: incomplete startup packet
2021-09-17 12:26:38.912 GMT [144] LOG: incomplete startup packet
2021-09-17 12:26:39.567 GMT [145] LOG: incomplete startup packet
2021-09-17 12:26:39.634 GMT [146] LOG: incomplete startup packet
2021-09-17 12:26:42.909 GMT [149] ERROR: relation "log" does not exist at character 13
2021-09-17 12:26:42.909 GMT [149] STATEMENT: INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner, extra) VALUES ('2021-09-17T12:26:42.877318+00:00'::timestamptz, NULL, NULL, 'cli_upgradedb', NULL, 'airflow', '{"host_name": "airflow-run-airflow-migrations-wwccb", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''upgrade'']"}') RETURNING log.id
2021-09-17 12:26:43.238 GMT [149] ERROR: relation "connection" does not exist at character 55
2021-09-17 12:26:43.238 GMT [149] STATEMENT: SELECT connection.conn_id AS connection_conn_id
FROM connection GROUP BY connection.conn_id
HAVING count(*) > 1
2021-09-17 12:26:43.240 GMT [149] ERROR: current transaction is aborted, commands ignored until end of transaction block
2021-09-17 12:26:43.240 GMT [149] STATEMENT: SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_id, connection.conn_id AS connection_conn_id, connection.conn_type AS connection_conn_type, connection.description AS connection_description, connection.host AS connection_host, connection.schema AS connection_schema, connection.login AS connection_login, connection.port AS connection_port, connection.is_encrypted AS connection_is_encrypted, connection.is_extra_encrypted AS connection_is_extra_encrypted
FROM connection
WHERE connection.conn_type IS NULL
2021-09-17 12:26:43.302 GMT [150] ERROR: relation "log" does not exist at character 13
2021-09-17 12:26:43.302 GMT [150] STATEMENT: INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner, extra) VALUES ('2021-09-17T12:26:43.269569+00:00'::timestamptz, NULL, NULL, 'cli_flower', NULL, 'airflow', '{"host_name": "airflow-flower-545dd8bf97-pwjbp", "full_command": "[''/home/airflow/.local/bin/airflow'', ''celery'', ''flower'']"}') RETURNING log.id
2021-09-17 12:27:01.648 GMT [166] LOG: incomplete startup packet
2021-09-17 12:27:02.277 GMT [167] LOG: incomplete startup packet
2021-09-17 12:27:02.919 GMT [168] LOG: incomplete startup packet`
### What you expected to happen
_No response_
### How to reproduce
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] uranusjr closed issue #18327: [error] airflow postgres
Posted by GitBox <gi...@apache.org>.
uranusjr closed issue #18327:
URL: https://github.com/apache/airflow/issues/18327
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #18327: [error] airflow postgres
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #18327:
URL: https://github.com/apache/airflow/issues/18327#issuecomment-921794743
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org