You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Startouf (via GitHub)" <gi...@apache.org> on 2023/02/14 11:51:31 UTC
[GitHub] [airflow] Startouf commented on issue #29530: `'NoneType' object has no attribute 'sign'` error on the webserver when deploying the helm chart for the first time
Startouf commented on issue #29530:
URL: https://github.com/apache/airflow/issues/29530#issuecomment-1429615178
Additional logs from my kubernetes pods
Worker : it seems to have started successfully
triggerer : I see logs like this
```
[2023-02-14T11:42:55.556+0000] {triggerer_job.py:348} ERROR - Triggerer's async thread was blocked for 1.41 seconds, likely by a badly-written trigger. Set PYTHONASYNCIODEBUG=1 to get more information on overrunning coroutines.
```
statsd: OK
scheduler : last log lines are like this, not sur if it is OKay or not
```
[2023-02-14T11:34:31.109+0000] {settings.py:548} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py .
[2023-02-14T11:34:31.156+0000] {scheduler_job.py:1431} INFO - Marked 1 SchedulerJob instances as failed
[2023-02-14T11:39:31.232+0000] {scheduler_job.py:1408} INFO - Resetting orphaned tasks for active dag runs
[2023-02-14T11:44:31.283+0000] {scheduler_job.py:1408} INFO - Resetting orphaned tasks for active dag runs
```
redis OK
PostgreSQL : Not sure but I see problems that could be related to my initial startup failure
```
postgresql 10:47:27.73 INFO ==> ** Starting PostgreSQL setup **
postgresql 10:47:27.75 INFO ==> Validating settings in POSTGRESQL_* env vars..
postgresql 10:47:27.76 INFO ==> Cleaning stale /bitnami/postgresql/data/postmaster.pid file
postgresql 10:47:27.77 INFO ==> Loading custom pre-init scripts...
postgresql 10:47:27.78 INFO ==> Initializing PostgreSQL database...
postgresql 10:47:27.80 INFO ==> pg_hba.conf file not detected. Generating it...
postgresql 10:47:27.81 INFO ==> Generating local authentication configuration
postgresql 10:47:27.83 INFO ==> Deploying PostgreSQL with persisted data...
postgresql 10:47:27.84 INFO ==> Configuring replication parameters
postgresql 10:47:27.88 INFO ==> Configuring fsync
postgresql 10:47:27.89 INFO ==> Configuring synchronous_replication
postgresql 10:47:27.95 INFO ==> Loading custom scripts...
postgresql 10:47:27.96 INFO ==> Enabling remote connections
postgresql 10:47:27.97 INFO ==> ** PostgreSQL setup finished! **
postgresql 10:47:27.99 INFO ==> ** Starting PostgreSQL **
2023-02-14 10:47:28.080 GMT [1] LOG: pgaudit extension initialized
2023-02-14 10:47:28.085 GMT [1] LOG: listening on IPv4 address "0.0.0.0", port 5432
2023-02-14 10:47:28.087 GMT [1] LOG: could not create IPv6 socket for address "::": Address family not supported by protocol
2023-02-14 10:47:28.092 GMT [1] LOG: listening on Unix socket "/tmp/.s.PGSQL.5432"
2023-02-14 10:47:28.129 GMT [94] LOG: database system was interrupted; last known up at 2023-02-14 10:45:55 GMT
2023-02-14 10:47:28.219 GMT [94] LOG: database system was not properly shut down; automatic recovery in progress
2023-02-14 10:47:28.222 GMT [94] LOG: redo starts at 0/1661948
2023-02-14 10:47:28.222 GMT [94] LOG: invalid record length at 0/1661980: wanted 24, got 0
2023-02-14 10:47:28.222 GMT [94] LOG: redo done at 0/1661948
2023-02-14 10:47:28.242 GMT [1] LOG: database system is ready to accept connections
2023-02-14 10:47:38.442 GMT [108] ERROR: relation "log" does not exist at character 13
2023-02-14 10:47:38.442 GMT [108] STATEMENT: INSERT INTO log (dttm, event, owner, extra) VALUES ('2023-02-14T10:47:36.919125+00:00'::timestamptz, 'cli_check', 'airflow', '{"host_name": "airflow-worker-0", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''check'']"}') RETURNING log.id
2023-02-14 10:47:38.442 GMT [109] ERROR: relation "log" does not exist at character 13
2023-02-14 10:47:38.442 GMT [109] STATEMENT: INSERT INTO log (dttm, event, owner, extra) VALUES ('2023-02-14T10:47:37.186626+00:00'::timestamptz, 'cli_check', 'airflow', '{"host_name": "airflow-run-airflow-migrations-cnkx8", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''check'']"}') RETURNING log.id
2023-02-14 10:47:42.280 GMT [110] ERROR: relation "log" does not exist at character 13
2023-02-14 10:47:42.280 GMT [110] STATEMENT: INSERT INTO log (dttm, event, owner, extra) VALUES ('2023-02-14T10:47:42.243064+00:00'::timestamptz, 'cli_check', 'airflow', '{"host_name": "airflow-scheduler-774877b6b-n4r6d", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''check'']"}') RETURNING log.id
2023-02-14 10:47:42.995 GMT [111] ERROR: relation "log" does not exist at character 13
2023-02-14 10:47:42.995 GMT [111] STATEMENT: INSERT INTO log (dttm, event, owner, extra) VALUES ('2023-02-14T10:47:42.947552+00:00'::timestamptz, 'cli_upgradedb', 'airflow', '{"host_name": "airflow-run-airflow-migrations-cnkx8", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''upgrade'']"}') RETURNING log.id
2023-02-14 10:47:43.122 GMT [112] ERROR: relation "log" does not exist at character 13
2023-02-14 10:47:43.122 GMT [112] STATEMENT: INSERT INTO log (dttm, event, owner, extra) VALUES ('2023-02-14T10:47:43.102700+00:00'::timestamptz, 'cli_check', 'airflow', '{"host_name": "airflow-triggerer-84888d74bc-mvt2c", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''check'']"}') RETURNING log.id
2023-02-14 10:47:43.744 GMT [113] ERROR: relation "log" does not exist at character 13
2023-02-14 10:47:43.744 GMT [113] STATEMENT: INSERT INTO log (dttm, event, owner, extra) VALUES ('2023-02-14T10:47:43.630938+00:00'::timestamptz, 'cli_check', 'airflow', '{"host_name": "airflow-webserver-86b6bddf7c-vkv7c", "full_command": "[''/home/airflow/.local/bin/airflow'', ''db'', ''check'']"}') RETURNING log.id
2023-02-14 10:47:47.294 GMT [111] ERROR: relation "connection" does not exist at character 55
2023-02-14 10:47:47.294 GMT [111] STATEMENT: SELECT connection.conn_id AS connection_conn_id
FROM connection GROUP BY connection.conn_id
HAVING count(*) > 1
2023-02-14 10:47:47.298 GMT [111] ERROR: relation "connection" does not exist at character 55
2023-02-14 10:47:47.298 GMT [111] STATEMENT: SELECT connection.conn_id AS connection_conn_id
FROM connection
WHERE connection.conn_type IS NULL
2023-02-14 10:47:47.441 GMT [111] ERROR: relation "ab_user" does not exist at character 51
2023-02-14 10:47:47.441 GMT [111] STATEMENT: SELECT ab_user.username AS ab_user_username
FROM ab_user GROUP BY ab_user.username
HAVING count(*) > 1
2023-02-14 10:47:47.445 GMT [111] ERROR: relation "ab_register_user" does not exist at character 69
2023-02-14 10:47:47.445 GMT [111] STATEMENT: SELECT ab_register_user.username AS ab_register_user_username
FROM ab_register_user GROUP BY ab_register_user.username
HAVING count(*) > 1
2023-02-14 10:54:26.167 GMT [709] ERROR: canceling statement due to lock timeout
2023-02-14 10:54:26.167 GMT [709] STATEMENT: SELECT pg_advisory_lock(1)
2023-02-14 10:54:26.171 GMT [709] WARNING: you don't own a lock of type ExclusiveLock
2023-02-14 10:54:48.416 GMT [740] ERROR: canceling statement due to lock timeout
2023-02-14 10:54:48.416 GMT [740] STATEMENT: SELECT pg_advisory_lock(1)
2023-02-14 10:54:48.419 GMT [740] WARNING: you don't own a lock of type ExclusiveLock
2023-02-14 10:56:24.621 GMT [895] ERROR: canceling statement due to lock timeout
2023-02-14 10:56:24.621 GMT [895] STATEMENT: SELECT pg_advisory_lock(1)
2023-02-14 10:56:24.624 GMT [895] WARNING: you don't own a lock of type ExclusiveLock
2023-02-14 10:57:12.739 GMT [972] ERROR: canceling statement due to lock timeout
2023-02-14 10:57:12.739 GMT [972] STATEMENT: SELECT pg_advisory_lock(1)
2023-02-14 10:57:12.743 GMT [972] WARNING: you don't own a lock of type ExclusiveLock
2023-02-14 10:59:24.413 GMT [1166] ERROR: canceling statement due to lock timeout
2023-02-14 10:59:24.413 GMT [1166] STATEMENT: SELECT pg_advisory_lock(1)
2023-02-14 10:59:24.418 GMT [1166] WARNING: you don't own a lock of type ExclusiveLock
2023-02-14 11:01:33.334 GMT [1367] ERROR: canceling statement due to lock timeout
2023-02-14 11:01:33.334 GMT [1367] STATEMENT: SELECT pg_advisory_lock(1)
2023-02-14 11:01:33.338 GMT [1367] WARNING: you don't own a lock of type ExclusiveLock
2023-02-14 11:14:22.714 GMT [98] LOG: using stale statistics instead of current ones because stats collector is not responding
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org