You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "hinchliff (via GitHub)" <gi...@apache.org> on 2025/02/20 21:29:45 UTC
[I] Unable to redact value of type SIGSEGV [airflow]
hinchliff opened a new issue, #46943:
URL: https://github.com/apache/airflow/issues/46943
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
2.9.3
### What happened?
Something in our airflow configuration (after configuring [Writing logs to Google Stackdriver](https://airflow.apache.org/docs/apache-airflow-providers-google/stable/logging/stackdriver.html)) is causing a SIGSEGV. Immediately after _some_ of the logging messages from `{local_task_job_runner.py:130} CRITICAL` showing the SIGSEGV, there follows another log message `{secrets_masker.py:282} WARNING - Unable to redact value of type` with the SIGSEGV message as the `item`.
### What you think should happen instead?
I'd love to not get a SIGSEGV when trying to configure Writing logs to Google Stackdriver. But I don't know what's causing that yet.
At the same time, those SIGSEGV probably should throw an exception in the redaction logic either. And those messages ask for a bug report to be filed.
### How to reproduce
Cause Airflow to raise a SIGSEGV ?
### Operating System
Debian GNU/Linux 12 (bookworm)
### Versions of Apache Airflow Providers
apache-airflow-providers-amazon==8.25.0
apache-airflow-providers-celery==3.7.2
apache-airflow-providers-cncf-kubernetes==8.3.3
apache-airflow-providers-common-io==1.3.2
apache-airflow-providers-common-sql==1.14.2
apache-airflow-providers-docker==3.12.2
apache-airflow-providers-elasticsearch==5.4.1
apache-airflow-providers-fab==1.2.2
apache-airflow-providers-ftp==3.10.0
apache-airflow-providers-google==10.21.0
apache-airflow-providers-grpc==3.5.2
apache-airflow-providers-hashicorp==3.7.1
apache-airflow-providers-http==4.12.0
apache-airflow-providers-imap==3.6.1
apache-airflow-providers-microsoft-azure==10.2.0
apache-airflow-providers-mysql==5.6.2
apache-airflow-providers-odbc==4.6.2
apache-airflow-providers-openlineage==1.9.1
apache-airflow-providers-postgres==5.11.2
apache-airflow-providers-redis==3.7.1
apache-airflow-providers-sendgrid==3.5.1
apache-airflow-providers-sftp==4.10.2
apache-airflow-providers-slack==8.7.1
apache-airflow-providers-smtp==1.7.1
apache-airflow-providers-snowflake==5.6.0
apache-airflow-providers-sqlite==3.8.1
apache-airflow-providers-ssh==3.11.2
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
Once the config changes to (attempt to) Write logs to Google Stackdriver, viewing every Task attempt in the UI resulted in the SIGSEGV.
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Unable to redact value of type SIGSEGV [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #46943:
URL: https://github.com/apache/airflow/issues/46943#issuecomment-2672726716
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Unable to redact value of type SIGSEGV [airflow]
Posted by "hinchliff (via GitHub)" <gi...@apache.org>.
hinchliff commented on issue #46943:
URL: https://github.com/apache/airflow/issues/46943#issuecomment-2672735913
the full exception log from `secrets_masker.py` --
```
[2025-02-20T19:44:42.794+0000] {secrets_masker.py:282} WARNING - Unable to redact value of type
******************************************* Received SIGSEGV *******************************************
SIGSEGV (Segmentation Violation) signal indicates Segmentation Fault error which refers to
an attempt by a program/library to write or read outside its allocated memory.
In Python environment usually this signal refers to libraries which use low level C API.
Make sure that you use right libraries/Docker Images
for your architecture (Intel/ARM) and/or Operational System (Linux/macOS).
Suggested way to debug
======================
- Set environment variable 'PYTHONFAULTHANDLER' to 'true'.
- Start airflow services.
- Restart failed airflow task.
- Check 'scheduler' and 'worker' services logs for additional traceback
which might contain information about module/library where actual error happen.
Known Issues
============
Note: Only Linux-based distros supported as "Production" execution environment for Airflow.
macOS
-----
1. Due to limitations in Apple's libraries not every process might 'fork' safe.
One of the general error is unable to query the macOS system configuration for network proxies.
If your are not using a proxy you could disable it by set environment variable 'no_proxy' to '*'.
See: https://github.com/python/cpython/issues/58037 and https://bugs.python.org/issue30385#msg293958
********************************************************************************************************, please report this via <https://github.com/apache/airflow/issues>. Error was: RecursionError: maximum recursion depth exceeded
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Unable to redact value of type SIGSEGV [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46943:
URL: https://github.com/apache/airflow/issues/46943#issuecomment-2675743400
Did you follow the recommendation for debugging that you copy & pasted?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Unable to redact value of type SIGSEGV [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #46943: Unable to redact value of type SIGSEGV
URL: https://github.com/apache/airflow/issues/46943
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org