You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Matthew (Jira)" <ji...@apache.org> on 2020/09/21 14:56:00 UTC

[jira] [Commented] (AIRFLOW-2880) Stack overflow with the logging tools

    [ https://issues.apache.org/jira/browse/AIRFLOW-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199435#comment-17199435 ] 

Matthew commented on AIRFLOW-2880:
----------------------------------

I'm seeing this same stack overflow scenario in the logging. Curious if this was closed as it was already fixed in some version of airflow, hoping for a bit of context here.

> Stack overflow with the logging tools
> -------------------------------------
>
>                 Key: AIRFLOW-2880
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2880
>             Project: Apache Airflow
>          Issue Type: Improvement
>         Environment: Ubuntu
>            Reporter: Thomas Schm
>            Priority: Minor
>
> I get some overflow. I am running standard python programs (with logging.debug etc) as bash operator jobs. Here's some output
>  
> {code:java}
> [2018-08-09 16:59:10,155] {base_task_runner.py:98} INFO - Subtask: Fatal Python error: Cannot recover from stack overflow.
> [2018-08-09 16:59:10,155] {base_task_runner.py:98} INFO - Subtask: 
> [2018-08-09 16:59:10,161] {base_task_runner.py:98} INFO - Subtask: Current thread 0x00007fc5d1865700 (most recent call first):
> [2018-08-09 16:59:10,161] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 388 in usesTime
> [2018-08-09 16:59:10,161] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 544 in usesTime
> [2018-08-09 16:59:10,162] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 576 in format
> [2018-08-09 16:59:10,162] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 838 in format
> [2018-08-09 16:59:10,162] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 992 in emit
> [2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,164] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,177] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,177] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> [2018-08-09 16:59:10,178] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
> [2018-08-09 16:59:10,178] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
> [2018-08-09 16:59:10,179] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
> [2018-08-09 16:59:10,179] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,180] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,180] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,181] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,181] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,182] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,182] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> [2018-08-09 16:59:10,182] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
> [2018-08-09 16:59:10,183] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
> [2018-08-09 16:59:10,184] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
> [2018-08-09 16:59:10,184] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,185] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,185] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,186] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,186] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,187] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,187] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> [2018-08-09 16:59:10,188] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
> [2018-08-09 16:59:10,188] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
> [2018-08-09 16:59:10,189] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
> [2018-08-09 16:59:10,189] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,190] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,190] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,191] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,191] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,191] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,192] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> [2018-08-09 16:59:10,192] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
> [2018-08-09 16:59:10,193] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
> [2018-08-09 16:59:10,193] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
> [2018-08-09 16:59:10,194] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,194] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,195] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,195] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,196] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,196] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,197] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> [2018-08-09 16:59:10,197] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
> [2018-08-09 16:59:10,198] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
> [2018-08-09 16:59:10,198] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
> [2018-08-09 16:59:10,199] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,199] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,200] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,200] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,200] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,201] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,201] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> [2018-08-09 16:59:10,202] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
> [2018-08-09 16:59:10,202] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
> [2018-08-09 16:59:10,202] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
> [2018-08-09 16:59:10,203] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,203] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,203] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,204] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,204] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,205] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,205] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> [2018-08-09 16:59:10,205] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
> [2018-08-09 16:59:10,206] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
> [2018-08-09 16:59:10,206] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
> [2018-08-09 16:59:10,206] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
> [2018-08-09 16:59:10,207] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
> [2018-08-09 16:59:10,207] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
> [2018-08-09 16:59:10,207] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
> [2018-08-09 16:59:10,208] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
> [2018-08-09 16:59:10,208] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
> [2018-08-09 16:59:10,209] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)