You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Thomas Schm (JIRA)" <ji...@apache.org> on 2018/08/09 15:17:00 UTC

[jira] [Created] (AIRFLOW-2880) Stackoverflow with the logging tools

Thomas Schm created AIRFLOW-2880:
------------------------------------

             Summary: Stackoverflow with the logging tools
                 Key: AIRFLOW-2880
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2880
             Project: Apache Airflow
          Issue Type: Improvement
         Environment: Ubuntu
            Reporter: Thomas Schm


I get some overflow. I am running standard python programs (with logging.debug etc) as bash operator jobs. Here's some output

 

{code:java}
[2018-08-09 16:59:10,155] {base_task_runner.py:98} INFO - Subtask: Fatal Python error: Cannot recover from stack overflow.
[2018-08-09 16:59:10,155] {base_task_runner.py:98} INFO - Subtask: 
[2018-08-09 16:59:10,161] {base_task_runner.py:98} INFO - Subtask: Current thread 0x00007fc5d1865700 (most recent call first):
[2018-08-09 16:59:10,161] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 388 in usesTime
[2018-08-09 16:59:10,161] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 544 in usesTime
[2018-08-09 16:59:10,162] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 576 in format
[2018-08-09 16:59:10,162] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 838 in format
[2018-08-09 16:59:10,162] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 992 in emit
[2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,163] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,164] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,177] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,177] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
[2018-08-09 16:59:10,178] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
[2018-08-09 16:59:10,178] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
[2018-08-09 16:59:10,179] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
[2018-08-09 16:59:10,179] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,180] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,180] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,181] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,181] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,182] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,182] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
[2018-08-09 16:59:10,182] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
[2018-08-09 16:59:10,183] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
[2018-08-09 16:59:10,184] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
[2018-08-09 16:59:10,184] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,185] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,185] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,186] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,186] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,187] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,187] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
[2018-08-09 16:59:10,188] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
[2018-08-09 16:59:10,188] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
[2018-08-09 16:59:10,189] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
[2018-08-09 16:59:10,189] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,190] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,190] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,191] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,191] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,191] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,192] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
[2018-08-09 16:59:10,192] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
[2018-08-09 16:59:10,193] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
[2018-08-09 16:59:10,193] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
[2018-08-09 16:59:10,194] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,194] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,195] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,195] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,196] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,196] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,197] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
[2018-08-09 16:59:10,197] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
[2018-08-09 16:59:10,198] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
[2018-08-09 16:59:10,198] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
[2018-08-09 16:59:10,199] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,199] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,200] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,200] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,200] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,201] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,201] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
[2018-08-09 16:59:10,202] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
[2018-08-09 16:59:10,202] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
[2018-08-09 16:59:10,202] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
[2018-08-09 16:59:10,203] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,203] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,203] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,204] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,204] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,205] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,205] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
[2018-08-09 16:59:10,205] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/logging_mixin.py", line 84 in write
[2018-08-09 16:59:10,206] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 915 in handleError
[2018-08-09 16:59:10,206] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 998 in emit
[2018-08-09 16:59:10,206] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1070 in emit
[2018-08-09 16:59:10,207] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/site-packages/airflow/utils/log/file_task_handler.py", line 60 in emit
[2018-08-09 16:59:10,207] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 863 in handle
[2018-08-09 16:59:10,207] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1514 in callHandlers
[2018-08-09 16:59:10,208] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1452 in handle
[2018-08-09 16:59:10,208] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1442 in _log
[2018-08-09 16:59:10,209] {base_task_runner.py:98} INFO - Subtask:   File "/home/thomas/miniconda/lib/python3.6/logging/__init__.py", line 1372 in log
{code}

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)