You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/03/27 20:41:36 UTC
[GitHub] [airflow] dimberman opened a new issue #7918: Add --debug option to
scheduler
dimberman opened a new issue #7918: Add --debug option to scheduler
URL: https://github.com/apache/airflow/issues/7918
**Description**
airflow webserver has a --debug param which enables the use of interactive debuggers like ipdb (among other side effects). Unfortunately the airflow scheduler process does not respect debugger instructions, which makes tracing errors very difficult. It just prints the following error and resumes operation:
Traceback (most recent call last):
File "/Users/jlowin/git/airflow/airflow/jobs.py", line 690, in _do_dags
self.process_dag(dag, tis_out)
File "/Users/jlowin/git/airflow/airflow/jobs.py", line 521, in process_dag
run.update_state()
File "/Users/jlowin/git/airflow/airflow/utils/db.py", line 53, in wrapper
result = func(*args, **kwargs)
File "/Users/jlowin/git/airflow/airflow/models.py", line 3471, in update_state
all_deadlocked = (has_unfinished_tasks and no_dependencies_met)
File "/Users/jlowin/git/airflow/airflow/models.py", line 3471, in update_state
all_deadlocked = (has_unfinished_tasks and no_dependencies_met)
File "/Users/jlowin/anaconda3/lib/python3.5/bdb.py", line 48, in trace_dispatch
return self.dispatch_line(frame)
File "/Users/jlowin/anaconda3/lib/python3.5/bdb.py", line 67, in dispatch_line
if self.quitting: raise BdbQuit
bdb.BdbQuit
Bolke de Bruin I'm assigning this to you for now because I suspect it's related to the subprocess/daemonizing changes you made though I'm not sure. If we can enable ipdb it will make future scheduler work so much easier!
**Use case / motivation**
**Related Issues**
Moved here from https://issues.apache.org/jira/browse/AIRFLOW-174
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services