[GitHub] [airflow] r-richmond edited a comment on issue #18051: Airflow scheduling only 1 dag at a time leaving other dags in a queued state

[GitBox <gi...@apache.org>]

r-richmond edited a comment on issue #18051:
URL: https://github.com/apache/airflow/issues/18051#issuecomment-924580052


   Going to close this out since I assume #18061 tackled it and I'm on 2.1.4. now. If this issue presents itself again I'll re-open.
   
   Thanks again @ephraimbuddy 
   
   note: the only thing that I find still strange is the error logs from the scheduler that I originally had in particular the error
   ```
   Traceback (most recent call last):
     File "/usr/local/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
       self.run()
     File "/usr/local/lib/python3.8/multiprocessing/process.py", line 108, in run
       self._target(*self._args, **self._kwargs)
     File "/usr/local/lib/python3.8/site-packages/airflow/dag_processing/manager.py", line 370, in _run_processor_manager
       processor_manager.start()
     File "/usr/local/lib/python3.8/site-packages/airflow/dag_processing/manager.py", line 610, in start
       return self._run_parsing_loop()
     File "/usr/local/lib/python3.8/site-packages/airflow/dag_processing/manager.py", line 671, in _run_parsing_loop
       self._collect_results_from_processor(processor)
     File "/usr/local/lib/python3.8/site-packages/airflow/dag_processing/manager.py", line 981, in _collect_results_from_processor
       if processor.result is not None:
     File "/usr/local/lib/python3.8/site-packages/airflow/dag_processing/processor.py", line 321, in result
       if not self.done:
     File "/usr/local/lib/python3.8/site-packages/airflow/dag_processing/processor.py", line 286, in done
       if self._parent_channel.poll():
     File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 255, in poll
       self._check_closed()
     File "/usr/local/lib/python3.8/multiprocessing/connection.py", line 136, in _check_closed
       raise OSError("handle is closed")
   ```
   however, that hasn't come up again so... fingers crossed it won't happen again?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org