[GitHub] [airflow] renanleme edited a comment on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

[GitBox <gi...@apache.org>]

renanleme edited a comment on issue #13542:
URL: https://github.com/apache/airflow/issues/13542#issuecomment-803572439


   I had the same problem today and I think I found the problem.
   
   I'm testing with:
   Apache Airflow version: `2.0.1`
   Executor: `Celery`
   Running locally
   
   I was testing one dag and after changing a few parameters in one of the tasks in the dag file and cleaning the tasks, the task got stuck on scheduled state.
   **The problem:** The changes that I made broke the task, something like this:
   ```
   airflow-worker_1     | airflow.exceptions.AirflowException: Invalid arguments were passed to GoogleCloudStorageToBigQueryOperator (task_id: load_dag). Invalid arguments were:
   airflow-worker_1     | **kwargs: {'gcp_conn_id': 'bigquery_default'}
   ```
   So, the worker was refusing to execute because I was passing an invalid argument to the task. **_The problem is that the worker doesn't notify the scheduler/web that the file is wrong_** (no alert of a broken dag was being show in the Airflow home page).
   
   After updating the task parameter and cleaning the task, it ran successfully.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org