You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/01/24 09:21:19 UTC

[GitHub] [airflow] uplsh580 opened a new issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

uplsh580 opened a new issue #21058:
URL: https://github.com/apache/airflow/issues/21058


   ### Apache Airflow version
   
   2.2.3 (latest released)
   
   ### What happened
   
   It's the same situation as https://github.com/apache/airflow/issues/21023.
   Only change to `airflow dags backfill` from `airflow dags test`.
   
   ``` bash
   (airflow) [www@np-data-eng-airflow-sync001-lde-jp2v-prod ~]$ airflow dags backfill tutorial --reset-dagruns -s 2022-01-20 -e 2022-01-23
   You are about to delete these 9 tasks:
   <TaskInstance: tutorial.print_date scheduled__2022-01-20T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.print_date scheduled__2022-01-21T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.print_date scheduled__2022-01-22T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.sleep scheduled__2022-01-20T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.sleep scheduled__2022-01-21T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.sleep scheduled__2022-01-22T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.templated scheduled__2022-01-20T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.templated scheduled__2022-01-21T07:48:54.720148+00:00 [success]>
   <TaskInstance: tutorial.templated scheduled__2022-01-22T07:48:54.720148+00:00 [success]>
   
   Are you sure? (yes/no):
   y
   Traceback (most recent call last):
     File "/home1/www/venv3/airflow/bin/airflow", line 8, in <module>
       sys.exit(main())
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/__main__.py", line 48, in main
       args.func(args)
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/cli/cli_parser.py", line 48, in command
       return func(*args, **kwargs)
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/utils/cli.py", line 92, in wrapper
       return f(*args, **kwargs)
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/cli/commands/dag_command.py", line 108, in dag_backfill
       dag_run_state=State.NONE,
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/models/dag.py", line 1948, in clear_dags
       dry_run=False,
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/utils/session.py", line 70, in wrapper
       return func(*args, session=session, **kwargs)
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/models/dag.py", line 1887, in clear
       dag_run_state=dag_run_state,
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 270, in clear_task_instances
       dr.state = dag_run_state
     File "<string>", line 1, in __set__
     File "/home1/www/venv3/airflow/lib/python3.7/site-packages/airflow/models/dagrun.py", line 194, in set_state
       raise ValueError(f"invalid DagRun state: {state}")
   ValueError: invalid DagRun state: None
   ```
   
   ### What you expected to happen
   
   _No response_
   
   ### How to reproduce
   
   1. Setup Airflow 2.2.3
   2. Run any dag (in my case, using [tutorial dag file)](https://airflow.apache.org/docs/apache-airflow/stable/tutorial.html).
   3. Run again same dag by `airflow dags backfill` command.
   
   ### Operating System
   
   CentOS Linux 7.9
   
   ### Versions of Apache Airflow Providers
   
   Providers info
   apache-airflow-providers-celery          | 2.1.0
   apache-airflow-providers-cncf-kubernetes | 3.0.1
   apache-airflow-providers-ftp             | 2.0.1
   apache-airflow-providers-http            | 2.0.2
   apache-airflow-providers-imap            | 2.1.0
   apache-airflow-providers-mysql           | 2.1.1
   apache-airflow-providers-redis           | 2.0.1
   apache-airflow-providers-slack           | 4.1.0
   apache-airflow-providers-sqlite          | 2.0.1
   apache-airflow-providers-ssh             | 2.3.0
   
   ### Deployment
   
   Virtualenv installation
   
   ### Deployment details
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] uplsh580 commented on issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

Posted by GitBox <gi...@apache.org>.
uplsh580 commented on issue #21058:
URL: https://github.com/apache/airflow/issues/21058#issuecomment-1022762397


   I uploaded the other PR because the document(`CONTRIBUTORS_QUICK_START.rst`, `TESTING.rst`) also seemed to need an update.
   https://github.com/apache/airflow/pull/21140


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk commented on issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #21058:
URL: https://github.com/apache/airflow/issues/21058#issuecomment-1019996444


   > We should also add a check in `clear_task_instances` to catch this mistake, otherwise future regressions are bound to happen.
   
   Good point!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] uranusjr commented on issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

Posted by GitBox <gi...@apache.org>.
uranusjr commented on issue #21058:
URL: https://github.com/apache/airflow/issues/21058#issuecomment-1019994581


   We should also add a check in `clear_task_instances` to catch this mistake, otherwise future regressions are bound to happen.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk commented on issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #21058:
URL: https://github.com/apache/airflow/issues/21058#issuecomment-1019967204


   Feel free to fix ! If you are fast, we can even cherry-pick to 2.1.4 :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] uranusjr closed issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

Posted by GitBox <gi...@apache.org>.
uranusjr closed issue #21058:
URL: https://github.com/apache/airflow/issues/21058


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk edited a comment on issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #21058:
URL: https://github.com/apache/airflow/issues/21058#issuecomment-1019967204






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] uplsh580 edited a comment on issue #21058: Running airflow dags backfill --reset-dagruns -s -e results in error when run twice.

Posted by GitBox <gi...@apache.org>.
uplsh580 edited a comment on issue #21058:
URL: https://github.com/apache/airflow/issues/21058#issuecomment-1022762397






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org