You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/04/04 19:51:01 UTC
[GitHub] [airflow] iremonur opened a new issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
iremonur opened a new issue #15192:
URL: https://github.com/apache/airflow/issues/15192
Hi,
I am trying to schedule 4 tasks to be 10 minutes between each other. In the dag code (located in ~/airflow/dags/example_v6.py), I set the
-> start_date=datetime.datetime(2021, 4, 4, 19, 20)
-> schedule_interval= '*/10 * * * *'
I'm trying to schedule 4 tasks with 10 minutes between them, I want the first task to start at 19:20.
The first task is succeeded but the other three of them are stuck in the state of "running".
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/example_v6.py
$ airflow db init
$ airflow dags backfill dag_v6 -s 2021-04-04-19:20 -e 2021-04-04-19:50
I got these messages from the terminal:
Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.
Environment:
- GPU : NVIDIA Quadro K3100M
- OS: Ubuntu 18.04
- Python 3.7.3
At the UI, the tasks are listed as:
I would be very glad if you help me with this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] hafid-d commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
hafid-d commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-849268160
Any update on this ? Facing the same issue!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] parkyo commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
parkyo commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813187887
I found this issue on ovio.org and would love to contribute!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] github-actions[bot] commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-1043662520
This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] github-actions[bot] commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-1050381575
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur edited a comment on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur edited a comment on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 19:50.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
The first task is succeeded but the other three of them are stuck in the state of "running".
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill dag_v6 -s 2021-04-04-19:50 -e 2021-04-06
The tasks which have the execution time at future are succeeded but some of the tasks at the beginning are stuck in the state of "running" :+1:
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813231876
Thank you, it would be great ! Could you share the link related to the issue ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813090037
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur edited a comment on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur edited a comment on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 20.00.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill tutorial_v2 -s 2021-04-04-19:50 -e 2021-04-06
NOTE: When I run these commands, the date of the database was: 4 April 2021 / 19:57.
Some of the tasks at the beginning are stuck in the state of "running" :
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.
Environment:
GPU : NVIDIA Quadro K3100M
OS: Ubuntu 18.04
Python 3.7.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur edited a comment on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur edited a comment on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 19:50.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
The first task is succeeded but the other three of them are stuck in the state of "running".
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill dag_v6 -s 2021-04-04-19:50 -e 2021-04-06
The tasks which have the execution time at future are succeeded but some of the tasks at the beginning are stuck in the state of "running" :+1:
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.
Environment:
GPU : NVIDIA Quadro K3100M
OS: Ubuntu 18.04
Python 3.7.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur edited a comment on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur edited a comment on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 19:50.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
The first task is succeeded but the other three of them are stuck in the state of "running".
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill dag_v6 -s 2021-04-04-19:50 -e 2021-04-06
The tasks which have the execution time at future are succeeded but some of the tasks at the beginning are stuck in the state of "running" :
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.
Environment:
GPU : NVIDIA Quadro K3100M
OS: Ubuntu 18.04
Python 3.7.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur edited a comment on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur edited a comment on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 19:50.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill tutorial_v2 -s 2021-04-04-19:50 -e 2021-04-06
Some of the tasks at the beginning are stuck in the state of "running" :
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.
Environment:
GPU : NVIDIA Quadro K3100M
OS: Ubuntu 18.04
Python 3.7.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-1015840361
If someone is experiencing similar issue with latest airflow version please comment and share reproduce steps
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur edited a comment on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur edited a comment on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 19:50.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
The first task is succeeded but the other three of them are stuck in the state of "running".
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill tutorial_v2 -s 2021-04-04-19:50 -e 2021-04-06
The tasks which have the execution time at future are succeeded but some of the tasks at the beginning are stuck in the state of "running" :
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.
Environment:
GPU : NVIDIA Quadro K3100M
OS: Ubuntu 18.04
Python 3.7.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] github-actions[bot] closed issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #15192:
URL: https://github.com/apache/airflow/issues/15192
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur commented on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur commented on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried schedule to another tasks to be 10 minutes between each other, I want the first task to start at 19:50.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
The first task is succeeded but the other three of them are stuck in the state of "running".
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill dag_v6 -s 2021-04-04-19:50 -e 2021-04-06
The tasks which have the execution time at future are succeeded but some of the tasks at the beginning are stuck in the state of "running" :+1:
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iremonur edited a comment on issue #15192: SCHEDULED TASKS ARE STUCK IN THE STATE OF "RUNNING"
Posted by GitBox <gi...@apache.org>.
iremonur edited a comment on issue #15192:
URL: https://github.com/apache/airflow/issues/15192#issuecomment-813236049
Actually, I tried to schedule another task to be 10 minutes between each other, I want the first task to start at 20.00.
In the dag code (located in ~/airflow/dags/tutorial_v2.py), I set:
-> start_date=datetime.datetime(2021, 4, 4, 19, 50)
-> schedule_interval= '*/10 * * * *'
Some of the parameters I set in the dag code :
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'wait_for_downstream' : False,
'email': ['airflow@example.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
}
I run these commands to schedule the dag:
$ python ~/airflow/dags/tutorial_v2.py
$ airflow db init
$ airflow dags backfill tutorial_v2 -s 2021-04-04-19:50 -e 2021-04-06
Some of the tasks at the beginning are stuck in the state of "running" :
I don't understand why the scheduler skip some of the tasks, I would be very glad if you help me with this.
Apache Airflow version: v2.0.1
Kubernetes is not used.
I use the SequentialExecutor.
Environment:
GPU : NVIDIA Quadro K3100M
OS: Ubuntu 18.04
Python 3.7.3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org