You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/01/06 04:20:35 UTC
[GitHub] [incubator-dolphinscheduler] RunningHu opened a new issue #4388: 定时任务自我依赖
RunningHu opened a new issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388
ds定时调度启动任务的时候，如果上一次的任务没有执行完，怎么设置不让他再次启动，或者干掉上次调度没有运行完的任务。
比如：昨天起了任务，这个任务一直跑着没有结束，今天又到时间了，上次没跑完，这次就不该起来，或者应该应该把上次没跑完的干掉。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] zhanguohao commented on issue #4388: 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
zhanguohao commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-755106763
It’s best to leave this strategy to the user to decide, such as
-Start a new task (regardless of the previous task)
-End the previous task and start a new task
-Wait for the completion of the previous task and start a new task (the next scheduling time point)
----
最好这个策略交给用户决定，比如
- 启动新任务（不管上一个任务）
- 结束上一个任务，启动新任务
- 等待上一个任务结束后，启动新任务（下一个调度时间点）
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] hujiang75277381 commented on issue #4388: Timed task self dependence | 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
hujiang75277381 commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-755824556
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #4388: 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-755116183
> You can choose the timeout failure strategy.
>
> By the way, for better communication, please use English,
English +1，please add title and desc in English
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] JinyLeeChina commented on issue #4388: 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
JinyLeeChina commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-755118580
> It’s best to leave this strategy to the user to decide, such as
> -Start a new task (regardless of the previous task)
> -End the previous task and start a new task
> -Wait for the completion of the previous task and start a new task (the next scheduling time point)
>
> 最好这个策略交给用户决定，比如
>
> * 启动新任务（不管上一个任务）
> * 结束上一个任务，启动新任务
> * 等待上一个任务结束后，启动新任务（下一个调度时间点）
+1, I agree
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] RunningHu commented on issue #4388: Timed task self dependence | 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
RunningHu commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-755139107
> It’s best to leave this strategy to the user to decide, such as
> -Start a new task (regardless of the previous task)
> -End the previous task and start a new task
> -Wait for the completion of the previous task and start a new task (the next scheduling time point)
>
> 最好这个策略交给用户决定，比如
>
> * 启动新任务（不管上一个任务）
> * 结束上一个任务，启动新任务
> * 等待上一个任务结束后，启动新任务（下一个调度时间点）
这样是最好的方案
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] hujiang75277381 commented on issue #4388: 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
hujiang75277381 commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-755106189
这个地方可以改造 worker。给task添加一个阻塞策略：并行执行 丢弃后续调度
改造方案:在worker初始化 AbstractTask 的时候，判断下相同工作流、task_type、task_name 是否有运行的task实例。如果存在 ，判断是否是自己，否则 中断执行，将task实例的状态标记为失败返回。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #4388: 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-755078926
You can choose the timeout failure strategy.
By the way, for better communication, please use English,
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] leeseven-li commented on issue #4388: Timed task self dependence | 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
leeseven-li commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-787575147
When can this function be realized
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] brucemen711 commented on issue #4388: Timed task self dependence | 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
brucemen711 commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-756006572
> It’s best to leave this strategy to the user to decide, such as
> -Start a new task (regardless of the previous task)
> -End the previous task and start a new task
> -Wait for the completion of the previous task and start a new task (the next scheduling time point)
>
> 最好这个策略交给用户决定，比如
>
> * 启动新任务（不管上一个任务）
> * 结束上一个任务，启动新任务
> * 等待上一个任务结束后，启动新任务（下一个调度时间点）
I think this is aceptable but user need to handle checking if job had proccess instances running or not, is this right ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] brucemen711 commented on issue #4388: Timed task self dependence | 定时任务自我依赖
Posted by GitBox <gi...@apache.org>.
brucemen711 commented on issue #4388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4388#issuecomment-768932153
I create this flow to make job run every hour, hope it helps.
You can even run every 10 minutes just in case previous schudule not done and next schedule not run cause checkpoint exists.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org