You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/08/10 13:41:18 UTC
[GitHub] [dolphinscheduler] atai-555 opened a new issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
atai-555 opened a new issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969
I created workflow named "dwD_01" with shell node, and the shell is configured with variable [YYYY-MM-DD-1], which is the day before the current scheduleTime. When dwD_01 is executed,ScheduleTime is 2021-08-10 03:01:00, but I find that [YYYY-MM-DD-1] is also 20210810(not 20210809).And then I saw this line in the code ShellTask.java:
if (CommandType.COMPLEMENT_DATA.getCode() == taskExecutionContext.getCmdTypeIfComplement()) {
The date = DateUtils. Add (taskExecutionContext getScheduleTime (), DAY_OF_MONTH, 1);
}
Why does it take an extra day here to fill data type operations?
the version of DolphinScheduler is 1.3.4
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] CalvinKirs closed issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
Posted by GitBox <gi...@apache.org>.
CalvinKirs closed issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] CalvinKirs commented on issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969#issuecomment-948250240
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Tandoy commented on issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
Posted by GitBox <gi...@apache.org>.
Tandoy commented on issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969#issuecomment-896471305
1. When you choose to supplement the data and run the workflow, dolphinscheduler will default the date +1, you can find the relevant date configuration instructions here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] dailidong commented on issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969#issuecomment-905713551
> > 1. When you choose to supplement the data and run the workflow, dolphinscheduler will default the date +1, you can find the relevant date configuration instructions here：https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/system-manual.html
> > 2. If you are not supplementing data, you can try $[yyyyMMdd-1]
>
> Thanks for your reply, I found the configuration instructions now after your help.
> The configuration instructions said: The day before the scheduled time of the daily scheduling instance, the format is yyyyMMdd, when the data is supplemented, the date is +1.
>
> I have a specific problem, I have two workflows ODS_01 and DWD_01,Dwd_01 depends on ODS_01. Today, ODS_01 was executed through the daily scheduling instance(scheduleTime is 2021-08-12 03:00:00), but DWD_01 was not executed. I started DWD_01 through the data complement task(scheduleTime is 2021-08-11 03:00:00), but because their dates were inconsistent, DWD_01 could not find the successful ODS_01 instance when checking whether the pre-dependent was completed.So it's been impossible to execute.
> Any reply would be appreciated.
as I know, except the shell task type, other task types have bugs in the complement. and 1.3.8 solved this issue, and 1.3.8 is in publishing process
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] atai-555 commented on issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
Posted by GitBox <gi...@apache.org>.
atai-555 commented on issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969#issuecomment-897312165
> 1. When you choose to supplement the data and run the workflow, dolphinscheduler will default the date +1, you can find the relevant date configuration instructions here：https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/system-manual.html
> 2. If you are not supplementing data, you can try $[yyyyMMdd-1]
Thanks for your reply, I found the configuration instructions now after your help.
The configuration instructions said: The day before the scheduled time of the daily scheduling instance, the format is yyyyMMdd, when the data is supplemented, the date is +1.
I have a specific problem, I have two workflows ODS_01 and DWD_01,Dwd_01 depends on ODS_01. Today, ODS_01 was executed through the daily scheduling instance(scheduleTime is 2021-08-12 03:00:00), but DWD_01 was not executed. I started DWD_01 through the data complement task(scheduleTime is 2021-08-11 03:00:00), but because their dates were inconsistent, DWD_01 could not find the successful ODS_01 instance when checking whether the pre-dependent was completed.So it's been impossible to execute.
Any reply would be appreciated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969#issuecomment-896038969
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/zh-cn/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Tandoy edited a comment on issue #5969: [Question] Why scheduleTime was added by one day when run complement data?
Posted by GitBox <gi...@apache.org>.
Tandoy edited a comment on issue #5969:
URL: https://github.com/apache/dolphinscheduler/issues/5969#issuecomment-896471305
1. When you choose to supplement the data and run the workflow, dolphinscheduler will default the date +1, you can find the relevant date configuration instructions here：https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/system-manual.html
2. If you are not supplementing data, you can try $[yyyyMMdd-1]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org