You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by ke...@apache.org on 2022/10/17 02:43:30 UTC
[dolphinscheduler] branch docker/base updated (00d6fe2bad -> 50e88741b3)
This is an automated email from the ASF dual-hosted git repository.
kezhenxu94 pushed a change to branch docker/base
in repository https://gitbox.apache.org/repos/asf/dolphinscheduler.git
discard 00d6fe2bad Use temurin Java docker images instead of deprecated ones
add 6332fee2b5 [Improvement-12289][k8s] update the common.properties in values.yaml (#12290)
add 0e1c8d8153 [Feature][API] New restful API task and task relation (#12116)
add 17cd644506 [Fix-#11669][Workflow Instance Page] Fix the duration in Workflow Instance page. (#12264)
add db1d319159 Reorganize some classes in common module, remove duplicate classes (#12321)
add 224508850e [Migrate][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module (#12337)
add 22103f975e [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module (#12328)
add 9652964c94 [python] Add resource plugin for python, dataX, CustomDataX and Sql (#12135)
add ac845046e7 [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules (#12352)
add c50cc997a8 [Doc][Bug] Fix dead link caused by markdown cross-files anchor (#12357)
add b357781df2 [Migrate][Test] Migrate junit4 -> junit5 test cases in common, service, and spi modules (#12363)
add b953cdc559 update english oracle.md (#12332)
add 2f37da0dbc [Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311)
add 7b44612f28 [Improvement-12372][k8s] Update the deprecated k8s api (#12373)
add 1e792186d0 [Fix][Worker] fix wrong env var name for alert in K8S (#12369)
add cd5fb12e46 [Bug][Python] Python class description error (#12360)
add bc80f34056 [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules (#12362)
add a725614429 [docs] change optional parameters --jar to --jars for Spark (#12385) (#12386)
add 7aa8a77fb2 [Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @Ignore to @Disable
add b7bd8d7803 [Improvement] add presto in datax (#12371)
add 55004bebe0 [Improvement-12391][API] Workflow definitions that contain logical task nodes support the copy function (#12392)
add 1d0d26a416 [fix#12170] If the worker's clock early than master node, will ignore dispatch time. (#12219)
add 50e88741b3 Use temurin Java docker images instead of deprecated ones
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (00d6fe2bad)
\
N -- N -- N refs/heads/docker/base (50e88741b3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../cluster-test/mysql/dolphinscheduler_env.sh | 2 +-
.../postgresql/dolphinscheduler_env.sh | 2 +-
.pre-commit-config.yaml | 2 +-
.../statefulset-dolphinscheduler-worker.yaml | 2 +-
deploy/kubernetes/dolphinscheduler/values.yaml | 83 ++--
docs/docs/en/about/hardware.md | 3 +
docs/docs/en/contribute/join/pull-request.md | 6 +-
docs/docs/en/contribute/join/unit-test.md | 4 +-
docs/docs/en/guide/datasource/oracle.md | 23 +-
docs/docs/en/guide/task/chunjun.md | 5 +-
docs/docs/en/guide/task/conditions.md | 5 +-
docs/docs/en/guide/task/datasync.md | 24 +-
docs/docs/en/guide/task/datax.md | 5 +-
docs/docs/en/guide/task/dependent.md | 5 +-
docs/docs/en/guide/task/dinky.md | 5 +-
docs/docs/en/guide/task/dms.md | 17 +-
docs/docs/en/guide/task/dvc.md | 5 +-
docs/docs/en/guide/task/emr.md | 5 +-
docs/docs/en/guide/task/flink.md | 5 +-
docs/docs/en/guide/task/hive-cli.md | 5 +-
docs/docs/en/guide/task/http.md | 5 +-
docs/docs/en/guide/task/java.md | 31 +-
docs/docs/en/guide/task/jupyter.md | 5 +-
docs/docs/en/guide/task/kubernetes.md | 5 +-
docs/docs/en/guide/task/map-reduce.md | 5 +-
docs/docs/en/guide/task/mlflow.md | 8 +-
docs/docs/en/guide/task/openmldb.md | 5 +-
docs/docs/en/guide/task/pigeon.md | 5 +-
docs/docs/en/guide/task/python.md | 5 +-
docs/docs/en/guide/task/pytorch.md | 5 +-
docs/docs/en/guide/task/sagemaker.md | 5 +-
docs/docs/en/guide/task/seatunnel.md | 21 +-
docs/docs/en/guide/task/shell.md | 5 +-
docs/docs/en/guide/task/spark.md | 5 +-
docs/docs/en/guide/task/sql.md | 5 +-
docs/docs/en/guide/task/stored-procedure.md | 5 +-
docs/docs/en/guide/task/sub-process.md | 5 +-
docs/docs/en/guide/task/switch.md | 5 +-
docs/docs/en/guide/task/zeppelin.md | 5 +-
docs/docs/zh/about/glossary.md | 4 +-
docs/docs/zh/about/hardware.md | 11 +-
docs/docs/zh/contribute/join/pull-request.md | 6 +-
docs/docs/zh/contribute/join/unit-test.md | 4 +-
docs/docs/zh/guide/task/chunjun.md | 5 +-
docs/docs/zh/guide/task/conditions.md | 5 +-
docs/docs/zh/guide/task/datasync.md | 38 +-
docs/docs/zh/guide/task/datax.md | 5 +-
docs/docs/zh/guide/task/dependent.md | 5 +-
docs/docs/zh/guide/task/dinky.md | 5 +-
docs/docs/zh/guide/task/dms.md | 13 +-
docs/docs/zh/guide/task/dvc.md | 5 +-
docs/docs/zh/guide/task/emr.md | 5 +-
docs/docs/zh/guide/task/flink.md | 5 +-
docs/docs/zh/guide/task/hive-cli.md | 5 +-
docs/docs/zh/guide/task/http.md | 5 +-
docs/docs/zh/guide/task/java.md | 5 +-
docs/docs/zh/guide/task/jupyter.md | 5 +-
docs/docs/zh/guide/task/kubernetes.md | 5 +-
docs/docs/zh/guide/task/map-reduce.md | 5 +-
docs/docs/zh/guide/task/mlflow.md | 8 +-
docs/docs/zh/guide/task/openmldb.md | 5 +-
docs/docs/zh/guide/task/pigeon.md | 5 +-
docs/docs/zh/guide/task/python.md | 5 +-
docs/docs/zh/guide/task/pytorch.md | 5 +-
docs/docs/zh/guide/task/sagemaker.md | 5 +-
docs/docs/zh/guide/task/seatunnel.md | 21 +-
docs/docs/zh/guide/task/shell.md | 5 +-
docs/docs/zh/guide/task/spark.md | 7 +-
docs/docs/zh/guide/task/sql.md | 11 +-
docs/docs/zh/guide/task/stored-procedure.md | 5 +-
docs/docs/zh/guide/task/sub-process.md | 5 +-
docs/docs/zh/guide/task/switch.md | 5 +-
docs/docs/zh/guide/task/zeppelin.md | 5 +-
docs/img/new_ui/dev/datasource/oracle.png | Bin 83589 -> 114734 bytes
.../dingtalk/DingTalkAlertChannelFactoryTest.java | 9 +-
.../plugin/alert/dingtalk/DingTalkSenderTest.java | 13 +-
.../alert/email/EmailAlertChannelFactoryTest.java | 9 +-
.../plugin/alert/email/EmailAlertChannelTest.java | 102 ++--
.../plugin/alert/email/ExcelUtilsTest.java | 75 +--
.../plugin/alert/email/MailUtilsTest.java | 33 +-
.../email/template/DefaultHTMLTemplateTest.java | 29 +-
.../feishu/FeiShuAlertChannelFactoryTest.java | 8 +-
.../plugin/alert/feishu/FeiShuSenderTest.java | 55 +-
.../alert/http/HttpAlertChannelFactoryTest.java | 12 +-
.../plugin/alert/http/HttpAlertChannelTest.java | 8 +-
.../plugin/alert/http/HttpSenderTest.java | 6 +-
.../PagerDutyAlertChannelFactoryTest.java | 10 +-
.../alert/pagerduty/PagerDutySenderTest.java | 13 +-
.../plugin/alert/script/ProcessUtilsTest.java | 5 +-
.../script/ScriptAlertChannelFactoryTest.java | 8 +-
.../plugin/alert/script/ScriptSenderTest.java | 14 +-
.../alert/slack/SlackAlertChannelFactoryTest.java | 10 +-
.../plugin/alert/slack/SlackSenderTest.java | 8 +-
.../telegram/TelegramAlertChannelFactoryTest.java | 11 +-
.../plugin/alert/telegram/TelegramSenderTest.java | 26 +-
.../WebexTeamsAlertChannelFactoryTest.java | 10 +-
.../alert/webexteams/WebexTeamsSenderTest.java | 50 +-
.../wechat/WeChatAlertChannelFactoryTest.java | 8 +-
.../plugin/alert/wechat/WeChatSenderTest.java | 48 +-
.../dolphinscheduler-alert-server/pom.xml | 12 -
.../alert/AlertPluginManagerTest.java | 39 +-
.../alert/processor/AlertRequestProcessorTest.java | 24 +-
.../alert/runner/AlertSenderServiceTest.java | 20 +-
dolphinscheduler-api/pom.xml | 14 -
dolphinscheduler-api/src/main/bin/start.sh | 2 +-
.../api/controller/AccessTokenController.java | 2 +-
.../api/controller/AlertGroupController.java | 2 +-
.../controller/AlertPluginInstanceController.java | 3 +-
.../api/controller/ClusterController.java | 2 +-
.../api/controller/DataQualityController.java | 2 +-
.../api/controller/DataSourceController.java | 4 +-
.../api/controller/EnvironmentController.java | 2 +-
.../api/controller/K8sNamespaceController.java | 2 +-
.../controller/ProcessDefinitionController.java | 2 +-
.../api/controller/ProcessInstanceController.java | 2 +-
.../ProcessTaskRelationV2Controller.java | 132 +++++
.../api/controller/ProjectController.java | 2 +-
.../api/controller/ProjectV2Controller.java | 2 +-
.../api/controller/QueueController.java | 2 +-
.../api/controller/QueueV2Controller.java | 2 +-
.../api/controller/ResourcesController.java | 2 +-
.../api/controller/ScheduleV2Controller.java | 2 +-
.../api/controller/SchedulerController.java | 3 +-
.../api/controller/TaskDefinitionController.java | 7 +-
.../api/controller/TaskDefinitionV2Controller.java | 170 +++++++
.../api/controller/TaskInstanceController.java | 2 +-
.../api/controller/TenantController.java | 2 +-
.../api/controller/UsersController.java | 2 +-
.../api/controller/WorkFlowLineageController.java | 2 +-
.../api/controller/WorkerGroupController.java | 2 +-
.../api/controller/WorkflowV2Controller.java | 2 +-
.../api/dto/task/TaskCreateRequest.java | 141 ++++++
.../TaskFilterRequest.java} | 35 +-
.../api/dto/task/TaskUpdateRequest.java | 175 +++++++
.../taskRelation/TaskRelationCreateRequest.java | 58 +++
.../TaskRelationDeleteRequest.java} | 33 +-
.../taskRelation/TaskRelationFilterRequest.java | 73 +++
.../TaskRelationUpdateUpstreamRequest.java} | 32 +-
.../api/dto/workflow/WorkflowUpdateRequest.java | 12 +
.../apache/dolphinscheduler/api/enums/Status.java | 14 +-
.../dolphinscheduler/api/k8s/K8sManager.java | 4 +-
.../api/service/ProcessTaskRelationService.java | 39 +-
.../api/service/TaskDefinitionService.java | 64 ++-
.../api/service/impl/ClusterServiceImpl.java | 3 +-
.../service/impl/ProcessDefinitionServiceImpl.java | 13 +-
.../service/impl/ProcessInstanceServiceImpl.java | 8 +-
.../impl/ProcessTaskRelationServiceImpl.java | 245 ++++++++-
.../api/service/impl/ResourcesServiceImpl.java | 2 +-
.../service/impl/TaskDefinitionServiceImpl.java | 345 ++++++++++---
.../api/service/impl/TenantServiceImpl.java | 4 +-
.../api/service/impl/UsersServiceImpl.java | 3 +-
.../api/service/impl/WorkerGroupServiceImpl.java | 2 +-
.../api}/utils/ClusterConfUtils.java | 3 +-
.../api/aspect/AccessLogAspectTest.java | 10 +-
.../api/audit/AuditSubscriberTest.java | 13 +-
.../api/configuration/AuditConfigurationTest.java | 11 +-
.../configuration/TrafficConfigurationTest.java | 14 +-
.../api/controller/AbstractControllerTest.java | 16 +-
.../api/controller/AccessTokenControllerTest.java | 35 +-
.../controller/AccessTokenV2ControllerTest.java | 34 +-
.../api/controller/AlertGroupControllerTest.java | 40 +-
.../AlertPluginInstanceControllerTest.java | 226 +++++----
.../api/controller/AuditLogControllerTest.java | 8 +-
.../api/controller/ClusterControllerTest.java | 109 ++--
.../api/controller/DataAnalysisControllerTest.java | 2 +-
.../api/controller/DataQualityControllerTest.java | 35 +-
.../api/controller/DataSourceControllerTest.java | 201 ++++----
.../api/controller/EnvironmentControllerTest.java | 58 ++-
.../api/controller/ExecutorControllerTest.java | 143 +++---
.../api/controller/K8sNamespaceControllerTest.java | 106 ++--
.../api/controller/LoggerControllerTest.java | 23 +-
.../api/controller/LoginControllerTest.java | 13 +-
.../api/controller/MonitorControllerTest.java | 41 +-
.../ProcessDefinitionControllerTest.java | 45 +-
.../controller/ProcessInstanceControllerTest.java | 41 +-
.../ProcessTaskRelationControllerTest.java | 12 +-
.../api/controller/ProjectControllerTest.java | 33 +-
.../api/controller/ProjectV2ControllerTest.java | 37 +-
.../api/controller/QueueControllerTest.java | 45 +-
.../api/controller/QueueV2ControllerTest.java | 113 ++---
.../api/controller/ResourcesControllerTest.java | 40 +-
.../api/controller/SchedulerControllerTest.java | 20 +-
.../api/controller/TaskGroupControllerTest.java | 20 +-
.../controller/TaskGroupQueueControllerTest.java | 6 +-
.../api/controller/TaskInstanceControllerTest.java | 14 +-
.../api/controller/TenantControllerTest.java | 57 ++-
.../api/controller/UiPluginControllerTest.java | 52 +-
.../api/controller/UsersControllerTest.java | 53 +-
.../controller/WorkFlowLineageControllerTest.java | 20 +-
.../api/controller/WorkerGroupControllerTest.java | 16 +-
.../api/controller/WorkflowV2ControllerTest.java | 17 +-
.../dto/resources/filter/ResourceFilterTest.java | 32 +-
.../resources/visitor/ResourceTreeVisitorTest.java | 43 +-
.../api/enums/ExecuteTypeTest.java | 15 +-
.../dolphinscheduler/api/enums/StatusTest.java | 22 +-
.../api/exceptions/ApiExceptionHandlerTest.java | 16 +-
.../api/exceptions/ServiceExceptionTest.java | 16 +-
.../interceptor/LocaleChangeInterceptorTest.java | 6 +-
.../interceptor/LoginHandlerInterceptorTest.java | 21 +-
.../api/interceptor/RateLimitInterceptorTest.java | 20 +-
.../dolphinscheduler/api/k8s/K8sManagerTest.java | 27 +-
.../ResourcePermissionCheckServiceTest.java | 48 +-
.../api/python/PythonGatewayTest.java | 47 +-
.../api/security/SecurityConfigLDAPTest.java | 11 +-
.../api/security/SecurityConfigPasswordTest.java | 6 +-
.../security/impl/ldap/LdapAuthenticatorTest.java | 46 +-
.../api/security/impl/ldap/LdapServiceTest.java | 49 +-
.../impl/pwd/PasswordAuthenticatorTest.java | 17 +-
.../api/service/AccessTokenServiceTest.java | 75 +--
.../api/service/AlertGroupServiceTest.java | 46 +-
.../service/AlertPluginInstanceServiceTest.java | 58 ++-
.../api/service/AuditServiceTest.java | 19 +-
.../api/service/BaseServiceTest.java | 29 +-
.../api/service/ClusterServiceTest.java | 70 +--
.../api/service/DataAnalysisServiceTest.java | 43 +-
.../api/service/DataSourceServiceTest.java | 66 +--
.../api/service/DqExecuteResultServiceTest.java | 28 +-
.../api/service/DqRuleServiceTest.java | 21 +-
.../api/service/EnvironmentServiceTest.java | 63 +--
.../EnvironmentWorkerGroupRelationServiceTest.java | 20 +-
.../api/service/ExecutorServiceTest.java | 78 +--
.../api/service/K8SNamespaceServiceTest.java | 61 +--
.../api/service/LoggerServiceTest.java | 29 +-
.../api/service/MonitorServiceTest.java | 67 +--
.../api/service/ProcessDefinitionServiceTest.java | 95 ++--
.../api/service/ProcessInstanceServiceTest.java | 225 +++++++--
.../service/ProcessTaskRelationServiceTest.java | 289 +++++++----
.../api/service/ProjectServiceTest.java | 75 +--
.../api/service/QueueServiceTest.java | 97 ++--
.../api/service/ResourcesServiceTest.java | 177 +++----
.../api/service/SchedulerServiceTest.java | 28 +-
.../api/service/SessionServiceTest.java | 50 +-
.../api/service/TaskDefinitionServiceImplTest.java | 553 ++++++++++++++-------
.../api/service/TaskGroupQueueServiceTest.java | 15 +-
.../api/service/TaskGroupServiceTest.java | 49 +-
.../api/service/TaskInstanceServiceTest.java | 157 +++---
.../api/service/TenantServiceTest.java | 38 +-
.../api/service/UdfFuncServiceTest.java | 51 +-
.../api/service/UiPluginServiceTest.java | 27 +-
.../api/service/UsersServiceTest.java | 183 +++----
.../api/service/WorkFlowLineageServiceTest.java | 25 +-
.../api/service/WorkerGroupServiceTest.java | 31 +-
.../dolphinscheduler/api/utils/CheckUtilsTest.java | 53 +-
.../dolphinscheduler/api/utils/FileUtilsTest.java | 83 ++--
.../dolphinscheduler/api/utils/RegexUtilsTest.java | 28 +-
.../dolphinscheduler/api/utils/ResultTest.java | 15 +-
dolphinscheduler-bom/pom.xml | 8 -
dolphinscheduler-common/pom.xml | 223 +--------
.../apache/dolphinscheduler/common/Constants.java | 20 -
.../dolphinscheduler/common/utils/DateUtils.java | 4 +
.../dolphinscheduler/common/utils/JSONUtils.java | 60 +--
.../dolphinscheduler/common/utils/OSUtils.java | 7 +-
.../common/utils/PropertyUtils.java | 2 +-
.../dolphinscheduler/common/ConstantsTest.java | 9 +-
.../common/exception/ExceptionTest.java | 24 +-
.../dolphinscheduler/common/graph/DAGTest.java | 119 +++--
.../dolphinscheduler/common/os/OSUtilsTest.java | 34 +-
.../common/utils/CodeGenerateUtilsTest.java | 8 +-
.../common/utils/DateUtilsTest.java | 107 ++--
.../common/utils/EncryptionUtilsTest.java | 6 +-
.../common/utils/FileUtilsTest.java | 51 +-
.../common/utils/LocalServerHttpUtilsTest.java | 34 +-
.../common/utils/NetUtilsTest.java | 45 +-
.../common/utils/PropertyUtilsTest.java | 15 +-
.../common/utils/RetryerUtilsTest.java | 88 ++--
.../common/utils/ScriptRunnerTest.java | 8 +-
.../dolphinscheduler/common/utils/StringTest.java | 6 +-
.../placeholder/TimePlaceholderUtilsTest.java | 83 ----
dolphinscheduler-dao/pom.xml | 32 +-
.../dolphinscheduler/dao/entity/ProcessData.java | 115 -----
.../dao/entity/ProcessDefinitionLog.java | 1 -
.../dao/entity/ProcessTaskRelation.java | 26 +-
.../dao/entity/ProcessTaskRelationLog.java | 1 -
.../dao/entity/TaskDefinitionLog.java | 1 -
.../dao/mapper/ProcessTaskRelationMapper.java | 23 +-
.../dao/mapper/TaskDefinitionMapper.java | 12 +-
.../dolphinscheduler/dao/utils/WorkflowUtils.java | 34 +-
.../dao/mapper/ProcessTaskRelationMapper.xml | 23 +
.../dao/mapper/TaskDefinitionMapper.xml | 20 +
.../apache/dolphinscheduler/dao/AlertDaoTest.java | 18 +-
.../apache/dolphinscheduler/dao/BaseDaoTest.java | 6 +-
.../dao/entity/ProcessDefinitionTest.java | 6 +-
.../dao/entity/TaskInstanceTest.java | 12 +-
.../dolphinscheduler/dao/entity/UdfFuncTest.java | 8 +-
.../dao/mapper/AccessTokenMapperTest.java | 42 +-
.../dao/mapper/AlertGroupMapperTest.java | 32 +-
.../dao/mapper/AlertMapperTest.java | 16 +-
.../dao/mapper/AlertPluginInstanceMapperTest.java | 18 +-
.../dao/mapper/AlertSendStatusMapperTest.java | 8 +-
.../dao/mapper/AuditLogMapperTest.java | 8 +-
.../dao/mapper/ClusterMapperTest.java | 32 +-
.../dao/mapper/CommandMapperTest.java | 34 +-
.../dao/mapper/DataSourceMapperTest.java | 43 +-
.../dao/mapper/DataSourceUserMapperTest.java | 14 +-
.../dao/mapper/DqRuleInputEntryMapperTest.java | 2 +-
.../dao/mapper/EnvironmentMapperTest.java | 32 +-
.../EnvironmentWorkerGroupRelationMapperTest.java | 20 +-
.../dao/mapper/ErrorCommandMapperTest.java | 8 +-
.../dao/mapper/K8sNamespaceMapperTest.java | 24 +-
.../dao/mapper/PluginDefineTest.java | 16 +-
.../dao/mapper/ProcessDefinitionLogMapperTest.java | 20 +-
.../dao/mapper/ProcessDefinitionMapperTest.java | 32 +-
.../dao/mapper/ProcessInstanceMapMapperTest.java | 14 +-
.../dao/mapper/ProcessInstanceMapperTest.java | 43 +-
.../mapper/ProcessTaskRelationLogMapperTest.java | 6 +-
.../dao/mapper/ProcessTaskRelationMapperTest.java | 12 +-
.../dao/mapper/ProjectMapperTest.java | 31 +-
.../dao/mapper/ProjectUserMapperTest.java | 17 +-
.../dao/mapper/QueueMapperTest.java | 26 +-
.../dao/mapper/ResourceMapperTest.java | 67 ++-
.../dao/mapper/ResourceUserMapperTest.java | 19 +-
.../dao/mapper/ScheduleMapperTest.java | 18 +-
.../dao/mapper/SessionMapperTest.java | 12 +-
.../dao/mapper/TaskDefinitionLogMapperTest.java | 12 +-
.../dao/mapper/TaskDefinitionMapperTest.java | 28 +-
.../dao/mapper/TaskGroupMapperTest.java | 21 +-
.../dao/mapper/TaskGroupQueueMapperTest.java | 16 +-
.../dao/mapper/TaskInstanceMapperTest.java | 32 +-
.../dao/mapper/TenantMapperTest.java | 21 +-
.../dao/mapper/UDFUserMapperTest.java | 14 +-
.../dao/mapper/UdfFuncMapperTest.java | 28 +-
.../dao/mapper/UserMapperTest.java | 26 +-
.../dao/mapper/WorkFlowLineageMapperTest.java | 12 +-
.../dao/mapper/WorkerGroupMapperTest.java | 24 +-
.../dao/upgrade/ProcessDefinitionDaoTest.java | 9 +-
.../dao/upgrade/SchemaUtilsTest.java | 30 +-
.../dao/upgrade/WorkerGroupDaoTest.java | 28 +-
.../utils/ResourceProcessDefinitionUtilsTest.java | 6 +-
.../dao/utils/WorkflowUtilsTest.java | 51 ++
.../data/quality/SparkApplicationTestBase.java | 16 +-
.../configuration/ConfigurationParserTest.java | 9 +-
.../data/quality/flow/reader/JdbcReaderTest.java | 24 +-
.../quality/flow/reader/ReaderFactoryTest.java | 22 +-
.../data/quality/flow/writer/JdbcWriterTest.java | 26 +-
.../quality/flow/writer/WriterFactoryTest.java | 8 +-
.../data/quality/utils/ConfigUtilsTest.java | 12 +-
.../dolphinscheduler-datasource-api/pom.xml | 6 -
.../plugin/datasource/api/utils/CommonUtils.java | 2 +-
.../api/client/CommonDataSourceClientTest.java | 12 +-
.../AbstractDataSourceProcessorTest.java | 2 +-
.../datasource/api/utils/CommonUtilsTest.java | 50 +-
.../param/AthenaDataSourceProcessorTest.java | 36 +-
.../dolphinscheduler-datasource-clickhouse/pom.xml | 19 +-
.../ClickHouseDataSourceChannelFactoryTest.java | 6 +-
.../ClickHouseDataSourceChannelTest.java | 13 +-
.../dolphinscheduler-datasource-db2/pom.xml | 19 +-
.../db2/DB2DataSourceChannelFactoryTest.java | 6 +-
.../datasource/db2/DB2DataSourceChannelTest.java | 12 +-
.../db2/param/Db2DataSourceProcessorTest.java | 28 +-
.../dolphinscheduler-datasource-hive/pom.xml | 7 -
.../plugin/datasource/hive/utils/CommonUtil.java | 8 +-
.../hive/HiveDataSourceChannelFactoryTest.java | 6 +-
.../datasource/hive/HiveDataSourceChannelTest.java | 12 +-
.../hive/param/HiveDataSourceProcessorTest.java | 27 +-
.../dolphinscheduler-datasource-mysql/pom.xml | 18 +-
.../mysql/MySQLDataSourceChannelFactoryTest.java | 6 +-
.../mysql/MySQLDataSourceChannelTest.java | 12 +-
.../mysql/param/MySQLDataSourceProcessorTest.java | 28 +-
.../mysql/provider/JDBCDataSourceProviderTest.java | 15 +-
.../mysql/utils/DataSourceUtilsTest.java | 30 +-
.../dolphinscheduler-datasource-oracle/pom.xml | 17 +-
.../oracle/OracleDataSourceChannelFactoryTest.java | 6 +-
.../oracle/OracleDataSourceChannelTest.java | 12 +-
.../param/OracleDataSourceProcessorTest.java | 28 +-
.../dolphinscheduler-datasource-postgresql/pom.xml | 18 +-
.../PostgreSQLDataSourceChannelFactoryTest.java | 6 +-
.../PostgreSQLDataSourceChannelTest.java | 13 +-
.../param/PostgreSQLDataSourceProcessorTest.java | 29 +-
.../dolphinscheduler-datasource-presto/pom.xml | 17 +-
.../presto/PrestoDataSourceChannelFactoryTest.java | 6 +-
.../presto/PrestoDataSourceChannelTest.java | 12 +-
.../param/PrestoDataSourceProcessorTest.java | 26 +-
.../param/RedshiftDataSourceProcessorTest.java | 26 +-
.../dolphinscheduler-datasource-spark/pom.xml | 17 +-
.../spark/SparkDataSourceChannelFactoryTest.java | 6 +-
.../spark/SparkDataSourceChannelTest.java | 12 +-
.../spark/param/SparkDataSourceProcessorTest.java | 28 +-
.../dolphinscheduler-datasource-sqlserver/pom.xml | 20 +-
.../SQLServerDataSourceChannelFactoryTest.java | 6 +-
.../sqlserver/SQLServerDataSourceChannelTest.java | 13 +-
.../param/SQLServerDataSourceProcessorTest.java | 31 +-
dolphinscheduler-datasource-plugin/pom.xml | 8 -
dolphinscheduler-master/pom.xml | 14 -
dolphinscheduler-master/src/main/bin/start.sh | 2 +-
.../master/processor/StateEventProcessor.java | 2 +-
.../master/processor/TaskEventProcessor.java | 2 +-
.../processor/TaskExecuteResponseProcessor.java | 3 +-
.../master/processor/TaskRecallProcessor.java | 3 +-
.../processor/queue/StateEventResponseService.java | 2 +-
.../processor/queue/TaskExecuteRunnable.java | 3 +-
.../server/master/runner/EventExecuteService.java | 3 +-
.../master/runner/MasterSchedulerBootstrap.java | 3 +-
.../master/runner/StateWheelExecuteThread.java | 2 +-
.../master/runner/StreamTaskExecuteRunnable.java | 2 +-
.../master/runner/StreamTaskExecuteThreadPool.java | 3 +-
.../server/master/runner/WorkflowEventLooper.java | 2 +-
.../master/runner/WorkflowExecuteRunnable.java | 9 +-
.../master/runner/WorkflowExecuteThreadPool.java | 2 +-
.../master/runner/task/BaseTaskProcessor.java | 4 +-
.../master/service/MasterFailoverService.java | 2 +-
.../master/service/WorkerFailoverService.java | 2 +-
.../server/master/BlockingTaskTest.java | 12 +-
.../server/master/ConditionsTaskTest.java | 43 +-
.../server/master/DependentTaskTest.java | 30 +-
.../server/master/MasterCommandTest.java | 6 +-
.../dolphinscheduler/server/master/ParamsTest.java | 6 +-
.../server/master/SubProcessTaskTest.java | 6 +-
.../server/master/SwitchTaskTest.java | 33 +-
.../ProcessInstanceExecCacheManagerImplTest.java | 33 +-
.../server/master/config/MasterConfigTest.java | 12 +-
.../consumer/TaskPriorityQueueConsumerTest.java | 38 +-
.../master/dispatch/ExecutorDispatcherTest.java | 19 +-
.../executor/NettyExecutorManagerTest.java | 22 +-
.../dispatch/host/RoundRobinHostManagerTest.java | 16 +-
.../dispatch/host/assign/HostWorkerTest.java | 20 +-
.../host/assign/LowerWeightRoundRobinTest.java | 36 +-
.../dispatch/host/assign/RandomSelectorTest.java | 14 +-
.../host/assign/RoundRobinSelectorTest.java | 40 +-
.../master/processor/CacheProcessorTest.java | 12 +-
.../master/processor/TaskAckProcessorTest.java | 16 +-
.../processor/TaskKillResponseProcessorTest.java | 10 +-
.../processor/queue/TaskResponseServiceTest.java | 18 +-
.../master/registry/MasterRegistryClientTest.java | 15 +-
.../master/runner/MasterTaskExecThreadTest.java | 16 +-
.../master/runner/WorkflowExecuteRunnableTest.java | 35 +-
.../runner/task/CommonTaskProcessorTest.java | 34 +-
.../runner/task/TaskProcessorFactoryTest.java | 10 +-
.../server/master/service/FailoverServiceTest.java | 33 +-
.../src/pydolphinscheduler/constants.py | 2 +
.../src/pydolphinscheduler/core/task.py | 29 +-
.../src/pydolphinscheduler/tasks/datax.py | 10 +-
.../src/pydolphinscheduler/tasks/python.py | 43 +-
.../src/pydolphinscheduler/tasks/sql.py | 7 +-
.../pydolphinscheduler/tests/tasks/test_datax.py | 91 +++-
.../pydolphinscheduler/tests/tasks/test_python.py | 58 ++-
.../pydolphinscheduler/tests/tasks/test_sql.py | 45 +-
.../plugin/registry/etcd/EtcdRegistryTest.java | 41 +-
.../registry/zookeeper/ZookeeperRegistryTest.java | 26 +-
dolphinscheduler-remote/pom.xml | 32 +-
.../apache/dolphinscheduler/remote/utils/Host.java | 7 +-
.../remote/NettyRemotingClientTest.java | 16 +-
.../command/alert/AlertSendRequestCommandTest.java | 7 +-
.../alert/AlertSendResponseCommandTest.java | 7 +-
.../command/cache/CacheExpireCommandTest.java | 7 +-
.../remote/command/future/ResponseFutureTest.java | 7 +-
.../command/log/GetLogBytesRequestCommandTest.java | 8 +-
.../log/GetLogBytesResponseCommandTest.java | 8 +-
.../log/RemoveTaskLogRequestCommandTest.java | 8 +-
.../log/RemoveTaskLogResponseCommandTest.java | 8 +-
.../command/log/RollViewLogRequestCommandTest.java | 8 +-
.../dolphinscheduler/remote/utils/HostTest.java | 10 +-
.../org/apache/dolphinscheduler/rpc/RpcTest.java | 10 +-
dolphinscheduler-service/pom.xml | 72 ++-
.../service/expand/CuringGlobalParams.java | 33 +-
.../dolphinscheduler/service/log/LogClient.java | 2 +-
.../service/log/LoggerRequestProcessor.java | 2 +-
.../dolphinscheduler/service}/model/TaskNode.java | 19 +-
.../service}/process/ProcessDag.java | 4 +-
.../service/process/ProcessService.java | 2 +-
.../service/process/ProcessServiceImpl.java | 31 +-
.../service}/storage/StorageOperate.java | 9 +-
.../service/storage}/StoreConfiguration.java | 9 +-
.../service/storage/impl}/HadoopUtils.java | 19 +-
.../service/storage/impl}/OssOperator.java | 5 +-
.../service/storage/impl}/S3Utils.java | 67 +--
.../service}/utils/CommonUtils.java | 42 +-
.../dolphinscheduler/service/utils/Constants.java | 44 ++
.../dolphinscheduler/service}/utils/DagHelper.java | 10 +-
.../service}/utils/LoggerUtils.java | 27 +-
.../service/utils/ProcessData.java | 31 +-
.../service/utils/ProcessUtils.java | 5 +-
.../service/alert/AlertClientServiceTest.java | 39 +-
.../service/alert/ProcessAlertManagerTest.java | 17 +-
.../service/cache/CacheNotifyServiceTest.java | 24 +-
.../service/cron/CronUtilsTest.java | 92 ++--
.../expand/CuringGlobalParamsServiceTest.java | 42 +-
.../TimePlaceholderResolverExpandServiceTest.java | 18 +-
.../service/log/LogClientTest.java | 29 +-
.../service/log/LoggerRequestProcessorTest.java | 41 +-
.../service/log/MasterLogFilterTest.java | 10 +-
.../service/log/SensitiveDataConverterTest.java | 17 +-
.../service/log/TaskLogDiscriminatorTest.java | 20 +-
.../service/log/TaskLogFilterTest.java | 10 +-
.../service/log/WorkerLogFilterTest.java | 10 +-
.../service/process/ProcessServiceTest.java | 197 +++-----
.../queue/PeerTaskInstancePriorityQueueTest.java | 39 +-
.../service/queue/TaskPriorityQueueImplTest.java | 77 ++-
.../service/storage/impl}/HadoopUtilsTest.java | 24 +-
.../service/storage/impl}/OssOperatorTest.java | 82 ++-
.../service}/utils/CommonUtilsTest.java | 34 +-
.../service}/utils/DagHelperTest.java | 113 +++--
.../service/utils/LogUtilsTest.java | 24 +-
.../service/utils/ProcessUtilsTest.java | 35 +-
dolphinscheduler-spi/pom.xml | 32 +-
.../dolphinscheduler/spi/enums/ResUploadType.java | 25 -
.../dolphinscheduler/spi/utils/PropertyUtils.java | 184 -------
.../spi/params/PluginParamsTransferTest.java | 19 +-
.../spi/plugin/PrioritySPIFactoryTest.java | 14 +-
.../dolphinscheduler/spi/utils/JSONUtilsTest.java | 78 ++-
.../spi/utils/StringUtilsTest.java | 37 +-
.../src/main/bin/start.sh | 2 +-
.../src/main/dist-bin/start.sh | 2 +-
.../dolphinscheduler-task-api/pom.xml | 77 +--
.../plugin/task/api/AbstractCommandExecutor.java | 34 +-
.../plugin/task/api/TaskConstants.java | 3 -
.../plugin/task/api/utils/K8sUtils.java | 7 +-
.../plugin/task/api/utils/OSUtils.java | 2 +-
.../plugin/task/api}/utils/ParameterUtils.java | 6 +-
.../plugin/task/api/model}/JSONUtilsTest.java | 129 ++---
.../plugin/task/api}/utils/ParameterUtilsTest.java | 47 +-
.../plugin/task/datasync/DatasyncHook.java | 48 +-
.../plugin/task/datax/DataxUtils.java | 15 +-
.../dolphinscheduler/plugin/task/dms/DmsHook.java | 91 ++--
.../plugin/task/emr/AbstractEmrTask.java | 23 +-
.../plugin/task/jupyter/JupyterTask.java | 2 +-
.../plugin/task/mlflow/MlflowTask.java | 35 +-
.../plugin/task/mlflow/MlflowTaskTest.java | 2 +-
.../dolphinscheduler-task-pigeon/pom.xml | 14 +-
.../plugin/task/sagemaker/SagemakerTask.java | 2 +-
dolphinscheduler-task-plugin/pom.xml | 9 -
.../src/main/bin/upgrade-schema.sh | 2 +-
.../task/components/node/fields/use-datax.ts | 3 +-
dolphinscheduler-worker/pom.xml | 5 -
dolphinscheduler-worker/src/main/bin/start.sh | 2 +-
.../server/worker/WorkerServer.java | 2 +-
.../server/worker/message/MessageRetryRunner.java | 2 +-
.../worker/processor/TaskDispatchProcessor.java | 5 +-
.../processor/TaskExecuteResultAckProcessor.java | 2 +-
.../processor/TaskExecuteRunningAckProcessor.java | 3 +-
.../server/worker/processor/TaskKillProcessor.java | 2 +-
.../worker/processor/TaskRejectAckProcessor.java | 2 +-
.../worker/processor/TaskSavePointProcessor.java | 2 +-
.../DefaultWorkerDelayTaskExecuteRunnable.java | 2 +-
...faultWorkerDelayTaskExecuteRunnableFactory.java | 2 +-
.../runner/WorkerDelayTaskExecuteRunnable.java | 2 +-
.../WorkerDelayTaskExecuteRunnableFactory.java | 2 +-
.../worker/runner/WorkerTaskExecuteRunnable.java | 6 +-
.../WorkerTaskExecuteRunnableFactoryBuilder.java | 2 +-
.../worker/utils/TaskExecutionCheckerUtils.java | 7 +-
.../server/worker/config/BeanConfigTest.java | 13 +-
.../processor/TaskDispatchProcessorTest.java | 16 +-
.../DefaultWorkerDelayTaskExecuteRunnableTest.java | 8 +-
pom.xml | 13 +-
script/env/dolphinscheduler_env.sh | 2 +-
544 files changed, 8335 insertions(+), 6752 deletions(-)
create mode 100644 dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/ProcessTaskRelationV2Controller.java
create mode 100644 dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/controller/TaskDefinitionV2Controller.java
create mode 100644 dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/task/TaskCreateRequest.java
copy dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/{schedule/ScheduleFilterRequest.java => task/TaskFilterRequest.java} (58%)
create mode 100644 dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/task/TaskUpdateRequest.java
create mode 100644 dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/taskRelation/TaskRelationCreateRequest.java
copy dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/{project/ProjectUpdateRequest.java => taskRelation/TaskRelationDeleteRequest.java} (57%)
create mode 100644 dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/taskRelation/TaskRelationFilterRequest.java
copy dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api/dto/{project/ProjectQueryRequest.java => taskRelation/TaskRelationUpdateUpstreamRequest.java} (58%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common => dolphinscheduler-api/src/main/java/org/apache/dolphinscheduler/api}/utils/ClusterConfUtils.java (93%)
delete mode 100644 dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils/placeholder/TimePlaceholderUtilsTest.java
delete mode 100644 dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/entity/ProcessData.java
copy dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/json/DateJsonSerializer.java => dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao/utils/WorkflowUtils.java (54%)
create mode 100644 dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler/dao/utils/WorkflowUtilsTest.java
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service}/model/TaskNode.java (97%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service}/process/ProcessDag.java (94%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service}/storage/StorageOperate.java (95%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/config => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/storage}/StoreConfiguration.java (87%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/storage/impl}/HadoopUtils.java (98%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/storage/impl}/OssOperator.java (98%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common/utils => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/storage/impl}/S3Utils.java (85%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service}/utils/CommonUtils.java (82%)
create mode 100644 dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/utils/Constants.java
rename {dolphinscheduler-dao/src/main/java/org/apache/dolphinscheduler/dao => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service}/utils/DagHelper.java (99%)
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service}/utils/LoggerUtils.java (88%)
copy dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api/parameters/DependentParameters.java => dolphinscheduler-service/src/main/java/org/apache/dolphinscheduler/service/utils/ProcessData.java (57%)
rename {dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils => dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service/storage/impl}/HadoopUtilsTest.java (80%)
rename {dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils => dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service/storage/impl}/OssOperatorTest.java (81%)
rename {dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common => dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service}/utils/CommonUtilsTest.java (75%)
rename {dolphinscheduler-dao/src/test/java/org/apache/dolphinscheduler/dao => dolphinscheduler-service/src/test/java/org/apache/dolphinscheduler/service}/utils/DagHelperTest.java (86%)
delete mode 100644 dolphinscheduler-spi/src/main/java/org/apache/dolphinscheduler/spi/enums/ResUploadType.java
delete mode 100644 dolphinscheduler-spi/src/main/java/org/apache/dolphinscheduler/spi/utils/PropertyUtils.java
rename {dolphinscheduler-common/src/main/java/org/apache/dolphinscheduler/common => dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/main/java/org/apache/dolphinscheduler/plugin/task/api}/utils/ParameterUtils.java (96%)
rename {dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common/utils => dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/test/java/org/apache/dolphinscheduler/plugin/task/api/model}/JSONUtilsTest.java (61%)
rename {dolphinscheduler-common/src/test/java/org/apache/dolphinscheduler/common => dolphinscheduler-task-plugin/dolphinscheduler-task-api/src/test/java/org/apache/dolphinscheduler/plugin/task/api}/utils/ParameterUtilsTest.java (56%)