You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/07/29 09:59:28 UTC
[GitHub] [dolphinscheduler] quanzhian opened a new issue #5917: [Bug][master-server] 2台master服务同时读取到了command表的同一条命令数据，并同时起了2个相同实例去运行
quanzhian opened a new issue #5917:
URL: https://github.com/apache/dolphinscheduler/issues/5917
**bug描述**
前端点击运行一个工作流，2台master服务同时读取到了command表的同一条命令数据，并同时起了2个相同实例去运行这个工作流
**排查原因**
先查看了api-server的日志，发现只有一次请求(怀疑是否连续点击出现的，经过排查排除该原因)
然后查了2个master的日志，发现同一时间(相差2毫秒级别)同一条command数据被2个master都读取到了
以下是第一台master-server的日志
[INFO] 2021-07-29 15:43:15.022 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 4761, type: START_PROCESS
以下是第二台master-server的日志
[INFO] 2021-07-29 15:43:15.020 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 4761, type: START_PROCESS
2台master-server都做了分发，导致同一时间创建了2条工作流实例去运行！
**Which version of Dolphin Scheduler:**
-[1.3.6]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] quanzhian commented on issue #5917: [Bug][master-server] Two master services read the same command data in the command table at the same time, and set up two identical instances to run at the same time
Posted by GitBox <gi...@apache.org>.
quanzhian commented on issue #5917:
URL: https://github.com/apache/dolphinscheduler/issues/5917#issuecomment-891680107
刚重新跟我们的研发人员确认了下，可能是由于我们这边部署的POC环境与测试环境使用了同一个数据库，但是ZK的root目录设置不一致的问题导致。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] quanzhian commented on issue #5917: [Bug][master-server] Two master services read the same command data in the command table at the same time, and set up two identical instances to run at the same time
Posted by GitBox <gi...@apache.org>.
quanzhian commented on issue #5917:
URL: https://github.com/apache/dolphinscheduler/issues/5917#issuecomment-891664328
> @quanzhian 如果是bug的话，能继续看下这两条工作流是否都继续向下执行了？也许时机最终master继续split 的只有一台机器，能再多提供一下下吗的日志么
2条工作流实例都正确执行了，一个ID是 4225，一个ID是 4226
第一个master节点关键日志如下：
[INFO] 2021-07-29 15:43:15.022 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 4761, type: START_PROCESS
[INFO] 2021-07-29 15:43:15.028 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] - start master exec thread , split DAG ...
[INFO] 2021-07-29 15:43:15.030 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] - prepare process :4226 end
[INFO] 2021-07-29 15:43:15.031 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add task to stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.031 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] - remove task from stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.033 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : oracle-postgresql, instance id:4226, state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.035 org.apache.dolphinscheduler.service.process.ProcessService:[858] - end submit task to db successfully:oracle-postgresql state:SUBMITTED_SUCCESS complete, instance id:4226 state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.037 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] - task ready to submit: TaskInstance{id=5279, name='oracle-postgresql', taskType='QTDI', processDefinitionId=1100, processInstanceId=4226, processInstanceName='null', taskJson='{"conditionResult":"{\"successNode\":[],\"failedNode\":[]}","conditionsTask":false,"depList":[],"dependence":"{}","extras":"{\"targetTable\":\"t_ds_user\",\"sourceDatasourceId\":756,\"sourceTable\":\"T_DS_USER_U\",\"sourceType\":\"oracle\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":748,\"targetType\":\"hive\",\"sourceSchema\":\"INVENTORY\",\"dsTargetDatasourceId\":386,\"targetDatabase\":\"dip_mxl\"}","forbidden":false,"id":"b393040f76bff88728460a683628355a","loc":"","maxRetryTimes":0,"name":"oracle-postgresql","params":"{\"customConfig\":1,\"extra\":{\"targetTable\":\"user_tbl\",\"targetSchema\":\"lzp-schema\",\"sourceTable\":\"T_DS_USER_U\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":
757,\"targetType\":\"postgresql\",\"sourceSchema\":\"INVENTORY\",\"targetDatabase\":\"liuzhipeng\",\"sourceDatasourceId\":756,\"sourceType\":\"oracle\",\"syncWay\":\"full\",\"dsTargetDatasourceId\":395,\"syncType\":\"insert\",\"projectId\":355},\"json\":\"{\\\"job\\\":{\\\"setting\\\":{\\\"speed\\\":{\\\"channel\\\":1,\\\"bytes\\\":0},\\\"errorLimit\\\":{\\\"record\\\":100}},\\\"content\\\":[{\\\"reader\\\":{\\\"parameter\\\":{\\\"customSql\\\":\\\"\\\",\\\"where\\\":\\\"\\\",\\\"splitPk\\\":\\\"\\\",\\\"queryTimeOut\\\":3600,\\\"requestAccumulatorInterval\\\":2,\\\"username\\\":\\\"inventory\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":[\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\"],\\\"table\\\":[\\\"T_DS_USER_U\\\"]}],\\\"column\\\":[{\\\"name\\\":\\\"ID\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"USER_NAME\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"USER_PASSWORD\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"
USER_TYPE\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"EMAIL\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"}]},\\\"name\\\":\\\"oraclereader\\\",\\\"extra\\\":[\\\"ID\\\",\\\"USER_NAME\\\",\\\"USER_PASSWORD\\\",\\\"USER_TYPE\\\",\\\"EMAIL\\\"]},\\\"writer\\\":{\\\"parameter\\\":{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"username\\\":\\\"postgres\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"table\\\":\\\"user_tbl\\\"}],\\\"insertSqlMode\\\":\\\"\\\",\\\"writeMode\\\":\\\"insert\\\",\\\"batchSize\\\":1024,\\\"preSql\\\":[],\\\"postSql\\\":[],\\\"column\\\":[{\\\"name\\\":\\\"id\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"user_name\\\",\\\"type\\\":\\\"varchar(64)\\\"},{\\\"name\\\":\\\"user_password\\\",\\\"type\\\":\\\"varchar(128)\\\"},{\\\"name\\\":\\\"user_type\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"email\\\",\\\"type\\\":\\\"varchar(64)\\\"}]},\\\"na
me\\\":\\\"postgresqlwriter\\\"}}]}}\",\"localParams\":[]}","preTasks":"[]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"interval\":\"\",\"strategy\":\"\"}","type":"QTDI","workerGroup":"default","workerGroupId":0}', state=SUBMITTED_SUCCESS, submitTime=Thu Jul 29 15:43:15 CST 2021, startTime=null, endTime=null, host='null', executePath='null', logPath='null', retryTimes=0, alertFlag=NO, processInstance=null, processDefine=null, pid=0, appLink='null', flag=YES, dependency='null', duration=null, maxRetryTimes=0, retryInterval=1, taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM, dependentResult='null', workerGroup='default', executorId=8, executorName='null'}
[INFO] 2021-07-29 15:43:15.037 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] - master submit success, task : oracle-postgresql
[INFO] 2021-07-29 15:43:15.038 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] - wait task: process id: 4226, task id:5279, task name:oracle-postgresql complete
[INFO] 2021-07-29 15:43:15.068 org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] - taskAckCommand : TaskExecuteAckCommand{taskInstanceId=5279, startTime=Thu Jul 29 15:43:15 CST 2021, host='172.18.70.220:1234', status=1, logPath='/mnt/services/dolphinscheduler136/logs/1100/4226/5279.log', executePath='/tmp/dolphinscheduler/exec/process/26/1100/4226/5279'}
第二个master节点关键日志如下：
[INFO] 2021-07-29 15:43:15.020 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 4761, type: START_PROCESS
[INFO] 2021-07-29 15:43:15.027 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] - start master exec thread , split DAG ...
[INFO] 2021-07-29 15:43:15.028 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] - prepare process :4225 end
[INFO] 2021-07-29 15:43:15.029 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add task to stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.029 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] - remove task from stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.031 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : oracle-postgresql, instance id:4225, state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.033 org.apache.dolphinscheduler.service.process.ProcessService:[858] - end submit task to db successfully:oracle-postgresql state:SUBMITTED_SUCCESS complete, instance id:4225 state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.035 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] - task ready to submit: TaskInstance{id=5278, name='oracle-postgresql', taskType='QTDI', processDefinitionId=1100, processInstanceId=4225, processInstanceName='null', taskJson='{"conditionResult":"{\"successNode\":[],\"failedNode\":[]}","conditionsTask":false,"depList":[],"dependence":"{}","extras":"{\"targetTable\":\"t_ds_user\",\"sourceDatasourceId\":756,\"sourceTable\":\"T_DS_USER_U\",\"sourceType\":\"oracle\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":748,\"targetType\":\"hive\",\"sourceSchema\":\"INVENTORY\",\"dsTargetDatasourceId\":386,\"targetDatabase\":\"dip_mxl\"}","forbidden":false,"id":"b393040f76bff88728460a683628355a","loc":"","maxRetryTimes":0,"name":"oracle-postgresql","params":"{\"customConfig\":1,\"extra\":{\"targetTable\":\"user_tbl\",\"targetSchema\":\"lzp-schema\",\"sourceTable\":\"T_DS_USER_U\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":
757,\"targetType\":\"postgresql\",\"sourceSchema\":\"INVENTORY\",\"targetDatabase\":\"liuzhipeng\",\"sourceDatasourceId\":756,\"sourceType\":\"oracle\",\"syncWay\":\"full\",\"dsTargetDatasourceId\":395,\"syncType\":\"insert\",\"projectId\":355},\"json\":\"{\\\"job\\\":{\\\"setting\\\":{\\\"speed\\\":{\\\"channel\\\":1,\\\"bytes\\\":0},\\\"errorLimit\\\":{\\\"record\\\":100}},\\\"content\\\":[{\\\"reader\\\":{\\\"parameter\\\":{\\\"customSql\\\":\\\"\\\",\\\"where\\\":\\\"\\\",\\\"splitPk\\\":\\\"\\\",\\\"queryTimeOut\\\":3600,\\\"requestAccumulatorInterval\\\":2,\\\"username\\\":\\\"inventory\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":[\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\"],\\\"table\\\":[\\\"T_DS_USER_U\\\"]}],\\\"column\\\":[{\\\"name\\\":\\\"ID\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"USER_NAME\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"USER_PASSWORD\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"
USER_TYPE\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"EMAIL\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"}]},\\\"name\\\":\\\"oraclereader\\\",\\\"extra\\\":[\\\"ID\\\",\\\"USER_NAME\\\",\\\"USER_PASSWORD\\\",\\\"USER_TYPE\\\",\\\"EMAIL\\\"]},\\\"writer\\\":{\\\"parameter\\\":{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"username\\\":\\\"postgres\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"table\\\":\\\"user_tbl\\\"}],\\\"insertSqlMode\\\":\\\"\\\",\\\"writeMode\\\":\\\"insert\\\",\\\"batchSize\\\":1024,\\\"preSql\\\":[],\\\"postSql\\\":[],\\\"column\\\":[{\\\"name\\\":\\\"id\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"user_name\\\",\\\"type\\\":\\\"varchar(64)\\\"},{\\\"name\\\":\\\"user_password\\\",\\\"type\\\":\\\"varchar(128)\\\"},{\\\"name\\\":\\\"user_type\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"email\\\",\\\"type\\\":\\\"varchar(64)\\\"}]},\\\"na
me\\\":\\\"postgresqlwriter\\\"}}]}}\",\"localParams\":[]}","preTasks":"[]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"interval\":\"\",\"strategy\":\"\"}","type":"QTDI","workerGroup":"default","workerGroupId":0}', state=SUBMITTED_SUCCESS, submitTime=Thu Jul 29 15:43:15 CST 2021, startTime=null, endTime=null, host='null', executePath='null', logPath='null', retryTimes=0, alertFlag=NO, processInstance=null, processDefine=null, pid=0, appLink='null', flag=YES, dependency='null', duration=null, maxRetryTimes=0, retryInterval=1, taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM, dependentResult='null', workerGroup='default', executorId=8, executorName='null'}
[INFO] 2021-07-29 15:43:15.035 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] - master submit success, task : oracle-postgresql
[INFO] 2021-07-29 15:43:15.036 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] - wait task: process id: 4225, task id:5278, task name:oracle-postgresql complete
[INFO] 2021-07-29 15:43:15.882 org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] - taskAckCommand : TaskExecuteAckCommand{taskInstanceId=5278, startTime=Thu Jul 29 15:43:15 CST 2021, host='172.18.70.241:1234', status=1, logPath='/mnt/services/dolphinscheduler_poc/logs/1100/4225/5278.log', executePath='/tmp/dolphinscheduler/exec/process/26/1100/4225/5278'}
[INFO] 2021-07-29 15:43:45.717 org.apache.dolphinscheduler.server.master.processor.TaskResponseProcessor:[71] - received command : TaskExecuteResponseCommand{taskInstanceId=5278, status=6, endTime=Thu Jul 29 15:43:45 CST 2021, processId=22898, appIds='application_1624943793042_1602'}
[INFO] 2021-07-29 15:43:47.103 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[102] - task :oracle-postgresql id:5278, process id:4225, exec thread completed
[INFO] 2021-07-29 15:43:48.094 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[864] - task :oracle-postgresql, id:5278 complete, state is FAILURE
[INFO] 2021-07-29 15:43:49.096 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[764] - work flow process instance [id: 4225, name:oracle-reader-where-0-1627544595022], state change from RUNNING_EXECUTION to FAILURE, cmd type: START_PROCESS
[INFO] 2021-07-29 15:43:49.101 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[925] - process:4225 end, state :FAILURE
[INFO] 2021-07-29 15:45:18.868 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 4762, type: START_PROCESS
第一个worker节点日志：
[INFO] 2021-07-29 15:43:15.066 org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[110] - received command : TaskExecuteRequestCommand{taskExecutionContext='{"cmdTypeIfComplement":0,"dataxTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"executorId":8,"procedureTaskExecutionContext":{},"processDefineId":1100,"processId":0,"processInstanceId":4226,"projectId":26,"queue":"default","resources":{},"sqlTaskExecutionContext":{"warningGroupId":0},"sqoopTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"taskInstanceId":5279,"taskJson":"{\"conditionResult\":\"{\\\"successNode\\\":[],\\\"failedNode\\\":[]}\",\"conditionsTask\":false,\"depList\":[],\"dependence\":\"{}\",\"extras\":\"{\\\"targetTable\\\":\\\"t_ds_user\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"sourceType\\\":\\\"oracle\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":748,\\\"tar
getType\\\":\\\"hive\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"dsTargetDatasourceId\\\":386,\\\"targetDatabase\\\":\\\"dip_mxl\\\"}\",\"forbidden\":false,\"id\":\"b393040f76bff88728460a683628355a\",\"loc\":\"\",\"maxRetryTimes\":0,\"name\":\"oracle-postgresql\",\"params\":\"{\\\"customConfig\\\":1,\\\"extra\\\":{\\\"targetTable\\\":\\\"user_tbl\\\",\\\"targetSchema\\\":\\\"lzp-schema\\\",\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":757,\\\"targetType\\\":\\\"postgresql\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"targetDatabase\\\":\\\"liuzhipeng\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceType\\\":\\\"oracle\\\",\\\"syncWay\\\":\\\"full\\\",\\\"dsTargetDatasourceId\\\":395,\\\"syncType\\\":\\\"insert\\\",\\\"projectId\\\":355},\\\"json\\\":\\\"{\\\\\\\"job\\\\\\\":{\\\\\\\"setting\\\\\\\":{\\\\\\\"speed\\\\\\\":{\\\\\\\"channel\\\\\\\":1,\\\\\\\"bytes\\\\\\\":0},\\\\\\\"errorLimit\\\\\\\":{\\\\\\\"record\\\\\\\":100}},\
\\\\\\"content\\\\\\\":[{\\\\\\\"reader\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"customSql\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"where\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"splitPk\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"queryTimeOut\\\\\\\":3600,\\\\\\\"requestAccumulatorInterval\\\\\\\":2,\\\\\\\"username\\\\\\\":\\\\\\\"inventory\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":[\\\\\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\\\\\"],\\\\\\\"table\\\\\\\":[\\\\\\\"T_DS_USER_U\\\\\\\"]}],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"ID\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"EMAIL\\\\\
\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"oraclereader\\\\\\\",\\\\\\\"extra\\\\\\\":[\\\\\\\"ID\\\\\\\",\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"EMAIL\\\\\\\"]},\\\\\\\"writer\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"username\\\\\\\":\\\\\\\"postgres\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"table\\\\\\\":\\\\\\\"user_tbl\\\\\\\"}],\\\\\\\"insertSqlMode\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"writeMode\\\\\\\":\\\\\\\"insert\\\\\\\",\\\\\\\"batchSize\\\\\\\":1024,\\\\\\\"preSql\\\\\\\":[],\\\\\\\"postSql\\\\\\\":[],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"id\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_name\\\\\\\",\\\\\
\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_password\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(128)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_type\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"email\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"postgresqlwriter\\\\\\\"}}]}}\\\",\\\"localParams\\\":[]}\",\"preTasks\":\"[]\",\"retryInterval\":1,\"runFlag\":\"NORMAL\",\"taskInstancePriority\":\"MEDIUM\",\"taskTimeoutParameter\":{\"enable\":false,\"interval\":0},\"timeout\":\"{\\\"enable\\\":false,\\\"interval\\\":\\\"\\\",\\\"strategy\\\":\\\"\\\"}\",\"type\":\"QTDI\",\"workerGroup\":\"default\",\"workerGroupId\":0}","taskName":"oracle-postgresql","taskTimeout":0,"taskTimeoutStrategy":0,"taskType":"QTDI","tenantCode":"dolphinscheduler","workerGroup":"default"}'}
[INFO] 2021-07-29 15:43:15.067 org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[137] - task instance local execute path : /tmp/dolphinscheduler/exec/process/26/1100/4226/5279
[INFO] 2021-07-29 15:43:15.067 org.apache.dolphinscheduler.common.utils.FileUtils:[115] - create dir success /tmp/dolphinscheduler/exec/process/26/1100/4226/5279
[INFO] 2021-07-29 15:43:15.067 - [taskAppId=TASK-1100-4226-5279]:[115] - create dir success /tmp/dolphinscheduler/exec/process/26/1100/4226/5279
[INFO] 2021-07-29 15:43:15.068 org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[107] - script path : /tmp/dolphinscheduler/exec/process/26/1100/4226/5279
第二个worker节点日志：
[INFO] 2021-07-29 15:43:15.880 org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[110] - received command : TaskExecuteRequestCommand{taskExecutionContext='{"cmdTypeIfComplement":0,"dataxTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"executorId":8,"procedureTaskExecutionContext":{},"processDefineId":1100,"processId":0,"processInstanceId":4225,"projectId":26,"queue":"default","resources":{},"sqlTaskExecutionContext":{"warningGroupId":0},"sqoopTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"taskInstanceId":5278,"taskJson":"{\"conditionResult\":\"{\\\"successNode\\\":[],\\\"failedNode\\\":[]}\",\"conditionsTask\":false,\"depList\":[],\"dependence\":\"{}\",\"extras\":\"{\\\"targetTable\\\":\\\"t_ds_user\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"sourceType\\\":\\\"oracle\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":748,\\\"tar
getType\\\":\\\"hive\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"dsTargetDatasourceId\\\":386,\\\"targetDatabase\\\":\\\"dip_mxl\\\"}\",\"forbidden\":false,\"id\":\"b393040f76bff88728460a683628355a\",\"loc\":\"\",\"maxRetryTimes\":0,\"name\":\"oracle-postgresql\",\"params\":\"{\\\"customConfig\\\":1,\\\"extra\\\":{\\\"targetTable\\\":\\\"user_tbl\\\",\\\"targetSchema\\\":\\\"lzp-schema\\\",\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":757,\\\"targetType\\\":\\\"postgresql\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"targetDatabase\\\":\\\"liuzhipeng\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceType\\\":\\\"oracle\\\",\\\"syncWay\\\":\\\"full\\\",\\\"dsTargetDatasourceId\\\":395,\\\"syncType\\\":\\\"insert\\\",\\\"projectId\\\":355},\\\"json\\\":\\\"{\\\\\\\"job\\\\\\\":{\\\\\\\"setting\\\\\\\":{\\\\\\\"speed\\\\\\\":{\\\\\\\"channel\\\\\\\":1,\\\\\\\"bytes\\\\\\\":0},\\\\\\\"errorLimit\\\\\\\":{\\\\\\\"record\\\\\\\":100}},\
\\\\\\"content\\\\\\\":[{\\\\\\\"reader\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"customSql\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"where\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"splitPk\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"queryTimeOut\\\\\\\":3600,\\\\\\\"requestAccumulatorInterval\\\\\\\":2,\\\\\\\"username\\\\\\\":\\\\\\\"inventory\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":[\\\\\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\\\\\"],\\\\\\\"table\\\\\\\":[\\\\\\\"T_DS_USER_U\\\\\\\"]}],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"ID\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"EMAIL\\\\\
\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"oraclereader\\\\\\\",\\\\\\\"extra\\\\\\\":[\\\\\\\"ID\\\\\\\",\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"EMAIL\\\\\\\"]},\\\\\\\"writer\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"username\\\\\\\":\\\\\\\"postgres\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"table\\\\\\\":\\\\\\\"user_tbl\\\\\\\"}],\\\\\\\"insertSqlMode\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"writeMode\\\\\\\":\\\\\\\"insert\\\\\\\",\\\\\\\"batchSize\\\\\\\":1024,\\\\\\\"preSql\\\\\\\":[],\\\\\\\"postSql\\\\\\\":[],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"id\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_name\\\\\\\",\\\\\
\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_password\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(128)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_type\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"email\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"postgresqlwriter\\\\\\\"}}]}}\\\",\\\"localParams\\\":[]}\",\"preTasks\":\"[]\",\"retryInterval\":1,\"runFlag\":\"NORMAL\",\"taskInstancePriority\":\"MEDIUM\",\"taskTimeoutParameter\":{\"enable\":false,\"interval\":0},\"timeout\":\"{\\\"enable\\\":false,\\\"interval\\\":\\\"\\\",\\\"strategy\\\":\\\"\\\"}\",\"type\":\"QTDI\",\"workerGroup\":\"default\",\"workerGroupId\":0}","taskName":"oracle-postgresql","taskTimeout":0,"taskTimeoutStrategy":0,"taskType":"QTDI","tenantCode":"dolphinscheduler","workerGroup":"default"}'}
[INFO] 2021-07-29 15:43:15.881 org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[137] - task instance local execute path : /tmp/dolphinscheduler/exec/process/26/1100/4225/5278
[INFO] 2021-07-29 15:43:15.881 org.apache.dolphinscheduler.common.utils.FileUtils:[115] - create dir success /tmp/dolphinscheduler/exec/process/26/1100/4225/5278
[INFO] 2021-07-29 15:43:15.881 - [taskAppId=TASK-1100-4225-5278]:[115] - create dir success /tmp/dolphinscheduler/exec/process/26/1100/4225/5278
[INFO] 2021-07-29 15:43:15.882 org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[107] - script path : /tmp/dolphinscheduler/exec/process/26/1100/4225/5278
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ruanwenjun commented on issue #5917: [Bug][master-server] Two master services read the same command data in the command table at the same time, and set up two identical instances to run at the same time
Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on issue #5917:
URL: https://github.com/apache/dolphinscheduler/issues/5917#issuecomment-890978762
@quanzhian Please use English.
Can you reproduce this issue? This should not happen.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5917: [Bug][master-server] Two master services read the same command data in the command table at the same time, and set up two identical instances to run at the same time
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5917:
URL: https://github.com/apache/dolphinscheduler/issues/5917#issuecomment-888980886
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] quanzhian closed issue #5917: [Bug][master-server] Two master services read the same command data in the command table at the same time, and set up two identical instances to run at the same time
Posted by GitBox <gi...@apache.org>.
quanzhian closed issue #5917:
URL: https://github.com/apache/dolphinscheduler/issues/5917
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Yao-MR commented on issue #5917: [Bug][master-server] Two master services read the same command data in the command table at the same time, and set up two identical instances to run at the same time
Posted by GitBox <gi...@apache.org>.
Yao-MR commented on issue #5917:
URL: https://github.com/apache/dolphinscheduler/issues/5917#issuecomment-891639771
@quanzhian 如果是bug的话，能继续看下这两条工作流是否都继续向下执行了？也许时机最终master继续split 的只有一台机器，能再多提供一下下吗的日志么
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org