You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/05/05 02:44:38 UTC
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #14050: [Bug] [Module Name] Flink job run wrong when use ParameterTool && mysql tool
github-actions[bot] commented on issue #14050:
URL: https://github.com/apache/dolphinscheduler/issues/14050#issuecomment-1535629179
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
i run mysql code in local ,i find that can run success.but when i substr job on dolphinscheduer,it going wrong
master log error:
`[ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1005] - [WorkflowInstance-166][TaskInstance-0] - Submit standby task Flink_test error, taskCode: 9438047879392
java.lang.NullPointerException: null
[ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1005] - [WorkflowInstance-165][TaskInstance-0] - Submit standby task Flink_test error, taskCode: 9438047879392
java.lang.NullPointerException: null
[INFO] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1821] - [WorkflowInstance-168][TaskInstance-0] - The dependResult of task Flink_test is success, so ready to submit to execute
[ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1005] - [WorkflowInstance-167][TaskInstance-0] - Submit standby task Flink_test error, taskCode: 9438047879392
java.lang.NullPointerException: null
[INFO] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1821] - [WorkflowInstance-164][TaskInstance-0] - The dependResult of task Flink_test is success, so ready to submit to execute
[ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[694] - [WorkflowInstance-0][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1832)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1352)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:688)`
and dolp's web also have a bad situiction,
<img width="1059" alt="截屏2023-05-05 上午10 40 55" src="https://user-images.githubusercontent.com/34538205/236367297-651570fe-d207-49b5-a687-f04fc45b3ff1.png">
this 工作流实例, always running and when kill it happend to 'READY KILL',but 任务实例, have nothing,
please help!
### What you expected to happen
mysql flink code can run in local idea,
`package com.flink.doris.demo;
import com.flink.doris.demo.utils.SourceMysql_get_data_user;
import org.apache.flink.api.java.ExecutionEnvironment;
import org.apache.flink.api.java.utils.ParameterTool;
import java.time.LocalDate;
import java.util.HashMap;
public class test {
public static void main(String[] args) throws Exception {
// ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
System.out.println("------------------------");
ParameterTool parameterTool = ParameterTool.fromArgs(args);
System.out.println("打印参数----" + parameterTool.toString());
System.out.println("*******3333***********" + parameterTool.getProperties());
String cs = String.valueOf(parameterTool.getProperties());
String cs_tool=cs.replace("{path=","").replace("}","");
LocalDate date = LocalDate.parse(cs_tool);
LocalDate previousDay = date.minusDays(1);
String previousDayStr = previousDay.toString();
System.out.println(previousDayStr+"<__>"+cs_tool);
HashMap<String,String> value_get = SourceMysql_get_data_user.getDays(previousDayStr,cs_tool);
System.out.println("max-id---------> " + value_get.get("id最大值") );
System.out.println("min-id---------> " + value_get.get("id最小值") );
}
}
### How to reproduce
help
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org