You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/05/05 02:44:38 UTC

[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #14050: [Bug] [Module Name] Flink job run wrong when use ParameterTool && mysql tool

github-actions[bot] commented on issue #14050:
URL: https://github.com/apache/dolphinscheduler/issues/14050#issuecomment-1535629179

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   i run mysql code in local ,i find that can run success.but when i substr job on dolphinscheduer,it going wrong
   master log error:
   `[ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1005] - [WorkflowInstance-166][TaskInstance-0] - Submit standby task Flink_test error, taskCode: 9438047879392
   java.lang.NullPointerException: null
   [ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1005] - [WorkflowInstance-165][TaskInstance-0] - Submit standby task Flink_test error, taskCode: 9438047879392
   java.lang.NullPointerException: null
   [INFO] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1821] - [WorkflowInstance-168][TaskInstance-0] - The dependResult of task Flink_test is success, so ready to submit to execute
   [ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1005] - [WorkflowInstance-167][TaskInstance-0] - Submit standby task Flink_test error, taskCode: 9438047879392
   java.lang.NullPointerException: null
   [INFO] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1821] - [WorkflowInstance-164][TaskInstance-0] - The dependResult of task Flink_test is success, so ready to submit to execute
   [ERROR] 2023-05-05 02:33:27.957 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[694] - [WorkflowInstance-0][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
           at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
           at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1832)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1352)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:688)`
         
   
   and dolp's web also have a bad situiction,
   
   
          
   <img width="1059" alt="截屏2023-05-05 上午10 40 55" src="https://user-images.githubusercontent.com/34538205/236367297-651570fe-d207-49b5-a687-f04fc45b3ff1.png">
   this 工作流实例, always running and when kill it happend to 'READY KILL',but 任务实例, have nothing,
   please help!
   
   ### What you expected to happen
   
   mysql flink code can run in local idea,
   `package com.flink.doris.demo;
   import com.flink.doris.demo.utils.SourceMysql_get_data_user;
   import org.apache.flink.api.java.ExecutionEnvironment;
   import org.apache.flink.api.java.utils.ParameterTool;
   
   import java.time.LocalDate;
   import java.util.HashMap;
   
   public class test {
       public static void main(String[] args) throws Exception {
   //        ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();
           System.out.println("------------------------");
           ParameterTool parameterTool = ParameterTool.fromArgs(args);
           System.out.println("打印参数----" + parameterTool.toString());
           System.out.println("*******3333***********" + parameterTool.getProperties());
           String cs = String.valueOf(parameterTool.getProperties());
           String cs_tool=cs.replace("{path=","").replace("}","");
           LocalDate date = LocalDate.parse(cs_tool);
           LocalDate previousDay = date.minusDays(1);
           String previousDayStr = previousDay.toString();
           System.out.println(previousDayStr+"<__>"+cs_tool);
           HashMap<String,String> value_get = SourceMysql_get_data_user.getDays(previousDayStr,cs_tool);
           System.out.println("max-id---------> " + value_get.get("id最大值") );
           System.out.println("min-id---------> " + value_get.get("id最小值") );
       }
   }
   
   
   
   ### How to reproduce
   
   help
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   3.1.x
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org