You are viewing a plain text version of this content. The canonical link for it is here.

Posted to notifications@linkis.apache.org by GitBox <gi...@apache.org> on 2022/06/01 06:24:00 UTC

[GitHub] [incubator-linkis] utopianet opened a new issue, #2204: [Bug] JDBC plugin NullPointerException

utopianet opened a new issue, #2204:
URL: https://github.com/apache/incubator-linkis/issues/2204

   ### Search before asking
   
   - [X] I searched the [issues](https://github.com/apache/incubator-linkis/issues) and found no similar issues.
   
   
   ### Linkis Component
   
   linkis-cg-engineConnplugin
   
   ### What happened + What you expected to happen
   
   After installing the JDBC engine, upload the MySQL jdbc driver tolinkis-engineconn-plugins/jdbc/
   dist/v4/lib, set JDBC URL, username and password, and then make script error reporting in SRIPT. The attachment is a log, and there is no error reporting information.
   
   mysql_jdbc.jdbc__1654063714651.log：
   2022-06-01 14:10:13.010 INFO Program is substituting variables for you
   2022-06-01 14:10:13.010 INFO Variables substitution ended successfully
   2022-06-01 14:10:13.010 INFO SQL code check has passed
   Job with jobId : IDE_hadoop_jdbc_0 and execID : IDE_hadoop_jdbc_0 submitted 
   2022-06-01 14:10:13.010 INFO You have submitted a new job, script code (after variable substitution) is
   ************************************SCRIPT CODE************************************
   show tables
   ************************************SCRIPT CODE************************************
   2022-06-01 14:10:13.010 INFO Your job is accepted,  jobID is IDE_hadoop_jdbc_0 and taskID is 80 in ServiceInstance(linkis-cg-entrance, dssdev01.gzcb.com.cn:9104). Please wait it to be scheduled
   job is scheduled.
   2022-06-01 14:10:13.010 INFO Your job is Scheduled. Please wait it to run.
   Your job is being scheduled by orchestrator.
   2022-06-01 14:10:13.010 INFO job is running.
   2022-06-01 14:10:13.010 INFO Your job is Running now. Please wait it to complete.
   2022-06-01 14:10:13.010 INFO Job with jobGroupId : 80 and subJobId : 80 was submitted to Orchestrator.
   2022-06-01 14:10:13.010 INFO Background is starting a new engine for you,execId astJob_1_codeExec_1 mark id is mark_1, it may take several seconds, please wait
   2022-06-01 14:10:24.010 INFO EngineConn local log path: ServiceInstance(linkis-cg-engineconn, dssdev02.gzcb.com.cn:41673) /appcom/tmp/hadoop/workDir/a6c84bb2-3b91-4411-894a-0ac78cfaad6f/logs
   Job with execId-IDE_hadoop_jdbc_0 and subJobId : 80 from orchestrator completed with state ErrorExecuteResponse(21304, Task is Failed,errorMsg: NullPointerException: ,null)
   2022-06-01 14:10:24.010 INFO job is completed.
   2022-06-01 14:10:24.010 INFO Task creation time(任务创建时间): 2022-06-01 14:10:13, Task scheduling time(任务调度时间): 2022-06-01 14:10:13, Task start time(任务开始时间): 2022-06-01 14:10:13, Mission end time(任务结束时间): 2022-06-01 14:10:24
   2022-06-01 14:10:24.010 INFO Your mission(您的任务) 80 The total time spent is(总耗时时间为): 11.6 秒
   2022-06-01 14:10:24.010 INFO Sorry. Your job completed with a status Failed. You can view logs for the reason.
   
   stdout：
   Listening for transport dt_socket at address: 37429
   
     .   ____          _            __ _ _
    /\\ / ___'_ __ _ _(_)_ __  __ _ \ \ \ \
   ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
    \\/  ___)| |_)| | | | | || (_| |  ) ) ) )
     '  |____| .__|_| |_|_| |_\__, | / / / /
    =========|_|==============|___/=/_/_/_/
    :: Spring Boot ::        (v2.3.2.RELEASE)
   
   2022-06-01 14:10:17.079 INFO  [main] org.apache.linkis.DataWorkCloudApplication 655 logStartupProfileInfo - The following profiles are active: engineconn
   2022-06-01 14:10:17.114 INFO  [main] org.apache.linkis.DataWorkCloudApplication 87 onApplicationEvent - add config from config server...
   2022-06-01 14:10:17.114 INFO  [main] org.apache.linkis.DataWorkCloudApplication 92 onApplicationEvent - initialize DataWorkCloud spring application...
   2022-06-01 14:10:22.036 INFO  [main] org.apache.linkis.DataWorkCloudApplication 87 onApplicationEvent - add config from config server...
   2022-06-01 14:10:22.036 INFO  [main] org.apache.linkis.DataWorkCloudApplication 92 onApplicationEvent - initialize DataWorkCloud spring application...
   2022-06-01 14:10:22.053 INFO  [main] org.apache.linkis.DataWorkCloudApplication 61 logStarted - Started DataWorkCloudApplication in 6.103 seconds (JVM running for 7.882)
   
   stderr：
   Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=250m; support was removed in 8.0
   Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0
   SLF4J: Class path contains multiple SLF4J bindings.
   SLF4J: Found binding in [jar:file:/appcom/tmp/engineConnPublickDir/fd2bcceb-9b60-450a-86e6-282a428c6c69/v000002/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in [jar:file:/appcom/install/linkis/lib/linkis-commons/public-module/log4j-slf4j-impl-2.17.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
   SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
   log4j:WARN No appenders could be found for logger (org.apache.linkis.common.conf.BDPConfiguration$).
   log4j:WARN Please initialize the log4j system properly.
   log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
   
   engineConnExec.sh：
   #!/bin/bash
   export HADOOP_CONF_DIR="/etc/hadoop/conf"
   export HIVE_CONF_DIR="/etc/hive/conf"
   export JAVA_HOME="/usr/java/jdk1.8.0_181-cloudera"
   export LOG_DIRS="/appcom/tmp/hadoop/workDir/a6c84bb2-3b91-4411-894a-0ac78cfaad6f/logs"
   export ECM_PORT="9102"
   export EUREKA_PREFER_IP="false"
   export USER="hadoop"
   export ECM_HOST="dssdev02.gzcb.com.cn"
   export ENGINECONN_ENVKEYS=""
   export TEMP_DIRS="/appcom/tmp/hadoop/workDir/a6c84bb2-3b91-4411-894a-0ac78cfaad6f/tmp"
   export HADOOP_HOME="/opt/cloudera/parcels/CDH/lib/hadoop"
   export ECM_HOME="/appcom/install/linkis/conf/"
   export PWD="/appcom/tmp/hadoop/workDir/a6c84bb2-3b91-4411-894a-0ac78cfaad6f"
   export RANDOM_PORT="37429"
   export CLASSPATH="${PWD}/conf:/appcom/install/linkis/conf:${PWD}/lib/*:/appcom/install/linkis/lib/linkis-commons/public-module/*:${PWD}"
   ln -sf "/appcom/tmp/engineConnPublickDir/fd2bcceb-9b60-450a-86e6-282a428c6c69/v000002/lib" "/appcom/tmp/hadoop/workDir/a6c84bb2-3b91-4411-894a-0ac78cfaad6f/lib"
   linkis_engineconn_errorcode=$?
   if [ $linkis_engineconn_errorcode -ne 0 ]
   then
     cat ${LOG_DIRS}/stderr
     exit $linkis_engineconn_errorcode
   fi
   ln -sf "/appcom/tmp/engineConnPublickDir/92d82c3a-ee0d-45a9-9243-505b2c6dae36/v000001/conf" "/appcom/tmp/hadoop/workDir/a6c84bb2-3b91-4411-894a-0ac78cfaad6f/conf"
   linkis_engineconn_errorcode=$?
   if [ $linkis_engineconn_errorcode -ne 0 ]
   then
     cat ${LOG_DIRS}/stderr
     exit $linkis_engineconn_errorcode
   fi
   ${JAVA_HOME}/bin/java -server -Xmx1g -Xms1g -XX:+UseG1GC -XX:MaxPermSize=250m -XX:PermSize=128m -Xloggc:${LOG_DIRS}/gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -Dwds.linkis.server.conf=linkis-engineconn.properties -Dwds.linkis.gateway.url=http://dssdev01.gzcb.com.cn:9001 -Dlogging.file=log4j2-engineconn.xml  -DTICKET_ID=a6c84bb2-3b91-4411-894a-0ac78cfaad6f -Djava.io.tmpdir=${TEMP_DIRS} -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=${RANDOM_PORT} -cp ${CLASSPATH} org.apache.linkis.engineconn.launch.EngineConnServer 1> ${LOG_DIRS}/stdout 2>> ${LOG_DIRS}/stderr --engineconn-conf wds.linkis.rm.instance=10 --engineconn-conf wds.linkis.jdbc.connect.max=10 --engineconn-conf label.userCreator=hadoop-IDE --engineconn-conf ticketId=a6c84bb2-3b91-4411-894a-0ac78cfaad6f --engineconn-conf wds.linkis.rm.yarnqueue.memory.max=300G --engineconn-conf label.engineType=jdbc-4 --engineconn-conf wds.linkis.rm.yarnqueue.instance.max=30 --engineconn-conf wds.l
 inkis.jdbc.version=jdbc4 --engineconn-conf wds.linkis.rm.client.memory.max=20G --engineconn-conf wds.linkis.jdbc.password=linkis --engineconn-conf wds.linkis.jdbc.connect.url=jdbc:mysql://cdhdev01.gzcb.com.cn:3306/linkis --engineconn-conf wds.linkis.rm.client.core.max=10 --engineconn-conf wds.linkis.jdbc.username=linkis --engineconn-conf wds.linkis.rm.yarnqueue.cores.max=150 --engineconn-conf user=hadoop --engineconn-conf wds.linkis.rm.yarnqueue=default --spring-conf eureka.client.serviceUrl.defaultZone=http://dssdev01.gzcb.com.cn:20303/eureka/,http://dssdev02.gzcb.com.cn:20303/eureka/ --spring-conf logging.config=classpath:log4j2-engineconn.xml --spring-conf spring.profiles.active=engineconn --spring-conf server.port=41673 --spring-conf spring.application.name=linkis-cg-engineconn
   linkis_engineconn_errorcode=$?
   if [ $linkis_engineconn_errorcode -ne 0 ]
   then
     cat ${LOG_DIRS}/stderr
     exit $linkis_engineconn_errorcode
   fi
   
   ### Relevent platform
   
   centos 7.4
   apache-linkis-1.0.3
   wedatasphere-dss-1.0.1
   mysql-connector-java-5.1.48
   
   ### Reproduction script
   
   show tables
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org

[GitHub] [incubator-linkis] utopianet commented on issue #2204: [Bug] JDBC plugin NullPointerException

Posted by GitBox <gi...@apache.org>.

utopianet commented on issue #2204:
URL: https://github.com/apache/incubator-linkis/issues/2204#issuecomment-1144347916

   已解决


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org

[GitHub] [incubator-linkis] utopianet commented on issue #2204: [Bug] JDBC plugin NullPointerException

Posted by GitBox <gi...@apache.org>.

utopianet commented on issue #2204:
URL: https://github.com/apache/incubator-linkis/issues/2204#issuecomment-1144347426

   使用https://github.com/apache/incubator-linkis/pull/1529/files版本重新编译后已解决，可以正常运行使用。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org

[GitHub] [incubator-linkis] CCweixiao commented on issue #2204: [Bug] JDBC plugin NullPointerException

Posted by GitBox <gi...@apache.org>.

CCweixiao commented on issue #2204:
URL: https://github.com/apache/incubator-linkis/issues/2204#issuecomment-1143625568

   1. 首先需要解决日志不打印问题
   ![image](https://user-images.githubusercontent.com/27730211/171417453-88dc4652-8d10-4ae8-966e-bf0c949e7249.png)
   https://mp.weixin.qq.com/s/vcFge4BNiEuW-7OC3P-yaw
   
   2.驱动类找不到的异常信息输出，不影响引擎启动
   是LOG.error()打出来的，会预先调用Driver.class("驱动")
   驱动列表由参数wds.linkis.jdbc.support.dbs控制，1.2.0里交由用户主动去指定driverClass 配置，这样会更灵活些，
   
   3. 1.0.3中getJdbcAuthType空指针问题，查看PR https://github.com/apache/incubator-linkis/pull/1529/files


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org

[GitHub] [incubator-linkis] utopianet closed issue #2204: [Bug] JDBC plugin NullPointerException

Posted by GitBox <gi...@apache.org>.

utopianet closed issue #2204: [Bug] JDBC plugin NullPointerException
URL: https://github.com/apache/incubator-linkis/issues/2204


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org