You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by GitBox <gi...@apache.org> on 2022/04/25 07:25:51 UTC

[GitHub] [incubator-linkis] LEOPROGRAM opened a new issue, #2029: [Bug] 使用spark2.4.8作为saprk引擎，执行报错

LEOPROGRAM opened a new issue, #2029:
URL: https://github.com/apache/incubator-linkis/issues/2029

   ### Search before asking
   
   - [X] I searched the [issues](https://github.com/apache/incubator-linkis/issues) and found no similar issues.
   
   
   ### Linkis Component
   
   linkis-cg-engineConnplugin
   
   ### What happened + What you expected to happen
   
   ![1650871352(1)](https://user-images.githubusercontent.com/11906632/165039903-e7915039-c6f6-43ae-b46b-e22944512e6d.png)
   执行spark引擎的时候报错，在创建的时候提示没有加载hive相关的类
   
   ### Relevent platform
   
   centos 7.3 CDH6.3.2 spark 2.4.8
   
   ### Reproduction script
   
   
       if (jars.nonEmpty) conf.setJars(jars)
       if (execUri != null) conf.set("spark.executor.uri", execUri)
       if (System.getenv("SPARK_HOME") != null) conf.setSparkHome(System.getenv("SPARK_HOME"))
       conf.set("spark.scheduler.mode", "FAIR")
       info("test.spark.conf====> tostring: " + conf.toDebugString)
   
       val builder = SparkSession.builder.config(conf)
       builder.enableHiveSupport().getOrCreate()
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org

[GitHub] [incubator-linkis] LEOPROGRAM commented on issue #2029: [Bug] 使用spark2.4.8作为saprk引擎，执行报错

Posted by GitBox <gi...@apache.org>.
LEOPROGRAM commented on issue #2029:
URL: https://github.com/apache/incubator-linkis/issues/2029#issuecomment-1109537270

   > Hello, this needs to confirm whether there are hive related Jars in your local Spark
   Is there？
   ![1650963527(1)](https://user-images.githubusercontent.com/11906632/165263209-1192fc17-8c98-4187-ae86-2c3840a52df6.png)
   
   /opt/spark-2.4.8-bin-hadoop2.7/jars


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org

[GitHub] [incubator-linkis] peacewong commented on issue #2029: [Bug] 使用spark2.4.8作为saprk引擎，执行报错

Posted by GitBox <gi...@apache.org>.
peacewong commented on issue #2029:
URL: https://github.com/apache/incubator-linkis/issues/2029#issuecomment-1108473598

   Hello, this needs to confirm whether there are hive related Jars in your local Spark


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org

[GitHub] [incubator-linkis] LEOPROGRAM commented on issue #2029: [Bug] 使用spark2.4.8作为saprk引擎，执行报错

Posted by GitBox <gi...@apache.org>.
LEOPROGRAM commented on issue #2029:
URL: https://github.com/apache/incubator-linkis/issues/2029#issuecomment-1109179438

   > Hello, this needs to confirm whether there are hive related Jars in your local Spark
   
   Thanks. I'll try again.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org

[GitHub] [incubator-linkis] peacewong closed issue #2029: [Bug] 使用spark2.4.8作为saprk引擎，执行报错

Posted by GitBox <gi...@apache.org>.
peacewong closed issue #2029: [Bug] 使用spark2.4.8作为saprk引擎，执行报错
URL: https://github.com/apache/incubator-linkis/issues/2029


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org