You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@kyuubi.apache.org by GitBox <gi...@apache.org> on 2022/11/21 09:25:11 UTC
[GitHub] [incubator-kyuubi] cfmcgrady commented on pull request #3819: [KYUUBI #3820] [Subtask] [PySpark] Use `_create_shell_session` for pyspark session creation and code improvements
cfmcgrady commented on PR #3819:
URL: https://github.com/apache/incubator-kyuubi/pull/3819#issuecomment-1321751409
logs from spark engine
```
07:54:23.125 SparkTBinaryFrontendHandler-Pool: Thread-1205 INFO ExecutePython: Processing runner's query[b5b05327-c4b6-49f5-b7ed-2a0847605fc7]: INITIALIZED_STATE -> RUNNING_STATE, statement:
print(1)
07:54:23.610 process stderr thread ERROR ExecutePython: Traceback (most recent call last):
07:54:23.610 process stderr thread ERROR ExecutePython: File "/home/runner/work/incubator-kyuubi/incubator-kyuubi/externals/kyuubi-spark-sql-engine/target/tmp/2146635243273334766/execute_python.py", line 238, in <module>
07:54:23.610 process stderr thread ERROR ExecutePython: spark_session = kyuubi_util.get_spark_session()
07:54:23.610 process stderr thread ERROR ExecutePython: File "/home/runner/work/incubator-kyuubi/incubator-kyuubi/externals/kyuubi-spark-sql-engine/target/tmp/2146635243273334766/kyuubi_util.py", line 77, in get_spark_session
07:54:23.610 process stderr thread ERROR ExecutePython: spark = SparkSession._create_shell_session()
07:54:23.610 process stderr thread ERROR ExecutePython: File "/home/runner/work/incubator-kyuubi/incubator-kyuubi/externals/kyuubi-download/target/spark-3.3.1-bin-hadoop3/python/pyspark/sql/session.py", line 667, in _create_shell_session
07:54:23.610 process stderr thread ERROR ExecutePython: return SparkSession.builder.enableHiveSupport().getOrCreate()
07:54:23.610 process stderr thread ERROR ExecutePython: File "/home/runner/work/incubator-kyuubi/incubator-kyuubi/externals/kyuubi-download/target/spark-3.3.1-bin-hadoop3/python/pyspark/sql/session.py", line 269, in getOrCreate
07:54:23.610 process stderr thread ERROR ExecutePython: sc = SparkContext.getOrCreate(sparkConf)
07:54:23.610 process stderr thread ERROR ExecutePython: File "/home/runner/work/incubator-kyuubi/incubator-kyuubi/externals/kyuubi-download/target/spark-3.3.1-bin-hadoop3/python/pyspark/context.py", line 483, in getOrCreate
07:54:23.610 process stderr thread ERROR ExecutePython: SparkContext(conf=conf or SparkConf())
07:54:23.610 process stderr thread ERROR ExecutePython: File "/home/runner/work/incubator-kyuubi/incubator-kyuubi/externals/kyuubi-download/target/spark-3.3.1-bin-hadoop3/python/pyspark/context.py", line 197, in __init__
07:54:23.610 process stderr thread ERROR ExecutePython: self._do_init(
07:54:23.610 process stderr thread ERROR ExecutePython: File "/home/runner/work/incubator-kyuubi/incubator-kyuubi/externals/kyuubi-download/target/spark-3.3.1-bin-hadoop3/python/pyspark/context.py", line 264, in _do_init
07:54:23.610 process stderr thread ERROR ExecutePython: raise RuntimeError("A master URL must be set in your configuration")
07:54:23.610 process stderr thread ERROR ExecutePython: RuntimeError: A master URL must be set in your configuration
07:54:23.629 process watcher thread ERROR ExecutePython: Process has died with 1
```
https://github.com/apache/incubator-kyuubi/actions/runs/3512338329
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@kyuubi.apache.org
For additional commands, e-mail: notifications-help@kyuubi.apache.org