[GitHub] [bigtop] guyuqi commented on pull request #984: BIGTOP-3777: Add Spark support for Bigtop 3.1.0 Mpack

[GitBox <gi...@apache.org>]

guyuqi commented on PR #984:
URL: https://github.com/apache/bigtop/pull/984#issuecomment-1219222188

   Thanks for working on it. @timyuer 
   
   After rebuilt Spark (including commits for BIGTOP-3767 and BIGTOP-3776 ),  it still failed to start Spark Thrift Server:
   
   ```
    File "/var/lib/ambari-agent/cache/stacks/BGTP/1.0/services/SPARK/package/scripts/spark_service.py", line 152, in spark_service
       check_process_status(status_params.spark_thrift_server_pid_file)
     File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/check_process_status.py", line 61, in check_process_status
       raise ComponentIsNotRunning()
   ComponentIsNotRunning
   ```
   
   ```
   2022-08-18 08:48:52,081 - Execute['! /usr/lib/spark/bin/beeline -u 'jdbc:hive2://ambari-server:10016/default;transportMode=binary'  -e '' 2>&1| awk '{print}'|grep -i -e 'Connection refused' -e 'Invalid URL' -e 'Error: Could not open''] {'path': ['/usr/lib/spark/bin/beeline'], 'user': 'spark', 'timeout': 60.0}
   2022-08-18 08:48:53,631 - Connection to STS still is not created.
   2022-08-18 08:48:53,631 - Check STS process status.
   2022-08-18 08:48:53,632 - Process with pid 8112 is not running. Stale pid file at /var/run/spark/spark-spark-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1.pid
   
   ```
   
   The Hive and Tez were mandatory to be installed by Mpack.
   Is it possible I missed someting in deployment?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org