You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@bigtop.apache.org by "Amir Sanjar (JIRA)" <ji...@apache.org> on 2017/04/11 17:40:41 UTC

[jira] [Created] (BIGTOP-2738) spark-worker fails to start

Amir Sanjar created BIGTOP-2738:
-----------------------------------

             Summary: spark-worker fails to start
                 Key: BIGTOP-2738
                 URL: https://issues.apache.org/jira/browse/BIGTOP-2738
             Project: Bigtop
          Issue Type: Bug
          Components: spark
    Affects Versions: 1.2.0
            Reporter: Amir Sanjar
            Priority: Blocker
             Fix For: 1.2.0


Problem is caused by BIGTOP-2490 that assumes only puppet managed orchestration. Thus, breaks other method of deployment .
Cause of the problem: 
File bigtop-packages/src/common/spark/spark-worker.svc was changed to look for value $SPARK_MASTER_URL (line 47). This value is defined only in file spark-env.sh (bigtop-deploy/puppet/modules/spark/templates/spark-env.sh) that gets only initialized during puppet deployment.

https://github.com/apache/bigtop/commit/f627c7868cb1123f6595380a7325f538ebdb8913#diff-90a09a528d21e12a96d209ffc4036f1e

I propose to remove BIGTOP-2490 and update Bigtop 1.2 repository asap, Hopefully we will have a proper fix soon.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)