[jira] [Commented] (BIGTOP-2738) spark-worker fails to start

["Konstantin Boudnik (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964705#comment-15964705 ] 

Konstantin Boudnik commented on BIGTOP-2738:
--------------------------------------------

What other means of the deployment you have in mind [~asanjar]? Bigtop only works with one, effectively. And IIRC spark_env.sh is the standard piece of how spark environment is getting configured. It can be created via different means if you chosen not to use Puppet route. 

> spark-worker fails to start
> ---------------------------
>
>                 Key: BIGTOP-2738
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-2738
>             Project: Bigtop
>          Issue Type: Bug
>          Components: spark
>    Affects Versions: 1.2.0
>            Reporter: Amir Sanjar
>            Priority: Blocker
>             Fix For: 1.2.0
>
>
> Problem is caused by BIGTOP-2490 that assumes only puppet managed orchestration. Thus, breaks other method of deployment .
> Cause of the problem: 
> File bigtop-packages/src/common/spark/spark-worker.svc was changed to look for value $SPARK_MASTER_URL (line 47). This value is defined only in file spark-env.sh (bigtop-deploy/puppet/modules/spark/templates/spark-env.sh) that gets only initialized during puppet deployment.
> https://github.com/apache/bigtop/commit/f627c7868cb1123f6595380a7325f538ebdb8913#diff-90a09a528d21e12a96d209ffc4036f1e
> I propose to remove BIGTOP-2490 and update Bigtop 1.2 repository asap, Hopefully we will have a proper fix soon.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)