[jira] [Comment Edited] (BIGTOP-1974) Revise SPARK_HOME/conf/spark-env.sh

["YoungWoo Kim (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706091#comment-14706091 ] 

YoungWoo Kim edited comment on BIGTOP-1974 at 8/21/15 2:29 AM:
---------------------------------------------------------------

First PR: Removed deprecated or unused env vars from spark-env.sh
As a result, these vars will remain by default:
{code}
export HADOOP_HOME=${HADOOP_HOME:-/usr/lib/hadoop}
export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-/etc/hadoop/conf}

export SPARK_MASTER_IP=`hostname`
export SPARK_MASTER_WEBUI_PORT=18080
export SPARK_MASTER_PORT=7077
export SPARK_WORKER_PORT=7078
export SPARK_WORKER_WEBUI_PORT=18081
export SPARK_WORKER_DIR=/var/run/spark/work
export SPARK_HISTORY_OPTS="$SPARK_HISTORY_OPTS -Dspark.history.fs.logDirectory=hdfs:///var/log/spark/apps -Dspark.history.ui.port=18082"

export SPARK_LOG_DIR=/var/log/spark

export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:${HADOOP_HOME}/lib/native
{code}



was (Author: warwithin):
First PR: Removed deprecated or unused env vars at spark-env.sh

> Revise SPARK_HOME/conf/spark-env.sh
> -----------------------------------
>
>                 Key: BIGTOP-1974
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1974
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: spark
>    Affects Versions: 1.0.0
>            Reporter: YoungWoo Kim
>             Fix For: 1.1.0
>
>
> Current spark-env.sh is a bit complex; It's not easy to read and edit. It would be nice to have a simplified spark-env.sh



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)