[jira] [Commented] (TOREE-390) Lazily start Spark sessions

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TOREE-390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040785#comment-16040785 ] 

ASF GitHub Bot commented on TOREE-390:
--------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/incubator-toree/pull/109


> Lazily start Spark sessions
> ---------------------------
>
>                 Key: TOREE-390
>                 URL: https://issues.apache.org/jira/browse/TOREE-390
>             Project: TOREE
>          Issue Type: Improvement
>            Reporter: Ryan Blue
>
> In our deployment, more than half of the startup time for a Toree notebook is taken by starting a Spark session and waiting for containers. Lazily starting Spark sessions helps the notebook environment feel faster, even if the user is waiting on Spark to start up because the time waiting for Spark to start is clearly Spark, not Toree, and is initiated by the user.
> Also, lazily starting a Spark session allows users to change settings that can't be changed in a Spark context. It also enables the same startup code that would be used in a spark-submit application:
> {code:lang=java}
> SparkSession.builder
>     .config(...)
>     .setAppName(...)
>     .getOrCreate()
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)