You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@livy.apache.org by "Saisai Shao (JIRA)" <ji...@apache.org> on 2018/04/19 08:10:00 UTC

[jira] [Commented] (LIVY-424) Session memory keeps growing as session persists

    [ https://issues.apache.org/jira/browse/LIVY-424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16443705#comment-16443705 ] 

Saisai Shao commented on LIVY-424:
----------------------------------

This seems like a Scala issue, and looks like no way to fix it in the Livy side.

> Session memory keeps growing as session persists
> ------------------------------------------------
>
>                 Key: LIVY-424
>                 URL: https://issues.apache.org/jira/browse/LIVY-424
>             Project: Livy
>          Issue Type: Bug
>          Components: REPL
>    Affects Versions: 0.4.0
>            Reporter: Lauren Spiegel
>            Priority: Major
>         Attachments: commonrootpath.png, leaksuspects.png, suspect1.png, suspect2.png
>
>
> I am using Spark 2.1.1 and Scala 2.11 with Livy. When I have a session open for about an hour or so, I see the memory of the Spark driver growing out of control.  
> I think it is related to this since a session is a spark shell/scala REPL: https://issues.scala-lang.org/browse/SI-4331
> See attached analysis from Eclipse Memory Analyzer Tool.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)