You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "kaishen (JIRA)" <ji...@apache.org> on 2018/11/12 01:19:00 UTC
[jira] [Commented] (LIVY-424) Session memory keeps growing as
session persists
[ https://issues.apache.org/jira/browse/LIVY-424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683105#comment-16683105 ]
kaishen commented on LIVY-424:
------------------------------
I had the same problem, I'm using spark2.3.0 and livy-0.5.0-incubating
> Session memory keeps growing as session persists
> ------------------------------------------------
>
> Key: LIVY-424
> URL: https://issues.apache.org/jira/browse/LIVY-424
> Project: Livy
> Issue Type: Bug
> Components: REPL
> Affects Versions: 0.4.0
> Reporter: Lauren Spiegel
> Priority: Major
> Attachments: commonrootpath.png, leaksuspects.png, suspect1.png, suspect2.png
>
>
> I am using Spark 2.1.1 and Scala 2.11 with Livy. When I have a session open for about an hour or so, I see the memory of the Spark driver growing out of control.
> I think it is related to this since a session is a spark shell/scala REPL: https://issues.scala-lang.org/browse/SI-4331
> See attached analysis from Eclipse Memory Analyzer Tool.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)