[SPARK SQL] Spark Thrift server, It is not releasing memory.

[Ramakrishna Chilaka <ra...@nference.net.INVALID>]

Hi,
After some heavy usage, spark thrift server is not releasing memory and
when i enabled gc logging. Here is the output from GC Log.

```
2022-05-25T06:34:50.577+0000: 581403.163: [Full GC (System.gc())
 8322M->8224M(26312M), 10.8605086 secs]
   [Eden: 104.0M(14784.0M)->0.0B(14784.0M) Survivors: 0.0B->0.0B Heap:
8323.0M(26312.0M)->8224.9M(26312.0M)], [Metaspace:
211003K->211003K(225280K)]
 [Times: user=18.11 sys=0.00, real=10.86 secs]
2022-05-25T06:39:50.577+0000: 581703.163: [Full GC (System.gc())
 8328M->8224M(26312M), 10.8777197 secs]
   [Eden: 112.0M(14784.0M)->0.0B(14784.0M) Survivors: 0.0B->0.0B Heap:
8328.9M(26312.0M)->8224.9M(26312.0M)], [Metaspace:
211003K->211003K(225280K)]
 [Times: user=18.21 sys=0.00, real=10.88 secs]
2022-05-25T06:44:50.577+0000: 582003.163: [Full GC (System.gc())
 8325M->8224M(26312M), 10.8945603 secs]
   [Eden: 104.0M(14784.0M)->0.0B(14784.0M) Survivors: 0.0B->0.0B Heap:
8325.5M(26312.0M)->8224.9M(26312.0M)], [Metaspace:
211003K->211003K(225280K)]
 [Times: user=18.31 sys=0.00, real=10.90 secs]
```
GC options are as follows: --conf
spark.driver.extraJavaOptions=-XX:+UseG1GC -XX:+UnlockDiagnosticVMOptions
-XX:+G1SummarizeConcMark -XX:InitiatingHeapOccupancyPercent=35 -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps

spark.ui.enabled is false, and also disabled operationLog.

Kindly, Can you please help ?

Thanks.

-- 
CONFIDENTIALITY NOTICE: This E-Mail is intended only for the individual or 
entity to which it is addressed and may contain information that is 
confidential. If you have received this communication in error, do not 
distribute. Please delete the original message and immediately notify the 
sender.