You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by vindhya g <vn...@gmail.com> on 2023/01/05 05:33:38 UTC

Spark Yarn UI shows high usedOnHeapStorageMemory than totalOnHeapStorageMemory

Hi ,
   I am consistently seeing Yarn UI for spark structured streaming app
(2.4.0) showing up usedOnHeapStorageMemory more than totalOnHeapStorageMemory
in executors tab. Same goes with storageMemory.
For example : 65GB/11.5GB
I did not find any  stack-overflow and other forums reporting somethng like
this.
Any help on why this could be the case (or if it is a bug ) would be
appreciated.

PFA screenshots.
[image: Screenshot 2023-01-05 at 10.58.15 AM.png]

Thanks!