You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/10/01 00:06:11 UTC
[GitHub] [spark] vanzin commented on issue #25779: [SPARK-27468][core] Track
correct storage level and mem/disk usage for RDDs.
vanzin commented on issue #25779: [SPARK-27468][core] Track correct storage level and mem/disk usage for RDDs.
URL: https://github.com/apache/spark/pull/25779#issuecomment-536801622
> It also receives droppedMemorySize and let master deal with information of both sizes (memory/disk) which is really confusing
Yeah, I'll have to take a second look at that code, run some more experiments. That's a really awkward API... let me see if there's a way to end up with the correct info without having to change the block manager code.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org