You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by madhu phatak <ph...@gmail.com> on 2015/04/01 06:14:08 UTC

Anatomy of RDD : Deep dive into RDD data structure

Hi,
 Recently I gave a talk on RDD data structure which gives in depth
understanding of spark internals. You can watch it on youtube
<https://www.youtube.com/watch?v=WVdyuVwWcBc>. Also slides are on slideshare
<http://www.slideshare.net/datamantra/anatomy-of-rdd> and code is on github
<https://github.com/phatak-dev/anatomy-of-rdd>.



Regards,
Madhukara Phatak
http://datamantra.io/

Re: Anatomy of RDD : Deep dive into RDD data structure

Posted by David Holiday <da...@annaisystems.com>.

w00t - t/y for this! I'm currently doing a deep dive into the RDD memory footprint under various conditions so this is timely and helpful.

DAVID HOLIDAY
Software Engineer
760 607 3300 | Office
312 758 8385 | Mobile
DavidH@AnnaiSystems.com<ma...@AnnaiSystems.com>


[cid:AE39C43E-3FF7-4C90-BCE4-9711C84C4CB8@cld.annailabs.com]
www.AnnaiSystems.com<http://www.AnnaiSystems.com>

On Mar 31, 2015, at 9:14 PM, madhu phatak <ph...@gmail.com>> wrote:

Hi,
 Recently I gave a talk on RDD data structure which gives in depth understanding of spark internals. You can watch it on youtube<https://www.youtube.com/watch?v=WVdyuVwWcBc>. Also slides are on slideshare<http://www.slideshare.net/datamantra/anatomy-of-rdd> and code is on github<https://github.com/phatak-dev/anatomy-of-rdd>.



Regards,
Madhukara Phatak
http://datamantra.io/