You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Jeetendra Gangele <ga...@gmail.com> on 2015/04/17 22:02:11 UTC

Need Costom RDD

Hi All

I have an RDD<Ojbect> then I convert it to RDD<Object,Long> with
ZipWithIndex
here Index is Long and its taking 8 bytes Is there any way to make it
Integer?
There is no API available which INT index.
How Can I create Custom RDD so that I takes only 4 bytes for index part?

Also why API is design such a way that index of element it gives second
part of tuple


Regards
j