You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Koert Kuipers <ko...@tresata.com> on 2014/07/23 22:04:09 UTC

using shapeless in spark to optimize data layout in memory

hello all,
in case anyone is interested, i just wrote a short blog about using
shapeless in spark to optimize data layout in memory.

blog is here:
http://tresata.com/tresata-open-sources-spark-columnar

code is here:
https://github.com/tresata/spark-columnar