You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Debasish Das <de...@gmail.com> on 2014/03/27 04:33:17 UTC

Spark preferred compression format

Hi,

What's the splittable compression format that works with Spark right now ?

We are looking into bzip2 / lzo / gzip...gzip is not splittable so not a
good option....Within bzip2/lzo I am confused.

Thanks.
Deb