You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by t3l <t3...@threelights.de> on 2015/10/23 06:13:01 UTC

(SOLVED) Ahhhh... Spark creates >30000 partitions... What can I do?

I was able to solve this by myself. What I did is changing the way spark
computes the partitioning for binary files.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Ahhhh-Spark-creates-30000-partitions-What-can-I-do-tp25140p25170.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org