You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by "446463844@qq.com" <44...@qq.com> on 2017/03/28 02:05:01 UTC

spark streaming write orc suddenly slow?

Hi All：
when I use sparking streaming to consume kafka data to stroe in HDFS with orc files format.
it's fast in the beginning,but it's slow in several hours later.
environment:
spark version: 2.1.0
kafka version 0.10.1.1
spark-streaming-kafka jar's version: spark-streaming-kafka-0-8-2.11



446463844@qq.com