You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by haosdent <ha...@gmail.com> on 2014/02/25 03:43:06 UTC

Is it necessary to call setID in SparkHadoopWriter.scala

Hi, folks. I read the spark sources, and couldn't understand why we should
call setID(), setConfParams(), commit() in SparkHadoopWriter.scala. I think
we just need create a RecordWriter and write(k, v). Anything I miss?

-- 
Best Regards,
Haosdent Huang