KafkaWordCount

[Eduardo Costa Alfaia <e....@unibs.it>]

Hi Guys,

I would like to put in the kafkawordcount scala code the kafka parameter:  val kafkaParams = Map(“fetch.message.max.bytes” -> “4000000”). I’ve put this variable like this

val KafkaDStreams = (1 to numStreams) map {_ =>                                                                                                                                                   
        KafkaUtils.createStream(ssc, kafkaParams, zkQuorum, group, topicpMap).map(_._2)


However I’ve gotten these erros:

 (jssc: org.apache.spark.streaming.api.java.JavaStreamingContext,zkQuorum: String,groupId: String,topics: jav                                                         a.util.Map[String,Integer],storageLevel: org.apache.spark.storage.StorageLevel)org.apache.spark.streaming.api.java.Jav                                                            aPairReceiverInputDStream[String,String] <and>                                                                                                                                     
[error]   (ssc: org.apache.spark.streaming.StreamingContext,zkQuorum: String,groupId: String,topics: scala.collection.                                                             
immutable.Map[String,Int],storageLevel: org.apache.spark.storage.StorageLevel)org.apache.spark.streaming.dstream.Recei                                                             
verInputDStream[(String, String)]    

Thanks
-- 
Informativa sulla Privacy: http://www.unibs.it/node/8155