You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Peter Lee <le...@gmail.com> on 2021/06/04 01:35:53 UTC
kafka-server log rename error
Whenever I run Kafka server in windows 10, it failed to rename
controller.log to controller.log.time
After several failed attempts, it stops running.
Do you have any idea how to fix this?
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-00].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-01].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-02].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-03].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-04].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-05].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-06].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-07].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-08].
log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
[C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-09].
Re: kafka-server log rename error
Posted by wenbing shen <ol...@gmail.com>.
Hi Peter
You can take a look at this jira id https://issues.apache.org/jira/browse/KAFKA-10886
On 2021/06/04 01:35:53, Peter Lee <le...@gmail.com> wrote:
> Whenever I run Kafka server in windows 10, it failed to rename
> controller.log to controller.log.time
> After several failed attempts, it stops running.
> Do you have any idea how to fix this?
>
>
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-00].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-01].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-02].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-03].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-04].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-05].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-06].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-07].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-08].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-09].
>
Re: kafka-server log rename error
Posted by Meiling He <he...@gmail.com>.
Hi,
I tried to connect to Kafka from Databricks with this code, but I
encountered the error:
Does anyone have an idea how to fix this?
Thanks,
Meiling
*code:*
%scala
import org.apache.kafka.clients.consumer.ConsumerRecord
import org.apache.kafka.common.serialization.StringDeserializer
import org.apache.spark.streaming.kafka010._
import
org.apache.spark.streaming.kafka010.LocationStrategies.PreferConsistent
import org.apache.spark.streaming.kafka010.ConsumerStrategies.Subscribe
import org.apache.spark.{SparkContext, SparkConf}
import org.apache.spark.streaming.{Seconds, StreamingContext}
// val conf = new SparkConf().setAppName(“KafkaTest”).setMaster(“local”)
val conf = new SparkConf().setMaster("local[*]").setAppName("Ingesting Data
from Kafka")
conf.set("spark.streaming.ui.retainedBatches", "5")
conf.set("spark.streaming.backpressure.enabled", "true") // Enable
Back Pressure
val ssc = new StreamingContext(conf, batchDuration = Seconds(5))
// val messages = KafkaUtils.createDirectStream[String, String,
StringDecoder, StringDecoder](ssc, kafkaParams, kafkaTopics)
val kafkaParams = Map[String, Object](
"bootstrap.servers" -> "host1:port1,host2:port2,host3:port3",
"key.deserializer" -> classOf[StringDeserializer],
"value.deserializer" -> classOf[StringDeserializer],
"group.id" -> "use_a_separate_group_id_for_each_stream",
"auto.offset.reset" -> "latest",
"enable.auto.commit" -> (false: java.lang.Boolean)
)
val topics = Array("topicA", "topicB")
val stream = KafkaUtils.createDirectStream[String, String](
StreamingContext,
PreferConsistent, Subscribe[String,
String](topics.toString.split(",").toSet, kafkaParams)
stream.map(record => (record.key, record.value))
display(stream)
*error:* overloaded method value createDirectStream with alternatives:
(jssc:
org.apache.spark.streaming.api.java.JavaStreamingContext,locationStrategy:
org.apache.spark.streaming.kafka010.LocationStrategy,consumerStrategy:
org.apache.spark.streaming.kafka010.ConsumerStrategy[String,String],perPartitionConfig:
org.apache.spark.streaming.kafka010.PerPartitionConfig)org.apache.spark.streaming.api.java.JavaInputDStream[org.apache.kafka.clients.consumer.ConsumerRecord[String,String]]
<and>
(jssc:
org.apache.spark.streaming.api.java.JavaStreamingContext,locationStrategy:
org.apache.spark.streaming.kafka010.LocationStrategy,consumerStrategy:
org.apache.spark.streaming.kafka010.ConsumerStrategy[String,String])org.apache.spark.streaming.api.java.JavaInputDStream[org.apache.kafka.clients.consumer.ConsumerRecord[String,String]]
<and>
(ssc: org.apache.spark.streaming.StreamingContext,locationStrategy:
org.apache.spark.streaming.kafka010.LocationStrategy,consumerStrategy:
org.apache.spark.streaming.kafka010.ConsumerStrategy[String,String],perPartitionConfig:
org.apache.spark.streaming.kafka010.PerPartitionConfig)org.apache.spark.streaming.dstream.InputDStream[org.apache.kafka.clients.consumer.ConsumerRecord[String,String]]
<and>
(ssc: org.apache.spark.streaming.StreamingContext,locationStrategy:
org.apache.spark.streaming.kafka010.LocationStrategy,consumerStrategy:
org.apache.spark.streaming.kafka010.ConsumerStrategy[String,String])org.apache.spark.streaming.dstream.InputDStream[org.apache.kafka.clients.consumer.ConsumerRecord[String,String]]
cannot be applied to (org.apache.spark.streaming.StreamingContext.type,
org.apache.spark.streaming.kafka010.LocationStrategy,
org.apache.spark.streaming.kafka010.ConsumerStrategy[String,String])
val stream = KafkaUtils.createDirectStream[String, String](
On Fri, Jun 4, 2021 at 9:47 AM Peter Lee <le...@gmail.com> wrote:
> Whenever I run Kafka server in windows 10, it failed to rename
> controller.log to controller.log.time
> After several failed attempts, it stops running.
> Do you have any idea how to fix this?
>
>
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-00].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-01].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-02].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-03].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-04].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-05].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-06].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-07].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-08].
> log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to
> [C:\kafka_2.13-2.7.0/logs/controller.log.2021-06-04-09].
>