[GitHub] [spark] ijuma commented on pull request #34089: [SPARK-36837][BUILD] Upgrade Kafka to 3.1.0

[GitBox <gi...@apache.org>]

ijuma commented on pull request #34089:
URL: https://github.com/apache/spark/pull/34089#issuecomment-1034027323


   @dongjoon-hyun We have no stability concerns and companies like Confluent have been running Apache Kafka 3.x in production for several months. A few notes:
   
   1. @mimaison has volunteered to do the 3.0.1 release a couple of days ago. He can clarify the timeline he's aiming for.
   2. Apache Kafka 3.0.0 removed deprecated methods/configs that had been deprecated for ~2 years or more. Details here: https://kafka.apache.org/documentation/#upgrade_300_notable
   3. The default acks configuration for the producer was changed from `1` to `all`.
   4. Idempotence was supposed to have been enabled by default in 3.0.0/3.1.0, but due to a bug it will only be enabled by default in 3.0.1/3.1.1.
   
   When is the next Spark release planned for?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org