You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by va...@apache.org on 2019/11/08 01:07:32 UTC
[spark] branch master updated (4ec04e5 -> 3641c3d)
This is an automated email from the ASF dual-hosted git repository.
vanzin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4ec04e5 [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
add 3641c3d [SPARK-21869][SS] Apply Apache Commons Pool to Kafka producer
No new revisions were added by this update.
Summary of changes:
.../spark/sql/kafka010/CachedKafkaProducer.scala | 118 +++++-------
.../sql/kafka010/InternalKafkaConnectorPool.scala | 210 +++++++++++++++++++++
.../sql/kafka010/InternalKafkaConsumerPool.scala | 210 +++------------------
.../sql/kafka010/InternalKafkaProducerPool.scala | 68 +++++++
.../spark/sql/kafka010/KafkaDataConsumer.scala | 7 +-
.../spark/sql/kafka010/KafkaDataWriter.scala | 34 +++-
.../apache/spark/sql/kafka010/KafkaWriteTask.scala | 20 +-
.../org/apache/spark/sql/kafka010/package.scala | 34 +++-
.../sql/kafka010/CachedKafkaProducerSuite.scala | 154 +++++++++++----
...scala => InternalKafkaConnectorPoolSuite.scala} | 8 +-
.../sql/kafka010/KafkaDataConsumerSuite.scala | 6 +-
.../org/apache/spark/sql/kafka010/KafkaTest.scala | 10 +-
.../kafka010/KafkaDataConsumerSuite.scala | 7 -
13 files changed, 554 insertions(+), 332 deletions(-)
create mode 100644 external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaConnectorPool.scala
create mode 100644 external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaProducerPool.scala
rename external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/{InternalKafkaConsumerPoolSuite.scala => InternalKafkaConnectorPoolSuite.scala} (96%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org