You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by va...@apache.org on 2019/11/08 01:07:32 UTC

[spark] branch master updated (4ec04e5 -> 3641c3d)

This is an automated email from the ASF dual-hosted git repository.

vanzin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 4ec04e5  [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's
     add 3641c3d  [SPARK-21869][SS] Apply Apache Commons Pool to Kafka producer

No new revisions were added by this update.

Summary of changes:
 .../spark/sql/kafka010/CachedKafkaProducer.scala   | 118 +++++-------
 .../sql/kafka010/InternalKafkaConnectorPool.scala  | 210 +++++++++++++++++++++
 .../sql/kafka010/InternalKafkaConsumerPool.scala   | 210 +++------------------
 .../sql/kafka010/InternalKafkaProducerPool.scala   |  68 +++++++
 .../spark/sql/kafka010/KafkaDataConsumer.scala     |   7 +-
 .../spark/sql/kafka010/KafkaDataWriter.scala       |  34 +++-
 .../apache/spark/sql/kafka010/KafkaWriteTask.scala |  20 +-
 .../org/apache/spark/sql/kafka010/package.scala    |  34 +++-
 .../sql/kafka010/CachedKafkaProducerSuite.scala    | 154 +++++++++++----
 ...scala => InternalKafkaConnectorPoolSuite.scala} |   8 +-
 .../sql/kafka010/KafkaDataConsumerSuite.scala      |   6 +-
 .../org/apache/spark/sql/kafka010/KafkaTest.scala  |  10 +-
 .../kafka010/KafkaDataConsumerSuite.scala          |   7 -
 13 files changed, 554 insertions(+), 332 deletions(-)
 create mode 100644 external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaConnectorPool.scala
 create mode 100644 external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/InternalKafkaProducerPool.scala
 rename external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/{InternalKafkaConsumerPoolSuite.scala => InternalKafkaConnectorPoolSuite.scala} (96%)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org