You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by sr...@apache.org on 2019/09/24 00:26:37 UTC

[spark] branch master updated (c38f459 -> 4513f1c)

This is an automated email from the ASF dual-hosted git repository.

srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from c38f459  [SPARK-29016][BUILD] Update LICENSE and NOTICE for Hive 2.3
     add 4513f1c  [SPARK-26848][SQL][SS] Introduce new option to Kafka source: offset by timestamp (starting/ending)

No new revisions were added by this update.

Summary of changes:
 docs/structured-streaming-kafka-integration.md     |  40 +++++
 .../org/apache/spark/sql/kafka010/JsonUtils.scala  |  24 ++-
 .../org/apache/spark/sql/kafka010/KafkaBatch.scala |   4 +-
 .../spark/sql/kafka010/KafkaContinuousStream.scala |   2 +
 .../spark/sql/kafka010/KafkaMicroBatchStream.scala |   2 +
 .../spark/sql/kafka010/KafkaOffsetRangeLimit.scala |   7 +
 .../spark/sql/kafka010/KafkaOffsetReader.scala     | 194 +++++++++++++-------
 .../apache/spark/sql/kafka010/KafkaRelation.scala  |   4 +-
 .../apache/spark/sql/kafka010/KafkaSource.scala    |   2 +
 .../spark/sql/kafka010/KafkaSourceProvider.scala   |  53 ++++--
 .../sql/kafka010/KafkaDataConsumerSuite.scala      |   5 +-
 .../sql/kafka010/KafkaMicroBatchSourceSuite.scala  | 119 ++++++++++++-
 .../spark/sql/kafka010/KafkaRelationSuite.scala    | 198 ++++++++++++++++++++-
 .../apache/spark/sql/kafka010/KafkaTestUtils.scala |  59 ++----
 .../apache/spark/sql/kafka010/RecordBuilder.scala  |  74 ++++++++
 15 files changed, 644 insertions(+), 143 deletions(-)
 create mode 100644 external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/RecordBuilder.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org