You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by mo...@apache.org on 2021/08/16 14:43:40 UTC
[incubator-doris] branch master updated (63a0d9d -> b13e512)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from 63a0d9d Add statistics struct and Support manually inject statistics (#6420)
add b13e512 [Feature] Support spark connector sink data to Doris (#6256)
No new revisions were added by this update.
Summary of changes:
.../org/apache/doris/spark}/DorisStreamLoad.java | 41 +++----
.../spark}/exception/StreamLoadException.java | 6 +-
.../org/apache/doris/spark/rest/RestService.java | 75 +++++++++++--
.../apache/doris/spark}/rest/models/Backend.java | 4 +-
.../doris/spark}/rest/models/BackendRow.java | 7 +-
.../doris/spark}/rest/models/RespContent.java | 2 +-
.../doris/spark/sql/DorisSourceProvider.scala | 119 ++++++++++++++++++++-
.../apache/doris/spark/sql/DorisWriterOption.scala | 41 +++++++
.../doris/spark/sql/DorisWriterOptionKeys.scala | 18 ++--
.../doris/spark/sql/DataframeSinkDoris.scala} | 32 ++++--
10 files changed, 275 insertions(+), 70 deletions(-)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink/table => spark-doris-connector/src/main/java/org/apache/doris/spark}/DorisStreamLoad.java (83%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink => spark-doris-connector/src/main/java/org/apache/doris/spark}/exception/StreamLoadException.java (96%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink => spark-doris-connector/src/main/java/org/apache/doris/spark}/rest/models/Backend.java (96%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink => spark-doris-connector/src/main/java/org/apache/doris/spark}/rest/models/BackendRow.java (97%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink => spark-doris-connector/src/main/java/org/apache/doris/spark}/rest/models/RespContent.java (98%)
create mode 100644 extension/spark-doris-connector/src/main/scala/org/apache/doris/spark/sql/DorisWriterOption.scala
copy be/src/olap/memory/row_block.cpp => extension/spark-doris-connector/src/main/scala/org/apache/doris/spark/sql/DorisWriterOptionKeys.scala (76%)
copy extension/spark-doris-connector/src/{main/scala/org/apache/doris/spark/sql/DorisSourceProvider.scala => test/scala/org/apache/doris/spark/sql/DataframeSinkDoris.scala} (55%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org