You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by mo...@apache.org on 2021/09/26 03:59:21 UTC
[incubator-doris] branch branch-0.15 updated (9c0c129 -> 11ec38d)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-0.15
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
discard 9c0c129 [Bug] Fix some memory bugs (#6699)
add 521fb15 [Bug] Fix some memory bugs (#6699)
add 5c45e26 Fixed zone map init error for string type (#6667)
add 840a7ef Fix a typo (#6688)
add bdc8c98 [Outfile] Support hdfs in select outfile clause (#6644)
add a52104f [Bug] Fix bug that DROP SCHEMA will forcibly database (#6729)
add f49362b [Demo] Add Spark-Doris-Sink demo (#6570)
add 39fd839 [Bug] fix backup bug when comparisons case sensitive (#6648)
add 68529d2 [Flink] Fix bug of flink doris connector (#6655)
add af771be [Improvement] Try to finish transaction if all backends of unfinished tasks have been dead (#6662)
add e03b74e [Doc] Add the error code document of returned by the OLAP function on the BE side (#6666)
add f73af47 [HTTP API] Add aggregation type information in table schema api (#6686)
add 56031cb [Doc] Change CN/EN sql-functions single quote in markdown (#6698)
add 36d6788 [Optimize] Use compact mode to send query plan thrift data structure. (#6702)
add 537a542 [Bugs] Fix the bugs list of sync job (#6705)
add e5a4172 [Bug][Docs]Fix outfile docs for parquet (#6709)
add ec777aa [DOCS] improve docs (#6718)
add f3d4c47 [DOC] Add connection reset exception solution (#6733)
add a121124 [Doc] Update doris-on-es.md (#6734)
add ce7f9be [Bug][bdbje] handle bdb rollbackexception (#6582)
add 11ec38d [Bug] When using view, make toSql method generates the final sql (#6736)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9c0c129)
\
N -- N -- N refs/heads/branch-0.15 (11ec38d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/common/config.h | 11 -
be/src/exec/CMakeLists.txt | 1 +
be/src/exec/hdfs_writer.cpp | 173 ++++++++++++++
be/src/exec/{s3_writer.h => hdfs_writer.h} | 42 ++--
be/src/exec/olap_scan_node.cpp | 17 +-
be/src/olap/field.h | 20 +-
be/src/runtime/file_result_writer.cpp | 5 +-
be/src/runtime/result_file_sink.cpp | 14 +-
be/src/runtime/tuple.cpp | 13 +-
be/src/service/internal_service.cpp | 9 +-
be/src/service/internal_service.h | 2 +-
docs/.vuepress/sidebar/en.js | 1 +
docs/.vuepress/sidebar/zh-CN.js | 1 +
docs/en/administrator-guide/config/fe_config.md | 7 +
.../http-actions/fe/table-schema-action.md | 6 +-
.../load-data/stream-load-manual.md | 27 ++-
.../operation/be-olap-error-code.md | 256 ++++++++++++++++++++
docs/en/administrator-guide/outfile.md | 66 ++++-
docs/en/installing/install-deploy.md | 6 +-
.../sql-functions/date-time-functions/curdate.md | 2 +-
.../date-time-functions/date_format.md | 2 +-
.../sql-functions/date-time-functions/datediff.md | 2 +-
.../sql-functions/date-time-functions/dayname.md | 2 +-
.../date-time-functions/dayofmonth.md | 2 +-
.../sql-functions/date-time-functions/dayofweek.md | 2 +-
.../sql-functions/date-time-functions/dayofyear.md | 2 +-
.../sql-functions/date-time-functions/month.md | 2 +-
.../sql-functions/date-time-functions/monthname.md | 2 +-
.../sql-functions/date-time-functions/now.md | 2 +-
.../date-time-functions/str_to_date.md | 2 +-
.../sql-functions/date-time-functions/timediff.md | 2 +-
.../sql-functions/date-time-functions/to_days.md | 2 +-
.../date-time-functions/weekofyear.md | 2 +-
.../sql-functions/spatial-functions/st_astext.md | 2 +-
.../spatial-functions/st_geometryfromtext.md | 2 +-
.../spatial-functions/st_linefromtext.md | 2 +-
.../sql-functions/spatial-functions/st_polygon.md | 2 +-
.../sql-functions/string-functions/bit_length.md | 2 +-
.../sql-functions/string-functions/concat_ws.md | 2 +-
.../string-functions/get_json_double.md | 2 +-
.../sql-functions/string-functions/get_json_int.md | 2 +-
.../string-functions/get_json_string.md | 2 +-
.../sql-functions/string-functions/instr.md | 2 +-
.../sql-functions/string-functions/left.md | 2 +-
.../sql-functions/string-functions/length.md | 2 +-
.../sql-functions/string-functions/locate.md | 2 +-
.../sql-functions/string-functions/lower.md | 2 +-
.../sql-functions/string-functions/lpad.md | 2 +-
.../sql-functions/string-functions/ltrim.md | 2 +-
.../sql-functions/string-functions/money_format.md | 2 +-
.../sql-functions/string-functions/repeat.md | 2 +-
.../sql-functions/string-functions/right.md | 2 +-
.../sql-functions/string-functions/rpad.md | 2 +-
.../sql-functions/string-functions/split_part.md | 2 +-
.../sql-functions/string-functions/strleft.md | 2 +-
.../sql-functions/string-functions/strright.md | 2 +-
docs/zh-CN/administrator-guide/config/fe_config.md | 7 +
.../http-actions/fe/table-schema-action.md | 6 +-
.../load-data/stream-load-manual.md | 40 +++-
.../operation/be-olap-error-code.md | 265 +++++++++++++++++++++
docs/zh-CN/administrator-guide/outfile.md | 64 ++++-
docs/zh-CN/extending-doris/doris-on-es.md | 4 +-
.../zh-CN/extending-doris/flink-doris-connector.md | 4 +-
docs/zh-CN/installing/install-deploy.md | 6 +-
.../string-functions/get_json_double.md | 2 +-
.../sql-functions/string-functions/get_json_int.md | 2 +-
.../string-functions/get_json_string.md | 2 +-
.../sql-functions/string-functions/money_format.md | 2 +-
.../string-functions/regexp/regexp_replace.md | 2 +-
.../sql-functions/string-functions/repeat.md | 2 +-
.../flink/table/DorisDynamicOutputFormat.java | 45 ++--
.../flink/table/DorisDynamicTableFactory.java | 165 +++++++------
.../doris/flink/table/DorisDynamicTableSink.java | 28 ++-
fe/fe-core/src/main/cup/sql_parser.cup | 4 +-
.../analysis/AbstractBackupTableRefClause.java | 11 +-
.../apache/doris/analysis/ChannelDescription.java | 2 +-
.../org/apache/doris/analysis/InlineViewRef.java | 19 +-
.../org/apache/doris/analysis/OutFileClause.java | 17 +-
.../apache/doris/analysis/SetOperationStmt.java | 4 +
.../java/org/apache/doris/backup/HDFSStorage.java | 57 +++++
.../java/org/apache/doris/catalog/Catalog.java | 8 +-
.../main/java/org/apache/doris/common/Config.java | 8 +
.../java/org/apache/doris/common/util/LogKey.java | 5 +-
.../apache/doris/http/rest/TableSchemaAction.java | 3 +
.../apache/doris/journal/bdbje/BDBEnvironment.java | 37 +++
.../apache/doris/journal/bdbje/BDBJEJournal.java | 40 +++-
.../org/apache/doris/load/sync/SyncChecker.java | 87 +++----
.../org/apache/doris/load/sync/SyncFailMsg.java | 1 +
.../java/org/apache/doris/load/sync/SyncJob.java | 123 +++++++++-
.../org/apache/doris/load/sync/SyncJobManager.java | 38 ++-
.../org/apache/doris/load/sync/SyncLifeCycle.java | 6 +-
.../doris/load/sync/canal/CanalSyncChannel.java | 77 +++---
.../apache/doris/load/sync/canal/CanalSyncJob.java | 107 ++++++---
.../org/apache/doris/load/sync/model/Data.java | 4 +
.../main/java/org/apache/doris/qe/Coordinator.java | 5 +-
.../java/org/apache/doris/qe/cache/SqlCache.java | 6 +-
.../org/apache/doris/rpc/BackendServiceClient.java | 36 ++-
.../org/apache/doris/rpc/BackendServiceProxy.java | 61 ++---
.../org/apache/doris/task/SyncPendingTask.java | 53 -----
.../doris/transaction/PublishVersionDaemon.java | 16 +-
...etUserPropertyStmtTest.java => BackupTest.java} | 60 ++---
.../org/apache/doris/analysis/SelectStmtTest.java | 84 +++++++
.../java/org/apache/doris/catalog/DropDbTest.java | 32 ++-
.../apache/doris/load/sync/SyncJobManagerTest.java | 58 +++--
.../org/apache/doris/load/sync/SyncJobTest.java | 13 +-
.../doris/load/sync/canal/CanalSyncDataTest.java | 2 +-
.../doris/load/sync/canal/CanalSyncJobTest.java | 6 +-
gensrc/proto/internal_service.proto | 1 +
samples/doris-demo/spark-demo/pom.xml | 21 ++
.../demo/spark/constant/SparkToDorisConstants.java | 21 +-
.../demo/connector/SparkDorisConnectorDemo.java | 53 +++++
.../demo/hdfs/MyForeachPartitionFunction.java | 71 ++++++
.../demo/spark/demo/hdfs/SparkHdfsToDorisDemo.java | 46 ++++
.../spark/demo/kafka/SparkKafkaToDorisDemo.java | 68 ++++++
.../apache/doris/demo/spark/sink/DorisSink.java | 61 +++++
.../doris/demo/spark/util}/DorisStreamLoad.java | 35 +--
.../org/apache/doris/demo/spark/vo/TestVo.java | 20 +-
117 files changed, 2258 insertions(+), 626 deletions(-)
create mode 100644 be/src/exec/hdfs_writer.cpp
copy be/src/exec/{s3_writer.h => hdfs_writer.h} (66%)
create mode 100644 docs/en/administrator-guide/operation/be-olap-error-code.md
create mode 100644 docs/zh-CN/administrator-guide/operation/be-olap-error-code.md
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/backup/HDFSStorage.java
delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/task/SyncPendingTask.java
copy fe/fe-core/src/test/java/org/apache/doris/analysis/{SetUserPropertyStmtTest.java => BackupTest.java} (52%)
copy be/src/exec/empty_set_node.cpp => samples/doris-demo/spark-demo/src/main/java/org/apache/doris/demo/spark/constant/SparkToDorisConstants.java (56%)
create mode 100644 samples/doris-demo/spark-demo/src/main/java/org/apache/doris/demo/spark/demo/connector/SparkDorisConnectorDemo.java
create mode 100644 samples/doris-demo/spark-demo/src/main/java/org/apache/doris/demo/spark/demo/hdfs/MyForeachPartitionFunction.java
create mode 100644 samples/doris-demo/spark-demo/src/main/java/org/apache/doris/demo/spark/demo/hdfs/SparkHdfsToDorisDemo.java
create mode 100644 samples/doris-demo/spark-demo/src/main/java/org/apache/doris/demo/spark/demo/kafka/SparkKafkaToDorisDemo.java
create mode 100644 samples/doris-demo/spark-demo/src/main/java/org/apache/doris/demo/spark/sink/DorisSink.java
copy samples/doris-demo/{flink-demo/src/main/java/org/apache/doris/demo/flink => spark-demo/src/main/java/org/apache/doris/demo/spark/util}/DorisStreamLoad.java (88%)
copy extension/flink-doris-connector/src/main/java/org/apache/doris/flink/deserialization/DorisDeserializationSchema.java => samples/doris-demo/spark-demo/src/main/java/org/apache/doris/demo/spark/vo/TestVo.java (73%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org