You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iotdb.apache.org by xi...@apache.org on 2021/05/13 12:27:40 UTC
[iotdb] branch QueryWithoutNull updated (e82608d -> 89fa7f4)
This is an automated email from the ASF dual-hosted git repository.
xiangweiwei pushed a change to branch QueryWithoutNull
in repository https://gitbox.apache.org/repos/asf/iotdb.git.
from e82608d Fix comments
add 56bed8c [IOTDB-1326] make config files and IoTDBConfig consistent (#3071)
add f585d02 [IOTDB-1220] MQTT example may have timestamp precision issue (#3074)
add 1dd10ca Fix Delete vector data bug (#3076)
add 7148f15 [IOTDB-1132] username, password and rolename shouldn't contains spaces (#3069)
add 7ecccf5 [IOTDB-1293] Message of enable_partition cannot be modified after iotdb started should be more clear (#3075)
add faed0d8 Fix group by month StackOverflow bug (#3070)
add ae77977 fix some spell mistake for iotdb-engine conf (#3077)
add 308e39d JDBC bug - check authority for execute batch (#3059)
add 0452bc3 Improve openid user manual (#3062)
add f4ed918 Fix AuthorizationIT failed caused by #3069 (#3085)
add 5c026bc Fix query multiple subSensors for multiple device timeout bug in cluster (#3087)
add a6401e4 [IOTDB-1319] Trigger module: alert manager sink (#3057)
add ce6945f [IOTDB-1339] optimize TimeoutChangeableTSnappyFramedTransport (#3086)
add 6aa58c1 Print too many useless logs when snapshot occurred loading one tsfile (#3095)
add b98b453 line separator (#3097)
add 13f846a fix some config inconsistent (#3082)
add 9ba36a3 [IOTDB-1306] New memory control strategy (#3060)
add 8cb33d7 Only print last query details while debuging (#3094)
add 8c5bef7 Fixed openid bug (#3073)
add 06ba8b3 Fix for issue # 1804 (Opened by me) (#2278)
add 3f55841 [IOTDB-1344] Deleting Storage Group does not clear the count of time series (#3104)
add 17a2872 [IOTDB-1330]fix the load tsfile bug when the cross multi partition's tsfile only have one page (#3080)
add 05bdd1c Add TsFileSequenceReader getChunkMetadataList method return empty if path not exists (#3109)
add 077bb3c [IOTDB-1212] The given error message is not right when executing `select sin(non_existence) from root.sg1.d1` (#3101)
add c17cfa2 [IOTDB-1345] AlertManagerTest: Bind Address already in use (#3110)
add 4cabbfa [GITHUB-3121] add maven http parameter to avoid maven downloading dependencies timeout in github actions (#3122)
add e43aea6 Fix reduce frequent log printing. (#3114)
add c45fa84 fix link for CSV tool
add 126ebc0 [IOTDB-1345] reuse server in AlertManagerTest (#3124)
add f34cfb3 [IOTDB-1355] Support updating aligned timeseries values when insert partially (#3128)
add 925a2b4 [ISSUE-3132] Replace Bintray repository with JFrog
add 421d35c [IOTDB-1350]Change the log packing time from one hour to one day(#3120)
add 6e88ad7 [IOTDB-1315] ExportCsvTool should support timestamp `yyyy-MM-dd'T'HH:mm:ss.SSSZ` (#3115)
add ca36589 [IOTDB-1286] fix 4 C++ mem-leak points (#2976)
add db71701 [IoTDB-1331] Add transformPath for CMManger (#3105)
add 1594797 Update LICENCE-binary (#3140)
add 8907772 [IOTDB-1348] Last plan not work in cluster mode (#3118)
add e9ada63 [IOTDB-1232][IOTDB-1313] Fix lossing time precision when import csv with unsupported timestamp format (#3142)
add 7a77b3f [IOTDB-1316] The importCsv tool should continue inserting if a part of insertion failed (#3131)
add f4db723 [ISSUE-3089] make it possible for storage groups to have name with hyphen (#3151)
add 1a6118a Fix `merge` command cannot execute compaction task bug (#3152)
add 819b195 Add continuous compaction in level compaction strategy (#2080)
add 19cfcd5 [IOTDB-1352][IOTDB-1353] Rafactor E2E test, add ClusterInfo thrift based API (#3143)
add 215199f Fix code format error
add 7151b7d fix cluster_info_public_port parameter not set in cluster/src/test/resources/ (#3156)
add d6fe7b0 [IOTDB-1366] Refactor MetadataIndex in TsFile for Vector (#3081)
add 55d9260 [IOTDB-1266]SHOW TIMESERIES will only display 2000 timeseries (#2958)
add e4a3e74 Increase the time of timeout in Jenkinsfile to fix website build failed (#3165)
add 0050262 [IOTDB-1357] Compaction use append chunk merge strategy when chunk is already large (#3159)
add 9e56152 [IOTDB-1356] Separate unseq_file_num_in_each_level from selecting candidate file in unseq compaction (#3160)
add 470ea63 [ISSUE-3166] Privilege `CREATE_TIMESERIES` is not stated in the document (#3168)
add 4852dad [IOTDB-1371] Fix NPE when creating aligned timeseries and inserting with mismatched data type (#3164)
add 0ea44c4 Update some badge in README (#3174)
add 6907e34 [IOTDB-1378] Fix MetadataIndexTree constructs error when existing more than one chunks in vector (#3180)
add f6e636b support (#3172)
add 49cd4d1 Fix align by device query locally bugs in cluster module && Fix concurrent query bugs in cluster module (#3183)
add 89fa7f4 Merge master and fix conflicts
No new revisions were added by this update.
Summary of changes:
.github/workflows/client-go.yml | 3 +
.github/workflows/client.yml | 5 +-
.github/workflows/e2e.yml | 3 +
.github/workflows/main-unix.yml | 3 +
.github/workflows/main-win.yml | 3 +
.github/workflows/sonar-coveralls.yml | 3 +
Code Summary.md | 59 ++++
Jenkinsfile | 2 +-
LICENSE-binary | 4 +-
README.md | 5 +-
README_ZH.md | 3 +-
.../antlr4/org/apache/iotdb/db/qp/sql/SqlBase.g4 | 6 +-
cli/pom.xml | 2 +-
.../org/apache/iotdb/tool/AbstractCsvTool.java | 40 ++-
.../main/java/org/apache/iotdb/tool/ExportCsv.java | 2 +-
.../main/java/org/apache/iotdb/tool/ImportCsv.java | 56 +--
client-cpp/src/main/Session.cpp | 11 +-
client-cpp/src/main/Session.h | 16 +-
client-py/README.md | 5 +-
cluster/pom.xml | 12 +-
.../resources/conf/iotdb-cluster.properties | 5 +-
.../java/org/apache/iotdb/cluster/ClusterMain.java | 13 +
.../apache/iotdb/cluster/config/ClusterConfig.java | 17 +-
.../iotdb/cluster/config/ClusterDescriptor.java | 9 +-
.../iotdb/cluster/coordinator/Coordinator.java | 3 +-
.../apache/iotdb/cluster/metadata/CMManager.java | 47 ++-
.../cluster/query/ClusterDataQueryExecutor.java | 5 +-
.../query/last/ClusterLastQueryExecutor.java | 1 +
.../cluster/query/reader/ClusterReaderFactory.java | 12 +-
.../query/reader/mult/RemoteMultSeriesReader.java | 7 +-
.../iotdb/cluster/server/MetaClusterServer.java | 27 +-
.../server/clusterinfo/ClusterInfoServer.java | 65 ++--
.../server/clusterinfo/ClusterInfoServerMBean.java | 6 +-
.../server/clusterinfo/ClusterInfoServiceImpl.java | 71 ++++
.../ClusterInfoServiceThriftHandler.java | 9 +-
.../cluster/server/member/MetaGroupMember.java | 4 +-
.../cluster/utils/nodetool/ClusterMonitor.java | 2 +
.../utils/nodetool/ClusterMonitorMBean.java | 2 +-
.../query/groupby/MergeGroupByExecutorTest.java | 23 +-
.../query/groupby/RemoteGroupByExecutorTest.java | 23 +-
.../server/clusterinfo/ClusterInfoServerTest.java | 73 ++++
.../clusterinfo/ClusterInfoServiceImplTest.java | 98 ++++++
.../cluster/server/member/DataGroupMemberTest.java | 28 +-
.../cluster/server/member/MetaGroupMemberTest.java | 20 +-
.../resources/node1conf/iotdb-cluster.properties | 1 +
.../resources/node2conf/iotdb-cluster.properties | 1 +
.../resources/node3conf/iotdb-cluster.properties | 1 +
compile-tools/pom.xml | 8 +-
docs/UserGuide/API/Programming-Java-Native-API.md | 98 ++++++
.../Administration-Management/Administration.md | 7 +-
docs/UserGuide/Advanced-Features/Alerting.md | 385 +++++++++++++++++++++
docs/UserGuide/Advanced-Features/Triggers.md | 108 ++++++
docs/UserGuide/CLI/Command-Line-Interface.md | 69 +++-
docs/UserGuide/Cluster/Cluster-Setup.md | 9 +
.../Data-Concept/Data-Model-and-Terminology.md | 4 +-
.../DDL-Data-Definition-Language.md | 2 +-
.../UserGuide/API/Programming-Java-Native-API.md | 95 +++++
.../Administration-Management/Administration.md | 5 +-
docs/zh/UserGuide/Advanced-Features/Alerting.md | 385 +++++++++++++++++++++
docs/zh/UserGuide/Advanced-Features/Triggers.md | 107 ++++++
docs/zh/UserGuide/CLI/Command-Line-Interface.md | 75 +++-
docs/zh/UserGuide/Cluster/Cluster-Setup.md | 9 +
.../Data-Concept/Data-Model-and-Terminology.md | 4 +-
.../DDL-Data-Definition-Language.md | 2 +-
example/hadoop/pom.xml | 3 +-
.../java/org/apache/iotdb/mqtt/MQTTClient.java | 1 +
.../org/apache/iotdb/trigger/AlertingExample.java | 107 ++++++
.../apache/iotdb/tsfile/TsFileSequenceRead.java | 5 +
example/udf/pom.xml | 2 +-
hadoop/pom.xml | 2 +-
hive-connector/pom.xml | 5 +-
.../java/org/apache/iotdb/jdbc/IoTDBStatement.java | 14 +-
server/pom.xml | 6 +
.../resources/conf/iotdb-engine.properties | 160 ++++++++-
server/src/assembly/resources/conf/logback.xml | 24 +-
.../iotdb/db/auth/authorizer/OpenIdAuthorizer.java | 3 +-
.../apache/iotdb/db/auth/entity/PrivilegeType.java | 1 +
.../org/apache/iotdb/db/concurrent/ThreadName.java | 3 +-
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 92 +++--
.../org/apache/iotdb/db/conf/IoTDBConfigCheck.java | 4 +
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 19 +
.../org/apache/iotdb/db/engine/StorageEngine.java | 41 ++-
.../db/engine/cache/TimeSeriesMetadataCache.java | 123 ++++++-
.../db/engine/compaction/TsFileManagement.java | 21 +-
.../level/LevelCompactionTsFileManagement.java | 51 +--
.../engine/compaction/utils/CompactionUtils.java | 81 ++++-
.../iotdb/db/engine/flush/MemTableFlushTask.java | 20 +-
.../iotdb/db/engine/memtable/AbstractMemTable.java | 14 +
.../apache/iotdb/db/engine/memtable/IMemTable.java | 4 +
.../db/engine/merge/manage/MergeResource.java | 2 +-
.../db/engine/storagegroup/StorageGroupInfo.java | 6 +-
.../engine/storagegroup/StorageGroupProcessor.java | 65 ++--
.../db/engine/storagegroup/TsFileProcessor.java | 50 +--
.../engine/storagegroup/TsFileProcessorInfo.java | 6 +-
.../db/engine/storagegroup/TsFileResource.java | 26 +-
.../storagegroup/timeindex/DeviceTimeIndex.java | 18 -
.../storagegroup/timeindex/FileTimeIndex.java | 5 -
.../engine/storagegroup/timeindex/ITimeIndex.java | 8 -
.../org/apache/iotdb/db/metadata/MManager.java | 88 +++--
.../org/apache/iotdb/db/metadata/PartialPath.java | 15 +
.../org/apache/iotdb/db/metadata/mnode/MNode.java | 4 +
.../apache/iotdb/db/qp/executor/PlanExecutor.java | 6 +-
.../apache/iotdb/db/qp/physical/sys/ShowPlan.java | 1 -
.../apache/iotdb/db/qp/sql/IoTDBSqlVisitor.java | 2 +-
.../qp/strategy/optimizer/ConcatPathOptimizer.java | 9 +
.../apache/iotdb/db/query/dataset/ShowDataSet.java | 12 +-
.../iotdb/db/query/executor/LastQueryExecutor.java | 41 ++-
.../iotdb/db/query/executor/QueryRouter.java | 6 +-
.../db/query/executor/fill/LastPointReader.java | 51 +--
.../chunk/metadata/DiskChunkMetadataLoader.java | 2 +-
.../query/reader/series/SeriesAggregateReader.java | 2 +-
.../reader/series/SeriesRawDataBatchReader.java | 4 +-
.../iotdb/db/query/reader/series/SeriesReader.java | 13 +-
.../reader/series/SeriesReaderByTimestamp.java | 2 +-
.../query/reader/series/SeriesReaderFactory.java | 94 -----
.../db/query/reader/series/VectorSeriesReader.java | 144 --------
.../org/apache/iotdb/db/rescon/SystemInfo.java | 230 ++++++------
.../org/apache/iotdb/db/service/ServiceType.java | 5 +-
.../org/apache/iotdb/db/service/TSServiceImpl.java | 15 +
.../alertmanager/AlertManagerConfiguration.java | 20 +-
.../db/sink/alertmanager/AlertManagerEvent.java | 123 +++++++
.../db/sink/alertmanager/AlertManagerHandler.java | 83 +++++
.../apache/iotdb/db/tools/TsFileRewriteTool.java | 15 +-
.../db/tools/upgrade/TsFileOnlineUpgradeTool.java | 16 +
.../java/org/apache/iotdb/db/utils/AuthUtils.java | 11 +-
.../org/apache/iotdb/db/utils/FileLoaderUtils.java | 94 ++++-
.../java/org/apache/iotdb/db/utils/MergeUtils.java | 4 +-
.../org/apache/iotdb/db/utils/SchemaUtils.java | 2 +-
.../iotdb/db/utils/datastructure/TVList.java | 31 +-
.../iotdb/db/utils/datastructure/VectorTVList.java | 63 +++-
.../apache/iotdb/db/auth/AuthorityCheckerTest.java | 2 -
.../auth/authorizer/LocalFileAuthorizerTest.java | 6 +-
.../db/auth/role/LocalFileRoleManagerTest.java | 6 +
.../db/auth/user/LocalFileUserManagerTest.java | 16 +
.../db/engine/compaction/CompactionChunkTest.java | 4 +-
.../compaction/LevelCompactionCacheTest.java | 3 +-
.../engine/compaction/LevelCompactionLogTest.java | 3 +-
.../compaction/LevelCompactionMergeTest.java | 83 ++++-
.../compaction/LevelCompactionMoreDataTest.java | 3 +-
.../NoCompactionTsFileManagementTest.java | 4 +-
.../iotdb/db/engine/merge/MergeTaskTest.java | 75 ++++
.../engine/storagegroup/TsFileProcessorTest.java | 12 +-
.../db/integration/IOTDBInsertAlignedValuesIT.java | 78 ++++-
.../iotdb/db/integration/IoTDBGroupByMonthIT.java | 70 +++-
...oTDBLoadExternalTsFileWithTimePartitionIT.java} | 44 ++-
.../iotdb/db/integration/IoTDBSimpleQueryIT.java | 36 ++
.../integration/IoTDBUDTFAlignByTimeQueryIT.java | 16 +
.../db/integration/auth/IoTDBAuthorizationIT.java | 108 +++++-
.../iotdb/db/metadata/MManagerBasicTest.java | 296 ++++++++++++++++
.../org/apache/iotdb/db/script/EnvScriptIT.java | 6 +-
.../org/apache/iotdb/db/sink/AlertManagerTest.java | 328 ++++++++++++++++++
.../apache/iotdb/db/sink/LocalIoTDBSinkTest.java | 3 +-
.../iotdb/db/utils/TsFileRewriteToolTest.java | 57 +++
.../org/apache/iotdb/rpc/RpcTransportFactory.java | 10 +-
.../main/java/org/apache/iotdb/rpc/RpcUtils.java | 4 +-
.../rpc/TimeoutChangeableTFastFramedTransport.java | 8 +-
.../TimeoutChangeableTSnappyFramedTransport.java | 20 +-
spark-tsfile/pom.xml | 2 +-
.../test/java/org/apache/iotdb/db/sql/Cases.java | 149 ++++++++
.../java/org/apache/iotdb/db/sql/ClusterIT.java | 113 +++---
.../java/org/apache/iotdb/db/sql/SingleNodeIT.java | 47 +--
.../iotdb/db/sql/node1/OneNodeClusterIT.java | 54 +++
.../AbstractThreeNodeClusterIT.java} | 63 +---
.../iotdb/db/sql/nodes3/ThreeNodeCluster1IT.java | 10 +-
.../iotdb/db/sql/nodes3/ThreeNodeCluster2IT.java | 16 +-
.../AbstractFiveNodeClusterIT.java} | 89 ++---
.../iotdb/db/sql/nodes5/FiveNodeCluster1IT.java | 10 +-
.../iotdb/db/sql/nodes5/FiveNodeCluster2IT.java | 15 +-
.../iotdb/db/sql/nodes5/FiveNodeCluster4IT.java | 15 +-
.../test/resources/1node/iotdb-cluster.properties | 2 +-
thrift-cluster/src/main/thrift/cluster.thrift | 52 ++-
thrift-sync/pom.xml | 5 -
.../tsfile/common/constant/TsFileConstant.java | 3 +
.../iotdb/tsfile/file/metadata/ChunkMetadata.java | 16 +
.../iotdb/tsfile/file/metadata/IChunkMetadata.java | 6 +
.../tsfile/file/metadata/ITimeSeriesMetadata.java | 3 +
.../file/metadata/MetadataIndexConstructor.java | 54 ++-
.../tsfile/file/metadata/MetadataIndexNode.java | 2 +-
.../tsfile/file/metadata/TimeseriesMetadata.java | 20 +-
.../tsfile/file/metadata/VectorChunkMetadata.java | 24 ++
.../file/metadata/VectorTimeSeriesMetadata.java | 16 +
.../iotdb/tsfile/read/TsFileSequenceReader.java | 97 ++++--
.../tsfile/read/filter/GroupByMonthFilter.java | 17 +-
.../tsfile/v2/read/TsFileSequenceReaderForV2.java | 12 +-
.../iotdb/tsfile/write/chunk/TimeChunkWriter.java | 3 +-
.../iotdb/tsfile/write/chunk/ValueChunkWriter.java | 3 +-
.../iotdb/tsfile/write/writer/TsFileIOWriter.java | 121 +++++--
187 files changed, 5375 insertions(+), 1353 deletions(-)
create mode 100644 Code Summary.md
copy server/src/main/java/org/apache/iotdb/db/service/RPCService.java => cluster/src/main/java/org/apache/iotdb/cluster/server/clusterinfo/ClusterInfoServer.java (55%)
copy server/src/main/java/org/apache/iotdb/db/metrics/source/Source.java => cluster/src/main/java/org/apache/iotdb/cluster/server/clusterinfo/ClusterInfoServerMBean.java (89%)
create mode 100644 cluster/src/main/java/org/apache/iotdb/cluster/server/clusterinfo/ClusterInfoServiceImpl.java
copy server/src/main/java/org/apache/iotdb/db/sync/receiver/SyncServerThriftHandler.java => cluster/src/main/java/org/apache/iotdb/cluster/server/clusterinfo/ClusterInfoServiceThriftHandler.java (84%)
create mode 100644 cluster/src/test/java/org/apache/iotdb/cluster/server/clusterinfo/ClusterInfoServerTest.java
create mode 100644 cluster/src/test/java/org/apache/iotdb/cluster/server/clusterinfo/ClusterInfoServiceImplTest.java
create mode 100644 docs/UserGuide/Advanced-Features/Alerting.md
create mode 100644 docs/zh/UserGuide/Advanced-Features/Alerting.md
create mode 100644 example/trigger/src/main/java/org/apache/iotdb/trigger/AlertingExample.java
delete mode 100644 server/src/main/java/org/apache/iotdb/db/query/reader/series/SeriesReaderFactory.java
delete mode 100644 server/src/main/java/org/apache/iotdb/db/query/reader/series/VectorSeriesReader.java
copy grafana/src/main/java/org/apache/iotdb/web/grafana/dao/BasicDao.java => server/src/main/java/org/apache/iotdb/db/sink/alertmanager/AlertManagerConfiguration.java (71%)
create mode 100644 server/src/main/java/org/apache/iotdb/db/sink/alertmanager/AlertManagerEvent.java
create mode 100644 server/src/main/java/org/apache/iotdb/db/sink/alertmanager/AlertManagerHandler.java
rename server/src/test/java/org/apache/iotdb/db/integration/{IoTDBLoadExternalTsfileWithTimePartitionIT.java => IoTDBLoadExternalTsFileWithTimePartitionIT.java} (82%)
create mode 100644 server/src/test/java/org/apache/iotdb/db/sink/AlertManagerTest.java
create mode 100644 testcontainer/src/test/java/org/apache/iotdb/db/sql/Cases.java
create mode 100644 testcontainer/src/test/java/org/apache/iotdb/db/sql/node1/OneNodeClusterIT.java
copy testcontainer/src/test/java/org/apache/iotdb/db/sql/{ClusterIT.java => nodes3/AbstractThreeNodeClusterIT.java} (58%)
copy server/src/main/java/org/apache/iotdb/db/engine/merge/selector/MergeFileStrategy.java => testcontainer/src/test/java/org/apache/iotdb/db/sql/nodes3/ThreeNodeCluster1IT.java (83%)
copy server/src/main/java/org/apache/iotdb/db/exception/UDFRegistrationException.java => testcontainer/src/test/java/org/apache/iotdb/db/sql/nodes3/ThreeNodeCluster2IT.java (68%)
copy testcontainer/src/test/java/org/apache/iotdb/db/sql/{ClusterIT.java => nodes5/AbstractFiveNodeClusterIT.java} (54%)
copy server/src/main/java/org/apache/iotdb/db/engine/merge/selector/MergeFileStrategy.java => testcontainer/src/test/java/org/apache/iotdb/db/sql/nodes5/FiveNodeCluster1IT.java (82%)
copy server/src/main/java/org/apache/iotdb/db/exception/LoadFileException.java => testcontainer/src/test/java/org/apache/iotdb/db/sql/nodes5/FiveNodeCluster2IT.java (67%)
copy server/src/main/java/org/apache/iotdb/db/exception/LoadFileException.java => testcontainer/src/test/java/org/apache/iotdb/db/sql/nodes5/FiveNodeCluster4IT.java (66%)