You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iotdb.apache.org by ge...@apache.org on 2020/03/27 02:37:07 UTC
[incubator-iotdb] branch http updated (1d9a2f8 -> c05ea76)
This is an automated email from the ASF dual-hosted git repository.
geniuspig pushed a change to branch http
in repository https://gitbox.apache.org/repos/asf/incubator-iotdb.git.
from 1d9a2f8 Update MetricsSystem.java
add e760b7c init (#888)
add 6df3d43 Use a batched style to get series type (#899)
add 24476a9 add pulications
add 713f6fa add link for IoTDB distributed framework
add 6ba8aa8 Fix a NPE when concat filter with multiple devices (#900)
add 74f1eb9 Release query resource while exception happened in query producer thread (#903)
add 2f61528 fix timegenerator cache bug (#905)
add 40ae1e9 Cheery pick changes from cluster_new (#901)
add 91daeab Merge remote-tracking branch 'origin/master'
add 1cb650f add text support for grafana (#906)
add f9fd91f [IOTDB-538]add a simple connection pool for session api (#880)
add 8681bb2 fix execute flush command while inserting bug (#916)
add a3646a3 [IOTDB-500] Let timeColumn and batchData store time in the same struct (#913)
add 94d95f4 Fix Write Image (#915)
add a92b80c Fix bugs of add duplicated metadata (#918)
add 5a9b84f Fix empty ChunkMetadata in LAST query gives wrong answer bug (#920)
add f94d326 Fix bugs of deleting sg and initing from mlog (#921)
add 9d90f79 add checkout a released branch in readme
add 7dcef6f fix recover deadlock (#927)
add a5cfb37 avoid flushing empty memtable (#926)
add 03fbb9e add write process error code (#928)
add 99310d4 add merge doc (#852)
add d384cb5 add rpc compression api in client and session module (#930)
add 94411e0 Delete dataTypeMapping etc fields in QueryPlan (#934)
add 8b8d4c3 Fix Travis issues about timeout and the socket problem in the Sync module (#940)
add 9fe3895 support Chinese character (#939)
add b1c209d fix downloading pentaho-aggdesigner-algorithm error from maven repo (#941)
add 658f1c0 add system design eng (#938)
add 9c8a6c3 fix sqlArgumentsList concurrent modification error (#932)
add b9d59d9 update quickstart url
add 2938642 modify doc's format to fit the website (#944)
add f6f216e Integrate data file version recording with time partitioning (#935)
add 5394f53 Merge remote-tracking branch 'origin/master'
add 3e77d66 Merge branch 'master' into http
add c05ea76 Update TSServiceImpl.java
No new revisions were added by this update.
Summary of changes:
.travis.yml | 2 +-
README.md | 7 +
.../org/apache/iotdb/client/AbstractClient.java | 21 +-
.../main/java/org/apache/iotdb/client/Client.java | 3 +
.../java/org/apache/iotdb/client/WinClient.java | 3 +
docs/Development/Development-Chinese.md | 2 +-
.../SystemDesign/0-Architecture/1-Architecture.md | 4 +-
.../SystemDesign/1-TsFile/3-Write.md | 6 +-
.../SystemDesign/2-QueryEngine/1-QueryEngine.md | 8 +-
.../4-StorageEngine/1-StorageEngine.md | 21 +-
.../SystemDesign/4-StorageEngine/4-MergeManager.md | 92 ++-
.../4-StorageEngine/6-DataManipulation.md | 6 +-
.../SystemDesign/5-DataQuery/1-DataQuery.md | 14 +-
.../SystemDesign/5-DataQuery/3-RawDataQuery.md | 56 +-
.../SystemDesign/5-DataQuery/5-GroupByQuery.md | 14 +-
.../SystemDesign/7-Connector/2-Hive-TsFile.md | 21 +-
.../UserGuide/0-Get Started/1-QuickStart.md | 38 +-
.../0-Get Started/2-Frequently asked questions.md | 23 +-
.../UserGuide/0-Get Started/3-Publication.md | 3 +-
.../UserGuide/1-Overview/1-What is IoTDB.md | 8 +-
.../UserGuide/1-Overview/2-Architecture.md | 8 +-
.../UserGuide/1-Overview/3-Scenario.md | 16 +-
.../UserGuide/1-Overview/4-Features.md | 8 +-
.../2-Concept/1-Data Model and Terminology.md | 24 +-
.../UserGuide/2-Concept/2-Data Type.md | 9 +-
.../UserGuide/2-Concept/3-Encoding.md | 8 +-
.../UserGuide/2-Concept/4-Compression.md | 10 +-
.../UserGuide/3-Server/1-Download.md | 18 +-
.../UserGuide/3-Server/2-Single Node Setup.md | 8 +-
.../UserGuide/3-Server/3-Cluster Setup.md | 3 +-
.../UserGuide/3-Server/4-Config Manual.md | 20 +-
.../UserGuide/3-Server/5-Docker Image.md | 8 +-
...erface (CLI).md => 1-Command Line Interface.md} | 14 +-
.../4-Client/2-Programming - Native API.md | 55 +-
.../UserGuide/4-Client/3-Programming - JDBC.md | 8 +-
.../4-Client/4-Programming - Other Languages.md | 4 +-
.../4-Client/5-Programming - TsFile API.md | 144 ++---
.../UserGuide/4-Client/6-Status Codes.md | 5 +-
...guage).md => 1-DDL Data Definition Language.md} | 42 +-
...age).md => 2-DML Data Manipulation Language.md} | 23 +-
.../3-Account Management Statements.md | 42 +-
.../5-Operation Manual/4-SQL Reference.md | 28 +-
.../UserGuide/6-System Tools/1-Sync Tool.md | 5 +-
.../6-System Tools/2-Memory Estimation Tool.md | 6 +-
.../UserGuide/6-System Tools/3-JMX Tool.md | 6 +-
.../UserGuide/6-System Tools/4-Watermark Tool.md | 1 -
.../UserGuide/6-System Tools/5-Log Visualizer.md | 15 +-
.../6-Query History Visualization Tool.md | 8 +-
.../6-System Tools/7-Monitor and Log Tools.md | 10 +-
.../6-System Tools/8-Load External Tsfile.md | 6 +-
.../UserGuide/7-Ecosystem Integration/1-Grafana.md | 31 +-
.../7-Ecosystem Integration/2-MapReduce TsFile.md | 7 +-
.../7-Ecosystem Integration/3-Spark TsFile.md | 7 +-
.../7-Ecosystem Integration/4-Spark IoTDB.md | 5 +-
.../7-Ecosystem Integration/5-Hive TsFile.md | 29 +-
.../UserGuide/8-Architecture/1-Files.md | 24 +-
.../8-Architecture/2-Writing Data on HDFS.md | 8 +-
.../8-Architecture/3-Shared Nothing Cluster.md | 10 +-
.../SystemDesign/0-Architecture/1-Architecture.md | 39 +-
.../SystemDesign/1-TsFile/1-TsFile.md | 10 +-
.../Documentation/SystemDesign/1-TsFile/3-Write.md | 46 +-
.../SystemDesign/2-QueryEngine/1-QueryEngine.md | 52 +-
.../SystemDesign/2-QueryEngine/2-Planner.md | 38 +-
.../SystemDesign/2-QueryEngine/3-PlanExecutor.md | 8 +-
.../3-SchemaManager/1-SchemaManager.md | 8 +-
.../4-StorageEngine/1-StorageEngine.md | 68 +++
.../SystemDesign/4-StorageEngine/2-WAL.md | 8 +-
.../SystemDesign/4-StorageEngine/3-FlushManager.md | 84 +++
.../SystemDesign/4-StorageEngine/4-MergeManager.md | 107 ++++
.../4-StorageEngine/5-DataPartition.md | 86 +++
.../4-StorageEngine/6-DataManipulation.md | 95 +++
.../SystemDesign/5-DataQuery/1-DataQuery.md} | 21 +-
.../SystemDesign/5-DataQuery/2-SeriesReader.md | 384 ++++++++++++
.../SystemDesign/5-DataQuery/3-RawDataQuery.md | 303 ++++++++++
.../SystemDesign/5-DataQuery/4-AggregationQuery.md | 114 ++++
.../SystemDesign/5-DataQuery/5-GroupByQuery.md | 260 ++++++++
.../SystemDesign/5-DataQuery/6-LastQuery.md | 43 +-
.../5-DataQuery/7-AlignByDeviceQuery.md | 203 +++++++
docs/Documentation/SystemDesign/6-Tools/1-Sync.md | 249 ++++++++
.../SystemDesign/7-Connector/2-Hive-TsFile.md | 114 ++++
.../SystemDesign/7-Connector/3-Spark-TsFile.md | 89 ++-
.../SystemDesign/7-Connector/4-Spark-IOTDB.md | 70 ++-
docs/Documentation/UserGuide/0-Content.md | 72 ---
.../UserGuide/0-Get Started/1-QuickStart.md | 46 +-
.../0-Get Started/2-Frequently asked questions.md | 26 +-
.../UserGuide/0-Get Started/3-Publication.md | 2 +
.../UserGuide/1-Overview/1-What is IoTDB.md | 8 +-
.../UserGuide/1-Overview/2-Architecture.md | 8 +-
.../UserGuide/1-Overview/3-Scenario.md | 16 +-
.../UserGuide/1-Overview/4-Features.md | 8 +-
.../2-Concept/1-Data Model and Terminology.md | 50 +-
.../UserGuide/2-Concept/2-Data Type.md | 9 +-
.../UserGuide/2-Concept/3-Encoding.md | 9 +-
.../UserGuide/2-Concept/4-Compression.md | 10 +-
.../Documentation/UserGuide/3-Server/1-Download.md | 21 +-
.../UserGuide/3-Server/2-Single Node Setup.md | 8 +-
.../UserGuide/3-Server/3-Cluster Setup.md | 8 +-
.../UserGuide/3-Server/4-Config Manual.md | 22 +-
.../UserGuide/3-Server/5-Docker Image.md | 7 +-
...erface (CLI).md => 1-Command Line Interface.md} | 18 +-
.../4-Client/2-Programming - Native API.md | 76 ++-
.../UserGuide/4-Client/3-Programming - JDBC.md | 1 -
.../4-Client/4-Programming - Other Languages.md | 2 -
.../4-Client/5-Programming - TsFile API.md | 135 +++--
.../UserGuide/4-Client/6-Status Codes.md | 5 +-
...guage).md => 1-DDL Data Definition Language.md} | 38 +-
...age).md => 2-DML Data Manipulation Language.md} | 31 +-
.../3-Account Management Statements.md | 48 +-
.../5-Operation Manual/4-SQL Reference.md | 29 +-
.../UserGuide/6-System Tools/1-Sync Tool.md | 8 +-
.../6-System Tools/2-Memory Estimation Tool.md | 14 +-
.../UserGuide/6-System Tools/3-JMX Tool.md | 6 +-
.../UserGuide/6-System Tools/4-Watermark Tool.md | 2 -
.../UserGuide/6-System Tools/5-Log Visualizer.md | 18 +-
.../6-Query History Visualization Tool.md | 8 +-
.../6-System Tools/7-Monitor and Log Tools.md | 18 +-
.../6-System Tools/8-Load External Tsfile.md | 5 +-
.../UserGuide/7-Ecosystem Integration/1-Grafana.md | 5 +-
.../7-Ecosystem Integration/2-MapReduce TsFile.md | 5 +-
.../7-Ecosystem Integration/3-Spark TsFile.md | 34 +-
.../7-Ecosystem Integration/4-Spark IoTDB.md | 23 +-
.../7-Ecosystem Integration/5-Hive TsFile.md | 10 +-
.../UserGuide/8-Architecture/1-Files.md | 24 +-
.../8-Architecture/2-Writing Data on HDFS.md | 6 +-
.../8-Architecture/3-Shared Nothing Cluster.md | 8 +-
.../main/java/org/apache/iotdb/SessionExample.java | 87 ++-
.../apache/iotdb/web/grafana/bean/TimeValues.java | 6 +-
.../controller/DatabaseConnectController.java | 2 +-
.../iotdb/web/grafana/dao/impl/BasicDaoImpl.java | 17 +-
hive-connector/pom.xml | 16 +
.../main/java/org/apache/iotdb/jdbc/Config.java | 2 +-
.../resources/conf/iotdb-engine.properties | 2 +-
.../org/apache/iotdb/db/qp/strategy/SqlBase.g4 | 9 +-
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 2 +-
.../org/apache/iotdb/db/engine/StorageEngine.java | 59 +-
.../iotdb/db/engine/cache/TsFileMetaDataCache.java | 9 +-
.../iotdb/db/engine/flush/TsFileFlushPolicy.java | 2 +-
.../iotdb/db/engine/memtable/AbstractMemTable.java | 13 +-
.../apache/iotdb/db/engine/memtable/IMemTable.java | 5 +-
.../engine/storagegroup/StorageGroupProcessor.java | 514 ++++++++++------
.../db/engine/storagegroup/TsFileProcessor.java | 53 +-
.../apache/iotdb/db/exception/IoTDBException.java | 5 +
.../db/exception/LoadEmptyFileException.java} | 58 +-
...{MergeException.java => LoadFileException.java} | 10 +-
...ption.java => PartitionViolationException.java} | 10 +-
.../iotdb/db/exception/StorageEngineException.java | 4 +
.../iotdb/db/exception/WriteProcessException.java | 12 +-
.../exception/query/LogicalOperatorException.java | 5 +
.../exception/query/LogicalOptimizeException.java | 5 +
.../db/exception/query/OutOfTTLException.java | 3 +-
.../org/apache/iotdb/db/metadata/MManager.java | 55 +-
.../java/org/apache/iotdb/db/metadata/MTree.java | 3 +
.../org/apache/iotdb/db/monitor/StatMonitor.java | 3 +-
.../main/java/org/apache/iotdb/db/qp/Planner.java | 4 +
.../apache/iotdb/db/qp/constant/SQLConstant.java | 3 -
.../db/qp/logical/crud/BasicFunctionOperator.java | 8 +-
.../iotdb/db/qp/logical/crud/FilterOperator.java | 31 +-
.../iotdb/db/qp/logical/crud/InOperator.java | 8 +-
.../iotdb/db/qp/physical/crud/AggregationPlan.java | 4 +
.../db/qp/physical/crud/AlignByDevicePlan.java | 12 +-
.../iotdb/db/qp/physical/crud/QueryPlan.java | 11 -
.../iotdb/db/qp/strategy/PhysicalGenerator.java | 128 ++--
.../qp/strategy/optimizer/ConcatPathOptimizer.java | 13 +-
.../db/query/aggregation/AggregateResult.java | 100 +--
.../db/query/aggregation/impl/AvgAggrResult.java | 9 +
.../aggregation/impl/FirstValueAggrResult.java | 6 +
.../aggregation/impl/LastValueAggrResult.java | 6 +
.../db/query/dataset/AlignByDeviceDataSet.java | 53 +-
.../dataset/RawQueryDataSetWithoutValueFilter.java | 45 +-
.../dataset/groupby/GroupByEngineDataSet.java | 13 +-
.../dataset/groupby/GroupByExecutor.java} | 23 +-
.../groupby/GroupByWithValueFilterDataSet.java | 26 +-
.../groupby/GroupByWithoutValueFilterDataSet.java | 216 ++-----
.../dataset/groupby/LocalGroupByExecutor.java | 203 +++++++
.../db/query/executor/AggregationExecutor.java | 16 +-
.../iotdb/db/query/executor/FillQueryExecutor.java | 11 +-
.../iotdb/db/query/executor/LastQueryExecutor.java | 23 +-
.../iotdb/db/query/executor/QueryRouter.java | 23 +-
.../db/query/executor/RawDataQueryExecutor.java | 10 +-
.../java/org/apache/iotdb/db/query/fill/IFill.java | 8 +
.../iotdb/db/query/reader/series/SeriesReader.java | 4 +-
.../org/apache/iotdb/db/service/TSServiceImpl.java | 127 ++--
.../iotdb/db/sync/receiver/SyncServerManager.java | 36 +-
.../iotdb/db/sync/receiver/load/FileLoader.java | 4 +-
.../db/sync/receiver/transfer/SyncServiceImpl.java | 16 +-
.../db/sync/sender/manage/SyncFileManager.java | 10 -
.../iotdb/db/sync/sender/transfer/SyncClient.java | 9 +-
.../thrift/SyncServiceEventHandler.java} | 29 +-
.../org/apache/iotdb/db/utils/FileLoaderUtils.java | 1 +
.../org/apache/iotdb/db/utils/FilePathUtils.java | 6 +
.../org/apache/iotdb/db/utils/SchemaUtils.java | 119 ++--
.../iotdb/db/writelog/recover/LogReplayer.java | 8 +-
.../db/engine/cache/DeviceMetaDataCacheTest.java | 12 +-
.../storagegroup/FileNodeManagerBenchmark.java | 3 +-
.../storagegroup/StorageGroupProcessorTest.java | 37 +-
.../iotdb/db/engine/storagegroup/TTLTest.java | 21 +-
.../engine/storagegroup/TsFileProcessorTest.java | 10 +-
.../apache/iotdb/db/integration/IoTDBLastIT.java | 56 ++
.../integration/IoTDBLoadExternalTsfileTest.java | 27 +-
.../apache/iotdb/db/integration/IoTDBTtlIT.java | 2 +-
.../org/apache/iotdb/db/metadata/MTreeTest.java | 2 +-
.../iotdb/db/qp/plan/ConcatOptimizerTest.java | 22 +
.../iotdb/db/qp/plan/LogicalPlanSmallTest.java | 33 +-
.../iotdb/db/query/reader/ReaderTestHelper.java | 7 +-
.../apache/iotdb/db/utils/EnvironmentUtils.java | 9 +
.../java/org/apache/iotdb/rpc/TSStatusCode.java | 2 +
service-rpc/src/main/thrift/sync.thrift | 23 +-
.../java/org/apache/iotdb/session/Session.java | 77 ++-
.../org/apache/iotdb/session/SessionDataSet.java | 10 +-
.../iotdb/session/pool/SessionDataSetWrapper.java | 81 +++
.../org/apache/iotdb/session/pool/SessionPool.java | 669 +++++++++++++++++++++
.../org/apache/iotdb/session/IoTDBSessionIT.java | 31 +-
.../apache/iotdb/session/pool/SessionPoolTest.java | 236 ++++++++
.../iotdb/tsfile/common/conf/TSFileConfig.java | 4 +-
.../apache/iotdb/tsfile/read/common/BatchData.java | 139 +++--
.../ExceptionBatchData.java} | 18 +-
.../iotdb/tsfile/read/common/TimeColumn.java | 89 ++-
.../tsfile/read/query/dataset/QueryDataSet.java | 3 +
.../read/query/timegenerator/TimeGenerator.java | 7 +-
.../read/query/timegenerator/node/AndNode.java | 2 +-
.../read/query/timegenerator/node/LeafNode.java | 38 +-
.../read/query/timegenerator/node/OrNode.java | 2 +-
.../apache/iotdb/tsfile/write/TsFileWriter.java | 2 +-
.../apache/iotdb/tsfile/write/ReadWriteTest.java | 180 ++++++
.../tsfile/write/TimeGeneratorReadEmptyTest.java | 141 +++++
.../tsfile/write/TimeGeneratorReadWriteTest.java | 182 ++++++
226 files changed, 6732 insertions(+), 2239 deletions(-)
rename docs/Documentation-CHN/UserGuide/4-Client/{1-Command Line Interface (CLI).md => 1-Command Line Interface.md} (97%)
rename docs/Documentation-CHN/UserGuide/5-Operation Manual/{1-DDL (Data Definition Language).md => 1-DDL Data Definition Language.md} (94%)
rename docs/Documentation-CHN/UserGuide/5-Operation Manual/{2-DML (Data Manipulation Language).md => 2-DML Data Manipulation Language.md} (94%)
copy docs/{Documentation-CHN => Documentation}/SystemDesign/0-Architecture/1-Architecture.md (50%)
copy docs/{Documentation-CHN => Documentation}/SystemDesign/2-QueryEngine/1-QueryEngine.md (53%)
copy docs/{Documentation-CHN => Documentation}/SystemDesign/2-QueryEngine/2-Planner.md (65%)
copy docs/{Documentation-CHN => Documentation}/SystemDesign/2-QueryEngine/3-PlanExecutor.md (94%)
copy docs/{Documentation-CHN => Documentation}/SystemDesign/3-SchemaManager/1-SchemaManager.md (85%)
create mode 100644 docs/Documentation/SystemDesign/4-StorageEngine/1-StorageEngine.md
copy docs/{Documentation-CHN => Documentation}/SystemDesign/4-StorageEngine/2-WAL.md (96%)
create mode 100644 docs/Documentation/SystemDesign/4-StorageEngine/3-FlushManager.md
create mode 100644 docs/Documentation/SystemDesign/4-StorageEngine/4-MergeManager.md
create mode 100644 docs/Documentation/SystemDesign/4-StorageEngine/5-DataPartition.md
create mode 100644 docs/Documentation/SystemDesign/4-StorageEngine/6-DataManipulation.md
copy docs/{Documentation-CHN/UserGuide/3-Server/3-Cluster Setup.md => Documentation/SystemDesign/5-DataQuery/1-DataQuery.md} (50%)
create mode 100644 docs/Documentation/SystemDesign/5-DataQuery/2-SeriesReader.md
create mode 100644 docs/Documentation/SystemDesign/5-DataQuery/3-RawDataQuery.md
create mode 100644 docs/Documentation/SystemDesign/5-DataQuery/4-AggregationQuery.md
create mode 100644 docs/Documentation/SystemDesign/5-DataQuery/5-GroupByQuery.md
copy docs/{Documentation-CHN => Documentation}/SystemDesign/5-DataQuery/6-LastQuery.md (56%)
create mode 100644 docs/Documentation/SystemDesign/5-DataQuery/7-AlignByDeviceQuery.md
create mode 100644 docs/Documentation/SystemDesign/6-Tools/1-Sync.md
create mode 100644 docs/Documentation/SystemDesign/7-Connector/2-Hive-TsFile.md
copy docs/{Documentation-CHN => Documentation}/SystemDesign/7-Connector/3-Spark-TsFile.md (57%)
copy docs/{Documentation-CHN => Documentation}/SystemDesign/7-Connector/4-Spark-IOTDB.md (65%)
delete mode 100644 docs/Documentation/UserGuide/0-Content.md
rename docs/Documentation/UserGuide/4-Client/{1-Command Line Interface (CLI).md => 1-Command Line Interface.md} (97%)
rename docs/Documentation/UserGuide/5-Operation Manual/{1-DDL (Data Definition Language).md => 1-DDL Data Definition Language.md} (94%)
rename docs/Documentation/UserGuide/5-Operation Manual/{2-DML (Data Manipulation Language).md => 2-DML Data Manipulation Language.md} (93%)
copy server/src/{test/java/org/apache/iotdb/db/query/control/QueryResourceManagerTest.java => main/java/org/apache/iotdb/db/exception/LoadEmptyFileException.java} (81%)
copy server/src/main/java/org/apache/iotdb/db/exception/{MergeException.java => LoadFileException.java} (75%)
copy server/src/main/java/org/apache/iotdb/db/exception/{MergeException.java => PartitionViolationException.java} (75%)
copy server/src/main/java/org/apache/iotdb/db/{qp/strategy/optimizer/IFilterOptimizer.java => query/dataset/groupby/GroupByExecutor.java} (61%)
create mode 100644 server/src/main/java/org/apache/iotdb/db/query/dataset/groupby/LocalGroupByExecutor.java
copy server/src/main/java/org/apache/iotdb/db/{service/JDBCServiceEventHandler.java => sync/thrift/SyncServiceEventHandler.java} (65%)
create mode 100644 session/src/main/java/org/apache/iotdb/session/pool/SessionDataSetWrapper.java
create mode 100644 session/src/main/java/org/apache/iotdb/session/pool/SessionPool.java
create mode 100644 session/src/test/java/org/apache/iotdb/session/pool/SessionPoolTest.java
copy tsfile/src/main/java/org/apache/iotdb/tsfile/read/{filter/factory/FilterType.java => common/ExceptionBatchData.java} (67%)
create mode 100644 tsfile/src/test/java/org/apache/iotdb/tsfile/write/ReadWriteTest.java
create mode 100644 tsfile/src/test/java/org/apache/iotdb/tsfile/write/TimeGeneratorReadEmptyTest.java
create mode 100644 tsfile/src/test/java/org/apache/iotdb/tsfile/write/TimeGeneratorReadWriteTest.java