You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iotdb.apache.org by ha...@apache.org on 2022/03/10 01:40:36 UTC
[iotdb] branch new_cluster updated (c4e385d -> 9058ecb)
This is an automated email from the ASF dual-hosted git repository.
haonan pushed a change to branch new_cluster
in repository https://gitbox.apache.org/repos/asf/iotdb.git.
from c4e385d ConfigNode basic framework (#5174)
add 6e983ee fix UserGuide.EcosystemIntegration.FAQ.2.A (#5126)
add 3f915d0 [IOTDB-2578]Fix cross space compaction recover and log read compatible with 0.12 (#5122)
add 92ad9f2 [IOTDB-2620] Unrecognizable operator type (SHOW) for AuthorityChecker (#5129)
add e44835f [IOTDB-2625] Fix election deadlock when updating partition table (#5131)
add 20df9c8 [IOTDB-2578]Fix cross space compaction recover and log read compatible with 0.12 (#5133)
add 2bd7eb7 fix not set compactionCandidate to false when start compacting(#5127)
add 2ab97b4 [IOTDB-2595] add buildin UDTF ON_OFF (#5124)
add 9d33535 [IOTDB-2632] Set compaction_write_throughput_mb_per_sec to 16 by default (#5138)
add ebd7ae1 Bump jjwt-impl from 0.10.7 to 0.10.8 (#5143)
add 2bb33ae Bump jaxb-impl from 2.3.0 to 2.3.6 (#5141)
add 091c14a [IOTDB-2625] Optimize RaftMember initialization (#5144)
add 6fe4b91 Fix website compile error (#5149)
add 2bddbf0 [IOTDB-2647] UDF Library in Apache Way (#5153)
add 07fb542 [IOTDB-1807] Compatibility of Apache IoTDB with InfluxDB - Parse InfluxQL (#4535)
add 9f9dc19 [IOTDB-2634] Fix batch script exit directly from cmd.exe (#5158)
add e8462e4 [IOTDB-2638][Metric] add features into metric module (#5147)
add 479c8d7 [IOTDB-2653] Fix "overlapped data should be consumed first" occurs when executing query (#5161)
add 1cfbd48 [IOTDB-2597] Add four functions to find suitable intervals (#5136)
add edd4d5c [IOTDB-2520] list user privilege root returns empty (#5167)
add a1627f3 [IOTDB-2579] fixed mvn clean can not clean folder "grafana-plugin" (#5103)
add 107cdc6 [IOTDB-2668] Fix align by device with aligned path bug (#5169)
add d2c21e3 [IOTDB-2633]Unification of compaction log formats (#5157)
add 6d15dd0 [IOTDB-2657] Fix "NumberFormatException occurs when type infer for value with whitespace" (#5171)
add f9b16cd [IOTDB-2693] Fix compaction recover bug (#5178)
add c788726 [IOTDB-2691][Metric] update metric doc (#5172)
add e4af0c0 [IOTDB-2654] Alias doesn't show when using group by level (#5163)
add a5f1a16 [Doc] Update download links for release v0.12.5 (#5180)
add 48ad032 [IOTDB-2694] fix without null any bug in raw query with value filter (#5179)
add c388dfb [IOTDB-2596] Add buildin UDTF in_range (#5146)
add b98d25f [IOTDB-2692] Fix compaction exception caused by deleted timeseries (#5173)
add 7664600 [IOTDB-2357] Support create timeseries interface with tags in python client (#5181)
add b2d060c [IOTDB-2651] Fix write performance deteriorates severely (#5170)
add 5286d42 [IOTDB-2697] Add metadata modification validation before accelerating query by statistics (#5182)
add 1584871 [IOTDB-2680] Fix too many open files exception (#5177)
add 6c0f35e [IOTDB-2705] Separate CQ persistence from MLog (#5187)
add 270fcc3 [IOTDB-2703] Support insert ndarray Tablet in Python API (#5185)
add 064010c [IOTDB-2707] Update Python API userguide (#5189)
new 9058ecb Merge branch 'master' of https://github.com/apache/iotdb into new_cluster
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
Jenkinsfile | 2 +-
RELEASE_NOTES.md | 3 +-
.../apache/iotdb/db/qp/sql/InfluxDBSqlParser.g4 | 129 +++++++
.../org/apache/iotdb/db/qp/sql/IoTDBSqlParser.g4 | 2 +-
.../db/qp/sql/{IoTDBSqlLexer.g4 => SqlLexer.g4} | 2 +-
cli/src/assembly/resources/sbin/start-cli.bat | 2 +-
cli/src/assembly/resources/tools/export-csv.bat | 2 +-
cli/src/assembly/resources/tools/import-csv.bat | 2 +-
.../apache/iotdb/cli/IoTDBSyntaxHighlighter.java | 4 +-
.../org/apache/iotdb/cli/utils/JlineUtils.java | 6 +-
.../org/apache/iotdb/cli/StartClientScriptIT.java | 15 +-
.../iotdb/tool/integration/ExportCsvTestIT.java | 5 +-
.../iotdb/tool/integration/ImportCsvTestIT.java | 5 +-
client-py/SessionExample.py | 66 ++++
client-py/SessionTest.py | 62 +++
client-py/iotdb/Session.py | 20 +-
client-py/iotdb/utils/NumpyTablet.py | 107 ++++++
client-py/iotdb/utils/Tablet.py | 244 ++++++------
client-py/requirements.txt | 5 +-
client-py/setup.py | 3 +-
client-py/tests/tablet_performance_comparison.py | 13 +-
.../log/manage/PartitionedSnapshotLogManager.java | 2 +
.../server/handlers/caller/ElectionHandler.java | 2 +
.../iotdb/cluster/server/member/RaftMember.java | 8 +-
.../cluster/utils/nodetool/ClusterMonitor.java | 3 +
.../server/heartbeat/HeartbeatThreadTest.java | 1 +
docs/Download/README.md | 34 +-
.../UserGuide/API/Programming-Python-Native-API.md | 242 ++++++++++--
docs/UserGuide/Maintenance-Tools/Metric-Tool.md | 189 +++++-----
docs/UserGuide/Query-Data/Select-Expression.md | 116 ++++++
docs/UserGuide/Reference/Config-Manual.md | 17 +-
docs/UserGuide/UDF-Library/Quick-Start.md | 26 +-
docs/zh/Download/README.md | 34 +-
docs/zh/UserGuide/API/InfluxDB-Protocol.md | 2 +-
.../UserGuide/API/Programming-Python-Native-API.md | 254 +++++++++++--
.../Ecosystem Integration/Writing Data on HDFS.md | 2 +-
docs/zh/UserGuide/Maintenance-Tools/Metric-Tool.md | 181 ++++-----
docs/zh/UserGuide/Query-Data/Select-Expression.md | 113 ++++++
docs/zh/UserGuide/Reference/Config-Manual.md | 15 +-
docs/zh/UserGuide/UDF-Library/Quick-Start.md | 25 +-
grafana-plugin/pom.xml | 20 +
.../db/integration/IoTDBNewTsFileCompactionIT.java | 6 +-
.../IoTDBQueryWithComplexValueFilterIT.java | 64 ++--
...va => IoTDBQueryWithRecreatedTimeseriesIT.java} | 57 ++-
.../integration/IoTDBSizeTieredCompactionIT.java | 6 +-
.../db/integration/IoTDBUDTFBuiltinFunctionIT.java | 224 +++++++++++
.../db/integration/IoTDBWithoutAnyNullIT.java | 33 ++
.../aggregation/IoTDBAggregationByLevelIT.java | 160 ++++++++
.../integration/aligned/IoTDBAlignByDeviceIT.java | 275 ++++++++++++++
metrics/ReadMe.md | 28 +-
metrics/dropwizard-metrics/pom.xml | 5 +
.../dropwizard/DropwizardMetricManager.java | 99 ++---
.../iotdb/metrics/dropwizard/MetricName.java | 44 ++-
.../dropwizard/reporter/DropwizardJmxReporter.java | 4 +-
.../DropwizardMetricsExporter.java | 26 +-
.../reporter/DropwizardPrometheusReporter.java | 85 +++--
.../reporter/{prometheus => }/MetricType.java | 2 +-
.../{prometheus => }/PrometheusTextWriter.java | 2 +-
.../reporter/prometheus/PrometheusReporter.java | 231 ------------
.../reporter/prometheus/PrometheusSender.java | 63 ----
.../reporter/prometheus/PushGateway.java | 151 --------
.../dropwizard/reporter/prometheus/TextFormat.java | 27 --
... => org.apache.iotdb.metrics.reporter.Reporter} | 0
.../dropwizard/DropwizardMetricManagerTest.java | 134 ++++---
.../main/assembly/resources/conf/iotdb-metric.yml | 33 +-
.../org/apache/iotdb/metrics/MetricManager.java | 43 +--
.../org/apache/iotdb/metrics/MetricService.java | 25 +-
.../apache/iotdb/metrics/config/MetricConfig.java | 67 ++--
.../metrics/config/MetricConfigDescriptor.java | 1 +
.../iotdb/metrics/impl/DoNothingMetricManager.java | 31 +-
.../metrics/{ => reporter}/CompositeReporter.java | 2 +-
.../iotdb/metrics/{ => reporter}/Reporter.java | 3 +-
.../org/apache/iotdb/metrics/type/IMetric.java | 9 +-
.../utils/{ReporterType.java => MetricLevel.java} | 22 +-
.../apache/iotdb/metrics/utils/MonitorType.java | 31 +-
.../{PredefinedMetric.java => OutPutFormat.java} | 11 +-
.../iotdb/metrics/utils/PredefinedMetric.java | 9 +-
.../apache/iotdb/metrics/utils/ReporterType.java | 8 +-
.../iotdb/metrics/config/MetricConfigTest.java | 5 +-
.../interface/src/test/resources/iotdb-metric.yml | 36 +-
.../{MeterIdUtils.java => MetricName.java} | 42 ++-
.../micrometer/MicrometerMetricManager.java | 185 +++++----
.../micrometer/reporter/MicrometerJmxReporter.java | 4 +-
.../reporter/MicrometerPrometheusReporter.java | 11 +-
... => org.apache.iotdb.metrics.reporter.Reporter} | 0
.../micrometer/MicrometerMetricManagerTest.java | 10 +-
pom.xml | 2 +-
server/pom.xml | 2 +-
.../resources/conf/iotdb-engine.properties | 20 +-
.../org/apache/iotdb/db/auth/AuthorityChecker.java | 1 +
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 40 +-
.../org/apache/iotdb/db/conf/IoTDBConstant.java | 6 +
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 16 +-
.../apache/iotdb/db/engine/cache/ChunkCache.java | 2 +
.../db/engine/cache/TimeSeriesMetadataCache.java | 3 +
.../engine/compaction/CompactionTaskManager.java | 3 +
.../db/engine/compaction/CompactionUtils.java | 50 ++-
.../db/engine/compaction/TsFileIdentifier.java | 49 ++-
.../cross/AbstractCrossSpaceCompactionTask.java | 16 +-
.../CrossSpaceCompactionExceptionHandler.java | 71 ++--
.../RewriteCrossSpaceCompactionSelector.java | 15 +-
...urce.java => CrossSpaceCompactionResource.java} | 7 +-
.../RewriteCrossSpaceCompactionLogAnalyzer.java | 118 ------
.../selector/RewriteCompactionFileSelector.java | 22 +-
.../task/RewriteCrossCompactionRecoverTask.java | 230 +++++++++++-
.../task/RewriteCrossSpaceCompactionTask.java | 31 +-
.../inner/AbstractInnerSpaceCompactionTask.java | 6 +
.../SizeTieredCompactionRecoverTask.java | 102 +++--
.../sizetiered/SizeTieredCompactionSelector.java | 3 +-
.../inner/sizetiered/SizeTieredCompactionTask.java | 29 +-
.../inner/utils/InnerSpaceCompactionUtils.java | 25 +-
.../inner/utils/MultiTsFileDeviceIterator.java | 31 +-
.../utils/SingleSeriesCompactionExecutor.java | 13 +-
.../utils/SizeTieredCompactionLogAnalyzer.java | 101 -----
.../inner/utils/SizeTieredCompactionLogger.java | 87 -----
.../compaction/task/AbstractCompactionTask.java | 4 +
.../compaction/task/CompactionRecoverTask.java | 32 +-
.../utils/log/CompactionLogAnalyzer.java | 163 ++++++++
.../log/CompactionLogger.java} | 55 ++-
.../TriggerLogReader.java => cq/CQLogReader.java} | 7 +-
.../TriggerLogWriter.java => cq/CQLogWriter.java} | 48 +--
.../iotdb/db/engine/cq/ContinuousQueryService.java | 120 ++++--
.../apache/iotdb/db/engine/flush/FlushManager.java | 3 +
.../iotdb/db/engine/flush/MemTableFlushTask.java | 2 +
.../iotdb/db/engine/memtable/AbstractMemTable.java | 27 +-
.../engine/storagegroup/TsFileNameGenerator.java | 2 +-
.../engine/storagegroup/TsFileProcessorInfo.java | 4 +
.../db/engine/storagegroup/TsFileResource.java | 4 +-
.../storagegroup/VirtualStorageGroupProcessor.java | 6 +-
.../org/apache/iotdb/db/metadata/MManager.java | 43 +--
.../iotdb/db/metadata/logfile/MLogWriter.java | 12 -
.../reporter/DropwizardIoTDBReporter.java | 4 +-
.../reporter/MicrometerIoTDBReporter.java | 4 +-
.../influxdb/constant/InfluxSQLConstant.java | 57 +++
.../iotdb/db/protocol/influxdb/dto/IoTDBPoint.java | 10 +-
.../influxdb/operator/InfluxQueryOperator.java | 22 +-
.../influxdb/operator/InfluxSelectComponent.java | 94 +++++
.../influxdb/sql/InfluxDBLogicalGenerator.java | 66 ++++
.../protocol/influxdb/sql/InfluxDBSqlVisitor.java | 297 +++++++++++++++
.../iotdb/db/qp/constant/FilterConstant.java | 20 +-
.../apache/iotdb/db/qp/constant/SQLConstant.java | 3 +-
.../apache/iotdb/db/qp/executor/PlanExecutor.java | 56 ++-
.../iotdb/db/qp/logical/crud/SelectComponent.java | 4 +-
.../iotdb/db/qp/physical/crud/AggregationPlan.java | 12 +-
.../iotdb/db/qp/strategy/LogicalGenerator.java | 6 +-
.../qp/strategy/optimizer/ConcatPathOptimizer.java | 6 +-
.../iotdb/db/qp/utils/GroupByLevelController.java | 89 ++++-
.../db/query/dataset/AlignByDeviceDataSet.java | 2 +-
.../dataset/RawQueryDataSetWithValueFilter.java | 5 +-
.../query/dataset/groupby/GroupByLevelDataSet.java | 3 +-
.../iotdb/db/query/expression/ResultColumn.java | 20 +-
.../db/query/pool/RawQueryReadTaskPoolManager.java | 3 +
.../iotdb/db/query/reader/series/SeriesReader.java | 2 +
.../db/query/udf/builtin/BuiltinFunction.java | 6 +
.../query/udf/builtin/UDTFContinuouslySatisfy.java | 239 ++++++++++++
.../builtin/{UDTFMath.java => UDTFInRange.java} | 36 +-
.../db/query/udf/builtin/UDTFNonZeroCount.java | 41 +-
.../db/query/udf/builtin/UDTFNonZeroDuration.java | 39 +-
.../udf/builtin/{UDTFMath.java => UDTFOnOff.java} | 34 +-
.../iotdb/db/query/udf/builtin/UDTFZeroCount.java | 41 +-
.../db/query/udf/builtin/UDTFZeroDuration.java | 39 +-
.../iotdb/db/service/metrics/MetricsService.java | 13 +-
.../db/service/thrift/ProcessorWithMetrics.java | 9 +-
.../db/service/thrift/impl/TSServiceImpl.java | 12 +-
.../org/apache/iotdb/db/utils/CommonUtils.java | 5 +-
.../apache/iotdb/db/utils/TypeInferenceUtils.java | 4 +-
... => org.apache.iotdb.metrics.reporter.Reporter} | 0
.../engine/compaction/CompactionSchedulerTest.java | 90 ++---
.../compaction/CompactionTaskManagerTest.java | 104 +++++-
.../db/engine/compaction/CompactionUtilsTest.java | 10 +-
.../cross/CrossSpaceCompactionExceptionTest.java | 73 ++--
.../compaction/cross/CrossSpaceCompactionTest.java | 14 +-
.../engine/compaction/cross/MergeUpgradeTest.java | 5 +-
.../cross/RewriteCompactionFileSelectorTest.java | 286 +++++++++++++-
.../RewriteCrossSpaceCompactionRecoverTest.java | 279 +++++++++++---
.../compaction/inner/InnerCompactionLogTest.java | 4 +-
.../inner/InnerCompactionSchedulerTest.java | 8 +-
.../inner/InnerSpaceCompactionExceptionTest.java | 101 +++--
.../InnerSpaceCompactionUtilsNoAlignedTest.java | 9 +-
.../inner/InnerSpaceCompactionUtilsOldTest.java | 14 +-
.../SizeTieredCompactionRecoverTest.java | 393 ++++++++++++++-----
...eCrossSpaceCompactionRecoverCompatibleTest.java | 414 +++++++++++++++++++++
.../SizeTieredCompactionRecoverCompatibleTest.java | 8 +-
.../recover/SizeTieredCompactionRecoverTest.java | 83 ++---
.../compaction/utils/CompactionCheckerUtils.java | 5 +
.../compaction/utils/CompactionClearUtils.java | 7 +-
.../compaction/utils/CompactionConfigRestorer.java | 6 +-
.../storagegroup/StorageGroupProcessorTest.java | 6 +-
.../influxdb/sql/InfluxDBLogicalGeneratorTest.java | 68 ++++
.../java/org/apache/iotdb/db/qp/PlannerTest.java | 22 ++
.../iotdb/db/utils/TypeInferenceUtilsTest.java | 23 +-
site/src/main/.vuepress/config.js | 34 +-
thrift-influxdb/README.md | 2 +-
.../apache/iotdb/tsfile/read/common/RowRecord.java | 8 +
194 files changed, 6541 insertions(+), 2770 deletions(-)
create mode 100644 antlr/src/main/antlr4/org/apache/iotdb/db/qp/sql/InfluxDBSqlParser.g4
rename antlr/src/main/antlr4/org/apache/iotdb/db/qp/sql/{IoTDBSqlLexer.g4 => SqlLexer.g4} (99%)
create mode 100644 client-py/iotdb/utils/NumpyTablet.py
copy integration/src/test/java/org/apache/iotdb/db/integration/{IoTDBKillQueryIT.java => IoTDBQueryWithRecreatedTimeseriesIT.java} (56%)
rename metrics/dropwizard-metrics/src/main/java/org/apache/iotdb/metrics/dropwizard/reporter/{prometheus => }/DropwizardMetricsExporter.java (85%)
rename metrics/dropwizard-metrics/src/main/java/org/apache/iotdb/metrics/dropwizard/reporter/{prometheus => }/MetricType.java (94%)
rename metrics/dropwizard-metrics/src/main/java/org/apache/iotdb/metrics/dropwizard/reporter/{prometheus => }/PrometheusTextWriter.java (97%)
delete mode 100644 metrics/dropwizard-metrics/src/main/java/org/apache/iotdb/metrics/dropwizard/reporter/prometheus/PrometheusReporter.java
delete mode 100644 metrics/dropwizard-metrics/src/main/java/org/apache/iotdb/metrics/dropwizard/reporter/prometheus/PrometheusSender.java
delete mode 100644 metrics/dropwizard-metrics/src/main/java/org/apache/iotdb/metrics/dropwizard/reporter/prometheus/PushGateway.java
delete mode 100644 metrics/dropwizard-metrics/src/main/java/org/apache/iotdb/metrics/dropwizard/reporter/prometheus/TextFormat.java
rename metrics/dropwizard-metrics/src/main/resources/META-INF/services/{org.apache.iotdb.metrics.Reporter => org.apache.iotdb.metrics.reporter.Reporter} (100%)
rename metrics/interface/src/main/java/org/apache/iotdb/metrics/{ => reporter}/CompositeReporter.java (98%)
rename metrics/interface/src/main/java/org/apache/iotdb/metrics/{ => reporter}/Reporter.java (92%)
copy metrics/interface/src/main/java/org/apache/iotdb/metrics/utils/{ReporterType.java => MetricLevel.java} (75%)
copy metrics/interface/src/main/java/org/apache/iotdb/metrics/utils/{PredefinedMetric.java => OutPutFormat.java} (88%)
rename metrics/micrometer-metrics/src/main/java/org/apache/iotdb/metrics/micrometer/{MeterIdUtils.java => MetricName.java} (51%)
rename metrics/micrometer-metrics/src/main/resources/META-INF/services/{org.apache.iotdb.metrics.Reporter => org.apache.iotdb.metrics.reporter.Reporter} (100%)
rename server/src/main/java/org/apache/iotdb/db/engine/compaction/cross/rewrite/manage/{CrossSpaceMergeResource.java => CrossSpaceCompactionResource.java} (97%)
delete mode 100644 server/src/main/java/org/apache/iotdb/db/engine/compaction/cross/rewrite/recover/RewriteCrossSpaceCompactionLogAnalyzer.java
delete mode 100644 server/src/main/java/org/apache/iotdb/db/engine/compaction/inner/utils/SizeTieredCompactionLogAnalyzer.java
delete mode 100644 server/src/main/java/org/apache/iotdb/db/engine/compaction/inner/utils/SizeTieredCompactionLogger.java
create mode 100644 server/src/main/java/org/apache/iotdb/db/engine/compaction/utils/log/CompactionLogAnalyzer.java
rename server/src/main/java/org/apache/iotdb/db/engine/compaction/{cross/rewrite/recover/RewriteCrossSpaceCompactionLogger.java => utils/log/CompactionLogger.java} (50%)
copy server/src/main/java/org/apache/iotdb/db/engine/{trigger/service/TriggerLogReader.java => cq/CQLogReader.java} (88%)
copy server/src/main/java/org/apache/iotdb/db/engine/{trigger/service/TriggerLogWriter.java => cq/CQLogWriter.java} (54%)
create mode 100644 server/src/main/java/org/apache/iotdb/db/protocol/influxdb/constant/InfluxSQLConstant.java
copy tsfile/src/main/java/org/apache/iotdb/tsfile/exception/NotImplementedException.java => server/src/main/java/org/apache/iotdb/db/protocol/influxdb/operator/InfluxQueryOperator.java (63%)
create mode 100644 server/src/main/java/org/apache/iotdb/db/protocol/influxdb/operator/InfluxSelectComponent.java
create mode 100644 server/src/main/java/org/apache/iotdb/db/protocol/influxdb/sql/InfluxDBLogicalGenerator.java
create mode 100644 server/src/main/java/org/apache/iotdb/db/protocol/influxdb/sql/InfluxDBSqlVisitor.java
create mode 100644 server/src/main/java/org/apache/iotdb/db/query/udf/builtin/UDTFContinuouslySatisfy.java
copy server/src/main/java/org/apache/iotdb/db/query/udf/builtin/{UDTFMath.java => UDTFInRange.java} (74%)
copy metrics/interface/src/main/java/org/apache/iotdb/metrics/impl/DoNothingHistogramSnapshot.java => server/src/main/java/org/apache/iotdb/db/query/udf/builtin/UDTFNonZeroCount.java (56%)
copy metrics/interface/src/main/java/org/apache/iotdb/metrics/impl/DoNothingHistogramSnapshot.java => server/src/main/java/org/apache/iotdb/db/query/udf/builtin/UDTFNonZeroDuration.java (56%)
copy server/src/main/java/org/apache/iotdb/db/query/udf/builtin/{UDTFMath.java => UDTFOnOff.java} (79%)
copy metrics/interface/src/main/java/org/apache/iotdb/metrics/impl/DoNothingHistogramSnapshot.java => server/src/main/java/org/apache/iotdb/db/query/udf/builtin/UDTFZeroCount.java (56%)
copy metrics/interface/src/main/java/org/apache/iotdb/metrics/impl/DoNothingHistogramSnapshot.java => server/src/main/java/org/apache/iotdb/db/query/udf/builtin/UDTFZeroDuration.java (56%)
rename server/src/main/resources/META-INF/services/{org.apache.iotdb.metrics.Reporter => org.apache.iotdb.metrics.reporter.Reporter} (100%)
create mode 100644 server/src/test/java/org/apache/iotdb/db/engine/compaction/recover/RewriteCrossSpaceCompactionRecoverCompatibleTest.java
create mode 100644 server/src/test/java/org/apache/iotdb/db/protocol/influxdb/sql/InfluxDBLogicalGeneratorTest.java
[iotdb] 01/01: Merge branch 'master' of https://github.com/apache/iotdb into new_cluster
Posted by ha...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
haonan pushed a commit to branch new_cluster
in repository https://gitbox.apache.org/repos/asf/iotdb.git
commit 9058ecba38a64b3a9b7ff7a9217e6de2bb19dd1b
Merge: c4e385d 064010c
Author: HTHou <hh...@outlook.com>
AuthorDate: Thu Mar 10 09:39:16 2022 +0800
Merge branch 'master' of https://github.com/apache/iotdb into new_cluster
Jenkinsfile | 2 +-
RELEASE_NOTES.md | 3 +-
.../apache/iotdb/db/qp/sql/InfluxDBSqlParser.g4 | 129 +++++++
.../org/apache/iotdb/db/qp/sql/IoTDBSqlParser.g4 | 2 +-
.../db/qp/sql/{IoTDBSqlLexer.g4 => SqlLexer.g4} | 2 +-
cli/src/assembly/resources/sbin/start-cli.bat | 2 +-
cli/src/assembly/resources/tools/export-csv.bat | 2 +-
cli/src/assembly/resources/tools/import-csv.bat | 2 +-
.../apache/iotdb/cli/IoTDBSyntaxHighlighter.java | 4 +-
.../org/apache/iotdb/cli/utils/JlineUtils.java | 6 +-
.../org/apache/iotdb/cli/StartClientScriptIT.java | 15 +-
.../iotdb/tool/integration/ExportCsvTestIT.java | 5 +-
.../iotdb/tool/integration/ImportCsvTestIT.java | 5 +-
client-py/SessionExample.py | 66 ++++
client-py/SessionTest.py | 62 +++
client-py/iotdb/Session.py | 20 +-
client-py/iotdb/utils/NumpyTablet.py | 107 ++++++
client-py/iotdb/utils/Tablet.py | 244 ++++++------
client-py/requirements.txt | 5 +-
client-py/setup.py | 3 +-
client-py/tests/tablet_performance_comparison.py | 13 +-
.../log/manage/PartitionedSnapshotLogManager.java | 2 +
.../server/handlers/caller/ElectionHandler.java | 2 +
.../iotdb/cluster/server/member/RaftMember.java | 8 +-
.../cluster/utils/nodetool/ClusterMonitor.java | 3 +
.../server/heartbeat/HeartbeatThreadTest.java | 1 +
docs/Download/README.md | 34 +-
.../UserGuide/API/Programming-Python-Native-API.md | 242 ++++++++++--
docs/UserGuide/Maintenance-Tools/Metric-Tool.md | 189 +++++-----
docs/UserGuide/Query-Data/Select-Expression.md | 116 ++++++
docs/UserGuide/Reference/Config-Manual.md | 17 +-
docs/UserGuide/UDF-Library/Quick-Start.md | 26 +-
docs/zh/Download/README.md | 34 +-
docs/zh/UserGuide/API/InfluxDB-Protocol.md | 2 +-
.../UserGuide/API/Programming-Python-Native-API.md | 254 +++++++++++--
.../Ecosystem Integration/Writing Data on HDFS.md | 2 +-
docs/zh/UserGuide/Maintenance-Tools/Metric-Tool.md | 181 ++++-----
docs/zh/UserGuide/Query-Data/Select-Expression.md | 113 ++++++
docs/zh/UserGuide/Reference/Config-Manual.md | 15 +-
docs/zh/UserGuide/UDF-Library/Quick-Start.md | 25 +-
grafana-plugin/pom.xml | 20 +
.../db/integration/IoTDBNewTsFileCompactionIT.java | 6 +-
.../IoTDBQueryWithComplexValueFilterIT.java | 64 ++--
.../IoTDBQueryWithRecreatedTimeseriesIT.java | 79 ++++
.../integration/IoTDBSizeTieredCompactionIT.java | 6 +-
.../db/integration/IoTDBUDTFBuiltinFunctionIT.java | 224 +++++++++++
.../db/integration/IoTDBWithoutAnyNullIT.java | 33 ++
.../aggregation/IoTDBAggregationByLevelIT.java | 160 ++++++++
.../integration/aligned/IoTDBAlignByDeviceIT.java | 275 ++++++++++++++
metrics/ReadMe.md | 28 +-
metrics/dropwizard-metrics/pom.xml | 5 +
.../dropwizard/DropwizardMetricManager.java | 99 ++---
.../iotdb/metrics/dropwizard/MetricName.java | 44 ++-
.../dropwizard/reporter/DropwizardJmxReporter.java | 4 +-
.../DropwizardMetricsExporter.java | 26 +-
.../reporter/DropwizardPrometheusReporter.java | 85 +++--
.../reporter/{prometheus => }/MetricType.java | 2 +-
.../{prometheus => }/PrometheusTextWriter.java | 2 +-
.../reporter/prometheus/PrometheusReporter.java | 231 ------------
.../reporter/prometheus/PrometheusSender.java | 63 ----
.../reporter/prometheus/PushGateway.java | 151 --------
... => org.apache.iotdb.metrics.reporter.Reporter} | 0
.../dropwizard/DropwizardMetricManagerTest.java | 134 ++++---
.../main/assembly/resources/conf/iotdb-metric.yml | 33 +-
.../org/apache/iotdb/metrics/MetricManager.java | 43 +--
.../org/apache/iotdb/metrics/MetricService.java | 25 +-
.../apache/iotdb/metrics/config/MetricConfig.java | 67 ++--
.../metrics/config/MetricConfigDescriptor.java | 1 +
.../iotdb/metrics/impl/DoNothingMetricManager.java | 31 +-
.../metrics/{ => reporter}/CompositeReporter.java | 2 +-
.../iotdb/metrics/{ => reporter}/Reporter.java | 3 +-
.../org/apache/iotdb/metrics/type/IMetric.java | 9 +-
.../apache/iotdb/metrics/utils/MetricLevel.java} | 25 +-
.../apache/iotdb/metrics/utils/MonitorType.java | 31 +-
.../apache/iotdb/metrics/utils/OutPutFormat.java} | 13 +-
.../iotdb/metrics/utils/PredefinedMetric.java | 9 +-
.../apache/iotdb/metrics/utils/ReporterType.java | 8 +-
.../iotdb/metrics/config/MetricConfigTest.java | 5 +-
.../interface/src/test/resources/iotdb-metric.yml | 36 +-
.../{MeterIdUtils.java => MetricName.java} | 42 ++-
.../micrometer/MicrometerMetricManager.java | 185 +++++----
.../micrometer/reporter/MicrometerJmxReporter.java | 4 +-
.../reporter/MicrometerPrometheusReporter.java | 11 +-
... => org.apache.iotdb.metrics.reporter.Reporter} | 0
.../micrometer/MicrometerMetricManagerTest.java | 10 +-
pom.xml | 2 +-
server/pom.xml | 2 +-
.../resources/conf/iotdb-engine.properties | 20 +-
.../org/apache/iotdb/db/auth/AuthorityChecker.java | 1 +
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 40 +-
.../org/apache/iotdb/db/conf/IoTDBConstant.java | 6 +
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 16 +-
.../apache/iotdb/db/engine/cache/ChunkCache.java | 2 +
.../db/engine/cache/TimeSeriesMetadataCache.java | 3 +
.../engine/compaction/CompactionTaskManager.java | 3 +
.../db/engine/compaction/CompactionUtils.java | 50 ++-
.../db/engine/compaction/TsFileIdentifier.java | 49 ++-
.../cross/AbstractCrossSpaceCompactionTask.java | 16 +-
.../CrossSpaceCompactionExceptionHandler.java | 71 ++--
.../RewriteCrossSpaceCompactionSelector.java | 15 +-
...urce.java => CrossSpaceCompactionResource.java} | 7 +-
.../RewriteCrossSpaceCompactionLogAnalyzer.java | 118 ------
.../selector/RewriteCompactionFileSelector.java | 22 +-
.../task/RewriteCrossCompactionRecoverTask.java | 230 +++++++++++-
.../task/RewriteCrossSpaceCompactionTask.java | 31 +-
.../inner/AbstractInnerSpaceCompactionTask.java | 6 +
.../SizeTieredCompactionRecoverTask.java | 102 +++--
.../sizetiered/SizeTieredCompactionSelector.java | 3 +-
.../inner/sizetiered/SizeTieredCompactionTask.java | 29 +-
.../inner/utils/InnerSpaceCompactionUtils.java | 25 +-
.../inner/utils/MultiTsFileDeviceIterator.java | 31 +-
.../utils/SingleSeriesCompactionExecutor.java | 13 +-
.../utils/SizeTieredCompactionLogAnalyzer.java | 101 -----
.../inner/utils/SizeTieredCompactionLogger.java | 87 -----
.../compaction/task/AbstractCompactionTask.java | 4 +
.../compaction/task/CompactionRecoverTask.java | 32 +-
.../utils/log/CompactionLogAnalyzer.java | 163 ++++++++
.../log/CompactionLogger.java} | 55 ++-
.../org/apache/iotdb/db/engine/cq/CQLogReader.java | 40 +-
.../org/apache/iotdb/db/engine/cq/CQLogWriter.java | 74 ++++
.../iotdb/db/engine/cq/ContinuousQueryService.java | 120 ++++--
.../apache/iotdb/db/engine/flush/FlushManager.java | 3 +
.../iotdb/db/engine/flush/MemTableFlushTask.java | 2 +
.../iotdb/db/engine/memtable/AbstractMemTable.java | 27 +-
.../engine/storagegroup/TsFileNameGenerator.java | 2 +-
.../engine/storagegroup/TsFileProcessorInfo.java | 4 +
.../db/engine/storagegroup/TsFileResource.java | 4 +-
.../storagegroup/VirtualStorageGroupProcessor.java | 6 +-
.../org/apache/iotdb/db/metadata/MManager.java | 43 +--
.../iotdb/db/metadata/logfile/MLogWriter.java | 12 -
.../reporter/DropwizardIoTDBReporter.java | 4 +-
.../reporter/MicrometerIoTDBReporter.java | 4 +-
.../influxdb/constant/InfluxSQLConstant.java | 57 +++
.../iotdb/db/protocol/influxdb/dto/IoTDBPoint.java | 10 +-
.../influxdb/operator/InfluxQueryOperator.java | 26 +-
.../influxdb/operator/InfluxSelectComponent.java | 94 +++++
.../influxdb/sql/InfluxDBLogicalGenerator.java | 66 ++++
.../protocol/influxdb/sql/InfluxDBSqlVisitor.java | 297 +++++++++++++++
.../iotdb/db/qp/constant/FilterConstant.java | 20 +-
.../apache/iotdb/db/qp/constant/SQLConstant.java | 3 +-
.../apache/iotdb/db/qp/executor/PlanExecutor.java | 56 ++-
.../iotdb/db/qp/logical/crud/SelectComponent.java | 4 +-
.../iotdb/db/qp/physical/crud/AggregationPlan.java | 12 +-
.../iotdb/db/qp/strategy/LogicalGenerator.java | 6 +-
.../qp/strategy/optimizer/ConcatPathOptimizer.java | 6 +-
.../iotdb/db/qp/utils/GroupByLevelController.java | 89 ++++-
.../db/query/dataset/AlignByDeviceDataSet.java | 2 +-
.../dataset/RawQueryDataSetWithValueFilter.java | 5 +-
.../query/dataset/groupby/GroupByLevelDataSet.java | 3 +-
.../iotdb/db/query/expression/ResultColumn.java | 20 +-
.../db/query/pool/RawQueryReadTaskPoolManager.java | 3 +
.../iotdb/db/query/reader/series/SeriesReader.java | 2 +
.../db/query/udf/builtin/BuiltinFunction.java | 6 +
.../query/udf/builtin/UDTFContinuouslySatisfy.java | 239 ++++++++++++
.../iotdb/db/query/udf/builtin/UDTFInRange.java | 90 +++++
.../db/query/udf/builtin/UDTFNonZeroCount.java | 50 +--
.../db/query/udf/builtin/UDTFNonZeroDuration.java | 63 ++++
.../iotdb/db/query/udf/builtin/UDTFOnOff.java | 86 +++++
.../iotdb/db/query/udf/builtin/UDTFZeroCount.java | 50 +--
.../db/query/udf/builtin/UDTFZeroDuration.java | 63 ++++
.../iotdb/db/service/metrics/MetricsService.java | 13 +-
.../db/service/thrift/ProcessorWithMetrics.java | 9 +-
.../db/service/thrift/impl/TSServiceImpl.java | 12 +-
.../org/apache/iotdb/db/utils/CommonUtils.java | 5 +-
.../apache/iotdb/db/utils/TypeInferenceUtils.java | 4 +-
... => org.apache.iotdb.metrics.reporter.Reporter} | 0
.../engine/compaction/CompactionSchedulerTest.java | 90 ++---
.../compaction/CompactionTaskManagerTest.java | 104 +++++-
.../db/engine/compaction/CompactionUtilsTest.java | 10 +-
.../cross/CrossSpaceCompactionExceptionTest.java | 73 ++--
.../compaction/cross/CrossSpaceCompactionTest.java | 14 +-
.../engine/compaction/cross/MergeUpgradeTest.java | 5 +-
.../cross/RewriteCompactionFileSelectorTest.java | 286 +++++++++++++-
.../RewriteCrossSpaceCompactionRecoverTest.java | 279 +++++++++++---
.../compaction/inner/InnerCompactionLogTest.java | 4 +-
.../inner/InnerCompactionSchedulerTest.java | 8 +-
.../inner/InnerSpaceCompactionExceptionTest.java | 101 +++--
.../InnerSpaceCompactionUtilsNoAlignedTest.java | 9 +-
.../inner/InnerSpaceCompactionUtilsOldTest.java | 14 +-
.../SizeTieredCompactionRecoverTest.java | 393 ++++++++++++++-----
...eCrossSpaceCompactionRecoverCompatibleTest.java | 414 +++++++++++++++++++++
.../SizeTieredCompactionRecoverCompatibleTest.java | 8 +-
.../recover/SizeTieredCompactionRecoverTest.java | 83 ++---
.../compaction/utils/CompactionCheckerUtils.java | 5 +
.../compaction/utils/CompactionClearUtils.java | 7 +-
.../compaction/utils/CompactionConfigRestorer.java | 6 +-
.../storagegroup/StorageGroupProcessorTest.java | 6 +-
.../influxdb/sql/InfluxDBLogicalGeneratorTest.java | 68 ++++
.../java/org/apache/iotdb/db/qp/PlannerTest.java | 22 ++
.../iotdb/db/utils/TypeInferenceUtilsTest.java | 23 +-
site/src/main/.vuepress/config.js | 34 +-
thrift-influxdb/README.md | 2 +-
.../apache/iotdb/tsfile/read/common/RowRecord.java | 8 +
193 files changed, 6910 insertions(+), 2636 deletions(-)