You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iotdb.apache.org by qi...@apache.org on 2022/11/23 06:08:43 UTC
[iotdb] branch master updated: add data load export tool document (#8107)
This is an automated email from the ASF dual-hosted git repository.
qiaojialin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iotdb.git
The following commit(s) were added to refs/heads/master by this push:
new 8546175048 add data load export tool document (#8107)
8546175048 is described below
commit 854617504868e0ed1a4df7ba5fe46716cc1169f3
Author: Zhijia Cao <ca...@126.com>
AuthorDate: Wed Nov 23 14:08:37 2022 +0800
add data load export tool document (#8107)
---
.../{Write-Data => Maintenance-Tools}/CSV-Tool.md | 0
.../TsFile-Load-Export-Tool.md} | 0
docs/UserGuide/Write-Data/Batch-Load-Tool.md | 32 ++++++++++++++++++++++
.../{Write-Data => Maintenance-Tools}/CSV-Tool.md | 0
.../TsFile-Load-Export-Tool.md} | 0
docs/zh/UserGuide/Write-Data/Batch-Load-Tool.md | 32 ++++++++++++++++++++++
site/src/main/.vuepress/config.js | 12 +++++---
7 files changed, 72 insertions(+), 4 deletions(-)
diff --git a/docs/UserGuide/Write-Data/CSV-Tool.md b/docs/UserGuide/Maintenance-Tools/CSV-Tool.md
similarity index 100%
rename from docs/UserGuide/Write-Data/CSV-Tool.md
rename to docs/UserGuide/Maintenance-Tools/CSV-Tool.md
diff --git a/docs/UserGuide/Write-Data/TsFile-Tool.md b/docs/UserGuide/Maintenance-Tools/TsFile-Load-Export-Tool.md
similarity index 100%
rename from docs/UserGuide/Write-Data/TsFile-Tool.md
rename to docs/UserGuide/Maintenance-Tools/TsFile-Load-Export-Tool.md
diff --git a/docs/UserGuide/Write-Data/Batch-Load-Tool.md b/docs/UserGuide/Write-Data/Batch-Load-Tool.md
new file mode 100644
index 0000000000..05af4f7b14
--- /dev/null
+++ b/docs/UserGuide/Write-Data/Batch-Load-Tool.md
@@ -0,0 +1,32 @@
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one
+ or more contributor license agreements. See the NOTICE file
+ distributed with this work for additional information
+ regarding copyright ownership. The ASF licenses this file
+ to you under the Apache License, Version 2.0 (the
+ "License"); you may not use this file except in compliance
+ with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing,
+ software distributed under the License is distributed on an
+ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ KIND, either express or implied. See the License for the
+ specific language governing permissions and limitations
+ under the License.
+
+-->
+
+# Batch Data Load
+
+In different scenarios, the IoTDB provides a variety of methods for importing data in batches. This section describes the two most common methods for importing data in CSV format and TsFile format.
+
+## TsFile Batch Load
+
+TsFile is the file format of time series used in IoTDB. You can directly import one or more TsFile files with time series into another running IoTDB instance through tools such as CLI. For details, see [TsFile Load Export Tools](../Maintenance-Tools/TsFile-Load-Export-Tool.md).
+
+## CSV Batch Load
+
+CSV stores table data in plain text. You can write multiple formatted data into a CSV file and import the data into the IoTDB in batches. Before importing data, you are advised to create the corresponding metadata in the IoTDB. Don't worry if you forget to create one, the IoTDB can automatically infer the data in the CSV to its corresponding data type, as long as you have a unique data type for each column. In addition to a single file, the tool supports importing multiple CSV files as f [...]
diff --git a/docs/zh/UserGuide/Write-Data/CSV-Tool.md b/docs/zh/UserGuide/Maintenance-Tools/CSV-Tool.md
similarity index 100%
rename from docs/zh/UserGuide/Write-Data/CSV-Tool.md
rename to docs/zh/UserGuide/Maintenance-Tools/CSV-Tool.md
diff --git a/docs/zh/UserGuide/Write-Data/TsFile-Tool.md b/docs/zh/UserGuide/Maintenance-Tools/TsFile-Load-Export-Tool.md
similarity index 100%
rename from docs/zh/UserGuide/Write-Data/TsFile-Tool.md
rename to docs/zh/UserGuide/Maintenance-Tools/TsFile-Load-Export-Tool.md
diff --git a/docs/zh/UserGuide/Write-Data/Batch-Load-Tool.md b/docs/zh/UserGuide/Write-Data/Batch-Load-Tool.md
new file mode 100644
index 0000000000..577c83e535
--- /dev/null
+++ b/docs/zh/UserGuide/Write-Data/Batch-Load-Tool.md
@@ -0,0 +1,32 @@
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one
+ or more contributor license agreements. See the NOTICE file
+ distributed with this work for additional information
+ regarding copyright ownership. The ASF licenses this file
+ to you under the Apache License, Version 2.0 (the
+ "License"); you may not use this file except in compliance
+ with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing,
+ software distributed under the License is distributed on an
+ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ KIND, either express or implied. See the License for the
+ specific language governing permissions and limitations
+ under the License.
+
+-->
+
+# 批量数据导入
+
+针对于不同场景，IoTDB 为用户提供多种批量导入数据的操作方式，本章节向大家介绍最为常用的两种方式为 CSV文本形式的导入 和 TsFile文件形式的导入。
+
+## TsFile批量导入
+
+TsFile 是在 IoTDB 中使用的时间序列的文件格式，您可以通过CLI等工具直接将存有时间序列的一个或多个 TsFile 文件导入到另外一个正在运行的IoTDB实例中。具体操作方式请参考 [TsFile 导入导出工具](../Maintenance-Tools/TsFile-Load-Export-Tool.md)。
+
+## CSV批量导入
+
+CSV 是以纯文本形式存储表格数据，您可以在CSV文件中写入多条格式化的数据，并批量的将这些数据导入到 IoTDB 中，在导入数据之前，建议在IoTDB中创建好对应的元数据信息。如果忘记创建元数据也不要担心，IoTDB 可以自动将CSV中数据推断为其对应的数据类型，前提是你每一列的数据类型必须唯一。除单个文件外，此工具还支持以文件夹的形式导入多个 CSV 文件，并且支持设置如时间精度等优化参数。具体操作方式请参考 [CSV 导入导出工具](../Maintenance-Tools/CSV-Tool.md)。
diff --git a/site/src/main/.vuepress/config.js b/site/src/main/.vuepress/config.js
index 87519fa710..89f62f8c95 100644
--- a/site/src/main/.vuepress/config.js
+++ b/site/src/main/.vuepress/config.js
@@ -909,7 +909,7 @@ var config = {
['Write-Data/REST-API','REST API'],
['Write-Data/MQTT','MQTT Write'],
['Write-Data/Load-External-Tsfile','Load External Tsfile'],
- ['Write-Data/CSV-Tool','CSV Tool'],
+ ['Write-Data/Batch-Load-Tool','Batch Data Load']
]
},
{
@@ -966,7 +966,9 @@ var config = {
['Maintenance-Tools/JMX-Tool','JMX Tool'],
['Maintenance-Tools/MLogParser-Tool','MLogParser Tool'],
['Maintenance-Tools/NodeTool','Node Tool'],
- ['Maintenance-Tools/TsFile-Split-Tool','TsFile Split Tool']
+ ['Maintenance-Tools/TsFile-Split-Tool','TsFile Split Tool'],
+ ['Maintenance-Tools/TsFile-Load-Export-Tool','TsFile Load Export Tool'],
+ ['Maintenance-Tools/CSV-Tool','CSV Load Export Tool'],
]
},
{
@@ -1860,7 +1862,7 @@ var config = {
['Write-Data/REST-API','REST 服务'],
['Write-Data/MQTT','MQTT写入'],
['Write-Data/Load-External-Tsfile','加载 TsFile'],
- ['Write-Data/CSV-Tool','导入导出 CSV']
+ ['Write-Data/Batch-Load-Tool','批量数据导入']
]
},
{
@@ -1948,7 +1950,9 @@ var config = {
['Maintenance-Tools/JMX-Tool','JMX 工具'],
['Maintenance-Tools/MLogParser-Tool','Mlog解析工具'],
['Maintenance-Tools/NodeTool','节点工具'],
- ['Maintenance-Tools/TsFile-Split-Tool','TsFile 拆分工具']
+ ['Maintenance-Tools/TsFile-Split-Tool','TsFile 拆分工具'],
+ ['Maintenance-Tools/TsFile-Load-Export-Tool','TsFile 导入导出工具'],
+ ['Maintenance-Tools/CSV-Tool','CSV 导入导出工具'],
]
},
{