You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iotdb.apache.org by su...@apache.org on 2021/03/26 15:41:01 UTC
[iotdb] branch NewDoc_HDFS created (now 7a90de7)
This is an automated email from the ASF dual-hosted git repository.
sunzesong pushed a change to branch NewDoc_HDFS
in repository https://gitbox.apache.org/repos/asf/iotdb.git.
at 7a90de7 [To NewDoc] Update tsfile storage on HDFS docs
This branch includes the following new commits:
new 7a90de7 [To NewDoc] Update tsfile storage on HDFS docs
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[iotdb] 01/01: [To NewDoc] Update tsfile storage on HDFS docs
Posted by su...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
sunzesong pushed a commit to branch NewDoc_HDFS
in repository https://gitbox.apache.org/repos/asf/iotdb.git
commit 7a90de7fe7759e80354635243526ed142f1f6a22
Author: samperson1997 <sz...@mails.tsinghua.edu.cn>
AuthorDate: Fri Mar 26 23:40:22 2021 +0800
[To NewDoc] Update tsfile storage on HDFS docs
---
docs/UserGuide/Architecture/Writing Data on HDFS.md | 12 ++++++------
docs/zh/UserGuide/Architecture/Writing Data on HDFS.md | 12 ++++++------
2 files changed, 12 insertions(+), 12 deletions(-)
diff --git a/docs/UserGuide/Architecture/Writing Data on HDFS.md b/docs/UserGuide/Architecture/Writing Data on HDFS.md
index 5837d99..57f371d 100644
--- a/docs/UserGuide/Architecture/Writing Data on HDFS.md
+++ b/docs/UserGuide/Architecture/Writing Data on HDFS.md
@@ -35,11 +35,11 @@ When you config to store TSFile on HDFS, your data files will be in distributed
To store TSFile and related data files in HDFS, here are the steps:
-First, download the source release from website or git clone the repository, the tag of a released version is release/x.x.x
+First, download the source release from website or git clone the repository
-Build server and Hadoop module by: `mvn clean package -pl server,hadoop -am -Dmaven.test.skip=true`
+Build server and Hadoop module by: `mvn clean package -pl server,hadoop -am -Dmaven.test.skip=true -P get-jar-with-dependencies`
-Then, copy the target jar of Hadoop module `hadoop-tsfile-0.10.0-jar-with-dependencies.jar` into server target lib folder `.../server/target/iotdb-server-0.10.0/lib`.
+Then, copy the target jar of Hadoop module `hadoop-tsfile-X.X.X-jar-with-dependencies.jar` into server target lib folder `.../server/target/iotdb-server-X.X.X/lib`.
Edit user config in `iotdb-engine.properties`. Related configurations are:
@@ -153,7 +153,7 @@ Edit user config in `iotdb-engine.properties`. Related configurations are:
Start server, and Tsfile will be stored on HDFS.
-To reset storage file system to local, just edit configuration `tsfile_storage_fs` to `LOCAL`. In this situation, if data files are already on HDFS, you should either download them to local and move them to your config data file folder (`../server/target/iotdb-server-0.10.0/data/data` by default), or restart your process and import data to IoTDB.
+To reset storage file system to local, just edit configuration `tsfile_storage_fs` to `LOCAL`. In this situation, if data files are already on HDFS, you should either download them to local and move them to your config data file folder (`../server/target/iotdb-server-X.X.X/data/data` by default), or restart your process and import data to IoTDB.
#### Frequent questions
@@ -167,5 +167,5 @@ ERROR org.apache.iotdb.tsfile.fileSystem.fsFactory.HDFSFactory:62 - Failed to ge
```
A: It indicates that you forget to put Hadoop module dependency in IoTDB server. You can solve it by:
-* Build Hadoop module: `mvn clean package -pl hadoop -am -Dmaven.test.skip=true`
-* Copy the target jar of Hadoop module `hadoop-tsfile-0.10.0-jar-with-dependencies.jar` into server target lib folder `.../server/target/iotdb-server-0.10.0/lib`.
+* Build Hadoop module: `mvn clean package -pl hadoop -am -Dmaven.test.skip=true -P get-jar-with-dependencies`
+* Copy the target jar of Hadoop module `hadoop-tsfile-X.X.X-jar-with-dependencies.jar` into server target lib folder `.../server/target/iotdb-server-X.X.X/lib`.
diff --git a/docs/zh/UserGuide/Architecture/Writing Data on HDFS.md b/docs/zh/UserGuide/Architecture/Writing Data on HDFS.md
index 00d77cd..0d62915 100644
--- a/docs/zh/UserGuide/Architecture/Writing Data on HDFS.md
+++ b/docs/zh/UserGuide/Architecture/Writing Data on HDFS.md
@@ -35,11 +35,11 @@
如果你希望将TSFile存储在HDFS上，可以遵循以下步骤：
-首先下载对应版本的源码发布版或者下载 github 仓库，发布版代码的 tag 为 release/x.x.x
+首先下载对应版本的源码发布版或者下载 github 仓库
-使用maven打包server和Hadoop模块：`mvn clean package -pl server,hadoop -am -Dmaven.test.skip=true`
+使用maven打包server和Hadoop模块：`mvn clean package -pl server,hadoop -am -Dmaven.test.skip=true -P get-jar-with-dependencies`
-然后，将Hadoop模块的target jar包`hadoop-tsfile-0.10.0-jar-with-dependencies.jar`复制到server模块的target lib文件夹 `.../server/target/iotdb-server-0.10.0/lib`下。
+然后，将Hadoop模块的target jar包`hadoop-tsfile-X.X.X-jar-with-dependencies.jar`复制到server模块的target lib文件夹 `.../server/target/iotdb-server-X.X.X/lib`下。
编辑`iotdb-engine.properties`中的用户配置。相关配置项包括：
@@ -153,7 +153,7 @@
启动server, Tsfile将会被存储到HDFS上。
-如果你想要恢复将TSFile存储到本地文件系统，只需编辑配置项`tsfile_storage_fs`为`LOCAL`。在这种情况下，如果你已经在HDFS上存储了一些数据文件，你需要将它们下载到本地，并移动到你所配置的数据文件文件夹（默认为`../server/target/iotdb-server-0.10.0/data/data`）， 或者重新开始你的整个导入数据过程。
+如果你想要恢复将TSFile存储到本地文件系统，只需编辑配置项`tsfile_storage_fs`为`LOCAL`。在这种情况下，如果你已经在HDFS上存储了一些数据文件，你需要将它们下载到本地，并移动到你所配置的数据文件文件夹（默认为`../server/target/iotdb-server-X.X.X/data/data`）， 或者重新开始你的整个导入数据过程。
#### 常见问题
@@ -167,5 +167,5 @@ ERROR org.apache.iotdb.tsfile.fileSystem.fsFactory.HDFSFactory:62 - Failed to ge
```
A: 这表明你没有将Hadoop模块的以来放到IoTDB server中。你可以这样解决：
-* 使用Maven打包Hadoop模块: `mvn clean package -pl hadoop -am -Dmaven.test.skip=true`
-* 将Hadoop模块的target jar包`hadoop-tsfile-0.10.0-jar-with-dependencies.jar`复制到server模块的target lib文件夹 `.../server/target/iotdb-server-0.10.0/lib`下。
+* 使用Maven打包Hadoop模块: `mvn clean package -pl hadoop -am -Dmaven.test.skip=true -P get-jar-with-dependencies`
+* 将Hadoop模块的target jar包`hadoop-tsfile-X.X.X-jar-with-dependencies.jar`复制到server模块的target lib文件夹 `.../server/target/iotdb-server-X.X.X/lib`下。