You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by gi...@apache.org on 2021/07/08 03:26:06 UTC
[incubator-inlong-website] branch asf-site updated: Automated
deployment: Thu Jul 8 03:25:59 UTC 2021
934c97f48087768a60afdae1bdc635a201a6ec6e
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-inlong-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new d187676 Automated deployment: Thu Jul 8 03:25:59 UTC 2021 934c97f48087768a60afdae1bdc635a201a6ec6e
d187676 is described below
commit d187676f70f562d5de167a6ac9b8d623ef4a58b6
Author: gosonzhang <go...@users.noreply.github.com>
AuthorDate: Thu Jul 8 03:26:00 2021 +0000
Automated deployment: Thu Jul 8 03:25:59 UTC 2021 934c97f48087768a60afdae1bdc635a201a6ec6e
---
docs/en-us/modules/agent/quick_start.md | 65 +++++------
docs/zh-cn/modules/agent/quick_start.md | 73 ++++++------
en-us/docs/modules/agent/quick_start.html | 178 +++++++++++++++---------------
en-us/docs/modules/agent/quick_start.json | 2 +-
en-us/docs/modules/agent/quick_start.md | 65 +++++------
zh-cn/docs/modules/agent/quick_start.html | 172 +++++++++++++++--------------
zh-cn/docs/modules/agent/quick_start.json | 2 +-
zh-cn/docs/modules/agent/quick_start.md | 73 ++++++------
8 files changed, 322 insertions(+), 308 deletions(-)
diff --git a/docs/en-us/modules/agent/quick_start.md b/docs/en-us/modules/agent/quick_start.md
index f2a2840..294e052 100644
--- a/docs/en-us/modules/agent/quick_start.md
+++ b/docs/en-us/modules/agent/quick_start.md
@@ -16,28 +16,32 @@
The agent supports two modes of operation: local operation and online operation
-###2.1 Agent configuration
+### 2.1 Agent configuration
Online operation needs to pull the configuration from inlong-manager, the configuration conf/agent.properties is as follows:
+```ini
agent.fetcher.classname=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (the class name for fetch tasks, default ManagerFetcher)
agent.local.ip=Write local ip
agent.manager.vip.http.host=manager host
agent.manager.vip.http.port=manager port
+```
-###2.2 Proxy configuration
+### 2.2 Proxy configuration
Create a new folder named .inlong\.managerIps in the agent directory, and create a new bid+.local file inside. For example, if the sending bid is set to a, then create a new file a.local
write:
+```ini
+{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":write proxy port,"host":"write proxy ip"}], "switch":0}
+```
- {"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":write proxy port,"host":"write proxy ip"}], "switch":0}
-
-###2.3 local job configuration
+### 2.3 local job configuration
If you do not use the online mode, you can use the local file to create a new read task
Create a new directory jobs in conf,
vim job1.json:
put
-
+```json
+ {
"job": {
"dir": {
@@ -67,30 +71,27 @@ put
}
}
-
-
+```
The meaning of each parameter is :
-
- job.dir.pattern: Configure the read file path, which can include regular expressions
-
- job.trigger: Trigger name, the default is DirectoryTrigger, the function is to monitor the files under the folder to generate events
-
- job.source: The type of data source used, the default is TextFileSource, which reads text files
-
- job.sink:The type of writer used, the default is ProxySink, which sends messages to the proxy
-
- proxy.bid: The bid type used when writing proxy
-
-###2.4 Add job configuration in real time
-
-##agent.propertities Modify the following two places
-
- # whether enable http service
- agent.http.enable=true
- # http default port
- agent.http.port=Available ports
-
+- job.dir.pattern: Configure the read file path, which can include regular expressions
+- job.trigger: Trigger name, the default is DirectoryTrigger, the function is to monitor the files under the folder to generate events
+- job.source: The type of data source used, the default is TextFileSource, which reads text files
+- job.sink:The type of writer used, the default is ProxySink, which sends messages to the proxy
+- proxy.bid: The bid type used when writing proxy
+
+### 2.4 Add job configuration in real time
+
+#### 2.4.1 agent.propertities Modify the following two places
+```ini
+# whether enable http service
+agent.http.enable=true
+# http default port
+agent.http.port=Available ports
+```
+
+#### 2.4.2 Execute the following command
+```bash
curl --location --request POST 'http://localhost:8129/config/job' \
--header 'Content-Type: application/json' \
--data '{
@@ -121,9 +122,11 @@ The meaning of each parameter is :
},
"op": "add"
}'
+```
-
-##3、run
+## 3、run
After decompression, run the following command
- sh agent.sh start
+```bash
+sh agent.sh start
+```
\ No newline at end of file
diff --git a/docs/zh-cn/modules/agent/quick_start.md b/docs/zh-cn/modules/agent/quick_start.md
index 2bfe2ce..3711af6 100644
--- a/docs/zh-cn/modules/agent/quick_start.md
+++ b/docs/zh-cn/modules/agent/quick_start.md
@@ -15,30 +15,33 @@
agent 支持两种运行模式:本地运行以及线上运行
-###2.1 Agent 线上运行相关设置
+### 2.1 Agent 线上运行相关设置
线上运行需要从inlong-manager拉取配置,配置conf/agent.properties如下:
+```ini
agent.fetcher.classname=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (设置任务获取的类名,默认为ManagerFetcher)
agent.local.ip=写入本机ip
agent.manager.vip.http.host=manager host
agent.manager.vip.http.port=manager port
+```
-###2.2 Proxy 相关设置
+### 2.2 Proxy 相关设置
在agent目录下新建.inlong\.managerIps文件夹,内部新建bid+.local文件,例如设置的发送bid为a, 则新建a.local文件
-内部写入:
+内部将写入:
+```ini
+{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":写入proxy port,"host":"写入proxy ip"}], "switch":0}
+```
- {"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":写入proxy port,"host":"写入proxy ip"}], "switch":0}
-
-###2.3 agent本地运行job配置
+### 2.3 agent本地运行job配置
如果不使用线上模式,可以使用本地文件新建读取任务
在conf中新建目录jobs,
vim job1.json:
写入
-
+```json
{
-
+
"job": {
"dir": {
@@ -68,30 +71,28 @@ vim job1.json:
}
}
-
+```
其中各个参数含义为:
-
- job.dir.pattern: 配置读取的文件路径,可包含正则表达式
-
- job.trigger: 触发器名称,默认为DirectoryTrigger,功能为监听文件夹下的文件产生事件
-
- job.source: 使用的数据源类型,默认为TextFileSource,读取文本文件
-
- job.sink:使用的写入器类型,默认为ProxySink,发送消息到proxy中
-
- proxy.bid: 写入proxy时使用的bid类型
-
-###2.4 实时添加job配置
-
-##agent.propertities 修改下面两处
-
- # whether enable http service
- agent.http.enable=true
- # http default port
- agent.http.port=可用端口
-
+- job.dir.pattern: 配置读取的文件路径,可包含正则表达式
+- job.trigger: 触发器名称,默认为DirectoryTrigger,功能为监听文件夹下的文件产生事件
+- job.source: 使用的数据源类型,默认为TextFileSource,读取文本文件
+- job.sink:使用的写入器类型,默认为ProxySink,发送消息到proxy中
+- proxy.bid: 写入proxy时使用的bid类型
+
+### 2.4 实时添加job配置
+
+#### 2.4.1 agent.propertities 修改下面两处
+```ini
+# whether enable http service
+agent.http.enable=true
+# http default port
+agent.http.port=可用端口
+```
+
+#### 2.4.2 执行如下命令:
+```bash
curl --location --request POST 'http://localhost:8129/config/job' \
--header 'Content-Type: application/json' \
--data '{
@@ -117,12 +118,14 @@ curl --location --request POST 'http://localhost:8129/config/job' \
},
"op": "add"
}'
+```
- 其中参数分别为:
- pattern: 代表读取/data/inlong-agent/test.log文件
- proxy.bid: 代表发送到proxy使用的bid
+其中参数分别为:
+- pattern: 代表读取/data/inlong-agent/test.log文件
+- proxy.bid: 代表发送到proxy使用的bid
-##三、运行
+## 三、运行
解压后如下命令运行
-
- sh agent.sh start
\ No newline at end of file
+```bash
+sh agent.sh start
+```
\ No newline at end of file
diff --git a/en-us/docs/modules/agent/quick_start.html b/en-us/docs/modules/agent/quick_start.html
index 11f1f5c..390f237 100644
--- a/en-us/docs/modules/agent/quick_start.html
+++ b/en-us/docs/modules/agent/quick_start.html
@@ -24,104 +24,104 @@ The tgz installation package can be found in the target under the agent-release
</code></pre>
<h2>2、Configuration</h2>
<p>The agent supports two modes of operation: local operation and online operation</p>
-<p>###2.1 Agent configuration</p>
-<p>Online operation needs to pull the configuration from inlong-manager, the configuration conf/agent.properties is as follows:
-agent.fetcher.classname=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (the class name for fetch tasks, default ManagerFetcher)
-agent.local.ip=Write local ip
-agent.manager.vip.http.host=manager host
-agent.manager.vip.http.port=manager port</p>
-<p>###2.2 Proxy configuration
-Create a new folder named .inlong.managerIps in the agent directory, and create a new bid+.local file inside. For example, if the sending bid is set to a, then create a new file a.local</p>
+<h3>2.1 Agent configuration</h3>
+<p>Online operation needs to pull the configuration from inlong-manager, the configuration conf/agent.properties is as follows:</p>
+<pre><code class="language-ini"><span class="hljs-attr">agent.fetcher.classname</span>=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (the class name for fetch tasks, default ManagerFetcher)
+<span class="hljs-attr">agent.local.ip</span>=Write local ip
+<span class="hljs-attr">agent.manager.vip.http.host</span>=manager host
+<span class="hljs-attr">agent.manager.vip.http.port</span>=manager port
+</code></pre>
+<h3>2.2 Proxy configuration</h3>
+<p>Create a new folder named .inlong.managerIps in the agent directory, and create a new bid+.local file inside. For example, if the sending bid is set to a, then create a new file a.local</p>
<p>write:</p>
-<pre><code>{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":write proxy port,"host":"write proxy ip"}], "switch":0}
+<pre><code class="language-ini">{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":write proxy port,"host":"write proxy ip"}], "switch":0}
</code></pre>
-<p>###2.3 local job configuration
-If you do not use the online mode, you can use the local file to create a new read task
+<h3>2.3 local job configuration</h3>
+<p>If you do not use the online mode, you can use the local file to create a new read task
Create a new directory jobs in conf,
vim job1.json:</p>
<p>put</p>
-<pre><code>"job": {
-
-"dir": {
-
-"pattern": "The path of the file to be read, which can contain regular expressions"
-
-},
-
-"trigger": "org.apache.inlong.agent.plugin.trigger.DirectoryTrigger",
-
-"id": 1,
-
-"name": "fileAgentTest",
-
-"source": "org.apache.inlong.agent.plugin.sources.TextFileSource",
-
-"sink": "org.apache.inlong.agent.plugin.sinks.ProxySink",
-
-"channel": "org.apache.inlong.agent.plugin.channel.MemoryChannel"
-
-},
-
-"proxy": {
-
-"bid": "testbid1"
-
-}
-
-}
+<pre><code class="language-json"> {
+ <span class="hljs-attr">"job"</span>: {
+
+ <span class="hljs-attr">"dir"</span>: {
+
+ <span class="hljs-attr">"pattern"</span>: <span class="hljs-string">"The path of the file to be read, which can contain regular expressions"</span>
+
+ },
+
+ <span class="hljs-attr">"trigger"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.trigger.DirectoryTrigger"</span>,
+
+ <span class="hljs-attr">"id"</span>: <span class="hljs-number">1</span>,
+
+ <span class="hljs-attr">"name"</span>: <span class="hljs-string">"fileAgentTest"</span>,
+
+ <span class="hljs-attr">"source"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.sources.TextFileSource"</span>,
+
+ <span class="hljs-attr">"sink"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.sinks.ProxySink"</span>,
+
+ <span class="hljs-attr">"channel"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.channel.MemoryChannel"</span>
+
+ },
+
+ <span class="hljs-attr">"proxy"</span>: {
+
+ <span class="hljs-attr">"bid"</span>: <span class="hljs-string">"testbid1"</span>
+
+ }
+
+ }
</code></pre>
<p>The meaning of each parameter is :</p>
-<pre><code>job.dir.pattern: Configure the read file path, which can include regular expressions
-
-job.trigger: Trigger name, the default is DirectoryTrigger, the function is to monitor the files under the folder to generate events
-
-job.source: The type of data source used, the default is TextFileSource, which reads text files
-
-job.sink:The type of writer used, the default is ProxySink, which sends messages to the proxy
-
-proxy.bid: The bid type used when writing proxy
+<ul>
+<li>job.dir.pattern: Configure the read file path, which can include regular expressions</li>
+<li>job.trigger: Trigger name, the default is DirectoryTrigger, the function is to monitor the files under the folder to generate events</li>
+<li>job.source: The type of data source used, the default is TextFileSource, which reads text files</li>
+<li>job.sink:The type of writer used, the default is ProxySink, which sends messages to the proxy</li>
+<li>proxy.bid: The bid type used when writing proxy</li>
+</ul>
+<h3>2.4 Add job configuration in real time</h3>
+<h4>2.4.1 agent.propertities Modify the following two places</h4>
+<pre><code class="language-ini"><span class="hljs-comment"># whether enable http service</span>
+<span class="hljs-attr">agent.http.enable</span>=<span class="hljs-literal">true</span>
+<span class="hljs-comment"># http default port</span>
+<span class="hljs-attr">agent.http.port</span>=Available ports
</code></pre>
-<p>###2.4 Add job configuration in real time</p>
-<p>##agent.propertities Modify the following two places</p>
-<pre><code># whether enable http service
-agent.http.enable=true
-# http default port
-agent.http.port=Available ports
-
-curl --location --request POST 'http://localhost:8129/config/job' \
---header 'Content-Type: application/json' \
---data '{
-"job": {
-"dir": {
-"path": "",
-"pattern": "/data/inlong-agent/test.log"
-},
-"trigger": "org.apache.inlong.agent.plugin.trigger.DirectoryTrigger",
-"id": 1,
-"thread": {
-"running": {
-"core": "4"
-},
-"onejob": true
-},
-"name": "fileAgentTest",
-"source": "org.apache.inlong.agent.plugin.sources.TextFileSource",
-"sink": "org.apache.inlong.agent.plugin.sinks.TdBusSink",
-"channel": "org.apache.inlong.agent.plugin.channel.MemoryChannel"
-},
-"bus": {
-"bid": "thirtybid10",
-"tdmanager": {
-"port": "8099",
-"host": "http://tl-tdbank-tdmanger.tencent-distribute.com"
-}
-},
-"op": "add"
-}'
+<h4>2.4.2 Execute the following command</h4>
+<pre><code class="language-bash"> curl --location --request POST <span class="hljs-string">'http://localhost:8129/config/job'</span> \
+ --header <span class="hljs-string">'Content-Type: application/json'</span> \
+ --data <span class="hljs-string">'{
+ "job": {
+ "dir": {
+ "path": "",
+ "pattern": "/data/inlong-agent/test.log"
+ },
+ "trigger": "org.apache.inlong.agent.plugin.trigger.DirectoryTrigger",
+ "id": 1,
+ "thread": {
+ "running": {
+ "core": "4"
+ },
+ "onejob": true
+ },
+ "name": "fileAgentTest",
+ "source": "org.apache.inlong.agent.plugin.sources.TextFileSource",
+ "sink": "org.apache.inlong.agent.plugin.sinks.TdBusSink",
+ "channel": "org.apache.inlong.agent.plugin.channel.MemoryChannel"
+ },
+ "bus": {
+ "bid": "thirtybid10",
+ "tdmanager": {
+ "port": "8099",
+ "host": "http://tl-tdbank-tdmanger.tencent-distribute.com"
+ }
+ },
+ "op": "add"
+ }'</span>
</code></pre>
-<p>##3、run
-After decompression, run the following command</p>
-<pre><code>sh agent.sh start
+<h2>3、run</h2>
+<p>After decompression, run the following command</p>
+<pre><code class="language-bash">sh agent.sh start
</code></pre>
</div></section><footer class="footer-container"><div class="footer-body"><img src="/img/incubator-logo.svg"/><div class="cols-container"><div class="col col-24"><p>Apache InLong (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with [...]
<script src="https://f.alicdn.com/react/15.4.1/react-with-addons.min.js"></script>
diff --git a/en-us/docs/modules/agent/quick_start.json b/en-us/docs/modules/agent/quick_start.json
index 6ab2fb3..a2fb6a0 100644
--- a/en-us/docs/modules/agent/quick_start.json
+++ b/en-us/docs/modules/agent/quick_start.json
@@ -1,6 +1,6 @@
{
"filename": "quick_start.md",
- "__html": "<h2>1、install</h2>\n<pre><code>env requirements:\njava JDK 1.8\nMaven 3.6 +\n\n\nmvn clean package -DskipTests\n\nThe tgz installation package can be found in the target under the agent-release\n</code></pre>\n<h2>2、Configuration</h2>\n<p>The agent supports two modes of operation: local operation and online operation</p>\n<p>###2.1 Agent configuration</p>\n<p>Online operation needs to pull the configuration from inlong-manager, the configuration conf/agent.properties is as f [...]
+ "__html": "<h2>1、install</h2>\n<pre><code>env requirements:\njava JDK 1.8\nMaven 3.6 +\n\n\nmvn clean package -DskipTests\n\nThe tgz installation package can be found in the target under the agent-release\n</code></pre>\n<h2>2、Configuration</h2>\n<p>The agent supports two modes of operation: local operation and online operation</p>\n<h3>2.1 Agent configuration</h3>\n<p>Online operation needs to pull the configuration from inlong-manager, the configuration conf/agent.properties is as fo [...]
"link": "/en-us/docs/modules/agent/quick_start.html",
"meta": {}
}
\ No newline at end of file
diff --git a/en-us/docs/modules/agent/quick_start.md b/en-us/docs/modules/agent/quick_start.md
index f2a2840..294e052 100644
--- a/en-us/docs/modules/agent/quick_start.md
+++ b/en-us/docs/modules/agent/quick_start.md
@@ -16,28 +16,32 @@
The agent supports two modes of operation: local operation and online operation
-###2.1 Agent configuration
+### 2.1 Agent configuration
Online operation needs to pull the configuration from inlong-manager, the configuration conf/agent.properties is as follows:
+```ini
agent.fetcher.classname=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (the class name for fetch tasks, default ManagerFetcher)
agent.local.ip=Write local ip
agent.manager.vip.http.host=manager host
agent.manager.vip.http.port=manager port
+```
-###2.2 Proxy configuration
+### 2.2 Proxy configuration
Create a new folder named .inlong\.managerIps in the agent directory, and create a new bid+.local file inside. For example, if the sending bid is set to a, then create a new file a.local
write:
+```ini
+{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":write proxy port,"host":"write proxy ip"}], "switch":0}
+```
- {"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":write proxy port,"host":"write proxy ip"}], "switch":0}
-
-###2.3 local job configuration
+### 2.3 local job configuration
If you do not use the online mode, you can use the local file to create a new read task
Create a new directory jobs in conf,
vim job1.json:
put
-
+```json
+ {
"job": {
"dir": {
@@ -67,30 +71,27 @@ put
}
}
-
-
+```
The meaning of each parameter is :
-
- job.dir.pattern: Configure the read file path, which can include regular expressions
-
- job.trigger: Trigger name, the default is DirectoryTrigger, the function is to monitor the files under the folder to generate events
-
- job.source: The type of data source used, the default is TextFileSource, which reads text files
-
- job.sink:The type of writer used, the default is ProxySink, which sends messages to the proxy
-
- proxy.bid: The bid type used when writing proxy
-
-###2.4 Add job configuration in real time
-
-##agent.propertities Modify the following two places
-
- # whether enable http service
- agent.http.enable=true
- # http default port
- agent.http.port=Available ports
-
+- job.dir.pattern: Configure the read file path, which can include regular expressions
+- job.trigger: Trigger name, the default is DirectoryTrigger, the function is to monitor the files under the folder to generate events
+- job.source: The type of data source used, the default is TextFileSource, which reads text files
+- job.sink:The type of writer used, the default is ProxySink, which sends messages to the proxy
+- proxy.bid: The bid type used when writing proxy
+
+### 2.4 Add job configuration in real time
+
+#### 2.4.1 agent.propertities Modify the following two places
+```ini
+# whether enable http service
+agent.http.enable=true
+# http default port
+agent.http.port=Available ports
+```
+
+#### 2.4.2 Execute the following command
+```bash
curl --location --request POST 'http://localhost:8129/config/job' \
--header 'Content-Type: application/json' \
--data '{
@@ -121,9 +122,11 @@ The meaning of each parameter is :
},
"op": "add"
}'
+```
-
-##3、run
+## 3、run
After decompression, run the following command
- sh agent.sh start
+```bash
+sh agent.sh start
+```
\ No newline at end of file
diff --git a/zh-cn/docs/modules/agent/quick_start.html b/zh-cn/docs/modules/agent/quick_start.html
index 19acace..eea3373 100644
--- a/zh-cn/docs/modules/agent/quick_start.html
+++ b/zh-cn/docs/modules/agent/quick_start.html
@@ -24,104 +24,106 @@ mvn clean package -DskipTests
</code></pre>
<h2>二、配置</h2>
<p>agent 支持两种运行模式:本地运行以及线上运行</p>
-<p>###2.1 Agent 线上运行相关设置</p>
-<p>线上运行需要从inlong-manager拉取配置,配置conf/agent.properties如下:
-agent.fetcher.classname=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (设置任务获取的类名,默认为ManagerFetcher)
-agent.local.ip=写入本机ip
-agent.manager.vip.http.host=manager host
-agent.manager.vip.http.port=manager port</p>
-<p>###2.2 Proxy 相关设置
-在agent目录下新建.inlong.managerIps文件夹,内部新建bid+.local文件,例如设置的发送bid为a, 则新建a.local文件</p>
-<p>内部写入:</p>
-<pre><code>{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":写入proxy port,"host":"写入proxy ip"}], "switch":0}
+<h3>2.1 Agent 线上运行相关设置</h3>
+<p>线上运行需要从inlong-manager拉取配置,配置conf/agent.properties如下:</p>
+<pre><code class="language-ini"><span class="hljs-attr">agent.fetcher.classname</span>=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (设置任务获取的类名,默认为ManagerFetcher)
+<span class="hljs-attr">agent.local.ip</span>=写入本机ip
+<span class="hljs-attr">agent.manager.vip.http.host</span>=manager host
+<span class="hljs-attr">agent.manager.vip.http.port</span>=manager port
</code></pre>
-<p>###2.3 agent本地运行job配置
-如果不使用线上模式,可以使用本地文件新建读取任务
+<h3>2.2 Proxy 相关设置</h3>
+<p>在agent目录下新建.inlong.managerIps文件夹,内部新建bid+.local文件,例如设置的发送bid为a, 则新建a.local文件</p>
+<p>内部将写入:</p>
+<pre><code class="language-ini">{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":写入proxy port,"host":"写入proxy ip"}], "switch":0}
+</code></pre>
+<h3>2.3 agent本地运行job配置</h3>
+<p>如果不使用线上模式,可以使用本地文件新建读取任务
在conf中新建目录jobs,
vim job1.json:</p>
<p>写入</p>
-<pre><code>{
-
-"job": {
-
-"dir": {
-
-"pattern": "需要读取的文件路径,可包含正则表达式,例如test/inlong_[0-9]{1},监听test下创建的新文件"
-
-},
-
-"trigger": "org.apache.inlong.agent.plugin.trigger.DirectoryTrigger",
-
-"id": 1,
-
-"name": "fileAgentTest",
-
-"source": "org.apache.inlong.agent.plugin.sources.TextFileSource",
-
-"sink": "org.apache.inlong.agent.plugin.sinks.ProxySink",
-
-"channel": "org.apache.inlong.agent.plugin.channel.MemoryChannel"
-
-},
-
-"proxy": {
-
-"bid": "testbid1"
-
-}
-
-}
+<pre><code class="language-json"> {
+
+ <span class="hljs-attr">"job"</span>: {
+
+ <span class="hljs-attr">"dir"</span>: {
+
+ <span class="hljs-attr">"pattern"</span>: <span class="hljs-string">"需要读取的文件路径,可包含正则表达式,例如test/inlong_[0-9]{1},监听test下创建的新文件"</span>
+
+ },
+
+ <span class="hljs-attr">"trigger"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.trigger.DirectoryTrigger"</span>,
+
+ <span class="hljs-attr">"id"</span>: <span class="hljs-number">1</span>,
+
+ <span class="hljs-attr">"name"</span>: <span class="hljs-string">"fileAgentTest"</span>,
+
+ <span class="hljs-attr">"source"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.sources.TextFileSource"</span>,
+
+ <span class="hljs-attr">"sink"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.sinks.ProxySink"</span>,
+
+ <span class="hljs-attr">"channel"</span>: <span class="hljs-string">"org.apache.inlong.agent.plugin.channel.MemoryChannel"</span>
+
+ },
+
+ <span class="hljs-attr">"proxy"</span>: {
+
+ <span class="hljs-attr">"bid"</span>: <span class="hljs-string">"testbid1"</span>
+
+ }
+
+ }
</code></pre>
<p>其中各个参数含义为:</p>
-<pre><code>job.dir.pattern: 配置读取的文件路径,可包含正则表达式
-
-job.trigger: 触发器名称,默认为DirectoryTrigger,功能为监听文件夹下的文件产生事件
-
-job.source: 使用的数据源类型,默认为TextFileSource,读取文本文件
-
-job.sink:使用的写入器类型,默认为ProxySink,发送消息到proxy中
-
-proxy.bid: 写入proxy时使用的bid类型
-</code></pre>
-<p>###2.4 实时添加job配置</p>
-<p>##agent.propertities 修改下面两处</p>
-<pre><code># whether enable http service
-agent.http.enable=true
-# http default port
-agent.http.port=可用端口
+<ul>
+<li>job.dir.pattern: 配置读取的文件路径,可包含正则表达式</li>
+<li>job.trigger: 触发器名称,默认为DirectoryTrigger,功能为监听文件夹下的文件产生事件</li>
+<li>job.source: 使用的数据源类型,默认为TextFileSource,读取文本文件</li>
+<li>job.sink:使用的写入器类型,默认为ProxySink,发送消息到proxy中</li>
+<li>proxy.bid: 写入proxy时使用的bid类型</li>
+</ul>
+<h3>2.4 实时添加job配置</h3>
+<h4>2.4.1 agent.propertities 修改下面两处</h4>
+<pre><code class="language-ini"><span class="hljs-comment"># whether enable http service</span>
+<span class="hljs-attr">agent.http.enable</span>=<span class="hljs-literal">true</span>
+<span class="hljs-comment"># http default port</span>
+<span class="hljs-attr">agent.http.port</span>=可用端口
</code></pre>
-<p>curl --location --request POST '<a href="http://localhost:8129/config/job">http://localhost:8129/config/job</a>' <br>
---header 'Content-Type: application/json' <br>
---data '{
-"job": {
-"dir": {
-"path": "",
-"pattern": "/data/inlong-agent/test.log"
+<h4>2.4.2 执行如下命令:</h4>
+<pre><code class="language-bash">curl --location --request POST <span class="hljs-string">'http://localhost:8129/config/job'</span> \
+--header <span class="hljs-string">'Content-Type: application/json'</span> \
+--data <span class="hljs-string">'{
+"job": {
+"dir": {
+"path": "",
+"pattern": "/data/inlong-agent/test.log"
},
-"trigger": "org.apache.inlong.agent.plugin.trigger.DirectoryTrigger",
-"id": 1,
-"thread": {
-"running": {
-"core": "4"
+"trigger": "org.apache.inlong.agent.plugin.trigger.DirectoryTrigger",
+"id": 1,
+"thread": {
+"running": {
+"core": "4"
}
},
-"name": "fileAgentTest",
-"source": "org.apache.inlong.agent.plugin.sources.TextFileSource",
-"sink": "org.apache.inlong.agent.plugin.sinks.TdBusSink",
-"channel": "org.apache.inlong.agent.plugin.channel.MemoryChannel"
+"name": "fileAgentTest",
+"source": "org.apache.inlong.agent.plugin.sources.TextFileSource",
+"sink": "org.apache.inlong.agent.plugin.sinks.TdBusSink",
+"channel": "org.apache.inlong.agent.plugin.channel.MemoryChannel"
},
-"proxy": {
-"bid": "thirtybid10"
+"proxy": {
+"bid": "thirtybid10"
},
-"op": "add"
-}'</p>
-<pre><code>其中参数分别为:
-pattern: 代表读取/data/inlong-agent/test.log文件
-proxy.bid: 代表发送到proxy使用的bid
+"op": "add"
+}'</span>
+</code></pre>
+<p>其中参数分别为:</p>
+<ul>
+<li>pattern: 代表读取/data/inlong-agent/test.log文件</li>
+<li>proxy.bid: 代表发送到proxy使用的bid</li>
+</ul>
+<h2>三、运行</h2>
+<p>解压后如下命令运行</p>
+<pre><code class="language-bash">sh agent.sh start
</code></pre>
-<p>##三、运行
-解压后如下命令运行</p>
-<pre><code>sh agent.sh start</code></pre>
</div></section><footer class="footer-container"><div class="footer-body"><img src="/img/incubator-logo.svg"/><div class="cols-container"><div class="col col-24"><p>Apache InLong (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with [...]
<script src="https://f.alicdn.com/react/15.4.1/react-with-addons.min.js"></script>
<script src="https://f.alicdn.com/react/15.4.1/react-dom.min.js"></script>
diff --git a/zh-cn/docs/modules/agent/quick_start.json b/zh-cn/docs/modules/agent/quick_start.json
index cd0a434..7db6905 100644
--- a/zh-cn/docs/modules/agent/quick_start.json
+++ b/zh-cn/docs/modules/agent/quick_start.json
@@ -1,6 +1,6 @@
{
"filename": "quick_start.md",
- "__html": "<h2>~~~~一、安装</h2>\n<pre><code>环境要求:\njava JDK 1.8\nMaven 3.6 +\n\ninlong目录下执行命令\nmvn clean package -DskipTests\n\n在项目下的agent-release/target里面可以找到tgz安装包\n</code></pre>\n<h2>二、配置</h2>\n<p>agent 支持两种运行模式:本地运行以及线上运行</p>\n<p>###2.1 Agent 线上运行相关设置</p>\n<p>线上运行需要从inlong-manager拉取配置,配置conf/agent.properties如下:\nagent.fetcher.classname=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (设置任务获取的类名,默认为ManagerFetcher)\nagent.local.ip=写入本机ip\nagent.manager.vip.http.host=manager host\na [...]
+ "__html": "<h2>~~~~一、安装</h2>\n<pre><code>环境要求:\njava JDK 1.8\nMaven 3.6 +\n\ninlong目录下执行命令\nmvn clean package -DskipTests\n\n在项目下的agent-release/target里面可以找到tgz安装包\n</code></pre>\n<h2>二、配置</h2>\n<p>agent 支持两种运行模式:本地运行以及线上运行</p>\n<h3>2.1 Agent 线上运行相关设置</h3>\n<p>线上运行需要从inlong-manager拉取配置,配置conf/agent.properties如下:</p>\n<pre><code class=\"language-ini\"><span class=\"hljs-attr\">agent.fetcher.classname</span>=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (设置任务获取的类名,默认为ManagerFetche [...]
"link": "/zh-cn/docs/modules/agent/quick_start.html",
"meta": {}
}
\ No newline at end of file
diff --git a/zh-cn/docs/modules/agent/quick_start.md b/zh-cn/docs/modules/agent/quick_start.md
index 2bfe2ce..3711af6 100644
--- a/zh-cn/docs/modules/agent/quick_start.md
+++ b/zh-cn/docs/modules/agent/quick_start.md
@@ -15,30 +15,33 @@
agent 支持两种运行模式:本地运行以及线上运行
-###2.1 Agent 线上运行相关设置
+### 2.1 Agent 线上运行相关设置
线上运行需要从inlong-manager拉取配置,配置conf/agent.properties如下:
+```ini
agent.fetcher.classname=org.apache.inlong.agent.plugin.fetcher.ManagerFetcher (设置任务获取的类名,默认为ManagerFetcher)
agent.local.ip=写入本机ip
agent.manager.vip.http.host=manager host
agent.manager.vip.http.port=manager port
+```
-###2.2 Proxy 相关设置
+### 2.2 Proxy 相关设置
在agent目录下新建.inlong\.managerIps文件夹,内部新建bid+.local文件,例如设置的发送bid为a, 则新建a.local文件
-内部写入:
+内部将写入:
+```ini
+{"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":写入proxy port,"host":"写入proxy ip"}], "switch":0}
+```
- {"cluster_id":1,"isInterVisit":1,"size":1,"address": [{"port":写入proxy port,"host":"写入proxy ip"}], "switch":0}
-
-###2.3 agent本地运行job配置
+### 2.3 agent本地运行job配置
如果不使用线上模式,可以使用本地文件新建读取任务
在conf中新建目录jobs,
vim job1.json:
写入
-
+```json
{
-
+
"job": {
"dir": {
@@ -68,30 +71,28 @@ vim job1.json:
}
}
-
+```
其中各个参数含义为:
-
- job.dir.pattern: 配置读取的文件路径,可包含正则表达式
-
- job.trigger: 触发器名称,默认为DirectoryTrigger,功能为监听文件夹下的文件产生事件
-
- job.source: 使用的数据源类型,默认为TextFileSource,读取文本文件
-
- job.sink:使用的写入器类型,默认为ProxySink,发送消息到proxy中
-
- proxy.bid: 写入proxy时使用的bid类型
-
-###2.4 实时添加job配置
-
-##agent.propertities 修改下面两处
-
- # whether enable http service
- agent.http.enable=true
- # http default port
- agent.http.port=可用端口
-
+- job.dir.pattern: 配置读取的文件路径,可包含正则表达式
+- job.trigger: 触发器名称,默认为DirectoryTrigger,功能为监听文件夹下的文件产生事件
+- job.source: 使用的数据源类型,默认为TextFileSource,读取文本文件
+- job.sink:使用的写入器类型,默认为ProxySink,发送消息到proxy中
+- proxy.bid: 写入proxy时使用的bid类型
+
+### 2.4 实时添加job配置
+
+#### 2.4.1 agent.propertities 修改下面两处
+```ini
+# whether enable http service
+agent.http.enable=true
+# http default port
+agent.http.port=可用端口
+```
+
+#### 2.4.2 执行如下命令:
+```bash
curl --location --request POST 'http://localhost:8129/config/job' \
--header 'Content-Type: application/json' \
--data '{
@@ -117,12 +118,14 @@ curl --location --request POST 'http://localhost:8129/config/job' \
},
"op": "add"
}'
+```
- 其中参数分别为:
- pattern: 代表读取/data/inlong-agent/test.log文件
- proxy.bid: 代表发送到proxy使用的bid
+其中参数分别为:
+- pattern: 代表读取/data/inlong-agent/test.log文件
+- proxy.bid: 代表发送到proxy使用的bid
-##三、运行
+## 三、运行
解压后如下命令运行
-
- sh agent.sh start
\ No newline at end of file
+```bash
+sh agent.sh start
+```
\ No newline at end of file