You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by "e-mhui (via GitHub)" <gi...@apache.org> on 2023/06/27 09:46:34 UTC

[GitHub] [inlong-website] e-mhui opened a new pull request, #787: [INLONG-783][Doc][HDFS] Describe tables using MarkDown

e-mhui opened a new pull request, #787:
URL: https://github.com/apache/inlong-website/pull/787

   ### Prepare a Pull Request
   *(Change the title refer to the following example)*
   
   - Title Example: [INLONG-XYZ][Component] Title of the pull request
   
   *(The following *XYZ* should be replaced by the actual [GitHub Issue](https://github.com/apache/inlong/issues) number)*
   
   - Fixes #783
   
   ### Motivation
   
   *Explain here the context, and why you're making that change. What is the problem you're trying to solve.*
   
   ### Modifications
   
   *Describe the modifications you've done.*
   
   ### Verifying this change
   
   - [ ] Make sure that the change passes the CI checks.
   
   *(Please pick either of the following options)*
   
   This change is a trivial rework / code cleanup without any test coverage.
   
   *(or)*
   
   This change is already covered by existing tests, such as *(please describe tests)*.
   
   *(or)*
   
   This change added tests and can be verified as follows:
   
   *(example:)*
     - *Added integration tests for end-to-end deployment with large payloads (10MB)*
     - *Extended integration test for recovery after broker failure*
   
   ### Documentation
   
     - Does this pull request introduce a new feature? (yes / no)
     - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
     - If a feature is not applicable for documentation, explain why?
     - If a feature is not documented yet in this PR, please create a followup issue for adding the documentation
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [inlong-website] dockerzhang merged pull request #787: [INLONG-783][Doc][HDFS] Describe tables using MarkDown

Posted by "dockerzhang (via GitHub)" <gi...@apache.org>.
dockerzhang merged PR #787:
URL: https://github.com/apache/inlong-website/pull/787


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [inlong-website] e-mhui commented on a diff in pull request #787: [INLONG-783][Doc][HDFS] Describe tables using MarkDown

Posted by "e-mhui (via GitHub)" <gi...@apache.org>.
e-mhui commented on code in PR #787:
URL: https://github.com/apache/inlong-website/pull/787#discussion_r1244678424


##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/hdfs.md:
##########
@@ -50,73 +49,21 @@ CREATE TABLE hdfs_load_node (
 数据会被加载到文件的目录下的 part 文件中,每个分区接收到来之 subtask 的数据至少会为该分区生成一个 part 文件。同时可以配置滚动策略
 来生成 part 文件,生成 part 文件会将 in-progress part 文件关闭。该策略基于大小和指定文件被打开的超时时间来生成 part 文件。
 
-<table class="table table-bordered">
-    <thead>
-      <tr>
-          <th class="text-left" style={{width: '10%'}}>参数</th>
-          <th class="text-left" style={{width: '7%'}}>默认值</th>
-          <th class="text-left" style={{width: '10%'}}>数据类型</th>
-          <th class="text-left" style={{width: '65%'}}>描述</th>
-      </tr>
-    </thead>
-    <tbody>
-    <tr>
-        <td><h5>sink.rolling-policy.file-size</h5></td>
-        <td style={{wordWrap: 'break-word'}}>128MB</td>
-        <td>MemorySize</td>
-        <td>滚动前 part 文件的最大值。</td>
-    </tr>
-    <tr>
-      <td><h5>sink.rolling-policy.rollover-interval</h5></td>
-      <td style={{wordWrap: 'break-word'}}>30 min</td>
-      <td>String</td>
-      <td>滚动前,part 文件处于打开状态的最大时长(默认值30分钟,以避免产生大量小文件)。
-       检查频率是由 'sink.rolling-policy.check-interval' 属性控制的。</td>
-    </tr>
-    <tr>
-      <td><h5>sink.rolling-policy.check-interval</h5></td>
-      <td style={{wordWrap: 'break-word'}}>1 min</td>
-      <td>String</td>
-      <td>基于时间的滚动策略的检查间隔。
-      该属性控制了基于 'sink.rolling-policy.rollover-interval' 属性检查文件是否该被滚动的检查频率。</td>
-    </tr>
-    </tbody>
-</table>
+| 参数  | 默认值 | 数据类型 | 描述  |
+| --- | --- | --- | --- |
+|  sink.rolling-policy.file-size | 128MB | MemorySize | 滚动前 part 文件的最大值。 |
+|  sink.rolling-policy.rollover-interval | 30 min | String | 滚动前,part 文件处于打开状态的最大时长(默认值30分钟,以避免产生大量小文件)。 检查频率是由 'sink.rolling-policy.check-interval' 属性控制的。 |
+|  sink.rolling-policy.check-interval | 1 min | String | 基于时间的滚动策略的检查间隔。 该属性控制了基于 'sink.rolling-policy.rollover-interval' 属性检查文件是否该被滚动的检查频率。 |
 
 #### 文件合并 
+
 支持文件能力,允许在较小的 checkpoint 下不产生大量的小文件。
-<table class="table table-bordered">
-    <thead>
-      <tr>
-          <th class="text-left" style={{width: '10%'}}>参数</th>
-          <th class="text-left" style={{width: '7%'}}>默认值</th>
-          <th class="text-left" style={{width: '10%'}}>数据类型</th>
-          <th class="text-left" style={{width: '65%'}}>描述</th>
-      </tr>
-    </thead>
-    <tbody>
-    <tr>
-        <td><h5>auto-compaction</h5></td>
-        <td style={{wordWrap: 'break-word'}}>false</td>
-        <td>Boolean</td>
-        <td>在流式 sink 中是否开启自动合并功能,数据首先会被写入临时文件。
-        当 checkpoint 完成后,该检查点产生的临时文件会被合并,这些临时文件在合并前不可见。</td>
-    </tr>
-    <tr>
-      <td><h5>compaction.file-size</h5></td>
-      <td style={{wordWrap: 'break-word'}}>(none)</td>
-      <td>String</td>
-      <td>合并目标文件大小,默认值为滚动文件大小。</td>
-    </tr>
-    <tr>
-      <td>inlong.metric.labels</td>
-      <td>可选</td>
-      <td style={{wordWrap: 'break-word'}}>(none)</td>
-      <td>String</td>
-      <td>inlong metric 的标签值,该值的构成为groupId=[groupId]&streamId=[streamId]&nodeId=[nodeId]。</td> 
-    </tr>
-    </tbody>
-</table>
+
+| 参数  | 默认值 | 数据类型 | 描述  |
+| --- | --- | --- | --- | 
+|  auto-compaction | false | Boolean | 在流式 sink 中是否开启自动合并功能,数据首先会被写入临时文件。 当 checkpoint 完成后,该检查点产生的临时文件会被合并,这些临时文件在合并前不可见。 |
+|  compaction.file-size | (none) | String | 合并目标文件大小,默认值为滚动文件大小。 |
+| inlong.metric.labels | (none) | String | inlong metric 的标签值,该值的构成为groupId=g[groupId]&streamId=[streamId]&nodeId=[nodeId]。 |

Review Comment:
   Done.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [inlong-website] yunqingmoswu commented on a diff in pull request #787: [INLONG-783][Doc][HDFS] Describe tables using MarkDown

Posted by "yunqingmoswu (via GitHub)" <gi...@apache.org>.
yunqingmoswu commented on code in PR #787:
URL: https://github.com/apache/inlong-website/pull/787#discussion_r1244632381


##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/hdfs.md:
##########
@@ -50,73 +49,21 @@ CREATE TABLE hdfs_load_node (
 数据会被加载到文件的目录下的 part 文件中,每个分区接收到来之 subtask 的数据至少会为该分区生成一个 part 文件。同时可以配置滚动策略
 来生成 part 文件,生成 part 文件会将 in-progress part 文件关闭。该策略基于大小和指定文件被打开的超时时间来生成 part 文件。
 
-<table class="table table-bordered">
-    <thead>
-      <tr>
-          <th class="text-left" style={{width: '10%'}}>参数</th>
-          <th class="text-left" style={{width: '7%'}}>默认值</th>
-          <th class="text-left" style={{width: '10%'}}>数据类型</th>
-          <th class="text-left" style={{width: '65%'}}>描述</th>
-      </tr>
-    </thead>
-    <tbody>
-    <tr>
-        <td><h5>sink.rolling-policy.file-size</h5></td>
-        <td style={{wordWrap: 'break-word'}}>128MB</td>
-        <td>MemorySize</td>
-        <td>滚动前 part 文件的最大值。</td>
-    </tr>
-    <tr>
-      <td><h5>sink.rolling-policy.rollover-interval</h5></td>
-      <td style={{wordWrap: 'break-word'}}>30 min</td>
-      <td>String</td>
-      <td>滚动前,part 文件处于打开状态的最大时长(默认值30分钟,以避免产生大量小文件)。
-       检查频率是由 'sink.rolling-policy.check-interval' 属性控制的。</td>
-    </tr>
-    <tr>
-      <td><h5>sink.rolling-policy.check-interval</h5></td>
-      <td style={{wordWrap: 'break-word'}}>1 min</td>
-      <td>String</td>
-      <td>基于时间的滚动策略的检查间隔。
-      该属性控制了基于 'sink.rolling-policy.rollover-interval' 属性检查文件是否该被滚动的检查频率。</td>
-    </tr>
-    </tbody>
-</table>
+| 参数  | 默认值 | 数据类型 | 描述  |
+| --- | --- | --- | --- |
+|  sink.rolling-policy.file-size | 128MB | MemorySize | 滚动前 part 文件的最大值。 |
+|  sink.rolling-policy.rollover-interval | 30 min | String | 滚动前,part 文件处于打开状态的最大时长(默认值30分钟,以避免产生大量小文件)。 检查频率是由 'sink.rolling-policy.check-interval' 属性控制的。 |
+|  sink.rolling-policy.check-interval | 1 min | String | 基于时间的滚动策略的检查间隔。 该属性控制了基于 'sink.rolling-policy.rollover-interval' 属性检查文件是否该被滚动的检查频率。 |
 
 #### 文件合并 
+
 支持文件能力,允许在较小的 checkpoint 下不产生大量的小文件。
-<table class="table table-bordered">
-    <thead>
-      <tr>
-          <th class="text-left" style={{width: '10%'}}>参数</th>
-          <th class="text-left" style={{width: '7%'}}>默认值</th>
-          <th class="text-left" style={{width: '10%'}}>数据类型</th>
-          <th class="text-left" style={{width: '65%'}}>描述</th>
-      </tr>
-    </thead>
-    <tbody>
-    <tr>
-        <td><h5>auto-compaction</h5></td>
-        <td style={{wordWrap: 'break-word'}}>false</td>
-        <td>Boolean</td>
-        <td>在流式 sink 中是否开启自动合并功能,数据首先会被写入临时文件。
-        当 checkpoint 完成后,该检查点产生的临时文件会被合并,这些临时文件在合并前不可见。</td>
-    </tr>
-    <tr>
-      <td><h5>compaction.file-size</h5></td>
-      <td style={{wordWrap: 'break-word'}}>(none)</td>
-      <td>String</td>
-      <td>合并目标文件大小,默认值为滚动文件大小。</td>
-    </tr>
-    <tr>
-      <td>inlong.metric.labels</td>
-      <td>可选</td>
-      <td style={{wordWrap: 'break-word'}}>(none)</td>
-      <td>String</td>
-      <td>inlong metric 的标签值,该值的构成为groupId=[groupId]&streamId=[streamId]&nodeId=[nodeId]。</td> 
-    </tr>
-    </tbody>
-</table>
+
+| 参数  | 默认值 | 数据类型 | 描述  |
+| --- | --- | --- | --- | 
+|  auto-compaction | false | Boolean | 在流式 sink 中是否开启自动合并功能,数据首先会被写入临时文件。 当 checkpoint 完成后,该检查点产生的临时文件会被合并,这些临时文件在合并前不可见。 |
+|  compaction.file-size | (none) | String | 合并目标文件大小,默认值为滚动文件大小。 |
+| inlong.metric.labels | (none) | String | inlong metric 的标签值,该值的构成为groupId=g[groupId]&streamId=[streamId]&nodeId=[nodeId]。 |

Review Comment:
   Add a space for `groupId...` between chinese words.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org