You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by GitBox <gi...@apache.org> on 2022/04/25 09:42:40 UTC
[GitHub] [incubator-inlong-website] dockerzhang opened a new pull request, #373: [INLONG-372][Doc] Add 1.1.0 release blog
dockerzhang opened a new pull request, #373:
URL: https://github.com/apache/incubator-inlong-website/pull/373
Fixes #372
where *XYZ* should be replaced by the actual issue number.
### Motivation
*Explain here the context, and why you're making that change. What is the problem you're trying to solve.*
### Modifications
*Describe the modifications you've done.*
### Verifying this change
- [ ] Make sure that the change passes the CI checks.
*(Please pick either of the following options)*
This change is a trivial rework / code cleanup without any test coverage.
*(or)*
This change is already covered by existing tests, such as *(please describe tests)*.
*(or)*
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end deployment with large payloads (10MB)*
- *Extended integration test for recovery after broker failure*
### Documentation
- Does this pull request introduce a new feature? (yes / no)
- If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
- If a feature is not applicable for documentation, explain why?
- If a feature is not documented yet in this PR, please create a followup issue for adding the documentation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong-website] healchow commented on a diff in pull request #373: [INLONG-372][Doc] Add 1.1.0 release blog
Posted by GitBox <gi...@apache.org>.
healchow commented on code in PR #373:
URL: https://github.com/apache/incubator-inlong-website/pull/373#discussion_r857455593
##########
blog/apache-inlong-1.1.0.md:
##########
@@ -0,0 +1,95 @@
+---
+title: Release InLong 1.1.0
+sidebar_position: 1
+---
+
+Apache InLong is a one-stop integration framework for massive data that provides automatic, secure and reliable data transmission capabilities. InLong supports both batch and stream data processing at the same time, which offers great power to build data analysis, modeling and other real-time applications based on streaming data.
+
+## 1.1.0 Features Overview
+The 1.1.0-incubating just released mainly includes the following:
+
+### Enhanced management capabilities for manager
+- Added Manager Client to support the integration of InLong for creating data streams
+- Added ManagerCtl command-line tool to support viewing and creating data streams
+- Manager supports dispatching Agent tasks
+- Manager supports dispatching Sort Flink tasks
+- Manger data streams management, supports start, restart, pause operations
+- Manager plugin support
+- Manager metadata management supports using MySQL
+- The first phase of cluster management, unified cluster information registration
+
+### Rich data nodes
+- Support Iceberg
+- Support ClickHouse
+- Support MySQL Binlog collection
+- Support Kafka ingestion
+- Sort Standalone supports multiple type streams
+
+### Tools construction
+- Dashboard plugin support
+- Kubernetes deployment optimization
+- Standalone deployment refactoring
+
+### System Upgrade
+- Protocol Buffers upgrade
+- Unified version Maven version dependencies
+- Fixed a bunch of dependency CVEs
+- DataProxy supports PB compression protocol
+
+This version closed about 642+ issues, including four 23 features and 180 improvements.
+
+## 1.1.0 Features Details
+### Add Manager Client
+The newly added Manager Client defines common InLong Group/Stream operation interfaces, including task creation, viewing and deletion. Through Manager Client, users can build InLong into any third-party platform to achieve unified customized platform construction. The Manager Client is mainly designed and implemented by @kipshi, @gong, @ciscozhou, thanks to three contributors.
+
+### Add ManagerCtl command line tool
+ManagerCtl is developed based on Manager Client and is a command-line tool for manipulating InLong resources, which can further simplify the use of developers. ManagerCtl was contributed independently by @haifxu and includes guidelines including:
+```
+Usage: managerctl [options] [command] [command options]
+Options:
+-h, --help
+Get all command about managerctl.
+Commands:
+create Create resource by json file
+Usage: create [options]
+
+describe Display details of one or more resources
+Usage: describe [options]
+
+list Displays main information for one or more resources
+Usage: list [options]
+```
+
+### Manager supports issuing Sort tasks
+In previous versions, after the user created the data group/stream task, Sort needed to submit it to the Flink cluster through the command line, and then perform data sorting. In version 1.1.0, we unified the start, stop, and suspend operations of Sort tasks to the Manager to complete. Users only need to configure the correct Flink cluster when the Manager is deployed. When the data stream is approved, Sort will be automatically started.
+This part of the work is mainly contributed by @LvJiancheng.
+
+### Manager metadata is saved to ZooKeeper
+InLong uses ZooKeeper to save data stream metadata, which increases the deployment threshold and operation and maintenance difficulty for developers and users.
+In version 1.1.0, we save data stream metadata in DB by default, and ZooKeeper is only an optional solution in large-scale scenarios. Thanks to @kipshi @yunqingmoswu for contributing a PR to ZooKeeper.
+
+### Support MySQL Binlog collection
+Version 1.1.0 fully supports the collection of data from MySQL, and supports both incremental and full strategies. Users can collect MySQL data with simple configuration in InLong. This part of the work was contributed by @EMsnap.
+
+### Sort Added Iceberg, ClickHouse, Kafka
+In version 1.1.0, the storage of data nodes for various scenarios has been added, including Iceberg, ClickHouse, and Kafka. The support of these three streams enriches the usage scenarios of InLong. New stream support, mainly contributed by @chantccc @KevinWen007 @healchow.
+
+### Sort Standalone supports Hive, ElasticSearch, Kafka
Review Comment:
`ElasticSearch` should be `Elasticsearch`. Could you please change it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong-website] dockerzhang merged pull request #373: [INLONG-372][Doc] Add 1.1.0 release blog
Posted by GitBox <gi...@apache.org>.
dockerzhang merged PR #373:
URL: https://github.com/apache/incubator-inlong-website/pull/373
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org