You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by GitBox <gi...@apache.org> on 2022/08/25 13:09:14 UTC
[GitHub] [inlong] liangyepianzhou commented on issue #5133: [Feature] Add InfluxDB Extract and Load Node for Sort
liangyepianzhou commented on issue #5133:
URL: https://github.com/apache/inlong/issues/5133#issuecomment-1227236577
# Motivation
Sort module supports InfluxDB.
InfluxDs is a scalable datastore for metrics, events, and real-time analytics. We should support InfluxDB in sort module.
# Design
The design will follow following the document [Sort Plugin](https://inlong.apache.org/docs/design_and_concept/how_to_extend_data_node_for_sort) and [Manager Plugin](https://inlong.apache.org/zh-CN/docs/design_and_concept/how_to_extend_data_node_for_manager)
1. Extend a new Extract Node for InfluxDB
2. Extend a new Load Node for InfluxDB
3. Implement the corresponding flink connectors for InfluxDB
4. Extend Extract Node and Load Node in manager module for InfluxDB
# Modification
## Load Node
1. add the new class InfluxDBLoadNode, which inherits the LoadNode class
2. add the Load for InfluxDB to JsonSubTypes in LoadNode and Node
## Extract Node
1. add the new class InfluxDBExtractNode, which inherits the ExtractNode class
2. add the Extract for InfluxDB to JsonSubTypes in ExtractNode and Node
## Flink Connector
Creating new file called InfluxDB in inlong-sort/sort-connectors, Adding new classes into the file:
* InfluxDBTableSink
* InfluxDBTableSource
* InfluxDBTableFactory
* ConfigOptions
* InfluxDBCatalog
* InfluxDBCatalogFactory
# Manager plugin
Follow the document [Manager Plugin](https://inlong.apache.org/zh-CN/docs/design_and_concept/how_to_extend_data_node_for_manager) to extend the extract node and load node
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org