You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by GitBox <gi...@apache.org> on 2022/07/19 13:32:02 UTC
[GitHub] [inlong] dockerzhang opened a new issue, #5133: [Feature] Add Apache InfluxDB Extract and Load Node for Sort
dockerzhang opened a new issue, #5133:
URL: https://github.com/apache/inlong/issues/5133
### Description
Add Apache InfluxDB Extract and Load Node for Sort, and you can refer to:
https://inlong.apache.org/docs/next/design_and_concept/how_to_extend_data_node_for_sort/#overview
### Use case
_No response_
### Are you willing to submit PR?
- [ ] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] ifndef-SleePy commented on issue #5133: [Feature] Add InfluxDB Extract and Load Node for Sort
Posted by GitBox <gi...@apache.org>.
ifndef-SleePy commented on issue #5133:
URL: https://github.com/apache/inlong/issues/5133#issuecomment-1190305007
Hi, @dockerzhang , could you assign this ticket to me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] Lu0-Wenfeng commented on issue #5133: [Feature] Add InfluxDB Extract and Load Node for Sort
Posted by GitBox <gi...@apache.org>.
Lu0-Wenfeng commented on issue #5133:
URL: https://github.com/apache/inlong/issues/5133#issuecomment-1200844248
# Task
Sort module should support InfluxDB.
InfluxDB is an open-source database for storing and analyzing time sequences. InfluxDB ranked the first place in the latest DB-ENGINES time sequence database ranking. Therefore, it will become more widespread among developers in the near future.
In detail, the tasks includes the following subtasks:
* Implement the Extract Node for InfluxDB
* Implement the Load Node for InfluxDB
* Implement the flink connector for InfluxDB
* Implement the Extract Node and Load Node in Manager module for InfluxDB
# Reference
https://inlong.apache.org/docs/design_and_concept/how_to_extend_data_node_for_sort/
https://inlong.apache.org/zh-CN/docs/design_and_concept/how_to_extend_data_node_for_manager/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] Lu0-Wenfeng commented on issue #5133: [Feature] Add InfluxDB Extract and Load Node for Sort
Posted by GitBox <gi...@apache.org>.
Lu0-Wenfeng commented on issue #5133:
URL: https://github.com/apache/inlong/issues/5133#issuecomment-1191823190
Hi, could you please assign this task to me? Thanks @dockerzhang
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Add InfluxDB Extract and Load Node for Sort [inlong]
Posted by "dockerzhang (via GitHub)" <gi...@apache.org>.
dockerzhang closed issue #5133: [Feature] Add InfluxDB Extract and Load Node for Sort
URL: https://github.com/apache/inlong/issues/5133
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] liangyepianzhou commented on issue #5133: [Feature] Add InfluxDB Extract and Load Node for Sort
Posted by GitBox <gi...@apache.org>.
liangyepianzhou commented on issue #5133:
URL: https://github.com/apache/inlong/issues/5133#issuecomment-1227236577
# Motivation
Sort module supports InfluxDB.
InfluxDs is a scalable datastore for metrics, events, and real-time analytics. We should support InfluxDB in sort module.
# Design
The design will follow following the document [Sort Plugin](https://inlong.apache.org/docs/design_and_concept/how_to_extend_data_node_for_sort) and [Manager Plugin](https://inlong.apache.org/zh-CN/docs/design_and_concept/how_to_extend_data_node_for_manager)
1. Extend a new Extract Node for InfluxDB
2. Extend a new Load Node for InfluxDB
3. Implement the corresponding flink connectors for InfluxDB
4. Extend Extract Node and Load Node in manager module for InfluxDB
# Modification
## Load Node
1. add the new class InfluxDBLoadNode, which inherits the LoadNode class
2. add the Load for InfluxDB to JsonSubTypes in LoadNode and Node
## Extract Node
1. add the new class InfluxDBExtractNode, which inherits the ExtractNode class
2. add the Extract for InfluxDB to JsonSubTypes in ExtractNode and Node
## Flink Connector
Creating new file called InfluxDB in inlong-sort/sort-connectors, Adding new classes into the file:
* InfluxDBTableSink
* InfluxDBTableSource
* InfluxDBTableFactory
* ConfigOptions
* InfluxDBCatalog
* InfluxDBCatalogFactory
# Manager plugin
Follow the document [Manager Plugin](https://inlong.apache.org/zh-CN/docs/design_and_concept/how_to_extend_data_node_for_manager) to extend the extract node and load node
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] github-actions[bot] commented on issue #5133: [Feature] Add InfluxDB Extract and Load Node for Sort
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5133:
URL: https://github.com/apache/inlong/issues/5133#issuecomment-1371653307
This issue is stale because it has been open for 60 days with no activity.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org