You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/07/26 13:43:33 UTC
[GitHub] [incubator-seatunnel] EricJoy2048 opened a new issue, #2272: [ST-Engine] Design And Task Tracking
EricJoy2048 opened a new issue, #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
This issue can help us tracking the design of SeaTunnelEngine.
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ic4y commented on issue #2272: [ST-Engine] Design And Task Tracking
Posted by GitBox <gi...@apache.org>.
ic4y commented on issue #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272#issuecomment-1197562276
TaskExecutionService and Task related design : https://github.com/apache/incubator-seatunnel/issues/2279
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] hailin0 commented on issue #2272: [ST-Engine] Design And Task Tracking
Posted by GitBox <gi...@apache.org>.
hailin0 commented on issue #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272#issuecomment-1245565145
ST-Engine integration log ecosystem #2725
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] lhyundeadsoul commented on issue #2272: [ST-Engine] Design And Task Tracking
Posted by GitBox <gi...@apache.org>.
lhyundeadsoul commented on issue #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272#issuecomment-1197891488
The design proposals above are detailed designs.
As a rookie, I want to know :
1. What's the background of the new engine? What's the primary scenario? (Running on IoT device in edge computing? or substitute of flink in the cloud?)
2. Since the positioning of ST is Data Integration, What's the most crucial character of the st-engine? And what is unnecessary in the st-engine but important to flink/spark (checkpoint)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Umbrella][ST-Engine] Design And Task Tracking [seatunnel]
Posted by "Hisoka-X (via GitHub)" <gi...@apache.org>.
Hisoka-X closed issue #2272: [Umbrella][ST-Engine] Design And Task Tracking
URL: https://github.com/apache/seatunnel/issues/2272
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] lhyundeadsoul commented on issue #2272: [ST-Engine] Design And Task Tracking
Posted by GitBox <gi...@apache.org>.
lhyundeadsoul commented on issue #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272#issuecomment-1198805867
>
Thx for your answer.
No aggregate operator/ No state management, that makes sense for a data integration engine. But, Can SQL transformation plugin still be used in st-engine?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #2272: [ST-Engine] Design And Task Tracking
Posted by GitBox <gi...@apache.org>.
EricJoy2048 commented on issue #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272#issuecomment-1201969472
>
We plan support Code Transformation first. And, In the feature, we will support SQL.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ashulin commented on issue #2272: [ST-Engine] Design And Task Tracking
Posted by GitBox <gi...@apache.org>.
ashulin commented on issue #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272#issuecomment-1196139414
Job fault-tolerant(Checkpoint): https://github.com/apache/incubator-seatunnel/issues/2274
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ashulin commented on issue #2272: [ST-Engine] Design And Task Tracking
Posted by GitBox <gi...@apache.org>.
ashulin commented on issue #2272:
URL: https://github.com/apache/incubator-seatunnel/issues/2272#issuecomment-1197920316
> The design proposals above are detailed designs. As a rookie, I am really interested in the following questions:
>
> 1. What's the background of the new engine? What's the primary scenario? (Running on IoT device in edge computing? or substitute of flink in the cloud?)
> 2. Since the positioning of ST is Data Integration, What's the most crucial character of the st-engine? And what is unnecessary in the st-engine but important to flink/spark (checkpoint)?
@lhyundeadsoul 1: https://github.com/apache/incubator-seatunnel/issues/1954
2: Seatunnel engine will not have aggregate calculation, such as join, window and other operations that require large state
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org