You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@seatunnel.apache.org by Destiny狄杰 <nj...@gmail.com> on 2022/09/05 12:00:24 UTC
About seatunnel-web present and future
Dear all:
We are currently working on Seatunnel's Web Platform and we have a few
things to sync up
1. current progress
A. Scheduler: The basic combination with DolphinScheduler has been
completed, including execution, rerun, stop, list and other operations
B. User management: CRUD and simple permission management have been
performed.
C. Script management: CRUD and publish script to job or other
operations.
D. Front-end: development based on PRD
Most of the features of the MVP version have been developed and tested,
will release soon.
2. What we do next
A. Unified datasource: As an independent module, it provides basic
datasource management and can be integrated in any project. In addition, it
will also play an important role in future wizard mode.
In addition to the basic datasource 's CRUD, we can extend more
functions
i. Automatically collect basic data statistics to understand
the data preferably
j. Simple data exploration, including standard DBMS and
unstructured datasources
k. Monitoring of structural changes of datasources can help us
find problems in advance
B. Extra a module named task-executor, not crontab-local.
Task-executor is a module independent of the scheduling engine. It would Be
responsible for actually executing the seatunnel-script, run on local or
K8S pod, etc. For more features we will have a detailed design
document to explain the relevant things
Re: About seatunnel-web present and future
Posted by Zongwen Li <zo...@gmail.com>.
For 2.A, this can be extended in the
`org.apache.seatunnel.api.table.catalog.Catalog` of `seatunnel-api` module.
Best wishes,
Zongwen Li
CalvinKirs <ac...@163.com> 于2022年9月5日周一 21:16写道：
> I like J,It's an exciting feature, looking forward to your detailed design
> and I think it would more contributors could join
>
>
> Best wishes！
> Calvin Kirs
>
>
> On 09/5/2022 21:14，CalvinKirs<ac...@163.com> wrote：
>
>
>
>
> Best wishes！
> Calvin Kirs
>
>
> On 09/5/2022 20:00，Destiny狄杰<nj...@gmail.com> wrote：
> Dear all:
>
> We are currently working on Seatunnel's Web Platform and we have a few
> things to sync up
>
> 1. current progress
>
> A. Scheduler: The basic combination with DolphinScheduler has been
> completed, including execution, rerun, stop, list and other operations
>
> B. User management: CRUD and simple permission management have been
> performed.
>
> C. Script management: CRUD and publish script to job or other
> operations.
>
> D. Front-end: development based on PRD
>
> Most of the features of the MVP version have been developed and tested,
> will release soon.
>
>
> 2. What we do next
>
> A. Unified datasource: As an independent module, it provides basic
> datasource management and can be integrated in any project. In addition, it
> will also play an important role in future wizard mode.
>
> In addition to the basic datasource 's CRUD, we can extend more
> functions
>
> i. Automatically collect basic data statistics to understand
> the data preferably
>
> j. Simple data exploration, including standard DBMS and
> unstructured datasources
> It's an exciting feature, looking forward to your detailed design and I
> think it would more contributors could join
>
> k. Monitoring of structural changes of datasources can help us
> find problems in advance
>
> B. Extra a module named task-executor, not crontab-local.
> Task-executor is a module independent of the scheduling engine. It would Be
> responsible for actually executing the seatunnel-script, run on local or
> K8S pod, etc. For more features we will have a detailed design
> document to explain the relevant things
>
Re:About seatunnel-web present and future
Posted by CalvinKirs <ac...@163.com>.
I like J,It's an exciting feature, looking forward to your detailed design and I think it would more contributors could join
Best wishes！
Calvin Kirs
On 09/5/2022 21:14，CalvinKirs<ac...@163.com> wrote：
Best wishes！
Calvin Kirs
On 09/5/2022 20:00，Destiny狄杰<nj...@gmail.com> wrote：
Dear all:
We are currently working on Seatunnel's Web Platform and we have a few
things to sync up
1. current progress
A. Scheduler: The basic combination with DolphinScheduler has been
completed, including execution, rerun, stop, list and other operations
B. User management: CRUD and simple permission management have been
performed.
C. Script management: CRUD and publish script to job or other
operations.
D. Front-end: development based on PRD
Most of the features of the MVP version have been developed and tested,
will release soon.
2. What we do next
A. Unified datasource: As an independent module, it provides basic
datasource management and can be integrated in any project. In addition, it
will also play an important role in future wizard mode.
In addition to the basic datasource 's CRUD, we can extend more
functions
i. Automatically collect basic data statistics to understand
the data preferably
j. Simple data exploration, including standard DBMS and
unstructured datasources
It's an exciting feature, looking forward to your detailed design and I think it would more contributors could join
k. Monitoring of structural changes of datasources can help us
find problems in advance
B. Extra a module named task-executor, not crontab-local.
Task-executor is a module independent of the scheduling engine. It would Be
responsible for actually executing the seatunnel-script, run on local or
K8S pod, etc. For more features we will have a detailed design
document to explain the relevant things
Re:About seatunnel-web present and future
Posted by CalvinKirs <ac...@163.com>.
Best wishes！
Calvin Kirs
On 09/5/2022 20:00，Destiny狄杰<nj...@gmail.com> wrote：
Dear all:
We are currently working on Seatunnel's Web Platform and we have a few
things to sync up
1. current progress
A. Scheduler: The basic combination with DolphinScheduler has been
completed, including execution, rerun, stop, list and other operations
B. User management: CRUD and simple permission management have been
performed.
C. Script management: CRUD and publish script to job or other
operations.
D. Front-end: development based on PRD
Most of the features of the MVP version have been developed and tested,
will release soon.
2. What we do next
A. Unified datasource: As an independent module, it provides basic
datasource management and can be integrated in any project. In addition, it
will also play an important role in future wizard mode.
In addition to the basic datasource 's CRUD, we can extend more
functions
i. Automatically collect basic data statistics to understand
the data preferably
j. Simple data exploration, including standard DBMS and
unstructured datasources
It's an exciting feature, looking forward to your detailed design and I think it would more contributors could join
k. Monitoring of structural changes of datasources can help us
find problems in advance
B. Extra a module named task-executor, not crontab-local.
Task-executor is a module independent of the scheduling engine. It would Be
responsible for actually executing the seatunnel-script, run on local or
K8S pod, etc. For more features we will have a detailed design
document to explain the relevant things
Re: About seatunnel-web present and future
Posted by Lucifer Tyrant <ty...@apache.org>.
Hi
This is really exciting news! Looking forward to the MVP version!
Chao Tian
BR
范佳 <fa...@qq.com.invalid> 于2022年9月5日周一 20:27写道：
> Hi
>
> Happy to heard this news, good job!
>
> Looking forward to the MVP version
>
> ________________________
>
> Jia Fan
>
>
>
> > 2022年9月5日 20:00，Destiny狄杰 <nj...@gmail.com> 写道：
> >
> > Dear all:
> >
> > We are currently working on Seatunnel's Web Platform and we have a few
> > things to sync up
> >
> > 1. current progress
> >
> > A. Scheduler: The basic combination with DolphinScheduler has been
> > completed, including execution, rerun, stop, list and other operations
> >
> > B. User management: CRUD and simple permission management have
> been
> > performed.
> >
> > C. Script management: CRUD and publish script to job or other
> > operations.
> >
> > D. Front-end: development based on PRD
> >
> > Most of the features of the MVP version have been developed and
> tested,
> > will release soon.
> >
> >
> > 2. What we do next
> >
> > A. Unified datasource: As an independent module, it provides basic
> > datasource management and can be integrated in any project. In addition,
> it
> > will also play an important role in future wizard mode.
> >
> > In addition to the basic datasource 's CRUD, we can extend more
> > functions
> >
> > i. Automatically collect basic data statistics to understand
> > the data preferably
> >
> > j. Simple data exploration, including standard DBMS and
> > unstructured datasources
> >
> > k. Monitoring of structural changes of datasources can help us
> > find problems in advance
> >
> > B. Extra a module named task-executor, not crontab-local.
> > Task-executor is a module independent of the scheduling engine. It would
> Be
> > responsible for actually executing the seatunnel-script, run on local or
> > K8S pod, etc. For more features we will have a detailed design
> > document to explain the relevant things
> >
>
>
Re: About seatunnel-web present and future
Posted by 范佳 <fa...@qq.com.INVALID>.
Hi
Happy to heard this news, good job!
Looking forward to the MVP version
________________________
Jia Fan
> 2022年9月5日 20:00，Destiny狄杰 <nj...@gmail.com> 写道：
>
> Dear all:
>
> We are currently working on Seatunnel's Web Platform and we have a few
> things to sync up
>
> 1. current progress
>
> A. Scheduler: The basic combination with DolphinScheduler has been
> completed, including execution, rerun, stop, list and other operations
>
> B. User management: CRUD and simple permission management have been
> performed.
>
> C. Script management: CRUD and publish script to job or other
> operations.
>
> D. Front-end: development based on PRD
>
> Most of the features of the MVP version have been developed and tested,
> will release soon.
>
>
> 2. What we do next
>
> A. Unified datasource: As an independent module, it provides basic
> datasource management and can be integrated in any project. In addition, it
> will also play an important role in future wizard mode.
>
> In addition to the basic datasource 's CRUD, we can extend more
> functions
>
> i. Automatically collect basic data statistics to understand
> the data preferably
>
> j. Simple data exploration, including standard DBMS and
> unstructured datasources
>
> k. Monitoring of structural changes of datasources can help us
> find problems in advance
>
> B. Extra a module named task-executor, not crontab-local.
> Task-executor is a module independent of the scheduling engine. It would Be
> responsible for actually executing the seatunnel-script, run on local or
> K8S pod, etc. For more features we will have a detailed design
> document to explain the relevant things
>