[DSIP][Performance Improvement] Performance improvement for DolphinScheduler 2.0

[逆向顺风 <53...@qq.com.INVALID>]

Hi guys,

As we know, DolphinScheduler 2.0.0-alpha had been released days ago. It 20x faster than 1.3.x, and we will keep the performance optimization for it.
We hope DolphinScheduler is more stable and has higher performance, so it is a long-term challenge that needs to be done consistenly.


Actually, I already start it by adding DSIP issue [1], which contains six parts:  Master、Worker、Registry、DB、Netty and Performance Test.
And it will be a parent issue to track and summarize the optimization issue for ds 2.0 performance.
This is my initial idea, correct me if I wrong, looking forward your feedback.

If you have some performance test and suggestion  for ds, or just interested in performance optimization, welcome to join us by reply mail or GitHub issue[1].

[1]: https://github.com/apache/dolphinscheduler/issues/6666;




Best Wishes！— ShunFeng


 

Re: [DSIP][Performance Improvement] Performance improvement for DolphinScheduler 2.0

[Jiajie Zhong <zh...@hotmail.com>]

Well done, Shunfeng! Looking forward our performance improvement.

BTW, did we have some goal about it, after this DSIP finish.

Best Wish
— Jiajie

> On Nov 5, 2021, at 12:04, 逆向顺风 <53...@qq.com.INVALID> wrote:
> 
> Hi guys,
> 
> As we know,&nbsp;DolphinScheduler 2.0.0-alpha had been released days ago. It 20x faster than 1.3.x,&nbsp;and we will keep the performance optimization for it.
> We hope DolphinScheduler is more stable and has higher performance, so it is a long-term challenge that needs to be done consistenly.
> 
> 
> Actually, I already start it by adding DSIP issue [1], which contains six parts:&nbsp; Master、Worker、Registry、DB、Netty and Performance Test.
> And it will be a parent issue to track and summarize the optimization issue for ds 2.0 performance.
> This is my initial idea, correct me if I wrong, looking forward your feedback.
> 
> If you have some performance test and suggestion&nbsp;&nbsp;for ds, or just&nbsp;interested in performance optimization,&nbsp;welcome to join us by reply mail&nbsp;or GitHub issue[1].
> 
> [1]: https://github.com/apache/dolphinscheduler/issues/6666;
> 
> 
> 
> 
> Best Wishes！— ShunFeng
> 
> 
> &nbsp;