You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by Zhengyu Zhang <fr...@gmail.com> on 2024/01/17 06:16:25 UTC
Request new doris-streamloader repo under apache
Hi list!
We are engineers at SelectDB. We are developing a streamload tool that
is intended to be
a robust, feature-rich and user-friendly alternative to the
traditional curl command, offering
the following features:
- Automatically split splittable data files and do parallel loading to
boost load performance
- Support multiple files & directories load with one shot
- Support path traversal when the target is a directory
- Resume loading from where it failed or is manually canceled
- Automatically retry when failure
- Provide easily understandable input parameters
Since this tool is mainly independent with the Doris core and will be
released in a different
versioning plan, we would like to develop it in a separate repo (i.e.
'doris-streamloader').
All the best!
Zhengyu
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org
Re:Request new doris-streamloader repo under apache
Posted by Mingyu Chen <mo...@163.com>.
Good to see that, I'm glad to create a new repo for this tool.
The name is `doris-streamloader`
--
Best Regards
Mingyu Chen
Email:
morningman@apache.org
At 2024-01-17 14:16:25, "Zhengyu Zhang" <fr...@gmail.com> wrote:
>Hi list!
>
>We are engineers at SelectDB. We are developing a streamload tool that
>is intended to be
>a robust, feature-rich and user-friendly alternative to the
>traditional curl command, offering
>the following features:
>
>- Automatically split splittable data files and do parallel loading to
>boost load performance
>- Support multiple files & directories load with one shot
>- Support path traversal when the target is a directory
>- Resume loading from where it failed or is manually canceled
>- Automatically retry when failure
>- Provide easily understandable input parameters
>
>Since this tool is mainly independent with the Doris core and will be
>released in a different
>versioning plan, we would like to develop it in a separate repo (i.e.
>'doris-streamloader').
>
>
>All the best!
>Zhengyu
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
>For additional commands, e-mail: dev-help@doris.apache.org