You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@doris.apache.org by 德李 <li...@apache.org> on 2019/04/19 04:01:51 UTC

[DISCUSS] Propose to release Apache Doris(incubating) 0.10.0

Hi all,

I propose to discuss the release of Doris 0.10.0.

It will include some important features, and you can also add other feature
to below list:

1. Unified Loading Framework
You can refer to the email "[DISCUSS] Unify the load framework in Doris".
a) Improve the performance of broker and mini load by using the framework of
stream load.
b) The loading of large file is supported by the unified framework.

2. Routine Load Job
a) Introduce Build-in routine load manager
b) Automatically Data Consuming and Loading

3. Doris on ElasticSearch
It enable us to query ElasticSearch on Doris by SQL way.

4. Performance Optimization
a) Introduce high-efficient Decimal
b) Parallel Fragment Instance

5. Usability
a) Introduce UDF
b) More HLL functions
c) More metrics to monitor
d) Bug fixed

Best Regards,
Reed

Re:Re: [DISCUSS] Propose to release Apache Doris(incubating) 0.10.0

Posted by 陈明雨 <mo...@163.com>.

Yes, there are still some pending issues, we will fix them later. You can check list here:
https://github.com/apache/incubator-doris/issues?q=is%3Aissue+is%3Aopen+label%3Abug+milestone%3A0.11


And I forgot to paste the document of Doris on ES, which can be found here:
https://github.com/apache/incubator-doris/blob/master/docs/documentation/cn/extending-doris/doris-on-es.md


--
此致！Best Regards
陈明雨 Mingyu Chen

Email:
chenmingyu@apache.org



At 2019-05-14 14:47:25, "Zhao Chun" <bu...@gmail.com> wrote:
>We have some pending issues which are belong to 0.10.0. Before we release
>we need to handle these issues.
>
>Thanks,
>ZHAO Chun
>
>
>
>Zhao Chun <bu...@gmail.com> 于2019年5月14日周二 下午2:13写道：
>
>> Yes, It has been a long time since we release 0.9.0. And we have developed
>> some interesting features.
>>
>> give my +1 for releasing our new version.
>>
>> Thanks for your job Mingyu.
>>
>> Thanks,
>> ZHAO Chun
>>
>>
>>
>> 陈明雨 <mo...@163.com> 于2019年5月14日周二 下午1:59写道：
>>
>>> Hi all,
>>> Somethings delayed our 0.10.0 release.
>>> I think it is time to release the version 0.10.0 as some exciting feature
>>> are fully implements.
>>> The major features show as bellow:
>>>
>>>
>>> New Features:
>>>
>>>
>>> * Support Routine Load
>>>
>>>
>>> Doris now support routine load job, which allow user to create a routine
>>> load job with simple instruction, and the data will be consumed and loaded
>>> into Doris automatically. More information and guide can be found in
>>> [例行导入使用手册](
>>> https://github.com/apache/incubator-doris/blob/master/docs/documentation/cn/administrator-guide/load-data/routine-load-manual.md
>>> ).
>>>
>>>
>>> * Support Doris on ES
>>>
>>>
>>> Doris now support querying Elasticsearch. User can create an extern table
>>> with engine type `ES`, and query it as a noraml table. Doris also support a
>>> new built-in function `es_query()`, which allow user to write special
>>> Elasticsearch query language in SQL. More information and guide can be
>>> found in []()
>>>
>>>
>>> * Support UDF and UDAF
>>>
>>>
>>> Now user can write UDF and UDAF in C++ language.
>>>
>>>
>>> * New documentation framework
>>>
>>>
>>> All documents of Doris will be moved to the directory
>>> `docs/documentation/`. You can see [README](
>>> https://github.com/apache/incubator-doris/blob/master/docs/readme.md) to
>>> get more information, and help us complete the documentations. Any
>>> documents are welcome.
>>> There is also a new directory `samples/` which contains some samples of
>>> using Doris.
>>>
>>>
>>> Enhancement:
>>>
>>>
>>> * High performance Decimal type implementation.(#727)
>>> * Parallel execution of fragment instance (#851)
>>> * Support hll_union_agg in Analytic Function (#819)
>>> * Support hll_raw_agg in Aggregate Function (#832)
>>> * Support adding columns to multiple rollup indexes in one ALTER TABLE
>>> stmt (#931)
>>>
>>>
>>> Usability:
>>>
>>>
>>> * Add --daemon option to all start scripts (#642)
>>> * Remove the restrict that delete stmt must specify partition even for
>>> unpartitioned table (#668)
>>> * Remove restrict of that Analytic function must have partition by clause
>>> (#659)
>>> * Support `enable_insert_strict` session variable to control the insert
>>> request (#1013)
>>> * Support NEGATIVE keyword in Broker Load (#1101)
>>> * Support more functions which can be calculated in Frontends:
>>> unix_timestamp(), str_to_date(), current_user(), user()
>>> * Support more built-in functions: money_format(), left(), right()
>>> * New metrics: disk_state, tablet_distribution, scheduled_tablet_num
>>> * Forward some requests to Master Frontend to get accurate results (#944)
>>>
>>>
>>> Bug fixed:
>>>
>>>
>>> * A lot of bugs fixed. Please see [ISSUES](
>>> https://github.com/apache/incubator-doris/issues) to get more
>>> information.
>>>
>>>
>>> --
>>> 此致！Best Regards
>>> 陈明雨 Mingyu Chen
>>>
>>> Email:
>>> chenmingyu@apache.org
>>>
>>>
>>>
>>> At 2019-04-19 12:01:51, "德 李" <li...@apache.org> wrote:
>>> >Hi all,
>>> >
>>> >I propose to discuss the release of Doris 0.10.0.
>>> >
>>> >It will include some important features, and you can also add other
>>> feature
>>> >to below list:
>>> >
>>> >1. Unified Loading Framework
>>> >You can refer to the email "[DISCUSS] Unify the load framework in Doris".
>>> >a) Improve the performance of broker and mini load by using the
>>> framework of
>>> >stream load.
>>> >b) The loading of large file is supported by the unified framework.
>>> >
>>> >2. Routine Load Job
>>> >a) Introduce Build-in routine load manager
>>> >b) Automatically Data Consuming and Loading
>>> >
>>> >3. Doris on ElasticSearch
>>> >It enable us to query ElasticSearch on Doris by SQL way.
>>> >
>>> >4. Performance Optimization
>>> >a) Introduce high-efficient Decimal
>>> >b) Parallel Fragment Instance
>>> >
>>> >5. Usability
>>> >a) Introduce UDF
>>> >b) More HLL functions
>>> >c) More metrics to monitor
>>> >d) Bug fixed
>>> >
>>> >Best Regards,
>>> >Reed
>>> >
>>> >
>>>
>>

Re: [DISCUSS] Propose to release Apache Doris(incubating) 0.10.0

Posted by Zhao Chun <bu...@gmail.com>.

We have some pending issues which are belong to 0.10.0. Before we release
we need to handle these issues.

Thanks,
ZHAO Chun



Zhao Chun <bu...@gmail.com> 于2019年5月14日周二 下午2:13写道：

> Yes, It has been a long time since we release 0.9.0. And we have developed
> some interesting features.
>
> give my +1 for releasing our new version.
>
> Thanks for your job Mingyu.
>
> Thanks,
> ZHAO Chun
>
>
>
> 陈明雨 <mo...@163.com> 于2019年5月14日周二 下午1:59写道：
>
>> Hi all,
>> Somethings delayed our 0.10.0 release.
>> I think it is time to release the version 0.10.0 as some exciting feature
>> are fully implements.
>> The major features show as bellow:
>>
>>
>> New Features:
>>
>>
>> * Support Routine Load
>>
>>
>> Doris now support routine load job, which allow user to create a routine
>> load job with simple instruction, and the data will be consumed and loaded
>> into Doris automatically. More information and guide can be found in
>> [例行导入使用手册](
>> https://github.com/apache/incubator-doris/blob/master/docs/documentation/cn/administrator-guide/load-data/routine-load-manual.md
>> ).
>>
>>
>> * Support Doris on ES
>>
>>
>> Doris now support querying Elasticsearch. User can create an extern table
>> with engine type `ES`, and query it as a noraml table. Doris also support a
>> new built-in function `es_query()`, which allow user to write special
>> Elasticsearch query language in SQL. More information and guide can be
>> found in []()
>>
>>
>> * Support UDF and UDAF
>>
>>
>> Now user can write UDF and UDAF in C++ language.
>>
>>
>> * New documentation framework
>>
>>
>> All documents of Doris will be moved to the directory
>> `docs/documentation/`. You can see [README](
>> https://github.com/apache/incubator-doris/blob/master/docs/readme.md) to
>> get more information, and help us complete the documentations. Any
>> documents are welcome.
>> There is also a new directory `samples/` which contains some samples of
>> using Doris.
>>
>>
>> Enhancement:
>>
>>
>> * High performance Decimal type implementation.(#727)
>> * Parallel execution of fragment instance (#851)
>> * Support hll_union_agg in Analytic Function (#819)
>> * Support hll_raw_agg in Aggregate Function (#832)
>> * Support adding columns to multiple rollup indexes in one ALTER TABLE
>> stmt (#931)
>>
>>
>> Usability:
>>
>>
>> * Add --daemon option to all start scripts (#642)
>> * Remove the restrict that delete stmt must specify partition even for
>> unpartitioned table (#668)
>> * Remove restrict of that Analytic function must have partition by clause
>> (#659)
>> * Support `enable_insert_strict` session variable to control the insert
>> request (#1013)
>> * Support NEGATIVE keyword in Broker Load (#1101)
>> * Support more functions which can be calculated in Frontends:
>> unix_timestamp(), str_to_date(), current_user(), user()
>> * Support more built-in functions: money_format(), left(), right()
>> * New metrics: disk_state, tablet_distribution, scheduled_tablet_num
>> * Forward some requests to Master Frontend to get accurate results (#944)
>>
>>
>> Bug fixed:
>>
>>
>> * A lot of bugs fixed. Please see [ISSUES](
>> https://github.com/apache/incubator-doris/issues) to get more
>> information.
>>
>>
>> --
>> 此致！Best Regards
>> 陈明雨 Mingyu Chen
>>
>> Email:
>> chenmingyu@apache.org
>>
>>
>>
>> At 2019-04-19 12:01:51, "德 李" <li...@apache.org> wrote:
>> >Hi all,
>> >
>> >I propose to discuss the release of Doris 0.10.0.
>> >
>> >It will include some important features, and you can also add other
>> feature
>> >to below list:
>> >
>> >1. Unified Loading Framework
>> >You can refer to the email "[DISCUSS] Unify the load framework in Doris".
>> >a) Improve the performance of broker and mini load by using the
>> framework of
>> >stream load.
>> >b) The loading of large file is supported by the unified framework.
>> >
>> >2. Routine Load Job
>> >a) Introduce Build-in routine load manager
>> >b) Automatically Data Consuming and Loading
>> >
>> >3. Doris on ElasticSearch
>> >It enable us to query ElasticSearch on Doris by SQL way.
>> >
>> >4. Performance Optimization
>> >a) Introduce high-efficient Decimal
>> >b) Parallel Fragment Instance
>> >
>> >5. Usability
>> >a) Introduce UDF
>> >b) More HLL functions
>> >c) More metrics to monitor
>> >d) Bug fixed
>> >
>> >Best Regards,
>> >Reed
>> >
>> >
>>
>

Re: [DISCUSS] Propose to release Apache Doris(incubating) 0.10.0

Posted by Zhao Chun <bu...@gmail.com>.

Yes, It has been a long time since we release 0.9.0. And we have developed
some interesting features.

give my +1 for releasing our new version.

Thanks for your job Mingyu.

Thanks,
ZHAO Chun



陈明雨 <mo...@163.com> 于2019年5月14日周二 下午1:59写道：

> Hi all,
> Somethings delayed our 0.10.0 release.
> I think it is time to release the version 0.10.0 as some exciting feature
> are fully implements.
> The major features show as bellow:
>
>
> New Features:
>
>
> * Support Routine Load
>
>
> Doris now support routine load job, which allow user to create a routine
> load job with simple instruction, and the data will be consumed and loaded
> into Doris automatically. More information and guide can be found in
> [例行导入使用手册](
> https://github.com/apache/incubator-doris/blob/master/docs/documentation/cn/administrator-guide/load-data/routine-load-manual.md
> ).
>
>
> * Support Doris on ES
>
>
> Doris now support querying Elasticsearch. User can create an extern table
> with engine type `ES`, and query it as a noraml table. Doris also support a
> new built-in function `es_query()`, which allow user to write special
> Elasticsearch query language in SQL. More information and guide can be
> found in []()
>
>
> * Support UDF and UDAF
>
>
> Now user can write UDF and UDAF in C++ language.
>
>
> * New documentation framework
>
>
> All documents of Doris will be moved to the directory
> `docs/documentation/`. You can see [README](
> https://github.com/apache/incubator-doris/blob/master/docs/readme.md) to
> get more information, and help us complete the documentations. Any
> documents are welcome.
> There is also a new directory `samples/` which contains some samples of
> using Doris.
>
>
> Enhancement:
>
>
> * High performance Decimal type implementation.(#727)
> * Parallel execution of fragment instance (#851)
> * Support hll_union_agg in Analytic Function (#819)
> * Support hll_raw_agg in Aggregate Function (#832)
> * Support adding columns to multiple rollup indexes in one ALTER TABLE
> stmt (#931)
>
>
> Usability:
>
>
> * Add --daemon option to all start scripts (#642)
> * Remove the restrict that delete stmt must specify partition even for
> unpartitioned table (#668)
> * Remove restrict of that Analytic function must have partition by clause
> (#659)
> * Support `enable_insert_strict` session variable to control the insert
> request (#1013)
> * Support NEGATIVE keyword in Broker Load (#1101)
> * Support more functions which can be calculated in Frontends:
> unix_timestamp(), str_to_date(), current_user(), user()
> * Support more built-in functions: money_format(), left(), right()
> * New metrics: disk_state, tablet_distribution, scheduled_tablet_num
> * Forward some requests to Master Frontend to get accurate results (#944)
>
>
> Bug fixed:
>
>
> * A lot of bugs fixed. Please see [ISSUES](
> https://github.com/apache/incubator-doris/issues) to get more information.
>
>
> --
> 此致！Best Regards
> 陈明雨 Mingyu Chen
>
> Email:
> chenmingyu@apache.org
>
>
>
> At 2019-04-19 12:01:51, "德 李" <li...@apache.org> wrote:
> >Hi all,
> >
> >I propose to discuss the release of Doris 0.10.0.
> >
> >It will include some important features, and you can also add other
> feature
> >to below list:
> >
> >1. Unified Loading Framework
> >You can refer to the email "[DISCUSS] Unify the load framework in Doris".
> >a) Improve the performance of broker and mini load by using the framework
> of
> >stream load.
> >b) The loading of large file is supported by the unified framework.
> >
> >2. Routine Load Job
> >a) Introduce Build-in routine load manager
> >b) Automatically Data Consuming and Loading
> >
> >3. Doris on ElasticSearch
> >It enable us to query ElasticSearch on Doris by SQL way.
> >
> >4. Performance Optimization
> >a) Introduce high-efficient Decimal
> >b) Parallel Fragment Instance
> >
> >5. Usability
> >a) Introduce UDF
> >b) More HLL functions
> >c) More metrics to monitor
> >d) Bug fixed
> >
> >Best Regards,
> >Reed
> >
> >
>

Re:[DISCUSS] Propose to release Apache Doris(incubating) 0.10.0

Posted by 陈明雨 <mo...@163.com>.

Hi all,
Somethings delayed our 0.10.0 release.
I think it is time to release the version 0.10.0 as some exciting feature are fully implements.
The major features show as bellow:

New Features:

* Support Routine Load

Doris now support routine load job, which allow user to create a routine load job with simple instruction, and the data will be consumed and loaded into Doris automatically. More information and guide can be found in [例行导入使用手册](https://github.com/apache/incubator-doris/blob/master/docs/documentation/cn/administrator-guide/load-data/routine-load-manual.md).

* Support Doris on ES

Doris now support querying Elasticsearch. User can create an extern table with engine type `ES`, and query it as a noraml table. Doris also support a new built-in function `es_query()`, which allow user to write special Elasticsearch query language in SQL. More information and guide can be found in []()

* Support UDF and UDAF

Now user can write UDF and UDAF in C++ language.

* New documentation framework

All documents of Doris will be moved to the directory `docs/documentation/`. You can see [README](https://github.com/apache/incubator-doris/blob/master/docs/readme.md) to get more information, and help us complete the documentations. Any documents are welcome.
There is also a new directory `samples/` which contains some samples of using Doris. 

Enhancement:

* High performance Decimal type implementation.(#727)
* Parallel execution of fragment instance (#851)
* Support hll_union_agg in Analytic Function (#819)
* Support hll_raw_agg in Aggregate Function (#832)
* Support adding columns to multiple rollup indexes in one ALTER TABLE stmt (#931)

Usability:

* Add --daemon option to all start scripts (#642)
* Remove the restrict that delete stmt must specify partition even for unpartitioned table (#668)
* Remove restrict of that Analytic function must have partition by clause (#659)
* Support `enable_insert_strict` session variable to control the insert request (#1013)
* Support NEGATIVE keyword in Broker Load (#1101)
* Support more functions which can be calculated in Frontends: unix_timestamp(), str_to_date(), current_user(), user()
* Support more built-in functions: money_format(), left(), right()
* New metrics: disk_state, tablet_distribution, scheduled_tablet_num
* Forward some requests to Master Frontend to get accurate results (#944)

Bug fixed:

* A lot of bugs fixed. Please see [ISSUES](https://github.com/apache/incubator-doris/issues) to get more information.

--
此致！Best Regards
陈明雨 Mingyu Chen

Email:
chenmingyu@apache.org

At 2019-04-19 12:01:51, "德 李" <li...@apache.org> wrote:
>Hi all,
>
>I propose to discuss the release of Doris 0.10.0.
>
>It will include some important features, and you can also add other feature
>to below list:
>
>1. Unified Loading Framework
>You can refer to the email "[DISCUSS] Unify the load framework in Doris".
>a) Improve the performance of broker and mini load by using the framework of
>stream load.
>b) The loading of large file is supported by the unified framework.
>
>2. Routine Load Job
>a) Introduce Build-in routine load manager
>b) Automatically Data Consuming and Loading
>
>3. Doris on ElasticSearch
>It enable us to query ElasticSearch on Doris by SQL way.
>
>4. Performance Optimization
>a) Introduce high-efficient Decimal
>b) Parallel Fragment Instance
>
>5. Usability
>a) Introduce UDF
>b) More HLL functions
>c) More metrics to monitor
>d) Bug fixed
>
>Best Regards,
>Reed
>
>