You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by Ravindra Pesala <ra...@gmail.com> on 2018/12/01 01:00:53 UTC
[VOTE] Apache CarbonData 1.5.1(RC2) release
Hi
I submit the Apache CarbonData 1.5.1 (RC2) for your vote.
1.Release Notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320
Some key features and improvements in this release:
1. Optimized scan performance by avoiding multiple data copies and
avoided double filtering for spark fileformat and presto by lazy loading
and page pruning.
2. Supported customize column compressor
3. Supported concurrent reading through SDK reader to improve read
performance.
4. Supported fallback mechanism when offheap memory is not enough then
switch to onheap
5. Supported C++ interface for writing carbon data in CSDK
6. Supported VectorizedReader for SDK Reader to improve read performance.
7. Improved Blocklet DataMap pruning in driver using multi-threading.
8. Make inverted index false by default
9. Enable Local dictionary by default
10. Support prefetch for compaction to improve compaction performance.
11. Many Bug fixes and stabilized Carbondata.
2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
1d1eb7bd625f1af1745c555274dd69298a79ab65)
https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2
3. The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/
4. A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachecarbondata-1036/
5. Release artifacts are signed with the following key:
*https://people.apache.org/keys/committer/ravipesala.asc
<https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@getmailspring.com/9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D>*
Please vote on releasing this package as Apache CarbonData 1.5.1, The vote
will be open for the next 72 hours and passes if a majority of
at least three +1 PMC votes are cast.
[ ] +1 Release this package as Apache CarbonData 1.5.1
[ ] 0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...
Regards,
Ravindra.
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by Ravindra Pesala <ra...@gmail.com>.
Hi all
PMC vote has passed for Apache Carbondata 1.5.1 release, the result
as below:
+1(binding): 4（Liang Chen, Jacky, Kumar Vishal, Ravindra)
+1(non-binding) : 5
Thanks all for your vote.
Regards,
Ravindra
On Tue, 4 Dec 2018 at 16:57, Bhavya Aggarwal <bh...@knoldus.com> wrote:
> +1
>
> Regards
> Bhavya
>
> On Tue, Dec 4, 2018 at 10:24 AM Liang Chen <ch...@gmail.com>
> wrote:
>
> > Hi
> >
> > +1
> >
> > Regards
> > Liang
> >
> >
> >
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> >
>
>
> --
> *Bhavya Aggarwal*
> CTO & Partner
> Knoldus Inc. <http://www.knoldus.com/>
> +91-9910483067
> Canada - USA - India - Singapore
> <https://in.linkedin.com/company/knoldus> <https://twitter.com/Knolspeak>
> <https://www.facebook.com/KnoldusSoftware/> <https://blog.knoldus.com/>
>
--
Thanks & Regards,
Ravi
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by Bhavya Aggarwal <bh...@knoldus.com>.
+1
Regards
Bhavya
On Tue, Dec 4, 2018 at 10:24 AM Liang Chen <ch...@gmail.com> wrote:
> Hi
>
> +1
>
> Regards
> Liang
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
--
*Bhavya Aggarwal*
CTO & Partner
Knoldus Inc. <http://www.knoldus.com/>
+91-9910483067
Canada - USA - India - Singapore
<https://in.linkedin.com/company/knoldus> <https://twitter.com/Knolspeak>
<https://www.facebook.com/KnoldusSoftware/> <https://blog.knoldus.com/>
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by Liang Chen <ch...@gmail.com>.
Hi
+1
Regards
Liang
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by manish gupta <to...@gmail.com>.
+1
Regards
Manish Gupta
On Mon, 3 Dec 2018 at 12:22 PM, Jacky Li <ja...@qq.com> wrote:
> I think there are other places that are using apache-common-log, like
> https://github.com/apache/carbondata/blob/382ce430a18ca3d7d0b444777c66591e2c2e705f/hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java#L103
>
> Since this is not introduced in this version, I think it is OK to raise a
> jira now and solve it in next version.
> So +1 for the voting.
>
> Regards,
> Jacky
>
>
> > 在 2018年12月1日，下午9:41，xuchuanyin <xu...@hust.edu.cn> 写道：
> >
> > Hi, please consider this line of code:
> https://github.com/apache/carbondata/blob/master/core/src/main/java/org/apache/carbondata/core/datamap/TableDataMap.java#L78
> >
> > It uses apache-common-log directly instead of carbondata log. I’m not
> sure about the impact of this.
> > Please take care of this before voting.
> >
> > Sent from laptop
> >
> > From: Ravindra Pesala
> > Sent: Saturday, December 1, 2018 08:58
> > To: dev
> > Subject: [VOTE] Apache CarbonData 1.5.1(RC2) release
> >
> > Hi
> >
> > I submit the Apache CarbonData 1.5.1 (RC2) for your vote.
> >
> > 1.Release Notes:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320
> >
> >
> > Some key features and improvements in this release:
> >
> > 1. Optimized scan performance by avoiding multiple data copies and
> > avoided double filtering for spark fileformat and presto by lazy
> loading
> > and page pruning.
> > 2. Supported customize column compressor
> > 3. Supported concurrent reading through SDK reader to improve read
> > performance.
> > 4. Supported fallback mechanism when offheap memory is not enough then
> > switch to onheap
> > 5. Supported C++ interface for writing carbon data in CSDK
> > 6. Supported VectorizedReader for SDK Reader to improve read
> performance.
> > 7. Improved Blocklet DataMap pruning in driver using multi-threading.
> > 8. Make inverted index false by default
> > 9. Enable Local dictionary by default
> > 10. Support prefetch for compaction to improve compaction performance.
> > 11. Many Bug fixes and stabilized Carbondata.
> >
> >
> > 2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
> > 1d1eb7bd625f1af1745c555274dd69298a79ab65)
> >
> https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2
> >
> >
> > 3. The artifacts to be voted on are located here:
> > https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/
> >
> >
> > 4. A staged Maven repository is available for review at:
> >
> https://repository.apache.org/content/repositories/orgapachecarbondata-1036/
> >
> >
> > 5. Release artifacts are signed with the following key:
> >
> > *https://people.apache.org/keys/committer/ravipesala.asc
> > <
> https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@getmailspring.com/9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D
> >*
> >
> >
> > Please vote on releasing this package as Apache CarbonData 1.5.1, The
> vote
> >
> > will be open for the next 72 hours and passes if a majority of
> >
> > at least three +1 PMC votes are cast.
> >
> >
> > [ ] +1 Release this package as Apache CarbonData 1.5.1
> >
> > [ ] 0 I don't feel strongly about it, but I'm okay with the release
> >
> > [ ] -1 Do not release this package because...
> >
> >
> > Regards,
> > Ravindra.
> >
> >
> >
>
>
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by Jacky Li <ja...@qq.com>.
I think there are other places that are using apache-common-log, like https://github.com/apache/carbondata/blob/382ce430a18ca3d7d0b444777c66591e2c2e705f/hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java#L103
Since this is not introduced in this version, I think it is OK to raise a jira now and solve it in next version.
So +1 for the voting.
Regards,
Jacky
> 在 2018年12月1日，下午9:41，xuchuanyin <xu...@hust.edu.cn> 写道：
>
> Hi, please consider this line of code: https://github.com/apache/carbondata/blob/master/core/src/main/java/org/apache/carbondata/core/datamap/TableDataMap.java#L78
>
> It uses apache-common-log directly instead of carbondata log. I’m not sure about the impact of this.
> Please take care of this before voting.
>
> Sent from laptop
>
> From: Ravindra Pesala
> Sent: Saturday, December 1, 2018 08:58
> To: dev
> Subject: [VOTE] Apache CarbonData 1.5.1(RC2) release
>
> Hi
>
> I submit the Apache CarbonData 1.5.1 (RC2) for your vote.
>
> 1.Release Notes:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320
>
>
> Some key features and improvements in this release:
>
> 1. Optimized scan performance by avoiding multiple data copies and
> avoided double filtering for spark fileformat and presto by lazy loading
> and page pruning.
> 2. Supported customize column compressor
> 3. Supported concurrent reading through SDK reader to improve read
> performance.
> 4. Supported fallback mechanism when offheap memory is not enough then
> switch to onheap
> 5. Supported C++ interface for writing carbon data in CSDK
> 6. Supported VectorizedReader for SDK Reader to improve read performance.
> 7. Improved Blocklet DataMap pruning in driver using multi-threading.
> 8. Make inverted index false by default
> 9. Enable Local dictionary by default
> 10. Support prefetch for compaction to improve compaction performance.
> 11. Many Bug fixes and stabilized Carbondata.
>
>
> 2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
> 1d1eb7bd625f1af1745c555274dd69298a79ab65)
> https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2
>
>
> 3. The artifacts to be voted on are located here:
> https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/
>
>
> 4. A staged Maven repository is available for review at:
> https://repository.apache.org/content/repositories/orgapachecarbondata-1036/
>
>
> 5. Release artifacts are signed with the following key:
>
> *https://people.apache.org/keys/committer/ravipesala.asc
> <https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@getmailspring.com/9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D>*
>
>
> Please vote on releasing this package as Apache CarbonData 1.5.1, The vote
>
> will be open for the next 72 hours and passes if a majority of
>
> at least three +1 PMC votes are cast.
>
>
> [ ] +1 Release this package as Apache CarbonData 1.5.1
>
> [ ] 0 I don't feel strongly about it, but I'm okay with the release
>
> [ ] -1 Do not release this package because...
>
>
> Regards,
> Ravindra.
>
>
>
RE: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by xuchuanyin <xu...@hust.edu.cn>.
Hi, please consider this line of code: https://github.com/apache/carbondata/blob/master/core/src/main/java/org/apache/carbondata/core/datamap/TableDataMap.java#L78
It uses apache-common-log directly instead of carbondata log. I’m not sure about the impact of this.
Please take care of this before voting.
Sent from laptop
From: Ravindra Pesala
Sent: Saturday, December 1, 2018 08:58
To: dev
Subject: [VOTE] Apache CarbonData 1.5.1(RC2) release
Hi
I submit the Apache CarbonData 1.5.1 (RC2) for your vote.
1.Release Notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320
Some key features and improvements in this release:
1. Optimized scan performance by avoiding multiple data copies and
avoided double filtering for spark fileformat and presto by lazy loading
and page pruning.
2. Supported customize column compressor
3. Supported concurrent reading through SDK reader to improve read
performance.
4. Supported fallback mechanism when offheap memory is not enough then
switch to onheap
5. Supported C++ interface for writing carbon data in CSDK
6. Supported VectorizedReader for SDK Reader to improve read performance.
7. Improved Blocklet DataMap pruning in driver using multi-threading.
8. Make inverted index false by default
9. Enable Local dictionary by default
10. Support prefetch for compaction to improve compaction performance.
11. Many Bug fixes and stabilized Carbondata.
2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
1d1eb7bd625f1af1745c555274dd69298a79ab65)
https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2
3. The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/
4. A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachecarbondata-1036/
5. Release artifacts are signed with the following key:
*https://people.apache.org/keys/committer/ravipesala.asc
<https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@getmailspring.com/9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D>*
Please vote on releasing this package as Apache CarbonData 1.5.1, The vote
will be open for the next 72 hours and passes if a majority of
at least three +1 PMC votes are cast.
[ ] +1 Release this package as Apache CarbonData 1.5.1
[ ] 0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...
Regards,
Ravindra.
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by xubo245 <60...@qq.com>.
This bug can be fixed in next version（1.5.2）
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by Kumar Vishal <ku...@gmail.com>.
+1
Regards
Kumar Vishal
On Mon, 3 Dec 2018 at 12:59, ravipesala <ra...@gmail.com> wrote:
> Hi,
>
> @Xubo Regarding your PR, the property is used only for internal test
> purpose
> not to expose outside. I don't see any impact on any feature or on the
> current release. We have given enough time between RC1 and RC2 releases to
> consider and merge all necessary PRs. Please consult the release manager
> before release if any of the PR you think is important.
>
> Regarding,
> Ravindra.
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by Kunal Kapoor <ku...@gmail.com>.
+1
Regards
Kunal Kapoor
On Mon, Dec 3, 2018, 1:18 PM kanaka <kanakakumaravvaru@gmail.com wrote:
> +1
>
> I think CARBONDATA-3116 is not introduced in 1.5.1 & As Ravindra mentioned,
> If currently it is not intended for end users, we can discuss and optimize
> configuration in next version
>
> About the apache commons logging in TableDataMap.java#L78, as we verified
> our local cluster required messages still shown in log file. So, we can
> fix
> together with other classes in next version.
>
> Regards,
> Kanaka
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by kanaka <ka...@gmail.com>.
+1
I think CARBONDATA-3116 is not introduced in 1.5.1 & As Ravindra mentioned,
If currently it is not intended for end users, we can discuss and optimize
configuration in next version
About the apache commons logging in TableDataMap.java#L78, as we verified
our local cluster required messages still shown in log file. So, we can fix
together with other classes in next version.
Regards,
Kanaka
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by ravipesala <ra...@gmail.com>.
Hi,
@Xubo Regarding your PR, the property is used only for internal test purpose
not to expose outside. I don't see any impact on any feature or on the
current release. We have given enough time between RC1 and RC2 releases to
consider and merge all necessary PRs. Please consult the release manager
before release if any of the PR you think is important.
Regarding,
Ravindra.
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by xubo245 <60...@qq.com>.
@jackylk @ravipesala @KanakaKumar @kunal642
https://github.com/apache/carbondata/pull/2940 is a bug, please check it.
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by Raghunandan S <ca...@gmail.com>.
+1
On Mon, 3 Dec 2018, 3:03 pm xm_zzc, <44...@qq.com> wrote:
> +1
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
Re: [VOTE] Apache CarbonData 1.5.1(RC2) release
Posted by xm_zzc <44...@qq.com>.
+1
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/