You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pinot.apache.org by Xiang Fu <xi...@gmail.com> on 2022/09/01 23:25:50 UTC
[VOTE] Apache Pinot 0.11.0 RC0
Hi Pinot Community,
This is a call for a vote to release Apache Pinot 0.11.0.
The release candidate:
https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/
Git tag for this release:
https://github.com/apache/pinot/tree/release-0.11.0-rc0
Git hash for this release:
3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
The artifact has been signed with key: 9079294B, which can be found in the
following KEYS file:
https://dist.apache.org/repos/dist/release/pinot/KEYS
Release notes:
https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0
Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1039
Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
The vote will be open for at least 72 hours or until a necessary number of
votes is reached.
Please vote accordingly,
[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason
Thanks,
Apache Pinot team
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Atri Sharma <at...@apache.org>.
+1
Tried it out on MacOs and it looks good.
On Fri, Sep 2, 2022 at 10:29 PM Siddharth Teotia
<st...@linkedin.com.invalid> wrote:
>
> +1
>
> Validated on Mac OS
> ________________________________
> From: Mayank Shrivastava <ma...@gmail.com>
> Sent: Friday, September 2, 2022 5:52 AM
> To: dev@pinot.apache.org <de...@pinot.apache.org>
> Subject: Re: [VOTE] Apache Pinot 0.11.0 RC0
>
> +1
>
> On Sep 1, 2022, at 10:21 PM, Neha Pawar <ne...@gmail.com> wrote:
>
>
> +1.
> Validated as per steps in https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate .
>
> Thanks,
> Neha Pawar
>
>
>
> On Thu, Sep 1, 2022 at 4:26 PM Xiang Fu <xi...@gmail.com> wrote:
>
> Hi Pinot Community,
>
> This is a call for a vote to release Apache Pinot 0.11.0.
>
> The release candidate:
> https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/
>
> Git tag for this release:
> https://github.com/apache/pinot/tree/release-0.11.0-rc0
>
> Git hash for this release:
> 3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
>
> The artifact has been signed with key: 9079294B, which can be found in the following KEYS file:
> https://dist.apache.org/repos/dist/release/pinot/KEYS
>
> Release notes:
> https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0
>
> Staging repository:
> https://repository.apache.org/content/repositories/orgapachepinot-1039
>
> Documentation on verifying a release candidate:
> https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
>
> The vote will be open for at least 72 hours or until a necessary number of
> votes is reached.
>
> Please vote accordingly,
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Thanks,
> Apache Pinot team
--
Regards,
Atri
Apache Concerted
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org
For additional commands, e-mail: dev-help@pinot.apache.org
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Siddharth Teotia <st...@linkedin.com.INVALID>.
+1
Validated on Mac OS
________________________________
From: Mayank Shrivastava <ma...@gmail.com>
Sent: Friday, September 2, 2022 5:52 AM
To: dev@pinot.apache.org <de...@pinot.apache.org>
Subject: Re: [VOTE] Apache Pinot 0.11.0 RC0
+1
On Sep 1, 2022, at 10:21 PM, Neha Pawar <ne...@gmail.com> wrote:
+1.
Validated as per steps in https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=05%7C01%7Csteotia%40linkedin.com%7C8533c83491a6418139d908da8ce1fd32%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637977199516280422%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=wAFm%2BNB%2FF8dx67%2BreCfdY7QvrzHB1qU1yeMEGfdpz1U%3D&reserved=0> .
Thanks,
Neha Pawar
<ma...@illinois.edu>
On Thu, Sep 1, 2022 at 4:26 PM Xiang Fu <xi...@gmail.com>> wrote:
Hi Pinot Community,
This is a call for a vote to release Apache Pinot 0.11.0.
The release candidate:
https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fpinot%2Fapache-pinot-0.11.0-rc0%2F&data=05%7C01%7Csteotia%40linkedin.com%7C8533c83491a6418139d908da8ce1fd32%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637977199516436181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fnsFZmJTgmAwXXi%2F8mtJbtoCBz%2BA1r66zP0TtLAlEcY%3D&reserved=0>
Git tag for this release:
https://github.com/apache/pinot/tree/release-0.11.0-rc0<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Ftree%2Frelease-0.11.0-rc0&data=05%7C01%7Csteotia%40linkedin.com%7C8533c83491a6418139d908da8ce1fd32%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637977199516436181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DNqWN1nlxYKNYA7pfZwzxOLR6bZAyY3ImqDbDqBSs2Q%3D&reserved=0>
Git hash for this release:
3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
The artifact has been signed with key: 9079294B, which can be found in the following KEYS file:
https://dist.apache.org/repos/dist/release/pinot/KEYS<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fpinot%2FKEYS&data=05%7C01%7Csteotia%40linkedin.com%7C8533c83491a6418139d908da8ce1fd32%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637977199516436181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=cfUOcuboT%2BCmyfU6g19KI2GARy799O1B61us5%2FucHK4%3D&reserved=0>
Release notes:
https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Freleases%2Ftag%2Frelease-0.11.0-rc0&data=05%7C01%7Csteotia%40linkedin.com%7C8533c83491a6418139d908da8ce1fd32%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637977199516436181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3W%2BdyJ5CLo0kB%2BSIvPA5g%2BodBSn8nZ2QkM0t6JVbuUM%3D&reserved=0>
Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1039<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepinot-1039&data=05%7C01%7Csteotia%40linkedin.com%7C8533c83491a6418139d908da8ce1fd32%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637977199516436181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RL1tlH7nXNXpEY%2FQ0Gqu2GcScsSRPncGr9fR1ZZCzK8%3D&reserved=0>
Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=05%7C01%7Csteotia%40linkedin.com%7C8533c83491a6418139d908da8ce1fd32%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637977199516436181%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6AgVD7%2B22Utgk21kQsG8mucMQKCVGAjoMZecuZy8KQ8%3D&reserved=0>
The vote will be open for at least 72 hours or until a necessary number of
votes is reached.
Please vote accordingly,
[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason
Thanks,
Apache Pinot team
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Mayank Shrivastava <ma...@gmail.com>.
+1
> On Sep 1, 2022, at 10:21 PM, Neha Pawar <ne...@gmail.com> wrote:
>
>
> +1.
> Validated as per steps in https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate .
>
> Thanks,
> Neha Pawar
>
>
>
>> On Thu, Sep 1, 2022 at 4:26 PM Xiang Fu <xi...@gmail.com> wrote:
>> Hi Pinot Community,
>>
>> This is a call for a vote to release Apache Pinot 0.11.0.
>>
>> The release candidate:
>> https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/
>>
>> Git tag for this release:
>> https://github.com/apache/pinot/tree/release-0.11.0-rc0
>>
>> Git hash for this release:
>> 3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
>>
>> The artifact has been signed with key: 9079294B, which can be found in the following KEYS file:
>> https://dist.apache.org/repos/dist/release/pinot/KEYS
>>
>> Release notes:
>> https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0
>>
>> Staging repository:
>> https://repository.apache.org/content/repositories/orgapachepinot-1039
>>
>> Documentation on verifying a release candidate:
>> https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
>>
>> The vote will be open for at least 72 hours or until a necessary number of
>> votes is reached.
>>
>> Please vote accordingly,
>>
>> [ ] +1 approve
>> [ ] +0 no opinion
>> [ ] -1 disapprove with the reason
>>
>> Thanks,
>> Apache Pinot team
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Neha Pawar <ne...@gmail.com>.
+1.
Validated as per steps in
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
.
Thanks,
Neha Pawar
<pa...@illinois.edu>
On Thu, Sep 1, 2022 at 4:26 PM Xiang Fu <xi...@gmail.com> wrote:
> Hi Pinot Community,
>
> This is a call for a vote to release Apache Pinot 0.11.0.
>
> The release candidate:
> https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/
>
> Git tag for this release:
> https://github.com/apache/pinot/tree/release-0.11.0-rc0
>
> Git hash for this release:
> 3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
>
> The artifact has been signed with key: 9079294B, which can be found in the
> following KEYS file:
> https://dist.apache.org/repos/dist/release/pinot/KEYS
>
> Release notes:
> https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0
>
> Staging repository:
> https://repository.apache.org/content/repositories/orgapachepinot-1039
>
> Documentation on verifying a release candidate:
>
> https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
>
> The vote will be open for at least 72 hours or until a necessary number of
> votes is reached.
>
> Please vote accordingly,
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Thanks,
> Apache Pinot team
>
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Subbu Subramaniam <ss...@linkedin.com.INVALID>.
Verified, RC1 to be good.
+1 (binding)
-Subbu Subramaniam
PMC, Apache Pinot
________________________________
From: Xiang Fu <xi...@gmail.com>
Sent: Sunday, September 4, 2022 3:54 AM
To: dev@pinot.apache.org <de...@pinot.apache.org>
Subject: Re: [VOTE] Apache Pinot 0.11.0 RC0
Hi,
I did some research on this, and I can reproduce this on my Ubuntu 18.04.5 LTS.
This is due to the h3-core library upgrade from 3.7.0->3.7.2 (https://github.com/apache/pinot/pull/8696<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Fpull%2F8696&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998221105%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6n9Xez4sQobthf448UwT1tUGTqNHI88onVxdW1dpXLQ%3D&reserved=0>) to support Apple Mac M1. However the h3 library has introduced higher glibc(2.29) requirement from 3.7.1 (See discussion here: https://github.com/uber/h3-java/issues/85<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fuber%2Fh3-java%2Fissues%2F85&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998221105%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=hWUjI9P%2BhF%2FXmQ5bWuEb%2BnN2ztOsHfMXgWFm8%2BkGQjE%3D&reserved=0>). This means that there is no way to build a binary which can be running both on Ubuntu 18 & Mac M1, considering it’s nearly impossible to upgrade glibcc on ubuntu 18.
Luckily Uber team has recently released h3 4.0.0 which has lower the glibc requirements. I open a new PR: https://github.com/apache/pinot/pull/9335<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Fpull%2F9335&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998221105%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=y1mH4oyXSUKa2V%2ByQj2dt9JR2oUcDjRgP3gHhX1%2F8BY%3D&reserved=0> to upgrade the h3 lib and will back port to redo RC1 to address this issue.
Best,
Xiang
On Sep 3, 2022, at 11:50 AM, Xiang Fu <xi...@gmail.com>> wrote:
Can you try to upgrade the glibc? If it works, I can put a notice for that.
On Sat, Sep 3, 2022 at 10:22 Subbu Subramaniam <ss...@linkedin.com.invalid>> wrote:
I am seeing the following exception when the source is compiled with Java 11 on Centos 7.9.2009. Not sure if I need a glibc upgrade?
-Subbu
***** Bootstrap tables *****
java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner
at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:152)
at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:121)
at org.apache.pinot.tools.BootstrapTableTool.bootstrapOfflineTable(BootstrapTableTool.java:188)
at org.apache.pinot.tools.BootstrapTableTool.execute(BootstrapTableTool.java:93)
at org.apache.pinot.tools.admin.command.QuickstartRunner.bootstrapTable(QuickstartRunner.java:233)
at org.apache.pinot.tools.Quickstart.execute(Quickstart.java:85)
at org.apache.pinot.tools.admin.command.QuickStartCommand.execute(QuickStartCommand.java:178)
at org.apache.pinot.tools.Command.call(Command.java:33)
at org.apache.pinot.tools.Command.call(Command.java:29)
at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
at picocli.CommandLine.access$1300(CommandLine.java:145)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
at picocli.CommandLine.execute(CommandLine.java:2078)
at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:165)
at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:196)
at org.apache.pinot.tools.Quickstart.main(Quickstart.java:146)
Caused by: java.lang.RuntimeException: Failed to generate Pinot segment for file - file:/home/XXXXXX/tmp/apache-release/rc-test/apache-pinot-0.11.0-src/pinot-distribution/target/apache-pinot-0.11.0-bin/apache-pinot-0.11.0-bin/examples/batch/starbucksStores/rawdata/data.csv
at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:309)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.UnsatisfiedLinkError: /tmp/libh3-java10943907092098384359.so: /lib64/libm.so.6: version `GLIBC_2.29' not found (required by /tmp/libh3-java10943907092098384359.so)
at java.base/java.lang.ClassLoader$NativeLibrary.load0(Native Method)
at java.base/java.lang.ClassLoader$NativeLibrary.load(ClassLoader.java:2442)
at java.base/java.lang.ClassLoader$NativeLibrary.loadLibrary(ClassLoader.java:2498)
at java.base/java.lang.ClassLoader.loadLibrary0(ClassLoader.java:2694)
at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2627)
at java.base/java.lang.Runtime.load0(Runtime.java:768)
at java.base/java.lang.System.load(System.java:1837)
at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:129)
at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:96)
at com.uber.h3core.H3Core.newInstance(H3Core.java:79)
at org.apache.pinot.segment.local.utils.H3Utils.<clinit>(H3Utils.java:51)
at org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.BaseH3IndexCreator.add(BaseH3IndexCreator.java:111)
at org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.OffHeapH3IndexCreator.add(OffHeapH3IndexCreator.java:73)
at org.apache.pinot.segment.local.segment.creator.impl.SegmentColumnarIndexCreator.indexRow(SegmentColumnarIndexCreator.java:495)
at org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl.build(SegmentIndexCreationDriverImpl.java:235)
at org.apache.pinot.plugin.ingestion.batch.common.SegmentGenerationTaskRunner.run(SegmentGenerationTaskRunner.java:119)
at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:287)
... 5 more
________________________________
From: Xiang Fu <xi...@gmail.com>>
Sent: Thursday, September 1, 2022 4:25 PM
To: dev@pinot.apache.org<ma...@pinot.apache.org> <de...@pinot.apache.org>>
Subject: [VOTE] Apache Pinot 0.11.0 RC0
Hi Pinot Community,
This is a call for a vote to release Apache Pinot 0.11.0.
The release candidate:
https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fpinot%2Fapache-pinot-0.11.0-rc0%2F&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998221105%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=uM7Ng1l4vp0L606RWf%2BOEujAv05hFtMK4BAN5MI3KC0%3D&reserved=0>
Git tag for this release:
https://github.com/apache/pinot/tree/release-0.11.0-rc0<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Ftree%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998221105%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=2wnQtGg1GjeU0tAI%2FzEIZTIZbYoYjx0t20b1pYU6i9Y%3D&reserved=0>
Git hash for this release:
3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
The artifact has been signed with key: 9079294B, which can be found in the following KEYS file:
https://dist.apache.org/repos/dist/release/pinot/KEYS<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fpinot%2FKEYS&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998221105%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4V90XLACRsLFGWGAOhgnQvdM3A1yJaO9wufZeUWB6H4%3D&reserved=0>
Release notes:
https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Freleases%2Ftag%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998221105%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Y3D5VBttHwwrEKm5h2nVZPmffBUUB9n0c1Yd0dJs1qc%3D&reserved=0>
Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1039<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepinot-1039&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998377824%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=hRsw6%2FkwN0rNWnIpBCoiIDa8bGdVNqBbhHgB4IpiyQE%3D&reserved=0>
Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=05%7C01%7Cssubramaniam%40linkedin.com%7C49a46726ab8b4a942ce308da8e63e7a2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637978856998377824%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=VTvilEGm3wFZOuQG2PNRUgrbU5KmDOe2rfeOF%2FkXAyg%3D&reserved=0>
The vote will be open for at least 72 hours or until a necessary number of
votes is reached.
Please vote accordingly,
[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason
Thanks,
Apache Pinot team
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Xiang Fu <xi...@gmail.com>.
Hi,
I did some research on this, and I can reproduce this on my Ubuntu 18.04.5 LTS.
This is due to the h3-core library upgrade from 3.7.0->3.7.2 (https://github.com/apache/pinot/pull/8696 <https://github.com/apache/pinot/pull/8696>) to support Apple Mac M1. However the h3 library has introduced higher glibc(2.29) requirement from 3.7.1 (See discussion here: https://github.com/uber/h3-java/issues/85 <https://github.com/uber/h3-java/issues/85>). This means that there is no way to build a binary which can be running both on Ubuntu 18 & Mac M1, considering it’s nearly impossible to upgrade glibcc on ubuntu 18.
Luckily Uber team has recently released h3 4.0.0 which has lower the glibc requirements. I open a new PR: https://github.com/apache/pinot/pull/9335 <https://github.com/apache/pinot/pull/9335> to upgrade the h3 lib and will back port to redo RC1 to address this issue.
Best,
Xiang
> On Sep 3, 2022, at 11:50 AM, Xiang Fu <xi...@gmail.com> wrote:
>
> Can you try to upgrade the glibc? If it works, I can put a notice for that.
>
>
> On Sat, Sep 3, 2022 at 10:22 Subbu Subramaniam <ss...@linkedin.com.invalid> wrote:
> I am seeing the following exception when the source is compiled with Java 11 on Centos 7.9.2009. Not sure if I need a glibc upgrade?
>
> -Subbu
>
> ***** Bootstrap tables *****
> java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner
> at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:152)
> at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:121)
> at org.apache.pinot.tools.BootstrapTableTool.bootstrapOfflineTable(BootstrapTableTool.java:188)
> at org.apache.pinot.tools.BootstrapTableTool.execute(BootstrapTableTool.java:93)
> at org.apache.pinot.tools.admin.command.QuickstartRunner.bootstrapTable(QuickstartRunner.java:233)
> at org.apache.pinot.tools.Quickstart.execute(Quickstart.java:85)
> at org.apache.pinot.tools.admin.command.QuickStartCommand.execute(QuickStartCommand.java:178)
> at org.apache.pinot.tools.Command.call(Command.java:33)
> at org.apache.pinot.tools.Command.call(Command.java:29)
> at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
> at picocli.CommandLine.access$1300(CommandLine.java:145)
> at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
> at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
> at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
> at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
> at picocli.CommandLine.execute(CommandLine.java:2078)
> at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:165)
> at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:196)
> at org.apache.pinot.tools.Quickstart.main(Quickstart.java:146)
> Caused by: java.lang.RuntimeException: Failed to generate Pinot segment for file - file:/home/XXXXXX/tmp/apache-release/rc-test/apache-pinot-0.11.0-src/pinot-distribution/target/apache-pinot-0.11.0-bin/apache-pinot-0.11.0-bin/examples/batch/starbucksStores/rawdata/data.csv
> at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:309)
> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.UnsatisfiedLinkError: /tmp/libh3-java10943907092098384359.so: /lib64/libm.so.6: version `GLIBC_2.29' not found (required by /tmp/libh3-java10943907092098384359.so)
> at java.base/java.lang.ClassLoader$NativeLibrary.load0(Native Method)
> at java.base/java.lang.ClassLoader$NativeLibrary.load(ClassLoader.java:2442)
> at java.base/java.lang.ClassLoader$NativeLibrary.loadLibrary(ClassLoader.java:2498)
> at java.base/java.lang.ClassLoader.loadLibrary0(ClassLoader.java:2694)
> at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2627)
> at java.base/java.lang.Runtime.load0(Runtime.java:768)
> at java.base/java.lang.System.load(System.java:1837)
> at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:129)
> at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:96)
> at com.uber.h3core.H3Core.newInstance(H3Core.java:79)
> at org.apache.pinot.segment.local.utils.H3Utils.<clinit>(H3Utils.java:51)
> at org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.BaseH3IndexCreator.add(BaseH3IndexCreator.java:111)
> at org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.OffHeapH3IndexCreator.add(OffHeapH3IndexCreator.java:73)
> at org.apache.pinot.segment.local.segment.creator.impl.SegmentColumnarIndexCreator.indexRow(SegmentColumnarIndexCreator.java:495)
> at org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl.build(SegmentIndexCreationDriverImpl.java:235)
> at org.apache.pinot.plugin.ingestion.batch.common.SegmentGenerationTaskRunner.run(SegmentGenerationTaskRunner.java:119)
> at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:287)
> ... 5 more
>
>
> From: Xiang Fu <xiangfu.1024@gmail.com <ma...@gmail.com>>
> Sent: Thursday, September 1, 2022 4:25 PM
> To: dev@pinot.apache.org <ma...@pinot.apache.org> <dev@pinot.apache.org <ma...@pinot.apache.org>>
> Subject: [VOTE] Apache Pinot 0.11.0 RC0
>
> Hi Pinot Community,
>
> This is a call for a vote to release Apache Pinot 0.11.0.
>
> The release candidate:
> https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/ <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fpinot%2Fapache-pinot-0.11.0-rc0%2F&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ZweRF6Av0EZhCb%2BR%2BcyrwCEo%2FpdJQB8l9QOYPJX2ovM%3D&reserved=0>
>
> Git tag for this release:
> https://github.com/apache/pinot/tree/release-0.11.0-rc0 <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Ftree%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BxwcXktiHzsbeEupay73%2FVkESLDXMMgbb77PRU7z1T4%3D&reserved=0>
>
> Git hash for this release:
> 3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
>
> The artifact has been signed with key: 9079294B, which can be found in the following KEYS file:
> https://dist.apache.org/repos/dist/release/pinot/KEYS <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fpinot%2FKEYS&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RZNQrtVRLgbKmDtX2f%2FymVmufb%2FaTpjXP6vz8FxGEew%3D&reserved=0>
>
> Release notes:
> https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0 <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Freleases%2Ftag%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=L5Dc55dMxEYoFHMlUKNprdocyJssW870GS0YCejm8zs%3D&reserved=0>
>
> Staging repository:
> https://repository.apache.org/content/repositories/orgapachepinot-1039 <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepinot-1039&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=gz8V6BOQK3WpfXRjYbOx2OfOEIut5kZ4dlPuZj%2BSmUk%3D&reserved=0>
>
> Documentation on verifying a release candidate:
> https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EKKjOa7ypnza5fjMWaN%2BOiDpr8vo4USykczbqUsVfgs%3D&reserved=0>
>
> The vote will be open for at least 72 hours or until a necessary number of
> votes is reached.
>
> Please vote accordingly,
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Thanks,
> Apache Pinot team
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Xiang Fu <xi...@gmail.com>.
Can you try to upgrade the glibc? If it works, I can put a notice for that.
On Sat, Sep 3, 2022 at 10:22 Subbu Subramaniam
<ss...@linkedin.com.invalid> wrote:
> I am seeing the following exception when the source is compiled with Java
> 11 on Centos 7.9.2009. Not sure if I need a glibc upgrade?
>
> -Subbu
>
> ***** Bootstrap tables *****
> java.lang.RuntimeException: Caught exception during running -
> org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner
> at
> org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:152)
> at
> org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:121)
> at
> org.apache.pinot.tools.BootstrapTableTool.bootstrapOfflineTable(BootstrapTableTool.java:188)
> at
> org.apache.pinot.tools.BootstrapTableTool.execute(BootstrapTableTool.java:93)
> at
> org.apache.pinot.tools.admin.command.QuickstartRunner.bootstrapTable(QuickstartRunner.java:233)
> at org.apache.pinot.tools.Quickstart.execute(Quickstart.java:85)
> at
> org.apache.pinot.tools.admin.command.QuickStartCommand.execute(QuickStartCommand.java:178)
> at org.apache.pinot.tools.Command.call(Command.java:33)
> at org.apache.pinot.tools.Command.call(Command.java:29)
> at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
> at picocli.CommandLine.access$1300(CommandLine.java:145)
> at
> picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
> at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
> at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
> at
> picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
> at picocli.CommandLine.execute(CommandLine.java:2078)
> at
> org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:165)
> at
> org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:196)
> at org.apache.pinot.tools.Quickstart.main(Quickstart.java:146)
> Caused by: java.lang.RuntimeException: Failed to generate Pinot segment
> for file -
> file:/home/XXXXXX/tmp/apache-release/rc-test/apache-pinot-0.11.0-src/pinot-distribution/target/apache-pinot-0.11.0-bin/apache-pinot-0.11.0-bin/examples/batch/starbucksStores/rawdata/data.csv
> at
> org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:309)
> at
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.UnsatisfiedLinkError:
> /tmp/libh3-java10943907092098384359.so: /lib64/libm.so.6: version
> `GLIBC_2.29' not found (required by /tmp/libh3-java10943907092098384359.so)
> at java.base/java.lang.ClassLoader$NativeLibrary.load0(Native Method)
> at
> java.base/java.lang.ClassLoader$NativeLibrary.load(ClassLoader.java:2442)
> at
> java.base/java.lang.ClassLoader$NativeLibrary.loadLibrary(ClassLoader.java:2498)
> at java.base/java.lang.ClassLoader.loadLibrary0(ClassLoader.java:2694)
> at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2627)
> at java.base/java.lang.Runtime.load0(Runtime.java:768)
> at java.base/java.lang.System.load(System.java:1837)
> at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:129)
> at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:96)
> at com.uber.h3core.H3Core.newInstance(H3Core.java:79)
> at org.apache.pinot.segment.local.utils.H3Utils.<clinit>(H3Utils.java:51)
> at
> org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.BaseH3IndexCreator.add(BaseH3IndexCreator.java:111)
> at
> org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.OffHeapH3IndexCreator.add(OffHeapH3IndexCreator.java:73)
> at
> org.apache.pinot.segment.local.segment.creator.impl.SegmentColumnarIndexCreator.indexRow(SegmentColumnarIndexCreator.java:495)
> at
> org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl.build(SegmentIndexCreationDriverImpl.java:235)
> at
> org.apache.pinot.plugin.ingestion.batch.common.SegmentGenerationTaskRunner.run(SegmentGenerationTaskRunner.java:119)
> at
> org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:287)
> ... 5 more
>
>
> ------------------------------
> *From:* Xiang Fu <xi...@gmail.com>
> *Sent:* Thursday, September 1, 2022 4:25 PM
> *To:* dev@pinot.apache.org <de...@pinot.apache.org>
> *Subject:* [VOTE] Apache Pinot 0.11.0 RC0
>
> Hi Pinot Community,
>
> This is a call for a vote to release Apache Pinot 0.11.0.
>
> The release candidate:
> https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/
> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fpinot%2Fapache-pinot-0.11.0-rc0%2F&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ZweRF6Av0EZhCb%2BR%2BcyrwCEo%2FpdJQB8l9QOYPJX2ovM%3D&reserved=0>
>
> Git tag for this release:
> https://github.com/apache/pinot/tree/release-0.11.0-rc0
> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Ftree%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BxwcXktiHzsbeEupay73%2FVkESLDXMMgbb77PRU7z1T4%3D&reserved=0>
>
> Git hash for this release:
> 3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
>
> The artifact has been signed with key: 9079294B, which can be found in the
> following KEYS file:
> https://dist.apache.org/repos/dist/release/pinot/KEYS
> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fpinot%2FKEYS&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RZNQrtVRLgbKmDtX2f%2FymVmufb%2FaTpjXP6vz8FxGEew%3D&reserved=0>
>
> Release notes:
> https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0
> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Freleases%2Ftag%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=L5Dc55dMxEYoFHMlUKNprdocyJssW870GS0YCejm8zs%3D&reserved=0>
>
> Staging repository:
> https://repository.apache.org/content/repositories/orgapachepinot-1039
> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepinot-1039&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=gz8V6BOQK3WpfXRjYbOx2OfOEIut5kZ4dlPuZj%2BSmUk%3D&reserved=0>
>
> Documentation on verifying a release candidate:
>
> https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
> <https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EKKjOa7ypnza5fjMWaN%2BOiDpr8vo4USykczbqUsVfgs%3D&reserved=0>
>
> The vote will be open for at least 72 hours or until a necessary number of
> votes is reached.
>
> Please vote accordingly,
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Thanks,
> Apache Pinot team
>
Re: [VOTE] Apache Pinot 0.11.0 RC0
Posted by Subbu Subramaniam <ss...@linkedin.com.INVALID>.
I am seeing the following exception when the source is compiled with Java 11 on Centos 7.9.2009. Not sure if I need a glibc upgrade?
-Subbu
***** Bootstrap tables *****
java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner
at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:152)
at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:121)
at org.apache.pinot.tools.BootstrapTableTool.bootstrapOfflineTable(BootstrapTableTool.java:188)
at org.apache.pinot.tools.BootstrapTableTool.execute(BootstrapTableTool.java:93)
at org.apache.pinot.tools.admin.command.QuickstartRunner.bootstrapTable(QuickstartRunner.java:233)
at org.apache.pinot.tools.Quickstart.execute(Quickstart.java:85)
at org.apache.pinot.tools.admin.command.QuickStartCommand.execute(QuickStartCommand.java:178)
at org.apache.pinot.tools.Command.call(Command.java:33)
at org.apache.pinot.tools.Command.call(Command.java:29)
at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
at picocli.CommandLine.access$1300(CommandLine.java:145)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
at picocli.CommandLine.execute(CommandLine.java:2078)
at org.apache.pinot.tools.admin.PinotAdministrator.execute(PinotAdministrator.java:165)
at org.apache.pinot.tools.admin.PinotAdministrator.main(PinotAdministrator.java:196)
at org.apache.pinot.tools.Quickstart.main(Quickstart.java:146)
Caused by: java.lang.RuntimeException: Failed to generate Pinot segment for file - file:/home/XXXXXX/tmp/apache-release/rc-test/apache-pinot-0.11.0-src/pinot-distribution/target/apache-pinot-0.11.0-bin/apache-pinot-0.11.0-bin/examples/batch/starbucksStores/rawdata/data.csv
at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:309)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.UnsatisfiedLinkError: /tmp/libh3-java10943907092098384359.so: /lib64/libm.so.6: version `GLIBC_2.29' not found (required by /tmp/libh3-java10943907092098384359.so)
at java.base/java.lang.ClassLoader$NativeLibrary.load0(Native Method)
at java.base/java.lang.ClassLoader$NativeLibrary.load(ClassLoader.java:2442)
at java.base/java.lang.ClassLoader$NativeLibrary.loadLibrary(ClassLoader.java:2498)
at java.base/java.lang.ClassLoader.loadLibrary0(ClassLoader.java:2694)
at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2627)
at java.base/java.lang.Runtime.load0(Runtime.java:768)
at java.base/java.lang.System.load(System.java:1837)
at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:129)
at com.uber.h3core.H3CoreLoader.loadNatives(H3CoreLoader.java:96)
at com.uber.h3core.H3Core.newInstance(H3Core.java:79)
at org.apache.pinot.segment.local.utils.H3Utils.<clinit>(H3Utils.java:51)
at org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.BaseH3IndexCreator.add(BaseH3IndexCreator.java:111)
at org.apache.pinot.segment.local.segment.creator.impl.inv.geospatial.OffHeapH3IndexCreator.add(OffHeapH3IndexCreator.java:73)
at org.apache.pinot.segment.local.segment.creator.impl.SegmentColumnarIndexCreator.indexRow(SegmentColumnarIndexCreator.java:495)
at org.apache.pinot.segment.local.segment.creator.impl.SegmentIndexCreationDriverImpl.build(SegmentIndexCreationDriverImpl.java:235)
at org.apache.pinot.plugin.ingestion.batch.common.SegmentGenerationTaskRunner.run(SegmentGenerationTaskRunner.java:119)
at org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner.lambda$submitSegmentGenTask$1(SegmentGenerationJobRunner.java:287)
... 5 more
________________________________
From: Xiang Fu <xi...@gmail.com>
Sent: Thursday, September 1, 2022 4:25 PM
To: dev@pinot.apache.org <de...@pinot.apache.org>
Subject: [VOTE] Apache Pinot 0.11.0 RC0
Hi Pinot Community,
This is a call for a vote to release Apache Pinot 0.11.0.
The release candidate:
https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.11.0-rc0/<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fpinot%2Fapache-pinot-0.11.0-rc0%2F&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ZweRF6Av0EZhCb%2BR%2BcyrwCEo%2FpdJQB8l9QOYPJX2ovM%3D&reserved=0>
Git tag for this release:
https://github.com/apache/pinot/tree/release-0.11.0-rc0<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Ftree%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BxwcXktiHzsbeEupay73%2FVkESLDXMMgbb77PRU7z1T4%3D&reserved=0>
Git hash for this release:
3d66f604e72eebbc940aeae89dfe5f9d9bbb6fc0
The artifact has been signed with key: 9079294B, which can be found in the following KEYS file:
https://dist.apache.org/repos/dist/release/pinot/KEYS<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fpinot%2FKEYS&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RZNQrtVRLgbKmDtX2f%2FymVmufb%2FaTpjXP6vz8FxGEew%3D&reserved=0>
Release notes:
https://github.com/apache/pinot/releases/tag/release-0.11.0-rc0<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpinot%2Freleases%2Ftag%2Frelease-0.11.0-rc0&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=L5Dc55dMxEYoFHMlUKNprdocyJssW870GS0YCejm8zs%3D&reserved=0>
Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1039<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepinot-1039&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=gz8V6BOQK3WpfXRjYbOx2OfOEIut5kZ4dlPuZj%2BSmUk%3D&reserved=0>
Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FPINOT%2FValidating%2Ba%2Brelease%2Bcandidate&data=05%7C01%7Cssubramaniam%40linkedin.com%7C3146c4dcaef647e4ccb808da8c715de1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637976715783605931%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EKKjOa7ypnza5fjMWaN%2BOiDpr8vo4USykczbqUsVfgs%3D&reserved=0>
The vote will be open for at least 72 hours or until a necessary number of
votes is reached.
Please vote accordingly,
[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason
Thanks,
Apache Pinot team