You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Manong Karl <ab...@gmail.com> on 2021/07/04 06:21:18 UTC
can't build on mac m1 with main branche
Hello Team:
When I tried to build, command "./gradlew build -x test", it got an
exception which I have uploaded.
What did I miss?
Re: can't build on mac m1 with main branche
Posted by Russell Spitzer <ru...@gmail.com>.
Since we are getting it via Spark for those tests, https://issues.apache.org/jira/browse/SPARK-33725 <https://issues.apache.org/jira/browse/SPARK-33725> we just need to bump to 2.4.8 and 3.0.2 for tests
> On Jul 7, 2021, at 10:37 PM, Russell Spitzer <ru...@gmail.com> wrote:
>
> Hmm that sounds like we should just upgrade snappy?
>
> https://github.com/xerial/snappy-java/blob/master/Milestone.md#snappy-java-1182-2020-11-28 <https://github.com/xerial/snappy-java/blob/master/Milestone.md#snappy-java-1182-2020-11-28>
>
> snappy-java-1.1.8.2 has the Apple Silicon Support
>
>> On Jul 7, 2021, at 8:38 PM, Manong Karl <abc549825@gmail.com <ma...@gmail.com>> wrote:
>>
>> As far as I know integrationTest task used snappy-java:1.1.7.5 which doesn't contain native mac aarch64 snappyjava lib. Then the Snappy class can't be loaded.
>> A quick fix is downloading the lib from snappy-java/libsnappyjava.dylib at m1 · xerial/snappy-java · GitHub <https://github.com/xerial/snappy-java/blob/m1/src/main/resources/org/xerial/snappy/native/Mac/aarch64/libsnappyjava.dylib>, place it somewhere, and set integrationTest task's systemProperty "org.xerial.snappy.lib.path".
>>
>> Shall we comment it to others using mac m1?
>>
>> <russell.spitzer@gmail.com <ma...@gmail.com>> 于2021年7月6日周二 下午7:26写道：
>> Underlying error from my quick skim
>>
>> java.base/java.lang.Thread.run(Thread.java:829)
>> Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
>>
>> Which is usually caused by the temp directory being set as noexec
>>
>> Sent from my iPhone
>>
>>> On Jul 5, 2021, at 11:40 PM, Manong Karl <abc549825@gmail.com <ma...@gmail.com>> wrote:
>>>
>>>
>>> Don't know why gmail lost my files. So I uploaded them to google drive.
>>> https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view?usp=sharing <https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view>
>>> https://drive.google.com/file/d/1V4Rg0fbwmeHBG_NjyLjLPo3BmjxWnFan/view?usp=sharing <https://drive.google.com/file/d/1V4Rg0fbwmeHBG_NjyLjLPo3BmjxWnFan/view?usp=sharing>
>>> https://drive.google.com/file/d/1LWv6e-fu5rY30Vkq29wH6OzjcSexWdmE/view?usp=sharing <https://drive.google.com/file/d/1LWv6e-fu5rY30Vkq29wH6OzjcSexWdmE/view?usp=sharing>
>>>
>>>
>>>
>>> Russell Spitzer <russell.spitzer@gmail.com <ma...@gmail.com>> 于2021年7月5日周一 下午11:07写道：
>>> I do not see any logs attached
>>>
>>> On Sun, Jul 4, 2021 at 8:12 PM Manong Karl <abc549825@gmail.com <ma...@gmail.com>> wrote:
>>> And the info log:
>>>
>>> Manong Karl <abc549825@gmail.com <ma...@gmail.com>> 于2021年7月5日周一 上午9:09写道：
>>> Hello Ryan, I was running on commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full log, please help, Thank U.
>>>
>>> Ryan Blue <blue@tabular.io <ma...@tabular.io>> 于2021年7月5日周一 上午2:40写道：
>>> It isn't clear why those tests failed because there is no error message or stack trace. Maybe you could find those and post those so we can take a look?
>>>
>>> Ryan
>>>
>>> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <abc549825@gmail.com <ma...@gmail.com>> wrote:
>>> Hello Team:
>>> When I tried to build, command "./gradlew build -x test", it got an exception which I have uploaded.
>>> What did I miss?
>>>
>>>
>>> --
>>> Ryan Blue
>>> Tabular
>
Re: can't build on mac m1 with main branche
Posted by Russell Spitzer <ru...@gmail.com>.
Hmm that sounds like we should just upgrade snappy?
https://github.com/xerial/snappy-java/blob/master/Milestone.md#snappy-java-1182-2020-11-28 <https://github.com/xerial/snappy-java/blob/master/Milestone.md#snappy-java-1182-2020-11-28>
snappy-java-1.1.8.2 has the Apple Silicon Support
> On Jul 7, 2021, at 8:38 PM, Manong Karl <ab...@gmail.com> wrote:
>
> As far as I know integrationTest task used snappy-java:1.1.7.5 which doesn't contain native mac aarch64 snappyjava lib. Then the Snappy class can't be loaded.
> A quick fix is downloading the lib from snappy-java/libsnappyjava.dylib at m1 · xerial/snappy-java · GitHub <https://github.com/xerial/snappy-java/blob/m1/src/main/resources/org/xerial/snappy/native/Mac/aarch64/libsnappyjava.dylib>, place it somewhere, and set integrationTest task's systemProperty "org.xerial.snappy.lib.path".
>
> Shall we comment it to others using mac m1?
>
> <russell.spitzer@gmail.com <ma...@gmail.com>> 于2021年7月6日周二 下午7:26写道：
> Underlying error from my quick skim
>
> java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
>
> Which is usually caused by the temp directory being set as noexec
>
> Sent from my iPhone
>
>> On Jul 5, 2021, at 11:40 PM, Manong Karl <abc549825@gmail.com <ma...@gmail.com>> wrote:
>>
>>
>> Don't know why gmail lost my files. So I uploaded them to google drive.
>> https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view?usp=sharing <https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view>
>> https://drive.google.com/file/d/1V4Rg0fbwmeHBG_NjyLjLPo3BmjxWnFan/view?usp=sharing <https://drive.google.com/file/d/1V4Rg0fbwmeHBG_NjyLjLPo3BmjxWnFan/view?usp=sharing>
>> https://drive.google.com/file/d/1LWv6e-fu5rY30Vkq29wH6OzjcSexWdmE/view?usp=sharing <https://drive.google.com/file/d/1LWv6e-fu5rY30Vkq29wH6OzjcSexWdmE/view?usp=sharing>
>>
>>
>>
>> Russell Spitzer <russell.spitzer@gmail.com <ma...@gmail.com>> 于2021年7月5日周一 下午11:07写道：
>> I do not see any logs attached
>>
>> On Sun, Jul 4, 2021 at 8:12 PM Manong Karl <abc549825@gmail.com <ma...@gmail.com>> wrote:
>> And the info log:
>>
>> Manong Karl <abc549825@gmail.com <ma...@gmail.com>> 于2021年7月5日周一 上午9:09写道：
>> Hello Ryan, I was running on commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full log, please help, Thank U.
>>
>> Ryan Blue <blue@tabular.io <ma...@tabular.io>> 于2021年7月5日周一 上午2:40写道：
>> It isn't clear why those tests failed because there is no error message or stack trace. Maybe you could find those and post those so we can take a look?
>>
>> Ryan
>>
>> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <abc549825@gmail.com <ma...@gmail.com>> wrote:
>> Hello Team:
>> When I tried to build, command "./gradlew build -x test", it got an exception which I have uploaded.
>> What did I miss?
>>
>>
>> --
>> Ryan Blue
>> Tabular
Re: can't build on mac m1 with main branche
Posted by Manong Karl <ab...@gmail.com>.
As far as I know integrationTest task used snappy-java:1.1.7.5 which
doesn't contain native mac aarch64 snappyjava lib. Then the Snappy class
can't be loaded.
A quick fix is downloading the lib from snappy-java/libsnappyjava.dylib at
m1 · xerial/snappy-java · GitHub
<https://github.com/xerial/snappy-java/blob/m1/src/main/resources/org/xerial/snappy/native/Mac/aarch64/libsnappyjava.dylib>,
place it somewhere, and set integrationTest task's systemProperty
"org.xerial.snappy.lib.path".
Shall we comment it to others using mac m1?
<ru...@gmail.com> 于2021年7月6日周二 下午7:26写道：
> Underlying error from my quick skim
>
> java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
>
>
> Which is usually caused by the temp directory being set as noexec
>
>
> Sent from my iPhone
>
> On Jul 5, 2021, at 11:40 PM, Manong Karl <ab...@gmail.com> wrote:
>
>
> Don't know why gmail lost my files. So I uploaded them to google drive.
>
> https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view?usp=sharing
> <https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view>
>
> https://drive.google.com/file/d/1V4Rg0fbwmeHBG_NjyLjLPo3BmjxWnFan/view?usp=sharing
>
> https://drive.google.com/file/d/1LWv6e-fu5rY30Vkq29wH6OzjcSexWdmE/view?usp=sharing
>
>
>
> Russell Spitzer <ru...@gmail.com> 于2021年7月5日周一 下午11:07写道：
>
>> I do not see any logs attached
>>
>> On Sun, Jul 4, 2021 at 8:12 PM Manong Karl <ab...@gmail.com> wrote:
>>
>>> And the info log:
>>>
>>> Manong Karl <ab...@gmail.com> 于2021年7月5日周一 上午9:09写道：
>>>
>>>> Hello Ryan, I was running on
>>>> commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full
>>>> log, please help, Thank U.
>>>>
>>>> Ryan Blue <bl...@tabular.io> 于2021年7月5日周一 上午2:40写道：
>>>>
>>>>> It isn't clear why those tests failed because there is no error
>>>>> message or stack trace. Maybe you could find those and post those so we can
>>>>> take a look?
>>>>>
>>>>> Ryan
>>>>>
>>>>> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <ab...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hello Team:
>>>>>> When I tried to build, command "./gradlew build -x test", it got an
>>>>>> exception which I have uploaded.
>>>>>> What did I miss?
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Ryan Blue
>>>>> Tabular
>>>>>
>>>>
Re: can't build on mac m1 with main branche
Posted by ru...@gmail.com.
Underlying error from my quick skim
java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
Which is usually caused by the temp directory being set as noexec
Sent from my iPhone
> On Jul 5, 2021, at 11:40 PM, Manong Karl <ab...@gmail.com> wrote:
>
>
> Don't know why gmail lost my files. So I uploaded them to google drive.
> https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view?usp=sharing
> https://drive.google.com/file/d/1V4Rg0fbwmeHBG_NjyLjLPo3BmjxWnFan/view?usp=sharing
> https://drive.google.com/file/d/1LWv6e-fu5rY30Vkq29wH6OzjcSexWdmE/view?usp=sharing
>
>
>
> Russell Spitzer <ru...@gmail.com> 于2021年7月5日周一 下午11:07写道：
>> I do not see any logs attached
>>
>>> On Sun, Jul 4, 2021 at 8:12 PM Manong Karl <ab...@gmail.com> wrote:
>>> And the info log:
>>>
>>> Manong Karl <ab...@gmail.com> 于2021年7月5日周一 上午9:09写道：
>>>> Hello Ryan, I was running on commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full log, please help, Thank U.
>>>>
>>>> Ryan Blue <bl...@tabular.io> 于2021年7月5日周一 上午2:40写道：
>>>>> It isn't clear why those tests failed because there is no error message or stack trace. Maybe you could find those and post those so we can take a look?
>>>>>
>>>>> Ryan
>>>>>
>>>>>> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <ab...@gmail.com> wrote:
>>>>>> Hello Team:
>>>>>> When I tried to build, command "./gradlew build -x test", it got an exception which I have uploaded.
>>>>>> What did I miss?
>>>>>
>>>>>
>>>>> --
>>>>> Ryan Blue
>>>>> Tabular
Re: can't build on mac m1 with main branche
Posted by Manong Karl <ab...@gmail.com>.
Don't know why gmail lost my files. So I uploaded them to google drive.
https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view?usp=sharing
<https://drive.google.com/file/d/1GKCfH5-Ier9TM0vidd37eq299RVaocm_/view>
https://drive.google.com/file/d/1V4Rg0fbwmeHBG_NjyLjLPo3BmjxWnFan/view?usp=sharing
https://drive.google.com/file/d/1LWv6e-fu5rY30Vkq29wH6OzjcSexWdmE/view?usp=sharing
Russell Spitzer <ru...@gmail.com> 于2021年7月5日周一 下午11:07写道：
> I do not see any logs attached
>
> On Sun, Jul 4, 2021 at 8:12 PM Manong Karl <ab...@gmail.com> wrote:
>
>> And the info log:
>>
>> Manong Karl <ab...@gmail.com> 于2021年7月5日周一 上午9:09写道：
>>
>>> Hello Ryan, I was running on
>>> commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full
>>> log, please help, Thank U.
>>>
>>> Ryan Blue <bl...@tabular.io> 于2021年7月5日周一 上午2:40写道：
>>>
>>>> It isn't clear why those tests failed because there is no error message
>>>> or stack trace. Maybe you could find those and post those so we can take a
>>>> look?
>>>>
>>>> Ryan
>>>>
>>>> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <ab...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hello Team:
>>>>> When I tried to build, command "./gradlew build -x test", it got an
>>>>> exception which I have uploaded.
>>>>> What did I miss?
>>>>>
>>>>
>>>>
>>>> --
>>>> Ryan Blue
>>>> Tabular
>>>>
>>>
Re: can't build on mac m1 with main branche
Posted by Russell Spitzer <ru...@gmail.com>.
I do not see any logs attached
On Sun, Jul 4, 2021 at 8:12 PM Manong Karl <ab...@gmail.com> wrote:
> And the info log:
>
> Manong Karl <ab...@gmail.com> 于2021年7月5日周一 上午9:09写道：
>
>> Hello Ryan, I was running on
>> commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full
>> log, please help, Thank U.
>>
>> Ryan Blue <bl...@tabular.io> 于2021年7月5日周一 上午2:40写道：
>>
>>> It isn't clear why those tests failed because there is no error message
>>> or stack trace. Maybe you could find those and post those so we can take a
>>> look?
>>>
>>> Ryan
>>>
>>> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <ab...@gmail.com> wrote:
>>>
>>>> Hello Team:
>>>> When I tried to build, command "./gradlew build -x test", it got an
>>>> exception which I have uploaded.
>>>> What did I miss?
>>>>
>>>
>>>
>>> --
>>> Ryan Blue
>>> Tabular
>>>
>>
Re: can't build on mac m1 with main branche
Posted by Manong Karl <ab...@gmail.com>.
And the info log:
Manong Karl <ab...@gmail.com> 于2021年7月5日周一 上午9:09写道：
> Hello Ryan, I was running on
> commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full
> log, please help, Thank U.
>
> Ryan Blue <bl...@tabular.io> 于2021年7月5日周一 上午2:40写道：
>
>> It isn't clear why those tests failed because there is no error message
>> or stack trace. Maybe you could find those and post those so we can take a
>> look?
>>
>> Ryan
>>
>> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <ab...@gmail.com> wrote:
>>
>>> Hello Team:
>>> When I tried to build, command "./gradlew build -x test", it got an
>>> exception which I have uploaded.
>>> What did I miss?
>>>
>>
>>
>> --
>> Ryan Blue
>> Tabular
>>
>
Re: can't build on mac m1 with main branche
Posted by Manong Karl <ab...@gmail.com>.
Hello Ryan, I was running on
commit cf0b94f69ec2659d59fcb4aa1be5865d2db03ffd. Have uploaded the full
log, please help, Thank U.
Ryan Blue <bl...@tabular.io> 于2021年7月5日周一 上午2:40写道：
> It isn't clear why those tests failed because there is no error message or
> stack trace. Maybe you could find those and post those so we can take a
> look?
>
> Ryan
>
> On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <ab...@gmail.com> wrote:
>
>> Hello Team:
>> When I tried to build, command "./gradlew build -x test", it got an
>> exception which I have uploaded.
>> What did I miss?
>>
>
>
> --
> Ryan Blue
> Tabular
>
Re: can't build on mac m1 with main branche
Posted by Ryan Blue <bl...@tabular.io>.
It isn't clear why those tests failed because there is no error message or
stack trace. Maybe you could find those and post those so we can take a
look?
Ryan
On Sat, Jul 3, 2021 at 11:21 PM Manong Karl <ab...@gmail.com> wrote:
> Hello Team:
> When I tried to build, command "./gradlew build -x test", it got an
> exception which I have uploaded.
> What did I miss?
>
--
Ryan Blue
Tabular