You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Lars Volker <lv...@cloudera.com> on 2016/10/10 23:25:17 UTC
Where is testdata/target/dependency/ populated
I'm trying to run the ParserTest but cannot get it to work.
Running org.apache.impala.analysis.ParserTest
> Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.856 sec
> <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed: 0.011
> sec <<< ERROR!
> java.lang.UnsatisfiedLinkError:
> org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> at
> org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native Method)
> at
> org.apache.impala.service.FeSupport.GetStartupOptions(FeSupport.java:268)
> at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.java:47)
> at org.apache.impala.common.RuntimeEnv.<clinit>(RuntimeEnv.java:34)
> at
> org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(TestUtils.java:288)
> at
> org.apache.impala.analysis.ParserTest.TestKuduUpdate(ParserTest.java:1632)
>
> Results :
>
> Tests in error:
> ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
> org.apache.impala.service.FeS...
My working copy does not seem to have the necessary dependencies
in testdata/target/dependency/. I suspect this causes my issue.
$ source bin/set-classpath.sh
> bin/set-classpath.sh:40: no matches found:
> /home/lv/i2/testdata/target/dependency/*.jar
Where do those files come from and how can I get them?
Thanks for the help, Lars
Re: Where is testdata/target/dependency/ populated
Posted by Matthew Jacobs <mj...@cloudera.com>.
I just started hitting this issue this morning and posted a fix:
https://gerrit.cloudera.org/#/c/4976/
https://issues.cloudera.org/browse/IMPALA-4442
On Mon, Oct 10, 2016 at 5:57 PM, Alex Behm <al...@cloudera.com> wrote:
> I still think it has to do with libfesupport.so. The stack is pretty clear.
> We are trying to call into native code from the FE and it's failing to find
> the native library (of which there is only libfesupport.so).
>
> Maven picks up the path for native code from the fe/pom.xml:
>
> <backend.library.path>${env.IMPALA_HOME}/be/build/debug/service:${env.IMPALA_HOME}/be/build/release/service</backend.library.path>
>
> Maybe you can manually specify the path to libfesupport when running the
> tests through mvn?
>
> mvn -Dbackend.library.path=/your/path/goes/here
>
>
>
>
>
>
>
> On Mon, Oct 10, 2016 at 5:40 PM, Lars Volker <lv...@cloudera.com> wrote:
>
>> No change, still the same error. I tried cleaning the repo, building from
>> scratch, new terminal.
>>
>> Running org.apache.impala.analysis.ParserTest
>> Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.447 sec
>> <<< FAILURE! - in org.apache.impala.analysis.ParserTest
>> TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed: 0.007
>> sec <<< ERROR!
>> java.lang.UnsatisfiedLinkError:
>> org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
>> at
>> org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native Method)
>> at
>> org.apache.impala.service.FeSupport.GetStartupOptions(FeSupport.java:268)
>> at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.java:47)
>> at org.apache.impala.common.RuntimeEnv.<clinit>(
>> RuntimeEnv.java:34)
>> at
>> org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
>> TestUtils.java:288)
>> at
>> org.apache.impala.analysis.ParserTest.TestKuduUpdate(ParserTest.java:1632)
>>
>> On Tue, Oct 11, 2016 at 2:33 AM, Alex Behm <al...@cloudera.com> wrote:
>>
>> > Maybe try running "mvn dependency:copy-dependencies" from the testdata
>> > directory?
>> >
>> > On Mon, Oct 10, 2016 at 5:04 PM, Lars Volker <lv...@cloudera.com> wrote:
>> >
>> > > Thanks for helping me, Alex. Apparently the .jar dependencies get
>> > > downloaded to fe/target/dependency, and bin/set-classpath.sh tries
>> both,
>> > > that location and testdata/target/dependency, and using zsh the latter
>> > > throws a (maybe insignificant) error. The problem still persists
>> though.
>> > >
>> > > I should have libfesupport.so in my LD_LIBRARY_PATH:
>> > >
>> > > ✔ ~/i2(i2) ✗$ echo $LD_LIBRARY_PATH
>> > > :/usr/lib/jvm/java-8-oracle/jre/lib/amd64:/usr/lib/jvm/
>> > > java-8-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-8-
>> > > oracle/jre/lib/amd64/server:/opt/Impala-Toolchain/cdh_
>> > > components/hadoop-2.6.0-cdh5.10.0-SNAPSHOT//lib/native:
>> > > */home/lv/i2/be/build/debug/service*
>> > > :/opt/Impala-Toolchain/snappy-1.1.3/lib:/home/lv/i2/../
>> > > Impala-lzo/build:/opt/Impala-Toolchain/gcc-4.9.2/lib64
>> > > ✔ ~/i2(i2) ✗$ ls /home/lv/i2/be/build/debug/service
>> > > impalad libfesupport.so libService.a
>> > >
>> > >
>> > >
>> > > On Tue, Oct 11, 2016 at 1:36 AM, Alex Behm <al...@cloudera.com>
>> > wrote:
>> > >
>> > > > This looks more like it could not find libfesupport.so. Do you have
>> it
>> > on
>> > > > your LD_LIBRARY_PATH?
>> > > >
>> > > > Regarding the dependency stuff. As part of "mvn package" we execute
>> the
>> > > > "copy-dependencies" plugin which populates target/dependency.
>> > > > You can manually run that step only with "mvn
>> > > dependency:copy-dependencies"
>> > > > from the fe dir.
>> > > >
>> > > >
>> > > > On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <lv...@cloudera.com>
>> wrote:
>> > > >
>> > > > > I'm trying to run the ParserTest but cannot get it to work.
>> > > > >
>> > > > > Running org.apache.impala.analysis.ParserTest
>> > > > > > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
>> > > 0.856
>> > > > > sec
>> > > > > > <<< FAILURE! - in org.apache.impala.analysis.ParserTest
>> > > > > > TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time
>> > elapsed:
>> > > > > 0.011
>> > > > > > sec <<< ERROR!
>> > > > > > java.lang.UnsatisfiedLinkError:
>> > > > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
>> > > > > > at
>> > > > > > org.apache.impala.service.FeSupport.
>> NativeGetStartupOptions(Native
>> > > > > Method)
>> > > > > > at
>> > > > > > org.apache.impala.service.FeSupport.GetStartupOptions(
>> > > > > FeSupport.java:268)
>> > > > > > at org.apache.impala.common.
>> RuntimeEnv.<init>(RuntimeEnv.
>> > > > > java:47)
>> > > > > > at org.apache.impala.common.RuntimeEnv.<clinit>(
>> > > > > RuntimeEnv.java:34)
>> > > > > > at
>> > > > > > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
>> > > > > TestUtils.java:288)
>> > > > > > at
>> > > > > > org.apache.impala.analysis.ParserTest.TestKuduUpdate(
>> > > > > ParserTest.java:1632)
>> > > > > >
>> > > > > > Results :
>> > > > > >
>> > > > > > Tests in error:
>> > > > > > ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
>> > > > > > org.apache.impala.service.FeS...
>> > > > >
>> > > > >
>> > > > >
>> > > > > My working copy does not seem to have the necessary dependencies
>> > > > > in testdata/target/dependency/. I suspect this causes my issue.
>> > > > >
>> > > > > $ source bin/set-classpath.sh
>> > > > > > bin/set-classpath.sh:40: no matches found:
>> > > > > > /home/lv/i2/testdata/target/dependency/*.jar
>> > > > >
>> > > > >
>> > > > > Where do those files come from and how can I get them?
>> > > > >
>> > > > > Thanks for the help, Lars
>> > > > >
>> > > >
>> > >
>> >
>>
Re: Where is testdata/target/dependency/ populated
Posted by Alex Behm <al...@cloudera.com>.
I still think it has to do with libfesupport.so. The stack is pretty clear.
We are trying to call into native code from the FE and it's failing to find
the native library (of which there is only libfesupport.so).
Maven picks up the path for native code from the fe/pom.xml:
<backend.library.path>${env.IMPALA_HOME}/be/build/debug/service:${env.IMPALA_HOME}/be/build/release/service</backend.library.path>
Maybe you can manually specify the path to libfesupport when running the
tests through mvn?
mvn -Dbackend.library.path=/your/path/goes/here
On Mon, Oct 10, 2016 at 5:40 PM, Lars Volker <lv...@cloudera.com> wrote:
> No change, still the same error. I tried cleaning the repo, building from
> scratch, new terminal.
>
> Running org.apache.impala.analysis.ParserTest
> Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.447 sec
> <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed: 0.007
> sec <<< ERROR!
> java.lang.UnsatisfiedLinkError:
> org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> at
> org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native Method)
> at
> org.apache.impala.service.FeSupport.GetStartupOptions(FeSupport.java:268)
> at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.java:47)
> at org.apache.impala.common.RuntimeEnv.<clinit>(
> RuntimeEnv.java:34)
> at
> org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> TestUtils.java:288)
> at
> org.apache.impala.analysis.ParserTest.TestKuduUpdate(ParserTest.java:1632)
>
> On Tue, Oct 11, 2016 at 2:33 AM, Alex Behm <al...@cloudera.com> wrote:
>
> > Maybe try running "mvn dependency:copy-dependencies" from the testdata
> > directory?
> >
> > On Mon, Oct 10, 2016 at 5:04 PM, Lars Volker <lv...@cloudera.com> wrote:
> >
> > > Thanks for helping me, Alex. Apparently the .jar dependencies get
> > > downloaded to fe/target/dependency, and bin/set-classpath.sh tries
> both,
> > > that location and testdata/target/dependency, and using zsh the latter
> > > throws a (maybe insignificant) error. The problem still persists
> though.
> > >
> > > I should have libfesupport.so in my LD_LIBRARY_PATH:
> > >
> > > ✔ ~/i2(i2) ✗$ echo $LD_LIBRARY_PATH
> > > :/usr/lib/jvm/java-8-oracle/jre/lib/amd64:/usr/lib/jvm/
> > > java-8-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-8-
> > > oracle/jre/lib/amd64/server:/opt/Impala-Toolchain/cdh_
> > > components/hadoop-2.6.0-cdh5.10.0-SNAPSHOT//lib/native:
> > > */home/lv/i2/be/build/debug/service*
> > > :/opt/Impala-Toolchain/snappy-1.1.3/lib:/home/lv/i2/../
> > > Impala-lzo/build:/opt/Impala-Toolchain/gcc-4.9.2/lib64
> > > ✔ ~/i2(i2) ✗$ ls /home/lv/i2/be/build/debug/service
> > > impalad libfesupport.so libService.a
> > >
> > >
> > >
> > > On Tue, Oct 11, 2016 at 1:36 AM, Alex Behm <al...@cloudera.com>
> > wrote:
> > >
> > > > This looks more like it could not find libfesupport.so. Do you have
> it
> > on
> > > > your LD_LIBRARY_PATH?
> > > >
> > > > Regarding the dependency stuff. As part of "mvn package" we execute
> the
> > > > "copy-dependencies" plugin which populates target/dependency.
> > > > You can manually run that step only with "mvn
> > > dependency:copy-dependencies"
> > > > from the fe dir.
> > > >
> > > >
> > > > On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <lv...@cloudera.com>
> wrote:
> > > >
> > > > > I'm trying to run the ParserTest but cannot get it to work.
> > > > >
> > > > > Running org.apache.impala.analysis.ParserTest
> > > > > > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> > > 0.856
> > > > > sec
> > > > > > <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> > > > > > TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time
> > elapsed:
> > > > > 0.011
> > > > > > sec <<< ERROR!
> > > > > > java.lang.UnsatisfiedLinkError:
> > > > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> > > > > > at
> > > > > > org.apache.impala.service.FeSupport.
> NativeGetStartupOptions(Native
> > > > > Method)
> > > > > > at
> > > > > > org.apache.impala.service.FeSupport.GetStartupOptions(
> > > > > FeSupport.java:268)
> > > > > > at org.apache.impala.common.
> RuntimeEnv.<init>(RuntimeEnv.
> > > > > java:47)
> > > > > > at org.apache.impala.common.RuntimeEnv.<clinit>(
> > > > > RuntimeEnv.java:34)
> > > > > > at
> > > > > > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> > > > > TestUtils.java:288)
> > > > > > at
> > > > > > org.apache.impala.analysis.ParserTest.TestKuduUpdate(
> > > > > ParserTest.java:1632)
> > > > > >
> > > > > > Results :
> > > > > >
> > > > > > Tests in error:
> > > > > > ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
> > > > > > org.apache.impala.service.FeS...
> > > > >
> > > > >
> > > > >
> > > > > My working copy does not seem to have the necessary dependencies
> > > > > in testdata/target/dependency/. I suspect this causes my issue.
> > > > >
> > > > > $ source bin/set-classpath.sh
> > > > > > bin/set-classpath.sh:40: no matches found:
> > > > > > /home/lv/i2/testdata/target/dependency/*.jar
> > > > >
> > > > >
> > > > > Where do those files come from and how can I get them?
> > > > >
> > > > > Thanks for the help, Lars
> > > > >
> > > >
> > >
> >
>
Re: Where is testdata/target/dependency/ populated
Posted by Lars Volker <lv...@cloudera.com>.
No change, still the same error. I tried cleaning the repo, building from
scratch, new terminal.
Running org.apache.impala.analysis.ParserTest
Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.447 sec
<<< FAILURE! - in org.apache.impala.analysis.ParserTest
TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed: 0.007
sec <<< ERROR!
java.lang.UnsatisfiedLinkError:
org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
at
org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native Method)
at
org.apache.impala.service.FeSupport.GetStartupOptions(FeSupport.java:268)
at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.java:47)
at org.apache.impala.common.RuntimeEnv.<clinit>(RuntimeEnv.java:34)
at
org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(TestUtils.java:288)
at
org.apache.impala.analysis.ParserTest.TestKuduUpdate(ParserTest.java:1632)
On Tue, Oct 11, 2016 at 2:33 AM, Alex Behm <al...@cloudera.com> wrote:
> Maybe try running "mvn dependency:copy-dependencies" from the testdata
> directory?
>
> On Mon, Oct 10, 2016 at 5:04 PM, Lars Volker <lv...@cloudera.com> wrote:
>
> > Thanks for helping me, Alex. Apparently the .jar dependencies get
> > downloaded to fe/target/dependency, and bin/set-classpath.sh tries both,
> > that location and testdata/target/dependency, and using zsh the latter
> > throws a (maybe insignificant) error. The problem still persists though.
> >
> > I should have libfesupport.so in my LD_LIBRARY_PATH:
> >
> > ✔ ~/i2(i2) ✗$ echo $LD_LIBRARY_PATH
> > :/usr/lib/jvm/java-8-oracle/jre/lib/amd64:/usr/lib/jvm/
> > java-8-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-8-
> > oracle/jre/lib/amd64/server:/opt/Impala-Toolchain/cdh_
> > components/hadoop-2.6.0-cdh5.10.0-SNAPSHOT//lib/native:
> > */home/lv/i2/be/build/debug/service*
> > :/opt/Impala-Toolchain/snappy-1.1.3/lib:/home/lv/i2/../
> > Impala-lzo/build:/opt/Impala-Toolchain/gcc-4.9.2/lib64
> > ✔ ~/i2(i2) ✗$ ls /home/lv/i2/be/build/debug/service
> > impalad libfesupport.so libService.a
> >
> >
> >
> > On Tue, Oct 11, 2016 at 1:36 AM, Alex Behm <al...@cloudera.com>
> wrote:
> >
> > > This looks more like it could not find libfesupport.so. Do you have it
> on
> > > your LD_LIBRARY_PATH?
> > >
> > > Regarding the dependency stuff. As part of "mvn package" we execute the
> > > "copy-dependencies" plugin which populates target/dependency.
> > > You can manually run that step only with "mvn
> > dependency:copy-dependencies"
> > > from the fe dir.
> > >
> > >
> > > On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <lv...@cloudera.com> wrote:
> > >
> > > > I'm trying to run the ParserTest but cannot get it to work.
> > > >
> > > > Running org.apache.impala.analysis.ParserTest
> > > > > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> > 0.856
> > > > sec
> > > > > <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> > > > > TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time
> elapsed:
> > > > 0.011
> > > > > sec <<< ERROR!
> > > > > java.lang.UnsatisfiedLinkError:
> > > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> > > > > at
> > > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native
> > > > Method)
> > > > > at
> > > > > org.apache.impala.service.FeSupport.GetStartupOptions(
> > > > FeSupport.java:268)
> > > > > at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.
> > > > java:47)
> > > > > at org.apache.impala.common.RuntimeEnv.<clinit>(
> > > > RuntimeEnv.java:34)
> > > > > at
> > > > > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> > > > TestUtils.java:288)
> > > > > at
> > > > > org.apache.impala.analysis.ParserTest.TestKuduUpdate(
> > > > ParserTest.java:1632)
> > > > >
> > > > > Results :
> > > > >
> > > > > Tests in error:
> > > > > ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
> > > > > org.apache.impala.service.FeS...
> > > >
> > > >
> > > >
> > > > My working copy does not seem to have the necessary dependencies
> > > > in testdata/target/dependency/. I suspect this causes my issue.
> > > >
> > > > $ source bin/set-classpath.sh
> > > > > bin/set-classpath.sh:40: no matches found:
> > > > > /home/lv/i2/testdata/target/dependency/*.jar
> > > >
> > > >
> > > > Where do those files come from and how can I get them?
> > > >
> > > > Thanks for the help, Lars
> > > >
> > >
> >
>
Re: Where is testdata/target/dependency/ populated
Posted by Alex Behm <al...@cloudera.com>.
Maybe try running "mvn dependency:copy-dependencies" from the testdata
directory?
On Mon, Oct 10, 2016 at 5:04 PM, Lars Volker <lv...@cloudera.com> wrote:
> Thanks for helping me, Alex. Apparently the .jar dependencies get
> downloaded to fe/target/dependency, and bin/set-classpath.sh tries both,
> that location and testdata/target/dependency, and using zsh the latter
> throws a (maybe insignificant) error. The problem still persists though.
>
> I should have libfesupport.so in my LD_LIBRARY_PATH:
>
> ✔ ~/i2(i2) ✗$ echo $LD_LIBRARY_PATH
> :/usr/lib/jvm/java-8-oracle/jre/lib/amd64:/usr/lib/jvm/
> java-8-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-8-
> oracle/jre/lib/amd64/server:/opt/Impala-Toolchain/cdh_
> components/hadoop-2.6.0-cdh5.10.0-SNAPSHOT//lib/native:
> */home/lv/i2/be/build/debug/service*
> :/opt/Impala-Toolchain/snappy-1.1.3/lib:/home/lv/i2/../
> Impala-lzo/build:/opt/Impala-Toolchain/gcc-4.9.2/lib64
> ✔ ~/i2(i2) ✗$ ls /home/lv/i2/be/build/debug/service
> impalad libfesupport.so libService.a
>
>
>
> On Tue, Oct 11, 2016 at 1:36 AM, Alex Behm <al...@cloudera.com> wrote:
>
> > This looks more like it could not find libfesupport.so. Do you have it on
> > your LD_LIBRARY_PATH?
> >
> > Regarding the dependency stuff. As part of "mvn package" we execute the
> > "copy-dependencies" plugin which populates target/dependency.
> > You can manually run that step only with "mvn
> dependency:copy-dependencies"
> > from the fe dir.
> >
> >
> > On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <lv...@cloudera.com> wrote:
> >
> > > I'm trying to run the ParserTest but cannot get it to work.
> > >
> > > Running org.apache.impala.analysis.ParserTest
> > > > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 0.856
> > > sec
> > > > <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> > > > TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed:
> > > 0.011
> > > > sec <<< ERROR!
> > > > java.lang.UnsatisfiedLinkError:
> > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> > > > at
> > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native
> > > Method)
> > > > at
> > > > org.apache.impala.service.FeSupport.GetStartupOptions(
> > > FeSupport.java:268)
> > > > at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.
> > > java:47)
> > > > at org.apache.impala.common.RuntimeEnv.<clinit>(
> > > RuntimeEnv.java:34)
> > > > at
> > > > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> > > TestUtils.java:288)
> > > > at
> > > > org.apache.impala.analysis.ParserTest.TestKuduUpdate(
> > > ParserTest.java:1632)
> > > >
> > > > Results :
> > > >
> > > > Tests in error:
> > > > ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
> > > > org.apache.impala.service.FeS...
> > >
> > >
> > >
> > > My working copy does not seem to have the necessary dependencies
> > > in testdata/target/dependency/. I suspect this causes my issue.
> > >
> > > $ source bin/set-classpath.sh
> > > > bin/set-classpath.sh:40: no matches found:
> > > > /home/lv/i2/testdata/target/dependency/*.jar
> > >
> > >
> > > Where do those files come from and how can I get them?
> > >
> > > Thanks for the help, Lars
> > >
> >
>
Re: Where is testdata/target/dependency/ populated
Posted by Lars Volker <lv...@cloudera.com>.
Thanks for helping me, Alex. Apparently the .jar dependencies get
downloaded to fe/target/dependency, and bin/set-classpath.sh tries both,
that location and testdata/target/dependency, and using zsh the latter
throws a (maybe insignificant) error. The problem still persists though.
I should have libfesupport.so in my LD_LIBRARY_PATH:
✔ ~/i2(i2) ✗$ echo $LD_LIBRARY_PATH
:/usr/lib/jvm/java-8-oracle/jre/lib/amd64:/usr/lib/jvm/java-8-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-8-oracle/jre/lib/amd64/server:/opt/Impala-Toolchain/cdh_components/hadoop-2.6.0-cdh5.10.0-SNAPSHOT//lib/native:
*/home/lv/i2/be/build/debug/service*
:/opt/Impala-Toolchain/snappy-1.1.3/lib:/home/lv/i2/../Impala-lzo/build:/opt/Impala-Toolchain/gcc-4.9.2/lib64
✔ ~/i2(i2) ✗$ ls /home/lv/i2/be/build/debug/service
impalad libfesupport.so libService.a
On Tue, Oct 11, 2016 at 1:36 AM, Alex Behm <al...@cloudera.com> wrote:
> This looks more like it could not find libfesupport.so. Do you have it on
> your LD_LIBRARY_PATH?
>
> Regarding the dependency stuff. As part of "mvn package" we execute the
> "copy-dependencies" plugin which populates target/dependency.
> You can manually run that step only with "mvn dependency:copy-dependencies"
> from the fe dir.
>
>
> On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <lv...@cloudera.com> wrote:
>
> > I'm trying to run the ParserTest but cannot get it to work.
> >
> > Running org.apache.impala.analysis.ParserTest
> > > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.856
> > sec
> > > <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> > > TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed:
> > 0.011
> > > sec <<< ERROR!
> > > java.lang.UnsatisfiedLinkError:
> > > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> > > at
> > > org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native
> > Method)
> > > at
> > > org.apache.impala.service.FeSupport.GetStartupOptions(
> > FeSupport.java:268)
> > > at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.
> > java:47)
> > > at org.apache.impala.common.RuntimeEnv.<clinit>(
> > RuntimeEnv.java:34)
> > > at
> > > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> > TestUtils.java:288)
> > > at
> > > org.apache.impala.analysis.ParserTest.TestKuduUpdate(
> > ParserTest.java:1632)
> > >
> > > Results :
> > >
> > > Tests in error:
> > > ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
> > > org.apache.impala.service.FeS...
> >
> >
> >
> > My working copy does not seem to have the necessary dependencies
> > in testdata/target/dependency/. I suspect this causes my issue.
> >
> > $ source bin/set-classpath.sh
> > > bin/set-classpath.sh:40: no matches found:
> > > /home/lv/i2/testdata/target/dependency/*.jar
> >
> >
> > Where do those files come from and how can I get them?
> >
> > Thanks for the help, Lars
> >
>
Re: Where is testdata/target/dependency/ populated
Posted by Alex Behm <al...@cloudera.com>.
This looks more like it could not find libfesupport.so. Do you have it on
your LD_LIBRARY_PATH?
Regarding the dependency stuff. As part of "mvn package" we execute the
"copy-dependencies" plugin which populates target/dependency.
You can manually run that step only with "mvn dependency:copy-dependencies"
from the fe dir.
On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <lv...@cloudera.com> wrote:
> I'm trying to run the ParserTest but cannot get it to work.
>
> Running org.apache.impala.analysis.ParserTest
> > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.856
> sec
> > <<< FAILURE! - in org.apache.impala.analysis.ParserTest
> > TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed:
> 0.011
> > sec <<< ERROR!
> > java.lang.UnsatisfiedLinkError:
> > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B
> > at
> > org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native
> Method)
> > at
> > org.apache.impala.service.FeSupport.GetStartupOptions(
> FeSupport.java:268)
> > at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.
> java:47)
> > at org.apache.impala.common.RuntimeEnv.<clinit>(
> RuntimeEnv.java:34)
> > at
> > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported(
> TestUtils.java:288)
> > at
> > org.apache.impala.analysis.ParserTest.TestKuduUpdate(
> ParserTest.java:1632)
> >
> > Results :
> >
> > Tests in error:
> > ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink
> > org.apache.impala.service.FeS...
>
>
>
> My working copy does not seem to have the necessary dependencies
> in testdata/target/dependency/. I suspect this causes my issue.
>
> $ source bin/set-classpath.sh
> > bin/set-classpath.sh:40: no matches found:
> > /home/lv/i2/testdata/target/dependency/*.jar
>
>
> Where do those files come from and how can I get them?
>
> Thanks for the help, Lars
>