You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by Neerja Bhatnagar <bn...@gmail.com> on 2015/06/23 19:50:49 UTC
Running lens-test (docker)
Hi!
I am in the following folder - lens/incubator-lens/lens-docker/lens-test. I
try to run the tests in this folder by running lens-bootstrap.sh. I get the
following error. Is there documentation available on docker settings, and
running docker tests that I can refer to?
Neerjas-MacBook-Pro:lens-test nbhatnag$ ./lens-bootstrap.sh
LENS_HOME
LENS_SERVER_CONF
LENS_CLIENT
LENS_CLIENT_CONF
LENS_ML
SPARK_HOME
./lens-bootstrap.sh: line 28: /bin/lens-ml-classpath.sh: No such file or
directory
HIVE_AUX_JARS_PATH
/lib/lens-ml-lib-2.2.0-beta-incubating-SNAPSHOT.jar,/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
./lens-bootstrap.sh: line 37: /etc/hive-bootstrap.sh: No such file or
directory
Waiting for 20 secs for servers to start ...
Starting Lens server...
./lens-bootstrap.sh: line 44: /bin/lens-ctl: No such file or directory
Waiting for 60 secs for Lens Server to start ...
./lens-bootstrap.sh: line 50: /bin/run-examples.sh: No such file or
directory
./lens-bootstrap.sh: line 51: /bin/run-examples.sh: No such file or
directory
./lens-bootstrap.sh: line 52: /bin/lens-cli.sh: No such file or directory
Thank you,
Neerja
Re: Running lens-test (docker)
Posted by Yash Sharma <ya...@gmail.com>.
Also to add on -
You would find lens dir in -
/opt/lens
You can then deploy lens like-
Deploy:
-----------
cd /opt/lens
mkdir -p /usr/local/lens
tar xvzf lens-dist/target/*.tar.gz --strip=1 -C /usr/local/lens
cd /usr/local/lens
Start Lens Server:
-------------------------
./server/bin/lens-ctl start
Populate sample data:
------------------------------
./client/bin/run-examples.sh sample-metastore
./client/bin/run-examples.sh populate-metastore
Start lens client:
----------------------
./client/bin/lens-cli.sh
On Wed, Jun 24, 2015 at 12:05 AM, Yash Sharma <ya...@gmail.com> wrote:
> Hey Neerja, Just adding a quick note. Hope it helps -
>
> Last time I tried lens-docker I used the run-docker.sh in the tools dir
> directly.
> $ cd incubator-lens
> $ tools/scripts/run-docker.sh
>
> Will check further details tomm.
> Best Regards
>
> You should see output like-
>
> Lens Basedir is -> /home/yash/work/git/incubator-lens
>> LENS_HOME
>> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/server
>> LENS_SERVER_CONF
>> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/server/conf-pseudo-distr/
>> LENS_CLIENT
>> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/client
>> LENS_CLIENT_CONF
>> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/client/conf-pseudo-distr/
>> LENS_ML
>> /opt/lens/lens-ml-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-ml/
>> SPARK_HOME /usr/local/spark-1.3.0-bin-hadoop2.4
>> SPARK_YARN_JAR
>> /usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
>> HIVE_AUX_JARS_PATH
>> /opt/lens/lens-ml-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-ml//lib/lens-ml-lib-2.1.0-beta-incubating-SNAPSHOT.jar,/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
>> Starting postgresql server...
>> /
>> 2015-06-23 18:27:18 GMT LOG: redirecting log output to logging collector
>> process
>> 2015-06-23 18:27:18 GMT HINT: Future log output will appear in directory
>> "pg_log".
>> Starting namenodes on [0711c57b224b]
>> 0711c57b224b: starting namenode, logging to
>> /usr/local/hadoop/logs/hadoop-root-namenode-0711c57b224b.out
>> localhost: starting datanode, logging to
>> /usr/local/hadoop/logs/hadoop-root-datanode-0711c57b224b.out
>> Starting secondary namenodes [0.0.0.0]
>> 0.0.0.0: starting secondarynamenode, logging to
>> /usr/local/hadoop/logs/hadoop-root-secondarynamenode-0711c57b224b.out
>> starting yarn daemons
>> starting resourcemanager, logging to
>> /usr/local/hadoop/logs/yarn--resourcemanager-0711c57b224b.out
>> localhost: starting nodemanager, logging to
>> /usr/local/hadoop/logs/yarn-root-nodemanager-0711c57b224b.out
>> Starting Hive Metastore Server
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in
>> [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in
>> [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>> explanation.
>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
>> use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
>> files.
>> Waiting for 20 secs for servers to start ...
>> Starting HiveServer2
>
>
>
>
> On Tue, Jun 23, 2015 at 11:20 PM, Neerja Bhatnagar <bn...@gmail.com>
> wrote:
>
>> Hi!
>>
>> I am in the following folder - lens/incubator-lens/lens-docker/lens-test.
>> I
>> try to run the tests in this folder by running lens-bootstrap.sh. I get
>> the
>> following error. Is there documentation available on docker settings, and
>> running docker tests that I can refer to?
>>
>> Neerjas-MacBook-Pro:lens-test nbhatnag$ ./lens-bootstrap.sh
>> LENS_HOME
>> LENS_SERVER_CONF
>> LENS_CLIENT
>> LENS_CLIENT_CONF
>> LENS_ML
>> SPARK_HOME
>> ./lens-bootstrap.sh: line 28: /bin/lens-ml-classpath.sh: No such file or
>> directory
>> HIVE_AUX_JARS_PATH
>>
>> /lib/lens-ml-lib-2.2.0-beta-incubating-SNAPSHOT.jar,/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
>> ./lens-bootstrap.sh: line 37: /etc/hive-bootstrap.sh: No such file or
>> directory
>> Waiting for 20 secs for servers to start ...
>> Starting Lens server...
>> ./lens-bootstrap.sh: line 44: /bin/lens-ctl: No such file or directory
>> Waiting for 60 secs for Lens Server to start ...
>> ./lens-bootstrap.sh: line 50: /bin/run-examples.sh: No such file or
>> directory
>> ./lens-bootstrap.sh: line 51: /bin/run-examples.sh: No such file or
>> directory
>> ./lens-bootstrap.sh: line 52: /bin/lens-cli.sh: No such file or directory
>>
>> Thank you,
>> Neerja
>>
>
>
Re: Running lens-test (docker)
Posted by Yash Sharma <ya...@gmail.com>.
Hey Neerja, Just adding a quick note. Hope it helps -
Last time I tried lens-docker I used the run-docker.sh in the tools dir
directly.
$ cd incubator-lens
$ tools/scripts/run-docker.sh
Will check further details tomm.
Best Regards
You should see output like-
Lens Basedir is -> /home/yash/work/git/incubator-lens
> LENS_HOME
> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/server
> LENS_SERVER_CONF
> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/server/conf-pseudo-distr/
> LENS_CLIENT
> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/client
> LENS_CLIENT_CONF
> /opt/lens/lens-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.2.0-beta-incubating-SNAPSHOT-bin/client/conf-pseudo-distr/
> LENS_ML
> /opt/lens/lens-ml-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-ml/
> SPARK_HOME /usr/local/spark-1.3.0-bin-hadoop2.4
> SPARK_YARN_JAR
> /usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
> HIVE_AUX_JARS_PATH
> /opt/lens/lens-ml-dist/target/apache-lens-2.2.0-beta-incubating-SNAPSHOT-ml//lib/lens-ml-lib-2.1.0-beta-incubating-SNAPSHOT.jar,/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
> Starting postgresql server...
> /
> 2015-06-23 18:27:18 GMT LOG: redirecting log output to logging collector
> process
> 2015-06-23 18:27:18 GMT HINT: Future log output will appear in directory
> "pg_log".
> Starting namenodes on [0711c57b224b]
> 0711c57b224b: starting namenode, logging to
> /usr/local/hadoop/logs/hadoop-root-namenode-0711c57b224b.out
> localhost: starting datanode, logging to
> /usr/local/hadoop/logs/hadoop-root-datanode-0711c57b224b.out
> Starting secondary namenodes [0.0.0.0]
> 0.0.0.0: starting secondarynamenode, logging to
> /usr/local/hadoop/logs/hadoop-root-secondarynamenode-0711c57b224b.out
> starting yarn daemons
> starting resourcemanager, logging to
> /usr/local/hadoop/logs/yarn--resourcemanager-0711c57b224b.out
> localhost: starting nodemanager, logging to
> /usr/local/hadoop/logs/yarn-root-nodemanager-0711c57b224b.out
> Starting Hive Metastore Server
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
> use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
> files.
> Waiting for 20 secs for servers to start ...
> Starting HiveServer2
On Tue, Jun 23, 2015 at 11:20 PM, Neerja Bhatnagar <bn...@gmail.com>
wrote:
> Hi!
>
> I am in the following folder - lens/incubator-lens/lens-docker/lens-test. I
> try to run the tests in this folder by running lens-bootstrap.sh. I get the
> following error. Is there documentation available on docker settings, and
> running docker tests that I can refer to?
>
> Neerjas-MacBook-Pro:lens-test nbhatnag$ ./lens-bootstrap.sh
> LENS_HOME
> LENS_SERVER_CONF
> LENS_CLIENT
> LENS_CLIENT_CONF
> LENS_ML
> SPARK_HOME
> ./lens-bootstrap.sh: line 28: /bin/lens-ml-classpath.sh: No such file or
> directory
> HIVE_AUX_JARS_PATH
>
> /lib/lens-ml-lib-2.2.0-beta-incubating-SNAPSHOT.jar,/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
> ./lens-bootstrap.sh: line 37: /etc/hive-bootstrap.sh: No such file or
> directory
> Waiting for 20 secs for servers to start ...
> Starting Lens server...
> ./lens-bootstrap.sh: line 44: /bin/lens-ctl: No such file or directory
> Waiting for 60 secs for Lens Server to start ...
> ./lens-bootstrap.sh: line 50: /bin/run-examples.sh: No such file or
> directory
> ./lens-bootstrap.sh: line 51: /bin/run-examples.sh: No such file or
> directory
> ./lens-bootstrap.sh: line 52: /bin/lens-cli.sh: No such file or directory
>
> Thank you,
> Neerja
>