You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by sharad agarwal <sh...@apache.org> on 2015/07/28 07:53:01 UTC

Review Request 36876: LENS-699 : Check for service to be up instead of using sleep in docker bootstrap

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/36876/
-----------------------------------------------------------

Review request for lens.


Repository: lens


Description
-------

LENS-699 : Check for service to be up instead of using sleep in docker bootstrap


Diffs
-----

  lens-docker/lens-test/lens-bootstrap.sh bdc5e2cb7929b750df5d517a1c18c060e417de9a 

Diff: https://reviews.apache.org/r/36876/diff/


Testing
-------

Output from the run-docker.sh
-----------------------------
~/projects/incubator-lens/tools/scripts>./run-docker.sh 
Lens Basedir is -> /Users/sharad.ag/projects/incubator-lens
LENS_HOME  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server
LENS_SERVER_CONF  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/conf-pseudo-distr/
LENS_CLIENT  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client
LENS_CLIENT_CONF  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/conf-pseudo-distr/
LENS_ML  /opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/
SPARK_HOME  /usr/local/spark-1.3.0-bin-hadoop2.4
rm: cannot remove '/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/*.log': No such file or directory
rm: cannot remove '/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/logs/*': No such file or directory
SPARK_YARN_JAR  /usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
HIVE_AUX_JARS_PATH  /opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml//lib/lens-ml-lib-2.3.0-beta-incubating-SNAPSHOT.jar,/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
Starting postgresql server...
/
2015-07-28 05:43:58 GMT LOG:  redirecting log output to logging collector process
2015-07-28 05:43:58 GMT HINT:  Future log output will appear in directory "pg_log".
Starting namenodes on [aa3f59d211cd]
aa3f59d211cd: starting namenode, logging to /usr/local/hadoop/logs/hadoop-root-namenode-aa3f59d211cd.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-root-datanode-aa3f59d211cd.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-root-secondarynamenode-aa3f59d211cd.out
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn--resourcemanager-aa3f59d211cd.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-root-nodemanager-aa3f59d211cd.out
Starting Hive Metastore Server
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Namenode up at 9000
RM up at 8088
HiveMetastore not yet up at 9083. waiting for 5 sec
Starting HiveServer2
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
HiveMetastore up at 9083
HiveServer not yet up at 10000. waiting for 5 sec
HiveServer not yet up at 10000. waiting for 5 sec
HiveServer not yet up at 10000. waiting for 5 sec
HiveServer up at 10000
Starting Lens server...
/
Adding hadoop libs in classpath from /usr/local/hadoop
HIVE_HOME is set, adding /usr/local/hive-dist/apache-hive-0.13.4-inm-SNAPSHOT-bin/lib/* into lens classpath
Started lens server!
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer not yet up at 9999. waiting for 5 sec
LensServer up at 9999
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Created DB storages
Created sample metastore!
Database:default
Storages:[cluster1, local, mydb]
Cubes:[sample_cube, sales]
Dimensions:[sample_db_dim, product, customer, sample_dim, sample_dim2, city]
Fact tables:[sales_aggr_fact2, rawfact, sales_raw_fact, sales_aggr_continuous_fact, fact1, sales_aggr_fact1, fact2]
Dimension tables:[city_table, dim_table, customer_table, dim_table3, product_db_table, dim_table2, product_table, dim_table4, city_subset]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Added partition from:dim1-local-part.xml
Added partition from:dim2-local-part.xml
Added partition from:dim4-local-part.xml
Added partitions from:product-local-parts.xml
Added partition from:city-local-part.xml
Added partition from:customer-local-part.xml
Added partition from:fact1-local-part1.xml
Added partition from:fact1-local-part2.xml
Added partition from:fact1-local-part3.xml
Added partition from:fact2-local-part1.xml
Added partition from:fact2-local-part2.xml
Added partition from:fact2-local-part3.xml
Added partition from:raw-local-part1.xml
Added partition from:raw-local-part2.xml
Added partition from:raw-local-part3.xml
Added partition from:raw-local-part4.xml
Added partition from:raw-local-part5.xml
Added partition from:raw-local-part6.xml
Added partitions from:sales-raw-local-parts.xml
Added partitions from:sales-aggr-fact1-local-parts.xml
Added partitions from:sales-aggr-fact2-local-parts.xml
Added partitions from:sales-aggr-fact1-mydb-parts.xml
Added partitions from:sales-aggr-fact2-mydb-parts.xml
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
=======================================
*                                     *
*            Lens Client              *
*                                     *
=======================================

Welcome to Lens Client
lens-shell>


Thanks,

sharad agarwal


Re: Review Request 36876: LENS-699 : Check for service to be up instead of using sleep in docker bootstrap

Posted by Amareshwari Sriramadasu <am...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/36876/#review93250
-----------------------------------------------------------

Ship it!


Ship It!

- Amareshwari Sriramadasu


On July 28, 2015, 5:53 a.m., sharad agarwal wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/36876/
> -----------------------------------------------------------
> 
> (Updated July 28, 2015, 5:53 a.m.)
> 
> 
> Review request for lens.
> 
> 
> Repository: lens
> 
> 
> Description
> -------
> 
> LENS-699 : Check for service to be up instead of using sleep in docker bootstrap
> 
> 
> Diffs
> -----
> 
>   lens-docker/lens-test/lens-bootstrap.sh bdc5e2cb7929b750df5d517a1c18c060e417de9a 
> 
> Diff: https://reviews.apache.org/r/36876/diff/
> 
> 
> Testing
> -------
> 
> Output from the run-docker.sh
> -----------------------------
> ~/projects/incubator-lens/tools/scripts>./run-docker.sh 
> Lens Basedir is -> /Users/sharad.ag/projects/incubator-lens
> LENS_HOME  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server
> LENS_SERVER_CONF  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/conf-pseudo-distr/
> LENS_CLIENT  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client
> LENS_CLIENT_CONF  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/conf-pseudo-distr/
> LENS_ML  /opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/
> SPARK_HOME  /usr/local/spark-1.3.0-bin-hadoop2.4
> rm: cannot remove '/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/*.log': No such file or directory
> rm: cannot remove '/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/logs/*': No such file or directory
> SPARK_YARN_JAR  /usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
> HIVE_AUX_JARS_PATH  /opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml//lib/lens-ml-lib-2.3.0-beta-incubating-SNAPSHOT.jar,/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
> Starting postgresql server...
> /
> 2015-07-28 05:43:58 GMT LOG:  redirecting log output to logging collector process
> 2015-07-28 05:43:58 GMT HINT:  Future log output will appear in directory "pg_log".
> Starting namenodes on [aa3f59d211cd]
> aa3f59d211cd: starting namenode, logging to /usr/local/hadoop/logs/hadoop-root-namenode-aa3f59d211cd.out
> localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-root-datanode-aa3f59d211cd.out
> Starting secondary namenodes [0.0.0.0]
> 0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-root-secondarynamenode-aa3f59d211cd.out
> starting yarn daemons
> starting resourcemanager, logging to /usr/local/hadoop/logs/yarn--resourcemanager-aa3f59d211cd.out
> localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-root-nodemanager-aa3f59d211cd.out
> Starting Hive Metastore Server
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Namenode up at 9000
> RM up at 8088
> HiveMetastore not yet up at 9083. waiting for 5 sec
> Starting HiveServer2
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> HiveMetastore up at 9083
> HiveServer not yet up at 10000. waiting for 5 sec
> HiveServer not yet up at 10000. waiting for 5 sec
> HiveServer not yet up at 10000. waiting for 5 sec
> HiveServer up at 10000
> Starting Lens server...
> /
> Adding hadoop libs in classpath from /usr/local/hadoop
> HIVE_HOME is set, adding /usr/local/hive-dist/apache-hive-0.13.4-inm-SNAPSHOT-bin/lib/* into lens classpath
> Started lens server!
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer up at 9999
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Created DB storages
> Created sample metastore!
> Database:default
> Storages:[cluster1, local, mydb]
> Cubes:[sample_cube, sales]
> Dimensions:[sample_db_dim, product, customer, sample_dim, sample_dim2, city]
> Fact tables:[sales_aggr_fact2, rawfact, sales_raw_fact, sales_aggr_continuous_fact, fact1, sales_aggr_fact1, fact2]
> Dimension tables:[city_table, dim_table, customer_table, dim_table3, product_db_table, dim_table2, product_table, dim_table4, city_subset]
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Added partition from:dim1-local-part.xml
> Added partition from:dim2-local-part.xml
> Added partition from:dim4-local-part.xml
> Added partitions from:product-local-parts.xml
> Added partition from:city-local-part.xml
> Added partition from:customer-local-part.xml
> Added partition from:fact1-local-part1.xml
> Added partition from:fact1-local-part2.xml
> Added partition from:fact1-local-part3.xml
> Added partition from:fact2-local-part1.xml
> Added partition from:fact2-local-part2.xml
> Added partition from:fact2-local-part3.xml
> Added partition from:raw-local-part1.xml
> Added partition from:raw-local-part2.xml
> Added partition from:raw-local-part3.xml
> Added partition from:raw-local-part4.xml
> Added partition from:raw-local-part5.xml
> Added partition from:raw-local-part6.xml
> Added partitions from:sales-raw-local-parts.xml
> Added partitions from:sales-aggr-fact1-local-parts.xml
> Added partitions from:sales-aggr-fact2-local-parts.xml
> Added partitions from:sales-aggr-fact1-mydb-parts.xml
> Added partitions from:sales-aggr-fact2-mydb-parts.xml
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> =======================================
> *                                     *
> *            Lens Client              *
> *                                     *
> =======================================
> 
> Welcome to Lens Client
> lens-shell>
> 
> 
> Thanks,
> 
> sharad agarwal
> 
>


Re: Review Request 36876: LENS-699 : Check for service to be up instead of using sleep in docker bootstrap

Posted by Rajat Khandelwal <ra...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/36876/#review93245
-----------------------------------------------------------

Ship it!



lens-docker/lens-test/lens-bootstrap.sh (line 30)
<https://reviews.apache.org/r/36876/#comment147583>

    extra whitespace


- Rajat Khandelwal


On July 28, 2015, 11:23 a.m., sharad agarwal wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/36876/
> -----------------------------------------------------------
> 
> (Updated July 28, 2015, 11:23 a.m.)
> 
> 
> Review request for lens.
> 
> 
> Repository: lens
> 
> 
> Description
> -------
> 
> LENS-699 : Check for service to be up instead of using sleep in docker bootstrap
> 
> 
> Diffs
> -----
> 
>   lens-docker/lens-test/lens-bootstrap.sh bdc5e2cb7929b750df5d517a1c18c060e417de9a 
> 
> Diff: https://reviews.apache.org/r/36876/diff/
> 
> 
> Testing
> -------
> 
> Output from the run-docker.sh
> -----------------------------
> ~/projects/incubator-lens/tools/scripts>./run-docker.sh 
> Lens Basedir is -> /Users/sharad.ag/projects/incubator-lens
> LENS_HOME  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server
> LENS_SERVER_CONF  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/conf-pseudo-distr/
> LENS_CLIENT  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client
> LENS_CLIENT_CONF  /opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/conf-pseudo-distr/
> LENS_ML  /opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/
> SPARK_HOME  /usr/local/spark-1.3.0-bin-hadoop2.4
> rm: cannot remove '/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/*.log': No such file or directory
> rm: cannot remove '/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/logs/*': No such file or directory
> SPARK_YARN_JAR  /usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
> HIVE_AUX_JARS_PATH  /opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml//lib/lens-ml-lib-2.3.0-beta-incubating-SNAPSHOT.jar,/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar
> Starting postgresql server...
> /
> 2015-07-28 05:43:58 GMT LOG:  redirecting log output to logging collector process
> 2015-07-28 05:43:58 GMT HINT:  Future log output will appear in directory "pg_log".
> Starting namenodes on [aa3f59d211cd]
> aa3f59d211cd: starting namenode, logging to /usr/local/hadoop/logs/hadoop-root-namenode-aa3f59d211cd.out
> localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-root-datanode-aa3f59d211cd.out
> Starting secondary namenodes [0.0.0.0]
> 0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-root-secondarynamenode-aa3f59d211cd.out
> starting yarn daemons
> starting resourcemanager, logging to /usr/local/hadoop/logs/yarn--resourcemanager-aa3f59d211cd.out
> localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-root-nodemanager-aa3f59d211cd.out
> Starting Hive Metastore Server
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Namenode up at 9000
> RM up at 8088
> HiveMetastore not yet up at 9083. waiting for 5 sec
> Starting HiveServer2
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.5.2/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/usr/local/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.3.0-hadoop2.4.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> HiveMetastore up at 9083
> HiveServer not yet up at 10000. waiting for 5 sec
> HiveServer not yet up at 10000. waiting for 5 sec
> HiveServer not yet up at 10000. waiting for 5 sec
> HiveServer up at 10000
> Starting Lens server...
> /
> Adding hadoop libs in classpath from /usr/local/hadoop
> HIVE_HOME is set, adding /usr/local/hive-dist/apache-hive-0.13.4-inm-SNAPSHOT-bin/lib/* into lens classpath
> Started lens server!
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer not yet up at 9999. waiting for 5 sec
> LensServer up at 9999
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Created DB storages
> Created sample metastore!
> Database:default
> Storages:[cluster1, local, mydb]
> Cubes:[sample_cube, sales]
> Dimensions:[sample_db_dim, product, customer, sample_dim, sample_dim2, city]
> Fact tables:[sales_aggr_fact2, rawfact, sales_raw_fact, sales_aggr_continuous_fact, fact1, sales_aggr_fact1, fact2]
> Dimension tables:[city_table, dim_table, customer_table, dim_table3, product_db_table, dim_table2, product_table, dim_table4, city_subset]
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> Added partition from:dim1-local-part.xml
> Added partition from:dim2-local-part.xml
> Added partition from:dim4-local-part.xml
> Added partitions from:product-local-parts.xml
> Added partition from:city-local-part.xml
> Added partition from:customer-local-part.xml
> Added partition from:fact1-local-part1.xml
> Added partition from:fact1-local-part2.xml
> Added partition from:fact1-local-part3.xml
> Added partition from:fact2-local-part1.xml
> Added partition from:fact2-local-part2.xml
> Added partition from:fact2-local-part3.xml
> Added partition from:raw-local-part1.xml
> Added partition from:raw-local-part2.xml
> Added partition from:raw-local-part3.xml
> Added partition from:raw-local-part4.xml
> Added partition from:raw-local-part5.xml
> Added partition from:raw-local-part6.xml
> Added partitions from:sales-raw-local-parts.xml
> Added partitions from:sales-aggr-fact1-local-parts.xml
> Added partitions from:sales-aggr-fact2-local-parts.xml
> Added partitions from:sales-aggr-fact1-mydb-parts.xml
> Added partitions from:sales-aggr-fact2-mydb-parts.xml
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/opt/lens/lens-ml-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-ml/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/opt/lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/client/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> =======================================
> *                                     *
> *            Lens Client              *
> *                                     *
> =======================================
> 
> Welcome to Lens Client
> lens-shell>
> 
> 
> Thanks,
> 
> sharad agarwal
> 
>