You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by streemwu <st...@126.com> on 2015/07/16 12:49:38 UTC
2015年7月16日 15:34:38 自动保存草稿
hi ，
----from the log I found when i run the job of building the cube,kylin get yarn.resourcemanager.address on localhost/127.0.0.1:18032.but in my yarn-site.xml,the yarn.resourcemanager.address is
<property>
<name>yarn.resourcemanager.address</name>
<value>ewayCEServer:8032</value>
</property>
---i am sure yarn had started successful. It seems like that kylin didn't get the yarn.resourcemanager.address from $hadoop_home/etc/hadoop/yarn-site.xml. but from the kylin.log I found Hadoop job classpath contains hadoop conf ,hbase conf,hive conf
[pool-7-thread-2]:[2015-07-16 18:34:48,609][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:180)] - Hadoop job classpath is: /home/eway/hadoop-2.6.0/etc/hadoop:/home/eway/hadoop-2.6.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.6.0/share/hadoop/common/*:/home/eway/hadoop-2.6.0/share/hadoop/hdfs:/home/eway/hadoop-2.6.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.6.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.6.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.6.0/share/hadoop/yarn/*:/home/eway/hadoop-2.6.0/share/hadoop/mapreduce/lib/*:(...........)
,/home/eway/hbase-0.98.13-hadoop2/lib/hbase-common-0.98.13-hadoop2.jar,/home/eway/hive-0.13.1-cdh5.3.0/conf,/home/eway/hive-0.13.1-cdh5.3.0/lib/*,/home/eway/hive-0.13.1-cdh5.3.0/hcatalog/share/hcatalog,/home/eway/hive-0.13.1-cdh5.3.0/bin,/home/eway/hbase-0.98.13-hadoop2/conf,/home/eway/hive-0.13.1-cdh5.3.0/conf,/home/eway/hive-0.13.1-cdh5.3.0/lib/*,/home/eway/hive-0.13.1-cdh5.3.0/hcatalog/share/hcatalog,/home/eway/hive-0.13.1-cdh5.3.0/bin,/home/eway/hbase-0.98.13-hadoop2/conf
-----BTW,i have searched the resource code from incubator-kylin-0.7.2-release,but there is no '18032'.
pls help me.
Regards.
Re: 2015年7月16日 15:34:38 自动保存草稿
Posted by 周千昊 <z....@gmail.com>.
that's interesting, kylin will not hard code some thing like that. So it
should be some where in the classpath.
in the bin/ directory, we have some script to locate the hive and hbase
classpath, can you please dig into these path to check if the value 18032
is configured anywhere in the classpath or some default settings for CDH
streemwu <st...@126.com>于2015年7月16日周四 下午6:50写道：
> hi ，
> ----from the log I found when i run the job of building the cube,kylin
> get yarn.resourcemanager.address on localhost/127.0.0.1:18032.but in
> my yarn-site.xml,the yarn.resourcemanager.address is
> <property>
> <name>yarn.resourcemanager.address</name>
> <value>ewayCEServer:8032</value>
> </property>
>
> ---i am sure yarn had started successful. It seems like that kylin
> didn't get the yarn.resourcemanager.address from $hadoop_home/etc/hadoop/
> yarn-site.xml. but from the kylin.log I found Hadoop job classpath contains
> hadoop conf ,hbase conf,hive conf
>
> [pool-7-thread-2]:[2015-07-16
> 18:34:48,609][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:180)]
> - Hadoop job classpath is: /home/eway/hadoop-2.6.0/etc/hadoop
> :/home/eway/hadoop-2.6.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.6.0/share/hadoop/common/*:/home/eway/hadoop-2.6.0/share/hadoop/hdfs:/home/eway/hadoop-2.6.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.6.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.6.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.6.0/share/hadoop/yarn/*:/home/eway/hadoop-2.6.0/share/hadoop/mapreduce/lib/*:(...........)
> ,/home/eway/hbase-0.98.13-hadoop2/lib/hbase-common-0.98.13-hadoop2.jar,
> /home/eway/hive-0.13.1-cdh5.3.0/conf
> ,/home/eway/hive-0.13.1-cdh5.3.0/lib/*,/home/eway/hive-0.13.1-cdh5.3.0/hcatalog/share/hcatalog,/home/eway/hive-0.13.1-cdh5.3.0/bin,/home/eway/hbase-0.98.13-hadoop2/conf,/home/eway/hive-0.13.1-cdh5.3.0/conf,/home/eway/hive-0.13.1-cdh5.3.0/lib/*,/home/eway/hive-0.13.1-cdh5.3.0/hcatalog/share/hcatalog,/home/eway/hive-0.13.1-cdh5.3.0/bin,
> /home/eway/hbase-0.98.13-hadoop2/conf
>
> -----BTW,i have searched the resource code from
> incubator-kylin-0.7.2-release,but there is no '18032'.
> pls help me.
> Regards.
>
>
>
>
>
> --
Best Regard
ZhouQianhao