You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by jun <10...@qq.com> on 2017/12/18 10:54:31 UTC
Re: kylin 监控JMX
Is this problem solved?
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: Re: kylin 监控JMX
Posted by "chenping_cd@keruyun.com" <ch...@keruyun.com>.
I have this problem
"export JMX_PORT=port_number in kylin.sh, It doesn't work and the port doesn't
come up", How to solve ?
陈平 DBA工程师
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
From: jun
Date: 2017-12-18 20:18
To: dev
Subject: Re: kylin 监控JMX
export JMX_PORT=port_number in kylin.sh, It doesn't work and the port doesn't
come up
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: kylin development environment
Posted by shaoxiong zhan <sh...@gmail.com>.
Can you provide more detailed info, such as kylin.log, kylin.properties.
2017-12-20 19:38 GMT+08:00 serajoon <se...@163.com>:
> Hi kylin team:
> I built a kylin development environment in my windows operating system
> with the idea IDE. Hadoop environment is my virtual machine with
> hadoop2.7.2 hbase1.1.2 hive1.2.1。
> I can build cube in my windows operating system with mapreduce。In
> virtual machine if I start up a kylin Instance(2.2),the query is ok。But in
> my windows operating, when I submit the query sql,it is wrong,"null while
> executing SQL: "SELECT ***".
> I guess I have a less configuration, where is it.
kylin development environment
Posted by serajoon <se...@163.com>.
Hi kylin team:
I built a kylin development environment in my windows operating system with the idea IDE. Hadoop environment is my virtual machine with hadoop2.7.2 hbase1.1.2 hive1.2.1。
I can build cube in my windows operating system with mapreduce。In virtual machine if I start up a kylin Instance(2.2),the query is ok。But in my windows operating, when I submit the query sql,it is wrong,"null while executing SQL: "SELECT ***".
I guess I have a less configuration, where is it.
Re: kylin 监控JMX
Posted by jun <10...@qq.com>.
thx @kaisen
as to your config, I use jmx_prometheus_httpserver as jmxtools, and run it
on the same host to kylin-server. But I encounter the problem:
http://apache-kylin.74782.x6.nabble.com/kylin-jmx-config-problem-td9689.html,
the kylin webService can't visit.
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: Re: kylin 监控JMX
Posted by "chenping_cd@keruyun.com" <ch...@keruyun.com>.
I have set kylin.server.query-metrics-enabled in kylin.properties ,and I have set export JMX_PORT=9001 in kylin.sh,But the port 9001 doesn't come up,why?
kylin verison :1.6 hadoop:CDH 8.4 jmx-collection-client:JConsole
my kylin log:
2017-12-25 14:05:02,864 INFO [localhost-startStop-1] init.InitialTaskManager:37 : Kylin service is starting.....
2017-12-25 14:05:02,898 WARN [localhost-startStop-1] impl.MetricsConfig:124 : Cannot locate configuration: tried hadoop-metrics2-kylin.properties,hadoop
-metrics2.properties
2017-12-25 14:05:02,917 INFO [localhost-startStop-1] impl.MetricsSystemImpl:377 : Scheduled snapshot period at 10 second(s).
2017-12-25 14:05:02,918 INFO [localhost-startStop-1] impl.MetricsSystemImpl:191 : Kylin metrics system started
2017-12-25 14:05:03,185 DEBUG [localhost-startStop-1] hbase.HBaseConnection:277 : HTable 'kylin_metadata_user' already exists
2017-12-25 14:05:03,371 INFO [localhost-startStop-1] filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM argument net.sf.ehc
ache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : ^.*cache\..*IgnoreSizeOf$
2017-12-25 14:05:03,390 INFO [localhost-startStop-1] sizeof.JvmInformation:446 : Detected JVM data model settings of: 64-Bit HotSpot JVM with Compressed
OOPs and Concurrent Mark-and-Sweep GC
陈平 DBA工程师
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
From: kangkaisen
Date: 2017-12-20 11:53
To: dev
Subject: Re: kylin 监控JMX
After setting kylin.server.query-metrics-enabled to true, kylin query metrics
will send to JMX.
As for How to collect JMX info:
For prod, you could use any well-known jmxtools to collect JMX info.
For debug and test, you could use jconsole tools:
1. set following commands to setenv.sh
export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=8416 -Djava.rmi.server.hostname=your
server IP -Dcom.sun.management.jmxremote.rmi.port=8416
-Dcom.sun.management.jmxremote.local.only=false"
2. restart kylin server
3. test a query
4. run jconsole on your local computer
5. connect remote kylin server with ip:port
6. click MBean button and find Hadoop-kylin-*** MBeans.
<http://apache-kylin.74782.x6.nabble.com/file/t705/1.1>
<http://apache-kylin.74782.x6.nabble.com/file/t705/2.2>
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: kylin 监控JMX
Posted by praveenece <pr...@gmail.com>.
Hi
How can i match in kylin Dashboard because my Dashboard showing zero for all
items
Can u tell me?
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: kylin 监控JMX
Posted by praveenece <pr...@gmail.com>.
Hi,
i Done all the Steps which your mentioned,but apche-kylin Ui Dashboard
Query Count and other items not recorded.(showing zero)
Cube planner- Cuboid Colors also not changed
what i need to flow?
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: Re: kylin 监控JMX
Posted by "chenping_cd@keruyun.com" <ch...@keruyun.com>.
I have soulved this problem,I set -Dcom.sun.management.jmxremote.port=8888 -Dcom.sun.management.
jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false of KYLIN_JVM_SETTINGS in setenv.sh
陈平 DBA工程师
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
发件人： chenping_cd@keruyun.com
发送时间： 2017-12-25 14:06
收件人： dev
主题： Re: Re: kylin 监控JMX
I have set kylin.server.query-metrics-enabled in kylin.properties ,and I have set export JMX_PORT=9001 in kylin.sh,But the port 9001 doesn't come up,why?
kylin verison :1.6 hadoop:CDH 8.4 jmx-collection-client:JConsole
my kylin log:
2017-12-25 14:05:02,864 INFO [localhost-startStop-1] init.InitialTaskManager:37 : Kylin service is starting.....
2017-12-25 14:05:02,898 WARN [localhost-startStop-1] impl.MetricsConfig:124 : Cannot locate configuration: tried hadoop-metrics2-kylin.properties,hadoop
-metrics2.properties
2017-12-25 14:05:02,917 INFO [localhost-startStop-1] impl.MetricsSystemImpl:377 : Scheduled snapshot period at 10 second(s).
2017-12-25 14:05:02,918 INFO [localhost-startStop-1] impl.MetricsSystemImpl:191 : Kylin metrics system started
2017-12-25 14:05:03,185 DEBUG [localhost-startStop-1] hbase.HBaseConnection:277 : HTable 'kylin_metadata_user' already exists
2017-12-25 14:05:03,371 INFO [localhost-startStop-1] filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM argument net.sf.ehc
ache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : ^.*cache\..*IgnoreSizeOf$
2017-12-25 14:05:03,390 INFO [localhost-startStop-1] sizeof.JvmInformation:446 : Detected JVM data model settings of: 64-Bit HotSpot JVM with Compressed
OOPs and Concurrent Mark-and-Sweep GC
陈平 DBA工程师
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
From: kangkaisen
Date: 2017-12-20 11:53
To: dev
Subject: Re: kylin 监控JMX
After setting kylin.server.query-metrics-enabled to true, kylin query metrics
will send to JMX.
As for How to collect JMX info:
For prod, you could use any well-known jmxtools to collect JMX info.
For debug and test, you could use jconsole tools:
1. set following commands to setenv.sh
export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=8416 -Djava.rmi.server.hostname=your
server IP -Dcom.sun.management.jmxremote.rmi.port=8416
-Dcom.sun.management.jmxremote.local.only=false"
2. restart kylin server
3. test a query
4. run jconsole on your local computer
5. connect remote kylin server with ip:port
6. click MBean button and find Hadoop-kylin-*** MBeans.
<http://apache-kylin.74782.x6.nabble.com/file/t705/1.1>
<http://apache-kylin.74782.x6.nabble.com/file/t705/2.2>
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: Re: kylin 监控JMX
Posted by jun <10...@qq.com>.
Hi,
can you try jconsloe on the same host to kylin?
I encounter problem if jconsloe client with the same host to kylin...
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: kylin 监控JMX
Posted by kangkaisen <ka...@apache.org>.
After setting kylin.server.query-metrics-enabled to true, kylin query metrics
will send to JMX.
As for How to collect JMX info:
For prod, you could use any well-known jmxtools to collect JMX info.
For debug and test, you could use jconsole tools:
1. set following commands to setenv.sh
export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=8416 -Djava.rmi.server.hostname=your
server IP -Dcom.sun.management.jmxremote.rmi.port=8416
-Dcom.sun.management.jmxremote.local.only=false"
2. restart kylin server
3. test a query
4. run jconsole on your local computer
5. connect remote kylin server with ip:port
6. click MBean button and find Hadoop-kylin-*** MBeans.
<http://apache-kylin.74782.x6.nabble.com/file/t705/1.1>
<http://apache-kylin.74782.x6.nabble.com/file/t705/2.2>
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: kylin 监控JMX
Posted by jun <10...@qq.com>.
Have someone others konw this issue?
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: kylin 监控JMX
Posted by ShaoFeng Shi <sh...@apache.org>.
okay; thanks for the update.
@kaisen, could you please check this?
2017-12-18 20:18 GMT+08:00 jun <10...@qq.com>:
> export JMX_PORT=port_number in kylin.sh, It doesn't work and the port
> doesn't
> come up
>
> --
> Sent from: http://apache-kylin.74782.x6.nabble.com/
>
--
Best regards,
Shaofeng Shi 史少锋
Re: kylin 监控JMX
Posted by jun <10...@qq.com>.
export JMX_PORT=port_number in kylin.sh, It doesn't work and the port doesn't
come up
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: kylin 监控JMX
Posted by ShaoFeng Shi <sh...@apache.org>.
Should be this single configuration; Besides, please try to add
"export JMX_PORT=port_number" in kylin.sh, so that JMX knows which port to
expose the metrics.
You can also refer to this article if haven't:
https://blog.bcmeng.com/post/kylin-query-metrics.html
2017-12-18 18:54 GMT+08:00 jun <10...@qq.com>:
> Is this problem solved?
>
> --
> Sent from: http://apache-kylin.74782.x6.nabble.com/
>
--
Best regards,
Shaofeng Shi 史少锋