You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2015/10/20 09:57:27 UTC
[jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase
1.0
Shaofeng SHI created KYLIN-1089:
-----------------------------------
Summary: Kylin failed to run on CDH with HBase 1.0
Key: KYLIN-1089
URL: https://issues.apache.org/jira/browse/KYLIN-1089
Project: Kylin
Issue Type: Bug
Components: Environment
Affects Versions: 1.x-HBase1.x
Reporter: Shaofeng SHI
Assignee: hongbin ma
Clone kylin "1.x-HBase1.x" branch and then make a binary package, upload to a CDH environment like CDH 5.4.2 quickstart vm, "kylin.sh start" will throw exception as below:
{code}
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'aclService' defined in file [/home/cloudera/kylin-1.1-incubating-SNAPSHOT/tomcat/webapps/kylin/WEB-INF/classes/org/apache/kylin/rest/service/AclService.class]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [org.apache.kylin.rest.service.AclService]: Constructor threw exception; nested exception is java.lang.NoSuchMethodError: org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/HTableDescriptor;
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:997)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:943)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:485)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:322)
... 116 more
Caused by: org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [org.apache.kylin.rest.service.AclService]: Constructor threw exception; nested exception is java.lang.NoSuchMethodError: org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/HTableDescriptor;
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:162)
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:76)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:990)
... 124 more
Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/HTableDescriptor;
at org.apache.kylin.common.persistence.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:113)
at org.apache.kylin.common.persistence.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:86)
at org.apache.kylin.rest.service.AclService.<init>(AclService.java:127)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:147)
... 126 more
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by Luke Han <lu...@gmail.com>.
Hi Shailesh,
Great to hear this good news, I have question about "older binaries",
which one are you mean, CDH or Kylin?
Thanks.
Luke
Best Regards!
---------------------
Luke Han
On Tue, Mar 1, 2016 at 8:29 AM, sdangi <sd...@datalenz.com> wrote:
> I think I have gone past this issue. I "think", the issue was around an
> older segment that was built using older binaries. I rebuilt that segment
> using Cloudera and now am in business. I'am able to reproduce this issue
> with an older/smaller cube with 70MM records. I'm sure if I rebuilt this
> the issue may go away. If you can make any sense of this technically, do
> let me know.
>
>
> CDH5.5.3 works finally !! I will do more testing and report any issues
> back
> to the community.
>
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3765.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
I think I have gone past this issue. I "think", the issue was around an
older segment that was built using older binaries. I rebuilt that segment
using Cloudera and now am in business. I'am able to reproduce this issue
with an older/smaller cube with 70MM records. I'm sure if I rebuilt this
the issue may go away. If you can make any sense of this technically, do
let me know.
CDH5.5.3 works finally !! I will do more testing and report any issues back
to the community.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3765.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
Team -- Any updates?
I'm unable to remote debug this any further as inspite of extending the
scanner time outs, CDH some how is taking default value of 60000 ms.
However, the call does do thru
AbstractScanner.hasNxt --> Client Scanner.nxt -->ClientScanner.loadCache --
where it seems to fail.
Can Kylin team look into this and let me know as we have to provide an
update to business for one of our fin services client by this Friday.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3760.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
*KYLIN HBASE TABLES*
HTable: KYLIN_MP3JIEZRGN
Region Count: 1
Size: 6.08 GB
Start Time: 2015-01-01 00:00:00
End Time: 2015-11-30 00:00:00
'KYLIN_MP3JIEZRGN', {TABLE_ATTRIBUTES => {coprocessor$1 =>
'hdfs://sd-244e-7d9b.nam.nsroot.net:8020/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-30.jar|org.apache.kylin.storage.hbase.coprocessor.endpoint.IIEndpoint|1000|',
coprocessor$2 =>
'hdfs://sd-244e-7d9b.nam.nsroot.net:8020/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-30.jar|org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver|1001|',
METADATA => {'KYLIN_HOST' => 'kylin_metadata', 'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}},
{NAME => 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', COMPRESSION => 'SNAPPY',
BLOCKSIZE => '4194304'}
Region Server
sd-b3a6-1d0f
HTable: KYLIN_0QB4268E19
Region Count: 1
Size: 1.34 GB
Start Time: 2015-11-30 00:00:00
End Time: 2016-02-29 00:00:00
'KYLIN_0QB4268E19', {TABLE_ATTRIBUTES => {coprocessor$1 =>
'hdfs://sd-244e-7d9b.nam.nsroot.net:8020/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-31.jar|org.apache.kylin.storage.hbase.coprocessor.endpoint.IIEndpoint|1000|',
coprocessor$2 =>
'hdfs://sd-244e-7d9b.nam.nsroot.net:8020/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-31.jar|org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver|1001|',
METADATA => {'KYLIN_HOST' => 'kylin_metadata', 'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}},
{NAME => 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', COMPRESSION => 'SNAPPY',
BLOCKSIZE => '4194304'}
Region Server
sd-d7e7-2a0a
Total Size: 7.42 GB
Total Number: 2
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3750.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
*****************KYLIN QUERY
LOG**********************************************
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,040][INFO][org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:162)]
- Using project: SR14
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,041][INFO][org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:163)]
- The original query:
SELECT
CCY_D_ORC.CCY_NM CURRENCY
,SUM(TXN_FCT_ORC.USD_TXN_AMT) TOT_USD_TXN_AMT
FROM SCHEMA.TXN_FCT_ORC as TXN_FCT_ORC
INNER JOIN SCHEMA.DT_D_ORC as DT_D_ORC
ON TXN_FCT_ORC.TXN_BOOK_DT_KEY = DT_D_ORC.DT_KEY
INNER JOIN SCHEMA.CCY_D_ORC as CCY_D_ORC
ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_D_ORC.CCY_KEY
WHERE DT_D_ORC.CDR_YR='2016'
GROUP BY
CCY_D_ORC.CCY_NM
ORDER BY TOT_USD_TXN_AMT DESC
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,042][DEBUG][org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:258)]
- The corrected query: SELECT
CCY_D_ORC.CCY_NM CURRENCY
,SUM(TXN_FCT_ORC.USD_TXN_AMT) TOT_USD_TXN_AMT
FROM SCHEMA.TXN_FCT_ORC as TXN_FCT_ORC
INNER JOIN SCHEMA.DT_D_ORC as DT_D_ORC
ON TXN_FCT_ORC.TXN_BOOK_DT_KEY = DT_D_ORC.DT_KEY
INNER JOIN SCHEMA.CCY_D_ORC as CCY_D_ORC
ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_D_ORC.CCY_KEY
WHERE DT_D_ORC.CDR_YR='2016'
GROUP BY
CCY_D_ORC.CCY_NM
ORDER BY TOT_USD_TXN_AMT DESC
LIMIT 50000
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,166][INFO][org.apache.kylin.query.routing.QueryRouter.selectRealization(QueryRouter.java:45)]
- Find candidates by table SCHEMA.TXN_FCT_ORC and project=SR14 :
CUBE[name=TOPN_CST_CCY_BR_TXN_clone],CUBE[name=TOPN_CST_CCY_BR_TXN_BY_MONTH_SEGMENT]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,167][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:53)]
- Initial realizations order:
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,167][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:54)]
- [TOPN_CST_CCY_BR_TXN_clone,TOPN_CST_CCY_BR_TXN_BY_MONTH_SEGMENT]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,168][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:55)]
- Applying rule class
org.apache.kylin.query.routing.RoutingRules.RemoveUncapableRealizationsRule
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,168][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:59)]
- [TOPN_CST_CCY_BR_TXN_clone]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,168][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:60)]
- ===================================================
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,169][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:53)]
- Initial realizations order:
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,169][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:54)]
- [TOPN_CST_CCY_BR_TXN_clone]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,169][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:55)]
- Applying rule class
org.apache.kylin.query.routing.RoutingRules.RealizationSortRule
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,169][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:59)]
- [TOPN_CST_CCY_BR_TXN_clone]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,170][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:60)]
- ===================================================
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,170][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:53)]
- Initial realizations order:
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,170][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:54)]
- [TOPN_CST_CCY_BR_TXN_clone]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,170][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:55)]
- Applying rule class
org.apache.kylin.query.routing.RoutingRules.AdjustForWeeklyMatchedRealization
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,171][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:59)]
- [TOPN_CST_CCY_BR_TXN_clone]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,171][INFO][org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:60)]
- ===================================================
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,171][INFO][org.apache.kylin.query.routing.QueryRouter.selectRealization(QueryRouter.java:54)]
- The realizations remaining:
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,171][INFO][org.apache.kylin.query.routing.QueryRouter.selectRealization(QueryRouter.java:55)]
- [TOPN_CST_CCY_BR_TXN_clone]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,172][INFO][org.apache.kylin.query.routing.QueryRouter.selectRealization(QueryRouter.java:56)]
- The realization being chosen: TOPN_CST_CCY_BR_TXN_clone
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,220][DEBUG][org.apache.kylin.query.enumerator.CubeEnumerator.queryStorage(CubeEnumerator.java:135)]
- query storage...
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,220][INFO][org.apache.kylin.storage.hbase.CubeStorageEngine.isExactAggregation(CubeStorageEngine.java:183)]
- exactAggregation is false because derived column require post aggregation:
[SCHEMA.TXN_FCT_ORC.RMTR_CCY_KEY]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,223][INFO][org.apache.kylin.storage.hbase.coprocessor.observer.ObserverEnabler.isCoprocessorBeneficial(ObserverEnabler.java:138)]
- Coprocessor is enabled to aggregate [SCHEMA.DT_D_ORC.CDR_YR], returning
[SCHEMA.TXN_FCT_ORC.RMTR_CCY_KEY]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,224][INFO][org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.logScan(CubeSegmentTupleIterator.java:249)]
-
Scan hbase table KYLIN_0QB4268E19: cuboid exact match, from 513 to 513
Start: \x00\x00\x00\x00\x00\x00\x02\x01\x11\x00 -
\x00\x00\x00\x00\x00\x00\x02\x01\x11\x00
Stop: \x00\x00\x00\x00\x00\x00\x02\x01\x11\xFF\x00 -
\x00\x00\x00\x00\x00\x00\x02\x01\x11\xFF\x00
Fuzzy: \x00\x00\x00\x00\x00\x00\x02\x01\x11\x00
\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,224][INFO][org.apache.kylin.storage.hbase.coprocessor.CoprocessorTupleFilterTranslator.translate(CoprocessorTupleFilterTranslator.java:52)]
- Translation to IN clause: CompareFilter [SCHEMA.DT_D_ORC.CDR_YR EQ [2016],
children=[ColumnFilter [column=SCHEMA.DT_D_ORC.CDR_YR], ConstantFilter
[constant=[2016]]]]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,225][INFO][org.apache.kylin.storage.hbase.coprocessor.CoprocessorTupleFilterTranslator.translate(CoprocessorTupleFilterTranslator.java:54)]
- Failed, will use Calcite to handle computed comparison.
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,246][INFO][org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.logScan(CubeSegmentTupleIterator.java:249)]
-
Scan hbase table KYLIN_MP3JIEZRGN: cuboid exact match, from 513 to 513
Start: \x00\x00\x00\x00\x00\x00\x02\x01\x11\x00 -
\x00\x00\x00\x00\x00\x00\x02\x01\x11\x00
Stop: \x00\x00\x00\x00\x00\x00\x02\x01\x11\xFF\x00 -
\x00\x00\x00\x00\x00\x00\x02\x01\x11\xFF\x00
Fuzzy: \x00\x00\x00\x00\x00\x00\x02\x01\x11\x00
\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,247][INFO][org.apache.kylin.storage.hbase.coprocessor.CoprocessorTupleFilterTranslator.translate(CoprocessorTupleFilterTranslator.java:52)]
- Translation to IN clause: CompareFilter [SCHEMA.DT_D_ORC.CDR_YR EQ [2016],
children=[ColumnFilter [column=SCHEMA.DT_D_ORC.CDR_YR], ConstantFilter
[constant=[2016]]]]
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,247][INFO][org.apache.kylin.storage.hbase.coprocessor.CoprocessorTupleFilterTranslator.translate(CoprocessorTupleFilterTranslator.java:54)]
- Failed, will use Calcite to handle computed comparison.
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,258][DEBUG][org.apache.kylin.query.enumerator.CubeEnumerator.queryStorage(CubeEnumerator.java:151)]
- return TupleIterator...
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,262][DEBUG][org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.closeScanner(CubeSegmentTupleIterator.java:126)]
- Scan
{"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\x00\\x00\\x00\\x00\\x00\\x00\\x02\\x01\\x11\\x00","stopRow":"\\x00\\x00\\x00\\x00\\x00\\x00\\x02\\x01\\x11\\xFF\\x00","loadColumnFamiliesOnDemand":null,"totalColumns":1,"cacheBlocks":true,"families":{"F1":["M"]},"maxResultSize":5242880,"maxVersions":1,"filter":"FuzzyRowFilter{fuzzyKeysData={\\x00\\x00\\x00\\x00\\x00\\x00\\x02\\x01\\x11\\x00:\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x00\\x01}},
","caching":1024}
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,263][ERROR][org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:190)]
- Exception when execute sql
java.sql.SQLException: error while executing SQL "SELECT
CCY_D_ORC.CCY_NM CURRENCY
,SUM(TXN_FCT_ORC.USD_TXN_AMT) TOT_USD_TXN_AMT
FROM SCHEMA.TXN_FCT_ORC as TXN_FCT_ORC
INNER JOIN SCHEMA.DT_D_ORC as DT_D_ORC
ON TXN_FCT_ORC.TXN_BOOK_DT_KEY = DT_D_ORC.DT_KEY
INNER JOIN SCHEMA.CCY_D_ORC as CCY_D_ORC
ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_D_ORC.CCY_KEY
WHERE DT_D_ORC.CDR_YR='2016'
GROUP BY
CCY_D_ORC.CCY_NM
ORDER BY TOT_USD_TXN_AMT DESC
LIMIT 50000": org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.AbstractMethodError
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AbstractMethodError
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
... 4 more
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:112)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:130)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:354)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:268)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:114)
at
org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618)
at
org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$cace939e.query(<generated>)
at
org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:178)
at
org.apache.kylin.rest.controller.QueryController.query(QueryController.java:85)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.kylin.rest.filter.KylinApiFilter.doFilterInternal(KylinApiFilter.java:66)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException:
org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.AbstractMethodError
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AbstractMethodError
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
... 4 more
at
org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(AbstractClientScanner.java:97)
at
org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.hasNext(CubeSegmentTupleIterator.java:155)
at
org.apache.kylin.storage.hbase.SerializedHBaseTupleIterator.next(SerializedHBaseTupleIterator.java:112)
at
org.apache.kylin.query.enumerator.CubeEnumerator.moveNext(CubeEnumerator.java:81)
at Baz$1$1.moveNext(Unknown Source)
at
org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:737)
at
org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:677)
at
org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:301)
at Baz.bind(Unknown Source)
at
org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:281)
at
org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:235)
at
org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:533)
at
org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:184)
at
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:63)
at
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:42)
at
org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:473)
at
org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:566)
at
org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:477)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:109)
... 84 more
Caused by: org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.AbstractMethodError
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AbstractMethodError
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
... 4 more
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1219)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651)
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:213)
... 9 more
[http-bio-7070-exec-7]:[2016-02-28
10:38:51,267][INFO][org.apache.kylin.rest.service.QueryService.logQuery(QueryService.java:242)]
-
==========================[QUERY]===============================
SQL:
SELECT
CCY_D_ORC.CCY_NM CURRENCY
,SUM(TXN_FCT_ORC.USD_TXN_AMT) TOT_USD_TXN_AMT
FROM SCHEMA.TXN_FCT_ORC as TXN_FCT_ORC
INNER JOIN SCHEMA.DT_D_ORC as DT_D_ORC
ON TXN_FCT_ORC.TXN_BOOK_DT_KEY = DT_D_ORC.DT_KEY
INNER JOIN SCHEMA.CCY_D_ORC as CCY_D_ORC
ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_D_ORC.CCY_KEY
WHERE DT_D_ORC.CDR_YR='2016'
GROUP BY
CCY_D_ORC.CCY_NM
ORDER BY TOT_USD_TXN_AMT DESC
User: ADMIN
Success: false
Duration: 0.0
Project: SR14
Realization Names: [TOPN_CST_CCY_BR_TXN_clone]
Cuboid Ids: [513]
Total scan count: 0
Result row count: 0
Accept Partial: true
Is Partial Result: false
Hit Cache: false
Message: org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.AbstractMethodError
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065) at
org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107) at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107) at
java.lang.Thread.run(Thread.java:745) Caused by:
java.lang.AbstractMethodError at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034) ... 4
more
while executing SQL: "SELECT CCY_D_ORC.CCY_NM CURRENCY
,SUM(TXN_FCT_ORC.USD_TXN_AMT) TOT_USD_TXN_AMT FROM SCHEMA.TXN_FCT_ORC as
TXN_FCT_ORC INNER JOIN SCHEMA.DT_D_ORC as DT_D_ORC ON
TXN_FCT_ORC.TXN_BOOK_DT_KEY = DT_D_ORC.DT_KEY INNER JOIN SCHEMA.CCY_D_ORC as
CCY_D_ORC ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_D_ORC.CCY_KEY WHERE
DT_D_ORC.CDR_YR='2016' GROUP BY CCY_D_ORC.CCY_NM ORDER BY TOT_USD_TXN_AMT
DESC LIMIT 50000"
==========================[QUERY]===============================
*****************************************************************************
HTable: KYLIN_MP3JIEZRGN
Region Count: 1
Size: 6.08 GB
Start Time: 2015-01-01 00:00:00
End Time: 2015-11-30 00:00:00
'KYLIN_MP3JIEZRGN', {TABLE_ATTRIBUTES => {coprocessor$1 =>
'hdfs://sd-244e-7d9b.nam.nsroot.net:8020/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-30.jar|org.apache.kylin.storage.hbase.coprocessor.endpoint.IIEndpoint|1000|',
coprocessor$2 =>
'hdfs://sd-244e-7d9b.nam.nsroot.net:8020/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-30.jar|org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver|1001|',
METADATA => {'KYLIN_HOST' => 'kylin_metadata', 'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}},
{NAME => 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', COMPRESSION => 'SNAPPY',
BLOCKSIZE => '4194304'}
Region Server
sd-b3a6-1d0f
******************************************************************************
*REGION SERVER LOGS (RS -1)*
2016-02-28 10:38:51,252 INFO
org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver:
Kylin Coprocessor start
2016-02-28 10:38:51,258 INFO
org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver:
Kylin Coprocessor aggregation done: 0% = 0 (out rows) / 0 (in rows); in
bytes = 0; est. out bytes = 0
2016-02-28 10:39:51,259 INFO
org.apache.hadoop.hbase.regionserver.RSRpcServices: Scanner 3759 lease
expired on region
KYLIN_MP3JIEZRGN,,1456359363454.d06ef1fbe3aec7d4d1bf4601271119b2.
2016-02-28 10:42:45,528 INFO org.apache.hadoop.hbase.io.hfile.LruBlockCache:
totalSize=13.59 MB, freeSize=5.96 GB, max=5.97 GB, blockCount=53,
accesses=4972, hits=4906, hitRatio=98.67%, , cachingAccesses=4953,
cachingHits=4898, cachingHitsRatio=98.89%, evictions=209, evicted=0,
evictedPerRun=0.0
*REGION SERVER-2*
2016-02-28 10:38:51,229 INFO
org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver:
Kylin Coprocessor start
2016-02-28 10:38:51,245 INFO
org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver:
Kylin Coprocessor aggregation done: 100% = 108 (out rows) / 108 (in rows);
in bytes = 3952; est. out bytes = 3952
2016-02-28 10:42:42,974 INFO org.apache.hadoop.hbase.io.hfile.LruBlockCache:
totalSize=12.14 MB, freeSize=5.96 GB, max=5.97 GB, blockCount=3,
accesses=10, hits=3, hitRatio=30.00%, , cachingAccesses=5, cachingHits=2,
cachingHitsRatio=40.00%, evictions=209, evicted=0, evictedPerRun=0.0
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3749.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by ShaoFeng Shi <sh...@apache.org>.
Need more detail logs to analysis, like the query log (in kylin.log), hbase
region server side log etc.
2016-02-28 11:25 GMT+08:00 sdangi <sd...@datalenz.com>:
> I have some good news. I have rebuilt the current Kylin Master1.2 against
> CDH5.5.3. I had to bring some of 1.1.3 branch changes dealing with
> Cloudera
> API around additional methods for RegionScanner interface.
>
> Also, I had exclude some HBase (server) dependencies in the pom and upgrade
> curator binaries. Compiles/Builds ok, server starts ok, kylin sample cube
> build and query works fine. I did apply this to our ongoing POC with over
> 1B rows. Build and most queries work. However, there is one query against
> time dimension (which had reported to Luke directly due to sensitive
> nature)
> and that is throwing a new error. Earlier it was AbstractMethod error
> related to getBatch interface of Scanner that is now fixed due to binary
> compatibility with CDH5.5.2.
>
> But now, it fails with
>
>
> Caused by:
>
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
> org.apache.hadoop.hbase.DoNotRetryIOException:
> java.lang.AbstractMethodError
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.AbstractMethodError
> at
>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
> at
>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
> ... 4 more
>
> at
> org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1219)
> at
>
> org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
> at
>
> org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
> at
>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651)
> at
>
> org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:213)
>
>
> I have remote debugged it. Here is the stack
>
> <http://apache-kylin.74782.x6.nabble.com/file/n3745/Debugger_stack.png>
>
> Similar query (See bel0w) on the sample cube works great.
>
> //this works
> SELECT SUM(PRICE) FROM KYLIN_SALES
> WHERE PART_DT=DATE'2012-01-01'
>
> //this does not (1B rows in fact table)
> SELECT
> CURRENCY
> ,SUM(TXN_AMT) TOT_USD_TXN_AMT
> FROM TXN_FCT_ORC as TXN_FCT_ORC
> INNER JOIN DIM_ORC as DT_DIM_ORC
> ON BOOK_DT_KEY = DT_DIM_ORC.DT_KEY
> INNER JOIN CCY_DIM_ORC as CCY_DIM_ORC
> ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_DIM_ORC.CCY_KEY
> WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03'
> GROUP BY
> CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR
> ORDER BY TOT_USD_TXN_AMT DESC
>
>
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
Thanks. Will get it in over the week-end.
Also, note almost all queries worked except one that was a wildcard search
query with a time dimension. If I take out the date, it works fine. here
is the exception --
LIMIT 10": Error when scan from lower key
^@^@^@^@^@^@^C�^@^@^@^@^@^@^K:�^@^@^@^@^@^@^@ to upper key
^@^@^@^@^@^@^C�����������������^@ on table KYLIN_JZ2UCDO0N2.
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:112)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:130)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:354)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:268)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:114)
at
org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke(<generated>)
at _D_ORC.BR_NM like '%%'
AND CST_D_ORC.PRN_CST_NM like '%%'
AND CTY_D_ORC.CTY_NM like '%%'
AND CCY_D_ORC.CCY_NM like '%DO%'
AND DT_D_ORC.DT_KEY >= DATE'2015-01-01'
GROUP BY
CST_DIM_ORC.PRN_CST_NM,CTY_DIM_ORC.CTY_NM,BR_DIM_ORC.BR_NM,CCY_DIM_ORC.CCY_NM
ORDER BY TOT_USD_TXN_AMT DESC
LIMIT 10": Error when scan from lower key
^@^@^@^@^@^@^C�^@^@^@^@^@^@^K:�^@^@^@^@^@^@^@ to upper key
^@^@^@^@^@^@^C�����������������^@ on table KYLIN_JZ2UCDO0N2.
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:112)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:130)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:354)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:268)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:114)
at
org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618)
at
org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$6cdc133b.query(<generated>)
at
org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618)
at
org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$6cdc133b.query(<generated>)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205)
at
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kylin.common.persistence.StorageException: Error when
scan from lower key ^@^@^@^@^@^@^C�^@^@^@^@^@^@^K:�^@^@^@^@^@^@^@ to upper
key ^@^@^@^@^@^@^C�����������������^@ on table KYLIN_JZ2UCDO0N2.
at
org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.doScan(CubeSegmentTupleIterator.java:221)
at
org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.scanNextRange(CubeSegmentTupleIterator.java:202)
at
org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.<init>(CubeSegmentTupleIterator.java:113)
at
org.apache.kylin.storage.hbase.SerializedHBaseTupleIterator.<init>(SerializedHBaseTupleIterator.java:64)
at
org.apache.kylin.storage.hbase.CubeStorageEngine.search(CubeStorageEngine.java:143)
at
org.apache.kylin.query.enumerator.CubeEnumerator.queryStorage(CubeEnumerator.java:149)
at
org.apache.kylin.query.enumerator.CubeEnumerator.moveNext(CubeEnumerator.java:74)
at Baz$1$1.moveNext(Unknown Source)
at
org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:737)
at
org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:677)
at
org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:301)
at Baz.bind(Unknown Source)
at
org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:281)
at
org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:235)
at
org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:533)
at
org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:184)
at
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:63)
at
org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:42)
at
org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:473)
at
org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:566)
at
org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:477)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:109)
... 83 more
*Caused by: java.nio.BufferOverflowException*
at java.nio.Buffer.nextPutIndex(Buffer.java:513)
at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:163)
at
org.apache.kylin.common.util.BytesUtil.writeVLong(BytesUtil.java:122)
at
org.apache.kylin.common.util.BytesUtil.writeVInt(BytesUtil.java:117)
at
org.apache.kylin.common.util.BytesUtil.writeByteArray(BytesUtil.java:309)
at
org.apache.kylin.common.util.BytesUtil.writeUTFString(BytesUtil.java:225)
at
org.apache.kylin.metadata.filter.ConstantTupleFilter.serialize(ConstantTupleFilter.java:87)
at
org.apache.kylin.metadata.filter.TupleFilterSerializer.serializeFilter(TupleFilterSerializer.java:90)
at
org.apache.kylin.metadata.filter.TupleFilterSerializer.internalSerialize(TupleFilterSerializer.java:82)
at
org.apache.kylin.metadata.filter.TupleFilterSerializer.internalSerialize(TupleFilterSerializer.java:76)
at
org.apache.kylin.metadata.filter.TupleFilterSerializer.internalSerialize(TupleFilterSerializer.java:76)
at
org.apache.kylin.metadata.filter.TupleFilterSerializer.serialize(TupleFilterSerializer.java:55)
at
org.apache.kylin.storage.hbase.coprocessor.CoprocessorFilter.fromFilter(CoprocessorFilter.java:188)
at
org.apache.kylin.storage.hbase.coprocessor.observer.ObserverEnabler.scanWithCoprocessorIfBeneficial(ObserverEnabler.java:68)
at
org.apache.kylin.storage.hbase.CubeSegmentTupleIterator.doScan(CubeSegmentTupleIterator.java:216)
... 104 more
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3787.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi sdangi, you can find how to make a patch in:
https://kylin.apache.org/development/howto_contribute.html
Thanks!
2016-03-03 21:02 GMT+08:00 sdangi <sd...@datalenz.com>:
> Team -- More than happy to. Can some one guide me on how to get the patch
> out?
>
> Thanks,
> Regards,
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3784.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
Team -- More than happy to. Can some one guide me on how to get the patch
out?
Thanks,
Regards,
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3784.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by Li Yang <li...@apache.org>.
I checked the line that causes the AbstractMethodError, but the root cause
is not obvious to me. Guess we have to reproduce the error and then there
might be more clues.
https://github.com/cloudera/hbase/blob/cdh5.5.2-release/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java#L2278
If @sdangi could contribute a patch, it will help us to reproduce the
problem and continue investigate locally.
On Tue, Mar 1, 2016 at 1:47 PM, ShaoFeng Shi <sh...@apache.org> wrote:
> Hi sdangi,
>
> Glad to hear this good news; Would you mind to convert all your changes
> based on Kylin1.2 to a patch so it can be easily shared with
> other CDH users? Thank you;
>
> 2016-02-28 11:25 GMT+08:00 sdangi <sd...@datalenz.com>:
>
> > I have some good news. I have rebuilt the current Kylin Master1.2
> against
> > CDH5.5.3. I had to bring some of 1.1.3 branch changes dealing with
> > Cloudera
> > API around additional methods for RegionScanner interface.
> >
> > Also, I had exclude some HBase (server) dependencies in the pom and
> upgrade
> > curator binaries. Compiles/Builds ok, server starts ok, kylin sample
> cube
> > build and query works fine. I did apply this to our ongoing POC with
> over
> > 1B rows. Build and most queries work. However, there is one query
> against
> > time dimension (which had reported to Luke directly due to sensitive
> > nature)
> > and that is throwing a new error. Earlier it was AbstractMethod error
> > related to getBatch interface of Scanner that is now fixed due to binary
> > compatibility with CDH5.5.2.
> >
> > But now, it fails with
> >
> >
> > Caused by:
> >
> >
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
> > org.apache.hadoop.hbase.DoNotRetryIOException:
> > java.lang.AbstractMethodError
> > at
> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
> > at
> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> > at
> >
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> > at
> > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.AbstractMethodError
> > at
> >
> >
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
> > at
> >
> >
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
> > at
> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
> > ... 4 more
> >
> > at
> > org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1219)
> > at
> >
> >
> org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
> > at
> >
> >
> org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
> > at
> >
> >
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651)
> > at
> >
> >
> org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:213)
> >
> >
> > I have remote debugged it. Here is the stack
> >
> > <http://apache-kylin.74782.x6.nabble.com/file/n3745/Debugger_stack.png>
> >
> > Similar query (See bel0w) on the sample cube works great.
> >
> > //this works
> > SELECT SUM(PRICE) FROM KYLIN_SALES
> > WHERE PART_DT=DATE'2012-01-01'
> >
> > //this does not (1B rows in fact table)
> > SELECT
> > CURRENCY
> > ,SUM(TXN_AMT) TOT_USD_TXN_AMT
> > FROM TXN_FCT_ORC as TXN_FCT_ORC
> > INNER JOIN DIM_ORC as DT_DIM_ORC
> > ON BOOK_DT_KEY = DT_DIM_ORC.DT_KEY
> > INNER JOIN CCY_DIM_ORC as CCY_DIM_ORC
> > ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_DIM_ORC.CCY_KEY
> > WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03'
> > GROUP BY
> > CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR
> > ORDER BY TOT_USD_TXN_AMT DESC
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi sdangi,
Glad to hear this good news; Would you mind to convert all your changes
based on Kylin1.2 to a patch so it can be easily shared with
other CDH users? Thank you;
2016-02-28 11:25 GMT+08:00 sdangi <sd...@datalenz.com>:
> I have some good news. I have rebuilt the current Kylin Master1.2 against
> CDH5.5.3. I had to bring some of 1.1.3 branch changes dealing with
> Cloudera
> API around additional methods for RegionScanner interface.
>
> Also, I had exclude some HBase (server) dependencies in the pom and upgrade
> curator binaries. Compiles/Builds ok, server starts ok, kylin sample cube
> build and query works fine. I did apply this to our ongoing POC with over
> 1B rows. Build and most queries work. However, there is one query against
> time dimension (which had reported to Luke directly due to sensitive
> nature)
> and that is throwing a new error. Earlier it was AbstractMethod error
> related to getBatch interface of Scanner that is now fixed due to binary
> compatibility with CDH5.5.2.
>
> But now, it fails with
>
>
> Caused by:
>
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
> org.apache.hadoop.hbase.DoNotRetryIOException:
> java.lang.AbstractMethodError
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.AbstractMethodError
> at
>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
> at
>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
> ... 4 more
>
> at
> org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1219)
> at
>
> org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
> at
>
> org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
> at
>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651)
> at
>
> org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:213)
>
>
> I have remote debugged it. Here is the stack
>
> <http://apache-kylin.74782.x6.nabble.com/file/n3745/Debugger_stack.png>
>
> Similar query (See bel0w) on the sample cube works great.
>
> //this works
> SELECT SUM(PRICE) FROM KYLIN_SALES
> WHERE PART_DT=DATE'2012-01-01'
>
> //this does not (1B rows in fact table)
> SELECT
> CURRENCY
> ,SUM(TXN_AMT) TOT_USD_TXN_AMT
> FROM TXN_FCT_ORC as TXN_FCT_ORC
> INNER JOIN DIM_ORC as DT_DIM_ORC
> ON BOOK_DT_KEY = DT_DIM_ORC.DT_KEY
> INNER JOIN CCY_DIM_ORC as CCY_DIM_ORC
> ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_DIM_ORC.CCY_KEY
> WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03'
> GROUP BY
> CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR
> ORDER BY TOT_USD_TXN_AMT DESC
>
>
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
I have some good news. I have rebuilt the current Kylin Master1.2 against
CDH5.5.3. I had to bring some of 1.1.3 branch changes dealing with Cloudera
API around additional methods for RegionScanner interface.
Also, I had exclude some HBase (server) dependencies in the pom and upgrade
curator binaries. Compiles/Builds ok, server starts ok, kylin sample cube
build and query works fine. I did apply this to our ongoing POC with over
1B rows. Build and most queries work. However, there is one query against
time dimension (which had reported to Luke directly due to sensitive nature)
and that is throwing a new error. Earlier it was AbstractMethod error
related to getBatch interface of Scanner that is now fixed due to binary
compatibility with CDH5.5.2.
But now, it fails with
Caused by:
org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.AbstractMethodError
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2065)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at
org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AbstractMethodError
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2278)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32205)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
... 4 more
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1219)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651)
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:213)
I have remote debugged it. Here is the stack
<http://apache-kylin.74782.x6.nabble.com/file/n3745/Debugger_stack.png>
Similar query (See bel0w) on the sample cube works great.
//this works
SELECT SUM(PRICE) FROM KYLIN_SALES
WHERE PART_DT=DATE'2012-01-01'
//this does not (1B rows in fact table)
SELECT
CURRENCY
,SUM(TXN_AMT) TOT_USD_TXN_AMT
FROM TXN_FCT_ORC as TXN_FCT_ORC
INNER JOIN DIM_ORC as DT_DIM_ORC
ON BOOK_DT_KEY = DT_DIM_ORC.DT_KEY
INNER JOIN CCY_DIM_ORC as CCY_DIM_ORC
ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_DIM_ORC.CCY_KEY
WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03'
GROUP BY
CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR
ORDER BY TOT_USD_TXN_AMT DESC
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi sdangi, we don't have progress on this; please go ahead and share your
findings with
the community on finish, either works or not works would be helpful for CDH
users, thank you!
2016-02-27 23:53 GMT+08:00 sdangi <sd...@datalenz.com>:
> Team -- Any successful builds against CDH5.5.x? I have just attempted it
> with
> changes in job/storage package to fix the HBase interface changes borrowed
> from 1.1.4 branch. 1.0.0-cdh5.5.x version of HBase from Cloudera is not
> aligning with 1.0.0 from Apache. However, I have got a clean build and am
> testing it.
>
>
>
> The pom is as below:
>
>
> <hadoop2.version>2.6.0-cdh5.5.2</hadoop2.version>
> <yarn.version>2.6.0-cdh5.5.2</yarn.version>
> <zookeeper.version>3.4.5-cdh5.5.2</zookeeper.version>
> <hive.version>1.1.0-cdh5.5.2</hive.version>
>
> <hive-hcatalog.version>1.1.0-cdh5.5.2</hive-hcatalog.version>
>
> <hbase-hadoop2.version>1.0.0-cdh5.5.2</hbase-hadoop2.version>
>
>
>
> INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Kylin:HadoopOLAPEngine ............................. SUCCESS [
> 0.919
> s]
> [INFO] Kylin:AtopCalcite .................................. SUCCESS [
> 2.660
> s]
> [INFO] Kylin:Common ....................................... SUCCESS [
> 46.248
> s]
> [INFO] Kylin:Metadata ..................................... SUCCESS [
> 5.385
> s]
> [INFO] Kylin:Dictionary ................................... SUCCESS [
> 1.558
> s]
> [INFO] Kylin:Cube ......................................... SUCCESS [
> 3.652
> s]
> [INFO] Kylin:InvertedIndex ................................ SUCCESS [
> 0.635
> s]
> [INFO] Kylin:Job .......................................... SUCCESS [
> 7.054
> s]
> [INFO] Kylin:Storage ...................................... SUCCESS [
> 3.900
> s]
> [INFO] Kylin:Query ........................................ SUCCESS [
> 1.272
> s]
> [INFO] Kylin:JDBC ......................................... SUCCESS [
> 2.235
> s]
> [INFO] Kylin:RESTServer ................................... SUCCESS [
> 11.829
> s]
> [INFO] Kylin:Monitor ...................................... SUCCESS [
> 1.129
> s]
> [INFO]
> ------------------------------------------------------------------------
>
> I will report any issues on running and building the cubes.
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3742.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi
Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with
HBase 1.0
Posted by sdangi <sd...@datalenz.com>.
Team -- Any successful builds against CDH5.5.x? I have just attempted it with
changes in job/storage package to fix the HBase interface changes borrowed
from 1.1.4 branch. 1.0.0-cdh5.5.x version of HBase from Cloudera is not
aligning with 1.0.0 from Apache. However, I have got a clean build and am
testing it.
The pom is as below:
<hadoop2.version>2.6.0-cdh5.5.2</hadoop2.version>
<yarn.version>2.6.0-cdh5.5.2</yarn.version>
<zookeeper.version>3.4.5-cdh5.5.2</zookeeper.version>
<hive.version>1.1.0-cdh5.5.2</hive.version>
<hive-hcatalog.version>1.1.0-cdh5.5.2</hive-hcatalog.version>
<hbase-hadoop2.version>1.0.0-cdh5.5.2</hbase-hadoop2.version>
INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Kylin:HadoopOLAPEngine ............................. SUCCESS [ 0.919
s]
[INFO] Kylin:AtopCalcite .................................. SUCCESS [ 2.660
s]
[INFO] Kylin:Common ....................................... SUCCESS [ 46.248
s]
[INFO] Kylin:Metadata ..................................... SUCCESS [ 5.385
s]
[INFO] Kylin:Dictionary ................................... SUCCESS [ 1.558
s]
[INFO] Kylin:Cube ......................................... SUCCESS [ 3.652
s]
[INFO] Kylin:InvertedIndex ................................ SUCCESS [ 0.635
s]
[INFO] Kylin:Job .......................................... SUCCESS [ 7.054
s]
[INFO] Kylin:Storage ...................................... SUCCESS [ 3.900
s]
[INFO] Kylin:Query ........................................ SUCCESS [ 1.272
s]
[INFO] Kylin:JDBC ......................................... SUCCESS [ 2.235
s]
[INFO] Kylin:RESTServer ................................... SUCCESS [ 11.829
s]
[INFO] Kylin:Monitor ...................................... SUCCESS [ 1.129
s]
[INFO]
------------------------------------------------------------------------
I will report any issues on running and building the cubes.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3742.html
Sent from the Apache Kylin mailing list archive at Nabble.com.