You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "LIU Ze (刘则)" <li...@wanda.cn> on 2015/11/11 13:49:08 UTC
Failed to Load HFile to HBase Table
hi,all
in the step of "Load HFile to HBase Table" ,connect to regionserver will retry 35 times .
the regionserver hosts had add to /etc/hosts ,why it can not connect to regionserver?
________________________________
2015-11-11 20:32:04,549 DEBUG [LoadIncrementalHFiles-1] mapreduce.LoadIncrementalHFiles: Going to connect to server region=KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae., hostname=CDM1C22-209021018,10620,1444379096591, seqNum=1 for row with hfile group [{[B@760ed940,hdfs://10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d}]
2015-11-11 20:32:04,558 INFO [LoadIncrementalHFiles-1] client.RpcRetryingCaller: Call exception, tries=12, retries=35, retryTime=108455ms, msg=row '' on table 'KYLIN_A1CZUZI0MU' at region=KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae., hostname=CDM1C22-209021018,10620,1444379096591, seqNum=1
2015-11-11 20:32:24,577 DEBUG [LoadIncrementalHFiles-1] client.HConnectionManager$HConnectionImplementation: Removed CDM1C22-209021018:10620 as a location of KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae. for tableName=KYLIN_A1CZUZI0MU from cache
hdfs of hbase:hdfs://10.209.21.11:10010
hdfs of hive: hdfs://wanda
Wed Nov 11 04:30:16 GMT-08:00 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@53cb23f2, java.io.IOException: java.io.IOException: Wrong FS: hdfs://10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924
e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d, expected: hdfs://wanda
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2132)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException: Wrong FS: hdfs://10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d, expected: hdfs://wanda
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:642)
at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:181)
at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:92)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1106)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
Re: Failed to Load HFile to HBase Table
Posted by ShaoFeng Shi <sh...@apache.org>.
Which Kylin version you're using? Besides, seems the stack trace you pasted
is truncked, please provide the fulll error stack so we can see it was
triggered from which part of Kylin.
Also, did you configure "kylin.hbase.cluster.fs" in "conf/kylin.properties"
with your HBase HDFS host info?
2015-11-11 21:02 GMT+08:00 Xiaoyu Wang <wa...@jd.com>:
> Which version Hadoop,HBase do you use?
>
>
> 在 2015年11月11日 20:49, LIU Ze (刘则) 写道:
>
>> hi,all
>>
>> in the step of "Load HFile to HBase Table" ,connect to regionserver will
>> retry 35 times .
>>
>> the regionserver hosts had add to /etc/hosts ,why it can not connect to
>> regionserver?
>> ________________________________
>>
>> 2015-11-11 20:32:04,549 DEBUG [LoadIncrementalHFiles-1]
>> mapreduce.LoadIncrementalHFiles: Going to connect to server
>> region=KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae.,
>> hostname=CDM1C22-209021018,10620,1444379096591, seqNum=1 for row with
>> hfile group [{[B@760ed940,hdfs://
>> 10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d
>> }]
>> 2015-11-11 20:32:04,558 INFO [LoadIncrementalHFiles-1]
>> client.RpcRetryingCaller: Call exception, tries=12, retries=35,
>> retryTime=108455ms, msg=row '' on table 'KYLIN_A1CZUZI0MU' at
>> region=KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae.,
>> hostname=CDM1C22-209021018,10620,1444379096591, seqNum=1
>> 2015-11-11 20:32:24,577 DEBUG [LoadIncrementalHFiles-1]
>> client.HConnectionManager$HConnectionImplementation: Removed
>> CDM1C22-209021018:10620 as a location of
>> KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae. for
>> tableName=KYLIN_A1CZUZI0MU from cache
>>
>> hdfs of hbase:hdfs://10.209.21.11:10010
>> hdfs of hive: hdfs://wanda
>>
>> Wed Nov 11 04:30:16 GMT-08:00 2015,
>> org.apache.hadoop.hbase.client.RpcRetryingCaller@53cb23f2,
>> java.io.IOException: java.io.IOException: Wrong FS: hdfs://
>> 10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924
>> e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d, expected:
>> hdfs://wanda
>> at
>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2132)
>> at
>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
>> at
>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>> at
>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>> at java.lang.Thread.run(Thread.java:745)
>> Caused by: java.lang.IllegalArgumentException: Wrong FS: hdfs://
>> 10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d,
>> expected: hdfs://wanda
>> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:642)
>> at
>> org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:181)
>> at
>> org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:92)
>> at
>> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1106)
>> at
>> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
>>
>
>
--
Best regards,
Shaofeng Shi
Re: Failed to Load HFile to HBase Table
Posted by Xiaoyu Wang <wa...@jd.com>.
Which version Hadoop,HBase do you use?
在 2015年11月11日 20:49, LIU Ze (刘则) 写道:
> hi,all
>
> in the step of "Load HFile to HBase Table" ,connect to regionserver will retry 35 times .
>
> the regionserver hosts had add to /etc/hosts ,why it can not connect to regionserver?
> ________________________________
>
> 2015-11-11 20:32:04,549 DEBUG [LoadIncrementalHFiles-1] mapreduce.LoadIncrementalHFiles: Going to connect to server region=KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae., hostname=CDM1C22-209021018,10620,1444379096591, seqNum=1 for row with hfile group [{[B@760ed940,hdfs://10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d}]
> 2015-11-11 20:32:04,558 INFO [LoadIncrementalHFiles-1] client.RpcRetryingCaller: Call exception, tries=12, retries=35, retryTime=108455ms, msg=row '' on table 'KYLIN_A1CZUZI0MU' at region=KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae., hostname=CDM1C22-209021018,10620,1444379096591, seqNum=1
> 2015-11-11 20:32:24,577 DEBUG [LoadIncrementalHFiles-1] client.HConnectionManager$HConnectionImplementation: Removed CDM1C22-209021018:10620 as a location of KYLIN_A1CZUZI0MU,,1447244994197.ae3549d9a76c212fea1330f849d4b4ae. for tableName=KYLIN_A1CZUZI0MU from cache
>
> hdfs of hbase:hdfs://10.209.21.11:10010
> hdfs of hive: hdfs://wanda
>
> Wed Nov 11 04:30:16 GMT-08:00 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@53cb23f2, java.io.IOException: java.io.IOException: Wrong FS: hdfs://10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924
> e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d, expected: hdfs://wanda
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2132)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
> at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException: Wrong FS: hdfs://10.209.21.11:10010/tmp/kylin/kylin_metadata/kylin-dd2f8f9f-76b1-44bb-8a7e-96b9c3924e0a/test2/hfile/F1/b4507237baf944d2818933935f22441d, expected: hdfs://wanda
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:642)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:181)
> at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:92)
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1106)
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)