You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by KylinPOC <sa...@gmail.com> on 2015/11/10 16:43:17 UTC

Sample cube build fails at Step 14 - Convert cubeoid data to HFile

Hi,

Sample cube build fails at Step 14 - Convert cubeoid data to HFile. The
error is: Error in CubeHFile job. Attached Kylin for reference. 

Also, where does Kylin cubeoids are stored? Can it be monitored to verify if
they run successfully?


Thanks



--
View this message in context: http://apache-kylin-incubating.74782.x6.nabble.com/Sample-cube-build-fails-at-Step-14-Convert-cubeoid-data-to-HFile-tp2288.html
Sent from the Apache Kylin (Incubating) mailing list archive at Nabble.com.

Re: Sample cube build fails at Step 14 - Convert cubeoid data to HFile

Posted by yu feng <ol...@gmail.com>.

In my opinion, Kylin store cuboid files in hdfs which the hadoop dependent
on, Since you are error at step 14 which means you success in 13
steps ahead, you can check "Detail Information" at web UI and go to "Build
Base Cuboid Data" at step 4, check the parameters and the -output is the
location base cuboid located. and you can find other cuboids by this way,
BTW, the files is SequenceFileOutputFormat

2015-11-10 23:43 GMT+08:00 KylinPOC <sa...@gmail.com>:

> Hi,
>
> Sample cube build fails at Step 14 - Convert cubeoid data to HFile. The
> error is: Error in CubeHFile job. Attached Kylin for reference.
>
> Also, where does Kylin cubeoids are stored? Can it be monitored to verify
> if
> they run successfully?
>
>
> Thanks
>
>
>
> --
> View this message in context:
> http://apache-kylin-incubating.74782.x6.nabble.com/Sample-cube-build-fails-at-Step-14-Convert-cubeoid-data-to-HFile-tp2288.html
> Sent from the Apache Kylin (Incubating) mailing list archive at Nabble.com.
>

Re: Sample cube build fails at Step 14 - Convert cubeoid data to HFile

Posted by KylinPOC <sa...@gmail.com>.

Added "webapps/kylin/WEB-INF/classes" directory in Kylin install location and
copied core-site.xml from Hadoop in classes directory.

Reran the job, the job runs till Step 12 and does nothing. Doesn't error out
either.

For "hbase.fs.tmp.dir" property, in which file it should be added? Is it
hbase-site.xml? What should be the value of hbase.fs.tmp.dir?

Also, I checked the logs from the Web UI. Step 1 shows no errors. Step 2
shows 

2015-11-26 13:04:48.364 - State of Hadoop job:
job_1448566405801_0013:ACCEPTED - UNDEFINED
2015-11-26 13:04:58.398 - State of Hadoop job:
job_1448566405801_0013:RUNNING - UNDEFINED
2015-11-26 13:05:08.459 - State of Hadoop job:
job_1448566405801_0013:RUNNING - UNDEFINED
2015-11-26 13:05:18.494 - State of Hadoop job:
job_1448566405801_0013:FINISHED - SUCCEEDED
org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException):
java.lang.NullPointerException
	at
org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getCounters(HistoryClientService.java:228)
	at
org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getCounters(MRClientProtocolPBServiceImpl.java:159)
	at
org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:281)
	at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2039)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2035)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2033)

Questions:

Why the log shows "Undefined" at the end of the first 3 lines?
If it throws a null pointer exception, why the step shows as successful?
Observed this in many other steps as well. 

Appreciate your help.







--
View this message in context: http://apache-kylin-incubating.74782.x6.nabble.com/Sample-cube-build-fails-at-Step-14-Convert-cubeoid-data-to-HFile-tp2288p2580.html
Sent from the Apache Kylin (Incubating) mailing list archive at Nabble.com.

Re: Sample cube build fails at Step 14 - Convert cubeoid data to HFile

Posted by "Shi, Shaofeng" <sh...@ebay.com>.

If you use your exception together with ³kylin² as keyword in Google, it
will give you the answer in the first result:
https://issues.apache.org/jira/browse/KYLIN-953

On 11/10/15, 11:43 PM, "KylinPOC" <sa...@gmail.com> wrote:

>Hi,
>
>Sample cube build fails at Step 14 - Convert cubeoid data to HFile. The
>error is: Error in CubeHFile job. Attached Kylin for reference.
>
>Also, where does Kylin cubeoids are stored? Can it be monitored to verify
>if
>they run successfully?
>
>
>Thanks
>
>
>
>--
>View this message in context:
>http://apache-kylin-incubating.74782.x6.nabble.com/Sample-cube-build-fails
>-at-Step-14-Convert-cubeoid-data-to-HFile-tp2288.html
>Sent from the Apache Kylin (Incubating) mailing list archive at
>Nabble.com.