Re: Error in stage 2 of cube build: Class not found org.apache.kylin.job.hadoop.cube.FactDistinctColumnsMapper

[Li Yang <li...@apache.org>]

Seems the Kylin job jar was not corrected added to MR classpath. Normally
you should see below in log if job jar is found.

[pool-7-thread-2]:[2015-05-18
20:36:56,361][INFO][org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:90)]
- Starting:
Kylin_Fact_Distinct_Columns_GA_CONVERSION_REPORT_CUBE_GA_VST_DT_V3_Step
[pool-7-thread-2]:[2015-05-18
20:36:56,362][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:158)]
- append job jar:
*/export/home/b_kylin/kylin_ii/lib/kylin-job-0.7.1-incubating-SNAPSHOT.jar*
[pool-7-thread-2]:[2015-05-18
20:36:56,362][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:164)]
- append kylin.hive.dependency:
/apache/hive/conf:/apache/hive/lib/*:/apache/hive-0.13.0.2.1.3.0-563/hcatalog/share/hcatalog/hive-hcatalog-core-0.13.0.2.1.3.0-563.jar
to mapreduce.application.classpath


To fix
- Check $KYLIN_HOME is set correctly, and the job jar exists under
$KYLIN_HOME/lib/.
- Alternatively, you may set "kylin.job.jar" in conf/kylin.properties with
an absolute path (although this is not needed by default).

Cheers
Yang


On Wed, May 27, 2015 at 5:28 PM, Mohit Bhatnagar <mo...@adobe.com> wrote:

>
> Hi,
> I'm hitting the below error while building the cube at stage 2. I have
> added the below property in Kylin.properties
>
> kylin.job.jar = /tmp/Kylin/kylin-job-0.7.1-incubating-SNAPSHOT-job.jar as
> a work around but it aint working.
>
> Below are the logs:
> Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsMapper not found at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2047) at
> org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:196)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742) at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at
> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:415) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) Caused by:
> java.lang.ClassNotFoundException: Class
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsMapper not found at
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1953)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2045)
> ... 8 more
>
>
> Thanks,
> Mohit
>