You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Richard Calaba (JIRA)" <ji...@apache.org> on 2016/06/21 23:41:57 UTC
[jira] [Updated] (KYLIN-1810) NPE in
org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
[ https://issues.apache.org/jira/browse/KYLIN-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Calaba updated KYLIN-1810:
----------------------------------
Attachment: job_2016_06_21_16_23_51-err.zip
> NPE in org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
> --------------------------------------------------------------------------------
>
> Key: KYLIN-1810
> URL: https://issues.apache.org/jira/browse/KYLIN-1810
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v1.5.2.1
> Reporter: Richard Calaba
> Attachments: job_2016_06_21_16_23_51-err.zip
>
>
> Hello,
> running into weird issue. I have designed Kylin cube. Clonned it to another cube without any changes and run the Build job. The Build succeeded. Then I have discarder the build job and disabled and dropped the cube. Clonned the same cube again (into different name than previously) and then again started to build the cube. Getting an NPE below every time in Step 4 - Build Dimension Dictionary":
> Kylin
> jambajuice_3_0
> Insight
> Model
> Monitor
> System
> Help
> Welcome, ADMIN
>
> Jobs
> Slow Queries
> Cube Name:
> Filter ...
> Jobs in: NEW PENDING RUNNING FINISHED ERROR DISCARDED
> Job Name Cube Progress Last Modified Time Duration Actions
> JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone
> ERROR
> 2016-06-21 15:35:21 PST 5.80 mins Action
> JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:06:48 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone
> 100%
> 2016-06-21 15:14:24 PST 6.85 mins Action
> JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626000000 - BUILD - PDT 2016-06-21 14:10:10 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone
> 14.29%
> 2016-06-21 14:59:37 PST 5.70 mins Action
> Total: 3
> Detail Information
> Job Name JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03
> Job ID ac090c87-496d-4173-9503-6a9ec97a764e
> Status ERROR
> Duration 5.80 mins
> MapReduce Waiting 0.18 mins
> Start 2016-06-21 15:29:32 PST
> 2016-06-21 15:29:32 PST
> #1 Step Name: Create Intermediate Flat Hive Table
> Duration: 2.82 mins
>
> 2016-06-21 15:32:21 PST
> #2 Step Name: Materialize Hive View in Lookup Tables
> Duration: 2.11 mins
>
> 2016-06-21 15:34:28 PST
> #3 Step Name: Extract Fact Table Distinct Columns
> Duration: 0.86 mins
>
> 2016-06-21 15:35:20 PST
> #4 Step Name: Build Dimension Dictionary
> Duration: 0.02 mins
>
> #5 Step Name: Save Cuboid Statistics
> Duration: 0 seconds
> #6 Step Name: Create HTable
> Duration: 0 seconds
> #7 Step Name: Build Base Cuboid Data
> Duration: 0 seconds
> #8 Step Name: Build N-Dimension Cuboid Data : 8-Dimension
> Duration: 0 seconds
> #9 Step Name: Build N-Dimension Cuboid Data : 7-Dimension
> Duration: 0 seconds
> #10 Step Name: Build N-Dimension Cuboid Data : 6-Dimension
> Duration: 0 seconds
> #11 Step Name: Build N-Dimension Cuboid Data : 5-Dimension
> Duration: 0 seconds
> #12 Step Name: Build N-Dimension Cuboid Data : 4-Dimension
> Duration: 0 seconds
> #13 Step Name: Build N-Dimension Cuboid Data : 3-Dimension
> Duration: 0 seconds
> #14 Step Name: Build N-Dimension Cuboid Data : 2-Dimension
> Duration: 0 seconds
> #15 Step Name: Build N-Dimension Cuboid Data : 1-Dimension
> Duration: 0 seconds
> #16 Step Name: Build N-Dimension Cuboid Data : 0-Dimension
> Duration: 0 seconds
> #17 Step Name: Build Cube
> Duration: 0 seconds
> #18 Step Name: Convert Cuboid Data to HFile
> Duration: 0 seconds
> #19 Step Name: Load HFile to HBase Table
> Duration: 0 seconds
> #20 Step Name: Update Cube Info
> Duration: 0 seconds
> #21 Step Name: Garbage Collection
> Duration: 0 seconds
> End
> Apache Kylin | Apache Kylin Community
> Output
> java.lang.NullPointerException
> at org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
> at org.apache.kylin.dict.lookup.SnapshotManager.checkDupByContent(SnapshotManager.java:167)
> at org.apache.kylin.dict.lookup.SnapshotManager.trySaveNewSnapshot(SnapshotManager.java:128)
> at org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:108)
> at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:215)
> at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:59)
> at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
> at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> result code:2
> Attaching the Diagnostic logs.
> Any clue how to resolve this ???
> I am thinking to wipe all Kylin metadata from repository and try to restore from backup.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)