You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Richard Calaba (JIRA)" <ji...@apache.org> on 2016/06/21 23:41:57 UTC

[jira] [Created] (KYLIN-1810) NPE in org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)

Richard Calaba created KYLIN-1810:
-------------------------------------

             Summary: NPE in org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
                 Key: KYLIN-1810
                 URL: https://issues.apache.org/jira/browse/KYLIN-1810
             Project: Kylin
          Issue Type: Bug
    Affects Versions: v1.5.2.1
            Reporter: Richard Calaba
         Attachments: job_2016_06_21_16_23_51-err.zip

Hello,

running into weird issue. I have designed Kylin cube. Clonned it to another cube without any changes and run the Build job. The Build succeeded. Then I have discarder the build job and disabled and dropped the cube. Clonned the same cube again (into different name than  previously) and then again started to build the cube. Getting an NPE below every time in Step 4  - Build Dimension Dictionary":

 Kylin
jambajuice_3_0

Insight
Model
Monitor
System
 Help 
Welcome, ADMIN 
 
Jobs
Slow Queries
Cube Name: 
Filter ...
Jobs in:    NEW PENDING RUNNING FINISHED ERROR DISCARDED   
Job Name 	Cube 	Progress	Last Modified Time 	Duration	Actions	
JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone	
ERROR
2016-06-21 15:35:21 PST	5.80 mins	Action 	
JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:06:48	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone	
100%
2016-06-21 15:14:24 PST	6.85 mins	Action 	
JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626000000 - BUILD - PDT 2016-06-21 14:10:10	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone	
14.29%
2016-06-21 14:59:37 PST	5.70 mins	Action 	
Total: 3
 Detail Information
Job Name	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03
Job ID	ac090c87-496d-4173-9503-6a9ec97a764e
Status	ERROR
Duration	5.80 mins
MapReduce Waiting	0.18 mins
Start   2016-06-21 15:29:32 PST
 2016-06-21 15:29:32 PST
#1 Step Name: Create Intermediate Flat Hive Table
Duration: 2.82 mins
  
 2016-06-21 15:32:21 PST
#2 Step Name: Materialize Hive View in Lookup Tables
Duration: 2.11 mins
  
 2016-06-21 15:34:28 PST
#3 Step Name: Extract Fact Table Distinct Columns
Duration: 0.86 mins
  
 2016-06-21 15:35:20 PST
#4 Step Name: Build Dimension Dictionary
Duration: 0.02 mins
 
#5 Step Name: Save Cuboid Statistics
Duration: 0 seconds
#6 Step Name: Create HTable
Duration: 0 seconds
#7 Step Name: Build Base Cuboid Data
Duration: 0 seconds
#8 Step Name: Build N-Dimension Cuboid Data : 8-Dimension
Duration: 0 seconds
#9 Step Name: Build N-Dimension Cuboid Data : 7-Dimension
Duration: 0 seconds
#10 Step Name: Build N-Dimension Cuboid Data : 6-Dimension
Duration: 0 seconds
#11 Step Name: Build N-Dimension Cuboid Data : 5-Dimension
Duration: 0 seconds
#12 Step Name: Build N-Dimension Cuboid Data : 4-Dimension
Duration: 0 seconds
#13 Step Name: Build N-Dimension Cuboid Data : 3-Dimension
Duration: 0 seconds
#14 Step Name: Build N-Dimension Cuboid Data : 2-Dimension
Duration: 0 seconds
#15 Step Name: Build N-Dimension Cuboid Data : 1-Dimension
Duration: 0 seconds
#16 Step Name: Build N-Dimension Cuboid Data : 0-Dimension
Duration: 0 seconds
#17 Step Name: Build Cube
Duration: 0 seconds
#18 Step Name: Convert Cuboid Data to HFile
Duration: 0 seconds
#19 Step Name: Load HFile to HBase Table
Duration: 0 seconds
#20 Step Name: Update Cube Info
Duration: 0 seconds
#21 Step Name: Garbage Collection
Duration: 0 seconds
End   
 Apache Kylin |  Apache Kylin Community
Output 
java.lang.NullPointerException
	at org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
	at org.apache.kylin.dict.lookup.SnapshotManager.checkDupByContent(SnapshotManager.java:167)
	at org.apache.kylin.dict.lookup.SnapshotManager.trySaveNewSnapshot(SnapshotManager.java:128)
	at org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:108)
	at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:215)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:59)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
	at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

result code:2

Attaching the Diagnostic logs.

Any clue how to resolve this ??? 

I am thinking to wipe all Kylin metadata from repository and try to restore from backup.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)