You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Richard Calaba (JIRA)" <ji...@apache.org> on 2016/06/21 23:41:57 UTC

[jira] [Updated] (KYLIN-1810) NPE in org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)

     [ https://issues.apache.org/jira/browse/KYLIN-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Richard Calaba updated KYLIN-1810:
----------------------------------
    Attachment: job_2016_06_21_16_23_51-err.zip

> NPE in org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
> --------------------------------------------------------------------------------
>
>                 Key: KYLIN-1810
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1810
>             Project: Kylin
>          Issue Type: Bug
>    Affects Versions: v1.5.2.1
>            Reporter: Richard Calaba
>         Attachments: job_2016_06_21_16_23_51-err.zip
>
>
> Hello,
> running into weird issue. I have designed Kylin cube. Clonned it to another cube without any changes and run the Build job. The Build succeeded. Then I have discarder the build job and disabled and dropped the cube. Clonned the same cube again (into different name than  previously) and then again started to build the cube. Getting an NPE below every time in Step 4  - Build Dimension Dictionary":
>  Kylin
> jambajuice_3_0
> Insight
> Model
> Monitor
> System
>  Help 
> Welcome, ADMIN 
>  
> Jobs
> Slow Queries
> Cube Name: 
> Filter ...
> Jobs in:    NEW PENDING RUNNING FINISHED ERROR DISCARDED   
> Job Name 	Cube 	Progress	Last Modified Time 	Duration	Actions	
> JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone	
> ERROR
> 2016-06-21 15:35:21 PST	5.80 mins	Action 	
> JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:06:48	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone	
> 100%
> 2016-06-21 15:14:24 PST	6.85 mins	Action 	
> JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626000000 - BUILD - PDT 2016-06-21 14:10:10	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone	
> 14.29%
> 2016-06-21 14:59:37 PST	5.70 mins	Action 	
> Total: 3
>  Detail Information
> Job Name	JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03
> Job ID	ac090c87-496d-4173-9503-6a9ec97a764e
> Status	ERROR
> Duration	5.80 mins
> MapReduce Waiting	0.18 mins
> Start   2016-06-21 15:29:32 PST
>  2016-06-21 15:29:32 PST
> #1 Step Name: Create Intermediate Flat Hive Table
> Duration: 2.82 mins
>   
>  2016-06-21 15:32:21 PST
> #2 Step Name: Materialize Hive View in Lookup Tables
> Duration: 2.11 mins
>   
>  2016-06-21 15:34:28 PST
> #3 Step Name: Extract Fact Table Distinct Columns
> Duration: 0.86 mins
>   
>  2016-06-21 15:35:20 PST
> #4 Step Name: Build Dimension Dictionary
> Duration: 0.02 mins
>  
> #5 Step Name: Save Cuboid Statistics
> Duration: 0 seconds
> #6 Step Name: Create HTable
> Duration: 0 seconds
> #7 Step Name: Build Base Cuboid Data
> Duration: 0 seconds
> #8 Step Name: Build N-Dimension Cuboid Data : 8-Dimension
> Duration: 0 seconds
> #9 Step Name: Build N-Dimension Cuboid Data : 7-Dimension
> Duration: 0 seconds
> #10 Step Name: Build N-Dimension Cuboid Data : 6-Dimension
> Duration: 0 seconds
> #11 Step Name: Build N-Dimension Cuboid Data : 5-Dimension
> Duration: 0 seconds
> #12 Step Name: Build N-Dimension Cuboid Data : 4-Dimension
> Duration: 0 seconds
> #13 Step Name: Build N-Dimension Cuboid Data : 3-Dimension
> Duration: 0 seconds
> #14 Step Name: Build N-Dimension Cuboid Data : 2-Dimension
> Duration: 0 seconds
> #15 Step Name: Build N-Dimension Cuboid Data : 1-Dimension
> Duration: 0 seconds
> #16 Step Name: Build N-Dimension Cuboid Data : 0-Dimension
> Duration: 0 seconds
> #17 Step Name: Build Cube
> Duration: 0 seconds
> #18 Step Name: Convert Cuboid Data to HFile
> Duration: 0 seconds
> #19 Step Name: Load HFile to HBase Table
> Duration: 0 seconds
> #20 Step Name: Update Cube Info
> Duration: 0 seconds
> #21 Step Name: Garbage Collection
> Duration: 0 seconds
> End   
>  Apache Kylin |  Apache Kylin Community
> Output 
> java.lang.NullPointerException
> 	at org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164)
> 	at org.apache.kylin.dict.lookup.SnapshotManager.checkDupByContent(SnapshotManager.java:167)
> 	at org.apache.kylin.dict.lookup.SnapshotManager.trySaveNewSnapshot(SnapshotManager.java:128)
> 	at org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:108)
> 	at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:215)
> 	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:59)
> 	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
> 	at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> 	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60)
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
> 	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
> 	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> result code:2
> Attaching the Diagnostic logs.
> Any clue how to resolve this ??? 
> I am thinking to wipe all Kylin metadata from repository and try to restore from backup.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)