You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Alexander Sterligov (JIRA)" <ji...@apache.org> on 2017/07/13 17:19:00 UTC

[jira] [Created] (KYLIN-2740) FileNotFoundException on base cuboid build if GlobalDictionary is used

Alexander Sterligov created KYLIN-2740:
------------------------------------------

             Summary: FileNotFoundException on base cuboid build if GlobalDictionary is used
                 Key: KYLIN-2740
                 URL: https://issues.apache.org/jira/browse/KYLIN-2740
             Project: Kylin
          Issue Type: Bug
    Affects Versions: v2.0.0
            Reporter: Alexander Sterligov


2017-07-13 15:25:20,515 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.RuntimeException: java.io.FileNotFoundException: No such file or directory: 'home/production/bi/kylin/kylin_metadata/resources/GlobalDict/dict/MART.STAR_MAIN_EVENT/DEVICE_ID/version_1499959477799/.index'
	at org.apache.kylin.dict.DictionaryManager.getDictionaryInfo(DictionaryManager.java:129)
	at org.apache.kylin.cube.CubeManager.getDictionary(CubeManager.java:264)
	at org.apache.kylin.cube.CubeSegment.getDictionary(CubeSegment.java:329)
	at org.apache.kylin.cube.CubeSegment.buildDictionaryMap(CubeSegment.java:321)
	at org.apache.kylin.engine.mr.common.BaseCuboidBuilder.<init>(BaseCuboidBuilder.java:86)
	at org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.setup(BaseCuboidMapperBase.java:70)
	at org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.setup(HiveToBaseCuboidMapper.java:36)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.io.FileNotFoundException: No such file or directory: 'home/production/bi/kylin/kylin_metadata/resources/GlobalDict/dict/MART.STAR_MAIN_EVENT/DEVICE_ID/version_1499959477799/.index'

The reason of the exception is that flushIndex in org.apache.kylin.dict.AppendTrieDictionary flushes and closes file after CachedTreeMap is committed. .index file is left in working directory.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)