You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Alexander Sterligov (JIRA)" <ji...@apache.org> on 2017/07/23 07:03:00 UTC

[jira] [Updated] (KYLIN-2740) FileNotFoundException on base cuboid build if GlobalDictionary is used

     [ https://issues.apache.org/jira/browse/KYLIN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexander Sterligov updated KYLIN-2740:
---------------------------------------
    Attachment: KYLIN-2740-patch

> FileNotFoundException on base cuboid build if GlobalDictionary is used
> ----------------------------------------------------------------------
>
>                 Key: KYLIN-2740
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2740
>             Project: Kylin
>          Issue Type: Bug
>    Affects Versions: v2.0.0
>            Reporter: Alexander Sterligov
>            Assignee: kangkaisen
>         Attachments: KYLIN-2740-patch
>
>
> 2017-07-13 15:25:20,515 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.RuntimeException: java.io.FileNotFoundException: No such file or directory: 'home/production/bi/kylin/kylin_metadata/resources/GlobalDict/dict/MART.STAR_MAIN_EVENT/DEVICE_ID/version_1499959477799/.index'
> 	at org.apache.kylin.dict.DictionaryManager.getDictionaryInfo(DictionaryManager.java:129)
> 	at org.apache.kylin.cube.CubeManager.getDictionary(CubeManager.java:264)
> 	at org.apache.kylin.cube.CubeSegment.getDictionary(CubeSegment.java:329)
> 	at org.apache.kylin.cube.CubeSegment.buildDictionaryMap(CubeSegment.java:321)
> 	at org.apache.kylin.engine.mr.common.BaseCuboidBuilder.<init>(BaseCuboidBuilder.java:86)
> 	at org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.setup(BaseCuboidMapperBase.java:70)
> 	at org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.setup(HiveToBaseCuboidMapper.java:36)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:422)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> Caused by: java.io.FileNotFoundException: No such file or directory: 'home/production/bi/kylin/kylin_metadata/resources/GlobalDict/dict/MART.STAR_MAIN_EVENT/DEVICE_ID/version_1499959477799/.index'
> The reason of the exception is that flushIndex in org.apache.kylin.dict.AppendTrieDictionary flushes and closes file after CachedTreeMap is committed. .index file is left in working directory.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)