You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 梅秋莹 <32...@qq.com> on 2020/07/03 08:55:52 UTC
When build cube in kylin, it failed at the 4th step "Build Dimension Dictionary"
Hello everyone:
Recently, we have encountered a new problem. That is, when build cube in kylin, it failed at the 4th step "Build Dimension Dictionary".
and the error message is like below. Before tha， we have never met such quetion, and our model and cube have functioned properly for at least one month. After reading some articles and blogs, someone think the errors could be related to the cube which has been set some measures like, "TOP-N" and "COUNT_DISTINCT". Indeed，I have set the measures like "TOP-N" and "COUNT_DISTINCT" when create cube. What should we do to solve the proble? Please tell me if you know the reason. Thank you very much.
our kylin is 2.6.3.
org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.RuntimeException: java.io.FileNotFoundException: /etc/hadoop/3.1.0.0-78/0/core-site.xml (打开的文件过多) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3000) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2926) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2806) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) at org.apache.kylin.common.util.HadoopUtil.healSickConfig(HadoopUtil.java:69) at org.apache.kylin.common.util.HadoopUtil.getCurrentConfiguration(HadoopUtil.java:59) at org.apache.kylin.common.util.HadoopUtil.getFileSystem(HadoopUtil.java:103) at org.apache.kylin.common.util.HadoopUtil.getFileSystem(HadoopUtil.java:95) at org.apache.kylin.common.util.HadoopUtil.getWorkingFileSystem(HadoopUtil.java:82) at org.apache.kylin.engine.mr.steps.CreateDictionaryJob$2.getDictionary(CreateDictionaryJob.java:92) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:95) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:69) at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.FileNotFoundException: /etc/hadoop/3.1.0.0-78/0/core-site.xml (打开的文件过多) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.<init>(FileInputStream.java:138) at java.io.FileInputStream.<init>(FileInputStream.java:93) at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90) at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188) at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2901) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2953) ... 21 more result code:2 at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)