回复： 执行cube在第4步报错，提示“打开的文件过多” 是怎么回事？

[梅秋莹 <32...@qq.com>]

We have tried to  restart kylin and rebuild the job many times，but it also returned the same errors. If you konw how to solve it ,please contact me . . Thank you very much!


------------------ 原始邮件 ------------------
发件人:&nbsp;"Yaqian Zhang"<Yaqian_Zhang@126.com&gt;;
发送时间:&nbsp;2020年7月9日(星期四) 上午10:39
收件人:&nbsp;"user"<user@kylin.apache.org&gt;;

主题:&nbsp;Re: 执行cube在第4步报错，提示“打开的文件过多” 是怎么回事？



Hi:


If it's useful to restart kylin or rebuild the job?

在 2020年7月8日，11:16，梅秋莹 <3281438086@qq.com&gt; 写道：







------------------ 原始邮件 ------------------
发件人:&nbsp;"梅秋莹"<3281438086@qq.com&gt;;
发送时间:&nbsp;2020年7月3日(星期五) 下午4:55
收件人:&nbsp;"user"<user@kylin.apache.org&gt;;

主题:&nbsp;When build cube in kylin, it failed at the 4th step "Build Dimension Dictionary"



Hello everyone:
&nbsp; &nbsp;
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Recently, we have encountered a new problem. That is, when build cube in kylin, it failed at the 4th step "Build Dimension Dictionary". 


<EB7E8108@66E50C04.A13A055F.jpg&gt;
and the error message is like below. Before tha， we have never met such quetion, and our model and cube have functioned properly for at least one month. After reading some articles and blogs, someone think the errors could be related to the cube which has been set some measures like, "TOP-N" and "COUNT_DISTINCT". Indeed，I have set the measures like "TOP-N" and "COUNT_DISTINCT"&nbsp; when create cube. What should we do to solve the proble? Please tell me if you know the reason. Thank you very much.


our kylin is 2.6.3.


org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.RuntimeException: java.io.FileNotFoundException: /etc/hadoop/3.1.0.0-78/0/core-site.xml (打开的文件过多) 	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3000) 	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2926) 	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2806) 	at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200) 	at org.apache.kylin.common.util.HadoopUtil.healSickConfig(HadoopUtil.java:69) 	at org.apache.kylin.common.util.HadoopUtil.getCurrentConfiguration(HadoopUtil.java:59) 	at org.apache.kylin.common.util.HadoopUtil.getFileSystem(HadoopUtil.java:103) 	at org.apache.kylin.common.util.HadoopUtil.getFileSystem(HadoopUtil.java:95) 	at org.apache.kylin.common.util.HadoopUtil.getWorkingFileSystem(HadoopUtil.java:82) 	at org.apache.kylin.engine.mr.steps.CreateDictionaryJob$2.getDictionary(CreateDictionaryJob.java:92) 	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:95) 	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:69) 	at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73) 	at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93) 	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63) 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) 	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71) 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) 	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 	at java.lang.Thread.run(Thread.java:748) Caused by: java.io.FileNotFoundException: /etc/hadoop/3.1.0.0-78/0/core-site.xml (打开的文件过多) 	at java.io.FileInputStream.open0(Native Method) 	at java.io.FileInputStream.open(FileInputStream.java:195) 	at java.io.FileInputStream.<init&gt;(FileInputStream.java:138) 	at java.io.FileInputStream.<init&gt;(FileInputStream.java:93) 	at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90) 	at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188) 	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2901) 	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2953) 	... 21 more result code:2 	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73) 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) 	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71) 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167) 	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)        at java.lang.Thread.run(Thread.java:748)<E4D43A7C@7AE6845F.A13A055F.jpg&gt;



<E4D43A7C@7AE6845F.A13A055F.jpg&gt;<EB7E8108@66E50C04.A13A055F.jpg&gt;<kylin(1).log&gt;