You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Luke Han <lu...@gmail.com> on 2015/01/31 04:53:16 UTC
Fwd: Cube builds stuck PENDING
Hi Steven,
Which branch/version of Kylin you are using?
BTW, please subscribe and send further discussion to Kylin dev mailing
list.
Thanks.
Luke
在 2015年1月22日星期四 UTC+8上午7:04:27，Steven Yu写道：
>
> Hi All,
>
> I am trying to create some cubes. I tried building one myself, but the
> job is stuck PENDING. I took a peek at the kylin.log and kylin_job.log and
> noticed that it can't find kylin_job_conf_small.xml, so it is defaulting to
> kylin_job_conf.xml (which does exist).
>
> from kylib_job.log:
>
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,001][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,002][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,002][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,003][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,004][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,005][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,005][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,005][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,006][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,006][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,007][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,007][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,007][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,008][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,008][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,008][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,008][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,009][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,009][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,009][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,010][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,010][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,010][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,011][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,011][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,011][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,012][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,012][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,012][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,013][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,013][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,013][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,014][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,014][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,014][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,015][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,015][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,015][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,016][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,016][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,016][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,017][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,017][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,017][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,017][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
> - Search conf file kylin_job_conf_small.xml from classpath ...
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,018][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
> - Can't get kylin_job_conf_small.xml from classpath
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,018][DEBUG][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
> - No kylin_job_conf_small.xml file were found
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,018][INFO][com.kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
> [http-bio-7070-exec-3]:[2015-01-21
> 14:15:36,019][DEBUG][com.kylinolap.job.JobInstanceBuilder.createBuildCubeSegmentSteps(JobInstanceBuilder.java:248)]
> - {
> "uuid" : "ee3d3195-b2c5-4ce7-a098-128cd21b76b7",
> "name" : "test_kylin_cube_without_slr_empty - FULL_BUILD - BUILD - PST
> 2015-01-21 14:15:36",
> "type" : "BUILD",
> "duration" : 0,
> "steps" : null,
> "submitter" : "ADMIN",
> "progress" : "NaN",
> "last_modified" : 0,
> "related_cube" : "test_kylin_cube_without_slr_empty",
> "related_segment" : "FULL_BUILD",
> "exec_start_time" : 0,
> "exec_end_time" : 0,
> "mr_waiting" : 0,
> "job_status" : "NEW"
> }
>
> from kylin.log (only last few lines for brevity):
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,439][DEBUG][com.kylinolap.metadata.MetadataManager.reloadAllSourceTableExd(MetadataManager.java:253)]
> - Loaded 1 SourceTable EXD(s)
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,439][INFO][com.kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:310)]
> - Reloading Cube Metadata from folder
> kylin_metadata_qa(key='/cube_desc')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,451][DEBUG][com.kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
> - Loading CubeDesc
> kylin_metadata_qa(key='/cube_desc/TestCube.json')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,454][DEBUG][com.kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
> - Loading CubeDesc
> kylin_metadata_qa(key='/cube_desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,456][DEBUG][com.kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
> - Loading CubeDesc
> kylin_metadata_qa(key='/cube_desc/test_kylin_cube_with_slr_desc.json')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,459][DEBUG][com.kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
> - Loading CubeDesc
> kylin_metadata_qa(key='/cube_desc/test_kylin_cube_with_slr_left_join_desc.json')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,462][DEBUG][com.kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
> - Loading CubeDesc
> kylin_metadata_qa(key='/cube_desc/test_kylin_cube_without_slr_desc.json')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,465][DEBUG][com.kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
> - Loading CubeDesc
> kylin_metadata_qa(key='/cube_desc/test_kylin_cube_without_slr_left_join_desc.json')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,468][DEBUG][com.kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:335)]
> - Loaded 6 Cube(s)
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,468][INFO][com.kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:359)]
> - Reloading Inverted Index Desc from folder
> kylin_metadata_qa(key='/invertedindex_desc')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,471][DEBUG][com.kylinolap.metadata.MetadataManager.loadInvertedIndexDesc(MetadataManager.java:389)]
> - Loading InvertedIndexDesc
> kylin_metadata_qa(key='/invertedindex_desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
> [http-bio-7070-exec-9]:[2015-01-21
> 14:15:38,473][DEBUG][com.kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:384)]
> - Loaded 1 Inverted Index Desc(s)
>
>
> No new updates to the logs from here. I do not see any jobs submitted to
> my ResourceManager from the ResourceManager UI. Could you please advise as
> to what I can check next to troubleshoot?
>
> I am testing this on a cluster environment running HDP 2.1.
>
> Thanks!
>
>
>
Re: Cube builds stuck PENDING
Posted by "Han, Luke" <lu...@ebay.com>.
Please pull latest master code and try again, there are many bug fixes and enhancements.
Regards!
Luke Han
On Mon, Feb 2, 2015 at 8:47 AM -0800, "Steven Yu" <st...@gmail.com>> wrote:
Hi All,
I installed it following the documentation here:
https://github.com/KylinOLAP/Kylin/wiki/On-Hadoop-CLI-installation
Looks like version 0.6.3.
Does this pull from the master? The commit id is:
79015010b0f0e9d0c3734a3c3af6f8c95956cab7
Thanks again for all the help!
--Steven
On Fri, Jan 30, 2015 at 9:11 PM, hongbin ma <ma...@apache.org> wrote:
> also please provide the commit id of the branch you ckecked out.
>
> thanks
>
> On Sat, Jan 31, 2015 at 11:53 AM, Luke Han <lu...@gmail.com> wrote:
>
>> Hi Steven,
>> Which branch/version of Kylin you are using?
>> BTW, please subscribe and send further discussion to Kylin dev
>> mailing list.
>> Thanks.
>> Luke
>>
>> 在 2015年1月22日星期四 UTC+8上午7:04:27，Steven Yu写道：
>>>
>>> Hi All,
>>>
>>> I am trying to create some cubes. I tried building one myself, but the
>>> job is stuck PENDING. I took a peek at the kylin.log and kylin_job.log and
>>> noticed that it can't find kylin_job_conf_small.xml, so it is defaulting to
>>> kylin_job_conf.xml (which does exist).
>>>
>>> from kylib_job.log:
>>>
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,001][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,002][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,002][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,003][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,004][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,006][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,006][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,019][DEBUG][com.
>>> kylinolap.job.JobInstanceBuilder.createBuildCubeSegmentSteps(JobInstanceBuilder.java:248)]
>>> - {
>>> "uuid" : "ee3d3195-b2c5-4ce7-a098-128cd21b76b7",
>>> "name" : "test_kylin_cube_without_slr_empty - FULL_BUILD - BUILD -
>>> PST 2015-01-21 14:15:36",
>>> "type" : "BUILD",
>>> "duration" : 0,
>>> "steps" : null,
>>> "submitter" : "ADMIN",
>>> "progress" : "NaN",
>>> "last_modified" : 0,
>>> "related_cube" : "test_kylin_cube_without_slr_empty",
>>> "related_segment" : "FULL_BUILD",
>>> "exec_start_time" : 0,
>>> "exec_end_time" : 0,
>>> "mr_waiting" : 0,
>>> "job_status" : "NEW"
>>> }
>>>
>>> from kylin.log (only last few lines for brevity):
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,439][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.reloadAllSourceTableExd(MetadataManager.java:253)]
>>> - Loaded 1 SourceTable EXD(s)
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,439][INFO][com.
>>> kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:310)]
>>> - Reloading Cube Metadata from folder kylin_metadata_qa(key='/cube_
>>> desc')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,451][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/TestCube.json')@kylin_metadata_qa@hbase:hdp014-2:
>>> 2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,454][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase:
>>> hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,456][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_with_slr_desc.json')@kylin_metadata_qa@
>>> hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,459][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_with_slr_left_join_desc.json')@kylin_
>>> metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,462][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_without_slr_desc.json')@kylin_metadata_qa@hbase
>>> :hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,465][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_without_slr_left_join_desc.json')@
>>> kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,468][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:335)]
>>> - Loaded 6 Cube(s)
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,468][INFO][com.
>>> kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:359)]
>>> - Reloading Inverted Index Desc from folder kylin_metadata_qa(key='/
>>> invertedindex_desc')@kylin_metadata_qa@hbase:hdp014-2:
>>> 2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,471][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadInvertedIndexDesc(MetadataManager.java:389)]
>>> - Loading InvertedIndexDesc kylin_metadata_qa(key='/
>>> invertedindex_desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase
>>> :hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,473][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:384)]
>>> - Loaded 1 Inverted Index Desc(s)
>>>
>>>
>>> No new updates to the logs from here. I do not see any jobs submitted
>>> to my ResourceManager from the ResourceManager UI. Could you please advise
>>> as to what I can check next to troubleshoot?
>>>
>>> I am testing this on a cluster environment running HDP 2.1.
>>>
>>> Thanks!
>>>
>>>
>>>
>
Re: Cube builds stuck PENDING
Posted by Steven Yu <st...@gmail.com>.
Hi All,
I installed it following the documentation here:
https://github.com/KylinOLAP/Kylin/wiki/On-Hadoop-CLI-installation
Looks like version 0.6.3.
Does this pull from the master? The commit id is:
79015010b0f0e9d0c3734a3c3af6f8c95956cab7
Thanks again for all the help!
--Steven
On Fri, Jan 30, 2015 at 9:11 PM, hongbin ma <ma...@apache.org> wrote:
> also please provide the commit id of the branch you ckecked out.
>
> thanks
>
> On Sat, Jan 31, 2015 at 11:53 AM, Luke Han <lu...@gmail.com> wrote:
>
>> Hi Steven,
>> Which branch/version of Kylin you are using?
>> BTW, please subscribe and send further discussion to Kylin dev
>> mailing list.
>> Thanks.
>> Luke
>>
>> 在 2015年1月22日星期四 UTC+8上午7:04:27，Steven Yu写道：
>>>
>>> Hi All,
>>>
>>> I am trying to create some cubes. I tried building one myself, but the
>>> job is stuck PENDING. I took a peek at the kylin.log and kylin_job.log and
>>> noticed that it can't find kylin_job_conf_small.xml, so it is defaulting to
>>> kylin_job_conf.xml (which does exist).
>>>
>>> from kylib_job.log:
>>>
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,001][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,002][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,002][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,003][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,004][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,006][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,006][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>>> - Search conf file kylin_job_conf_small.xml from classpath ...
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>>> - Can't get kylin_job_conf_small.xml from classpath
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][DEBUG][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>>> - No kylin_job_conf_small.xml file were found
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][INFO][com.
>>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,019][DEBUG][com.
>>> kylinolap.job.JobInstanceBuilder.createBuildCubeSegmentSteps(JobInstanceBuilder.java:248)]
>>> - {
>>> "uuid" : "ee3d3195-b2c5-4ce7-a098-128cd21b76b7",
>>> "name" : "test_kylin_cube_without_slr_empty - FULL_BUILD - BUILD -
>>> PST 2015-01-21 14:15:36",
>>> "type" : "BUILD",
>>> "duration" : 0,
>>> "steps" : null,
>>> "submitter" : "ADMIN",
>>> "progress" : "NaN",
>>> "last_modified" : 0,
>>> "related_cube" : "test_kylin_cube_without_slr_empty",
>>> "related_segment" : "FULL_BUILD",
>>> "exec_start_time" : 0,
>>> "exec_end_time" : 0,
>>> "mr_waiting" : 0,
>>> "job_status" : "NEW"
>>> }
>>>
>>> from kylin.log (only last few lines for brevity):
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,439][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.reloadAllSourceTableExd(MetadataManager.java:253)]
>>> - Loaded 1 SourceTable EXD(s)
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,439][INFO][com.
>>> kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:310)]
>>> - Reloading Cube Metadata from folder kylin_metadata_qa(key='/cube_
>>> desc')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,451][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/TestCube.json')@kylin_metadata_qa@hbase:hdp014-2:
>>> 2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,454][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase:
>>> hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,456][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_with_slr_desc.json')@kylin_metadata_qa@
>>> hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,459][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_with_slr_left_join_desc.json')@kylin_
>>> metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,462][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_without_slr_desc.json')@kylin_metadata_qa@hbase
>>> :hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,465][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>>> desc/test_kylin_cube_without_slr_left_join_desc.json')@
>>> kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,468][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:335)]
>>> - Loaded 6 Cube(s)
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,468][INFO][com.
>>> kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:359)]
>>> - Reloading Inverted Index Desc from folder kylin_metadata_qa(key='/
>>> invertedindex_desc')@kylin_metadata_qa@hbase:hdp014-2:
>>> 2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,471][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.loadInvertedIndexDesc(MetadataManager.java:389)]
>>> - Loading InvertedIndexDesc kylin_metadata_qa(key='/
>>> invertedindex_desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase
>>> :hdp014-2:2181:/hbase-unsecure
>>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,473][DEBUG][com.
>>> kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:384)]
>>> - Loaded 1 Inverted Index Desc(s)
>>>
>>>
>>> No new updates to the logs from here. I do not see any jobs submitted
>>> to my ResourceManager from the ResourceManager UI. Could you please advise
>>> as to what I can check next to troubleshoot?
>>>
>>> I am testing this on a cluster environment running HDP 2.1.
>>>
>>> Thanks!
>>>
>>>
>>>
>
Re: Cube builds stuck PENDING
Posted by hongbin ma <ma...@apache.org>.
also please provide the commit id of the branch you ckecked out.
thanks
On Sat, Jan 31, 2015 at 11:53 AM, Luke Han <lu...@gmail.com> wrote:
> Hi Steven,
> Which branch/version of Kylin you are using?
> BTW, please subscribe and send further discussion to Kylin dev mailing
> list.
> Thanks.
> Luke
>
> 在 2015年1月22日星期四 UTC+8上午7:04:27，Steven Yu写道：
>>
>> Hi All,
>>
>> I am trying to create some cubes. I tried building one myself, but the
>> job is stuck PENDING. I took a peek at the kylin.log and kylin_job.log and
>> noticed that it can't find kylin_job_conf_small.xml, so it is defaulting to
>> kylin_job_conf.xml (which does exist).
>>
>> from kylib_job.log:
>>
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,001][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,002][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,002][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,003][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,004][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,005][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,006][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,006][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,007][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,008][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,009][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,010][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,011][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,012][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,013][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,014][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,015][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,016][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,017][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:63)]
>> - Search conf file kylin_job_conf_small.xml from classpath ...
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:66)]
>> - Can't get kylin_job_conf_small.xml from classpath
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][DEBUG][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:67)]
>> - No kylin_job_conf_small.xml file were found
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,018][INFO][com.
>> kylinolap.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:91)]
>> - Chosen job conf is : /etc/kylin/kylin_job_conf.xml
>> [http-bio-7070-exec-3]:[2015-01-21 14:15:36,019][DEBUG][com.
>> kylinolap.job.JobInstanceBuilder.createBuildCubeSegmentSteps(JobInstanceBuilder.java:248)]
>> - {
>> "uuid" : "ee3d3195-b2c5-4ce7-a098-128cd21b76b7",
>> "name" : "test_kylin_cube_without_slr_empty - FULL_BUILD - BUILD - PST
>> 2015-01-21 14:15:36",
>> "type" : "BUILD",
>> "duration" : 0,
>> "steps" : null,
>> "submitter" : "ADMIN",
>> "progress" : "NaN",
>> "last_modified" : 0,
>> "related_cube" : "test_kylin_cube_without_slr_empty",
>> "related_segment" : "FULL_BUILD",
>> "exec_start_time" : 0,
>> "exec_end_time" : 0,
>> "mr_waiting" : 0,
>> "job_status" : "NEW"
>> }
>>
>> from kylin.log (only last few lines for brevity):
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,439][DEBUG][com.
>> kylinolap.metadata.MetadataManager.reloadAllSourceTableExd(MetadataManager.java:253)]
>> - Loaded 1 SourceTable EXD(s)
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,439][INFO][com.
>> kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:310)]
>> - Reloading Cube Metadata from folder kylin_metadata_qa(key='/cube_
>> desc')@kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,451][DEBUG][com.
>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>> desc/TestCube.json')@kylin_metadata_qa@hbase:hdp014-2:
>> 2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,454][DEBUG][com.
>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>> desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase:
>> hdp014-2:2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,456][DEBUG][com.
>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>> desc/test_kylin_cube_with_slr_desc.json')@kylin_metadata_qa@
>> hbase:hdp014-2:2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,459][DEBUG][com.
>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>> desc/test_kylin_cube_with_slr_left_join_desc.json')@kylin_
>> metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,462][DEBUG][com.
>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>> desc/test_kylin_cube_without_slr_desc.json')@kylin_metadata_qa@hbase
>> :hdp014-2:2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,465][DEBUG][com.
>> kylinolap.metadata.MetadataManager.loadCubeDesc(MetadataManager.java:340)]
>> - Loading CubeDesc kylin_metadata_qa(key='/cube_
>> desc/test_kylin_cube_without_slr_left_join_desc.json')@
>> kylin_metadata_qa@hbase:hdp014-2:2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,468][DEBUG][com.
>> kylinolap.metadata.MetadataManager.reloadAllCubeDesc(MetadataManager.java:335)]
>> - Loaded 6 Cube(s)
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,468][INFO][com.
>> kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:359)]
>> - Reloading Inverted Index Desc from folder kylin_metadata_qa(key='/
>> invertedindex_desc')@kylin_metadata_qa@hbase:hdp014-2:
>> 2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,471][DEBUG][com.
>> kylinolap.metadata.MetadataManager.loadInvertedIndexDesc(MetadataManager.java:389)]
>> - Loading InvertedIndexDesc kylin_metadata_qa(key='/
>> invertedindex_desc/test_kylin_cube_ii.json')@kylin_metadata_qa@hbase
>> :hdp014-2:2181:/hbase-unsecure
>> [http-bio-7070-exec-9]:[2015-01-21 14:15:38,473][DEBUG][com.
>> kylinolap.metadata.MetadataManager.reloadAllInvertedIndexDesc(MetadataManager.java:384)]
>> - Loaded 1 Inverted Index Desc(s)
>>
>>
>> No new updates to the logs from here. I do not see any jobs submitted to
>> my ResourceManager from the ResourceManager UI. Could you please advise as
>> to what I can check next to troubleshoot?
>>
>> I am testing this on a cluster environment running HDP 2.1.
>>
>> Thanks!
>>
>>
>>