You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Ge Silas <go...@live.cn> on 2018/03/01 13:32:11 UTC

Re: about kylin Sample problem

Hi,

The log contains a complete Hive command to be run. It looks that step failed. You can find that Hive command and try to run that by yourself in Hive CLI to see if it reports any errors.

Thanks,
Silas

On 1 Mar 2018, at 9:43 AM, nitc_007@qq.com<ma...@qq.com> wrote:



________________________________
nitc_007@qq.com<ma...@qq.com>

发件人: nitc_007@qq.com<ma...@qq.com>
发送时间: 2018-02-26 10:02
收件人: user<ma...@kylin.apache.org>
主题: 回复: about kylin Sample problem
“Kylin provides a script for you to create a sample Cube; the script will also create five sample hive tables:

  1.  Run ${KYLIN_HOME}/bin/sample.sh ; Restart kylin server to flush the caches;
  2.  Logon Kylin web with default user ADMIN/KYLIN, select project “learn_kylin” in the project dropdown list (left upper corner);
  3.  Select the sample cube “kylin_sales_cube”, click “Actions” -> “Build”, pick up a date later than 2014-01-01 (to cover all 10000 sample records);”

Do this step log in the following error.
 The environment is on Cloudera QuickStart VM 5.12 ,on VMWare, and the resources are given to 4cpu 8G memory


N SELLER_ACCOUNT.ACCOUNT_COUNTRY = SELLER_COUNTRY.COUNTRY
WHERE (KYLIN_SALES.PART_DT >= '2014-01-01' AND KYLIN_SALES.PART_DT < '2018-01-01')
;

" --hiveconf hive.merge.mapredfiles=false --hiveconf hive.merge.mapfiles=false --hiveconf hive.stats.autogather=true --hiveconf hive.auto.convert.join.noconditionaltask=true --hiveconf dfs.replication=2 --hiveconf hive.auto.convert.join.noconditionaltask.size=100000000 --hiveconf hive.auto.convert.join=true --hiveconf hive.exec.compress.output=true --hiveconf mapreduce.job.split.metainfo.maxsize=-1
at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:92)
at org.apache.kylin.source.hive.CreateFlatHiveTableStep.createFlatHiveTable(CreateFlatHiveTableStep.java:53)
at org.apache.kylin.source.hive.CreateFlatHiveTableStep.doWork(CreateFlatHiveTableStep.java:71)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:144)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2018-02-07 06:24:00,234 INFO  [Scheduler 1859819760 Job 90d1f92f-5797-4222-bef0-409e4534690d-139] execution.ExecutableManager:421 : job id:90d1f92f-5797-4222-bef0-409e4534690d-00 from RUNNING to ERROR
2018-02-07 06:24:00,318 INFO  [Scheduler 1859819760 Job 90d1f92f-5797-4222-bef0-409e4534690d-139] execution.ExecutableManager:421 : job id:90d1f92f-5797-4222-bef0-409e4534690d from RUNNING to ERROR
2018-02-07 06:24:00,318 DEBUG [Scheduler 1859819760 Job 90d1f92f-5797-4222-bef0-409e4534690d-139] execution.AbstractExecutable:259 : no need to send email, user list is empty

________________________________
nitc_007@qq.com<ma...@qq.com>

发件人: nitc_007@qq.com<ma...@qq.com>
发送时间: 2018-02-08 11:34
收件人: user<ma...@kylin.apache.org>
主题: about kylin Sample's problem

“Kylin provides a script for you to create a sample Cube; the script will also create five sample hive tables:

  1.  Run ${KYLIN_HOME}/bin/sample.sh ; Restart kylin server to flush the caches;
  2.  Logon Kylin web with default user ADMIN/KYLIN, select project “learn_kylin” in the project dropdown list (left upper corner);
  3.  Select the sample cube “kylin_sales_cube”, click “Actions” -> “Build”, pick up a date later than 2014-01-01 (to cover all 10000 sample records);”

Do this step log in the following error.
 The environment is on Cloudera QuickStart VM 5.12 ,on VMWare, and the resources are given to 4cpu 8G memory


N SELLER_ACCOUNT.ACCOUNT_COUNTRY = SELLER_COUNTRY.COUNTRY
WHERE (KYLIN_SALES.PART_DT >= '2014-01-01' AND KYLIN_SALES.PART_DT < '2018-01-01')
;

" --hiveconf hive.merge.mapredfiles=false --hiveconf hive.merge.mapfiles=false --hiveconf hive.stats.autogather=true --hiveconf hive.auto.convert.join.noconditionaltask=true --hiveconf dfs.replication=2 --hiveconf hive.auto.convert.join.noconditionaltask.size=100000000 --hiveconf hive.auto.convert.join=true --hiveconf hive.exec.compress.output=true --hiveconf mapreduce.job.split.metainfo.maxsize=-1
at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:92)
at org.apache.kylin.source.hive.CreateFlatHiveTableStep.createFlatHiveTable(CreateFlatHiveTableStep.java:53)
at org.apache.kylin.source.hive.CreateFlatHiveTableStep.doWork(CreateFlatHiveTableStep.java:71)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:144)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2018-02-07 06:24:00,234 INFO  [Scheduler 1859819760 Job 90d1f92f-5797-4222-bef0-409e4534690d-139] execution.ExecutableManager:421 : job id:90d1f92f-5797-4222-bef0-409e4534690d-00 from RUNNING to ERROR
2018-02-07 06:24:00,318 INFO  [Scheduler 1859819760 Job 90d1f92f-5797-4222-bef0-409e4534690d-139] execution.ExecutableManager:421 : job id:90d1f92f-5797-4222-bef0-409e4534690d from RUNNING to ERROR
2018-02-07 06:24:00,318 DEBUG [Scheduler 1859819760 Job 90d1f92f-5797-4222-bef0-409e4534690d-139] execution.AbstractExecutable:259 : no need to send email, user list is empty
________________________________
nitc_007@qq.com<ma...@qq.com>