You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2018/11/27 03:57:00 UTC
[jira] [Reopened] (KYLIN-3559) Use Splitter for splitting String
[ https://issues.apache.org/jira/browse/KYLIN-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shaofeng SHI reopened KYLIN-3559:
---------------------------------
The integration test was failed in last night:
2018-11-26 20:01:08,950 INFO [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] execution.ExecutableManager:435 : job id:ac05a6b3-b6de-6a60-bd2b-778e76b58998-00 from READY to RUNNING 2018-11-26 20:01:08,951 INFO [FetcherRunner 1980278840-288] threadpool.FetcherRunner:62 : CubingJob\{id=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb, name=OPTIMIZE CUBE - ci_inner_join_cube - 20120601000000_20130701000000 - GMT+08:00 2018-11-27 04:01:08, state=READY} prepare to schedule and its priority is 5 2018-11-26 20:01:08,951 INFO [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] execution.AbstractExecutable:148 : Executing AbstractExecutable (OPTIMIZE CUBE - ci_inner_join_cube - 20120601000000_20130701000000 - GMT+08:00 2018-11-27 04:01:08) 2018-11-26 20:01:08,951 INFO [FetcherRunner 1980278840-288] threadpool.FetcherRunner:66 : CubingJob\{id=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb, name=OPTIMIZE CUBE - ci_inner_join_cube - 20120601000000_20130701000000 - GMT+08:00 2018-11-27 04:01:08, state=READY} scheduled 2018-11-26 20:01:08,952 INFO [FetcherRunner 1980278840-288] threadpool.DefaultFetcherRunner:96 : Job Fetcher: 0 should running, 2 actual running, 0 stopped, 2 ready, 2 already succeed, 0 error, 0 discarded, 1 others 2018-11-26 20:01:08,953 INFO [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] execution.ExecutableManager:435 : job id:fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb from READY to RUNNING 2018-11-26 20:01:08,953 DEBUG [pool-4-thread-1] cachesync.Broadcaster:113 : Servers in the cluster: [localhost:7070] 2018-11-26 20:01:08,953 DEBUG [pool-4-thread-1] cachesync.Broadcaster:123 : Announcing new broadcast to all: BroadcastEvent\{entity=execute_output, event=update, cacheKey=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb} 2018-11-26 20:01:08,953 ERROR [pool-5-thread-1] cachesync.Broadcaster:137 : Announce broadcast event failed, targetNode localhost:7070 broadcastEvent BroadcastEvent\{entity=execute_output, event=update, cacheKey=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb}, error msg: org.apache.http.conn.HttpHostConnectException: Connection to
[http://localhost:7070|http://localhost:7070/]
refused 2018-11-26 20:01:08,953 ERROR [pool-5-thread-1] cachesync.Broadcaster:330 : Announce broadcast event exceeds retry limit, abandon targetNode localhost:7070 broadcastEvent BroadcastEvent\{entity=execute_output, event=update, cacheKey=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb} 2018-11-26 20:01:08,954 INFO [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] execution.AbstractExecutable:148 : Executing AbstractExecutable (Filter Recommend Cuboid Data for Optimization) 2018-11-26 20:01:08,955 INFO [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] execution.ExecutableManager:435 : job id:fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-00 from READY to RUNNING 2018-11-26 20:01:09,009 INFO [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.MapReduceExecutable:128 : parameters of the MapReduceExecutable: -conf /var/jenkins/workspace/kylin-master-full-regression/kylin-it/../examples/test_case_data/sandbox/kylin_job_conf.xml -cubename ci_inner_join_cube -segmentid bd8b568c-16af-6813-aabe-aba8345ae4b1 -input hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-5d654bc7-7a92-6c86-2102-6ade864a77a5/ci_inner_join_cube/cuboid/* -output hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-ac05a6b3-b6de-6a60-bd2b-778e76b58998/ci_inner_join_cube/optimize/cuboid/ -jobname Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26 20:01:09,010 INFO [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] steps.FilterRecommendCuboidDataJob:66 : Starting: Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26 20:01:09,010 DEBUG [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:245 : No hive dependency jars set in the environment, will find them from classpath: 2018-11-26 20:01:09,043 INFO [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.MapReduceExecutable:128 : parameters of the MapReduceExecutable: -conf /var/jenkins/workspace/kylin-master-full-regression/kylin-it/../examples/test_case_data/sandbox/kylin_job_conf.xml -cubename ci_inner_join_cube -segmentid 443b2a1d-213a-7f99-c399-2ebe28539d86 -input hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-8f043b00-6cde-f794-ab02-8b57f58da1c4/ci_inner_join_cube/cuboid/* -output hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb/ci_inner_join_cube/optimize/cuboid/ -jobname Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26 20:01:09,045 INFO [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] steps.FilterRecommendCuboidDataJob:66 : Starting: Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26 20:01:09,045 DEBUG [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:245 : No hive dependency jars set in the environment, will find them from classpath: 2018-11-26 20:01:09,143 DEBUG [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:251 : hive-exec jar file: /root/.m2/repository/org/apache/hive/hive-exec/1.2.1/hive-exec-1.2.1.jar 2018-11-26 20:01:09,143 DEBUG [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:251 : hive-exec jar file: /root/.m2/repository/org/apache/hive/hive-exec/1.2.1/hive-exec-1.2.1.jar 2018-11-26 20:01:09,150 DEBUG [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:256 : hive-catalog jar file: /root/.m2/repository/org/apache/hive/hcatalog/hive-hcatalog-core/1.2.1/hive-hcatalog-core-1.2.1.jar 2018-11-26 20:01:09,150 DEBUG [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:256 : hive-catalog jar file: /root/.m2/repository/org/apache/hive/hcatalog/hive-hcatalog-core/1.2.1/hive-hcatalog-core-1.2.1.jar 2018-11-26 20:01:09,167 DEBUG [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:261 : hive-metastore jar file: /root/.m2/repository/org/apache/hive/hive-metastore/1.2.1/hive-metastore-1.2.1.jar 2018-11-26 20:01:09,167 DEBUG [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:273 : No Kafka dependency jar set in the environment, will find them from classpath: 2018-11-26 20:01:09,167 DEBUG [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:261 : hive-metastore jar file: /root/.m2/repository/org/apache/hive/hive-metastore/1.2.1/hive-metastore-1.2.1.jar 2018-11-26 20:01:09,168 DEBUG [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:273 : No Kafka dependency jar set in the environment, will find them from classpath: 2018-11-26 20:01:09,288 DEBUG [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:278 : kafka jar file: /root/.m2/repository/org/apache/kafka/kafka-clients/1.0.0/kafka-clients-1.0.0.jar 2018-11-26 20:01:09,289 DEBUG [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:278 : kafka jar file: /root/.m2/repository/org/apache/kafka/kafka-clients/1.0.0/kafka-clients-1.0.0.jar 2018-11-26 20:01:09,310 ERROR [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] steps.FilterRecommendCuboidDataJob:97 : error in CuboidJob java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126) at org.apache.hadoop.fs.Path.<init>(Path.java:134) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290) at org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-11-26 20:01:09,310 ERROR [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] steps.FilterRecommendCuboidDataJob:97 : error in CuboidJob java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126) at org.apache.hadoop.fs.Path.<init>(Path.java:134) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290) at org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) usage: FilterRecommendCuboidDataJob -cubename <cubename> Cube name. For exmaple, flat_item_cube -input <input> Input path -jobname <jobname> Job name. For example, Kylin_Cuboid_Builder-clsfd_v2_Step_22-D) -output <output> Output path -segmentid <segmentid> Cube segment id usage: FilterRecommendCuboidDataJob -cubename <cubename> Cube name. For exmaple, flat_item_cube -input <input> Input path -jobname <jobname> Job name. For example, Kylin_Cuboid_Builder-clsfd_v2_Step_22-D) -output <output> Output path -segmentid <segmentid> Cube segment id 2018-11-26 20:01:09,380 ERROR [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.MapReduceExecutable:138 : error execute MapReduceExecutable\{id=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-00, name=Filter Recommend Cuboid Data for Optimization, state=RUNNING} java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126) at org.apache.hadoop.fs.Path.<init>(Path.java:134) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290) at org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-11-26 20:01:09,380 ERROR [Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.MapReduceExecutable:138 : error execute MapReduceExecutable\{id=ac05a6b3-b6de-6a60-bd2b-778e76b58998-00, name=Filter Recommend Cuboid Data for Optimization, state=RUNNING} java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126) at org.apache.hadoop.fs.Path.<init>(Path.java:134) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290) at org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-11-26 20:01:09,385 INFO [Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] execution.ExecutableManager:435 : job id:fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-00 from RUNNING to ERROR
> Use Splitter for splitting String
> ---------------------------------
>
> Key: KYLIN-3559
> URL: https://issues.apache.org/jira/browse/KYLIN-3559
> Project: Kylin
> Issue Type: Task
> Reporter: Ted Yu
> Assignee: Wu Bin
> Priority: Major
> Fix For: v2.6.0
>
>
> See http://errorprone.info/bugpattern/StringSplitter for why Splitter is preferred .
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)