You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by su...@cordis.us on 2023/02/28 18:31:34 UTC

Kylin 3.1.3 issue

Hi
  iam trying to build cubes in kylin 3.1.3
showing error like



23/02/28 20:54:49 WARN mapred.LocalJobRunner: job_local994537991_0001
java.lang.Exception: java.io.IOException: Mkdirs failed to create 
file:/kylin1/mysql_latest/kylin-0599f784-bebc-b1a2-97a1-6fe97f693cfd/kylin_intermediate_transaction_info_cube_c38c233d_836d_1e7e_bfe4_657f520cfbff/_temporary/0/_temporary/attempt_local994537991_0001_m_000000_0 
(exists=false, 
cwd=file:/usr/local/softwares/apache-kylin-3.1.3-bin-hbase1x/bin)
         at 
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
         at 
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.io.IOException: Mkdirs failed to create 
file:/kylin1/mysql_latest/kylin-0599f784-bebc-b1a2-97a1-6fe97f693cfd/kylin_intermediate_transaction_info_cube_c38c233d_836d_1e7e_bfe4_657f520cfbff/_temporary/0/_temporary/attempt_local994537991_0001_m_000000_0 
(exists=false, 
cwd=file:/usr/local/softwares/apache-kylin-3.1.3-bin-hbase1x/bin)
         at 
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:449)
         at 
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:435)
         at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:909)
         at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:890)
         at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:787)
         at 
org.apache.sqoop.mapreduce.RawKeyTextOutputFormat.getRecordWriter(RawKeyTextOutputFormat.java:98)
         at 
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:647)
         at 
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:767)
         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)

what could be the issue ?


Thank you

Best Regards
sushma goravar

Re: Kylin 3.1.3 issue

Posted by ShaoFeng Shi <sh...@apache.org>.
Looks like the Hadoop job tries to create a folder in local disk, instead
of on HDFS. You may need to check whether the Hadoop configurations are
properly sync on all the machines (includes the Kylin machine)

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC,
Apache Incubator PMC,
Email: shaofengshi@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org




<su...@cordis.us> 于2023年3月1日周三 17:52写道：

> Hi
>   iam trying to build cubes in kylin 3.1.3
> showing error like
>
>
>
> 23/02/28 20:54:49 WARN mapred.LocalJobRunner: job_local994537991_0001
> java.lang.Exception: java.io.IOException: Mkdirs failed to create
> file:/kylin1/mysql_latest/kylin-0599f784-bebc-b1a2-97a1-6fe97f693cfd/kylin_intermediate_transaction_info_cube_c38c233d_836d_1e7e_bfe4_657f520cfbff/_temporary/0/_temporary/attempt_local994537991_0001_m_000000_0
>
> (exists=false,
> cwd=file:/usr/local/softwares/apache-kylin-3.1.3-bin-hbase1x/bin)
>          at
>
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
>          at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.io.IOException: Mkdirs failed to create
> file:/kylin1/mysql_latest/kylin-0599f784-bebc-b1a2-97a1-6fe97f693cfd/kylin_intermediate_transaction_info_cube_c38c233d_836d_1e7e_bfe4_657f520cfbff/_temporary/0/_temporary/attempt_local994537991_0001_m_000000_0
>
> (exists=false,
> cwd=file:/usr/local/softwares/apache-kylin-3.1.3-bin-hbase1x/bin)
>          at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:449)
>          at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:435)
>          at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:909)
>          at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:890)
>          at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:787)
>          at
>
> org.apache.sqoop.mapreduce.RawKeyTextOutputFormat.getRecordWriter(RawKeyTextOutputFormat.java:98)
>          at
>
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:647)
>          at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:767)
>          at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>
> what could be the issue ?
>
>
> Thank you
>
> Best Regards
> sushma goravar
>