Re: Kylin 3.1.3 issue

[ShaoFeng Shi <sh...@apache.org>]

Looks like the Hadoop job tries to create a folder in local disk, instead
of on HDFS. You may need to check whether the Hadoop configurations are
properly sync on all the machines (includes the Kylin machine)

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC,
Apache Incubator PMC,
Email: shaofengshi@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org




<su...@cordis.us> 于2023年3月1日周三 17:52写道：

> Hi
>   iam trying to build cubes in kylin 3.1.3
> showing error like
>
>
>
> 23/02/28 20:54:49 WARN mapred.LocalJobRunner: job_local994537991_0001
> java.lang.Exception: java.io.IOException: Mkdirs failed to create
> file:/kylin1/mysql_latest/kylin-0599f784-bebc-b1a2-97a1-6fe97f693cfd/kylin_intermediate_transaction_info_cube_c38c233d_836d_1e7e_bfe4_657f520cfbff/_temporary/0/_temporary/attempt_local994537991_0001_m_000000_0
>
> (exists=false,
> cwd=file:/usr/local/softwares/apache-kylin-3.1.3-bin-hbase1x/bin)
>          at
>
> org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
>          at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
> Caused by: java.io.IOException: Mkdirs failed to create
> file:/kylin1/mysql_latest/kylin-0599f784-bebc-b1a2-97a1-6fe97f693cfd/kylin_intermediate_transaction_info_cube_c38c233d_836d_1e7e_bfe4_657f520cfbff/_temporary/0/_temporary/attempt_local994537991_0001_m_000000_0
>
> (exists=false,
> cwd=file:/usr/local/softwares/apache-kylin-3.1.3-bin-hbase1x/bin)
>          at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:449)
>          at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:435)
>          at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:909)
>          at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:890)
>          at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:787)
>          at
>
> org.apache.sqoop.mapreduce.RawKeyTextOutputFormat.getRecordWriter(RawKeyTextOutputFormat.java:98)
>          at
>
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:647)
>          at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:767)
>          at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>
> what could be the issue ?
>
>
> Thank you
>
> Best Regards
> sushma goravar
>