You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "Xiaoxiang Yu (Jira)" <ji...@apache.org> on 2020/02/21 12:17:00 UTC
[jira] [Created] (KYLIN-4384) Spark build failed in EMR when
KYLIN-4224 introduced
Xiaoxiang Yu created KYLIN-4384:
-----------------------------------
Summary: Spark build failed in EMR when KYLIN-4224 introduced
Key: KYLIN-4384
URL: https://issues.apache.org/jira/browse/KYLIN-4384
Project: Kylin
Issue Type: Bug
Components: Spark Engine
Environment: AWS EMR 5.28 with Glue support
Reporter: Xiaoxiang Yu
I built a package using the latest code of master branch to test the Kylin Glue integration.
I create a EMR cluster(5.28) with glue enabled. In my test, MR build engine works fine. But spark build engine failed at the first step, and I found the code change is introduced in https://issues.apache.org/jira/browse/KYLIN-4224.
The new added step change the way that how {color:#de350b}*intermediate table*{color} was created. And it is mandatory, so nobody can disable or skip it without rebuild the binary. It is not good in my side. Currently, I can not find the root cause. But I suggest we should add a config to make it easy to disable that feature.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)