You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Wang Cheng (JIRA)" <ji...@apache.org> on 2017/12/05 05:48:00 UTC
[jira] [Created] (KYLIN-3084) File not found Exception when
processing union-all view in TEZ mode
Wang Cheng created KYLIN-3084:
---------------------------------
Summary: File not found Exception when processing union-all view in TEZ mode
Key: KYLIN-3084
URL: https://issues.apache.org/jira/browse/KYLIN-3084
Project: Kylin
Issue Type: Bug
Reporter: Wang Cheng
Priority: Minor
If hive.execution.engine=TEZ and hql contains union all, it causes exception like: file not found when materializing the view or redistributing flat hive table.
Here is the reason:
http://grokbase.com/t/hive/user/162r80a2g9/anyway-to-avoid-creating-subdirectories-by-insert-with-union
i.e. "The Tez execution of UNION is entirely parallel &
the task-ids overlaps - so the files created have to have unique names.
But the total counts for "Map 1" and "Map 2" are only available as the job
runs, so they write to different dirs."
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)