You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Wang Cheng (JIRA)" <ji...@apache.org> on 2017/12/05 05:48:00 UTC

[jira] [Created] (KYLIN-3084) File not found Exception when processing union-all view in TEZ mode

Wang Cheng created KYLIN-3084:
---------------------------------

             Summary: File not found Exception when processing union-all view in TEZ mode
                 Key: KYLIN-3084
                 URL: https://issues.apache.org/jira/browse/KYLIN-3084
             Project: Kylin
          Issue Type: Bug
            Reporter: Wang Cheng
            Priority: Minor


If hive.execution.engine=TEZ and hql contains union all, it causes exception like: file not found when materializing the view or redistributing flat hive table.

Here is the reason:
http://grokbase.com/t/hive/user/162r80a2g9/anyway-to-avoid-creating-subdirectories-by-insert-with-union

i.e. "The Tez execution of UNION is entirely parallel &
the task-ids overlaps - so the files created have to have unique names.

But the total counts for "Map 1" and "Map 2" are only available as the job
runs, so they write to different dirs."


 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)