You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by sunww <sp...@outlook.com> on 2014/07/04 10:12:18 UTC

mapjoin error

Hi    I'm using hive0.11 and hadoop2.2.  When I use a large table join on two empty tables , it convert to mapjoin automatic.But mr  failed, This is error log:Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.FileNotFoundException: /data/data5/yarn/local/usercache/etl/appcache/application_1403597071312_256708/container_1403597071312_256708_01_000011/Stage-5.tar.gz/MapJoin-mapfile02--.hashtable (No such file or directory)
And I find uploaded file is MapJoin-mapfile01--.hashtable, not MapJoin-mapfile02--.hashtable2014-07-04 03:16:28	Upload 1 File to: file:/tmp/etl/hive_2014-07-04_15-16-19_742_5670921476466011329/-local-10002/HashTable-Stage-5/MapJoin-mapfile01--.hashtable File size: 82Is I miss something?
sql and log is in http://paste2.org/U4zg9WPz
Thanks

Re: mapjoin error

Posted by Navis류승우 <na...@nexr.com>.

Looks like HIVE-6913(https://issues.apache.org/jira/browse/HIVE-6913) and
will be fixed in hive-0.14.0.

Thanks,
Navis


2014-07-04 17:12 GMT+09:00 sunww <sp...@outlook.com>:

> Hi
>     I'm using hive0.11 and hadoop2.2.  When I use a large table join on
> two empty tables , it convert to mapjoin automatic.But mr  failed, This is
> error log:
> Error: java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException:
> java.io.FileNotFoundException:
> /data/data5/yarn/local/usercache/etl/appcache/application_1403597071312_256708/container_1403597071312_256708_01_000011/Stage-5.tar.gz/MapJoin-mapfile02--.hashtable
> (No such file or directory)
>
> And I find uploaded file is MapJoin-mapfile01--.hashtable, not
> MapJoin-mapfile02--.hashtable
> 2014-07-04 03:16:28 Upload 1 File to:
> file:/tmp/etl/hive_2014-07-04_15-16-19_742_5670921476466011329/-local-10002/HashTable-Stage-5/MapJoin-mapfile01--.hashtable
> File size: 82
> Is I miss something?
>
> sql and log is in http://paste2.org/U4zg9WPz
>
> Thanks
>