Empty Table in MR with "union all" (created in Tez)

[Gufran Mohammed Pathan <Gu...@mu-sigma.com>]

Hi,

I'm unable to retrieve rows from a table created in Tez when using MR as execution engine. This happens only when the create table statement has "union all".

Here's a way to reproduce the issue:

set hive.execution.engine=tez;

create table test_table as
select "1" from table1
union all
select "1" from table2 ;

select * from test_table;  --gives correct roles

set hive.execution.engine=mr;

select * from test_table;  --gives empty table

Any ideas on why this must be happening? This issue does not occur when I don't use a "union all" query.

I'm using HDP 2.2 with Hive 0.14 and Tez 0.4.0.2.

Thanks,
Gufran Pathan| +91 7760913355| www.mu-sigma.com<http://www.mu-sigma.com/> |

Correlation does not imply causation, but it does waggle its eyebrows suggestively and gesture furtively while mouthing "look over there." -Randall Munroe

Disclaimer: http://www.mu-sigma.com/disclaimer.html

RE: Empty Table in MR with "union all" (created in Tez)

[Gufran Mohammed Pathan <Gu...@mu-sigma.com>]

Hi Gopal,

My mapreduce.input.fileinputformat.input.dir.recursive was set to false. Setting it to true fixed it.

Thanks a lot!

Gufran Pathan| +91 7760913355| www.mu-sigma.com |

Correlation does not imply causation, but it does waggle its eyebrows suggestively and gesture furtively while mouthing "look over there." -Randall Munroe

-----Original Message-----
From: Gopal Vijayaraghavan [mailto:gopal@hortonworks.com] On Behalf Of Gopal Vijayaraghavan
Sent: Thursday, June 11, 2015 11:53 AM
To: user@hive.apache.org
Subject: Re: Empty Table in MR with "union all" (created in Tez)



> set hive.execution.engine=mr;

> select * from test_table;  --gives empty table

> Any ideas on why this must be happening? This issue does not occur
>when I don¹t use a ³union all² query.


What is the value of the parameter
mapreduce.input.fileinputformat.input.dir.recursive in your mapred-site.xml?

Cheers,
Gopal


Disclaimer: http://www.mu-sigma.com/disclaimer.html

Re: Empty Table in MR with "union all" (created in Tez)

[Gopal Vijayaraghavan <go...@apache.org>]

 
> set hive.execution.engine=mr;
 
> select * from test_table;  --gives empty table
 
> Any ideas on why this must be happening? This issue does not occur when
>I don¹t use a ³union all² query.
 

What is the value of the parameter
mapreduce.input.fileinputformat.input.dir.recursive in your
mapred-site.xml?

Cheers,
Gopal

Re: Empty Table in MR with "union all" (created in Tez)

[Vaibhav Gumashta <vg...@hortonworks.com>]

Might be related to: https://issues.apache.org/jira/browse/HIVE-10929

Thanks,
-Vaibhav

From: Gufran Mohammed Pathan <Gu...@mu-sigma.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Date: Wednesday, June 10, 2015 at 10:18 AM
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Subject: Empty Table in MR with "union all" (created in Tez)

Hi,

I'm unable to retrieve rows from a table created in Tez when using MR as execution engine. This happens only when the create table statement has "union all".

Here's a way to reproduce the issue:

set hive.execution.engine=tez;

create table test_table as
select "1" from table1
union all
select "1" from table2 ;

select * from test_table;  --gives correct roles

set hive.execution.engine=mr;

select * from test_table;  --gives empty table

Any ideas on why this must be happening? This issue does not occur when I don't use a "union all" query.

I'm using HDP 2.2 with Hive 0.14 and Tez 0.4.0.2.

Thanks,
Gufran Pathan| +91 7760913355|www.mu-sigma.com<http://www.mu-sigma.com/>|

Correlation does not imply causation, but it does waggle its eyebrows suggestively and gesture furtively while mouthing "look over there." -Randall Munroe

Disclaimer: http://www.mu-sigma.com/disclaimer.html