You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by wd <wd...@wdicc.com> on 2010/02/09 04:05:35 UTC
hive map reduce output
hi,
I've use hive map reduce to process some log files. I found out that hive
will output like "num1 rows loaded to table_name" message every run. But the
"num1" not equal to "select count(1) from table_name" execute result.
I think this should be a bug. If we can not count the right num, why we
output that message?
Re: hive map reduce output
Posted by wd <wd...@wdicc.com>.
Sorry about this mail, I think I should try it use current version. I will
do it later.
2010/2/9 Jeff Hammerbacher <ha...@cloudera.com>
> Hey wd,
>
> Actually, what version are you running? Your bug sounds an awful lot like
> http://issues.apache.org/jira/browse/HIVE-327, which was fixed many moons
> ago.
>
> Thanks,
> Jeff
>
>
> On Mon, Feb 8, 2010 at 11:25 PM, Carl Steinbach <ca...@cloudera.com> wrote:
>
>> Hi wd,
>>
>> Please file a JIRA ticket for this issue.
>>
>> Thanks.
>>
>> Carl
>>
>>
>> On Mon, Feb 8, 2010 at 7:05 PM, wd <wd...@wdicc.com> wrote:
>>
>>> hi,
>>>
>>> I've use hive map reduce to process some log files. I found out that hive
>>> will output like "num1 rows loaded to table_name" message every run. But the
>>> "num1" not equal to "select count(1) from table_name" execute result.
>>>
>>> I think this should be a bug. If we can not count the right num, why we
>>> output that message?
>>>
>>
>>
>
Re: hive map reduce output
Posted by wd <wd...@wdicc.com>.
sorry , I forget report my environment.
Hadoop 0.19.1
hive 0.4.0
2010/2/9 Zheng Shao <zs...@gmail.com>
> Another possible reason is that we found sometimes hadoop framework
> does not return the correct count to the clients.
> In all these cases, the count is smaller than the number of rows
> actually loaded.
>
> which version of hadoop are you using?
>
> Zheng
>
> On Mon, Feb 8, 2010 at 11:27 PM, Jeff Hammerbacher <ha...@cloudera.com>
> wrote:
> > Hey wd,
> >
> > Actually, what version are you running? Your bug sounds an awful lot like
> > http://issues.apache.org/jira/browse/HIVE-327, which was fixed many
> moons
> > ago.
> >
> > Thanks,
> > Jeff
> >
> > On Mon, Feb 8, 2010 at 11:25 PM, Carl Steinbach <ca...@cloudera.com>
> wrote:
> >>
> >> Hi wd,
> >>
> >> Please file a JIRA ticket for this issue.
> >>
> >> Thanks.
> >>
> >> Carl
> >>
> >> On Mon, Feb 8, 2010 at 7:05 PM, wd <wd...@wdicc.com> wrote:
> >>>
> >>> hi,
> >>>
> >>> I've use hive map reduce to process some log files. I found out that
> hive
> >>> will output like "num1 rows loaded to table_name" message every run.
> But the
> >>> "num1" not equal to "select count(1) from table_name" execute result.
> >>>
> >>> I think this should be a bug. If we can not count the right num, why we
> >>> output that message?
> >>
> >
> >
>
>
>
> --
> Yours,
> Zheng
>
Re: hive map reduce output
Posted by Zheng Shao <zs...@gmail.com>.
Another possible reason is that we found sometimes hadoop framework
does not return the correct count to the clients.
In all these cases, the count is smaller than the number of rows
actually loaded.
which version of hadoop are you using?
Zheng
On Mon, Feb 8, 2010 at 11:27 PM, Jeff Hammerbacher <ha...@cloudera.com> wrote:
> Hey wd,
>
> Actually, what version are you running? Your bug sounds an awful lot like
> http://issues.apache.org/jira/browse/HIVE-327, which was fixed many moons
> ago.
>
> Thanks,
> Jeff
>
> On Mon, Feb 8, 2010 at 11:25 PM, Carl Steinbach <ca...@cloudera.com> wrote:
>>
>> Hi wd,
>>
>> Please file a JIRA ticket for this issue.
>>
>> Thanks.
>>
>> Carl
>>
>> On Mon, Feb 8, 2010 at 7:05 PM, wd <wd...@wdicc.com> wrote:
>>>
>>> hi,
>>>
>>> I've use hive map reduce to process some log files. I found out that hive
>>> will output like "num1 rows loaded to table_name" message every run. But the
>>> "num1" not equal to "select count(1) from table_name" execute result.
>>>
>>> I think this should be a bug. If we can not count the right num, why we
>>> output that message?
>>
>
>
--
Yours,
Zheng
Re: hive map reduce output
Posted by Jeff Hammerbacher <ha...@cloudera.com>.
Hey wd,
Actually, what version are you running? Your bug sounds an awful lot like
http://issues.apache.org/jira/browse/HIVE-327, which was fixed many moons
ago.
Thanks,
Jeff
On Mon, Feb 8, 2010 at 11:25 PM, Carl Steinbach <ca...@cloudera.com> wrote:
> Hi wd,
>
> Please file a JIRA ticket for this issue.
>
> Thanks.
>
> Carl
>
>
> On Mon, Feb 8, 2010 at 7:05 PM, wd <wd...@wdicc.com> wrote:
>
>> hi,
>>
>> I've use hive map reduce to process some log files. I found out that hive
>> will output like "num1 rows loaded to table_name" message every run. But the
>> "num1" not equal to "select count(1) from table_name" execute result.
>>
>> I think this should be a bug. If we can not count the right num, why we
>> output that message?
>>
>
>
Re: hive map reduce output
Posted by Carl Steinbach <ca...@cloudera.com>.
Hi wd,
Please file a JIRA ticket for this issue.
Thanks.
Carl
On Mon, Feb 8, 2010 at 7:05 PM, wd <wd...@wdicc.com> wrote:
> hi,
>
> I've use hive map reduce to process some log files. I found out that hive
> will output like "num1 rows loaded to table_name" message every run. But the
> "num1" not equal to "select count(1) from table_name" execute result.
>
> I think this should be a bug. If we can not count the right num, why we
> output that message?
>