You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by na...@apache.org on 2009/05/04 20:11:41 UTC
svn commit: r771383 - in /hadoop/hive/branches/branch-0.3: CHANGES.txt
ql/src/java/org/apache/hadoop/hive/ql/exec/ExecReducer.java
Author: namit
Date: Mon May 4 18:11:41 2009
New Revision: 771383
URL: http://svn.apache.org/viewvc?rev=771383&view=rev
Log:
HIVE-440. Fixed bug in Reducer and Join to print out number of rows processed.
(Zheng Shao via namit)
Modified:
hadoop/hive/branches/branch-0.3/CHANGES.txt
hadoop/hive/branches/branch-0.3/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecReducer.java
Modified: hadoop/hive/branches/branch-0.3/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/hive/branches/branch-0.3/CHANGES.txt?rev=771383&r1=771382&r2=771383&view=diff
==============================================================================
--- hadoop/hive/branches/branch-0.3/CHANGES.txt (original)
+++ hadoop/hive/branches/branch-0.3/CHANGES.txt Mon May 4 18:11:41 2009
@@ -78,6 +78,9 @@
HIVE-440. Reducer and Join to print out number of rows processed.
(Namit Jain via zshao)
+ HIVE-440. Fixed bug in Reducer and Join to print out number of rows processed.
+ (Zheng Shao via namit)
+
OPTIMIZATIONS
BUG FIXES
Modified: hadoop/hive/branches/branch-0.3/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecReducer.java
URL: http://svn.apache.org/viewvc/hadoop/hive/branches/branch-0.3/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecReducer.java?rev=771383&r1=771382&r2=771383&view=diff
==============================================================================
--- hadoop/hive/branches/branch-0.3/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecReducer.java (original)
+++ hadoop/hive/branches/branch-0.3/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecReducer.java Mon May 4 18:11:41 2009
@@ -68,6 +68,8 @@
public void configure(JobConf job) {
jc = job;
+ cntr = 0;
+ nextCntr = 1;
mapredWork gWork = Utilities.getMapRedWork(job);
reducer = gWork.getReducer();
reducer.setMapredWork(gWork);
@@ -163,6 +165,7 @@
row.add(keyObject);
row.add(valueObject[tag]);
row.add(tag);
+ cntr++;
if (cntr == nextCntr) {
l4j.info("ExecReducer: processing " + cntr + " rows");
nextCntr = getNextCntr(cntr);