You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by dd...@apache.org on 2008/03/20 10:46:24 UTC
svn commit: r639227 - in /hadoop/core/branches/branch-0.16: CHANGES.txt
docs/mapred_tutorial.html docs/mapred_tutorial.pdf
src/docs/src/documentation/content/xdocs/mapred_tutorial.xml
src/java/org/apache/hadoop/mapred/JobConf.java
Author: ddas
Date: Thu Mar 20 02:46:23 2008
New Revision: 639227
URL: http://svn.apache.org/viewvc?rev=639227&view=rev
Log:
HADOOP-3042. Updates the Javadoc in JobConf.getOutputPath to reflect the actual temporary path. Contributed by Amareshwari Sriramadasu.
Modified:
hadoop/core/branches/branch-0.16/CHANGES.txt
hadoop/core/branches/branch-0.16/docs/mapred_tutorial.html
hadoop/core/branches/branch-0.16/docs/mapred_tutorial.pdf
hadoop/core/branches/branch-0.16/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml
hadoop/core/branches/branch-0.16/src/java/org/apache/hadoop/mapred/JobConf.java
Modified: hadoop/core/branches/branch-0.16/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.16/CHANGES.txt?rev=639227&r1=639226&r2=639227&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.16/CHANGES.txt (original)
+++ hadoop/core/branches/branch-0.16/CHANGES.txt Thu Mar 20 02:46:23 2008
@@ -21,6 +21,9 @@
HADOOP-3003. FileSystem cache key is updated after a
FileSystem object is created. (Tsz Wo (Nicholas), SZE via dhruba)
+ HADOOP-3042. Updates the Javadoc in JobConf.getOutputPath to reflect
+ the actual temporary path. (Amareshwari Sriramadasu via ddas)
+
Release 0.16.1 - 2008-03-13
INCOMPATIBLE CHANGES
Modified: hadoop/core/branches/branch-0.16/docs/mapred_tutorial.html
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.16/docs/mapred_tutorial.html?rev=639227&r1=639226&r2=639227&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.16/docs/mapred_tutorial.html (original)
+++ hadoop/core/branches/branch-0.16/docs/mapred_tutorial.html Thu Mar 20 02:46:23 2008
@@ -1720,10 +1720,11 @@
(using the taskid, say <span class="codefrag">task_200709221812_0001_m_000000_0</span>),
not just per task.</p>
<p>To avoid these issues the Map-Reduce framework maintains a special
- <span class="codefrag">${mapred.output.dir}/_${taskid}</span> sub-directory for each
- task-attempt on the <span class="codefrag">FileSystem</span> where the output of the
- task-attempt is stored. On successful completion of the task-attempt,
- the files in the <span class="codefrag">${mapred.output.dir}/_${taskid}</span> (only)
+ <span class="codefrag">${mapred.output.dir}/_temporary/_${taskid}</span> sub-directory
+ for each task-attempt on the <span class="codefrag">FileSystem</span> where the output
+ of the task-attempt is stored. On successful completion of the
+ task-attempt, the files in the
+ <span class="codefrag">${mapred.output.dir}/_temporary/_${taskid}</span> (only)
are <em>promoted</em> to <span class="codefrag">${mapred.output.dir}</span>. Of course,
the framework discards the sub-directory of unsuccessful task-attempts.
This process is completely transparent to the application.</p>
Modified: hadoop/core/branches/branch-0.16/docs/mapred_tutorial.pdf
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.16/docs/mapred_tutorial.pdf?rev=639227&r1=639226&r2=639227&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.16/docs/mapred_tutorial.pdf (original)
+++ hadoop/core/branches/branch-0.16/docs/mapred_tutorial.pdf Thu Mar 20 02:46:23 2008
@@ -1371,10 +1371,10 @@
>>
endobj
160 0 obj
-<< /Length 2550 /Filter [ /ASCII85Decode /FlateDecode ]
+<< /Length 2551 /Filter [ /ASCII85Decode /FlateDecode ]
>>
stream
-Gat=->Ar:T(4Q"]cpJlp+JpTF\h+[*[+Q]nJYLu=Mg\\\%$&8o@A8ku9!W4HrU5)T5LbM[3!n#:RQ4H@o:>?s5M]VY^Us>cjZ3YAp[K`1KK;C1^jioPrd<aQ...@fQVC1PV>n,Tpu0Qu#liW$ZPsHf.]]#o%4I<0?0Go88:f2=7<3dT\h7pN5+m_FZ:j#h?ckMPV7&6nT,[F8h^JEoE"k@9$;puZSmVDM@]c(EO]Af-:obt_WQ\n2$)[[m](CW"DJ?.UD_8-$i/.A2QX_?)`+,\;n#n2^;W9@:h*XJ=cPXcXSimE370*BN!C3WB;c1_[X!G?6`,T2-[E*(lh"=t4[?4sU[E,hs"glUD%U:$$>R?CmV"OZ2d3;Rj,':E7S<_6J@6e15@U/M!^/h5Casn+Ch%;RG*(;BghAntgb7#8k[E,B]:-;#uKh%^d-l1.MKLY8WVY`3=U#>@eTpuDD-/pEj9-4=&og,`nYVpO-Q_J@OqWq&VM2"fc=Y"ObEMZQYZY3Ys^GTt^kusl&.W4OQ[`e(29c;Gm?qS)?^3P+/,Aje"O8M?lbrNYC9XqOLk,1]q#1FU/ln(8
j4uubObXoT1R,qUXSK-P[iQ_!=F!unCd!9XqpRH:9ed#h/E0Cpqq_,qV?'4Tt6.Wen)>LlkRFa#MFe3!T3nZplDt,Qb*tV*l[L2%F/T0"R!To?l38maqWD)O"2OaN?[eI-04UnDMR=XLJ;5KSej8i^c\Wl?);m5fFku1.L-%qOWV&?F3$17gb6rEC^0Qt;EE.*m@U!s#M9g9G_Z,preNu3ep?%t/PQ^\L8b[/3kL'jT'Je@!dgVWaJX=VUrkc@/WFV0Hq\;Oe7B3^V&*t8F:9F#>kAiat)NVUo3.`WJ-r`).keIp6C;+9'WIr'*r80V@'.#$+"H?!?F?#m7e$<JD...@4>ebW1AVoFbIfl37K6?bY5_=o4G%94O57".8rHtEjan5?mS'5CR$_1=uX+T+]L;b(U*A7AYoB(B&7rpF(MTaF*79'Y/ukPXt>oK+?J_\.4oPI8_?B,p3$TT1rJ+9.Is`D]QlF<*PRbE7;E[Gm!\ZKO/P`(m(;^5]HQ\WC^tclE#:-F%#Vj)FTDViY"PLch#2#okkU244>Je,<3d+;RnFW/.F-=l2e=K*9[M(TqrIX'LMj$X\6H[$^:AnU%k?<1cZ#D_AYC9H7-07H&q&TUqpscHdOoe(d;;\)<%J/ISPL;dlmcVC)F[L7=cje,Bg.0#f;h?tI`;7WZm#uQen+pa<EP-on_Y*d#itN;pq]9h%s,[,/+uNDPWHq_=JY)BDd7H4B@ppNXmR6V"Q6
%CC$TC[hH%SRT]JJh(tkuhEghe;/cj0"G`COIGMje*T;np!g,3:1*K3F$jWBFJJin8<+!EFhVm4rgD@GrXI_,l-j=ctYI+KS#_GN$!mc(JGD(GcCP'Wlo/tM(miLro+mZr.%&k$;=nf@5=Pa3N,C%(Dif8FY[)AH#Fm$V[SC`c^1k@?*E<PAL_PF9j6rSi2X&s]F7\I4o!UIm2>ZO>G'T"dkcq'%c\c-^EEdHLK+FY3X/f=+'o8+e8bVu.`tQGWfu6M?<Wc]*)S[mdkNLat*(mFL67c0;rMXDM\f##5i/K3cW]PMHA2L7QVOMYl^L]!)*VHYZO<n`OCfQgc0D^u\tK43A,%@1RQKRmaEUW!b<n4XXt+!(T(cJe0'^AT9C!ZUg"KCrO;09X84E:9X,T]$U';KE`,O%.HVm#94O;8snMqeUGFUGL_bAP:.F+pjK[/S?07EMSc1l>*4Vpgc$i/?mQ5/-fP]#44:;&=f]HFgS)K_4%J4Ao2GP@_"h]SU?s%O/B<5)T0F.hqFPAmjo^R;FM.RC`;6O@rh6Z(Tk>3TqQ]olc'Z'A"-^E$JH~>
+Gau0ED/\2f')q<+Tb%+[!&731H9E5XBQHb&!f-K44nM*i0Xqa>Q\ea@.*:nOk^U@@?<0Fq,d.TG%4A3C)9rY'Sp?(f_rg+[k2tEXlg3U!j%W2RFb1`dIm)\:^@O?0D@em53np-Rhu)u<!"/ngL?oWVe0>QOrVhH<\."sFFuQdnU@@J0SYR?hJ9oN'kkoU.M5,G#$<fU%4-cM?LYG_VLPIhKSK].?f*?Qn^Wtsh==l_?2QXhF-#jdSMgYTuT2/H=O(V&a;DMdLP%7hl8!t`F@`E@1atcnPW)\u;4_n%j4[+3n=Z0S,`"Q0LN1Wb.Hl]DZ>^^Al8*r!VS9T[73J=Y(3q1"oW4q,F)S@\<*8IDhq0p-l,GW\rj,H[$<heCf`$o,I5t8[8CdL[&`n\XHO-EQ:nS%oST1?Ju".Y&jYgknL6+5hXo&EAAeLQZDg!J-6cp@=/`EkYA.^_T@TqJ?aC2fE>M#Bu2GFrF"i7ut!fTt\eU]!:^Q.PM\e-HcM;C5"H01FTUI1d"_J+pu\PZjr[B^2n&8ZMETpQ&pq$SD#8rpdTb]&!:*/``SPZh7ADp'u2dUb;9Gq,F!m99C4V!piEnXI]1b]=sNca<P]KCo,aKZ6*FG4s-S,Wo#F^k^'^9+.#/?[&Xpp%5qe1nT-l5W?<7_\8%0p<n4?=5`lc$16Vo>?>8!FKm*sF,!4?*qp="(W6"r[WJC.15^$Zc%/`GQQ3A'S4O5B;Z?;DC3#8nq='#$(O)R@19?ofm$R#N.V/%5Vb=M%q2;f2%iI,Wd,o8N1&m8+4,snM&pp<lC-C&2KP/SXW2#1B_i`)t?&"<[(!n[Z$3F<tYC<I%=;eqLs-#@dcl3b#@V1(K6oKJ8S_V\VQW=shu6@?a]l&u,FhTMa)`;]/"W#L[Q>NBIliMk@X7?/Ej.[>4A;Ut>B"$;mqH0UeI)E_$q)Os\p3"Kh^f;>eh?g:0$D>>E+QV"Ll>f+d_n`i]&Id*/@Ft5V
G4utVB$9%Cd[W"sW*Za/2iQh6gk"l]dU%@VumYGO0XS34ARm@@drMO-%Y/kft0C,7b#lJ/!kH0<.ee1YccYFa#[s/kT2[F`V#Vn'_ZHX,2.'m[HLf<E6182%N-J_\jEq*<Me"D)P)/.;C=ZZ6^gV!SaWa*\g^3\tamJ/16r>HGEcD_],6aXl7^S7[5#&$,-#baH(UsSA0IF4+4ArS_jbY3sa_gpc%kY[O`#UO(1iW<uY%'n=SrH<i2mTcQa4Wdt*BWj$4&I>j0bh.kQde0Aa5pXprg/:!LR*P7&"YQ8q`u>!W<Lumm"LK[YOYu\OCTSV/81-GjTl`/a*#Njs9[#c\/B%.iMt'K.c994TR3Qg<(@KT0D1iZ+oVL28X][?)SMfr!P;okm]Sa??;DT&p&tdJq4qBsmH:-PEQs5*/-mntnUkK'r\mAAg('Fjp*JXQ=ib)Yik?0V@68<L%&MN(;;(aWi?.%`;=Y&gT(`6+6X:(]EX@3pr)Mcc4B\4mt=_'/=/uT:s.4q5<<Yc;#B>mnRjLeEM+>f?FQ"0TQb)SS2!In[4/G*`r:t#Glb7V;$eEm,nXj,0p'GA]t<V<&4J^X+gQpm^W$Z)dg4NiFG>nXsBB'F`92et:g3@EZ_VEU8c2WJ+O-,;i_Pr-ik=02$\aQPU.Q'I)hqGWf%_Qig"`@gf5rgdni-O6/G.`Xf]f0rUjpgo&]LA'cN`Fnmb6_qdnUNlII"tG!M4c@lB0S;go`qLlU(YEq59m@0'WnP[_CVKQr@?:WC>$!rhG?khUjW7_A7IDtkH]bGhV3HsE_P]0?kaS=VDou$11VmYbg]cU0>BDs8gMQ`&E9A.rgoE,aU>aI9@EsY$&sXiU&+DsPn(S"%VX&g[S??(:Tjf3bCi//g>#m@%eKBa>aGP@09CpEe;5Y2CIJmjdMe9n9aBD;'TF+U0f`(bW%=u#*&jMaSl+W4[S@WYP:8NuV4qstZc!)QgaTZi?_,bnB4TO
t;U9Jc''Mg5g^XmKZC5cte?1Qb_?Q9-7$h,(H,O`E8^cth!CUJ"ed<EqQjWa_4'EZ5/JU`?sqP%K.cJ08\iP$04>4NK#n,0"J^kJn"+Pcgu@(/!%5YLAX7<7Wq%W<CL"DNpgG:GmX#!1W_T0R*>dQ;M*[s48gGG%5&A]dbY-"T0I_Cd0NDU%_]kap"a<qE6R4-?I8e];!_Un:V4<M!L<`c1rP3m/nU\L\4HX[Rm0&%AtE*?Wi>SK-.C`16CVYY#BaKF4hgjLB,q+ahD\#sk(9Odi>f?gH0H_CV"PSJX=[Qk$PJ6UnL)m+grLL/^:j*n"?e\,1NA$4ia>F^;jO*.dFlg1r-)@(Y6e$*=h#6W#4?2L:skR0+GnU'O)9I$_gCjGtK:MUI<9D4>(b/3MhH1j,M408b&ig@t)(@0R\U2+j6Sn7jo?NB:oGm#`^_c1n,"hE8"(L<'ahp1Ql=(4*];#QZ/Yi&d&+0"D)O.Sj78&+'c?7dWA@59$fM=+oU6Imi$sHs[BVe6RPVG4i2gkfsEH8*P!hHPYq-cFSpWm0[,d44@!mpG,+srWi:b@Sm~>
endstream
endobj
161 0 obj
@@ -2638,53 +2638,53 @@
xref
0 295
0000000000 65535 f
-0000105314 00000 n
-0000105579 00000 n
-0000105672 00000 n
+0000105315 00000 n
+0000105580 00000 n
+0000105673 00000 n
0000000015 00000 n
0000000071 00000 n
0000001296 00000 n
0000001416 00000 n
0000001574 00000 n
-0000105824 00000 n
+0000105825 00000 n
0000001709 00000 n
-0000105887 00000 n
+0000105888 00000 n
0000001846 00000 n
-0000105953 00000 n
+0000105954 00000 n
0000001983 00000 n
-0000106019 00000 n
+0000106020 00000 n
0000002120 00000 n
-0000106083 00000 n
+0000106084 00000 n
0000002256 00000 n
-0000106149 00000 n
+0000106150 00000 n
0000002393 00000 n
-0000106215 00000 n
+0000106216 00000 n
0000002530 00000 n
-0000106279 00000 n
+0000106280 00000 n
0000002666 00000 n
-0000106343 00000 n
+0000106344 00000 n
0000002803 00000 n
-0000106407 00000 n
+0000106408 00000 n
0000002940 00000 n
-0000106471 00000 n
+0000106472 00000 n
0000003075 00000 n
-0000106538 00000 n
+0000106539 00000 n
0000003212 00000 n
-0000106603 00000 n
+0000106604 00000 n
0000003349 00000 n
-0000106668 00000 n
+0000106669 00000 n
0000003484 00000 n
-0000106735 00000 n
+0000106736 00000 n
0000003621 00000 n
-0000106802 00000 n
+0000106803 00000 n
0000003758 00000 n
-0000106869 00000 n
+0000106870 00000 n
0000003894 00000 n
-0000106936 00000 n
+0000106937 00000 n
0000004031 00000 n
-0000107001 00000 n
+0000107002 00000 n
0000004168 00000 n
-0000107067 00000 n
+0000107068 00000 n
0000004305 00000 n
0000006936 00000 n
0000007059 00000 n
@@ -2774,7 +2774,7 @@
0000050787 00000 n
0000050913 00000 n
0000050982 00000 n
-0000107132 00000 n
+0000107133 00000 n
0000051118 00000 n
0000051409 00000 n
0000051695 00000 n
@@ -2798,140 +2798,140 @@
0000060035 00000 n
0000060232 00000 n
0000060430 00000 n
-0000063074 00000 n
-0000063200 00000 n
-0000063253 00000 n
-0000063460 00000 n
-0000063658 00000 n
-0000063886 00000 n
-0000064091 00000 n
-0000066707 00000 n
-0000066833 00000 n
-0000066894 00000 n
-0000067147 00000 n
-0000067337 00000 n
-0000067542 00000 n
-0000067789 00000 n
-0000067990 00000 n
-0000070724 00000 n
-0000070850 00000 n
-0000071015 00000 n
-0000071226 00000 n
-0000071434 00000 n
-0000071609 00000 n
-0000071804 00000 n
-0000071978 00000 n
-0000072154 00000 n
-0000072377 00000 n
-0000072618 00000 n
-0000072814 00000 n
-0000073027 00000 n
-0000073244 00000 n
-0000073463 00000 n
-0000073735 00000 n
-0000074000 00000 n
-0000074280 00000 n
-0000074493 00000 n
-0000074818 00000 n
-0000075140 00000 n
-0000077664 00000 n
-0000077790 00000 n
-0000077827 00000 n
-0000078009 00000 n
-0000078203 00000 n
-0000080532 00000 n
-0000080642 00000 n
-0000083064 00000 n
-0000083174 00000 n
-0000085505 00000 n
-0000085615 00000 n
-0000087925 00000 n
-0000088035 00000 n
-0000090246 00000 n
-0000090356 00000 n
-0000092080 00000 n
-0000092190 00000 n
-0000093440 00000 n
-0000093550 00000 n
-0000095115 00000 n
-0000107192 00000 n
-0000095225 00000 n
-0000095361 00000 n
-0000095554 00000 n
-0000095712 00000 n
-0000095928 00000 n
-0000096212 00000 n
-0000096382 00000 n
-0000096532 00000 n
-0000096708 00000 n
-0000097024 00000 n
-0000107246 00000 n
-0000097214 00000 n
-0000107313 00000 n
-0000097408 00000 n
-0000107378 00000 n
-0000097600 00000 n
-0000107445 00000 n
-0000097815 00000 n
-0000107512 00000 n
-0000097983 00000 n
-0000107579 00000 n
-0000098190 00000 n
-0000107644 00000 n
-0000098394 00000 n
-0000107710 00000 n
-0000098571 00000 n
-0000107777 00000 n
-0000098811 00000 n
-0000107844 00000 n
-0000099008 00000 n
-0000107910 00000 n
-0000099205 00000 n
-0000107978 00000 n
-0000099384 00000 n
-0000099590 00000 n
-0000099811 00000 n
-0000100095 00000 n
-0000108046 00000 n
-0000100428 00000 n
-0000100594 00000 n
-0000108112 00000 n
-0000100809 00000 n
-0000108178 00000 n
-0000100985 00000 n
-0000101173 00000 n
-0000108246 00000 n
-0000101394 00000 n
-0000108314 00000 n
-0000101639 00000 n
-0000101827 00000 n
-0000108380 00000 n
-0000102098 00000 n
-0000108448 00000 n
-0000102262 00000 n
-0000108516 00000 n
-0000102489 00000 n
-0000108582 00000 n
-0000102644 00000 n
-0000108650 00000 n
-0000102865 00000 n
-0000108716 00000 n
-0000103056 00000 n
-0000108784 00000 n
-0000103309 00000 n
-0000108852 00000 n
-0000103554 00000 n
-0000103745 00000 n
-0000104014 00000 n
-0000104184 00000 n
-0000104369 00000 n
-0000104534 00000 n
-0000104648 00000 n
-0000104759 00000 n
-0000104871 00000 n
-0000104980 00000 n
-0000105087 00000 n
-0000105204 00000 n
+0000063075 00000 n
+0000063201 00000 n
+0000063254 00000 n
+0000063461 00000 n
+0000063659 00000 n
+0000063887 00000 n
+0000064092 00000 n
+0000066708 00000 n
+0000066834 00000 n
+0000066895 00000 n
+0000067148 00000 n
+0000067338 00000 n
+0000067543 00000 n
+0000067790 00000 n
+0000067991 00000 n
+0000070725 00000 n
+0000070851 00000 n
+0000071016 00000 n
+0000071227 00000 n
+0000071435 00000 n
+0000071610 00000 n
+0000071805 00000 n
+0000071979 00000 n
+0000072155 00000 n
+0000072378 00000 n
+0000072619 00000 n
+0000072815 00000 n
+0000073028 00000 n
+0000073245 00000 n
+0000073464 00000 n
+0000073736 00000 n
+0000074001 00000 n
+0000074281 00000 n
+0000074494 00000 n
+0000074819 00000 n
+0000075141 00000 n
+0000077665 00000 n
+0000077791 00000 n
+0000077828 00000 n
+0000078010 00000 n
+0000078204 00000 n
+0000080533 00000 n
+0000080643 00000 n
+0000083065 00000 n
+0000083175 00000 n
+0000085506 00000 n
+0000085616 00000 n
+0000087926 00000 n
+0000088036 00000 n
+0000090247 00000 n
+0000090357 00000 n
+0000092081 00000 n
+0000092191 00000 n
+0000093441 00000 n
+0000093551 00000 n
+0000095116 00000 n
+0000107193 00000 n
+0000095226 00000 n
+0000095362 00000 n
+0000095555 00000 n
+0000095713 00000 n
+0000095929 00000 n
+0000096213 00000 n
+0000096383 00000 n
+0000096533 00000 n
+0000096709 00000 n
+0000097025 00000 n
+0000107247 00000 n
+0000097215 00000 n
+0000107314 00000 n
+0000097409 00000 n
+0000107379 00000 n
+0000097601 00000 n
+0000107446 00000 n
+0000097816 00000 n
+0000107513 00000 n
+0000097984 00000 n
+0000107580 00000 n
+0000098191 00000 n
+0000107645 00000 n
+0000098395 00000 n
+0000107711 00000 n
+0000098572 00000 n
+0000107778 00000 n
+0000098812 00000 n
+0000107845 00000 n
+0000099009 00000 n
+0000107911 00000 n
+0000099206 00000 n
+0000107979 00000 n
+0000099385 00000 n
+0000099591 00000 n
+0000099812 00000 n
+0000100096 00000 n
+0000108047 00000 n
+0000100429 00000 n
+0000100595 00000 n
+0000108113 00000 n
+0000100810 00000 n
+0000108179 00000 n
+0000100986 00000 n
+0000101174 00000 n
+0000108247 00000 n
+0000101395 00000 n
+0000108315 00000 n
+0000101640 00000 n
+0000101828 00000 n
+0000108381 00000 n
+0000102099 00000 n
+0000108449 00000 n
+0000102263 00000 n
+0000108517 00000 n
+0000102490 00000 n
+0000108583 00000 n
+0000102645 00000 n
+0000108651 00000 n
+0000102866 00000 n
+0000108717 00000 n
+0000103057 00000 n
+0000108785 00000 n
+0000103310 00000 n
+0000108853 00000 n
+0000103555 00000 n
+0000103746 00000 n
+0000104015 00000 n
+0000104185 00000 n
+0000104370 00000 n
+0000104535 00000 n
+0000104649 00000 n
+0000104760 00000 n
+0000104872 00000 n
+0000104981 00000 n
+0000105088 00000 n
+0000105205 00000 n
trailer
<<
/Size 295
@@ -2939,5 +2939,5 @@
/Info 4 0 R
>>
startxref
-108920
+108921
%%EOF
Modified: hadoop/core/branches/branch-0.16/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.16/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml?rev=639227&r1=639226&r2=639227&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.16/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml (original)
+++ hadoop/core/branches/branch-0.16/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml Thu Mar 20 02:46:23 2008
@@ -1270,10 +1270,11 @@
not just per task.</p>
<p>To avoid these issues the Map-Reduce framework maintains a special
- <code>${mapred.output.dir}/_${taskid}</code> sub-directory for each
- task-attempt on the <code>FileSystem</code> where the output of the
- task-attempt is stored. On successful completion of the task-attempt,
- the files in the <code>${mapred.output.dir}/_${taskid}</code> (only)
+ <code>${mapred.output.dir}/_temporary/_${taskid}</code> sub-directory
+ for each task-attempt on the <code>FileSystem</code> where the output
+ of the task-attempt is stored. On successful completion of the
+ task-attempt, the files in the
+ <code>${mapred.output.dir}/_temporary/_${taskid}</code> (only)
are <em>promoted</em> to <code>${mapred.output.dir}</code>. Of course,
the framework discards the sub-directory of unsuccessful task-attempts.
This process is completely transparent to the application.</p>
Modified: hadoop/core/branches/branch-0.16/src/java/org/apache/hadoop/mapred/JobConf.java
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.16/src/java/org/apache/hadoop/mapred/JobConf.java?rev=639227&r1=639226&r2=639227&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.16/src/java/org/apache/hadoop/mapred/JobConf.java (original)
+++ hadoop/core/branches/branch-0.16/src/java/org/apache/hadoop/mapred/JobConf.java Thu Mar 20 02:46:23 2008
@@ -367,10 +367,11 @@
* <tt>task_200709221812_0001_m_000000_0</tt>), not just per TIP.</p>
*
* <p>To get around this the Map-Reduce framework helps the application-writer
- * out by maintaining a special <tt>${mapred.output.dir}/_${taskid}</tt>
+ * out by maintaining a special
+ * <tt>${mapred.output.dir}/_temporary/_${taskid}</tt>
* sub-directory for each task-attempt on HDFS where the output of the
* task-attempt goes. On successful completion of the task-attempt the files
- * in the <tt>${mapred.output.dir}/_${taskid}</tt> (only)
+ * in the <tt>${mapred.output.dir}/_temporary/_${taskid}</tt> (only)
* are <i>promoted</i> to <tt>${mapred.output.dir}</tt>. Of course, the
* framework discards the sub-directory of unsuccessful task-attempts. This
* is completely transparent to the application.</p>
@@ -383,7 +384,7 @@
*
* <p><i>Note</i>: the value of <tt>${mapred.output.dir}</tt> during execution
* of a particular task-attempt is actually
- * <tt>${mapred.output.dir}/_{$taskid}</tt>, not the value set by
+ * <tt>${mapred.output.dir}/_temporary/_{$taskid}</tt>, not the value set by
* {@link #setOutputPath(Path)}. So, just create any side-files in the path
* returned by {@link #getOutputPath()} from map/reduce task to take
* advantage of this feature.</p>