You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by Ahmad Humayun <ah...@gmail.com> on 2008/03/14 12:37:28 UTC

FS to DFS

Hi there,

Does the map input (for a certain node) on the DFS get copied to the local
FS before work starts on it? Can you point me to a place in the code for
this?

Plus once the shuffle phase ends and the reduce task receives all the
intermediate data from all the maps, does every reduce copies the
intermediate data to the DFS for safe keeping?

thanks for all the help :)


regards,
-- 
Ahmad Humayun
Research Assistant
Computer Science Dpt., LUMS
+92 321 4457315