You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pig.apache.org by Apache Wiki <wi...@apache.org> on 2008/01/29 22:38:23 UTC

[Pig Wiki] Update of "PigExecutionModel" by AntonioMagnaghi

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.

The following page has been changed by AntonioMagnaghi:
http://wiki.apache.org/pig/PigExecutionModel

------------------------------------------------------------------------------
     * Stream Programming Model / MIT Stream-It
        * official page for stream-it: http://www.cag.csail.mit.edu/streamit/ (Articles on the compiler might be useful)
  
+ == Physical Plan Structure ==
+ 
+  1. A criterion we are adopting in the redesign of the logical and physical layer in Pig is to promote what used to be EvalSpec’s and Cond’s to operators.
+  1. Such approach provides: 1.) a clearer definition of the language; 2.) better identification of possibility for optimizations of various form
+  1. Logical operators are such that they provide the logical representation of a Pig computation and type checking.
+  1. The aspects that pertain to carrying out the actual computations on a given dataset belong to physical operators. Exploitation of type information should enable efficient computations.
+  1. The mapping from logical operators to physical operators aims at preserving isomorphism of computation trees. Hence, most logical operators have their counterpart in physical operators. For instance, a logical FILTER will be translated into a physical FILTER. See translation scheme below.
+  1. These are the following exceptions:
+     1. Logical Cogroup to be translated into a Physical LocalRearrange and GlobalRearrange.
+ 
+ 
+ === Logical to Physical Translation Scheme ===
+ 
+ __FILTER___
+