You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mrql.apache.org by Apache Wiki <wi...@apache.org> on 2013/09/02 23:48:26 UTC

[Mrql Wiki] Update of "Committers" by LeonidasFegaras

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Mrql Wiki" for change notification.

The "Committers" page has been changed by LeonidasFegaras:
https://wiki.apache.org/mrql/Committers?action=diff&rev1=8&rev2=9

  The '''BSP/Evaluator''' class is the interpreter that executes BSP plans.
  The '''BSP/BSPPlan''' class contains the code for evaluating a BSP plan using Hama. It uses the !FileInputFormats provided by Hama, instead of those from Hadoop. Currently, messages between BSP peers are buffered into bags (which can be spilled to local files). This buffering may not be necessary with the new Hama implementations that dumps the messages to local files.
  
+ === Spark Evaluation ===
+ 
+ The '''Spark/Evaluator''' class is the interpreter that evaluates the !MapReduce plans in Spark mode. The evaluation is straightforward because for each MRQL !MapReduce plans there is an equivalent Spark operation. The only complication is that Spark uses its own Java functions to capture anonymous functions, so MRQL '''Function''' values had to be mapped to Spark functions.
+