[GitHub] wonook opened a new pull request #94: [NEMO-152] Multiple physical plans execution

[GitBox <gi...@apache.org>]

wonook opened a new pull request #94: [NEMO-152] Multiple physical plans execution
URL: https://github.com/apache/incubator-nemo/pull/94
 
 
   JIRA: [NEMO-152: Multiple physical plans execution](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-152)
   
   **Major changes:**
   - Divides the usage of the word 'Job' and 'Plan' to be more specific about what is being run. Before, a job had a single physical plan, so it was possible to use them with an identical name, but as jobs can contain multiple physical plans, it was necessary to divide them
   - Fixes the scheduler and the scheduler runner to accept multiple physical plans
   
   **Minor changes to note:**
   - Grammatical errors on the comments
   - The convert method on the DAG had almost no usages, and it was misleading on the way it was used, so it was removed.
   - I've allowed multiple spark contexts on an evaluator, so that an evaluator can be reused for multiple physical plans.
   
   **Tests for the changes:**
   - A sample program, performing a line count on one execution, and then word count on another, is added as an integration test. All existing tests pass with the changes.
   
   **Other comments:**
   - N/A
   
   resolves [NEMO-152](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-152)

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services