You are viewing a plain text version of this content. The canonical link for it is here.
Posted to submarine-dev@hadoop.apache.org by "Liu Xun (Jira)" <ji...@apache.org> on 2019/10/11 02:02:00 UTC
[jira] [Created] (SUBMARINE-230) [Umbrella] Submarine Interpreter
Module
Liu Xun created SUBMARINE-230:
---------------------------------
Summary: [Umbrella] Submarine Interpreter Module
Key: SUBMARINE-230
URL: https://issues.apache.org/jira/browse/SUBMARINE-230
Project: Hadoop Submarine
Issue Type: New Feature
Components: Submarine interpreter
Reporter: Liu Xun
Assignee: Liu Xun
Because the user needs to write code and execution in the workbench (such as executing Python, Spark sql), in order to avoid user resource competition and code security control when the user executes the code, Workbench will create a Docker container for each user, User can write code in own container, bind the Github account for code version management, execute python and spark programs.
2. Interpreter
Submarine provides multi-language execution for notebooks in workbench through interpreters in a variety of programming languages (for example, python interpreter, spark interpreter).
2.1 Interpreter execution flow
1. The user enters the code in the workbench notebook and clicks the execute button. First the workbench server starts the interpreter process.
2. The workbench server sends the user's code to the interpreter process via the interface for execution, and gets the execution result, returning to the workbench notebook for display.
Design doc: https://docs.google.com/document/d/1LJc5hRTWfIs6K5f7vMgGC_FUizeQf-qqiWICqO8SoR8/edit#
--
This message was sent by Atlassian Jira
(v8.3.4#803005)