You are viewing a plain text version of this content. The canonical link for it is here.

Posted to submarine-dev@hadoop.apache.org by "Liu Xun (Jira)" <ji...@apache.org> on 2019/10/15 16:09:00 UTC

[jira] [Created] (SUBMARINE-246) Cluster Server module

Liu Xun created SUBMARINE-246:
---------------------------------

             Summary: Cluster Server module
                 Key: SUBMARINE-246
                 URL: https://issues.apache.org/jira/browse/SUBMARINE-246
             Project: Hadoop Submarine
          Issue Type: Sub-task
          Components: Submarine Commons
            Reporter: Liu Xun
            Assignee: Liu Xun
             Fix For: 0.4.0


The Submarine system contains a total of two Server services, Submarine Server and Workbench Server, which are long-running in the form of Daemon.

Among them, Submarine Server mainly provides job submission, job scheduling, job status monitoring, and model online service for Submarine.

Workbench Server is mainly for Submarine Workbench WEB is mainly for algorithm users to provide algorithm development, Python/Spark interpreter operation and other services through Notebook.

The goal of the Submarine project is to provide high availability and high reliability services for big data processing, algorithm development, job scheduling, job scheduling, model online services, model batch and incremental updates. In addition to the high availability of big data and machine learning frameworks, the high availability of Submarine Server and Workbench Server itself is a key consideration.

 

Design Doc: [https://docs.google.com/document/d/1Ax6FQ5CAP-jowm2_Mp2r5kc9r7s1bkFLRfzvvbm5Wzc/edit#]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)