You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by mo...@apache.org on 2020/06/09 13:57:56 UTC

[incubator-doris] 01/01: [Spark load][Fe 3/5] Fe create job (#3715)

This is an automated email from the ASF dual-hosted git repository.

morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git

commit 4fa9d8cbe983218312de30071b16bffd4768133f
Merge: 5b15894 7f6a7c6
Author: Mingyu Chen <mo...@gmail.com>
AuthorDate: Tue Jun 9 21:57:46 2020 +0800

    [Spark load][Fe 3/5] Fe create job (#3715)
    
    * Add create spark load job
    
    * Remove unused import

 fe/pom.xml                                         |  20 ++
 fe/src/main/cup/sql_parser.cup                     |  28 +-
 .../java/org/apache/doris/analysis/BrokerDesc.java |  11 +-
 .../java/org/apache/doris/analysis/LoadStmt.java   |  83 +++++-
 .../{BrokerDesc.java => ResourceDesc.java}         |  68 +++--
 .../org/apache/doris/catalog/SparkResource.java    |   4 +-
 .../main/java/org/apache/doris/common/Config.java  |   6 +
 .../java/org/apache/doris/load/EtlJobType.java     |   4 +-
 .../apache/doris/load/loadv2/BrokerLoadJob.java    | 266 +----------------
 .../org/apache/doris/load/loadv2/BulkLoadJob.java  | 328 +++++++++++++++++++++
 .../org/apache/doris/load/loadv2/JobState.java     |   1 +
 .../org/apache/doris/load/loadv2/LoadManager.java  |   7 +-
 .../org/apache/doris/load/loadv2/SparkLoadJob.java | 248 ++++++++++++++++
 .../main/java/org/apache/doris/qe/DdlExecutor.java |  16 +-
 .../org/apache/doris/analysis/LoadStmtTest.java    |  28 +-
 .../apache/doris/analysis/ResourceDescTest.java    |  80 +++++
 .../apache/doris/catalog/SparkResourceTest.java    |   4 +-
 .../doris/load/loadv2/BrokerLoadJobTest.java       |  11 +-
 18 files changed, 872 insertions(+), 341 deletions(-)



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org