You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by mo...@apache.org on 2020/06/09 13:57:55 UTC
[incubator-doris] branch master updated (5b15894 -> 4fa9d8c)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from 5b15894 [Bug] Fix SchemaChangeJobV2's meta persist bug (#3804)
add edfa668 Add create spark load job
add 7f6a7c6 Remove unused import
new 4fa9d8c [Spark load][Fe 3/5] Fe create job (#3715)
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
fe/pom.xml | 20 ++
fe/src/main/cup/sql_parser.cup | 28 +-
.../java/org/apache/doris/analysis/BrokerDesc.java | 11 +-
.../java/org/apache/doris/analysis/LoadStmt.java | 83 +++++-
.../{BrokerDesc.java => ResourceDesc.java} | 68 +++--
.../org/apache/doris/catalog/SparkResource.java | 4 +-
.../main/java/org/apache/doris/common/Config.java | 6 +
.../java/org/apache/doris/load/EtlJobType.java | 4 +-
.../apache/doris/load/loadv2/BrokerLoadJob.java | 266 +----------------
.../org/apache/doris/load/loadv2/BulkLoadJob.java | 328 +++++++++++++++++++++
.../org/apache/doris/load/loadv2/JobState.java | 1 +
.../org/apache/doris/load/loadv2/LoadManager.java | 7 +-
.../org/apache/doris/load/loadv2/SparkLoadJob.java | 248 ++++++++++++++++
.../main/java/org/apache/doris/qe/DdlExecutor.java | 16 +-
.../org/apache/doris/analysis/LoadStmtTest.java | 28 +-
.../apache/doris/analysis/ResourceDescTest.java | 80 +++++
.../apache/doris/catalog/SparkResourceTest.java | 4 +-
.../doris/load/loadv2/BrokerLoadJobTest.java | 11 +-
18 files changed, 872 insertions(+), 341 deletions(-)
copy fe/src/main/java/org/apache/doris/analysis/{BrokerDesc.java => ResourceDesc.java} (55%)
create mode 100644 fe/src/main/java/org/apache/doris/load/loadv2/BulkLoadJob.java
create mode 100644 fe/src/main/java/org/apache/doris/load/loadv2/SparkLoadJob.java
create mode 100644 fe/src/test/java/org/apache/doris/analysis/ResourceDescTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[incubator-doris] 01/01: [Spark load][Fe 3/5] Fe create job (#3715)
Posted by mo...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
commit 4fa9d8cbe983218312de30071b16bffd4768133f
Merge: 5b15894 7f6a7c6
Author: Mingyu Chen <mo...@gmail.com>
AuthorDate: Tue Jun 9 21:57:46 2020 +0800
[Spark load][Fe 3/5] Fe create job (#3715)
* Add create spark load job
* Remove unused import
fe/pom.xml | 20 ++
fe/src/main/cup/sql_parser.cup | 28 +-
.../java/org/apache/doris/analysis/BrokerDesc.java | 11 +-
.../java/org/apache/doris/analysis/LoadStmt.java | 83 +++++-
.../{BrokerDesc.java => ResourceDesc.java} | 68 +++--
.../org/apache/doris/catalog/SparkResource.java | 4 +-
.../main/java/org/apache/doris/common/Config.java | 6 +
.../java/org/apache/doris/load/EtlJobType.java | 4 +-
.../apache/doris/load/loadv2/BrokerLoadJob.java | 266 +----------------
.../org/apache/doris/load/loadv2/BulkLoadJob.java | 328 +++++++++++++++++++++
.../org/apache/doris/load/loadv2/JobState.java | 1 +
.../org/apache/doris/load/loadv2/LoadManager.java | 7 +-
.../org/apache/doris/load/loadv2/SparkLoadJob.java | 248 ++++++++++++++++
.../main/java/org/apache/doris/qe/DdlExecutor.java | 16 +-
.../org/apache/doris/analysis/LoadStmtTest.java | 28 +-
.../apache/doris/analysis/ResourceDescTest.java | 80 +++++
.../apache/doris/catalog/SparkResourceTest.java | 4 +-
.../doris/load/loadv2/BrokerLoadJobTest.java | 11 +-
18 files changed, 872 insertions(+), 341 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org