You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@submarine.apache.org by gi...@apache.org on 2023/03/26 00:46:34 UTC
[submarine] branch dependabot/pip/submarine-sdk/pysubmarine/github-actions/setuptools-65.5.1 updated (f06bee07 -> 5d00bd36)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/pip/submarine-sdk/pysubmarine/github-actions/setuptools-65.5.1
in repository https://gitbox.apache.org/repos/asf/submarine.git
discard f06bee07 Bump setuptools in /submarine-sdk/pysubmarine/github-actions
add a7e2c545 SUBMARINE-1352. Move submarine-cloud-v2 to submarine-cloud-v3
add 6d18d555 SUBMARINE-1358. fix the potential timeout issue while building jupyter image
add 58cf1d55 SUBMARINE-1364. Fix broken mlflow image building
add 4cd2af10 SUBMARINE-1361. Fix Submarine SQL injection vulnerability
add 793c8a26 SUBMARINE-1365. Fix failure python unit test environment
add 0ecfe38b SUBMARINE-1366. SQLAlchemy 2.0 upgrade causes compilation failure of pysubmarine
add c2f0eb1a SUBMARINE-1369. Fix CICD in submarine-workbench section always failed
add 604ad540 SUBMARINE-1368. Fix SysUserRestApiTest editUserTest test error
add 8360aec0 SUBMARINE-1367. Fix submarine-sdk build in Dockerfile
add 6fe02972 SUBMARINE-1370. Fix Calculate combined coverage failed
add 279393ad SUBMARINE-1349. Fix the syntax error reported in sonarcloud and add init value for apiversion in XGboostjobList.java
add 48cdf7bb SUBMARINE-1362. Refactor submarine-k8s-agent using JOSDK
add de303fa4 Bump golang.org/x/crypto in /submarine-cloud-v3 (#1053)
add 6dfd8584 Bump @sideway/formula from 3.0.0 to 3.0.1 in /website (#1055)
add 5987b92a SUBMARINE-1372. Fix tensorflow 2.6.5 in CI always failed
add 5d00bd36 Bump setuptools in /submarine-sdk/pysubmarine/github-actions
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f06bee07)
\
N -- N -- N refs/heads/dependabot/pip/submarine-sdk/pysubmarine/github-actions/setuptools-65.5.1 (5d00bd36)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/deploy_docker_images.yml | 2 +-
.github/workflows/master.yml | 120 ++------
.github/workflows/python.yml | 10 +-
.gitignore | 4 +
LICENSE-binary | 10 +-
dev-support/docker-images/agent/Dockerfile | 17 +-
dev-support/docker-images/agent/build.sh | 14 +-
dev-support/docker-images/jupyter-gpu/Dockerfile | 8 +-
dev-support/docker-images/jupyter/Dockerfile | 8 +-
dev-support/docker-images/mlflow/Dockerfile | 3 +-
dev-support/style-check/lint-go.sh | 2 +-
.../style-check/python/mypy-requirements.txt | 2 +-
pom.xml | 9 +-
submarine-cloud-v3/Makefile | 13 +-
submarine-cloud-v3/api/v1alpha1/submarine_types.go | 12 +-
.../api/v1alpha1/zz_generated.deepcopy.go | 20 ++
.../artifacts/submarine-agent.yaml | 42 ++-
.../crd/bases/submarine.apache.org_submarines.yaml | 15 +-
submarine-cloud-v3/config/rbac/role.yaml | 2 +-
submarine-cloud-v3/controllers/submarine_agent.go | 139 +++++++++
...ne_database_test.go => submarine_agent_test.go} | 20 +-
.../controllers/submarine_controller.go | 11 +-
.../controllers/submarine_database.go | 10 +-
.../controllers/submarine_virtualservice.go | 4 +-
submarine-cloud-v3/docs/developer-guide.md | 4 +
submarine-cloud-v3/go.mod | 12 +-
submarine-cloud-v3/go.sum | 24 +-
.../boilerplate.yaml.txt} | 2 -
.../hack/verify-codegen.sh | 12 +-
.../github-actions/test-requirements.txt | 1 +
submarine-sdk/pysubmarine/setup.py | 7 +-
.../store/model_registry/sqlalchemy_store.py | 5 +-
submarine-server/server-core/pom.xml | 4 +
.../submarine/server/manager/ModelManager.java | 14 +-
.../server/manager/ModelVersionManager.java | 16 +-
.../server/manager/RegisteredModelManager.java | 20 +-
.../submarine/server/rest/ExperimentRestApi.java | 2 +-
.../org/apache/submarine/server/s3/Client.java | 36 +--
.../server/rest/ModelVersionRestApiTest.java | 4 +-
.../server/rest/RegisteredModelRestApiTest.java | 2 +-
.../server/rest/workbench/SysUserRestApiTest.java | 6 +-
.../org/apache/submarine/server/s3/ClientTest.java | 21 +-
.../experiment/mappers/ExperimentMapper.java | 26 ++
.../model/service/ModelVersionService.java | 7 +
.../model/service/RegisteredModelService.java | 8 +
.../model/service/RegisteredModelTagService.java | 7 +
.../database/notebook/mappers/NotebookMapper.java | 8 +
.../database/mappers/ExperimentMapper.xml | 24 ++
.../submarine/database/mappers/NotebookMapper.xml | 8 +
.../submarine/database/mappers/SysDeptMapper.xml | 4 +-
.../database/mappers/SysDictItemMapper.xml | 4 +-
.../submarine/database/mappers/SysDictMapper.xml | 4 +-
.../submarine/database/mappers/SysUserMapper.xml | 4 +-
.../server/database/model/ModelVersionTagTest.java | 4 +-
.../server/database/model/ModelVersionTest.java | 4 +-
.../database/model/RegisteredModelServiceTest.java | 2 +-
.../model/RegisteredModelTagServiceTest.java | 4 +-
.../database/service/SysUserServiceTest.java | 13 +
.../server/k8s/utils/OwnerReferenceConfig.java | 66 ++++
.../server-submitter/submarine-k8s-agent/README.md | 46 +++
.../server-submitter/submarine-k8s-agent/pom.xml | 233 +++++++-------
.../src/assembly/distribution.xml | 69 -----
.../src/assembly/src-distribution.xml | 53 ----
.../submarine/server/k8s/agent/HandlerFactory.java | 36 ---
.../submarine/server/k8s/agent/SubmarineAgent.java | 84 ------
.../server/k8s/agent/SubmarineAgentListener.java | 82 +++++
.../k8s/agent/handler/CustomResourceHandler.java | 130 --------
.../server/k8s/agent/handler/NotebookHandler.java | 154 ----------
.../k8s/agent/handler/PyTorchJobHandler.java | 114 -------
.../server/k8s/agent/handler/TFJobHandler.java | 112 -------
.../k8s/agent/model/notebook/NotebookResource.java | 51 ++++
.../model/notebook/status/NotebookCondition.java | 116 +++++++
.../model/notebook/status/NotebookStatus.java | 94 ++++++
.../k8s/agent/model/training/JobResource.java} | 29 +-
.../agent/model/training/resource/PyTorchJob.java | 42 +++
.../k8s/agent/model/training/resource/TFJob.java} | 43 ++-
.../agent/model/training/resource/XGBoostJob.java | 42 +++
.../agent/model/training/status/JobCondition.java | 128 ++++++++
.../k8s/agent/model/training/status/JobStatus.java | 118 ++++++++
.../agent/model/training/status/ReplicaStatus.java | 101 +++++++
.../server/k8s/agent/reconciler/JobReconciler.java | 180 +++++++++++
.../k8s/agent/reconciler/NotebookReconciler.java | 197 ++++++++++++
.../k8s/agent/reconciler/PyTorchJobReconciler.java | 54 ++++
.../k8s/agent/reconciler/TFJobReconciler.java | 54 ++++
.../k8s/agent/reconciler/XGBoostJobReconciler.java | 54 ++++
.../server/k8s/agent/util/RestClient.java | 55 ----
.../src/main/resources/log4j.properties | 4 +
.../src/main/resources/mybatis-config.xml} | 17 +-
.../server/k8s/agent/SubmitSubmarineAgentTest.java | 336 +++++++++++++++++++++
.../test/resources/custom-resources/notebook.yml | 33 +-
.../resources/custom-resources/pytorchjobs.yaml | 43 +--
.../test/resources/custom-resources/tfjobs.yaml | 41 +--
.../resources/custom-resources/xgboostjobs.yaml | 42 +--
.../src/test/resources/db/agent-init.sql | 51 ++++
.../src/test}/resources/log4j.properties | 4 +
.../server/submitter/k8s/K8sSubmitter.java | 31 +-
.../server/submitter/k8s/model/AgentPod.java | 5 +
.../k8s/model/xgboostjob/XGBoostJobList.java | 6 +-
.../submitter/k8s/util/OwnerReferenceUtils.java | 17 +-
.../submitter/k8s/SubmitterNotebookApiTest.java | 21 +-
.../k8s/mljob/SubmitterPyTorchApiTest.java | 19 +-
.../k8s/mljob/SubmitterTensorflowApiTest.java | 19 +-
.../k8s/mljob/SubmitterXGBoostApiTest.java | 20 +-
website/yarn.lock | 6 +-
104 files changed, 2613 insertions(+), 1459 deletions(-)
copy helm-charts/submarine/charts/notebook-controller/templates/deployment.yaml => submarine-cloud-v3/artifacts/submarine-agent.yaml (54%)
create mode 100644 submarine-cloud-v3/controllers/submarine_agent.go
copy submarine-cloud-v3/controllers/{submarine_database_test.go => submarine_agent_test.go} (66%)
copy submarine-cloud-v3/{config/prometheus/kustomization.yaml => hack/boilerplate.yaml.txt} (96%)
copy {submarine-cloud-v2 => submarine-cloud-v3}/hack/verify-codegen.sh (86%)
create mode 100644 submarine-server/server-submitter/k8s-utils/src/main/java/org/apache/submarine/server/k8s/utils/OwnerReferenceConfig.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/README.md
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/assembly/distribution.xml
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/assembly/src-distribution.xml
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/HandlerFactory.java
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/SubmarineAgent.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/SubmarineAgentListener.java
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/handler/CustomResourceHandler.java
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/handler/NotebookHandler.java
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/handler/PyTorchJobHandler.java
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/handler/TFJobHandler.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/notebook/NotebookResource.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/notebook/status/NotebookCondition.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/notebook/status/NotebookStatus.java
copy submarine-server/server-submitter/{submitter-k8s/src/main/java/org/apache/submarine/server/submitter/k8s/model/ListMeta.java => submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/training/JobResource.java} (54%)
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/training/resource/PyTorchJob.java
copy submarine-server/{server-database/src/main/java/org/apache/submarine/server/database/workbench/utils/CustomJsonDateDeserializer.java => server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/training/resource/TFJob.java} (50%)
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/training/resource/XGBoostJob.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/training/status/JobCondition.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/training/status/JobStatus.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/model/training/status/ReplicaStatus.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/reconciler/JobReconciler.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/reconciler/NotebookReconciler.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/reconciler/PyTorchJobReconciler.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/reconciler/TFJobReconciler.java
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/reconciler/XGBoostJobReconciler.java
delete mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/main/java/org/apache/submarine/server/k8s/agent/util/RestClient.java
copy submarine-server/{server-database/src/main/resources/mybatis-config-metastore.xml => server-submitter/submarine-k8s-agent/src/main/resources/mybatis-config.xml} (78%)
mode change 100644 => 100755
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/test/java/org/apache/submarine/server/k8s/agent/SubmitSubmarineAgentTest.java
copy helm-charts/submarine/charts/notebook-controller/crds/crd.yaml => submarine-server/server-submitter/submarine-k8s-agent/src/test/resources/custom-resources/notebook.yml (59%)
copy helm-charts/submarine/charts/notebook-controller/crds/crd.yaml => submarine-server/server-submitter/submarine-k8s-agent/src/test/resources/custom-resources/pytorchjobs.yaml (51%)
copy helm-charts/submarine/charts/notebook-controller/crds/crd.yaml => submarine-server/server-submitter/submarine-k8s-agent/src/test/resources/custom-resources/tfjobs.yaml (51%)
copy helm-charts/submarine/charts/notebook-controller/crds/crd.yaml => submarine-server/server-submitter/submarine-k8s-agent/src/test/resources/custom-resources/xgboostjobs.yaml (51%)
create mode 100644 submarine-server/server-submitter/submarine-k8s-agent/src/test/resources/db/agent-init.sql
copy submarine-server/{server-core/src/main => server-submitter/submarine-k8s-agent/src/test}/resources/log4j.properties (86%)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@submarine.apache.org
For additional commands, e-mail: dev-help@submarine.apache.org