Submarine weekly meeting minutes (2022/9/27)

[Xiang Chen <cd...@hotmail.com>]

Hi, Everyone,
Below are the weekly meeting minutes:
Date: 2022/9/27

Host:
    Kevin Su
Participants:
Kevin Su, Fatal Lin, Xiang Chen, Tom, Zhao-Wei Liu

Discussion:
PRs completed:
[SUBMARINE-1329. Improve test coverage of submarine.artifacts module](https://github.com/apache/submarine/pull/998)

Issues still to be processed:
[Need to add a XGBoost k8s agent](https://issues.apache.org/jira/browse/SUBMARINE-1302)
A preliminary version has been completed that supports watching Kubeflow events and updating the status of the experiment to the database. However, there are still some details to be improved, so we can probably do a sharing and discussion next week.

Issues planned to start:
[Reduce tasks in github's workflow](https://issues.apache.org/jira/browse/SUBMARINE-1330)
There was a discussion on how to simplify the workflow of CICD, and the plan is to keep only one language version for testing and validation on each part (submarine-operator, submarine-sdk, submarine-server), and send the rest of the tasks to other supported open source CICD platforms (e.g. https://azure.microsoft.com/en-us/products/devops/pipelines/) using a gitbub bot.
[Add load_datasets method in submarine-sdk](https://issues.apache.org/jira/browse/SUBMARINE-1331)
After PR [SUBMARINE-1283. copy data for experiment before it running via distcp to minio](https://github.com/apache/submarine/pull/989) merged, there is a discussion on how to better load the dataset. During the meeting, there are some details that need to be refined, and the people involved will find another time to discuss them after the meeting.

Meeting every Tuesday at 12:40(GMT+8):
https://cloudera.zoom.us/j/97264903288
Sync Up: https://docs.google.com/document/d/16pUO3TP4SxSeLduG817GhVAjtiph9HYpRHo_JgduDvw/edit
Slack Developer: https://join.slack.com/t/asf-submarine/shared_invite/zt-18614cyqs-UhspdUOneiyg~ZPiVomDqw
YouTube: https://www.youtube.com/channel/UCmy7EV9WD9YM_iOpcGwIQPA

Cheers,
Xiang Chen