You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@devlake.apache.org by ka...@apache.org on 2023/05/18 07:01:21 UTC

[incubator-devlake] branch issues/4762 updated (be06a2ce7 -> 98e57438c)

This is an automated email from the ASF dual-hosted git repository.

ka94 pushed a change to branch issues/4762
in repository https://gitbox.apache.org/repos/asf/incubator-devlake.git


 discard be06a2ce7 feat: pagerduty adapted to use Delete Scopes
 discard 1c4a9e0f7 feat: Minimal support for deleting scopes
     add 8718e09e6 feat(config-ui): use new page connection home and detail (#5149)
     add 8ebffcd75 GitHub e2e fix (#5139)
     add c7907b627 feat: upgrade grafana to v9.5.1 (#5145)
     add c488fea71 feat(config-ui): improve the connection detail page (#5158)
     add 109a89cbd Support NEW_PASSWORD_REQUIRED challenge (#5127)
     add 4ade7a892 fix: missing board for tapd (#5160)
     add 9fba2d006 5081 fix missing records azuredevops (#5138)
     add b51b3fb07 feat: collect feishu chat(group) & message (#5001)
     add 47ebe5d54 feat: collect slack channel/message/thread (#5016)
     add 1b4fbbeb2 feat: collect jira issue desc and comments (#4925)
     add 86085b3cd fix: typo and unused struct (#5165)
     add f219a9376 feat: new password confirmation (#5170)
     add 56a74aeb2 feat: provide a calendar_months table (#5168)
     add 8491c73dd fix: update DORA validation dashboard (#5172)
     add 70ea96de2 [feat-4762] part1: Minimal support for deleting scopes (#5153)
     add 98e57438c feat: Rework scope_helper for compatiblity with Python and adapt DeleteScope to it

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (be06a2ce7)
            \
             N -- N -- N   refs/heads/issues/4762 (98e57438c)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 Makefile                                           |    3 +
 backend/Makefile                                   |    6 +-
 backend/core/dal/dal.go                            |    4 +-
 backend/core/models/blueprint.go                   |    7 +-
 backend/core/models/dynamic_tabler.go              |   15 +-
 ...r_metric.go => 20230511_add_calendar_months.go} |   55 +-
 backend/core/models/migrationscripts/register.go   |    1 +
 backend/core/runner/loader.go                      |    8 +-
 backend/helpers/pluginhelper/api/api_collector.go  |    3 +-
 .../pluginhelper/api/reflection_helper.go}         |   53 +-
 .../helpers/pluginhelper/api/scope_db_helper.go    |  115 +
 .../{scope_helper.go => scope_generic_helper.go}   |  410 ++-
 backend/helpers/pluginhelper/api/scope_helper.go   |  665 +----
 .../helpers/pluginhelper/api/scope_helper_test.go  |    5 +-
 .../pluginhelper/services/blueprint_helper.go      |    6 +-
 backend/impls/dalgorm/dalgorm.go                   |   70 +-
 .../ae/api/init.go => impls/dalgorm/db_mapper.go}  |   38 +-
 backend/plugins/feishu/apimodels/im_result.go      |   58 +
 backend/plugins/feishu/impl/impl.go                |    6 +
 .../worklog.go => feishu/models/chat_item.go}      |   26 +-
 .../{meeting_top_user_item.go => message.go}       |   24 +-
 ..._init_tables.go => 20230421_add_init_tables.go} |   10 +-
 .../models/migrationscripts/archived/chat_item.go} |   25 +-
 .../{meeting_top_user_item.go => message.go}       |   24 +-
 backend/plugins/feishu/tasks/api_client.go         |    4 +-
 ...op_user_item_collector.go => chat_collector.go} |   52 +-
 .../tasks/chat_extractor.go}                       |   36 +-
 .../tasks/message_collector.go}                    |   85 +-
 ...user_item_extractor.go => message_extractor.go} |   56 +-
 backend/plugins/feishu/tasks/task_data.go          |    6 +-
 backend/plugins/github/e2e/pr_review_test.go       |   20 +-
 .../raw_tables/_raw_github_api_account_orgs.csv    |    2 +-
 .../e2e/raw_tables/_raw_github_api_comments.csv    |  160 +-
 .../e2e/raw_tables/_raw_github_api_events.csv      |   52 +-
 .../e2e/raw_tables/_raw_github_api_issues.csv      |   56 +-
 .../_raw_github_api_pull_request_commits.csv       |   16 +-
 ...raw_github_api_pull_request_review_comments.csv |    4 +-
 .../_raw_github_api_pull_request_reviews.csv       |    8 +-
 .../raw_tables/_raw_github_api_pull_requests.csv   |  100 +-
 .../github/e2e/raw_tables/_raw_github_api_runs.csv |   40 +-
 .../github/e2e/raw_tables/_tool_github_issues.csv  |   46 +-
 .../e2e/raw_tables/_tool_github_pull_requests.csv  |   16 +-
 .../github/e2e/raw_tables/_tool_github_repos.csv   |    2 +-
 .../e2e/snapshot_tables/_tool_github_commits.csv   |   16 +-
 .../_tool_github_issue_comments.csv                |   92 +-
 .../e2e/snapshot_tables/_tool_github_issues.csv    |   46 +-
 .../_tool_github_pull_request_comments.csv         |   72 +-
 .../_tool_github_pull_request_commits.csv          |    2 +-
 .../_tool_github_pull_request_reviews.csv          |    8 +-
 .../snapshot_tables/_tool_github_pull_requests.csv |   16 +-
 .../e2e/snapshot_tables/_tool_github_repos.csv     |    2 +-
 .../plugins/github/e2e/snapshot_tables/boards.csv  |    2 +-
 .../github/e2e/snapshot_tables/cicd_scopes.csv     |    2 +-
 .../github/e2e/snapshot_tables/issue_comments.csv  |   92 +-
 .../plugins/github/e2e/snapshot_tables/issues.csv  |   46 +-
 .../e2e/snapshot_tables/pull_request_comments.csv  |   72 +-
 .../e2e/snapshot_tables/pull_request_commits.csv   |    2 +-
 .../pull_request_review_comments.csv               |   31 +
 .../github/e2e/snapshot_tables/pull_requests.csv   |   16 +-
 .../plugins/github/e2e/snapshot_tables/repos.csv   |    2 +-
 backend/plugins/jira/e2e/issue_test.go             |    3 +
 .../jira/e2e/snapshot_tables/_tool_jira_issues.csv |   62 +-
 .../_tool_jira_issues_for_external_epics.csv       |    8 +-
 backend/plugins/jira/impl/impl.go                  |    6 +-
 backend/plugins/jira/models/issue.go               |    2 +
 backend/plugins/jira/models/issue_comment.go       |   21 +-
 ...dd_project_name.go => 20230412_desc_comment.go} |   25 +-
 .../archived}/issue_comment.go                     |   23 +-
 .../jira/models/migrationscripts/register.go       |    1 +
 backend/plugins/jira/tasks/apiv2models/comment.go  |   53 +
 backend/plugins/jira/tasks/apiv2models/issue.go    |   27 +-
 ...log_collector.go => issue_comment_collector.go} |   22 +-
 ...mit_convertor.go => issue_comment_convertor.go} |   42 +-
 ...log_extractor.go => issue_comment_extractor.go} |   38 +-
 .../plugins/jira/tasks/issue_commit_convertor.go   |    2 +-
 backend/plugins/jira/tasks/issue_convertor.go      |    1 +
 backend/plugins/jira/tasks/issue_extractor.go      |    5 +-
 .../jira/tasks/issue_repo_commit_convertor.go      |    2 +-
 backend/plugins/pagerduty/api/init.go              |   11 +-
 backend/plugins/pagerduty/api/scope.go             |    6 +-
 backend/plugins/{dbt => slack}/README.md           |    2 +-
 .../plugins/{feishu => slack}/api/connection.go    |   86 +-
 backend/plugins/{ae => slack}/api/init.go          |    0
 backend/plugins/{feishu => slack}/api/swagger.go   |   24 +-
 .../{feishu => slack}/apimodels/access_token.go    |    0
 backend/plugins/slack/apimodels/im_result.go       |  166 ++
 backend/plugins/{feishu => slack}/impl/impl.go     |   69 +-
 backend/plugins/slack/models/channel.go            |   52 +
 .../worklog.go => slack/models/channel_message.go} |   33 +-
 .../plugins/{tapd => slack}/models/connection.go   |   16 +-
 .../migrationscripts/20230421_add_init_tables.go}  |   31 +-
 .../models/migrationscripts/archived/channel.go    |   52 +
 .../migrationscripts/archived/channel_message.go}  |   32 +-
 .../models/migrationscripts/archived/connection.go |    9 +-
 .../models/migrationscripts/register.go            |    0
 .../{icla/plugin_main.go => slack/slack.go}        |   13 +-
 .../plugins/{trello => slack}/tasks/api_client.go  |   11 +-
 .../tasks/channel_collector.go}                    |   69 +-
 .../tasks/channel_extractor.go}                    |   36 +-
 .../tasks/channel_message_collector.go}            |   84 +-
 .../slack/tasks/channel_message_extractor.go       |   85 +
 backend/plugins/{ae => slack}/tasks/task_data.go   |   15 +-
 .../tasks/thread_collector.go}                     |   87 +-
 backend/plugins/slack/tasks/thread_extractor.go    |   85 +
 backend/plugins/tapd/impl/impl.go                  |    1 +
 ...em_type_extractor.go => workspace_converter.go} |   61 +-
 backend/python/README.md                           |   19 +
 .../plugins/azuredevops/azuredevops/models.py      |   29 +-
 .../azuredevops/azuredevops/streams/builds.py      |   18 +-
 .../azuredevops/azuredevops/streams/jobs.py        |   18 +-
 .../azuredevops/streams/pull_requests.py           |    6 +-
 .../azuredevops/{azuredevops => tests}/__init__.py |    0
 backend/python/pydevlake/pydevlake/context.py      |   31 +-
 backend/python/pydevlake/pydevlake/ipc.py          |   25 +-
 backend/python/pydevlake/pydevlake/message.py      |    1 +
 backend/python/pydevlake/pydevlake/model.py        |   21 +-
 backend/python/pydevlake/pydevlake/plugin.py       |   34 +-
 backend/python/pydevlake/pydevlake/stream.py       |    9 +-
 backend/python/pydevlake/pydevlake/subtasks.py     |   19 +-
 .../python/pydevlake/pydevlake/testing/testing.py  |    6 +-
 backend/python/pydevlake/tests/stream_test.py      |   16 +-
 backend/resources/swagger/open_api_spec.json.tmpl  |   45 +
 backend/server/api/api.go                          |   12 +-
 backend/server/api/login/login.go                  |   62 +-
 backend/server/services/auth/auth.go               |  105 +
 backend/server/services/auth/cognito.go            |  215 +-
 backend/server/services/init.go                    |    8 +-
 .../server/services/remote/models/conversion.go    |   30 +
 backend/server/services/remote/models/models.go    |   20 +-
 .../server/services/remote/models/plugin_remote.go |    1 +
 .../server/services/remote/plugin/default_api.go   |   24 +-
 backend/server/services/remote/plugin/init.go      |    1 +
 .../services/remote/plugin/plugin_extensions.go    |    3 +-
 .../server/services/remote/plugin/plugin_impl.go   |   11 +-
 backend/server/services/remote/plugin/scope_api.go |  240 +-
 .../services/remote/plugin/scope_db_helper.go      |  147 +
 backend/test/e2e/remote/python_plugin_test.go      |    8 +
 config-ui/nginx.conf                               |    1 +
 config-ui/src/App.tsx                              |    9 +-
 config-ui/src/components/dialog/styled.ts          |    4 +-
 config-ui/src/components/page-header/styled.ts     |    4 +-
 config-ui/src/components/table/styled.ts           |    8 +-
 config-ui/src/layouts/base/base.tsx                |  196 +-
 config-ui/src/layouts/base/styled.ts               |   25 +-
 config-ui/src/layouts/base/use-menu.ts             |    9 -
 .../pages/blueprint/create/components/step-1.tsx   |    4 +-
 .../src/pages/connection/{list => detail}/api.ts   |    2 +
 config-ui/src/pages/connection/detail/index.tsx    |  220 ++
 .../connection/detail}/styled.ts                   |   39 +-
 config-ui/src/pages/connection/form/index.tsx      |   44 -
 config-ui/src/pages/connection/home/count.tsx      |   27 -
 config-ui/src/pages/connection/home/index.tsx      |  212 +-
 config-ui/src/pages/connection/home/styled.ts      |   10 +
 config-ui/src/pages/connection/index.ts            |    3 +-
 config-ui/src/pages/connection/list/connection.tsx |  142 -
 config-ui/src/pages/connection/list/index.tsx      |   46 -
 config-ui/src/pages/connection/list/styled.ts      |   47 -
 config-ui/src/pages/login/api.ts                   |    8 +
 config-ui/src/pages/login/login.tsx                |   76 +-
 .../plugins/components/connection-form/index.tsx   |   65 +-
 .../components/connection-form/operate/index.ts    |   20 -
 .../components/connection-form/operate/save.tsx    |   65 -
 .../components/connection-form/operate/test.tsx    |   65 -
 .../plugins/components/connection-form/styled.ts   |    7 +-
 .../{data-scope-form => data-scope-form-2}/api.ts  |    0
 .../index.tsx                                      |  191 +-
 .../styled.ts                                      |   10 +-
 .../components/data-scope-miller-columns/index.tsx |   10 +-
 .../plugins/components/data-scope-search/index.tsx |    4 +-
 config-ui/src/plugins/components/index.ts          |    1 +
 .../plugins/components/transformation-form/misc.ts |   12 +-
 config-ui/src/plugins/config.ts                    |    4 +-
 config-ui/src/plugins/register/ae/config.ts        |    2 +-
 config-ui/src/plugins/register/azure/config.tsx    |    7 +-
 .../src/plugins/register/azure/data-scope.tsx      |    9 +-
 .../src/plugins/register/bitbucket/config.tsx      |    4 +-
 .../src/plugins/register/bitbucket/data-scope.tsx  |    9 +-
 config-ui/src/plugins/register/customize/config.ts |    2 +-
 config-ui/src/plugins/register/dbt/config.ts       |    2 +-
 config-ui/src/plugins/register/dora/config.ts      |    2 +-
 config-ui/src/plugins/register/feishu/config.ts    |    2 +-
 config-ui/src/plugins/register/gitee/config.ts     |    2 +-
 .../src/plugins/register/gitextractor/config.ts    |    2 +-
 .../github/components/miller-columns/index.tsx     |    9 +-
 .../github/components/repo-selector/index.tsx      |    6 +-
 config-ui/src/plugins/register/github/config.tsx   |    6 +-
 .../src/plugins/register/github/data-scope.tsx     |   17 +-
 .../src/plugins/register/github_graphql/config.ts  |    2 +-
 config-ui/src/plugins/register/gitlab/config.tsx   |    6 +-
 .../src/plugins/register/gitlab/data-scope.tsx     |    8 +
 .../jenkins/components/miller-columns/index.tsx    |    9 +-
 config-ui/src/plugins/register/jenkins/config.ts   |    4 +-
 .../src/plugins/register/jenkins/data-scope.tsx    |    3 +-
 .../jira/components/miller-columns/index.tsx       |    9 +-
 config-ui/src/plugins/register/jira/config.tsx     |    4 +-
 config-ui/src/plugins/register/jira/data-scope.tsx |   12 +-
 config-ui/src/plugins/register/org/config.ts       |    2 +-
 .../src/plugins/register/pagerduty/config.tsx      |    4 +-
 .../src/plugins/register/pagerduty/data-scope.tsx  |    7 +
 config-ui/src/plugins/register/refdiff/config.ts   |    2 +-
 config-ui/src/plugins/register/sonarqube/config.ts |    4 +-
 .../src/plugins/register/sonarqube/data-scope.tsx  |    9 +-
 config-ui/src/plugins/register/starrocks/config.ts |    2 +-
 config-ui/src/plugins/register/tapd/config.tsx     |    7 +-
 config-ui/src/plugins/register/tapd/data-scope.tsx |    9 +-
 .../src/plugins/register/teambition/config.tsx     |    6 +-
 config-ui/src/plugins/register/webook/config.ts    |    6 +-
 config-ui/src/plugins/register/zentao/config.ts    |    4 +-
 .../src/plugins/register/zentao/data-scope.tsx     |   14 +-
 config-ui/src/store/connections/api.ts             |   13 +-
 config-ui/src/store/connections/context.tsx        |    4 +-
 config-ui/src/store/connections/status.tsx         |   47 +-
 .../src/store/connections/use-context-value.ts     |  179 +-
 config-ui/src/store/index.ts                       |    1 +
 .../no-data/index.tsx => store/tips/context.tsx}   |   51 +-
 .../{plugins/register/ae => store/tips}/index.ts   |    2 +-
 config-ui/src/utils/request.ts                     |    4 +-
 env.example                                        |    2 +
 grafana/Dockerfile                                 |    2 +-
 grafana/dashboards/DORA DEBUG.json                 | 1873 -------------
 grafana/dashboards/DORA.json                       |   24 +-
 grafana/dashboards/DORADebug.json                  | 2934 ++++++++++++++++++++
 222 files changed, 7184 insertions(+), 5336 deletions(-)
 copy backend/core/models/migrationscripts/{20221111_add_project_pr_metric.go => 20230511_add_calendar_months.go} (52%)
 copy backend/{core/models/migrationscripts/archived/task.go => helpers/pluginhelper/api/reflection_helper.go} (56%)
 create mode 100644 backend/helpers/pluginhelper/api/scope_db_helper.go
 copy backend/helpers/pluginhelper/api/{scope_helper.go => scope_generic_helper.go} (57%)
 copy backend/{plugins/ae/api/init.go => impls/dalgorm/db_mapper.go} (59%)
 create mode 100644 backend/plugins/feishu/apimodels/im_result.go
 copy backend/plugins/{jira/models/worklog.go => feishu/models/chat_item.go} (64%)
 copy backend/plugins/feishu/models/{meeting_top_user_item.go => message.go} (56%)
 copy backend/plugins/feishu/models/migrationscripts/{20220714_add_init_tables.go => 20230421_add_init_tables.go} (89%)
 copy backend/plugins/{bitbucket/models/migrationscripts/archived/issue_comment.go => feishu/models/migrationscripts/archived/chat_item.go} (64%)
 copy backend/plugins/feishu/models/migrationscripts/archived/{meeting_top_user_item.go => message.go} (56%)
 copy backend/plugins/feishu/tasks/{meeting_top_user_item_collector.go => chat_collector.go} (61%)
 copy backend/plugins/{jira/tasks/project_extractor.go => feishu/tasks/chat_extractor.go} (65%)
 copy backend/plugins/{teambition/tasks/task_activity_collector.go => feishu/tasks/message_collector.go} (55%)
 copy backend/plugins/feishu/tasks/{meeting_top_user_item_extractor.go => message_extractor.go} (52%)
 create mode 100644 backend/plugins/github/e2e/snapshot_tables/pull_request_review_comments.csv
 copy backend/plugins/jira/models/migrationscripts/{20221215_add_project_name.go => 20230412_desc_comment.go} (63%)
 copy backend/plugins/jira/models/{ => migrationscripts/archived}/issue_comment.go (66%)
 create mode 100644 backend/plugins/jira/tasks/apiv2models/comment.go
 copy backend/plugins/jira/tasks/{issue_changelog_collector.go => issue_comment_collector.go} (85%)
 copy backend/plugins/jira/tasks/{issue_commit_convertor.go => issue_comment_convertor.go} (63%)
 copy backend/plugins/jira/tasks/{issue_changelog_extractor.go => issue_comment_extractor.go} (68%)
 copy backend/plugins/{dbt => slack}/README.md (65%)
 copy backend/plugins/{feishu => slack}/api/connection.go (65%)
 copy backend/plugins/{ae => slack}/api/init.go (100%)
 copy backend/plugins/{feishu => slack}/api/swagger.go (66%)
 copy backend/plugins/{feishu => slack}/apimodels/access_token.go (100%)
 create mode 100644 backend/plugins/slack/apimodels/im_result.go
 copy backend/plugins/{feishu => slack}/impl/impl.go (55%)
 create mode 100644 backend/plugins/slack/models/channel.go
 copy backend/plugins/{jira/models/worklog.go => slack/models/channel_message.go} (51%)
 copy backend/plugins/{tapd => slack}/models/connection.go (72%)
 rename backend/plugins/{feishu/models/migrationscripts/20220714_add_init_tables.go => slack/models/migrationscripts/20230421_add_init_tables.go} (69%)
 create mode 100644 backend/plugins/slack/models/migrationscripts/archived/channel.go
 copy backend/plugins/{bitbucket/models/migrationscripts/archived/issue_comment.go => slack/models/migrationscripts/archived/channel_message.go} (51%)
 copy backend/plugins/{feishu => slack}/models/migrationscripts/archived/connection.go (84%)
 copy backend/plugins/{feishu => slack}/models/migrationscripts/register.go (100%)
 copy backend/plugins/{icla/plugin_main.go => slack/slack.go} (78%)
 copy backend/plugins/{trello => slack}/tasks/api_client.go (80%)
 copy backend/plugins/{teambition/tasks/sprint_collector.go => slack/tasks/channel_collector.go} (58%)
 copy backend/plugins/{jira/tasks/project_extractor.go => slack/tasks/channel_extractor.go} (65%)
 copy backend/plugins/{teambition/tasks/task_activity_collector.go => slack/tasks/channel_message_collector.go} (54%)
 create mode 100644 backend/plugins/slack/tasks/channel_message_extractor.go
 copy backend/plugins/{ae => slack}/tasks/task_data.go (88%)
 copy backend/plugins/{teambition/tasks/task_activity_collector.go => slack/tasks/thread_collector.go} (53%)
 create mode 100644 backend/plugins/slack/tasks/thread_extractor.go
 copy backend/plugins/tapd/tasks/{workitem_type_extractor.go => workspace_converter.go} (50%)
 copy backend/python/plugins/azuredevops/{azuredevops => tests}/__init__.py (100%)
 create mode 100644 backend/server/services/auth/auth.go
 create mode 100644 backend/server/services/remote/plugin/scope_db_helper.go
 rename config-ui/src/pages/connection/{list => detail}/api.ts (89%)
 create mode 100644 config-ui/src/pages/connection/detail/index.tsx
 copy config-ui/src/{plugins/components/data-scope-form => pages/connection/detail}/styled.ts (70%)
 delete mode 100644 config-ui/src/pages/connection/form/index.tsx
 delete mode 100644 config-ui/src/pages/connection/home/count.tsx
 delete mode 100644 config-ui/src/pages/connection/list/connection.tsx
 delete mode 100644 config-ui/src/pages/connection/list/index.tsx
 delete mode 100644 config-ui/src/pages/connection/list/styled.ts
 delete mode 100644 config-ui/src/plugins/components/connection-form/operate/index.ts
 delete mode 100644 config-ui/src/plugins/components/connection-form/operate/save.tsx
 delete mode 100644 config-ui/src/plugins/components/connection-form/operate/test.tsx
 copy config-ui/src/plugins/components/{data-scope-form => data-scope-form-2}/api.ts (100%)
 copy config-ui/src/plugins/components/{data-scope-form => data-scope-form-2}/index.tsx (50%)
 copy config-ui/src/plugins/components/{data-scope-form => data-scope-form-2}/styled.ts (91%)
 copy config-ui/src/{components/no-data/index.tsx => store/tips/context.tsx} (59%)
 copy config-ui/src/{plugins/register/ae => store/tips}/index.ts (96%)
 delete mode 100644 grafana/dashboards/DORA DEBUG.json
 create mode 100644 grafana/dashboards/DORADebug.json