You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@devlake.apache.org by "furlangiacomo (via GitHub)" <gi...@apache.org> on 2026/02/05 15:44:41 UTC
[I] [Bug][Module Name] Bug title [incubator-devlake]
furlangiacomo opened a new issue, #8698:
URL: https://github.com/apache/incubator-devlake/issues/8698
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues.
### What happened
After adding a new user via the /api/rest/plugins/org/users.csv API, we are seeing only `Finish a commit` activities in the work logs.
<img width="639" height="604" alt="Image" src="https://github.com/user-attachments/assets/e1d5d128-6726-423e-8efe-15c292d39385" />
### What do you expect to happen
We should also be able to see activities like `Review PR` or `Open a PR`, as we see from the GitHub profile
<img width="740" height="270" alt="Image" src="https://github.com/user-attachments/assets/72b7fa50-53b3-49ad-80c2-e774e5a7ca75" />
### How to reproduce
I haven’t found a way to reproduce the issue yet, and I’m not sure if you have any insights.
### Anything else
For users who were already present, it's working fine.
### Version
v1.0.3-beta9
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [incubator-devlake]
Posted by "furlangiacomo (via GitHub)" <gi...@apache.org>.
furlangiacomo commented on issue #8698:
URL: https://github.com/apache/incubator-devlake/issues/8698#issuecomment-3854832403
@dosu the user is present in the user_accounts table with entries in _raw_data_table set to gitextractor. I’ve noticed that for users who have both gitextractor and _raw_github_graphql_accounts, the work logs work as expected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8698:
URL: https://github.com/apache/devlake/issues/8698#issuecomment-6330499703
This issue has been closed because it has been inactive for a long time. You can reopen it if you encounter the similar problem in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8698:
URL: https://github.com/apache/devlake/issues/8698#issuecomment-6181604371
This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [devlake]
Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #8698:
URL: https://github.com/apache/devlake/issues/8698#issuecomment-5300132668
> I traced this through the code. It is not something you are doing wrong — the CSV upload simply cannot link a GitHub account in your situation, and your own observation about `gitextractor` vs `_raw_github_graphql_accounts` is exactly the tell.
>
> **Why only commit activities appear**
>
> There is exactly one subtask that links users to accounts, `ConnectUserAccountsExact` in [`backend/plugins/org/tasks/user_account.go`](https://github.com/apache/devlake/blob/main/backend/plugins/org/tasks/user_account.go), and it links an account only if one of three exact comparisons hits:
>
> if userId, ok := emails[account.Email]; account.Email != "" && ok { // line 79
> if userId, ok := names[account.FullName]; account.FullName != "" && ok { // line 87
> if userId, ok := names[account.UserName]; account.UserName != "" && ok { // line 95
> where `emails` and `names` are built from the `users.csv` rows (lines 49 and 52). There is no fuzzy matcher — those three are the whole mechanism.
>
> Now compare what each source puts in the `accounts` row:
>
> * **gitextractor** accounts carry the commit author's email and name, taken straight from the git
> history. Your `users.csv` email matches that, so the link is made and commit activities attribute
> correctly.
> * **GitHub** accounts copy `githubUser.Email`
> ([`account_convertor.go:151`](https://github.com/apache/devlake/blob/main/backend/plugins/github/tasks/account_convertor.go#L151)),
> and GitHub returns an **empty** email for any user who has not made it public — which is the
> default. With `account.Email == ""` the first branch is skipped by its own guard.
>
> That leaves only the name paths, and `users.csv` has no column for a provider login — its fields are just id, name, email and team ids. So the GitHub account links only if the GitHub **display name** or **login** happens to equal the `Name` in your CSV, character for character. If it does not, the GitHub account is never linked, and every PR/review activity, which attributes through that account, is missing — while commits keep working. That is precisely the split you are seeing.
>
> It also explains why pre-existing users are fine: they were linked when their name did match, or via a mapping that already existed. Note line 58 restricts the scan to `id NOT IN (SELECT account_id FROM user_accounts)`, so once an account is linked (or deliberately left unlinked) a later run will not revisit it.
>
> **What to do today**
>
> Link the GitHub accounts explicitly rather than relying on the match. There is a dedicated endpoint for it:
>
> ```
> PUT /plugins/org/user_account_mapping.csv
> ```
>
> `GET` the same path first to get the current mapping in the right shape, add a row pairing your user id with the GitHub account id (they look like `github:GithubAccount:1:12345678`), and PUT it back. That bypasses the matcher completely, and because of the line 58 filter it will also stop the exact matcher from trying to claim those accounts later.
>
> **A related defect I will raise separately**
>
> The email comparison is a plain map lookup with no case folding, so a CSV address of `TyroneKCummings@teleworm.us` will not match an account whose email is `tyronekcummings@teleworm.us`. Email addresses are treated case-insensitively in practice, and corporate git configs vs provider profiles differ in case all the time, so this silently drops links that should be made. It is not the cause of your specific problem — your gitextractor link is working — but it is the same class of failure and worth fixing.
>
> [@klesh](https://github.com/klesh) if the analysis looks right to you, the parts I would consider changing are: fold case when comparing emails, and let `users.csv` carry an optional provider login so linkage can be declared instead of guessed. Happy to send a PR for the first one now, and to discuss the second.
Thanks for the diligent analysis and thorough explanation. I totally agree with the email addresses should be case-insensitive.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [devlake]
Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #8698:
URL: https://github.com/apache/devlake/issues/8698#issuecomment-4719519222
> [@klesh](https://github.com/klesh), sorry for tagging you directly. Do you have any clue, or am I just doing something wrong?
Sorry for the late response, and unfortunately I have no clue either.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [incubator-devlake]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
dosubot[bot] commented on issue #8698:
URL: https://github.com/apache/incubator-devlake/issues/8698#issuecomment-3854859132
<!-- Answer -->
This happens because PR-related activities (like "Review PR" or "Open a PR") are only mapped to users if there are linked accounts from both gitextractor and GitHub GraphQL in the user_accounts table. The work logs join activities to users by matching account IDs from all relevant sources. If a user only has a gitextractor entry, only commit activities will show up; PR activities require a GitHub GraphQL account link as well.
To ensure full activity tracking, make sure the GitHub GraphQL plugin has collected account data for your users, and that the ConnectUserAccountsExact task (part of the org plugin) has run to link users and accounts by matching email, full name, or username. This subtask is enabled by default and runs automatically when the org plugin is included in your pipeline, but you can also trigger it manually if needed. No other background job performs this linkage—so if you add users or accounts via CSV, always ensure the mapping step runs to link all relevant accounts for each user. If PR activities are missing, check that the user has both gitextractor and GitHub GraphQL account entries and that their emails or usernames match for linking ([source](https://github.com/apache/incubator-devlake/blob/2c15ad880dce830c6512fa58039527cbf4745b8b/backend/plugins/org/tasks/user_account.go#L29-L110)).
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot).*
---
<sup>How did I do? [Good](https://app.dosu.dev/response-feedback/706b0bef-7cce-49fa-b056-216af771eda5?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/706b0bef-7cce-49fa-b056-216af771eda5?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/706b0bef-7cce-49fa-b056-216af771eda5?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/706b0bef-7cce-49fa-b056-216af771eda5?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/706b0bef-7cce-49fa-b056-216af771eda5?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/706b0bef-7cce-49fa-b056-216af771eda5?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/706b0bef-7cce-49fa-b056-216af771eda5?feedback_type=other)</sup>
[](https://app.dosu.dev/b4e8e847-d479-4541-83a8-d88d83fea5c9/ask?utm_source=github) [](https://cursor.com/link/prompt?text=This%20happens%20because%20PR-related%20activities%20%28like%20%22Review%20PR%22%20or%20%22Open%20a%20PR%22%29%20are%20only%20mapped%20to%20users%20if%20there%20are%20linked%20accounts%20from%20both%20gitextractor%20and%20GitHub%20GraphQL%20in%20the%20user_accounts%20table.%20The%20work%20logs%20join%20activities%20to%20users%20by%20matching%20account%20IDs%20from%20all%20relevant%20sources.%20If%20a%20user%20only%20has%20a%20gitextractor%20entry%2C%20only%20commit%20activities%20will%20show%20up%3B%20PR%20activities%20require%20a%20GitHub%20GraphQL%20account%20link%20as%20well.%0A%0ATo%20ensure%20full%20activity%20tracking%2C%20make%20sure%20the%20GitHub%20GraphQL%20plugin%20has%20collected%20account%20data%20for%20your%20users%2C%20and%20that%20t
he%20ConnectUserAccountsExact%20task%20%28part%20of%20the%20org%20plugin%29%20has%20run%20to%20link%20users%20and%20accounts%20by%20matching%20email%2C%20full%20name%2C%20or%20username.%20This%20subtask%20is%20enabled%20by%20default%20and%20runs%20automatically%20when%20the%20org%20plugin%20is%20included%20in%20your%20pipeline%2C%20but%20you%20can%20also%20trigger%20it%20manually%20if%20needed.%20No%20other%20background%20job%20performs%20this%20linkage%E2%80%94so%20if%20you%20add%20users%20or%20accounts%20via%20CSV%2C%20always%20ensure%20the%20mapping%20step%20runs%20to%20link%20all%20relevant%20accounts%20for%20each%20user.%20If%20PR%20activities%20are%20missing%2C%20check%20that%20the%20user%20has%20both%20gitextractor%20and%20GitHub%20GraphQL%20account%20entries%20and%20that%20their%20emails%20or%20usernames%20match%20for%20linking%C2%A0%28%5Bsource%5D%28https%3A//github.com/apache/incubator-devlake/blob/2c15ad880dce830c6512fa58039527cbf4745b8b/backend/plugins/org/tasks/user_acc
ount.go%23L29-L110%29%29.) [](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/incubator-devlake/issues/8698)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [devlake]
Posted by "vbhanuchander-lang (via GitHub)" <gi...@apache.org>.
vbhanuchander-lang commented on issue #8698:
URL: https://github.com/apache/devlake/issues/8698#issuecomment-5280035042
I traced this through the code. It is not something you are doing wrong — the CSV upload simply
cannot link a GitHub account in your situation, and your own observation about `gitextractor` vs
`_raw_github_graphql_accounts` is exactly the tell.
**Why only commit activities appear**
There is exactly one subtask that links users to accounts, `ConnectUserAccountsExact` in
[`backend/plugins/org/tasks/user_account.go`](https://github.com/apache/devlake/blob/main/backend/plugins/org/tasks/user_account.go),
and it links an account only if one of three exact comparisons hits:
```go
if userId, ok := emails[account.Email]; account.Email != "" && ok { // line 79
if userId, ok := names[account.FullName]; account.FullName != "" && ok { // line 87
if userId, ok := names[account.UserName]; account.UserName != "" && ok { // line 95
```
where `emails` and `names` are built from the `users.csv` rows (lines 49 and 52). There is no fuzzy
matcher — those three are the whole mechanism.
Now compare what each source puts in the `accounts` row:
- **gitextractor** accounts carry the commit author's email and name, taken straight from the git
history. Your `users.csv` email matches that, so the link is made and commit activities attribute
correctly.
- **GitHub** accounts copy `githubUser.Email`
([`account_convertor.go:151`](https://github.com/apache/devlake/blob/main/backend/plugins/github/tasks/account_convertor.go#L151)),
and GitHub returns an **empty** email for any user who has not made it public — which is the
default. With `account.Email == ""` the first branch is skipped by its own guard.
That leaves only the name paths, and `users.csv` has no column for a provider login — its fields are
just id, name, email and team ids. So the GitHub account links only if the GitHub **display name** or
**login** happens to equal the `Name` in your CSV, character for character. If it does not, the
GitHub account is never linked, and every PR/review activity, which attributes through that account,
is missing — while commits keep working. That is precisely the split you are seeing.
It also explains why pre-existing users are fine: they were linked when their name did match, or via
a mapping that already existed. Note line 58 restricts the scan to
`id NOT IN (SELECT account_id FROM user_accounts)`, so once an account is linked (or deliberately
left unlinked) a later run will not revisit it.
**What to do today**
Link the GitHub accounts explicitly rather than relying on the match. There is a dedicated endpoint
for it:
```
PUT /plugins/org/user_account_mapping.csv
```
`GET` the same path first to get the current mapping in the right shape, add a row pairing your user
id with the GitHub account id (they look like `github:GithubAccount:1:12345678`), and PUT it back.
That bypasses the matcher completely, and because of the line 58 filter it will also stop the exact
matcher from trying to claim those accounts later.
**A related defect I will raise separately**
The email comparison is a plain map lookup with no case folding, so a CSV address of
`TyroneKCummings@teleworm.us` will not match an account whose email is `tyronekcummings@teleworm.us`.
Email addresses are treated case-insensitively in practice, and corporate git configs vs provider
profiles differ in case all the time, so this silently drops links that should be made. It is not the
cause of your specific problem — your gitextractor link is working — but it is the same class of
failure and worth fixing.
@klesh if the analysis looks right to you, the parts I would consider changing are: fold case when
comparing emails, and let `users.csv` carry an optional provider login so linkage can be declared
instead of guessed. Happy to send a PR for the first one now, and to discuss the second.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [incubator-devlake]
Posted by "furlangiacomo (via GitHub)" <gi...@apache.org>.
furlangiacomo commented on issue #8698:
URL: https://github.com/apache/incubator-devlake/issues/8698#issuecomment-4023182787
@klesh, sorry for tagging you directly. Do you have any clue, or am I just doing something wrong?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [incubator-devlake]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
dosubot[bot] commented on issue #8698:
URL: https://github.com/apache/incubator-devlake/issues/8698#issuecomment-3854518711
<!-- Answer -->
This happens because after uploading users via `/api/rest/plugins/org/users.csv`, the new users are not automatically linked to their corresponding accounts in the user-account mapping table. Only commit activities are shown because those are matched by author info, but activities like "Review PR" or "Open a PR" require a proper user-account linkage to appear in work logs.
To fix this, make sure you also upload a `user_account_mapping.csv` via the `/api/rest/plugins/org/user_account_mapping.csv` endpoint after adding new users. This will link users to their accounts and allow all activities to be mapped correctly. Alternatively, you can trigger the user-account linking logic (ConnectUserAccountsExact) to match users and accounts by email, full name, or username. Without this step, only commit activities will show up for new users, while PR-related activities will be missing because the mapping is incomplete [see code details](https://github.com/apache/incubator-devlake/blob/2c15ad880dce830c6512fa58039527cbf4745b8b/backend/plugins/org/api/user.go#L65-L104) [and mapping logic](https://github.com/apache/incubator-devlake/blob/2c15ad880dce830c6512fa58039527cbf4745b8b/backend/plugins/org/tasks/user_account.go#L37-L110).
After updating the user-account mapping, re-run your data collection or refresh your dashboards to see the full set of activities for the new users.
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot).*
---
<sup>How did I do? [Good](https://app.dosu.dev/response-feedback/c83c2d50-c526-4791-b384-2fbbf5e35a74?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/c83c2d50-c526-4791-b384-2fbbf5e35a74?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/c83c2d50-c526-4791-b384-2fbbf5e35a74?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/c83c2d50-c526-4791-b384-2fbbf5e35a74?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/c83c2d50-c526-4791-b384-2fbbf5e35a74?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/c83c2d50-c526-4791-b384-2fbbf5e35a74?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/c83c2d50-c526-4791-b384-2fbbf5e35a74?feedback_type=other)</sup>
[](https://app.dosu.dev/b4e8e847-d479-4541-83a8-d88d83fea5c9/ask?utm_source=github) [](https://cursor.com/link/prompt?text=This%20happens%20because%20after%20uploading%20users%20via%20%60/api/rest/plugins/org/users.csv%60%2C%20the%20new%20users%20are%20not%20automatically%20linked%20to%20their%20corresponding%20accounts%20in%20the%20user-account%20mapping%20table.%20Only%20commit%20activities%20are%20shown%20because%20those%20are%20matched%20by%20author%20info%2C%20but%20activities%20like%20%22Review%20PR%22%20or%20%22Open%20a%20PR%22%20require%20a%20proper%20user-account%20linkage%20to%20appear%20in%20work%20logs.%20%0A%0ATo%20fix%20this%2C%20make%20sure%20you%20also%20upload%20a%20%60user_account_mapping.csv%60%20via%20the%20%60/api/rest/plugins/org/user_account_mapping.csv%60%20endpoint%20after%20adding%20new%20users.%20This%20will%20link%20users%20to%20their%20acco
unts%20and%20allow%20all%20activities%20to%20be%20mapped%20correctly.%20Alternatively%2C%20you%20can%20trigger%20the%20user-account%20linking%20logic%20%28ConnectUserAccountsExact%29%20to%20match%20users%20and%20accounts%20by%20email%2C%20full%20name%2C%20or%20username.%20Without%20this%20step%2C%20only%20commit%20activities%20will%20show%20up%20for%20new%20users%2C%20while%20PR-related%20activities%20will%20be%20missing%20because%20the%20mapping%20is%20incomplete%C2%A0%5Bsee%20code%20details%5D%28https%3A//github.com/apache/incubator-devlake/blob/2c15ad880dce830c6512fa58039527cbf4745b8b/backend/plugins/org/api/user.go%23L65-L104%29%C2%A0%5Band%20mapping%20logic%5D%28https%3A//github.com/apache/incubator-devlake/blob/2c15ad880dce830c6512fa58039527cbf4745b8b/backend/plugins/org/tasks/user_account.go%23L37-L110%29.%0A%0AAfter%20updating%20the%20user-account%20mapping%2C%20re-run%20your%20data%20collection%20or%20refresh%20your%20dashboards%20to%20see%20the%20full%20set%20of%20activiti
es%20for%20the%20new%20users.) [](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/incubator-devlake/issues/8698)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [devlake]
Posted by "furlangiacomo (via GitHub)" <gi...@apache.org>.
furlangiacomo commented on issue #8698:
URL: https://github.com/apache/devlake/issues/8698#issuecomment-4709157957
Anyone can help on this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][GitHub] Activities not present in worklogs [devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #8698: [Bug][GitHub] Activities not present in worklogs
URL: https://github.com/apache/devlake/issues/8698
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org