You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@devlake.apache.org by "khalibartan (via GitHub)" <gi...@apache.org> on 2025/04/25 09:23:04 UTC
[D] Gitextractor failing with multiple github tokens [incubator-devlake]
GitHub user khalibartan created a discussion: Gitextractor failing with multiple github tokens
Whenever I add multiple github tokens the gitextractor plugin starts to fail with error, if only keep one token it works correctly. I have individually verified all tokens and they are working correctly individually
```in failed: Cloning into bare repository '/tmp/gitextractor3209794320'... | remote: Support for password authentication was removed on August 13, 2021. | remote: Please see https://docs.github.com/get-started/getting-started-with-git/about-remote-repositories#cloning-with-https-urls for information on currently recommended modes of authentication. | fatal: Authentication failed for 'https://github.com/dreamplug-tech/caterpillar.git/' Error types: (1) *hintdetail.withDetail (2) *errors.errorString```
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "khalibartan (via GitHub)" <gi...@apache.org>.
GitHub user khalibartan added a comment to the discussion: Gitextractor failing with multiple github tokens
Btw, for timebeing i went ahead with configuring SSH for gitextractor instead of github tokens, we can put it as an response. It also helps avoid github api token limits
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-13047260
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "klesh (via GitHub)" <gi...@apache.org>.
GitHub user klesh added a comment to the discussion: Gitextractor failing with multiple github tokens
@khalibartan I see, can you file an issue? I will get into it ASAP.
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-13046740
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "khalibartan (via GitHub)" <gi...@apache.org>.
GitHub user khalibartan added a comment to the discussion: Gitextractor failing with multiple github tokens
raised https://github.com/apache/incubator-devlake/issues/8424
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-13047241
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "khalibartan (via GitHub)" <gi...@apache.org>.
GitHub user khalibartan added a comment to the discussion: Gitextractor failing with multiple github tokens
@klesh can you help?
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-12976938
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "dimapasko (via GitHub)" <gi...@apache.org>.
GitHub user dimapasko added a comment to the discussion: Gitextractor failing with multiple github tokens
I can confirm that I started encountering the same error after adding the second token
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-13014163
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
GitHub user dosubot[bot] added a comment to the discussion: Gitextractor failing with multiple github tokens
<!-- Answer -->
The error message indicates that the authentication method being used is outdated, as GitHub removed support for password authentication in August 2021. The gitextractor plugin supports authentication using personal access tokens, which should be configured correctly.
When using multiple GitHub tokens, ensure that each token is from a different GitHub account, as tokens from the same account share the rate limit. The plugin selects the first token from a comma-separated list for authentication, so verify that the tokens are correctly formatted and separated <sup>[[1]](https://github.com/apache/incubator-devlake/blob/main/config-ui/src/plugins/register/github/connection-fields/token.tsx)</sup>.
Additionally, check that the tokens have the necessary permissions. For private repositories, the required permissions are `repo`, `read:user`, and `read:org` <sup>[[2]](https://github.com/apache/incubator-devlake-website/blob/main/versioned_docs/version-v0.19/Configuration/GitHub.md)</sup>. If you are using fine-grained tokens, ensure they have read-only permissions for entities like `Actions`, `Contents`, `Discussions`, `Issues`, `Metadata`, and `Pull requests` <sup>[[3]](https://github.com/apache/incubator-devlake-website/blob/main/versioned_docs/version-v0.20/Configuration/GitHub.md)</sup>.
If the issue persists, consider reviewing the plugin's logging capabilities to diagnose authentication issues <sup>[[4]](https://github.com/apache/incubator-devlake/blob/main/backend/plugins/gitextractor/parser/clone_gitcli.go)</sup>.
<!-- Dosu Comment Footer -->
*To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
---
<sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/a6f18b37-0d75-4bd6-b989-fbd94563c122?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/a6f18b37-0d75-4bd6-b989-fbd94563c122?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/a6f18b37-0d75-4bd6-b989-fbd94563c122?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/a6f18b37-0d75-4bd6-b989-fbd94563c122?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/a6f18b37-0d75-4bd6-b989-fbd94563c122?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/a6f18b37-0d75-4bd6-b989-fbd94563c122?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/a6f18b37-0d75-4bd6-b989-fbd94563c122?feedback_type=other)</sup>
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-12945379
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "khalibartan (via GitHub)" <gi...@apache.org>.
GitHub user khalibartan edited a comment on the discussion: Gitextractor failing with multiple github tokens
For time being i went ahead with configuring SSH for gitextractor instead of github tokens, we can put it as an response. It also helps avoid github api token limits
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-13047260
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org
Re: [D] Gitextractor failing with multiple github tokens [incubator-devlake]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
GitHub user dosubot[bot] edited a comment on the discussion: Gitextractor failing with multiple github tokens
<!-- Answer -->
The error message indicates that the authentication method being used is outdated, as GitHub removed support for password authentication in August 2021. The gitextractor plugin supports authentication using personal access tokens, which should be configured correctly.
When using multiple GitHub tokens, ensure that each token is from a different GitHub account, as tokens from the same account share the rate limit. The plugin selects the first token from a comma-separated list for authentication, so verify that the tokens are correctly formatted and separated <sup>[[1]](https://github.com/apache/incubator-devlake/blob/main/config-ui/src/plugins/register/github/connection-fields/token.tsx)</sup>.
Additionally, check that the tokens have the necessary permissions. For private repositories, the required permissions are `repo`, `read:user`, and `read:org` <sup>[[2]](https://github.com/apache/incubator-devlake-website/blob/main/versioned_docs/version-v0.19/Configuration/GitHub.md)</sup>. If you are using fine-grained tokens, ensure they have read-only permissions for entities like `Actions`, `Contents`, `Discussions`, `Issues`, `Metadata`, and `Pull requests` <sup>[[3]](https://github.com/apache/incubator-devlake-website/blob/main/versioned_docs/version-v0.20/Configuration/GitHub.md)</sup>.
If the issue persists, consider reviewing the plugin's logging capabilities to diagnose authentication issues <sup>[[4]](https://github.com/apache/incubator-devlake/blob/main/backend/plugins/gitextractor/parser/clone_gitcli.go)</sup>.
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=reply-with-mention&utm_term=apache%2Fincubator-devlake).*
---
Share context across your team and agents. Try [Dosu](https://dosu.dev?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-tagline&utm_term=apache%2Fincubator-devlake).
[](https://app.dosu.dev/response-feedback?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-feedback&utm_term=apache%2Fincubator-devlake#message_id=a6f18b37-0d75-4bd6-b989-fbd94563c122) [](https://github.dosu.com/apache/incubator-devlake?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-learn-repo&utm_term=apache%2Fincubator-devlake) [](https://app.dosu.dev/signup?referrer=openSource&source=github-footer&utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-add-team&utm_term=apache%2Fincubator-devlake)
GitHub link: https://github.com/apache/incubator-devlake/discussions/8406#discussioncomment-12945379
----
This is an automatically sent email for dev@devlake.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@devlake.apache.org