You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@devlake.apache.org by "michaelawarren (via GitHub)" <gi...@apache.org> on 2024/02/28 15:33:49 UTC
[I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
michaelawarren opened a new issue, #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues.
### What happened
The Azure Devops Plugin is pulling in very old builds and not new / recent builds.
Configuration is to pull in latest data
Database shows that the dates are for old builds
_tool data indicates the same storry
### What do you expect to happen
I expect when i use the default config for dev lake to pull the most recent builds.
### How to reproduce
set up an azure devops project to pull in data from and azure devops pipeline following all the indicated steps in the app and run.
### Anything else
_No response_
### Version
0.21.0-beta4
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7048: [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data
URL: https://github.com/apache/incubator-devlake/issues/7048
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2465932760
This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2143164559
This issue has been closed because it has been inactive for a long time. You can reopen it if you encounter the similar problem in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "michaelawarren (via GitHub)" <gi...@apache.org>.
michaelawarren commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2000595890
All repos are private repos. I'm not sure what sets aside the ones that can be seen vs the ones that cannot be seen. They should be configured the same.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2606012133
This issue has been closed because it has been inactive for a long time. You can reopen it if you encounter the similar problem in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "michaelawarren (via GitHub)" <gi...@apache.org>.
michaelawarren commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1971863537
I tested the endpoints and they give the same information that exists in devops. So that leads me to a new question. The pipelines do have more recent builds however those builds are linked to github repos not azure dev ops repos. How do i still get the azure dev ops builds that are linked to github repos?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "keon94 (via GitHub)" <gi...@apache.org>.
keon94 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2015376813
@d4x1 This PR will add debug logging around API calls in PyDevLake. Please review it:
https://github.com/apache/incubator-devlake/pull/7206
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2282944161
This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "d4x1 (via GitHub)" <gi...@apache.org>.
d4x1 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2014511220
> All repos are private repos. I'm not sure what sets aside the ones that can be seen vs the ones that cannot be seen. They should be configured the same.
I am not sure either. Some debugging and test works are needed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "d4x1 (via GitHub)" <gi...@apache.org>.
d4x1 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2014510448
@keon94 We need your help~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2130547178
This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2017176992
I just took he liberty and merged the PR. @keon94 @d4x1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1991174386
@keon94 Can you support the `timeAfter`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2588488387
This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "d4x1 (via GitHub)" <gi...@apache.org>.
d4x1 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1970817943
@michaelawarren
AzureDevops is implemented with Pythin, whose behaviors are different from other golang based plugins more or less.
I think you're right.
First, I haven't found any codes that process the time range option. It's a bug definitly.
Second, althrough the time range doesn't work, you can still collect your repos' all build therotically.
I have test it locally and it works.
So you can visit this api `https://dev.azure.com/{org}/{project}/_apis/build/builds?repositoryId={repo_id}&repositoryType=tfsgit&deletedFilter=excludeDeleted` ([api detail](https://learn.microsoft.com/en-us/rest/api/azure/devops/build/builds/list?view=azure-devops-rest-7.1)) and see it's returns.
Repo id can be found with api: `https://dev.azure.com/{org}/{project}/_apis/git/repositories/`, and `repositoryType` should be set correctly depends on your repo's config.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "michaelawarren (via GitHub)" <gi...@apache.org>.
michaelawarren commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1973433685
Config:
* Repos/code exist in Github
* Build pipelines exist in Azure devops
Expectation:
* I expect to be able to load builds in to devlake from azure devops without an azure devops repo associated with the build pipeline.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "d4x1 (via GitHub)" <gi...@apache.org>.
d4x1 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1972631206
I don't understand what's your current config and what do you expect.
Please decribe them in detail as much as possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1982228785
@keon94 Would you like to work on it? Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7048: [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data
URL: https://github.com/apache/incubator-devlake/issues/7048
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "d4x1 (via GitHub)" <gi...@apache.org>.
d4x1 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1978577730
@michaelawarren I know your use case. Thank you for your feedback.
Can you see your GitHub repos in Azure DevOps' repo page ?
<img width="922" alt="image" src="https://github.com/apache/incubator-devlake/assets/5844806/9cba1845-e3d4-431a-9cd0-483f06e1e8fe">
When creating Azure DevOps connection in DevLake, which data scope have you chosen?
<img width="758" alt="image" src="https://github.com/apache/incubator-devlake/assets/5844806/7f758b56-e9d3-43ce-8c91-66134bd2d796">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "michaelawarren (via GitHub)" <gi...@apache.org>.
michaelawarren commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1979400747
No we do not see the git hub repos in azure devops repo list. We see the old ado repos.
In the add data scopes page i've been selecting the ADO repo. Which explains why i only see the old build since it only shows builds associated with the ADO repo and no builds associated with the new GitHub Repos.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "d4x1 (via GitHub)" <gi...@apache.org>.
d4x1 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1980043403
@michaelawarren Thank you for your reply.
If your GitHub repos can be selected in Azure DevOps connection, the you can couple repos and pipelines correctly. I think it's a bug. Let me try to find wha't wrong with it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "keon94 (via GitHub)" <gi...@apache.org>.
keon94 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1986367534
I probably won't do the dev work for this but I can try to help. @michaelawarren are the missing repos private? Anything that makes them different than the ones that do show up on the list?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "keon94 (via GitHub)" <gi...@apache.org>.
keon94 commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-2015084399
The APIs this plugin deals with are [here](https://github.com/apache/incubator-devlake/blob/main/backend/python/plugins/azuredevops/azuredevops/api.py).
Those of interest are git_repos (azdevops managed repos) and external__repositories (unmanaged repos that are referenced by azure builds). Sounds like git_repos works as expected. You need to test what external_repositories returns via curl/postman.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Azure devops plugin] Azure Devop plugin doesn't pull in current data [incubator-devlake]
Posted by "Startrekzky (via GitHub)" <gi...@apache.org>.
Startrekzky commented on issue #7048:
URL: https://github.com/apache/incubator-devlake/issues/7048#issuecomment-1969282592
Hi @d4x1 , could you take a look at this issue? I looked at it and I thought it was a bug.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org