You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@devlake.apache.org by "MarcViola (via GitHub)" <gi...@apache.org> on 2023/08/01 13:18:39 UTC
[GitHub] [incubator-devlake] MarcViola opened a new issue, #5783: [Bug][gitlab] gitlab connection syncs indefinitely
MarcViola opened a new issue, #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues.
### What happened
A gitlab connection never finishes to collect data. When the job is successful, it takes about 12 min. to complete. Every now and then the job runs continuously for days without completing. The cancel button doesn't cancel the job. I restart the devlake containers to end it.
Other gitlab jobs run just fine, there seems to be something special with this one.
I thought it was a one-time event but it's been happening a few times now.
### What do you expect to happen
Scan to complete in about 12 min.
### How to reproduce
Create project with a gitlab connection. Select a number of repositories. Create a daily schedule. Monitor job for status.
### Anything else
_No response_
### Version
v0.17.0
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1664116077
CPU idle and Free mem during the night when data collection is happening. I have disabled the collection of unused projects and will monitor again tonight and see if it makes a difference. It does look like resources may be a problem at some point.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1660301505
wrongly closed the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] klesh commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1660407167
@MarcViola Thanks for your report, there were so many tasks, can you point out which task failed/stucked?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1660413571
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1669655778
I will add more memory to the VM. I'll close the ticket for now and re-open if it's still an issue. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1660300556
Attached a failure and a successful job.
[logging fail.tar.gz](https://github.com/apache/incubator-devlake/files/12229572/logging.fail.tar.gz)
[logging succ.tar.gz](https://github.com/apache/incubator-devlake/files/12229573/logging.succ.tar.gz)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola closed issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola closed issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
URL: https://github.com/apache/incubator-devlake/issues/5783
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola closed issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola closed issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
URL: https://github.com/apache/incubator-devlake/issues/5783
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] MarcViola commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "MarcViola (via GitHub)" <gi...@apache.org>.
MarcViola commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1660760176
The container itself is ok. Storage is ok. But I'll setup some monitoring and see what happens to CPU and memory.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] klesh commented on issue #5783: [Bug][gitlab] gitlab connection syncs indefinitely
Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #5783:
URL: https://github.com/apache/incubator-devlake/issues/5783#issuecomment-1660437961
Seems like the connection to the database had failed. Maybe the mysql container crash for some reason? How about the storage and memeory usage? Can you set up some monitoring mechanism for it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org