You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@devlake.apache.org by "KyriosGN0 (via GitHub)" <gi...@apache.org> on 2025/05/07 11:06:46 UTC

[I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

KyriosGN0 opened a new issue, #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430

   ### Search before asking
   
   - [x] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   overtime the `_raw_jenkins_api_builds` table becomes full of records which are faulty, the params and input for a row are not in sync with the url of the jobs, i.e when params is `connectionId:"2", FullName:"FE/frontend"` the url points to a backend job in a different jenkins folder 
   
   ### What do you expect to happen
   
   records should be created correctly 
   
   ### How to reproduce
   
   configure projects with different multi-branch-pipelines and then after sometime those kinds of records will appear 
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   v1.0.2-beta7
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "KyriosGN0 (via GitHub)" <gi...@apache.org>.
KyriosGN0 commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-4021500079

   not stale


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3043177973

   This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "KyriosGN0 (via GitHub)" <gi...@apache.org>.
KyriosGN0 commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3263472730

   Not stale


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "KyriosGN0 (via GitHub)" <gi...@apache.org>.
KyriosGN0 commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3043466526

   Not stale
   Still needs a solution 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3716833138

   This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
dosubot[bot] commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-2858144391

   <!-- Answer -->
   To address the issue of the `_raw_jenkins_api_builds` table becoming bloated with faulty records, you can ensure that the job name and path are correctly extracted from the input when dealing with multi-branch workflows. The existing code snippet already includes a mechanism to handle this:
   
   ```go
   input := &SimpleJob{}
   err1 := json.Unmarshal(row.Input, input)
   if err1 == nil && input.Class == WORKFLOW_JOB {
       // For jobs from multi-branch workflow, the job name and path must come from the input,
       // otherwise it will be set to the multi-branch workflow name and path
       jobName = input.Name
       jobPath = input.Path
       fullName = fmt.Sprintf(`%s#%d`, input.FullName, body.Number)
   }
   ```
   
   This code checks if the input can be unmarshaled into a `SimpleJob` and if the class is `WORKFLOW_JOB`. If so, it uses the job name and path from the input, ensuring they are in sync with the URL of the jobs in Jenkins. This approach helps maintain consistency and prevents the table from being populated with incorrect records <sup>[[1]](https://github.com/apache/incubator-devlake/blob/main/backend/plugins/jenkins/tasks/build_extractor.go)</sup>.
   
   
   <!-- Dosu Comment Footer -->
   *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
   
   ---
   <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/660c1253-cc68-4e82-a516-5fa57334af7f?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/660c1253-cc68-4e82-a516-5fa57334af7f?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/660c1253-cc68-4e82-a516-5fa57334af7f?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/660c1253-cc68-4e82-a516-5fa57334af7f?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/660c1253-cc68-4e82-a516-5fa57334af7f?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/660c1253-cc68-4e82-a516-5fa57334af7f?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/660c1253-cc68-4e82-a516-5fa57334af7f?feedback_type=other)</sup>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-4020396746

   This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh closed issue #8430: [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records
URL: https://github.com/apache/incubator-devlake/issues/8430


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3263309581

   This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3499950123

   This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "KyriosGN0 (via GitHub)" <gi...@apache.org>.
KyriosGN0 commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3500900502

   Not stale


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug][Jenkins] _raw_jenkins_api_builds table becomes bloated with faulty records [incubator-devlake]

Posted by "KyriosGN0 (via GitHub)" <gi...@apache.org>.
KyriosGN0 commented on issue #8430:
URL: https://github.com/apache/incubator-devlake/issues/8430#issuecomment-3717290976

   Not stale


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org