[GitHub] [incubator-devlake] warren830 opened a new issue, #3710: [Bug][Tapd] Incremental collection works improperly

[GitBox <gi...@apache.org>]

warren830 opened a new issue, #3710:
URL: https://github.com/apache/incubator-devlake/issues/3710

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   Recently when we are trying to collect story_commits by incrementally, we found some minor issues:
   1. when doing incremental collection, we misused UTC and time.Format for the field modified which is used in url, as tapd time are all in China, but we store all data as UTC time in db, so we need to transform time to CstZone
   2. we used a wrong way to collect xxCommits, the old way will miss data which created after last modification of story/bug/task. For example, we already have story_commit which created on 2022-11-02, and that story was modified on 2022-11-01, then we collect both data on 2022-11-03, and we connected another commit to any story on 2022-11-04, then we tried to collect data again on 2022-11-05, we will not collect commits for the story which modified before 2022-11-02, because connect a commit to a story, the story's filed modified will not be changed.
   
   ### What do you expect to happen
   
   none
   
   ### How to reproduce
   
   none
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   main
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-devlake] abeizn closed issue #3710: [Bug][Tapd] Incremental collection works improperly

[GitBox <gi...@apache.org>]

abeizn closed issue #3710: [Bug][Tapd] Incremental collection works improperly
URL: https://github.com/apache/incubator-devlake/issues/3710


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org