You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@devlake.apache.org by "sstojak1 (via GitHub)" <gi...@apache.org> on 2025/01/21 08:10:39 UTC

[I] [Feature][All] Truncate non-domain tables [incubator-devlake]

sstojak1 opened a new issue, #8276:
URL: https://github.com/apache/incubator-devlake/issues/8276

### Search before asking

- [x] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar feature requirement.

### Use case

As a developer, I want to avoid having excessively large raw/tool tables in DevLake, as they consume significant storage and may impact performance. I would prefer a mechanism to manage these tables efficiently, such as automatic deletion or truncation of old records, to keep the system optimized.

### Description

Is it possible for DevLake to automatically delete or truncate non-domain tables? My understanding is that raw/tool tables are only required to transform data into domain tables. Once the data is transformed and pushed to domain tables, older records (beyond the most recent import) are no longer used.
We’re importing a large number of Jira boards (around 100) frequently, which is causing these raw tables to grow significantly. This issue isn't limited to Jira but applies to all tools supported by DevLake.
I’ve attached a screenshot showing an overview of the sizes for all our tables for reference.

### Related issues

_No response_

### Are you willing to submit a PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature][All] Truncate non-domain tables [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.

github-actions[bot] closed issue #8276: [Feature][All] Truncate non-domain tables
URL: https://github.com/apache/incubator-devlake/issues/8276


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature][All] Truncate non-domain tables [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.

github-actions[bot] commented on issue #8276:
URL: https://github.com/apache/incubator-devlake/issues/8276#issuecomment-2745932482

   This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature][All] Truncate non-domain tables [incubator-devlake]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.

github-actions[bot] commented on issue #8276:
URL: https://github.com/apache/incubator-devlake/issues/8276#issuecomment-2764309252

   This issue has been closed because it has been inactive for a long time. You can reopen it if you encounter the similar problem in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org