You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/04/14 13:22:25 UTC
[GitHub] [incubator-doris] liutang123 opened a new issue, #9032: [Bug] Compaction leads to schema change error
liutang123 opened a new issue, #9032:
URL: https://github.com/apache/incubator-doris/issues/9032
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Version
0.14
### What's Wrong?
base tablet：[0-62][63-64][65-65][66-66][67-67]
new tablet:[50-65][66-66][67-67]
begin compaction in new tablet: [50-65][66-66]
`begin to remove all data from new tablet to prevent rewrite.`
new tablet: [50-65][66-66][67-67] will move to `TimestampedVersionTracker._stale_version_path_map`
compaction end in new tablet: [50-66] will be inserted into new tablet.
begin convert base tablet to new tablet:
insert [0-62] to new tablet and new tablet will be[0-62][50-66]
insert [63-64] will fail.
```version already exist, version revert occurred. tablet=XXXXX, version='63-64```
[65-65] and [66-66] will fail too.
```version already exist, version revert occurred. tablet=XXXXX, version='66-66```
insert [67-67] to new tablet, and new tabelt will be: [0-62][50-66][67]
Because the removed rowset can be query now, `check_version_integrity([0-67])` will success and the schema cahnge will success.
```
I0412 21:42:58.683157 60051 schema_change.cpp:1953] finish converting rowsets for new_tablet from base_tablet. base_tablet=XXXXX, new_tablet=XXXXX
I0412 21:42:58.700071 60051 engine_alter_tablet_task.cpp:52] success to create new alter tablet. res=0 base_tablet_id=XXXX, base_schema_hashXXXX, new_tablet_id=XXXX, new_schema_hash=XXXX
```
### What You Expected?
1. compaction should not add output rowset to tablet if the origin rowsets not in tablet's `_rs_version_map`.
2. schema change should check new tablet's `_rs_version_map`
3. tablet report should check if a tablet has intersected versions.
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman closed issue #9032: [Bug] Compaction leads to schema change error
Posted by GitBox <gi...@apache.org>.
morningman closed issue #9032: [Bug] Compaction leads to schema change error
URL: https://github.com/apache/incubator-doris/issues/9032
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #9032: [Bug] Compaction leads to schema change error
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #9032:
URL: https://github.com/apache/incubator-doris/issues/9032#issuecomment-1133917452
I think can do this to fix the issue:
When the compaction finished, check if the input rowset still available in tablet, if not, the compaction will be failed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] wangbo commented on issue #9032: [Bug] Compaction leads to schema change error
Posted by GitBox <gi...@apache.org>.
wangbo commented on issue #9032:
URL: https://github.com/apache/incubator-doris/issues/9032#issuecomment-1099185918
Brother Jia 🐂🍺, YYDS
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org