You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "WuliHuazai (via GitHub)" <gi...@apache.org> on 2024/03/21 04:51:54 UTC
[I] [Bug] AUTO PARTITION change [doris]
WuliHuazai opened a new issue, #32596:
URL: https://github.com/apache/doris/issues/32596
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
apache-doris-2.1.0-bin-x64
### What's Wrong?
Create Sql:
CREATE TABLE IF NOT EXISTS test_db.testMonth
(
profileId bigint NOT NULL,
reportDateTime date NOT NULL,
keywordId bigint NOT NULL,
....
)
UNIQUE KEY(profileId,reportDateTime,keywordId)
AUTO PARTITION BY RANGE date_trunc(reportDateTime,'MONTH')
(
)
DISTRIBUTED BY HASH(reportDateTime) BUCKETS 10
PROPERTIES (
"dynamic_partition.enable" = "true",
"dynamic_partition.time_unit" = "MONTH",
"dynamic_partition.start" = "-12",
"dynamic_partition.end" = "1",
"dynamic_partition.prefix" = "p",
"dynamic_partition.create_history_partition"="true",
"replication_num" = "3"
);
When I use Kafka to synchronize data to doris，The AUTO PARTITION is changed：
AUTO PARTITION BY RANGE date_trunc(`B`.null, 'MONTH')
(PARTITION p202303 VALUES [('2023-03-01'), ('2023-04-01')),
PARTITION p202304 VALUES [('2023-04-01'), ('2023-05-01')),
PARTITION p202305 VALUES [('2023-05-01'), ('2023-06-01')),
PARTITION p202306 VALUES [('2023-06-01'), ('2023-07-01')),
PARTITION p202307 VALUES [('2023-07-01'), ('2023-08-01')),
PARTITION p202308 VALUES [('2023-08-01'), ('2023-09-01')),
PARTITION p202309 VALUES [('2023-09-01'), ('2023-10-01')),
PARTITION p202310 VALUES [('2023-10-01'), ('2023-11-01')),
PARTITION p202311 VALUES [('2023-11-01'), ('2023-12-01')),
PARTITION p202312 VALUES [('2023-12-01'), ('2024-01-01')),
PARTITION p202401 VALUES [('2024-01-01'), ('2024-02-01')),
PARTITION p202402 VALUES [('2024-02-01'), ('2024-03-01')),
PARTITION p202403 VALUES [('2024-03-01'), ('2024-04-01')),
PARTITION p202404 VALUES [('2024-04-01'), ('2024-05-01')))
I WOULD LIKE TO ASK WHY AUTO PARTITION IS CHANGING？
### What You Expected?
how to change AUTO PARTITION with ‘AUTO PARTITION BY RANGE date_trunc(reportDateTime,'MONTH')’ and why this wrong happend？
### How to Reproduce?
Kafka to doris send about 40000000 message
### Anything Else?
none
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] AUTO PARTITION change [doris]
Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on issue #32596:
URL: https://github.com/apache/doris/issues/32596#issuecomment-2405506922
> do your solve the problem? i have met the same problem
yes. this bug was fixed since doris-2.1.4. for the version before it, disable falling back to old planner will avoid it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] AUTO PARTITION change [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #32596:
URL: https://github.com/apache/doris/issues/32596#issuecomment-3288991644
We're closing this issue because it hasn't been updated in a while.
If you'd like to revive this issue, please reopen it and feel free a maintainer to remove the Stale tag!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] AUTO PARTITION change [doris]
Posted by "mark-triker (via GitHub)" <gi...@apache.org>.
mark-triker commented on issue #32596:
URL: https://github.com/apache/doris/issues/32596#issuecomment-2403697954
do your solve the problem? i have met the same problem
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] AUTO PARTITION change [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman closed issue #32596: [Bug] AUTO PARTITION change
URL: https://github.com/apache/doris/issues/32596
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] AUTO PARTITION change [doris]
Posted by "someorz (via GitHub)" <gi...@apache.org>.
someorz commented on issue #32596:
URL: https://github.com/apache/doris/issues/32596#issuecomment-2134244278
我也遇到了，分区字段会变，AUTO PARTITION 我使用的是list方式，写入一些数据后分区字段变了，很奇怪的是，'dr'.'dt'，dr其实是接口表名的别名。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] AUTO PARTITION change [doris]
Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on issue #32596:
URL: https://github.com/apache/doris/issues/32596#issuecomment-2014290723
hi, can you add my wechat torch-wood_ for more information?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org