You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by "bb33chen (via GitHub)" <gi...@apache.org> on 2025/09/26 07:44:28 UTC
[D] Why doesn't Doris support quarter aggregation? [superset]
GitHub user bb33chen created a discussion: Why doesn't Doris support quarter aggregation?
<img width="1911" height="919" alt="WeChatWorkScreenshot_89b40fc9-0ba8-4d75-be55-42477415b0fb" src="https://github.com/user-attachments/assets/f7249d04-a758-4eca-890a-9ba99d574e4e" />
<img width="1899" height="501" alt="WeChatWorkScreenshot_5b2e061e-fa11-4db5-a3ae-4479a305a97b" src="https://github.com/user-attachments/assets/bb287016-7a85-4176-93b9-49e60f032e5a" />
GitHub link: https://github.com/apache/superset/discussions/35304
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "bb33chen (via GitHub)" <gi...@apache.org>.
GitHub user bb33chen added a comment to the discussion: Why doesn't Doris support quarter aggregation?
@dosubot
Hi dosu, can you help to resolve this problem?
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519718
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
GitHub user dosubot[bot] added a comment to the discussion: Why doesn't Doris support quarter aggregation?
<!-- Greeting -->
Hi @bb33chen! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the superset team.
<!-- Answer -->
Doris (and MySQL) don't support 'QUARTER' as a valid interval unit in SQL, which is why quarter aggregation fails with a syntax error in Superset. Superset's Doris engine spec inherits MySQL's unsupported quarter syntax, so there's no working quarter time grain by default.
To work around this, you can remove the time grain setting in Superset and use a custom SQL expression in your chart's x-axis to manually extract the year and quarter. For example, you could use something like `CONCAT(YEAR(Shipping_Date), '-Q', QUARTER(Shipping_Date))` if Doris supports the `QUARTER()` function for extracting the quarter number, or build a calculated column in your dataset that represents year and quarter as a string (like `'2024-Q1'`) and group by that column instead. This approach is commonly used for databases that lack native quarter support in their time grain functions [example workaround](https://github.com/apache/superset/issues/26383#issuecomment-1883395006).
If you want a more permanent fix, you could customize the Doris engine spec in Superset to add a working quarter time grain expression, similar to how other databases (like Impala) use `DATE_TRUNC('quarter', {col})` [see reference](https://github.com/apache/superset/issues/33033), but this would require code changes.
Make sure your datetime column is of a recognized datetime type in Doris, as Superset's time grain controls only work with temporal columns [details](https://github.com/apache/superset/discussions/33692).
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot).*
---
<sup>How did I do? [Good](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=other)</sup> [](https://app.dosu.dev/a28d3c7e-a9d3-459e-9fb6-3a6f9ff4f357/ask?utm_source=github)&
nbsp;[](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/superset/discussions/35304)
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519748
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "bb33chen (via GitHub)" <gi...@apache.org>.
GitHub user bb33chen added a comment to the discussion: Why doesn't Doris support quarter aggregation?
@villebro
Could you help point out the specific code location for the modification?
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519935
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "bb33chen (via GitHub)" <gi...@apache.org>.
GitHub user bb33chen added a comment to the discussion: Why doesn't Doris support quarter aggregation?
> Hi @bb33chen! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the superset team.
>
> Doris (and MySQL) don't support 'QUARTER' as a valid interval unit in SQL, which is why quarter aggregation fails with a syntax error in Superset. Superset's Doris engine spec inherits MySQL's unsupported quarter syntax, so there's no working quarter time grain by default.
>
> To work around this, you can remove the time grain setting in Superset and use a custom SQL expression in your chart's x-axis to manually extract the year and quarter. For example, you could use something like `CONCAT(YEAR(Shipping_Date), '-Q', QUARTER(Shipping_Date))` if Doris supports the `QUARTER()` function for extracting the quarter number, or build a calculated column in your dataset that represents year and quarter as a string (like `'2024-Q1'`) and group by that column instead. This approach is commonly used for databases that lack native quarter support in their time grain functions [example workaround](https://github.com/apache/superset/issues/26383#issuecomment-1883395006).
>
> If you want a more permanent fix, you could customize the Doris engine spec in Superset to add a working quarter time grain expression, similar to how other databases (like Impala) use `DATE_TRUNC('quarter', {col})` [see reference](https://github.com/apache/superset/issues/33033), but this would require code changes.
>
> Make sure your datetime column is of a recognized datetime type in Doris, as Superset's time grain controls only work with temporal columns [details](https://github.com/apache/superset/discussions/33692).
>
> _To reply, just mention [@dosu](https://go.dosu.dev/dosubot)._
>
> How did I do? [Good](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/27479836-6728-48f6-a3ac-f73ef204725c?feedback_type=other) [](https://app.dosu.dev/a28d3c7e-a9d3-459e-9fb6-3a6f9ff4f357/ask?utm_source=github) [](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/superset/discussions/35304)
Could you help point out the specific code location for the modification?
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519895
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "bb33chen (via GitHub)" <gi...@apache.org>.
GitHub user bb33chen added a comment to the discussion: Why doesn't Doris support quarter aggregation?
Could you help point out the specific code location for the modification?
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519890
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "bb33chen (via GitHub)" <gi...@apache.org>.
GitHub user bb33chen edited a comment on the discussion: Why doesn't Doris support quarter aggregation?
@villebro @claude @mistercrunch @betodealmeida
Hi all, can you help to resolve this problem?
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519718
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
GitHub user dosubot[bot] added a comment to the discussion: Why doesn't Doris support quarter aggregation?
<!-- Answer -->
The code you need to modify is in superset/db_engine_specs/doris.py, inside the DorisEngineSpec class. To fix quarter aggregation, override the _time_grain_expressions dictionary in DorisEngineSpec and provide a Doris-compatible SQL expression for TimeGrain.QUARTER. For example, if Doris supports QUARTER() and YEAR(), you could use something like:
```python
from superset.db_engine_specs.base import TimeGrain
_time_grain_expressions = {
**MySQLEngineSpec._time_grain_expressions,
TimeGrain.QUARTER: "CONCAT(YEAR({col}), '-Q', QUARTER({col}))",
}
```
This approach is similar to how other engines (like Impala) define custom time grains in their engine spec files ([reference](https://github.com/apache/superset/issues/33033)). The key is to override the inherited MySQL quarter logic, which Doris does not support, with an expression that works for Doris.
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot).*
---
<sup>How did I do? [Good](https://app.dosu.dev/response-feedback/1aa96df4-9dce-4cd6-869d-6e50d15e885f?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/1aa96df4-9dce-4cd6-869d-6e50d15e885f?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/1aa96df4-9dce-4cd6-869d-6e50d15e885f?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/1aa96df4-9dce-4cd6-869d-6e50d15e885f?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/1aa96df4-9dce-4cd6-869d-6e50d15e885f?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/1aa96df4-9dce-4cd6-869d-6e50d15e885f?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/1aa96df4-9dce-4cd6-869d-6e50d15e885f?feedback_type=other)</sup> [](https://app.dosu.dev/a28d3c7e-a9d3-459e-9fb6-3a6f9ff4f357/ask?utm_source=github)&
nbsp;[](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/superset/discussions/35304)
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519937
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
GitHub user dosubot[bot] edited a comment on the discussion: Why doesn't Doris support quarter aggregation?
<!-- Greeting -->
Hi @bb33chen! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the superset team.
<!-- Answer -->
Doris (and MySQL) don't support 'QUARTER' as a valid interval unit in SQL, which is why quarter aggregation fails with a syntax error in Superset. Superset's Doris engine spec inherits MySQL's unsupported quarter syntax, so there's no working quarter time grain by default.
To work around this, you can remove the time grain setting in Superset and use a custom SQL expression in your chart's x-axis to manually extract the year and quarter. For example, you could use something like `CONCAT(YEAR(Shipping_Date), '-Q', QUARTER(Shipping_Date))` if Doris supports the `QUARTER()` function for extracting the quarter number, or build a calculated column in your dataset that represents year and quarter as a string (like `'2024-Q1'`) and group by that column instead. This approach is commonly used for databases that lack native quarter support in their time grain functions [example workaround](https://github.com/apache/superset/issues/26383#issuecomment-1883395006).
If you want a more permanent fix, you could customize the Doris engine spec in Superset to add a working quarter time grain expression, similar to how other databases (like Impala) use `DATE_TRUNC('quarter', {col})` [see reference](https://github.com/apache/superset/issues/33033), but this would require code changes.
Make sure your datetime column is of a recognized datetime type in Doris, as Superset's time grain controls only work with temporal columns [details](https://github.com/apache/superset/discussions/33692).
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=reply-with-mention&utm_term=apache%2Fsuperset).*
---
Share context across your team and agents. Try [Dosu](https://dosu.dev?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-tagline&utm_term=apache%2Fsuperset).
[](https://app.dosu.dev/response-feedback?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-feedback&utm_term=apache%2Fsuperset&message_id=27479836-6728-48f6-a3ac-f73ef204725c) [](https://github.dosu.com/apache/superset?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-learn-repo&utm_term=apache%2Fsuperset) [](https://app.dosu.dev/signup?referrer=openSource&source=github-footer&utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-add-team&utm_term=apache%2Fsuperset)
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519748
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [D] Why doesn't Doris support quarter aggregation? [superset]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
GitHub user dosubot[bot] edited a comment on the discussion: Why doesn't Doris support quarter aggregation?
<!-- Answer -->
The code you need to modify is in superset/db_engine_specs/doris.py, inside the DorisEngineSpec class. To fix quarter aggregation, override the _time_grain_expressions dictionary in DorisEngineSpec and provide a Doris-compatible SQL expression for TimeGrain.QUARTER. For example, if Doris supports QUARTER() and YEAR(), you could use something like:
```python
from superset.db_engine_specs.base import TimeGrain
_time_grain_expressions = {
**MySQLEngineSpec._time_grain_expressions,
TimeGrain.QUARTER: "CONCAT(YEAR({col}), '-Q', QUARTER({col}))",
}
```
This approach is similar to how other engines (like Impala) define custom time grains in their engine spec files ([reference](https://github.com/apache/superset/issues/33033)). The key is to override the inherited MySQL quarter logic, which Doris does not support, with an expression that works for Doris.
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=reply-with-mention&utm_term=apache%2Fsuperset).*
---
Docs are dead. Just use [Dosu](https://dosu.dev?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=static-docs-tagline&utm_term=apache%2Fsuperset).
[](https://app.dosu.dev/response-feedback?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=static-docs-feedback&utm_term=apache%2Fsuperset&message_id=1aa96df4-9dce-4cd6-869d-6e50d15e885f) [](https://github.dosu.com/apache/superset?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=static-docs-ask-repo&utm_term=apache%2Fsuperset) [](https://app.dosu.dev/signup?referrer=openSource&source=github-footer&utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=static-docs-share-team&utm_term=apache%2Fsuperset)
GitHub link: https://github.com/apache/superset/discussions/35304#discussioncomment-14519937
----
This is an automatically sent email for notifications@superset.apache.org.
To unsubscribe, please send an email to: notifications-unsubscribe@superset.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org