You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by GitBox <gi...@apache.org> on 2022/03/18 20:14:55 UTC
[GitHub] [superset] jleute opened a new issue #19260: Week-based time grains not working with databricks engine since spark 3.0
jleute opened a new issue #19260:
URL: https://github.com/apache/superset/issues/19260
A clear and concise description of what the bug is.
#### How to reproduce the bug
1. Use databricks engine "Databricks Interactive Cluster" with Spark 3.0 or larger
2. Create Time-series Bar Chart
3. Select "Week" as Time Grain and run the query
4. See the following error:
`'*java.lang.IllegalArgumentException:All week-based patterns are unsupported since Spark 3.0, detected: u, Please use the SQL function EXTRACT instead:312:21', `
### Environment
- browser type and version: not relevant
- superset version: docker apache/superset:1.4.1
- python version: 3.8.12
- node.js version: node:16
- any feature flags active: DASHBOARD_CROSS_FILTERS, ENABLE_TEMPLATE_PROCESSING, DASHBOARD_RBAC, VERSIONED_EXPORT
### Checklist
Make sure to follow these steps before submitting your issue - thank you!
- [ x] I have checked the superset logs for python stacktraces and included it here as text if there are any.
- [x ] I have reproduced the issue with at least the latest released version of superset.
- [x ] I have checked the issue tracker for the same issue and I haven't found one similar.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] jleute closed issue #19260: Week-based time grains not working with databricks engine since spark 3.0
Posted by GitBox <gi...@apache.org>.
jleute closed issue #19260:
URL: https://github.com/apache/superset/issues/19260
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] jleute commented on issue #19260: Week-based time grains not working with databricks engine since spark 3.0
Posted by GitBox <gi...@apache.org>.
jleute commented on issue #19260:
URL: https://github.com/apache/superset/issues/19260#issuecomment-1072790595
It looks like the problem was already fixed 10 days ago. We are using the latest release, which generates a different query:
`date_format(date_sub(`date`, CAST(7-from_unixtime(unix_timestamp(`date`), 'u') as int)), 'yyyy-MM-dd 00:00:00')`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] srinify commented on issue #19260: Week-based time grains not working with databricks engine since spark 3.0
Posted by GitBox <gi...@apache.org>.
srinify commented on issue #19260:
URL: https://github.com/apache/superset/issues/19260#issuecomment-1072780708
Hey @jleute can you also share the query that Superset has generated (should be in the CLI output, or in your log files) and sent to Databricks Interactive Cluster?
I want to confirm that `DATE_TRUNC('week')` is the problem, as suggested in `superset/db_engine_specs/databricks.py`:
https://github.com/apache/superset/blob/master/superset/db_engine_specs/databricks.py#L30
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org