You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by GitBox <gi...@apache.org> on 2021/08/16 15:51:04 UTC
[GitHub] [superset] IKkSssDendi opened a new issue #16276: For the same SQL statement, the results in superset and idea are different
IKkSssDendi opened a new issue #16276:
URL: https://github.com/apache/superset/issues/16276
Using the same Clickhouse database and the same SQL statement, the results obtained by superset and idea are inconsistent; Specifically, superset should only query some data, but I don't know why
### Expected results
When I used the pie chart to visualize the data in a Clickhouse database, I found this problem. The queried data was incorrect. To be exact, I only got some data, but I didn't make any settings. I felt that there was a problem somewhere
#### Screenshots
### Environment
(please complete the following information):
- superset version: `docker pull apache/superset:master`
- python version: `python --version 3.8`
### Checklist
Make sure to follow these steps before submitting your issue - thank you!
- [ ] I have checked the superset logs for python stacktraces and included it here as text if there are any.
- [ ] I have reproduced the issue with at least the latest released version of superset.
- [ ] I have checked the issue tracker for the same issue and I haven't found one similar.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899911757
>
>
> Is it only happening in clickhouse data?
> What's the expected results from your query? the ones showing in the spreadsheet screenshot? both results from Explore and SQL lab are incorrect? can you double check if any filters, same as in superset was added to your query in excel?
>
> @zhaoyongjie please follow up in the issue, if it's validated by the users with more info come back, let me know.
So far, this problem has only been found in Clickhouse. The data is migrated from Mysql to Clickhouse. I have used MySQL data for the same query and the same chart, and have not found such problems; Overdue results should look like the second picture
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] zhaoyongjie commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
zhaoyongjie commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899960188
> > @IKkSssDendi Let us double-check this issue
> > ```
> > 1. SQLLab treats first data as column name in Clickhous with Superset.
> >
> > 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
> > ```
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > Can you please confirm which issue is the specific one?
>
> Both。Found a problem that not only first data as column name ，lost some data
Okay, thank you for the report.
Which Clickhouse version do you use? Which SQLAlchemy driver do you use?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] save-my-heart commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
save-my-heart commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-900070399
When you use `clickhouse-sqlalchemy`, it is better to use native tcp interface.
Change your sqlalchemy uri to this: `clickhouse+native://<user>:<password>@<host>:<port>/<database>[?key=value..]
`.
If you prefer http interface, see this: [clickhouse-sqlalchemy #134](https://github.com/xzkostyan/clickhouse-sqlalchemy/pull/134)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899963636
>
>
> > > @IKkSssDendi Let us double-check this issue
> > > ```
> > > 1. SQLLab treats first data as column name in Clickhous with Superset.
> > >
> > > 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
> > > ```
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Can you please confirm which issue is the specific one?
> >
> >
> > Both。Found a problem that not only first data as column name ，lost some data
>
> Okay, thank you for the report.
> Which Clickhouse version do you use? Which SQLAlchemy driver do you use?
If the problem is solved or the root cause of the problem is found, please let me know。Thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] zhaoyongjie commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
zhaoyongjie commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899948823
@IKkSssDendi Let us double-check this issue
1. SQLLab treats first data as column name in Clickhous with Superset.
2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" / “所得税”.
Can you please confirm which issue is the specific one?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-900164408
>
>
> When you use `clickhouse-sqlalchemy`, it is better to use native tcp interface.
> Change your sqlalchemy uri to this: `clickhouse+native://<user>:<password>@<host>:<port>/<database>[?key=value..] `.
> If you prefer http interface, see this: [clickhouse-sqlalchemy #134](https://github.com/xzkostyan/clickhouse-sqlalchemy/pull/134)
Thank you ，let me try it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899928280
> Is it only happening in clickhouse data?
> What's the expected results from your query? the ones showing in the spreadsheet screenshot? both results from Explore and SQL lab are incorrect? can you double check if any filters, same as in superset was added to your query in excel?
>
> @zhaoyongjie please follow up in the issue, if it's validated by the users with more info come back, let me know.
same data,same sql.
The first figure queries the data in MySQL
The second figure queries the data in the Clickhouse
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-900016312
>
>
> > > @IKkSssDendi Let us double-check this issue
> > > ```
> > > 1. SQLLab treats first data as column name in Clickhous with Superset.
> > >
> > > 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
> > > ```
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Can you please confirm which issue is the specific one?
> >
> >
> > Both。Found a problem that not only first data as column name ，lost some data
>
> Okay, thank you for the report.
> Which Clickhouse version do you use? Which SQLAlchemy driver do you use?
Through my test, I found that it is related to clickhouse-sqlalchemy. When I use sqlalchemy-clickhouse and reduce the version of infi.clickhouse_orm to 1.0.4, the query results are normal. However, the above problems will occur when using the latest clickhouse-sqlalchemy
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi removed a comment on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi removed a comment on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-900016120
>
>
> > > @IKkSssDendi Let us double-check this issue
> > > ```
> > > 1. SQLLab treats first data as column name in Clickhous with Superset.
> > >
> > > 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
> > > ```
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Can you please confirm which issue is the specific one?
> >
> >
> > Both。Found a problem that not only first data as column name ，lost some data
>
> Okay, thank you for the report.
> Which Clickhouse version do you use? Which SQLAlchemy driver do you use?
Through my test, I found that it is related to Clickhouse. When I use sqlalchemy-clickhouse and reduce the version of infi.clickhouse_orm to 1.0.4, the query results are normal. However, the above problems will occur when using the latest clickhouse-sqlalchemy
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899950038
>
>
> @IKkSssDendi Let us double-check this issue
>
> 1. SQLLab treats first data as column name in Clickhous with Superset.
>
> 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
>
>
> Can you please confirm which issue is the specific one?
Both。Found a problem that not only first data as column name ，lost some data
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899963245
>
>
> > > @IKkSssDendi Let us double-check this issue
> > > ```
> > > 1. SQLLab treats first data as column name in Clickhous with Superset.
> > >
> > > 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
> > > ```
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Can you please confirm which issue is the specific one?
> >
> >
> > Both。Found a problem that not only first data as column name ，lost some data
>
> Okay, thank you for the report.
> Which Clickhouse version do you use? Which SQLAlchemy driver do you use?
Clickhouse --version `20.12.5.14`
SQLAlchemy --version `1.3.24`
Clickhouse-sqlalchemy --version `0.1.6`
clickhouse-driver --verison `0.2.1`
Thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] junlincc commented on issue #16276: For the same SQL statement, the results in superset and idea are different
Posted by GitBox <gi...@apache.org>.
junlincc commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899732809
Is it only happening in clickhouse data?
What's the expected results from your query? the ones showing in the spreadsheet screenshot? both results from Explore and SQL lab are incorrect? can you double check if any filters, same as in superset was added to your query in excel?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899950951
>
>
> @IKkSssDendi Let us double-check this issue
>
> 1. SQLLab treats first data as column name in Clickhous with Superset.
>
> 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
>
>
> Can you please confirm which issue is the specific one?
just now,i found that all query of clickhouse , the first data alaways be the colunm name
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] zhaoyongjie edited a comment on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
zhaoyongjie edited a comment on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899948823
@IKkSssDendi Let us double-check this issue
1. SQLLab treats first data as column name in Clickhous with Superset.
2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
Can you please confirm which issue is the specific one?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899915049
>
>
> Is it only happening in clickhouse data?
> What's the expected results from your query? the ones showing in the spreadsheet screenshot? both results from Explore and SQL lab are incorrect? can you double check if any filters, same as in superset was added to your query in excel?
>
> @zhaoyongjie please follow up in the issue, if it's validated by the users with more info come back, let me know.
In the third figure, the field name 印花税 should be one of the data, but it is regarded as the field name by superset. Is this related to the data storage structure of Clickhouse?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] junlincc edited a comment on issue #16276: For the same SQL statement, the results in superset and idea are different
Posted by GitBox <gi...@apache.org>.
junlincc edited a comment on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-899732809
Is it only happening in clickhouse data?
What's the expected results from your query? the ones showing in the spreadsheet screenshot? both results from Explore and SQL lab are incorrect? can you double check if any filters, same as in superset was added to your query in excel?
@zhaoyongjie please follow up in the issue, if it's validated by the users with more info come back, let me know.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] IKkSssDendi commented on issue #16276: [Question]Receive inconsistent query results when connected to Clickhouse(?)
Posted by GitBox <gi...@apache.org>.
IKkSssDendi commented on issue #16276:
URL: https://github.com/apache/superset/issues/16276#issuecomment-900016120
>
>
> > > @IKkSssDendi Let us double-check this issue
> > > ```
> > > 1. SQLLab treats first data as column name in Clickhous with Superset.
> > >
> > > 2. I had observed that the first Pie Chart was missing 2 lines of data, "印花税" and “所得税”.
> > > ```
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Can you please confirm which issue is the specific one?
> >
> >
> > Both。Found a problem that not only first data as column name ，lost some data
>
> Okay, thank you for the report.
> Which Clickhouse version do you use? Which SQLAlchemy driver do you use?
Through my test, I found that it is related to Clickhouse. When I use sqlalchemy-clickhouse and reduce the version of infi.clickhouse_orm to 1.0.4, the query results are normal. However, the above problems will occur when using the latest clickhouse-sqlalchemy
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org