You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by GitBox <gi...@apache.org> on 2020/04/14 16:26:40 UTC
[GitHub] [incubator-superset] eugeniamz commented on issue #9527: Table
view: Column sort option on the UI should fetch the data from the database
and display results accordingly
eugeniamz commented on issue #9527: Table view: Column sort option on the UI should fetch the data from the database and display results accordingly
URL: https://github.com/apache/incubator-superset/issues/9527#issuecomment-613543576
You could increase the limit to your needs,
I don't think is good idea to force to fetch the data every time that you sort a column. Superset does not know how much data the table/view has and in some cases it may really affect performance if you sort over trillions of rows, in addition is re-writting the SQL based on the changes not just in sort the data frame.
But _**this is my humble opinion**_, I worked with users with PB of data and in many cases they really froze the BI tools when they did select * or brought too much data to the interface. Some DBs could handle a good sort of trillions, but others are not as efficient or can not handle sorting of each column. Even if you have a LIMIT a SORT in the SQL force a full data scan.
I personally really like the efficiency of Superset dashboard because it works in aggregated cached values, this will force to connect to db each time.
Just my 2 cents. I am just thinking in my previous customers that have really big data sets and how this can impact them.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org