You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by "FrankChen021 (via GitHub)" <gi...@apache.org> on 2024/08/13 07:22:12 UTC

[I] Show total rows/avg row size in human readable format (druid)

FrankChen021 opened a new issue, #16888:
URL: https://github.com/apache/druid/issues/16888

   The Data Source tab, we can render these two colums in human readable format as the 'Total data size' or 'Replicated size'
   
   ![image](https://github.com/user-attachments/assets/5b4821e9-73d5-4d06-bb7e-e95fba1baebf)
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Show total rows/avg row size in human readable format (druid)

Posted by "FrankChen021 (via GitHub)" <gi...@apache.org>.
FrankChen021 commented on issue #16888:
URL: https://github.com/apache/druid/issues/16888#issuecomment-2285587420

   Yes, i mean show the number as `5M`, `63B`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Show total rows/avg row size in human readable format (druid)

Posted by "FrankChen021 (via GitHub)" <gi...@apache.org>.
FrankChen021 closed issue #16888: Show total rows/avg row size in human readable format
URL: https://github.com/apache/druid/issues/16888


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Show total rows/avg row size in human readable format (druid)

Posted by "kfaraz (via GitHub)" <gi...@apache.org>.
kfaraz commented on issue #16888:
URL: https://github.com/apache/druid/issues/16888#issuecomment-2285541593

   @FrankChen021 , the first column `Total Rows` denotes the total number of rows in the datasource, not the total size. Do you mean it should be displayed as `5 million`, `63 trillion`, etc. I think the current approach of showing the exact total number of rows is better.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Show total rows/avg row size in human readable format (druid)

Posted by "vogievetsky (via GitHub)" <gi...@apache.org>.
vogievetsky commented on issue #16888:
URL: https://github.com/apache/druid/issues/16888#issuecomment-2289276389

   Those columns are human readable (that is what the `,`s are for) the term you are looking for is "abbreviated".
   
   There is a reason why I chose to show those column unabbreviated. Let me explain here and then if we can decide if it still applies.
   
   The main issue with abbreviation is that it can make numbers that are very different visually appear very similar or even opposite in size. You can see it in the `Total data size` column in your screenshot. What is bigger `5.12 PB` or `15.53 MB`? what if you squint or take off your glasses (see blurry screenshot attached)? One way to solve this is to abbreviate the entire column to the same unit but that looses a lot of resolution on the small things.
   
   The `Total rows` column is very special it can vary from 63 billion to 2 as it does in your screenshot. It is also common that people care about the exact number like if you are importing data from somewhere where you know you have 63,267,111,852 rows you want to see that 63,267,111,852 exactly made it into Druid. By leaving it unabbreviated it easily shows the relative size of the datasource even from afar (again see my blurred screenshot). Lastly it is just cool to see a big number.
   
   The `Avg row size` is unabbreviated because it simply no likely to have a lot of range. Rows in Druid rarely exceed a couple of kilobytes in size. If your rows are getting close to megabytes you would very much want to know it very prominently.
   
   ![image](https://github.com/user-attachments/assets/a733172b-49ed-4eab-99ce-bab6fc071dd6)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org


Re: [I] Show total rows/avg row size in human readable format (druid)

Posted by "FrankChen021 (via GitHub)" <gi...@apache.org>.
FrankChen021 commented on issue #16888:
URL: https://github.com/apache/druid/issues/16888#issuecomment-2295261313

   I think you're right, sometimes users might care about the exact number of rows. it's complex if we support both formats.
   let me close this proposal.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org