[jira] [Created] (CARBONDATA-757) Big decimal optimization in store and processing

["Ravindra Pesala (JIRA)" <ji...@apache.org>]

Ravindra Pesala created CARBONDATA-757:
------------------------------------------

             Summary:  Big decimal optimization in store and processing
                 Key: CARBONDATA-757
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-757
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ravindra Pesala
            Assignee: Ravindra Pesala


Currently Decimal is converted to bytes and using LV (length + value) format  to write to store. And while getting back read the bytes in LV format and convert back the bigdecimal.

We can do following operations to improve storage and processing.
1. if decimal precision is less than 9 then we can fit in int (4 bytes)
2. if decimal precision is less than 18 then we can fit in long (8 bytes)
3. if decimal precision is more than 18 then we can fit in fixed length bytes(the length bytes can vary depends on precision but it is always fixed length)
So in this approach we no need store bigdecimal in LV format, we can store in fixed format.It reduces the memory.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)