You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Surya Hebbar (Jira)" <ji...@apache.org> on 2024/05/23 13:02:00 UTC
[jira] [Comment Edited] (IMPALA-13106) Support larger imported query profile sizes through compression
[ https://issues.apache.org/jira/browse/IMPALA-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848947#comment-17848947 ]
Surya Hebbar edited comment on IMPALA-13106 at 5/23/24 1:01 PM:
----------------------------------------------------------------
After thorough research, I have found an efficient zlib port written in client side javascript called "pako".
This supports changing compression levels, which is helpful for having control over speed of compression.
was (Author: JIRAUSER299620):
After thorough research, I have found an efficient zlip port written in client side javascript called "pako".
This supports changing compression levels, which is helpful for having control over speed of compression.
> Support larger imported query profile sizes through compression
> ---------------------------------------------------------------
>
> Key: IMPALA-13106
> URL: https://issues.apache.org/jira/browse/IMPALA-13106
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Surya Hebbar
> Assignee: Surya Hebbar
> Priority: Major
>
> Imported query profiles are currently being stored in IndexedDB.
> Although IndexedDB does not have storage limitations like other browser storage APIs, there is a limit on the data that can be stored in one attribute/field.
> This imposes a limitation on the size of query profiles. After some testing, I have found this limit to be around 220 MBs.
> So, it would be helpful to use compression on JSON query profiles, allowing for much larger query profiles.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org