You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2020/06/13 00:06:00 UTC

[jira] [Commented] (IMPALA-9847) JSON profiles are mostly space characters

    [ https://issues.apache.org/jira/browse/IMPALA-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134597#comment-17134597 ] 

ASF subversion and git services commented on IMPALA-9847:
---------------------------------------------------------

Commit 6ca6e403580dc592c026b4f684d31f8a4dcfae11 in impala's branch refs/heads/master from Tim Armstrong
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=6ca6e40 ]

IMPALA-9847: reduce web UI serialized JSON size

Switch to using the plain writer in some places, and
tweak PrettyWriter to produce denser output for the
debug UI JSON (so that it's still human readable but
denser).

Testing:
Manually tested. The profile for the below query went
from 338kB to 134kB.

  select min(l_orderkey) from tpch_parquet.lineitem;

Change-Id: I66af9d00f0f0fc70e324033b6464b75a6adadd6f
Reviewed-on: http://gerrit.cloudera.org:8080/16068
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> JSON profiles are mostly space characters
> -----------------------------------------
>
>                 Key: IMPALA-9847
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9847
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Backend
>            Reporter: Tim Armstrong
>            Assignee: Tim Armstrong
>            Priority: Major
>             Fix For: Impala 4.0
>
>
> JSON profiles are pretty-printed with 4 space characters per indent. This means that most of the profile data is actually just space characters, and this can add up for large profiles.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org