You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Aleksey Plekhanov (Jira)" <ji...@apache.org> on 2022/01/20 10:30:00 UTC
[jira] [Updated] (IGNITE-16315) Calcite engine. Query start request contains a lot of data
[ https://issues.apache.org/jira/browse/IGNITE-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aleksey Plekhanov updated IGNITE-16315:
---------------------------------------
Description: For simple queries SQL engine most of the time spend in writing/reading query start requests, which contains a lot of data. Nested instances of {{ColocationGroup}} class contain assignments for each partition (\{{List<List<UUID>>}}). Transferred size can be reduced if we compact assignments somehow. Also, the target colocation group from fragment description contains redundant synthetic partitions, this also can be optimized. (was: For simple queries SQL engine most of the time spend in writing/reading query start requests, which contains a lot of data.
{{FragmentDescription}} class stores in communication message {{ColocationGroup}} type (\{{target}} field), which contains cache partition assignments (for each partition of the cache, 1024 items by default, list of node IDs are stored). After it, {{ColocationGroup}} is stored again in {{FragmentMapping}} class.
We need to investigate this behaviour and optimize it if possible.)
> Calcite engine. Query start request contains a lot of data
> ----------------------------------------------------------
>
> Key: IGNITE-16315
> URL: https://issues.apache.org/jira/browse/IGNITE-16315
> Project: Ignite
> Issue Type: Improvement
> Reporter: Aleksey Plekhanov
> Assignee: Aleksey Plekhanov
> Priority: Major
> Labels: calcite2-required, calcite3-required
> Time Spent: 10m
> Remaining Estimate: 0h
>
> For simple queries SQL engine most of the time spend in writing/reading query start requests, which contains a lot of data. Nested instances of {{ColocationGroup}} class contain assignments for each partition (\{{List<List<UUID>>}}). Transferred size can be reduced if we compact assignments somehow. Also, the target colocation group from fragment description contains redundant synthetic partitions, this also can be optimized.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)