[jira] [Commented] (CARBONDATA-4195) Materialized view loading time increased due to full refresh

["Nihal kumar ojha (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CARBONDATA-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403524#comment-17403524 ] 

Nihal kumar ojha commented on CARBONDATA-4195:
----------------------------------------------

 Hi, can you please provide the create MV command? 

Based on that only MV will be created with incremental or full refresh. If your query contains avg() aggregate function or some expression like sum(col1) + sum(col2) then MV will be created with full refresh. So once we have that command then we can conclude.

> Materialized view loading time increased due to full refresh
> ------------------------------------------------------------
>
>                 Key: CARBONDATA-4195
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4195
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 2.1.0
>            Reporter: Mayuri Patole
>            Priority: Major
>             Fix For: 2.1.0
>
>
> Hi Team,
> We are using carbon 2.1.0 in our project where parallel data loading is happening.
> We are working on getting optimal performance for aggregated queries using materialized views.
> We observed that continues data loading and full refresh of MV is causing increased load time and high memory usage which doesn't have to be this way.
> Can you suggest a way to perform incremental refresh because we do not need to calculate old data again while loading ? 
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)