You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Venugopal Reddy K (Jira)" <ji...@apache.org> on 2020/10/23 06:31:00 UTC
[jira] [Created] (CARBONDATA-4042) Insert into select and CTAS
launches fewer tasks(limited to max nodes) even when target table is of
no_sort
Venugopal Reddy K created CARBONDATA-4042:
---------------------------------------------
Summary: Insert into select and CTAS launches fewer tasks(limited to max nodes) even when target table is of no_sort
Key: CARBONDATA-4042
URL: https://issues.apache.org/jira/browse/CARBONDATA-4042
Project: CarbonData
Issue Type: Improvement
Components: data-load, spark-integration
Reporter: Venugopal Reddy K
*Issue:*
At present, When we do insert into table select from or create table as select from, we lauch one single task per node. Whereas when we do a simple select * from table query, tasks launched are equal to number of carbondata files(CARBON_TASK_DISTRIBUTION default is CARBON_TASK_DISTRIBUTION_BLOCK).
Thus, slows down the load performance of insert into select and ctas cases.
Refer [Community discussion regd. task lauch|http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Discussion-Query-Regarding-Task-launch-mechanism-for-data-load-operations-tt98711.html]
*Suggestion:*
Lauch the same number of tasks as in select query for insert into select and ctas cases when the target table is of no-sort.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)