You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by "kumar vishal (JIRA)" <ji...@apache.org> on 2016/08/04 07:33:20 UTC
[jira] [Updated] (CARBONDATA-135) Multiple hdfs client creation
issue
[ https://issues.apache.org/jira/browse/CARBONDATA-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
kumar vishal updated CARBONDATA-135:
------------------------------------
Assignee: kumar vishal
Description:
Problem:When opening a input stream we are creating client every time and each time it is taking around 400 ms, In case of detail query we are opening for each blocklet and it is impacting the query performance
Solution:As query execution is a reading operation we can open only one client
Impact Area:Query execution and compaction
Need to handle for Below scenario
1. All inputstream creation
2. All outputstream creation
3. All places where we are creating carbon file(HDFS)
In this issue we are handling scenario1
was:
Problem:When opening a input stream we are creating client every time and each time it is taking around 400 ms, In case of detail query we are opening for each blocklet and it is impacting the query performance
Solution:As query execution is a reading operation we can open only one client
Impact Area:Query execution and compaction
> Multiple hdfs client creation issue
> -----------------------------------
>
> Key: CARBONDATA-135
> URL: https://issues.apache.org/jira/browse/CARBONDATA-135
> Project: CarbonData
> Issue Type: Bug
> Reporter: kumar vishal
> Assignee: kumar vishal
>
> Problem:When opening a input stream we are creating client every time and each time it is taking around 400 ms, In case of detail query we are opening for each blocklet and it is impacting the query performance
> Solution:As query execution is a reading operation we can open only one client
> Impact Area:Query execution and compaction
> Need to handle for Below scenario
> 1. All inputstream creation
> 2. All outputstream creation
> 3. All places where we are creating carbon file(HDFS)
> In this issue we are handling scenario1
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)