You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Yechao Chen (JIRA)" <ji...@apache.org> on 2018/02/28 06:11:00 UTC
[jira] [Assigned] (HBASE-20056) Performance optimization on
MultiTableInputFormatBase#getSplits()
[ https://issues.apache.org/jira/browse/HBASE-20056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yechao Chen reassigned HBASE-20056:
-----------------------------------
Assignee: Yechao Chen
> Performance optimization on MultiTableInputFormatBase#getSplits()
> ------------------------------------------------------------------
>
> Key: HBASE-20056
> URL: https://issues.apache.org/jira/browse/HBASE-20056
> Project: HBase
> Issue Type: Bug
> Components: hbase, mapreduce
> Affects Versions: 1.0.1, 1.3.1, 1.2.6
> Reporter: ShivaKumar SS
> Assignee: Yechao Chen
> Priority: Minor
> Labels: hbase, mapreduce, performance
> Attachments: HBASE-20056-barnch-1.2-v1.patch
>
>
> Currently this method iterates the List of scan objects to get splits and for each iteration it opens the HConnection object and closes it, which is heavy.
> It can be optimized such that a single Hconnection can be used to compute all the splits of for all the scan objects for their splits computation.
> This optimization will help in reducing the launch time for MR Job.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)