You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Ashutosh Chauhan (JIRA)" <ji...@apache.org> on 2015/10/17 20:03:05 UTC

[jira] [Resolved] (HIVE-12164) Remove jdbc stats collection mechanism

     [ https://issues.apache.org/jira/browse/HIVE-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashutosh Chauhan resolved HIVE-12164.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Pushed to master. Thanks, Pengcheng for review.

> Remove jdbc stats collection mechanism
> --------------------------------------
>
>                 Key: HIVE-12164
>                 URL: https://issues.apache.org/jira/browse/HIVE-12164
>             Project: Hive
>          Issue Type: Task
>          Components: Statistics
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 2.0.0
>
>         Attachments: HIVE-12164.1.patch, HIVE-12164.2.patch, HIVE-12164.3.patch, HIVE-12164.patch
>
>
> Though there are some deployments using it, usually its painful to setup since a valid hive-site.xml is needed on all task nodes (containing connection details) and for large tasks (with thousands of tasks) results in a scalability issue with all of them hammering DB at nearly same time.
> Because of these pain points alternative stats collection mechanism were added. FS stats based system is default for some time.
> We should remove jdbc stats collection mechanism as it needlessly adds complexity in TS and FS operators w.r.t key handling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)