[jira] [Commented] (HIVE-15489) Alternatively use table scan stats for HoS

["Lefty Leverenz (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097993#comment-16097993 ] 

Lefty Leverenz commented on HIVE-15489:
---------------------------------------

Doc note 2:  HIVE-16336 removes *hive.spark.use.file.size.for.mapjoin* in release 3.0.0, replacing it with *hive.spark.use.ts.stats.for.mapjoin*.

(Incidentally, the TODOC2.2 label ought to be TODOC2.3 because of changes to release numbering after this issue was committed.)

> Alternatively use table scan stats for HoS
> ------------------------------------------
>
>                 Key: HIVE-15489
>                 URL: https://issues.apache.org/jira/browse/HIVE-15489
>             Project: Hive
>          Issue Type: Improvement
>          Components: Spark, Statistics
>    Affects Versions: 2.2.0
>            Reporter: Chao Sun
>            Assignee: Chao Sun
>              Labels: TODOC2.2
>             Fix For: 2.3.0
>
>         Attachments: HIVE-15489.1.patch, HIVE-15489.2.patch, HIVE-15489.3.patch, HIVE-15489.6.patch, HIVE-15489.7.patch, HIVE-15489.wip.patch
>
>
> For MapJoin in HoS, we should provide an option to only use stats in the TS rather than the populated stats in each of the join branch. This could be pretty conservative but more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)