You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Raju Bairishetti (JIRA)" <ji...@apache.org> on 2015/07/15 03:17:04 UTC

[jira] [Created] (LENS-661) Add Weighted Driver selector for selecting driver among hive and spark drivers

Raju Bairishetti created LENS-661:
-------------------------------------

             Summary: Add Weighted Driver selector for selecting driver among hive and spark drivers
                 Key: LENS-661
                 URL: https://issues.apache.org/jira/browse/LENS-661
             Project: Apache Lens
          Issue Type: Sub-task
          Components: driver-hive
            Reporter: Raju Bairishetti


Spark Driver also uses hive thrift server as an execution engine. Both spark and hive drivers are eligible for executing the same cube query. Right now, Jdbc has Query cost 0.0 and Hive driver has 1.0. Spark driver also uses same query cost as hive driver which is 1.0.

We can introduce a weighted driver selector which will submit configured % of queries to spark driver for execution.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)