You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Puneet Gupta (JIRA)" <ji...@apache.org> on 2016/06/27 08:48:52 UTC

[jira] [Updated] (LENS-409) Fix usage of new HiveConf() and Hive.get() in ml lib

     [ https://issues.apache.org/jira/browse/LENS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Puneet Gupta updated LENS-409:
------------------------------
    Fix Version/s:     (was: 2.6)

> Fix usage of new HiveConf() and Hive.get() in ml lib
> ----------------------------------------------------
>
>                 Key: LENS-409
>                 URL: https://issues.apache.org/jira/browse/LENS-409
>             Project: Apache Lens
>          Issue Type: Improvement
>          Components: ml
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Jaideep Dhok
>
> We saw new HiveConf() call is costlier : See LENS-408. The following occurrences in ml-lib needs to be looked into to see if they are required.
> {noformat}
> lens-ml-lib amareshwari.sr$ git grep 'new HiveConf(' src/main/java/
> src/main/java/org/apache/lens/ml/MLUtils.java:    HIVE_CONF = new HiveConf();
> src/main/java/org/apache/lens/ml/ModelLoader.java:          FileSystem fs = modelPath.getFileSystem(new HiveConf());
> src/main/java/org/apache/lens/ml/spark/algos/BaseSparkAlgo.java:    HiveConf hiveConf = new HiveConf();
> src/main/java/org/apache/lens/ml/spark/algos/KMeansAlgo.java:    HiveConf hiveConf = new HiveConf();
> src/main/java/org/apache/lens/rdd/LensRDDClient.java:  protected static final HiveConf HIVE_CONF = new HiveConf();
> src/main/java/org/apache/lens/server/ml/MLServiceResource.java:    HIVE_CONF = new HiveConf();
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)