You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2015/03/16 05:36:38 UTC

[jira] [Created] (LENS-409) Fix usage of new HiveConf() in ml lib

Amareshwari Sriramadasu created LENS-409:
--------------------------------------------

             Summary: Fix usage of new HiveConf() in ml lib
                 Key: LENS-409
                 URL: https://issues.apache.org/jira/browse/LENS-409
             Project: Apache Lens
          Issue Type: Improvement
          Components: ml
            Reporter: Amareshwari Sriramadasu
            Assignee: Jaideep Dhok
             Fix For: 2.1


We saw new HiveConf() call is costlier : See LENS-408. The following occurrences in ml-lib needs to be looked into to see if they are required.

{noformat}
lens-ml-lib amareshwari.sr$ git grep 'new HiveConf(' src/main/java/
src/main/java/org/apache/lens/ml/MLUtils.java:    HIVE_CONF = new HiveConf();
src/main/java/org/apache/lens/ml/ModelLoader.java:          FileSystem fs = modelPath.getFileSystem(new HiveConf());
src/main/java/org/apache/lens/ml/spark/algos/BaseSparkAlgo.java:    HiveConf hiveConf = new HiveConf();
src/main/java/org/apache/lens/ml/spark/algos/KMeansAlgo.java:    HiveConf hiveConf = new HiveConf();
src/main/java/org/apache/lens/rdd/LensRDDClient.java:  protected static final HiveConf HIVE_CONF = new HiveConf();
src/main/java/org/apache/lens/server/ml/MLServiceResource.java:    HIVE_CONF = new HiveConf();
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)