You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Puneet Gupta (JIRA)" <ji...@apache.org> on 2016/06/27 08:48:52 UTC
[jira] [Updated] (LENS-409) Fix usage of new HiveConf() and
Hive.get() in ml lib
[ https://issues.apache.org/jira/browse/LENS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Puneet Gupta updated LENS-409:
------------------------------
Fix Version/s: (was: 2.6)
> Fix usage of new HiveConf() and Hive.get() in ml lib
> ----------------------------------------------------
>
> Key: LENS-409
> URL: https://issues.apache.org/jira/browse/LENS-409
> Project: Apache Lens
> Issue Type: Improvement
> Components: ml
> Reporter: Amareshwari Sriramadasu
> Assignee: Jaideep Dhok
>
> We saw new HiveConf() call is costlier : See LENS-408. The following occurrences in ml-lib needs to be looked into to see if they are required.
> {noformat}
> lens-ml-lib amareshwari.sr$ git grep 'new HiveConf(' src/main/java/
> src/main/java/org/apache/lens/ml/MLUtils.java: HIVE_CONF = new HiveConf();
> src/main/java/org/apache/lens/ml/ModelLoader.java: FileSystem fs = modelPath.getFileSystem(new HiveConf());
> src/main/java/org/apache/lens/ml/spark/algos/BaseSparkAlgo.java: HiveConf hiveConf = new HiveConf();
> src/main/java/org/apache/lens/ml/spark/algos/KMeansAlgo.java: HiveConf hiveConf = new HiveConf();
> src/main/java/org/apache/lens/rdd/LensRDDClient.java: protected static final HiveConf HIVE_CONF = new HiveConf();
> src/main/java/org/apache/lens/server/ml/MLServiceResource.java: HIVE_CONF = new HiveConf();
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)