You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "yuhao yang (JIRA)" <ji...@apache.org> on 2017/11/12 21:14:01 UTC
[jira] [Created] (SPARK-22502) OnlineLDAOptimizer
variationalTopicInference might be able to handle empty documents
yuhao yang created SPARK-22502:
----------------------------------
Summary: OnlineLDAOptimizer variationalTopicInference might be able to handle empty documents
Key: SPARK-22502
URL: https://issues.apache.org/jira/browse/SPARK-22502
Project: Spark
Issue Type: Improvement
Components: ML
Affects Versions: 2.2.0
Reporter: yuhao yang
Priority: Trivial
Currently we assume OnlineLDAOptimizer.variationalTopicInference cannot take empty documents and added a few checks during training and inference. Yet I tested and in my local env sending empty vectors to OnlineLDAOptimizer.variationalTopicInference does not trigger any error.
If this is true, maybe we can remove the extra check. Please be cautious as compared with the gain (some code cleaning and little performance improvement), we do want to avoid a regression.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org