[jira] [Created] (SPARK-13161) Extend MLlib LDA to include options for Author Topic Modeling

["John Hogue (JIRA)" <ji...@apache.org>]

John Hogue created SPARK-13161:
----------------------------------

             Summary: Extend MLlib LDA to include options for Author Topic Modeling
                 Key: SPARK-13161
                 URL: https://issues.apache.org/jira/browse/SPARK-13161
             Project: Spark
          Issue Type: Improvement
          Components: MLlib
    Affects Versions: 1.6.0
            Reporter: John Hogue


The author-topic model, a generative model for documents that extends Latent Dirichlet Allocation.

By modeling the interests of authors, we can answer a range of important queries about the content of document collections. With an appropriate author model, we can establish which subjects an author writes about, which authors are likely to have written documents similar to an observed document, and which authors produce similar work.

Full whitepaper here.

http://mimno.infosci.cornell.edu/info6150/readings/398.pdf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org