You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Donni Khan <pr...@googlemail.com> on 2018/02/05 11:51:58 UTC

high TFIDF value terms

Hi,

anyone knows how I can get the high TFIDF value terms by using Spark(Java)?

IDF idf = *new* IDF().setInputCol("TF").setOutputCol("IDF");

IDFModel idfModel = idf.fit(featurizedData);

DataFrame tfidf = idfModel.transform(featurizedData);


Thanks;

Donni