You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by tsj <ts...@gmail.com> on 2014/11/10 20:28:38 UTC

MLLib Decision Tress algorithm hangs, others fine

Hello all,

I have some text data that I am running different algorithms on. 
I had no problems with LibSVM and Naive Bayes on the same data, 
but when I run Decision Tree, the execution hangs in the middle 
of DecisionTree.trainClassifier(). The only difference from the example 
given on the site is that I am using 6 categories instead of 2, and the 
input is text that is transformed to labeled points using TF-IDF. It
halts shortly after this log output:

spark.SparkContext: Job finished: collect at DecisionTree.scala:1347, took
1.019579676 s

Any ideas as to what could be causing this?



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/MLLib-Decision-Tress-algorithm-hangs-others-fine-tp18515.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: MLLib Decision Tress algorithm hangs, others fine

Posted by Xiangrui Meng <me...@gmail.com>.
Could you provide more information? For example, spark version,
dataset size (number of instances/number of features), cluster size,
error messages from both the drive and the executor. -Xiangrui

On Mon, Nov 10, 2014 at 11:28 AM, tsj <ts...@gmail.com> wrote:
> Hello all,
>
> I have some text data that I am running different algorithms on.
> I had no problems with LibSVM and Naive Bayes on the same data,
> but when I run Decision Tree, the execution hangs in the middle
> of DecisionTree.trainClassifier(). The only difference from the example
> given on the site is that I am using 6 categories instead of 2, and the
> input is text that is transformed to labeled points using TF-IDF. It
> halts shortly after this log output:
>
> spark.SparkContext: Job finished: collect at DecisionTree.scala:1347, took
> 1.019579676 s
>
> Any ideas as to what could be causing this?
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/MLLib-Decision-Tress-algorithm-hangs-others-fine-tp18515.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org