You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Maitray Thaker <mt...@adelement.com> on 2016/12/28 06:27:49 UTC

StackOverflow Error spark mllib 1.6.1 FpGrowth Algorithm for Association rule generation

Hi,
I am getting stackoverflow error when I run FpGrowth algorithm on my
21 million transactions with a low support, since I want almost every
products association with other product. I know the problem is caused
by the recursive lineage of the algorithm, but I don't know how to get
around this problem. I also don't know that the RDD checkpointing is
done internally or not in the algorithm. Please suggest a solution
thanks.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org