You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Arun <ar...@gmail.com> on 2017/05/18 03:15:31 UTC
spark ML Recommender program
hi
I am writing spark ML Movie Recomender program on Intelij on windows10
Dataset is 2MB with 100000 datapoints, My Laptop has 8gb Memory
When I set number of iteration 10 works fine
When I set number of Iteration 20 I get StackOverFlow error..
Whats the solution?..
thanks
Sent from Samsung tablet
Re: spark ML Recommender program
Posted by Nick Pentreath <ni...@gmail.com>.
It sounds like this may be the same as
https://issues.apache.org/jira/browse/SPARK-20402
On Thu, 18 May 2017 at 08:16 Nick Pentreath <ni...@gmail.com>
wrote:
> Could you try setting the checkpoint interval for ALS (try 3, 5 say) and
> see what the effect is?
>
>
>
> On Thu, 18 May 2017 at 07:32 Mark Vervuurt <m....@gmail.com> wrote:
>
>> If you are running locally try increasing driver memory to for example 4G
>> en executor memory to 3G.
>> Regards, Mark
>>
>> On 18 May 2017, at 05:15, Arun <ar...@gmail.com> wrote:
>>
>> hi
>>
>> I am writing spark ML Movie Recomender program on Intelij on windows10
>> Dataset is 2MB with 100000 datapoints, My Laptop has 8gb Memory
>>
>> When I set number of iteration 10 works fine
>> When I set number of Iteration 20 I get StackOverFlow error..
>> Whats the solution?..
>>
>> thanks
>>
>>
>>
>>
>>
>> Sent from Samsung tablet
>>
>>
>>
>>
>>
>>
Re: spark ML Recommender program
Posted by Nick Pentreath <ni...@gmail.com>.
Could you try setting the checkpoint interval for ALS (try 3, 5 say) and
see what the effect is?
On Thu, 18 May 2017 at 07:32 Mark Vervuurt <m....@gmail.com> wrote:
> If you are running locally try increasing driver memory to for example 4G
> en executor memory to 3G.
> Regards, Mark
>
> On 18 May 2017, at 05:15, Arun <ar...@gmail.com> wrote:
>
> hi
>
> I am writing spark ML Movie Recomender program on Intelij on windows10
> Dataset is 2MB with 100000 datapoints, My Laptop has 8gb Memory
>
> When I set number of iteration 10 works fine
> When I set number of Iteration 20 I get StackOverFlow error..
> Whats the solution?..
>
> thanks
>
>
>
>
>
> Sent from Samsung tablet
>
>
>
>
>
>
Re: spark ML Recommender program
Posted by Mark Vervuurt <m....@gmail.com>.
If you are running locally try increasing driver memory to for example 4G en executor memory to 3G.
Regards, Mark
> On 18 May 2017, at 05:15, Arun <arunbm123@gmail.com <ma...@gmail.com>> wrote:
>
> hi
>
> I am writing spark ML Movie Recomender program on Intelij on windows10
> Dataset is 2MB with 100000 datapoints, My Laptop has 8gb Memory
>
> When I set number of iteration 10 works fine
> When I set number of Iteration 20 I get StackOverFlow error..
> Whats the solution?..
>
> thanks
>
>
>
>
>
> Sent from Samsung tablet
Re: spark ML Recommender program
Posted by Kun Liu <kl...@nyu.edu>.
Hi Arun,
Would you like to show us the codes?
On Wed, May 17, 2017 at 8:15 PM, Arun <ar...@gmail.com> wrote:
> hi
>
> I am writing spark ML Movie Recomender program on Intelij on windows10
> Dataset is 2MB with 100000 datapoints, My Laptop has 8gb Memory
>
> When I set number of iteration 10 works fine
> When I set number of Iteration 20 I get StackOverFlow error..
> Whats the solution?..
>
> thanks
>
>
>
>
>
> Sent from Samsung tablet
>