Re: spark 1.4 GC issue

[Ted Yu <yu...@gmail.com>]

Please take a look at http://www.infoq.com/articles/tuning-tips-G1-GC

Cheers

On Sat, Nov 14, 2015 at 10:03 PM, Renu Yadav <yr...@gmail.com> wrote:

> I have tried with G1 GC .Please if anyone can provide their setting for GC.
> At code level I am :
> 1.reading orc table usind dataframe
> 2.map df to rdd of my case class
> 3. changed that rdd to paired rdd
> 4.Applied combineByKey
> 5. saving the result to orc file
>
> Please suggest
>
> Regards,
> Renu Yadav
>
> On Fri, Nov 13, 2015 at 8:01 PM, Renu Yadav <yr...@gmail.com> wrote:
>
>> am using spark 1.4 and my application is taking much time in GC around
>> 60-70% of time for each task
>>
>> I am using parallel GC.
>> please help somebody as soon as possible.
>>
>> Thanks,
>> Renu
>>
>
>