You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@pig.apache.org by Chun Yang <cy...@contractor.salesforce.com> on 2012/07/27 00:32:54 UTC

Pig 0.10.0 slow startup

Hi all,

I'm trying to move from Pig 0.9.1 to Pig 0.10.0 . When I try to run the same
script using the two Pig versions, 0.9.1 starts off fast and almost
immediately submits the job to the cluster. On the other hand, Pig 0.10.0
takes forever to submit the job. When I use the java option
-XX:+PrintGCDetails, I see that for 0.10.0 the GC is being run many times
before and after the job is submitted to the cluster.

Does anyone know what is causing this and/or how I might be able to
troubleshoot it?

I've uploaded truncated output showing when GC happens to Pastebin:
http://pastebin.com/B8WTHW9r

Thanks,
Chun