You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by sandeep vura <sa...@gmail.com> on 2016/09/01 12:41:37 UTC

Pig job is unable to process huge file

we are processing 1 day data in pig and it generates each hour 1 .gz file
like 23 files. out of 23 files 1 file has 11GB remaining max 2.5 GB. 11GB
file is not able to process when running the pig script.

Can someone please suggest what could be the reason?