You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Charles Gonçalves <ch...@gmail.com> on 2011/02/18 00:12:06 UTC
Quick question about Reading dirs
Guys,
Does Pig read the _log directories from an output script ?
What I want is to read an pig output dir (or multiples) from pig scripts.
But I just want the part-XXXX files not the .part-crc or _logs files.
Thanks
--
*Charles Ferreira Gonçalves *
http://homepages.dcc.ufmg.br/~charles/
UFMG - ICEx - Dcc
Cel.: 55 31 87741485
Tel.: 55 31 34741485
Lab.: 55 31 34095840
Re: Quick question about Reading dirs
Posted by Charles Gonçalves <ch...@gmail.com>.
Files starting with .* are also ignored (hdfs does)
https://issues.apache.org/jira/browse/PIG-950
<https://issues.apache.org/jira/browse/PIG-950>But thanks, I didn't found
any documentation about files starting with _ files!
On Thu, Feb 17, 2011 at 9:23 PM, Ramesh, Amit <am...@amazon.com> wrote:
>
> Directory names starting with underscores are ignored, but I am not certain
> about .* files/directories.
>
> Amit
>
>
> On 2/17/11 3:12 PM, "Charles Gonçalves" <ch...@gmail.com> wrote:
>
> > Guys,
> >
> > Does Pig read the _log directories from an output script ?
> >
> > What I want is to read an pig output dir (or multiples) from pig scripts.
> > But I just want the part-XXXX files not the .part-crc or _logs files.
> >
> > Thanks
>
>
--
*Charles Ferreira Gonçalves *
http://homepages.dcc.ufmg.br/~charles/
UFMG - ICEx - Dcc
Cel.: 55 31 87741485
Tel.: 55 31 34741485
Lab.: 55 31 34095840
Re: Quick question about Reading dirs
Posted by Richard Ding <rd...@yahoo-inc.com>.
Files starting with . are also ignored.
-Richard
On 2/17/11 3:23 PM, "Ramesh, Amit" <am...@amazon.com> wrote:
Directory names starting with underscores are ignored, but I am not certain
about .* files/directories.
Amit
On 2/17/11 3:12 PM, "Charles Gonçalves" <ch...@gmail.com> wrote:
> Guys,
>
> Does Pig read the _log directories from an output script ?
>
> What I want is to read an pig output dir (or multiples) from pig scripts.
> But I just want the part-XXXX files not the .part-crc or _logs files.
>
> Thanks
Re: Quick question about Reading dirs
Posted by "Ramesh, Amit" <am...@amazon.com>.
Directory names starting with underscores are ignored, but I am not certain
about .* files/directories.
Amit
On 2/17/11 3:12 PM, "Charles Gonçalves" <ch...@gmail.com> wrote:
> Guys,
>
> Does Pig read the _log directories from an output script ?
>
> What I want is to read an pig output dir (or multiples) from pig scripts.
> But I just want the part-XXXX files not the .part-crc or _logs files.
>
> Thanks