You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Kevin Burton <bu...@spinn3r.com> on 2011/08/24 22:28:06 UTC
The fact that STORE needs to use quoted file names but fs does not is confusing!
This just bit me.
I can do:
STORE data INTO '/tmp/brokenfs.out';
but
fs -ls '/tmp/brokenfs.out';
won't work because it can't be quoted.
fs -ls /tmp/brokenfs.out;
works though.
………...
I'm pretty sure this is a bug.
fs won't ls or rm any files on the local file system when run with -x local
mode.
java -Xmx384M -classpath
pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
org.apache.pig.Main -x local brokenfs.pig
…
ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
2011-08-24 13:20:55,405 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 2997: Encountered IOException. fs command '-ls '/tmp/brokenfs.out''
failed. Please check output logs for details
Details at logfile: /Users/burton/projects/rankst3r/pig_1314217243730.log
but then I run:
> ls -al /tmp/brokenfs.out/
total 16
drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
-rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
-rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
-- brokenfs.pig
data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int, bar:int);
STORE data INTO '/tmp/brokenfs.out';
exec;
fs -ls '/tmp/brokenfs.out';
-- brokenfs.csv
1,2
--
Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
Skype: *burtonator*
Skype-in: *(415) 871-0687*
Re: The fact that STORE needs to use quoted file names but fs does
not is confusing!
Posted by Kevin Burton <bu...@spinn3r.com>.
Ha. Yeah. that's the bug. It tries to remove the file with quotes in the
name.
On Wed, Aug 24, 2011 at 5:59 PM, Daniel Dai <da...@hortonworks.com> wrote:
> fs command should work in local file system using "-x local". Is that
> because the quote?
>
> Daniel
>
> On Wed, Aug 24, 2011 at 4:14 PM, Dmitriy Ryaboy <dv...@gmail.com>
> wrote:
> > Agreed, I just don't know how to solve that cleanly :-/.
> >
> > On Wed, Aug 24, 2011 at 2:48 PM, Kevin Burton <bu...@spinn3r.com>
> wrote:
> >
> >> This makes sense from the bottom up , but doesn't make sense from the
> top
> >> down.
> >>
> >> Kevin
> >>
> >> On Wed, Aug 24, 2011 at 2:31 PM, Dmitriy Ryaboy <dv...@gmail.com>
> >> wrote:
> >>
> >> > fs delegates to "hadoop fs" (so, effectively, you are running "hadoop
> fs
> >> > -ls", and behaves exactly the same way as the hadoop command.
> >> >
> >> > Not sure you can get hadoop fs commands to work properly with local
> >> > filesystem.
> >> >
> >> > D
> >> >
> >> >
> >> >
> >> > On Wed, Aug 24, 2011 at 1:28 PM, Kevin Burton <bu...@spinn3r.com>
> >> wrote:
> >> >
> >> > > This just bit me.
> >> > >
> >> > > I can do:
> >> > >
> >> > > STORE data INTO '/tmp/brokenfs.out';
> >> > >
> >> > > but
> >> > >
> >> > > fs -ls '/tmp/brokenfs.out';
> >> > >
> >> > > won't work because it can't be quoted.
> >> > >
> >> > > fs -ls /tmp/brokenfs.out;
> >> > >
> >> > > works though.
> >> > >
> >> > >
> >> > > ………...
> >> > >
> >> > > I'm pretty sure this is a bug.
> >> > >
> >> > > fs won't ls or rm any files on the local file system when run with
> -x
> >> > local
> >> > > mode.
> >> > >
> >> > > java -Xmx384M -classpath
> >> > > pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
> >> > > org.apache.pig.Main -x local brokenfs.pig
> >> > > …
> >> > > ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
> >> > > 2011-08-24 13:20:55,405 [main] ERROR
> org.apache.pig.tools.grunt.Grunt -
> >> > > ERROR 2997: Encountered IOException. fs command '-ls
> >> '/tmp/brokenfs.out''
> >> > > failed. Please check output logs for details
> >> > > Details at logfile:
> >> /Users/burton/projects/rankst3r/pig_1314217243730.log
> >> > >
> >> > > but then I run:
> >> > >
> >> > > > ls -al /tmp/brokenfs.out/
> >> > > total 16
> >> > > drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
> >> > > drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
> >> > > -rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
> >> > > -rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
> >> > >
> >> > >
> >> > > -- brokenfs.pig
> >> > >
> >> > >
> >> > > data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int,
> bar:int);
> >> > >
> >> > > STORE data INTO '/tmp/brokenfs.out';
> >> > > exec;
> >> > >
> >> > > fs -ls '/tmp/brokenfs.out';
> >> > >
> >> > > -- brokenfs.csv
> >> > >
> >> > > 1,2
> >> > >
> >> > >
> >> > > --
> >> > >
> >> > > Founder/CEO Spinn3r.com
> >> > >
> >> > > Location: *San Francisco, CA*
> >> > > Skype: *burtonator*
> >> > >
> >> > > Skype-in: *(415) 871-0687*
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >>
> >> Founder/CEO Spinn3r.com
> >>
> >> Location: *San Francisco, CA*
> >> Skype: *burtonator*
> >>
> >> Skype-in: *(415) 871-0687*
> >>
> >
>
--
Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
Skype: *burtonator*
Skype-in: *(415) 871-0687*
Re: The fact that STORE needs to use quoted file names but fs does
not is confusing!
Posted by Daniel Dai <da...@hortonworks.com>.
fs command should work in local file system using "-x local". Is that
because the quote?
Daniel
On Wed, Aug 24, 2011 at 4:14 PM, Dmitriy Ryaboy <dv...@gmail.com> wrote:
> Agreed, I just don't know how to solve that cleanly :-/.
>
> On Wed, Aug 24, 2011 at 2:48 PM, Kevin Burton <bu...@spinn3r.com> wrote:
>
>> This makes sense from the bottom up , but doesn't make sense from the top
>> down.
>>
>> Kevin
>>
>> On Wed, Aug 24, 2011 at 2:31 PM, Dmitriy Ryaboy <dv...@gmail.com>
>> wrote:
>>
>> > fs delegates to "hadoop fs" (so, effectively, you are running "hadoop fs
>> > -ls", and behaves exactly the same way as the hadoop command.
>> >
>> > Not sure you can get hadoop fs commands to work properly with local
>> > filesystem.
>> >
>> > D
>> >
>> >
>> >
>> > On Wed, Aug 24, 2011 at 1:28 PM, Kevin Burton <bu...@spinn3r.com>
>> wrote:
>> >
>> > > This just bit me.
>> > >
>> > > I can do:
>> > >
>> > > STORE data INTO '/tmp/brokenfs.out';
>> > >
>> > > but
>> > >
>> > > fs -ls '/tmp/brokenfs.out';
>> > >
>> > > won't work because it can't be quoted.
>> > >
>> > > fs -ls /tmp/brokenfs.out;
>> > >
>> > > works though.
>> > >
>> > >
>> > > ………...
>> > >
>> > > I'm pretty sure this is a bug.
>> > >
>> > > fs won't ls or rm any files on the local file system when run with -x
>> > local
>> > > mode.
>> > >
>> > > java -Xmx384M -classpath
>> > > pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
>> > > org.apache.pig.Main -x local brokenfs.pig
>> > > …
>> > > ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
>> > > 2011-08-24 13:20:55,405 [main] ERROR org.apache.pig.tools.grunt.Grunt -
>> > > ERROR 2997: Encountered IOException. fs command '-ls
>> '/tmp/brokenfs.out''
>> > > failed. Please check output logs for details
>> > > Details at logfile:
>> /Users/burton/projects/rankst3r/pig_1314217243730.log
>> > >
>> > > but then I run:
>> > >
>> > > > ls -al /tmp/brokenfs.out/
>> > > total 16
>> > > drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
>> > > drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
>> > > -rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
>> > > -rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
>> > >
>> > >
>> > > -- brokenfs.pig
>> > >
>> > >
>> > > data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int, bar:int);
>> > >
>> > > STORE data INTO '/tmp/brokenfs.out';
>> > > exec;
>> > >
>> > > fs -ls '/tmp/brokenfs.out';
>> > >
>> > > -- brokenfs.csv
>> > >
>> > > 1,2
>> > >
>> > >
>> > > --
>> > >
>> > > Founder/CEO Spinn3r.com
>> > >
>> > > Location: *San Francisco, CA*
>> > > Skype: *burtonator*
>> > >
>> > > Skype-in: *(415) 871-0687*
>> > >
>> >
>>
>>
>>
>> --
>>
>> Founder/CEO Spinn3r.com
>>
>> Location: *San Francisco, CA*
>> Skype: *burtonator*
>>
>> Skype-in: *(415) 871-0687*
>>
>
Re: The fact that STORE needs to use quoted file names but fs does
not is confusing!
Posted by Kevin Burton <bu...@spinn3r.com>.
Maybe by changing the API so it looks like you're calling a function, even
though it's 1:1 with the ./bin/hadoop command.
For example:
fs.rmr( '/foo/bar');
On Wed, Aug 24, 2011 at 4:14 PM, Dmitriy Ryaboy <dv...@gmail.com> wrote:
> Agreed, I just don't know how to solve that cleanly :-/.
>
> On Wed, Aug 24, 2011 at 2:48 PM, Kevin Burton <bu...@spinn3r.com> wrote:
>
> > This makes sense from the bottom up , but doesn't make sense from the top
> > down.
> >
> > Kevin
> >
> > On Wed, Aug 24, 2011 at 2:31 PM, Dmitriy Ryaboy <dv...@gmail.com>
> > wrote:
> >
> > > fs delegates to "hadoop fs" (so, effectively, you are running "hadoop
> fs
> > > -ls", and behaves exactly the same way as the hadoop command.
> > >
> > > Not sure you can get hadoop fs commands to work properly with local
> > > filesystem.
> > >
> > > D
> > >
> > >
> > >
> > > On Wed, Aug 24, 2011 at 1:28 PM, Kevin Burton <bu...@spinn3r.com>
> > wrote:
> > >
> > > > This just bit me.
> > > >
> > > > I can do:
> > > >
> > > > STORE data INTO '/tmp/brokenfs.out';
> > > >
> > > > but
> > > >
> > > > fs -ls '/tmp/brokenfs.out';
> > > >
> > > > won't work because it can't be quoted.
> > > >
> > > > fs -ls /tmp/brokenfs.out;
> > > >
> > > > works though.
> > > >
> > > >
> > > > ………...
> > > >
> > > > I'm pretty sure this is a bug.
> > > >
> > > > fs won't ls or rm any files on the local file system when run with -x
> > > local
> > > > mode.
> > > >
> > > > java -Xmx384M -classpath
> > > > pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
> > > > org.apache.pig.Main -x local brokenfs.pig
> > > > …
> > > > ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
> > > > 2011-08-24 13:20:55,405 [main] ERROR org.apache.pig.tools.grunt.Grunt
> -
> > > > ERROR 2997: Encountered IOException. fs command '-ls
> > '/tmp/brokenfs.out''
> > > > failed. Please check output logs for details
> > > > Details at logfile:
> > /Users/burton/projects/rankst3r/pig_1314217243730.log
> > > >
> > > > but then I run:
> > > >
> > > > > ls -al /tmp/brokenfs.out/
> > > > total 16
> > > > drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
> > > > drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
> > > > -rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
> > > > -rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
> > > >
> > > >
> > > > -- brokenfs.pig
> > > >
> > > >
> > > > data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int,
> bar:int);
> > > >
> > > > STORE data INTO '/tmp/brokenfs.out';
> > > > exec;
> > > >
> > > > fs -ls '/tmp/brokenfs.out';
> > > >
> > > > -- brokenfs.csv
> > > >
> > > > 1,2
> > > >
> > > >
> > > > --
> > > >
> > > > Founder/CEO Spinn3r.com
> > > >
> > > > Location: *San Francisco, CA*
> > > > Skype: *burtonator*
> > > >
> > > > Skype-in: *(415) 871-0687*
> > > >
> > >
> >
> >
> >
> > --
> >
> > Founder/CEO Spinn3r.com
> >
> > Location: *San Francisco, CA*
> > Skype: *burtonator*
> >
> > Skype-in: *(415) 871-0687*
> >
>
--
Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
Skype: *burtonator*
Skype-in: *(415) 871-0687*
Re: The fact that STORE needs to use quoted file names but fs does
not is confusing!
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
Agreed, I just don't know how to solve that cleanly :-/.
On Wed, Aug 24, 2011 at 2:48 PM, Kevin Burton <bu...@spinn3r.com> wrote:
> This makes sense from the bottom up , but doesn't make sense from the top
> down.
>
> Kevin
>
> On Wed, Aug 24, 2011 at 2:31 PM, Dmitriy Ryaboy <dv...@gmail.com>
> wrote:
>
> > fs delegates to "hadoop fs" (so, effectively, you are running "hadoop fs
> > -ls", and behaves exactly the same way as the hadoop command.
> >
> > Not sure you can get hadoop fs commands to work properly with local
> > filesystem.
> >
> > D
> >
> >
> >
> > On Wed, Aug 24, 2011 at 1:28 PM, Kevin Burton <bu...@spinn3r.com>
> wrote:
> >
> > > This just bit me.
> > >
> > > I can do:
> > >
> > > STORE data INTO '/tmp/brokenfs.out';
> > >
> > > but
> > >
> > > fs -ls '/tmp/brokenfs.out';
> > >
> > > won't work because it can't be quoted.
> > >
> > > fs -ls /tmp/brokenfs.out;
> > >
> > > works though.
> > >
> > >
> > > ………...
> > >
> > > I'm pretty sure this is a bug.
> > >
> > > fs won't ls or rm any files on the local file system when run with -x
> > local
> > > mode.
> > >
> > > java -Xmx384M -classpath
> > > pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
> > > org.apache.pig.Main -x local brokenfs.pig
> > > …
> > > ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
> > > 2011-08-24 13:20:55,405 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> > > ERROR 2997: Encountered IOException. fs command '-ls
> '/tmp/brokenfs.out''
> > > failed. Please check output logs for details
> > > Details at logfile:
> /Users/burton/projects/rankst3r/pig_1314217243730.log
> > >
> > > but then I run:
> > >
> > > > ls -al /tmp/brokenfs.out/
> > > total 16
> > > drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
> > > drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
> > > -rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
> > > -rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
> > >
> > >
> > > -- brokenfs.pig
> > >
> > >
> > > data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int, bar:int);
> > >
> > > STORE data INTO '/tmp/brokenfs.out';
> > > exec;
> > >
> > > fs -ls '/tmp/brokenfs.out';
> > >
> > > -- brokenfs.csv
> > >
> > > 1,2
> > >
> > >
> > > --
> > >
> > > Founder/CEO Spinn3r.com
> > >
> > > Location: *San Francisco, CA*
> > > Skype: *burtonator*
> > >
> > > Skype-in: *(415) 871-0687*
> > >
> >
>
>
>
> --
>
> Founder/CEO Spinn3r.com
>
> Location: *San Francisco, CA*
> Skype: *burtonator*
>
> Skype-in: *(415) 871-0687*
>
Re: The fact that STORE needs to use quoted file names but fs does
not is confusing!
Posted by Kevin Burton <bu...@spinn3r.com>.
This makes sense from the bottom up , but doesn't make sense from the top
down.
Kevin
On Wed, Aug 24, 2011 at 2:31 PM, Dmitriy Ryaboy <dv...@gmail.com> wrote:
> fs delegates to "hadoop fs" (so, effectively, you are running "hadoop fs
> -ls", and behaves exactly the same way as the hadoop command.
>
> Not sure you can get hadoop fs commands to work properly with local
> filesystem.
>
> D
>
>
>
> On Wed, Aug 24, 2011 at 1:28 PM, Kevin Burton <bu...@spinn3r.com> wrote:
>
> > This just bit me.
> >
> > I can do:
> >
> > STORE data INTO '/tmp/brokenfs.out';
> >
> > but
> >
> > fs -ls '/tmp/brokenfs.out';
> >
> > won't work because it can't be quoted.
> >
> > fs -ls /tmp/brokenfs.out;
> >
> > works though.
> >
> >
> > ………...
> >
> > I'm pretty sure this is a bug.
> >
> > fs won't ls or rm any files on the local file system when run with -x
> local
> > mode.
> >
> > java -Xmx384M -classpath
> > pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
> > org.apache.pig.Main -x local brokenfs.pig
> > …
> > ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
> > 2011-08-24 13:20:55,405 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> > ERROR 2997: Encountered IOException. fs command '-ls '/tmp/brokenfs.out''
> > failed. Please check output logs for details
> > Details at logfile: /Users/burton/projects/rankst3r/pig_1314217243730.log
> >
> > but then I run:
> >
> > > ls -al /tmp/brokenfs.out/
> > total 16
> > drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
> > drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
> > -rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
> > -rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
> >
> >
> > -- brokenfs.pig
> >
> >
> > data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int, bar:int);
> >
> > STORE data INTO '/tmp/brokenfs.out';
> > exec;
> >
> > fs -ls '/tmp/brokenfs.out';
> >
> > -- brokenfs.csv
> >
> > 1,2
> >
> >
> > --
> >
> > Founder/CEO Spinn3r.com
> >
> > Location: *San Francisco, CA*
> > Skype: *burtonator*
> >
> > Skype-in: *(415) 871-0687*
> >
>
--
Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
Skype: *burtonator*
Skype-in: *(415) 871-0687*
Re: The fact that STORE needs to use quoted file names but fs does
not is confusing!
Posted by Ashutosh Chauhan <ha...@apache.org>.
Also, 'local' is overloaded here. local doesn't mean local fs, local means
local map-reduce mode (non-cluster)
Ashutosh
On Wed, Aug 24, 2011 at 14:31, Dmitriy Ryaboy <dv...@gmail.com> wrote:
> fs delegates to "hadoop fs" (so, effectively, you are running "hadoop fs
> -ls", and behaves exactly the same way as the hadoop command.
>
> Not sure you can get hadoop fs commands to work properly with local
> filesystem.
>
> D
>
>
>
> On Wed, Aug 24, 2011 at 1:28 PM, Kevin Burton <bu...@spinn3r.com> wrote:
>
> > This just bit me.
> >
> > I can do:
> >
> > STORE data INTO '/tmp/brokenfs.out';
> >
> > but
> >
> > fs -ls '/tmp/brokenfs.out';
> >
> > won't work because it can't be quoted.
> >
> > fs -ls /tmp/brokenfs.out;
> >
> > works though.
> >
> >
> > ………...
> >
> > I'm pretty sure this is a bug.
> >
> > fs won't ls or rm any files on the local file system when run with -x
> local
> > mode.
> >
> > java -Xmx384M -classpath
> > pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
> > org.apache.pig.Main -x local brokenfs.pig
> > …
> > ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
> > 2011-08-24 13:20:55,405 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> > ERROR 2997: Encountered IOException. fs command '-ls '/tmp/brokenfs.out''
> > failed. Please check output logs for details
> > Details at logfile: /Users/burton/projects/rankst3r/pig_1314217243730.log
> >
> > but then I run:
> >
> > > ls -al /tmp/brokenfs.out/
> > total 16
> > drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
> > drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
> > -rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
> > -rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
> >
> >
> > -- brokenfs.pig
> >
> >
> > data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int, bar:int);
> >
> > STORE data INTO '/tmp/brokenfs.out';
> > exec;
> >
> > fs -ls '/tmp/brokenfs.out';
> >
> > -- brokenfs.csv
> >
> > 1,2
> >
> >
> > --
> >
> > Founder/CEO Spinn3r.com
> >
> > Location: *San Francisco, CA*
> > Skype: *burtonator*
> >
> > Skype-in: *(415) 871-0687*
> >
>
Re: The fact that STORE needs to use quoted file names but fs does
not is confusing!
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
fs delegates to "hadoop fs" (so, effectively, you are running "hadoop fs
-ls", and behaves exactly the same way as the hadoop command.
Not sure you can get hadoop fs commands to work properly with local
filesystem.
D
On Wed, Aug 24, 2011 at 1:28 PM, Kevin Burton <bu...@spinn3r.com> wrote:
> This just bit me.
>
> I can do:
>
> STORE data INTO '/tmp/brokenfs.out';
>
> but
>
> fs -ls '/tmp/brokenfs.out';
>
> won't work because it can't be quoted.
>
> fs -ls /tmp/brokenfs.out;
>
> works though.
>
>
> ………...
>
> I'm pretty sure this is a bug.
>
> fs won't ls or rm any files on the local file system when run with -x local
> mode.
>
> java -Xmx384M -classpath
> pig/pig-0.9.0.jar:pig/lib/zebra.jar:../hadoop-0.20.2/conf/
> org.apache.pig.Main -x local brokenfs.pig
> …
> ls: Cannot access '/tmp/brokenfs.out': No such file or directory.
> 2011-08-24 13:20:55,405 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 2997: Encountered IOException. fs command '-ls '/tmp/brokenfs.out''
> failed. Please check output logs for details
> Details at logfile: /Users/burton/projects/rankst3r/pig_1314217243730.log
>
> but then I run:
>
> > ls -al /tmp/brokenfs.out/
> total 16
> drwxr-xr-x 4 burton wheel 136 Aug 24 13:25 ./
> drwxrwxrwt 21 root wheel 714 Aug 24 13:25 ../
> -rw-r--r-- 1 burton wheel 12 Aug 24 13:25 .part-m-00000.crc
> -rwxrwxrwx 1 burton wheel 4 Aug 24 13:25 part-m-00000*
>
>
> -- brokenfs.pig
>
>
> data = LOAD 'brokenfs.csv' USING PigStorage(',') AS (foo:int, bar:int);
>
> STORE data INTO '/tmp/brokenfs.out';
> exec;
>
> fs -ls '/tmp/brokenfs.out';
>
> -- brokenfs.csv
>
> 1,2
>
>
> --
>
> Founder/CEO Spinn3r.com
>
> Location: *San Francisco, CA*
> Skype: *burtonator*
>
> Skype-in: *(415) 871-0687*
>