loadtable.rb reads from LocalFS than DFS

[Dhaval Makawana <dh...@gmail.com>]

Hi,

I am running loadtable.rb script to bulk upload file created by
HFileOutputFormat. Following is my command line call to the script.

/usr/lib/hbase/bin/hbase org.jruby.Main /usr/lib/hbase/bin/loadtable.rb
MyTable /output_dir

where /output_dir is path where mapreduce output is stored in
HFileOutputFormat format. The script is throwing following error.
/usr/lib/hbase/bin/loadtable.rb:61:in `isDirExists': Does not exit:
/output_dir (IOError)

When I print fs object within the script, it prints following.
org.apache.hadoop.fs.LocalFileSystem@4523a389

I tried running separate java code for checking the directory existence the
way this ruby script is doing and it successfully recognizes directory.
        Configuration conf = HBaseConfiguration.create();
        FileSystem  fs = FileSystem.get(conf);
        System.out.println(fs);
        if(fs.exists(new Path("/output_dir"))){
            System.out.println("Directory exists");
        }else{
            System.out.println("Directory does not exist");
        }

Please help me running the loadtable.rb.

Thanks,
Dhaval

Re: loadtable.rb reads from LocalFS than DFS

[Ted Yu <yu...@gmail.com>]

In TRUNK,
puts 'DISABLED!!!! Use completebulkload instead.  See tail of
http://hbase.apache.org/bulk-loads.html'

Which version of HBase are you using ?

On Tue, Jul 19, 2011 at 6:50 AM, Dhaval Makawana
<dh...@gmail.com>wrote:

> Hi,
>
> I am running loadtable.rb script to bulk upload file created by
> HFileOutputFormat. Following is my command line call to the script.
>
> /usr/lib/hbase/bin/hbase org.jruby.Main /usr/lib/hbase/bin/loadtable.rb
> MyTable /output_dir
>
> where /output_dir is path where mapreduce output is stored in
> HFileOutputFormat format. The script is throwing following error.
> /usr/lib/hbase/bin/loadtable.rb:61:in `isDirExists': Does not exit:
> /output_dir (IOError)
>
> When I print fs object within the script, it prints following.
> org.apache.hadoop.fs.LocalFileSystem@4523a389
>
> I tried running separate java code for checking the directory existence the
> way this ruby script is doing and it successfully recognizes directory.
>        Configuration conf = HBaseConfiguration.create();
>        FileSystem  fs = FileSystem.get(conf);
>        System.out.println(fs);
>        if(fs.exists(new Path("/output_dir"))){
>            System.out.println("Directory exists");
>        }else{
>            System.out.println("Directory does not exist");
>        }
>
> Please help me running the loadtable.rb.
>
> Thanks,
> Dhaval
>