You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Bill Graham <bi...@gmail.com> on 2009/12/09 07:03:29 UTC

HDFS move instead of LOAD DATA INPATH?

Hi,

When the "LOAD DATA INPATH" is issued, does Hive modify the metastore data,
or do anything else special besides just moving the files in HDFS?

I've got a daily MR job that runs before I need to load data into a daily
Hive partition and using the FileSystem class to move the files from Java
would be pretty easy.

thanks,
Bill

Re: HDFS move instead of LOAD DATA INPATH?

Posted by Prasad Chakka <pc...@facebook.com>.

It adds metadata but you can always do a 'alter table <tb> add partition (pk='val') location '<somepath>'. Location clause is optional if it is in the usual <tbl>/part_name place.

________________________________
From: Bill Graham <bi...@gmail.com>
Reply-To: <hi...@hadoop.apache.org>, <bi...@gmail.com>
Date: Tue, 8 Dec 2009 22:03:29 -0800
To: <hi...@hadoop.apache.org>
Subject: HDFS move instead of LOAD DATA INPATH?

Hi,

When the "LOAD DATA INPATH" is issued, does Hive modify the metastore data, or do anything else special besides just moving the files in HDFS?

I've got a daily MR job that runs before I need to load data into a daily Hive partition and using the FileSystem class to move the files from Java would be pretty easy.

thanks,
Bill