You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Hamza Asad <ha...@gmail.com> on 2013/02/12 17:50:17 UTC
Transfer Data to new location
i want to change my HIVE/HDFS directory.. how can i transfer data which
resides in HDFS to some other directory ? either i have have to use
sqoop-export followed by sqoop-import to new location?? or is there any
easier solution for safely data transfer??
--
*Muhammad Hamza Asad *
+923457261988
Re: Transfer Data to new location
Posted by Dean Wampler <de...@thinkbiganalytics.com>.
hadoop fs -mv old_path new_path
If one new_path isn't in HDFS, use -get instead of -mv.
If you're moving Hive tables, you should then use ALTER TABLE to change the
metadata. Or, if the tables are external and have no partitions, you could
just drop them and recreate them with the new location.
On Tue, Feb 12, 2013 at 10:50 AM, Hamza Asad <ha...@gmail.com> wrote:
> i want to change my HIVE/HDFS directory.. how can i transfer data which
> resides in HDFS to some other directory ? either i have have to use
> sqoop-export followed by sqoop-import to new location?? or is there any
> easier solution for safely data transfer??
>
> --
> *Muhammad Hamza Asad *
> +923457261988
>
--
*Dean Wampler, Ph.D.*
thinkbiganalytics.com
+1-312-339-1330
Re: Transfer Data to new location
Posted by Hamza Asad <ha...@gmail.com>.
so that i still query existing data successfully
On Tue, Feb 12, 2013 at 10:08 PM, Hamza Asad <ha...@gmail.com> wrote:
> Actually i have data in HDFS under HIVE/Warehouse path. I ran short of
> disk space so i'm changing HDFS location (in new HDD partition). so please
> tell me how can i transfer my existing data safely to new location.
>
>
> On Tue, Feb 12, 2013 at 9:54 PM, Nitin Pawar <ni...@gmail.com>wrote:
>
>> little more clarification
>>
>> is it same hdfs cluster ?
>> when you say migrating data from one location to another are you keeping
>> the hive table metadata same?
>> how much of capacity you have by disk wise?
>>
>>
>>
>> On Tue, Feb 12, 2013 at 10:20 PM, Hamza Asad <ha...@gmail.com>wrote:
>>
>>> i want to change my HIVE/HDFS directory.. how can i transfer data which
>>> resides in HDFS to some other directory ? either i have have to use
>>> sqoop-export followed by sqoop-import to new location?? or is there any
>>> easier solution for safely data transfer??
>>>
>>> --
>>> *Muhammad Hamza Asad *
>>> +923457261988
>>>
>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>
>
> --
> *Muhammad Hamza Asad *
> +923457261988
>
--
*Muhammad Hamza Asad *
+923457261988
Re: Transfer Data to new location
Posted by Hamza Asad <ha...@gmail.com>.
Actually i have data in HDFS under HIVE/Warehouse path. I ran short of disk
space so i'm changing HDFS location (in new HDD partition). so please tell
me how can i transfer my existing data safely to new location.
On Tue, Feb 12, 2013 at 9:54 PM, Nitin Pawar <ni...@gmail.com>wrote:
> little more clarification
>
> is it same hdfs cluster ?
> when you say migrating data from one location to another are you keeping
> the hive table metadata same?
> how much of capacity you have by disk wise?
>
>
>
> On Tue, Feb 12, 2013 at 10:20 PM, Hamza Asad <ha...@gmail.com>wrote:
>
>> i want to change my HIVE/HDFS directory.. how can i transfer data which
>> resides in HDFS to some other directory ? either i have have to use
>> sqoop-export followed by sqoop-import to new location?? or is there any
>> easier solution for safely data transfer??
>>
>> --
>> *Muhammad Hamza Asad *
>> +923457261988
>>
>
>
>
> --
> Nitin Pawar
>
--
*Muhammad Hamza Asad *
+923457261988
Re: Transfer Data to new location
Posted by Nitin Pawar <ni...@gmail.com>.
little more clarification
is it same hdfs cluster ?
when you say migrating data from one location to another are you keeping
the hive table metadata same?
how much of capacity you have by disk wise?
On Tue, Feb 12, 2013 at 10:20 PM, Hamza Asad <ha...@gmail.com> wrote:
> i want to change my HIVE/HDFS directory.. how can i transfer data which
> resides in HDFS to some other directory ? either i have have to use
> sqoop-export followed by sqoop-import to new location?? or is there any
> easier solution for safely data transfer??
>
> --
> *Muhammad Hamza Asad *
> +923457261988
>
--
Nitin Pawar