question about hive.exec.max.dynamic.partitions.pernode

[hadoopman <ha...@gmail.com>]

I suspect we've found the problem to some hive loads.  We have 
hive.exec.max.dynamic.partitions.pernode set to 100 in the hive.xml 
however when running our hive job we're trying to set it from our script 
to 10000 (for example) and noticed it bombs.  Basically our job is 
simply loading about 4 months of data partitioned by day.  When I load 
less data or partition by say month then it works.

Is there a way from the cli or hive script to reset this number or do we 
need to modify the hive.xml file and restart?

Thanks a bunch!

Re: Export to MySQL

[Appan Thirumaligai <at...@ngmoco.com>]

http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html


On Mar 28, 2011, at 7:42 AM, Sharma, Akash wrote:

> Scoop=Sqoop
> 
> Thanks
> -Akash
> 
> -----Original Message-----
> From: Sharma, Akash [mailto:Akash.Sharma@searshc.com] 
> Sent: Monday, March 28, 2011 9:40 AM
> To: user@hive.apache.org
> Subject: Export to MySQL
> 
> New to Hadoop/Hive/Scoop. Wanted to find out the best option to export
> data out of HDFS and into a MYSQL database. I have read about scoop
> export but also wanted to know if there are other ways as well. Please
> share any scoop export if handy.
> 
> Any help in this direction is appreciated.
> 
> Thanks
> -Akash
> 
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is confidential
> and may contain proprietary or legally privileged information. If you
> are not the intended recipient, please delete it without reading the
> contents. Thank you.

RE: Export to MySQL

["Sharma, Akash" <Ak...@searshc.com>]

Scoop=Sqoop

Thanks
-Akash

-----Original Message-----
From: Sharma, Akash [mailto:Akash.Sharma@searshc.com] 
Sent: Monday, March 28, 2011 9:40 AM
To: user@hive.apache.org
Subject: Export to MySQL

New to Hadoop/Hive/Scoop. Wanted to find out the best option to export
data out of HDFS and into a MYSQL database. I have read about scoop
export but also wanted to know if there are other ways as well. Please
share any scoop export if handy.

Any help in this direction is appreciated.

Thanks
-Akash

This message, including any attachments, is the property of Sears
Holdings Corporation and/or one of its subsidiaries. It is confidential
and may contain proprietary or legally privileged information. If you
are not the intended recipient, please delete it without reading the
contents. Thank you.

Export to MySQL

["Sharma, Akash" <Ak...@searshc.com>]

New to Hadoop/Hive/Scoop. Wanted to find out the best option to export
data out of HDFS and into a MYSQL database. I have read about scoop
export but also wanted to know if there are other ways as well. Please
share any scoop export if handy.

Any help in this direction is appreciated.

Thanks
-Akash

This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.