You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by gaurav jain <ja...@yahoo.com> on 2010/09/29 00:37:14 UTC
Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain
Re: Change output filename
Posted by gaurav jain <ja...@yahoo.com>.
Thanks Paul.
Let me try.
----- Original Message ----
From: Paul Yang <py...@facebook.com>
To: "hive-dev@hadoop.apache.org" <hi...@hadoop.apache.org>;
"hive-user@hadoop.apache.org" <hi...@hadoop.apache.org>
Sent: Tue, September 28, 2010 4:12:59 PM
Subject: RE: Change output filename
One way to add extra data is to use the alter table ... set tblproperties
command:
http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL#Alter_Table_Properties
Whatever values you set for that table, it will show up when you do a describe
extended in the parameters field.
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 4:06 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Re: Change output filename
Just for debugging purposes, I wanted to have some information in each filename.
For Example: Some of the source information of that data.
If its not easy to do, then I can have that information somewhere else. I just
wanted to confirm that hive does not support this.
Regards,
Gaurav Jain
----- Original Message ----
From: Paul Yang <py...@facebook.com>
To: "hive-user@hadoop.apache.org" <hi...@hadoop.apache.org>;
"hive-dev@hadoop.apache.org" <hi...@hadoop.apache.org>
Sent: Tue, September 28, 2010 3:57:42 PM
Subject: RE: Change output filename
As far as I know, there's no easy way to do so. What's the use case?
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 3:37 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain
RE: Change output filename
Posted by Paul Yang <py...@facebook.com>.
One way to add extra data is to use the alter table ... set tblproperties command:
http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL#Alter_Table_Properties
Whatever values you set for that table, it will show up when you do a describe extended in the parameters field.
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 4:06 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Re: Change output filename
Just for debugging purposes, I wanted to have some information in each filename.
For Example: Some of the source information of that data.
If its not easy to do, then I can have that information somewhere else. I just
wanted to confirm that hive does not support this.
Regards,
Gaurav Jain
----- Original Message ----
From: Paul Yang <py...@facebook.com>
To: "hive-user@hadoop.apache.org" <hi...@hadoop.apache.org>;
"hive-dev@hadoop.apache.org" <hi...@hadoop.apache.org>
Sent: Tue, September 28, 2010 3:57:42 PM
Subject: RE: Change output filename
As far as I know, there's no easy way to do so. What's the use case?
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 3:37 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain
RE: Change output filename
Posted by Paul Yang <py...@facebook.com>.
One way to add extra data is to use the alter table ... set tblproperties command:
http://wiki.apache.org/hadoop/Hive/LanguageManual/DDL#Alter_Table_Properties
Whatever values you set for that table, it will show up when you do a describe extended in the parameters field.
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 4:06 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Re: Change output filename
Just for debugging purposes, I wanted to have some information in each filename.
For Example: Some of the source information of that data.
If its not easy to do, then I can have that information somewhere else. I just
wanted to confirm that hive does not support this.
Regards,
Gaurav Jain
----- Original Message ----
From: Paul Yang <py...@facebook.com>
To: "hive-user@hadoop.apache.org" <hi...@hadoop.apache.org>;
"hive-dev@hadoop.apache.org" <hi...@hadoop.apache.org>
Sent: Tue, September 28, 2010 3:57:42 PM
Subject: RE: Change output filename
As far as I know, there's no easy way to do so. What's the use case?
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 3:37 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain
Re: Change output filename
Posted by gaurav jain <ja...@yahoo.com>.
Just for debugging purposes, I wanted to have some information in each filename.
For Example: Some of the source information of that data.
If its not easy to do, then I can have that information somewhere else. I just
wanted to confirm that hive does not support this.
Regards,
Gaurav Jain
----- Original Message ----
From: Paul Yang <py...@facebook.com>
To: "hive-user@hadoop.apache.org" <hi...@hadoop.apache.org>;
"hive-dev@hadoop.apache.org" <hi...@hadoop.apache.org>
Sent: Tue, September 28, 2010 3:57:42 PM
Subject: RE: Change output filename
As far as I know, there's no easy way to do so. What's the use case?
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 3:37 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain
Re: Change output filename
Posted by gaurav jain <ja...@yahoo.com>.
Just for debugging purposes, I wanted to have some information in each filename.
For Example: Some of the source information of that data.
If its not easy to do, then I can have that information somewhere else. I just
wanted to confirm that hive does not support this.
Regards,
Gaurav Jain
----- Original Message ----
From: Paul Yang <py...@facebook.com>
To: "hive-user@hadoop.apache.org" <hi...@hadoop.apache.org>;
"hive-dev@hadoop.apache.org" <hi...@hadoop.apache.org>
Sent: Tue, September 28, 2010 3:57:42 PM
Subject: RE: Change output filename
As far as I know, there's no easy way to do so. What's the use case?
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 3:37 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain
RE: Change output filename
Posted by Paul Yang <py...@facebook.com>.
As far as I know, there's no easy way to do so. What's the use case?
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 3:37 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain
RE: Change output filename
Posted by Paul Yang <py...@facebook.com>.
As far as I know, there's no easy way to do so. What's the use case?
-----Original Message-----
From: gaurav jain [mailto:jainy_gaurav@yahoo.com]
Sent: Tuesday, September 28, 2010 3:37 PM
To: hive-user@hadoop.apache.org; hive-dev@hadoop.apache.org
Subject: Change output filename
Hi,
Is it possible to prefix the output filenames in a hive insert query?
Instead of:
part-00000
I want to have:
$prefix_part-00000
Regards,
Gaurav Jain