You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by CHEBARO Abdallah <Ab...@murex.com> on 2014/07/30 10:17:16 UTC
SELECT specific data
Hello,
I am interested in selecting specific data from a source and loading it to a table. For example, if I have 5 columns in my dataset, I want to load 3 columns of it. Is it possible to do it without create a second table?
Thank you
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
RE: SELECT specific data
Posted by CHEBARO Abdallah <Ab...@murex.com>.
Thank you very much, your respond was very helpful
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Wednesday, July 30, 2014 12:53 PM
To: user@hive.apache.org
Subject: Re: SELECT specific data
Please check another mail i sent right after that.
my bad had hit send button too soon without reading the mail.
I will rephrase
In hive to process the data, you will need the table created and data loaded to the table.
You can not process a file without loading it into a table.
If you want to do that and do not want to create a temporary table in hive with full columns from file then options available to you are
1) simple unix tools like awk or sed or cut
2) write a pig script
3) write your own mapreduce code
On Wed, Jul 30, 2014 at 3:09 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
“With hive, without creating a table with full data, you can do intermediate processing like select only few columns and write into another table”. How can I do this process?
Thank you alot!
From: Nitin Pawar [mailto:nitinpawar432@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 12:37 PM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
sorry hit send too soon ..
I mean without creating intermediate tables, in hive you can process the file directly
On Wed, Jul 30, 2014 at 3:06 PM, Nitin Pawar <ni...@gmail.com>> wrote:
With hive, without creating a table with full data, you can do intermediate processing like select only few columns and write into another table,
If this is something one time then you can take a look at awk or cut commands in linux and generate those files only.
On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
I am only using Hive and hadoop, nothing more.
From: Devopam Mittra [mailto:devopam@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 12:15 PM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
Are you using any tool to load data ? If yes, then the ETL tool will provide you such options.
If not, then please explore unix file processing/external table route.
On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
Thank you for your reply.
Consider we have data divided into 5 columns (col1, col2, col3, col4, col5).
So I can’t load directly col1, col3 and col5?
If I can’t do it directly, can you provide me with an alternate solution?
Thank you.
From: Nitin Pawar [mailto:nitinpawar432@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 11:37 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
you mean just by writing query then I think no.
But if you want to read only first 3 columns of the data then it would work with just a single table and load data into
On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
I am interested in selecting specific data from a source and loading it to a table. For example, if I have 5 columns in my dataset, I want to load 3 columns of it. Is it possible to do it without create a second table?
Thank you
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Devopam Mittra
Life and Relations are not binary
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
Re: SELECT specific data
Posted by Nitin Pawar <ni...@gmail.com>.
Please check another mail i sent right after that.
my bad had hit send button too soon without reading the mail.
I will rephrase
In hive to process the data, you will need the table created and data
loaded to the table.
You can not process a file without loading it into a table.
If you want to do that and do not want to create a temporary table in hive
with full columns from file then options available to you are
1) simple unix tools like awk or sed or cut
2) write a pig script
3) write your own mapreduce code
On Wed, Jul 30, 2014 at 3:09 PM, CHEBARO Abdallah <
Abdallah.CHEBARO@murex.com> wrote:
> “With hive, without creating a table with full data, you can do
> intermediate processing like select only few columns and write into another
> table”. How can I do this process?
>
>
>
> Thank you alot!
>
>
>
> *From:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Wednesday, July 30, 2014 12:37 PM
>
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> sorry hit send too soon ..
>
> I mean without creating intermediate tables, in hive you can process the
> file directly
>
>
>
> On Wed, Jul 30, 2014 at 3:06 PM, Nitin Pawar <ni...@gmail.com>
> wrote:
>
> With hive, without creating a table with full data, you can do
> intermediate processing like select only few columns and write into another
> table,
>
>
>
> If this is something one time then you can take a look at awk or cut
> commands in linux and generate those files only.
>
>
>
> On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> I am only using Hive and hadoop, nothing more.
>
>
>
> *From:* Devopam Mittra [mailto:devopam@gmail.com]
> *Sent:* Wednesday, July 30, 2014 12:15 PM
>
>
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> Are you using any tool to load data ? If yes, then the ETL tool will
> provide you such options.
>
> If not, then please explore unix file processing/external table route.
>
>
>
> On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> Hello,
>
>
>
> Thank you for your reply.
>
>
>
> Consider we have data divided into 5 columns (col1, col2, col3, col4,
> col5).
>
> So I can’t load directly col1, col3 and col5?
>
> If I can’t do it directly, can you provide me with an alternate solution?
>
>
>
> Thank you.
>
>
>
> *From:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Wednesday, July 30, 2014 11:37 AM
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> you mean just by writing query then I think no.
>
>
>
> But if you want to read only first 3 columns of the data then it would
> work with just a single table and load data into
>
>
>
> On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> Hello,
>
>
>
> I am interested in selecting specific data from a source and loading it to
> a table. For example, if I have 5 columns in my dataset, I want to load 3
> columns of it. Is it possible to do it without create a second table?
>
>
>
> Thank you
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Nitin Pawar
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Devopam Mittra
> Life and Relations are not binary
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Nitin Pawar
>
>
>
>
>
> --
> Nitin Pawar
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
--
Nitin Pawar
RE: SELECT specific data
Posted by CHEBARO Abdallah <Ab...@murex.com>.
“With hive, without creating a table with full data, you can do intermediate processing like select only few columns and write into another table”. How can I do this process?
Thank you alot!
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Wednesday, July 30, 2014 12:37 PM
To: user@hive.apache.org
Subject: Re: SELECT specific data
sorry hit send too soon ..
I mean without creating intermediate tables, in hive you can process the file directly
On Wed, Jul 30, 2014 at 3:06 PM, Nitin Pawar <ni...@gmail.com>> wrote:
With hive, without creating a table with full data, you can do intermediate processing like select only few columns and write into another table,
If this is something one time then you can take a look at awk or cut commands in linux and generate those files only.
On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
I am only using Hive and hadoop, nothing more.
From: Devopam Mittra [mailto:devopam@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 12:15 PM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
Are you using any tool to load data ? If yes, then the ETL tool will provide you such options.
If not, then please explore unix file processing/external table route.
On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
Thank you for your reply.
Consider we have data divided into 5 columns (col1, col2, col3, col4, col5).
So I can’t load directly col1, col3 and col5?
If I can’t do it directly, can you provide me with an alternate solution?
Thank you.
From: Nitin Pawar [mailto:nitinpawar432@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 11:37 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
you mean just by writing query then I think no.
But if you want to read only first 3 columns of the data then it would work with just a single table and load data into
On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
I am interested in selecting specific data from a source and loading it to a table. For example, if I have 5 columns in my dataset, I want to load 3 columns of it. Is it possible to do it without create a second table?
Thank you
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Devopam Mittra
Life and Relations are not binary
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
Re: SELECT specific data
Posted by Nitin Pawar <ni...@gmail.com>.
sorry hit send too soon ..
I mean without creating intermediate tables, in hive you can process the
file directly
On Wed, Jul 30, 2014 at 3:06 PM, Nitin Pawar <ni...@gmail.com>
wrote:
> With hive, without creating a table with full data, you can do
> intermediate processing like select only few columns and write into another
> table,
>
> If this is something one time then you can take a look at awk or cut
> commands in linux and generate those files only.
>
>
> On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
>> I am only using Hive and hadoop, nothing more.
>>
>>
>>
>> *From:* Devopam Mittra [mailto:devopam@gmail.com]
>> *Sent:* Wednesday, July 30, 2014 12:15 PM
>>
>> *To:* user@hive.apache.org
>> *Subject:* Re: SELECT specific data
>>
>>
>>
>> Are you using any tool to load data ? If yes, then the ETL tool will
>> provide you such options.
>>
>> If not, then please explore unix file processing/external table route.
>>
>>
>>
>> On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <
>> Abdallah.CHEBARO@murex.com> wrote:
>>
>> Hello,
>>
>>
>>
>> Thank you for your reply.
>>
>>
>>
>> Consider we have data divided into 5 columns (col1, col2, col3, col4,
>> col5).
>>
>> So I can’t load directly col1, col3 and col5?
>>
>> If I can’t do it directly, can you provide me with an alternate solution?
>>
>>
>>
>> Thank you.
>>
>>
>>
>> *From:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
>> *Sent:* Wednesday, July 30, 2014 11:37 AM
>> *To:* user@hive.apache.org
>> *Subject:* Re: SELECT specific data
>>
>>
>>
>> you mean just by writing query then I think no.
>>
>>
>>
>> But if you want to read only first 3 columns of the data then it would
>> work with just a single table and load data into
>>
>>
>>
>> On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <
>> Abdallah.CHEBARO@murex.com> wrote:
>>
>> Hello,
>>
>>
>>
>> I am interested in selecting specific data from a source and loading it
>> to a table. For example, if I have 5 columns in my dataset, I want to load
>> 3 columns of it. Is it possible to do it without create a second table?
>>
>>
>>
>> Thank you
>>
>> *******************************
>>
>> This e-mail contains information for the intended recipient only. It may
>> contain proprietary material or confidential information. If you are not
>> the intended recipient you are not authorised to distribute, copy or use
>> this e-mail or any attachment to it. Murex cannot guarantee that it is
>> virus free and accepts no responsibility for any loss or damage arising
>> from its use. If you have received this e-mail in error please notify
>> immediately the sender and delete the original email received, any
>> attachments and all copies from your system.
>>
>>
>>
>>
>>
>> --
>> Nitin Pawar
>>
>> *******************************
>>
>> This e-mail contains information for the intended recipient only. It may
>> contain proprietary material or confidential information. If you are not
>> the intended recipient you are not authorised to distribute, copy or use
>> this e-mail or any attachment to it. Murex cannot guarantee that it is
>> virus free and accepts no responsibility for any loss or damage arising
>> from its use. If you have received this e-mail in error please notify
>> immediately the sender and delete the original email received, any
>> attachments and all copies from your system.
>>
>>
>>
>>
>>
>> --
>> Devopam Mittra
>> Life and Relations are not binary
>>
>> *******************************
>>
>> This e-mail contains information for the intended recipient only. It may
>> contain proprietary material or confidential information. If you are not
>> the intended recipient you are not authorised to distribute, copy or use
>> this e-mail or any attachment to it. Murex cannot guarantee that it is
>> virus free and accepts no responsibility for any loss or damage arising
>> from its use. If you have received this e-mail in error please notify
>> immediately the sender and delete the original email received, any
>> attachments and all copies from your system.
>>
>
>
>
> --
> Nitin Pawar
>
--
Nitin Pawar
Re: SELECT specific data
Posted by Nitin Pawar <ni...@gmail.com>.
With hive, without creating a table with full data, you can do intermediate
processing like select only few columns and write into another table,
If this is something one time then you can take a look at awk or cut
commands in linux and generate those files only.
On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <
Abdallah.CHEBARO@murex.com> wrote:
> I am only using Hive and hadoop, nothing more.
>
>
>
> *From:* Devopam Mittra [mailto:devopam@gmail.com]
> *Sent:* Wednesday, July 30, 2014 12:15 PM
>
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> Are you using any tool to load data ? If yes, then the ETL tool will
> provide you such options.
>
> If not, then please explore unix file processing/external table route.
>
>
>
> On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> Hello,
>
>
>
> Thank you for your reply.
>
>
>
> Consider we have data divided into 5 columns (col1, col2, col3, col4,
> col5).
>
> So I can’t load directly col1, col3 and col5?
>
> If I can’t do it directly, can you provide me with an alternate solution?
>
>
>
> Thank you.
>
>
>
> *From:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Wednesday, July 30, 2014 11:37 AM
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> you mean just by writing query then I think no.
>
>
>
> But if you want to read only first 3 columns of the data then it would
> work with just a single table and load data into
>
>
>
> On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> Hello,
>
>
>
> I am interested in selecting specific data from a source and loading it to
> a table. For example, if I have 5 columns in my dataset, I want to load 3
> columns of it. Is it possible to do it without create a second table?
>
>
>
> Thank you
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Nitin Pawar
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Devopam Mittra
> Life and Relations are not binary
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
--
Nitin Pawar
RE: SELECT specific data
Posted by CHEBARO Abdallah <Ab...@murex.com>.
Thank you
From: Devopam Mittra [mailto:devopam@gmail.com]
Sent: Wednesday, July 30, 2014 2:57 PM
To: user@hive.apache.org
Subject: Re: SELECT specific data
If you have a defined table, then loading partial columns will be easiest handled with inserting the rest columns with NULL value after mapping your partial column file as an external table.
regards
Devopam
On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
I am only using Hive and hadoop, nothing more.
From: Devopam Mittra [mailto:devopam@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 12:15 PM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
Are you using any tool to load data ? If yes, then the ETL tool will provide you such options.
If not, then please explore unix file processing/external table route.
On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
Thank you for your reply.
Consider we have data divided into 5 columns (col1, col2, col3, col4, col5).
So I can’t load directly col1, col3 and col5?
If I can’t do it directly, can you provide me with an alternate solution?
Thank you.
From: Nitin Pawar [mailto:nitinpawar432@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 11:37 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
you mean just by writing query then I think no.
But if you want to read only first 3 columns of the data then it would work with just a single table and load data into
On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
I am interested in selecting specific data from a source and loading it to a table. For example, if I have 5 columns in my dataset, I want to load 3 columns of it. Is it possible to do it without create a second table?
Thank you
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Devopam Mittra
Life and Relations are not binary
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Devopam Mittra
Life and Relations are not binary
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
Re: SELECT specific data
Posted by Devopam Mittra <de...@gmail.com>.
If you have a defined table, then loading partial columns will be easiest
handled with inserting the rest columns with NULL value after mapping your
partial column file as an external table.
regards
Devopam
On Wed, Jul 30, 2014 at 2:49 PM, CHEBARO Abdallah <
Abdallah.CHEBARO@murex.com> wrote:
> I am only using Hive and hadoop, nothing more.
>
>
>
> *From:* Devopam Mittra [mailto:devopam@gmail.com]
> *Sent:* Wednesday, July 30, 2014 12:15 PM
>
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> Are you using any tool to load data ? If yes, then the ETL tool will
> provide you such options.
>
> If not, then please explore unix file processing/external table route.
>
>
>
> On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> Hello,
>
>
>
> Thank you for your reply.
>
>
>
> Consider we have data divided into 5 columns (col1, col2, col3, col4,
> col5).
>
> So I can’t load directly col1, col3 and col5?
>
> If I can’t do it directly, can you provide me with an alternate solution?
>
>
>
> Thank you.
>
>
>
> *From:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Wednesday, July 30, 2014 11:37 AM
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> you mean just by writing query then I think no.
>
>
>
> But if you want to read only first 3 columns of the data then it would
> work with just a single table and load data into
>
>
>
> On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> Hello,
>
>
>
> I am interested in selecting specific data from a source and loading it to
> a table. For example, if I have 5 columns in my dataset, I want to load 3
> columns of it. Is it possible to do it without create a second table?
>
>
>
> Thank you
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Nitin Pawar
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Devopam Mittra
> Life and Relations are not binary
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
--
Devopam Mittra
Life and Relations are not binary
RE: SELECT specific data
Posted by CHEBARO Abdallah <Ab...@murex.com>.
I am only using Hive and hadoop, nothing more.
From: Devopam Mittra [mailto:devopam@gmail.com]
Sent: Wednesday, July 30, 2014 12:15 PM
To: user@hive.apache.org
Subject: Re: SELECT specific data
Are you using any tool to load data ? If yes, then the ETL tool will provide you such options.
If not, then please explore unix file processing/external table route.
On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
Thank you for your reply.
Consider we have data divided into 5 columns (col1, col2, col3, col4, col5).
So I can’t load directly col1, col3 and col5?
If I can’t do it directly, can you provide me with an alternate solution?
Thank you.
From: Nitin Pawar [mailto:nitinpawar432@gmail.com<ma...@gmail.com>]
Sent: Wednesday, July 30, 2014 11:37 AM
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: Re: SELECT specific data
you mean just by writing query then I think no.
But if you want to read only first 3 columns of the data then it would work with just a single table and load data into
On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
I am interested in selecting specific data from a source and loading it to a table. For example, if I have 5 columns in my dataset, I want to load 3 columns of it. Is it possible to do it without create a second table?
Thank you
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Devopam Mittra
Life and Relations are not binary
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
Re: SELECT specific data
Posted by Devopam Mittra <de...@gmail.com>.
Are you using any tool to load data ? If yes, then the ETL tool will
provide you such options.
If not, then please explore unix file processing/external table route.
On Wed, Jul 30, 2014 at 2:09 PM, CHEBARO Abdallah <
Abdallah.CHEBARO@murex.com> wrote:
> Hello,
>
>
>
> Thank you for your reply.
>
>
>
> Consider we have data divided into 5 columns (col1, col2, col3, col4,
> col5).
>
> So I can’t load directly col1, col3 and col5?
>
> If I can’t do it directly, can you provide me with an alternate solution?
>
>
>
> Thank you.
>
>
>
> *From:* Nitin Pawar [mailto:nitinpawar432@gmail.com]
> *Sent:* Wednesday, July 30, 2014 11:37 AM
> *To:* user@hive.apache.org
> *Subject:* Re: SELECT specific data
>
>
>
> you mean just by writing query then I think no.
>
>
>
> But if you want to read only first 3 columns of the data then it would
> work with just a single table and load data into
>
>
>
> On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <
> Abdallah.CHEBARO@murex.com> wrote:
>
> Hello,
>
>
>
> I am interested in selecting specific data from a source and loading it to
> a table. For example, if I have 5 columns in my dataset, I want to load 3
> columns of it. Is it possible to do it without create a second table?
>
>
>
> Thank you
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
>
>
>
>
> --
> Nitin Pawar
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
--
Devopam Mittra
Life and Relations are not binary
RE: SELECT specific data
Posted by CHEBARO Abdallah <Ab...@murex.com>.
Hello,
Thank you for your reply.
Consider we have data divided into 5 columns (col1, col2, col3, col4, col5).
So I can’t load directly col1, col3 and col5?
If I can’t do it directly, can you provide me with an alternate solution?
Thank you.
From: Nitin Pawar [mailto:nitinpawar432@gmail.com]
Sent: Wednesday, July 30, 2014 11:37 AM
To: user@hive.apache.org
Subject: Re: SELECT specific data
you mean just by writing query then I think no.
But if you want to read only first 3 columns of the data then it would work with just a single table and load data into
On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <Ab...@murex.com>> wrote:
Hello,
I am interested in selecting specific data from a source and loading it to a table. For example, if I have 5 columns in my dataset, I want to load 3 columns of it. Is it possible to do it without create a second table?
Thank you
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
--
Nitin Pawar
*******************************
This e-mail contains information for the intended recipient only. It may contain proprietary material or confidential information. If you are not the intended recipient you are not authorised to distribute, copy or use this e-mail or any attachment to it. Murex cannot guarantee that it is virus free and accepts no responsibility for any loss or damage arising from its use. If you have received this e-mail in error please notify immediately the sender and delete the original email received, any attachments and all copies from your system.
Re: SELECT specific data
Posted by Nitin Pawar <ni...@gmail.com>.
you mean just by writing query then I think no.
But if you want to read only first 3 columns of the data then it would work
with just a single table and load data into
On Wed, Jul 30, 2014 at 1:47 PM, CHEBARO Abdallah <
Abdallah.CHEBARO@murex.com> wrote:
> Hello,
>
>
>
> I am interested in selecting specific data from a source and loading it to
> a table. For example, if I have 5 columns in my dataset, I want to load 3
> columns of it. Is it possible to do it without create a second table?
>
>
>
> Thank you
>
> *******************************
>
> This e-mail contains information for the intended recipient only. It may
> contain proprietary material or confidential information. If you are not
> the intended recipient you are not authorised to distribute, copy or use
> this e-mail or any attachment to it. Murex cannot guarantee that it is
> virus free and accepts no responsibility for any loss or damage arising
> from its use. If you have received this e-mail in error please notify
> immediately the sender and delete the original email received, any
> attachments and all copies from your system.
>
--
Nitin Pawar