You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Awhan Patnaik <aw...@spotzot.com> on 2015/12/04 11:26:09 UTC
how to search the archive
Hey all!
I have two questions:
1) How do I search the entire mailing list archive?
2) Sometimes I find that managed tables are not removed from HDFS even
after I drop them from the Hive shell. After a "drop table foo", foo does
not show up in a "show tables" listing however that table is present in
HDFS. These are not external tables.
Re: how to search the archive
Posted by Awhan Patnaik <aw...@spotzot.com>.
On Fri, Dec 4, 2015 at 7:26 PM, Timothy Garza <
timothy.garza@collinsongroup.com> wrote:
>
>
>
> Q. What does that have to do with the text in the Subject line in your
> email?
>
>
>
>
>
Yes sorry about that. That question is not related to the subject line of
the mail. In any case could somebody let me know how to search the mailing
list archive just in case my question has been previously discussed.
Re: how to search the archive
Posted by Awhan Patnaik <aw...@spotzot.com>.
On Mon, Dec 7, 2015 at 3:22 AM, Lefty Leverenz <le...@gmail.com>
wrote:
> I've been hoping someone else would answer the question about searching
> the archives, but here's what I know:
>
> 1. The Apache archives linked from Hive's mailing lists
> <http://hive.apache.org/mailing_lists.html> page don't seem to be
> searchable.
> 2. Links to searchable MarkMail archives are broken on the mailing
> lists page.
> 3. Find the MarkMail archives here:
> http://apache.markmail.org/search/?q=hive.
> - Clicking on a list puts it in the upper-right search field.
> - Add your search string in quotes.
> - Example:
> http://apache.markmail.org/search/?q=hive+list%3Aorg.apache.hadoop.hive-user+%22search+the+archive%22
> .
> - The ? button gives more search functions.
>
> If anyone knows more, please tell us.
>
> -- Lefty
>
>
Many thanks.
Re: how to search the archive
Posted by Lefty Leverenz <le...@gmail.com>.
I've been hoping someone else would answer the question about searching the
archives, but here's what I know:
1. The Apache archives linked from Hive's mailing lists
<http://hive.apache.org/mailing_lists.html> page don't seem to be
searchable.
2. Links to searchable MarkMail archives are broken on the mailing lists
page.
3. Find the MarkMail archives here:
http://apache.markmail.org/search/?q=hive.
- Clicking on a list puts it in the upper-right search field.
- Add your search string in quotes.
- Example:
http://apache.markmail.org/search/?q=hive+list%3Aorg.apache.hadoop.hive-user+%22search+the+archive%22
.
- The ? button gives more search functions.
If anyone knows more, please tell us.
-- Lefty
On Sun, Dec 6, 2015 at 6:08 AM, Awhan Patnaik <aw...@spotzot.com> wrote:
>
>
> On Fri, Dec 4, 2015 at 8:41 PM, Takahiko Saito <ty...@gmail.com> wrote:
>
>> Could a table be an external table?
>>
>>
>>
> Yes.
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-ExternalTables
>
Re: how to search the archive
Posted by Awhan Patnaik <aw...@spotzot.com>.
On Fri, Dec 4, 2015 at 8:41 PM, Takahiko Saito <ty...@gmail.com> wrote:
> Could a table be an external table?
>
>
>
Yes.
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-ExternalTables
Re: how to search the archive
Posted by Edward Capriolo <ed...@gmail.com>.
2) Sometimes I find that managed tables are not removed from HDFS even
after I drop them from the Hive shell. After a "drop table foo", foo does
not show up in a "show tables" listing however that table is present in
HDFS. These are not external tables.
I have noticed this as well. Sometimes this can be about the permissions of
the user that created the table. For example based on the UserGroupAll +
StickyBit a user might be able to create a table but another user might not
be able to drop them.
I had one weird issue where I could not drop a table as a different user
because one of the subdirs had a sticky bit and attempting to move the
sticky bit caused a failed file operation
On Fri, Dec 4, 2015 at 10:33 AM, Timothy Garza <
timothy.garza@collinsongroup.com> wrote:
> No, definitely not. A Hive table with Sequence Files stored in hdfs:
> /user/warehouse/<tablename>
>
>
>
>
>
> *Kind Regards *
>
>
> *Timothy Garza*
>
> Data Integration Developer
> *Collinson Technology Services*
>
> Skype: timothy.garza.cts
>
> collinsongroup.com <http://www.collinsongroup.com/>
>
>
>
> [image: Collinson Group] <http://www.collinsongroup.com/>
>
>
>
>
>
> *From:* Takahiko Saito [mailto:tysaito@gmail.com]
> *Sent:* 04 December 2015 15:12
> *To:* user@hive.apache.org
> *Subject:* Re: how to search the archive
>
>
>
> Could a table be an external table?
>
>
>
> On Fri, Dec 4, 2015 at 5:56 AM, Timothy Garza <
> timothy.garza@collinsongroup.com> wrote:
>
> I find the same thing, especially with Hive v1.2.1 that I am currently
> trialling. It does lead to issues with the Metastore when trying to re-use
> the same Hive Table name and I find manually deleting the files in HDFS
> serves as a workaround.
>
>
>
> Q. What does that have to do with the text in the Subject line in your
> email?
>
>
>
>
>
> *From:* Awhan Patnaik [mailto:awhan@spotzot.com]
> *Sent:* 04 December 2015 10:26
> *To:* user@hive.apache.org
> *Subject:* how to search the archive
>
>
>
> Hey all!
>
> I have two questions:
>
> 1) How do I search the entire mailing list archive?
>
> 2) Sometimes I find that managed tables are not removed from HDFS even
> after I drop them from the Hive shell. After a "drop table foo", foo does
> not show up in a "show tables" listing however that table is present in
> HDFS. These are not external tables.
>
>
>
> The Collinson Group Limited; Registered number: 2577557, Registered in
> England & Wales; Registered Office: Cutlers Exchange, 123 Houndsditch,
> London, EC3A 7BU.
>
>
> This e-mail may contain privileged and confidential information and/or
> copyright material and is intended for the use of the addressee only. If
> you receive this e-mail by mistake please advise the sender immediately by
> using the reply facility in your e-mail software and delete this e-mail
> from your computer system. You may not deliver, copy or disclose its
> contents to anyone else. Any unauthorised use may be unlawful. Any views
> expressed in this e-mail are those of the individual sender and may not
> necessarily reflect the views of The Collinson Group Ltd and/or its
> subsidiaries or any other associated company (collectively “Collinson
> Group”).
>
> As communications via the Internet are not secure Collinson Group cannot
> accept any liability if this e-mail is accessed by third parties during the
> course of transmission or is modified or amended in any way following
> despatch. Collinson Group cannot guarantee that any attachment to this
> email does not contain a virus, therefore it is strongly recommended that
> you carry out your own virus check before opening any attachment, as we
> cannot accept liability for any damage sustained as a result of software
> virus infection. Senders of messages shall be taken to consent to the
> monitoring and recording of e-mails addressed to members of the Company.
>
>
>
>
>
> --
>
> Takahiko Saito
>
RE: how to search the archive
Posted by Timothy Garza <ti...@collinsongroup.com>.
No, definitely not. A Hive table with Sequence Files stored in hdfs: /user/warehouse/<tablename>
Kind Regards
Timothy Garza
Data Integration Developer
Collinson Technology Services
Skype: timothy.garza.cts
collinsongroup.com<http://www.collinsongroup.com/>
[Collinson Group]<http://www.collinsongroup.com/>
From: Takahiko Saito [mailto:tysaito@gmail.com]
Sent: 04 December 2015 15:12
To: user@hive.apache.org
Subject: Re: how to search the archive
Could a table be an external table?
On Fri, Dec 4, 2015 at 5:56 AM, Timothy Garza <ti...@collinsongroup.com>> wrote:
I find the same thing, especially with Hive v1.2.1 that I am currently trialling. It does lead to issues with the Metastore when trying to re-use the same Hive Table name and I find manually deleting the files in HDFS serves as a workaround.
Q. What does that have to do with the text in the Subject line in your email?
From: Awhan Patnaik [mailto:awhan@spotzot.com<ma...@spotzot.com>]
Sent: 04 December 2015 10:26
To: user@hive.apache.org<ma...@hive.apache.org>
Subject: how to search the archive
Hey all!
I have two questions:
1) How do I search the entire mailing list archive?
2) Sometimes I find that managed tables are not removed from HDFS even after I drop them from the Hive shell. After a "drop table foo", foo does not show up in a "show tables" listing however that table is present in HDFS. These are not external tables.
The Collinson Group Limited; Registered number: 2577557, Registered in England & Wales; Registered Office: Cutlers Exchange, 123 Houndsditch, London, EC3A 7BU.
This e-mail may contain privileged and confidential information and/or copyright material and is intended for the use of the addressee only. If you receive this e-mail by mistake please advise the sender immediately by using the reply facility in your e-mail software and delete this e-mail from your computer system. You may not deliver, copy or disclose its contents to anyone else. Any unauthorised use may be unlawful. Any views expressed in this e-mail are those of the individual sender and may not necessarily reflect the views of The Collinson Group Ltd and/or its subsidiaries or any other associated company (collectively “Collinson Group”).
As communications via the Internet are not secure Collinson Group cannot accept any liability if this e-mail is accessed by third parties during the course of transmission or is modified or amended in any way following despatch. Collinson Group cannot guarantee that any attachment to this email does not contain a virus, therefore it is strongly recommended that you carry out your own virus check before opening any attachment, as we cannot accept liability for any damage sustained as a result of software virus infection. Senders of messages shall be taken to consent to the monitoring and recording of e-mails addressed to members of the Company.
--
Takahiko Saito
Re: how to search the archive
Posted by Takahiko Saito <ty...@gmail.com>.
Could a table be an external table?
On Fri, Dec 4, 2015 at 5:56 AM, Timothy Garza <
timothy.garza@collinsongroup.com> wrote:
> I find the same thing, especially with Hive v1.2.1 that I am currently
> trialling. It does lead to issues with the Metastore when trying to re-use
> the same Hive Table name and I find manually deleting the files in HDFS
> serves as a workaround.
>
>
>
> Q. What does that have to do with the text in the Subject line in your
> email?
>
>
>
>
>
> *From:* Awhan Patnaik [mailto:awhan@spotzot.com]
> *Sent:* 04 December 2015 10:26
> *To:* user@hive.apache.org
> *Subject:* how to search the archive
>
>
>
> Hey all!
>
> I have two questions:
>
> 1) How do I search the entire mailing list archive?
>
> 2) Sometimes I find that managed tables are not removed from HDFS even
> after I drop them from the Hive shell. After a "drop table foo", foo does
> not show up in a "show tables" listing however that table is present in
> HDFS. These are not external tables.
>
>
> The Collinson Group Limited; Registered number: 2577557, Registered in
> England & Wales; Registered Office: Cutlers Exchange, 123 Houndsditch,
> London, EC3A 7BU.
>
>
> This e-mail may contain privileged and confidential information and/or
> copyright material and is intended for the use of the addressee only. If
> you receive this e-mail by mistake please advise the sender immediately by
> using the reply facility in your e-mail software and delete this e-mail
> from your computer system. You may not deliver, copy or disclose its
> contents to anyone else. Any unauthorised use may be unlawful. Any views
> expressed in this e-mail are those of the individual sender and may not
> necessarily reflect the views of The Collinson Group Ltd and/or its
> subsidiaries or any other associated company (collectively “Collinson
> Group”).
>
> As communications via the Internet are not secure Collinson Group cannot
> accept any liability if this e-mail is accessed by third parties during the
> course of transmission or is modified or amended in any way following
> despatch. Collinson Group cannot guarantee that any attachment to this
> email does not contain a virus, therefore it is strongly recommended that
> you carry out your own virus check before opening any attachment, as we
> cannot accept liability for any damage sustained as a result of software
> virus infection. Senders of messages shall be taken to consent to the
> monitoring and recording of e-mails addressed to members of the Company.
>
--
Takahiko Saito
RE: how to search the archive
Posted by Timothy Garza <ti...@collinsongroup.com>.
I find the same thing, especially with Hive v1.2.1 that I am currently trialling. It does lead to issues with the Metastore when trying to re-use the same Hive Table name and I find manually deleting the files in HDFS serves as a workaround.
Q. What does that have to do with the text in the Subject line in your email?
From: Awhan Patnaik [mailto:awhan@spotzot.com]
Sent: 04 December 2015 10:26
To: user@hive.apache.org
Subject: how to search the archive
Hey all!
I have two questions:
1) How do I search the entire mailing list archive?
2) Sometimes I find that managed tables are not removed from HDFS even after I drop them from the Hive shell. After a "drop table foo", foo does not show up in a "show tables" listing however that table is present in HDFS. These are not external tables.
The Collinson Group Limited; Registered number: 2577557, Registered in England & Wales; Registered Office: Cutlers Exchange, 123 Houndsditch, London, EC3A 7BU.
This e-mail may contain privileged and confidential information and/or copyright material and is intended for the use of the addressee only. If you receive this e-mail by mistake please advise the sender immediately by using the reply facility in your e-mail software and delete this e-mail from your computer system. You may not deliver, copy or disclose its contents to anyone else. Any unauthorised use may be unlawful. Any views expressed in this e-mail are those of the individual sender and may not necessarily reflect the views of The Collinson Group Ltd and/or its subsidiaries or any other associated company (collectively “Collinson Group”).
As communications via the Internet are not secure Collinson Group cannot accept any liability if this e-mail is accessed by third parties during the course of transmission or is modified or amended in any way following despatch. Collinson Group cannot guarantee that any attachment to this email does not contain a virus, therefore it is strongly recommended that you carry out your own virus check before opening any attachment, as we cannot accept liability for any damage sustained as a result of software virus infection. Senders of messages shall be taken to consent to the monitoring and recording of e-mails addressed to members of the Company.