You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Philip Zeyliger (JIRA)" <ji...@apache.org> on 2018/06/06 17:32:00 UTC

[jira] [Commented] (IMPALA-7131) Support external data sources without catalogd

    [ https://issues.apache.org/jira/browse/IMPALA-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503633#comment-16503633 ] 

Philip Zeyliger commented on IMPALA-7131:
-----------------------------------------

When I was looking to remove them, I found that they were actually stored specially in the metastore. [https://gerrit.cloudera.org/#/c/9192/] was the review. The relevant bit from the commit message was as follows, and there are actually more properties to determine the class. So, I think they are persisted.
{code:java}
[pannier.ca.cloudera.com:21000] > create table t (x int) stored as textfile tblproperties('__IMPALA_DATA_SOURCE_NAME'='V1');{code}

> Support external data sources without catalogd
> ----------------------------------------------
>
>                 Key: IMPALA-7131
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7131
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Catalog, Frontend
>            Reporter: Todd Lipcon
>            Priority: Minor
>
> Currently it seems that external data sources are not persisted except in memory on the catalogd. This means that it will be somewhat more difficult to support this feature in the design of impalad without a catalogd.
> This JIRA is to eventually figure out a way to support this feature -- either by supporting in-memory on a per-impalad basis, or perhaps by figuring out a way to register them persistently in a file system directory, etc.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org