[jira] [Commented] (IMPALA-8455) GET_TABLE failed with InvalidStorageDescriptorException

["bharath v (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826271#comment-16826271 ] 

bharath v commented on IMPALA-8455:
-----------------------------------

This is the full stacktrace on the coordinator, for the record.

{noformat}
org.apache.impala.catalog.local.LocalCatalogException: Could not load table default.sample from metastore
	at org.apache.impala.catalog.local.LocalTable.loadTableMetadata(LocalTable.java:128)
	at org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:89)
	at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:116)
	at org.apache.impala.catalog.local.LocalCatalog.getTable(LocalCatalog.java:120)
	at org.apache.impala.service.MetadataOp.doGetDbsMetadata(MetadataOp.java:300)
	at org.apache.impala.service.MetadataOp.getDbsMetadata(MetadataOp.java:266)
	at org.apache.impala.service.MetadataOp.getTables(MetadataOp.java:519)
	at org.apache.impala.compat.MetastoreShim.execGetTables(MetastoreShim.java:117)
	at org.apache.impala.service.Frontend.execHiveServer2MetadataOp(Frontend.java:1505)
	at org.apache.impala.service.JniFrontend.execHiveServer2MetadataOp(JniFrontend.java:558)
Caused by: org.apache.thrift.TException: TGetPartialCatalogObjectResponse(status:TStatus(status_code:GENERAL, error_msgs:[TableLoadingException: Failed to load metadata for table: default.sample
CAUSED BY: InvalidStorageDescriptorException: Impala does not support tables of this type. REASON: SerDe library 'org.apache.hadoop.hive.serde2.OpenCSVSerde' is not supported.]), lookup_status:OK)
	at org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:336)
	at org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:164)
	at org.apache.impala.catalog.local.CatalogdMetaProvider$5.call(CatalogdMetaProvider.java:549)
	at org.apache.impala.catalog.local.CatalogdMetaProvider$5.call(CatalogdMetaProvider.java:544)
	at org.apache.impala.catalog.local.CatalogdMetaProvider$1.call(CatalogdMetaProvider.java:395)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4792)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257)
	at com.google.common.cache.LocalCache.get(LocalCache.java:4000)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4789)
	at org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:391)
	at org.apache.impala.catalog.local.CatalogdMetaProvider.loadTable(CatalogdMetaProvider.java:540)
	at org.apache.impala.catalog.local.LocalTable.loadTableMetadata(LocalTable.java:126)
	... 9 more
{noformat}.

I'm looking into why Catalog V1 doesn't hit the same issue. It is silently ignoring such incompatible tables.

> GET_TABLE failed with InvalidStorageDescriptorException
> -------------------------------------------------------
>
>                 Key: IMPALA-8455
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8455
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Xiaomin Zhang
>            Priority: Critical
>
> When ImpalaD is enabled local catalog mode, GET_TABLE call returns error when some table is using unsupported serde. 
> To reproduce:
> 1) Enable local catalog mode:
> --use_local_catalog=true
> --catalog_topic_mode=minimal
> --invalidate_tables_timeout_s=60
> 2) Create an CSV table:
> create table sample(id int)
>  row format serde 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
>  stored as textfile;
> 3) In HUE, it shows below error while loading the tables:
> *LocalCatalogException: Could not load table default.sample from metastore CAUSED BY: TException: TGetPartialCatalogObjectResponse(status:TStatus(status_code:GENERAL, error_msgs:[TableLoadingException: Failed to load metadata for table: default.sample CAUSED BY: InvalidStorageDescriptorException: Impala does not support tables of this type. REASON: SerDe library 'org.apache.hadoop.hive.serde2.OpenCSVSerde' is not supported.]), lookup_status:OK)* 
> 4) "SHOW TABLES" is not affected and runs fine.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org