[jira] [Comment Edited] (KYLIN-1702) The Key of the Snapshot to the related lookup table may be not informative

["Zhong Yanghong (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15444352#comment-15444352 ] 

Zhong Yanghong edited comment on KYLIN-1702 at 8/29/16 12:24 AM:
-----------------------------------------------------------------

Hi [~Shaofengshi], to make it compatible with old version, there are two ways:
1. upgrade the old path of snapshot to the new ones;
2. keep the old path, and let new snapshot go to the new path, and make the old path and new path compatible.

For the first solution, it may be trivial and We have to prepare an upgrade tool. For the second one, it's simple, but some duplication between the old path and the new path will occur. 

We have employed the second one and tested in eBay. It works well until now.


was (Author: yaho):
Hi [~Shaofengshi], as [~mahongbin] mentioned, the table name contains the db information. To make it compatible with old version, there are two ways:
1. upgrade the old path of snapshot to the new ones;
2. keep the old path, and let new snapshot go to the new path, and make the old path and new path compatible.

For the first solution, it may be trivial and We have to prepare an upgrade tool. For the second one, it's simple, but some duplication between the old path and the new path will occur. 

We have employed the second one and tested in eBay. It works well until now.

> The Key of the Snapshot to the related lookup table may be not informative
> --------------------------------------------------------------------------
>
>                 Key: KYLIN-1702
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1702
>             Project: Kylin
>          Issue Type: Improvement
>            Reporter: Zhong Yanghong
>            Assignee: Zhong Yanghong
>         Attachments: change_layout_path_of_table_snapshot_with_tableName.patch
>
>
> Currently the key for the snapshot stored in hbase metadata file is as follows:
> ResourceStore.SNAPSHOT_RESOURCE_ROOT + "/" + new File(signature.getPath()).getName() + "/" + uuid + ".snapshot"
> However, some hive tables stored in hive may organized like dirName/tableName/00, dirName/tableName/01.
> Based on current setting, the key will be ResourceStore.SNAPSHOT_RESOURCE_ROOT + "/" + 00 + "/" + uuid + ".snapshot", which is lack of the table name information.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)