You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org> on 2009/05/01 09:29:30 UTC
[jira] Updated: (HIVE-453) external table metastore and execution
codepaths use default FileSystem object instead of using one derived from
the supplied path
[ https://issues.apache.org/jira/browse/HIVE-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HIVE-453:
-----------------------------------
Attachment: hive-453.patch.2
- add rollback of fs operations if transaction fails
- added a couple of negative tests that verify that metadata transactions don't succeed if fs operations fail.
also added a cli option (by default false) to keep processing queries even if we hit errors. this was necessary for writing the negative tests and is likely useful more generally as well.
> external table metastore and execution codepaths use default FileSystem object instead of using one derived from the supplied path
> ----------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-453
> URL: https://issues.apache.org/jira/browse/HIVE-453
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Metastore
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Priority: Critical
> Attachments: hive-453.patch.1, hive-453.patch.2
>
>
> with fs.default.name set to file:///:
> hive> create external table kvu(key int, val string) location 's3n://data.s3ndemo.hive/kv1.txt'
> FAILED: Error in metadata: java.lang.IllegalArgumentException: Wrong FS: s3n://data.s3ndemo.hive/kv1.txt, expected: file:///
> stack trace:
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:322)
> at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem
> .java:52)
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.jav
> a:308)
> at org.apache.hadoop.fs.ChecksumFileSystem.mkdirs(ChecksumFileSystem.jav
> a:462)
> at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:90)
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_tabl
> e(HiveMetaStore.java:293)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(Hive
> MetaStoreClient.java:252)
> at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:256)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.