You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by 金杰 <he...@gmail.com> on 2013/11/10 12:08:33 UTC
What is pfile in pom.xml
Hi, All
I found a line in pom.xml
<test.warehouse.scheme>pfile://</test.warehouse.scheme>
You can check it on https://github.com/apache/hive/blob/trunk/pom.xml#L61
What is pfile? Is pfile a file system schema, same as hdfs:// ?
Best Regards
金杰 (Jie Jin)
Re: What is pfile in pom.xml
Posted by Abdelrahman Shettia <as...@hortonworks.com>.
Hi Jie,
Seems that there is an error related to:
No FileSystem for scheme: pfile
Have you tried to replace the line?
<test.warehouse.scheme>pfile://</test.warehouse.scheme>
With:
/test
So that it would work in this format:
CREATE TABLE rename_partition_table (key STRING, value STRING) PARTITIONED BY (part STRING)
STORED AS RCFILE
LOCATION 'pfile:${system:test.tmp.dir}/rename_partition_table';
Basically it is the following conf:
<property>
<name>hive.exim.uri.scheme.whitelist</name>
<value>hdfs,pfile</value>
<description>A comma separated list of acceptable URI schemes for import and export.</description>
</property>
Thanks
-Abdelrahman
On Nov 10, 2013, at 6:06 AM, 金杰 <he...@gmail.com> wrote:
> When I run mvn test on my Ubuntu box, I got the following error message.
> I also run mvn test on CentOS, there is no error about pfile.
> This error message only happen on my ubuntu box.
> So, how to fix this?
>
> org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat Time elapsed: 11.811 sec <<< ERROR!
> java.lang.Exception: MetaException(message:Got exception: java.io.IOException No FileSystem for scheme: pfile)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:22138)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:22106)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result.read(ThriftHiveMetastore.java:22032)
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_create_table_with_environment_context(ThriftHiveMetastore.java:797)
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.create_table_with_environment_context(ThriftHiveMetastore.java:783)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:487)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:476)
> at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.createTable(TestHCatMultiOutputFormat.java:256)
> at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.initalizeTables(TestHCatMultiOutputFormat.java:234)
> at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.initializeSetup(TestHCatMultiOutputFormat.java:215)
> at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.setup(TestHCatMultiOutputFormat.java:192)
>
> org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat Time elapsed: 11.811 sec <<< ERROR!
> java.io.IOException: No FileSystem for scheme: pfile
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1443)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
> at org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.tearDown(TestHCatMultiOutputFormat.java:265)
>
>
>
> Best Regards
> 金杰 (Jie Jin)
>
>
> On Sun, Nov 10, 2013 at 7:08 PM, 金杰 <he...@gmail.com> wrote:
> Hi, All
>
> I found a line in pom.xml
>
> <test.warehouse.scheme>pfile://</test.warehouse.scheme>
>
> You can check it on https://github.com/apache/hive/blob/trunk/pom.xml#L61
> What is pfile? Is pfile a file system schema, same as hdfs:// ?
>
> Best Regards
> 金杰 (Jie Jin)
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: What is pfile in pom.xml
Posted by 金杰 <he...@gmail.com>.
When I run mvn test on my Ubuntu box, I got the following error message.
I also run mvn test on CentOS, there is no error about pfile.
This error message only happen on my ubuntu box.
So, how to fix this?
org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat Time elapsed:
11.811 sec <<< ERROR!
java.lang.Exception: MetaException(message:Got exception:
java.io.IOException No FileSystem for scheme: pfile)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:22138)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result$create_table_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:22106)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$create_table_with_environment_context_result.read(ThriftHiveMetastore.java:22032)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_create_table_with_environment_context(ThriftHiveMetastore.java:797)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.create_table_with_environment_context(ThriftHiveMetastore.java:783)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:487)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:476)
at
org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.createTable(TestHCatMultiOutputFormat.java:256)
at
org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.initalizeTables(TestHCatMultiOutputFormat.java:234)
at
org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.initializeSetup(TestHCatMultiOutputFormat.java:215)
at
org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.setup(TestHCatMultiOutputFormat.java:192)
org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat Time elapsed:
11.811 sec <<< ERROR!
java.io.IOException: No FileSystem for scheme: pfile
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1443)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
at
org.apache.hcatalog.mapreduce.TestHCatMultiOutputFormat.tearDown(TestHCatMultiOutputFormat.java:265)
Best Regards
金杰 (Jie Jin)
On Sun, Nov 10, 2013 at 7:08 PM, 金杰 <he...@gmail.com> wrote:
> Hi, All
>
> I found a line in pom.xml
>
> <test.warehouse.scheme>pfile://</test.warehouse.scheme>
>
> You can check it on https://github.com/apache/hive/blob/trunk/pom.xml#L61
> What is pfile? Is pfile a file system schema, same as hdfs:// ?
>
>
> Best Regards
> 金杰 (Jie Jin)
>