You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Rajendra Bhat <ra...@gmail.com> on 2016/10/25 10:11:34 UTC

class not found exception

Hi,

i am getting below error on create extrnal table. I have
copied hadoop-aws-2.7.1.jar and aws-java-sdk-1.7.4.jar to hive_home/lib
folder. please let me know where should need to place supporting jar..


hive> create external table kv (key int, value string)  location
's3a://myntra-datasciences/cip/test';
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask.
MetaException(message:java.lang.RuntimeException:
java.lang.ClassNotFoundException: Class
org.apache.hadoop.fs.s3a.S3AFileSystem not found)

-- 
Thanks and
Regards

Rajendra Bhat

Re: class not found exception

Posted by Rajendra Bhat <ra...@gmail.com>.
Hi ,



I have configured mysql metastore.  issues is on s3 supporting jar.

On Tue, Oct 25, 2016 at 4:43 PM, dv akhil <dv...@gmail.com> wrote:

> Hi,
>    which metastore are you using for hive? . Have you copied the jar
> containing the JDBC driver for your metadata db into hive's lib dir?
>
>
> down voteaccepted
>
>
>
> On Tue, Oct 25, 2016 at 4:29 PM, Rajendra Bhat <ra...@gmail.com>
> wrote:
>
>> hive> list jars;
>> /opt/apache-hive-2.0.1-bin/lib/hadoop-aws-2.7.1.jar
>> /opt/apache-hive-2.0.1-bin/lib/aws-java-sdk-1.7.4.jar
>> hive>
>>
>>
>> On Tue, Oct 25, 2016 at 4:27 PM, Rajendra Bhat <ra...@gmail.com>
>> wrote:
>>
>>> yes, I have added the jar on hive prompt.
>>>
>>> On Tue, Oct 25, 2016 at 4:25 PM, aft <af...@gmail.com> wrote:
>>>
>>>> On Tue, Oct 25, 2016 at 6:11 AM, Rajendra Bhat <ra...@gmail.com>
>>>> wrote:
>>>> > Hi,
>>>> >
>>>> > i am getting below error on create extrnal table. I have copied
>>>> > hadoop-aws-2.7.1.jar and aws-java-sdk-1.7.4.jar to hive_home/lib
>>>> folder.
>>>> > please let me know where should need to place supporting jar..
>>>> >
>>>> >
>>>> > hive> create external table kv (key int, value string)  location
>>>> > 's3a://myntra-datasciences/cip/test';
>>>> > FAILED: Execution Error, return code 1 from
>>>> > org.apache.hadoop.hive.ql.exec.DDLTask.
>>>> > MetaException(message:java.lang.RuntimeException:
>>>> > java.lang.ClassNotFoundException: Class
>>>> > org.apache.hadoop.fs.s3a.S3AFileSystem not found)
>>>>
>>>> Have you added the jars at hive prompt with "add jar " command?
>>>>
>>>> >
>>>> > --
>>>> > Thanks and
>>>> > Regards
>>>> >
>>>> > Rajendra Bhat
>>>>
>>>
>>>
>>>
>>> --
>>> Thanks and
>>> Regards
>>>
>>> Rajendra Bhat
>>>
>>
>>
>>
>> --
>> Thanks and
>> Regards
>>
>> Rajendra Bhat
>>
>
>


-- 
Thanks and
Regards

Rajendra Bhat

Re: class not found exception

Posted by dv akhil <dv...@gmail.com>.
Hi,
   which metastore are you using for hive? . Have you copied the jar
containing the JDBC driver for your metadata db into hive's lib dir?


down voteaccepted



On Tue, Oct 25, 2016 at 4:29 PM, Rajendra Bhat <ra...@gmail.com> wrote:

> hive> list jars;
> /opt/apache-hive-2.0.1-bin/lib/hadoop-aws-2.7.1.jar
> /opt/apache-hive-2.0.1-bin/lib/aws-java-sdk-1.7.4.jar
> hive>
>
>
> On Tue, Oct 25, 2016 at 4:27 PM, Rajendra Bhat <ra...@gmail.com>
> wrote:
>
>> yes, I have added the jar on hive prompt.
>>
>> On Tue, Oct 25, 2016 at 4:25 PM, aft <af...@gmail.com> wrote:
>>
>>> On Tue, Oct 25, 2016 at 6:11 AM, Rajendra Bhat <ra...@gmail.com>
>>> wrote:
>>> > Hi,
>>> >
>>> > i am getting below error on create extrnal table. I have copied
>>> > hadoop-aws-2.7.1.jar and aws-java-sdk-1.7.4.jar to hive_home/lib
>>> folder.
>>> > please let me know where should need to place supporting jar..
>>> >
>>> >
>>> > hive> create external table kv (key int, value string)  location
>>> > 's3a://myntra-datasciences/cip/test';
>>> > FAILED: Execution Error, return code 1 from
>>> > org.apache.hadoop.hive.ql.exec.DDLTask.
>>> > MetaException(message:java.lang.RuntimeException:
>>> > java.lang.ClassNotFoundException: Class
>>> > org.apache.hadoop.fs.s3a.S3AFileSystem not found)
>>>
>>> Have you added the jars at hive prompt with "add jar " command?
>>>
>>> >
>>> > --
>>> > Thanks and
>>> > Regards
>>> >
>>> > Rajendra Bhat
>>>
>>
>>
>>
>> --
>> Thanks and
>> Regards
>>
>> Rajendra Bhat
>>
>
>
>
> --
> Thanks and
> Regards
>
> Rajendra Bhat
>

Re: class not found exception

Posted by Rajendra Bhat <ra...@gmail.com>.
hive> list jars;
/opt/apache-hive-2.0.1-bin/lib/hadoop-aws-2.7.1.jar
/opt/apache-hive-2.0.1-bin/lib/aws-java-sdk-1.7.4.jar
hive>


On Tue, Oct 25, 2016 at 4:27 PM, Rajendra Bhat <ra...@gmail.com> wrote:

> yes, I have added the jar on hive prompt.
>
> On Tue, Oct 25, 2016 at 4:25 PM, aft <af...@gmail.com> wrote:
>
>> On Tue, Oct 25, 2016 at 6:11 AM, Rajendra Bhat <ra...@gmail.com>
>> wrote:
>> > Hi,
>> >
>> > i am getting below error on create extrnal table. I have copied
>> > hadoop-aws-2.7.1.jar and aws-java-sdk-1.7.4.jar to hive_home/lib folder.
>> > please let me know where should need to place supporting jar..
>> >
>> >
>> > hive> create external table kv (key int, value string)  location
>> > 's3a://myntra-datasciences/cip/test';
>> > FAILED: Execution Error, return code 1 from
>> > org.apache.hadoop.hive.ql.exec.DDLTask.
>> > MetaException(message:java.lang.RuntimeException:
>> > java.lang.ClassNotFoundException: Class
>> > org.apache.hadoop.fs.s3a.S3AFileSystem not found)
>>
>> Have you added the jars at hive prompt with "add jar " command?
>>
>> >
>> > --
>> > Thanks and
>> > Regards
>> >
>> > Rajendra Bhat
>>
>
>
>
> --
> Thanks and
> Regards
>
> Rajendra Bhat
>



-- 
Thanks and
Regards

Rajendra Bhat

Re: class not found exception

Posted by Rajendra Bhat <ra...@gmail.com>.
yes, I have added the jar on hive prompt.

On Tue, Oct 25, 2016 at 4:25 PM, aft <af...@gmail.com> wrote:

> On Tue, Oct 25, 2016 at 6:11 AM, Rajendra Bhat <ra...@gmail.com>
> wrote:
> > Hi,
> >
> > i am getting below error on create extrnal table. I have copied
> > hadoop-aws-2.7.1.jar and aws-java-sdk-1.7.4.jar to hive_home/lib folder.
> > please let me know where should need to place supporting jar..
> >
> >
> > hive> create external table kv (key int, value string)  location
> > 's3a://myntra-datasciences/cip/test';
> > FAILED: Execution Error, return code 1 from
> > org.apache.hadoop.hive.ql.exec.DDLTask.
> > MetaException(message:java.lang.RuntimeException:
> > java.lang.ClassNotFoundException: Class
> > org.apache.hadoop.fs.s3a.S3AFileSystem not found)
>
> Have you added the jars at hive prompt with "add jar " command?
>
> >
> > --
> > Thanks and
> > Regards
> >
> > Rajendra Bhat
>



-- 
Thanks and
Regards

Rajendra Bhat

Re: class not found exception

Posted by aft <af...@gmail.com>.
On Tue, Oct 25, 2016 at 6:11 AM, Rajendra Bhat <ra...@gmail.com> wrote:
> Hi,
>
> i am getting below error on create extrnal table. I have copied
> hadoop-aws-2.7.1.jar and aws-java-sdk-1.7.4.jar to hive_home/lib folder.
> please let me know where should need to place supporting jar..
>
>
> hive> create external table kv (key int, value string)  location
> 's3a://myntra-datasciences/cip/test';
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask.
> MetaException(message:java.lang.RuntimeException:
> java.lang.ClassNotFoundException: Class
> org.apache.hadoop.fs.s3a.S3AFileSystem not found)

Have you added the jars at hive prompt with "add jar " command?

>
> --
> Thanks and
> Regards
>
> Rajendra Bhat