You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hawq.apache.org by jin tao <to...@outlook.com> on 2016/05/18 07:02:29 UTC

PXF-java.lang.ClassNotFoundException: HdfsDataFragmenter

Hi,

I installed hawq 2.0 and pxf 3.0 in a cluster using ambari successfully.
1 master,3 salves,4 pxf client on each machine.
While I use PXF to query data on hdfs,it 
shows:java.lang.ClassNotFoundException: HdfsDataFragmenter.
the DDL is :
create external table test_pxf(
a int,
b char(1)
)
LOCATION 
('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=HdfsDataFragmenter&ACCESSOR=LineBreakAccessor&Resolver=TextResolver')FORMAT 
'CSV'(DELIMITER = E',');

when I run:
postgres=# select * from test_pxf;
ERROR:  remote component error (500) from '192.168.81.11:51200': type  
Exception report   message   java.lang.ClassNotFoundException: 
HdfsDataFragmenter    description   The server encountered an internal 
error that prevented it from fulfilling this request. exception   
javax.servlet.ServletException: java.lang.ClassNotFoundException: 
HdfsDataFragmenter (libchurl.c:878)

Pleas anyone could help me to fix this issue?
Thanks a lot.

Bset  regards!

jin tao

Re: REMOVE

Posted by Vineet Goel <vg...@pivotal.io>.
Hi All, You can self-serve by emailing the Unsubscription addresses listed here.
Emailing everyone on this group doesn’t help.

http://mail-archives.apache.org/mod_mbox/incubator-hawq-user/

Thanks





On May 20, 2016, at 11:20 AM, Daly, Tim <TD...@semprautilities.com> wrote:

Please remove me as well.
 
From: swethak yadav [mailto:swethakyadav@gmail.com] 
Sent: Friday, May 20, 2016 11:19 AM
To: user@hawq.incubator.apache.org; wowagner@gmail.com
Cc: Shivram Mani <sh...@gmail.com>
Subject: Re: REMOVE
 
Hi..please remove me also from the mailing list.

Regards,
Swethak

On May 20, 2016 2:13 PM, "Will Wagner" <wo...@gmail.com> wrote:
Hello, 
 
I requested 3 times already to be removed from the list.  Emailing to help@hawq.incubator.apache.org
 
Thank you, 
Will 

Sent from Yahoo Mail on Android
 
On Fri, May 20, 2016 at 10:50 AM, Shivram Mani
<sh...@gmail.com> wrote:
You can instead set Porfile=HdfsTextSimple insteado f setting fragmenter,accessor and resolver.
 
On Wed, May 18, 2016 at 1:47 AM, jin tao <to...@outlook.com> wrote:
Thanks.

resolved it by using the full java class path.

the correct ddl:
create external table test_pxf(
a int,
b char(1)
)
LOCATION ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=org.apache.hawq.pxf.plugins.hdfs.HdfsDataFragmenter&ACCESSOR=org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor&Resolver=org.apache.hawq.pxf.plugins.hdfs.StringPassResolver')FORMAT 'CSV'(DELIMITER = E',');


On 05/18/2016 03:02 PM, jin tao wrote:
Hi,

I installed hawq 2.0 and pxf 3.0 in a cluster using ambari successfully.
1 master,3 salves,4 pxf client on each machine.
While I use PXF to query data on hdfs,it shows:java.lang.ClassNotFoundException: HdfsDataFragmenter.
the DDL is :
create external table test_pxf(
a int,
b char(1)
)
LOCATION ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=HdfsDataFragmenter&ACCESSOR=LineBreakAccessor&Resolver=TextResolver')FORMAT 'CSV'(DELIMITER = E',');

when I run:
postgres=# select * from test_pxf;
ERROR:  remote component error (500) from '192.168.81.11:51200': type  Exception report   message java.lang.ClassNotFoundException: HdfsDataFragmenter description   The server encountered an internal  error that prevented it from fulfilling this request. exception javax.servlet.ServletException: java.lang.ClassNotFoundException: HdfsDataFragmenter (libchurl.c:878)

Pleas anyone could help me to fix this issue?
Thanks a lot.

Bset  regards!

jin tao
 


 
--
shivram mani
This email originated outside of Sempra Energy. Be cautious of attachments, web links, or requests for information.


RE: REMOVE

Posted by "Daly, Tim" <TD...@semprautilities.com>.
Please remove me as well.

From: swethak yadav [mailto:swethakyadav@gmail.com]
Sent: Friday, May 20, 2016 11:19 AM
To: user@hawq.incubator.apache.org; wowagner@gmail.com
Cc: Shivram Mani <sh...@gmail.com>
Subject: Re: REMOVE


Hi..please remove me also from the mailing list.

Regards,
Swethak
On May 20, 2016 2:13 PM, "Will Wagner" <wo...@gmail.com>> wrote:
Hello,

I requested 3 times already to be removed from the list.  Emailing to help@hawq.incubator.apache.org<ma...@hawq.incubator.apache.org>

Thank you,
Will
Sent from Yahoo Mail on Android<https://overview.mail.yahoo.com/mobile/?.src=Android>

On Fri, May 20, 2016 at 10:50 AM, Shivram Mani
<sh...@gmail.com>> wrote:
You can instead set Porfile=HdfsTextSimple insteado f setting fragmenter,accessor and resolver.

On Wed, May 18, 2016 at 1:47 AM, jin tao <to...@outlook.com>> wrote:
Thanks.

resolved it by using the full java class path.

the correct ddl:
create external table test_pxf(
a int,
b char(1)
)
LOCATION ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=org.apache.hawq.pxf.plugins.hdfs.HdfsDataFragmenter&ACCESSOR=org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor&Resolver=org.apache.hawq.pxf.plugins.hdfs.StringPassResolver')FORMAT 'CSV'(DELIMITER = E',');


On 05/18/2016 03:02 PM, jin tao wrote:
Hi,

I installed hawq 2.0 and pxf 3.0 in a cluster using ambari successfully.
1 master,3 salves,4 pxf client on each machine.
While I use PXF to query data on hdfs,it shows:java.lang.ClassNotFoundException: HdfsDataFragmenter.
the DDL is :
create external table test_pxf(
a int,
b char(1)
)
LOCATION ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=HdfsDataFragmenter&ACCESSOR=LineBreakAccessor&Resolver=TextResolver')FORMAT 'CSV'(DELIMITER = E',');

when I run:
postgres=# select * from test_pxf;
ERROR:  remote component error (500) from '192.168.81.11:51200<http://192.168.81.11:51200>': type  Exception report   message java.lang.ClassNotFoundException: HdfsDataFragmenter description   The server encountered an internal error that prevented it from fulfilling this request. exception javax.servlet.ServletException: java.lang.ClassNotFoundException: HdfsDataFragmenter (libchurl.c:878)

Pleas anyone could help me to fix this issue?
Thanks a lot.

Bset  regards!

jin tao




--
shivram mani
________________________________
This email originated outside of Sempra Energy. Be cautious of attachments, web links, or requests for information.

Re: REMOVE

Posted by swethak yadav <sw...@gmail.com>.
Hi..please remove me also from the mailing list.

Regards,
Swethak
On May 20, 2016 2:13 PM, "Will Wagner" <wo...@gmail.com> wrote:

> Hello,
>
> I requested 3 times already to be removed from the list.  Emailing to
> help@hawq.incubator.apache.org
>
> Thank you,
> Will
>
> Sent from Yahoo Mail on Android
> <https://overview.mail.yahoo.com/mobile/?.src=Android>
>
> On Fri, May 20, 2016 at 10:50 AM, Shivram Mani
> <sh...@gmail.com> wrote:
> You can instead set Porfile=HdfsTextSimple insteado f setting
> fragmenter,accessor and resolver.
>
> On Wed, May 18, 2016 at 1:47 AM, jin tao <to...@outlook.com> wrote:
>
>> Thanks.
>>
>> resolved it by using the full java class path.
>>
>> the correct ddl:
>> create external table test_pxf(
>> a int,
>> b char(1)
>> )
>> LOCATION
>> ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=org.apache.hawq.pxf.plugins.hdfs.HdfsDataFragmenter&ACCESSOR=org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor&Resolver=org.apache.hawq.pxf.plugins.hdfs.StringPassResolver')FORMAT
>> 'CSV'(DELIMITER = E',');
>>
>>
>> On 05/18/2016 03:02 PM, jin tao wrote:
>>
>>> Hi,
>>>
>>> I installed hawq 2.0 and pxf 3.0 in a cluster using ambari successfully.
>>> 1 master,3 salves,4 pxf client on each machine.
>>> While I use PXF to query data on hdfs,it
>>> shows:java.lang.ClassNotFoundException: HdfsDataFragmenter.
>>> the DDL is :
>>> create external table test_pxf(
>>> a int,
>>> b char(1)
>>> )
>>> LOCATION
>>> ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=HdfsDataFragmenter&ACCESSOR=LineBreakAccessor&Resolver=TextResolver')FORMAT
>>> 'CSV'(DELIMITER = E',');
>>>
>>> when I run:
>>> postgres=# select * from test_pxf;
>>> ERROR:  remote component error (500) from '192.168.81.11:51200': type
>>> Exception report   message java.lang.ClassNotFoundException:
>>> HdfsDataFragmenter description   The server encountered an internal error
>>> that prevented it from fulfilling this request. exception
>>> javax.servlet.ServletException: java.lang.ClassNotFoundException:
>>> HdfsDataFragmenter (libchurl.c:878)
>>>
>>> Pleas anyone could help me to fix this issue?
>>> Thanks a lot.
>>>
>>> Bset  regards!
>>>
>>> jin tao
>>>
>>
>>
>
>
> --
> shivram mani
>
>

REMOVE

Posted by Will Wagner <wo...@gmail.com>.
Hello, 
I requested 3 times already to be removed from the list.  Emailing to help@hawq.incubator.apache.org
Thank you, Will 

Sent from Yahoo Mail on Android 
 
  On Fri, May 20, 2016 at 10:50 AM, Shivram Mani<sh...@gmail.com> wrote:   You can instead set Porfile=HdfsTextSimple insteado f setting fragmenter,accessor and resolver.
On Wed, May 18, 2016 at 1:47 AM, jin tao <to...@outlook.com> wrote:

Thanks.

resolved it by using the full java class path.

the correct ddl:
create external table test_pxf(
a int,
b char(1)
)
LOCATION ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=org.apache.hawq.pxf.plugins.hdfs.HdfsDataFragmenter&ACCESSOR=org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor&Resolver=org.apache.hawq.pxf.plugins.hdfs.StringPassResolver')FORMAT 'CSV'(DELIMITER = E',');

On 05/18/2016 03:02 PM, jin tao wrote:

Hi,

I installed hawq 2.0 and pxf 3.0 in a cluster using ambari successfully.
1 master,3 salves,4 pxf client on each machine.
While I use PXF to query data on hdfs,it shows:java.lang.ClassNotFoundException: HdfsDataFragmenter.
the DDL is :
create external table test_pxf(
a int,
b char(1)
)
LOCATION ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=HdfsDataFragmenter&ACCESSOR=LineBreakAccessor&Resolver=TextResolver')FORMAT 'CSV'(DELIMITER = E',');

when I run:
postgres=# select * from test_pxf;
ERROR:  remote component error (500) from '192.168.81.11:51200': type  Exception report   message java.lang.ClassNotFoundException: HdfsDataFragmenter description   The server encountered an internal error that prevented it from fulfilling this request. exception javax.servlet.ServletException: java.lang.ClassNotFoundException: HdfsDataFragmenter (libchurl.c:878)

Pleas anyone could help me to fix this issue?
Thanks a lot.

Bset  regards!

jin tao






-- 
shivram mani  

Re: PXF-java.lang.ClassNotFoundException: HdfsDataFragmenter

Posted by Shivram Mani <sh...@gmail.com>.
You can instead set Porfile=HdfsTextSimple insteado f setting
fragmenter,accessor and resolver.

On Wed, May 18, 2016 at 1:47 AM, jin tao <to...@outlook.com> wrote:

> Thanks.
>
> resolved it by using the full java class path.
>
> the correct ddl:
> create external table test_pxf(
> a int,
> b char(1)
> )
> LOCATION
> ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=org.apache.hawq.pxf.plugins.hdfs.HdfsDataFragmenter&ACCESSOR=org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor&Resolver=org.apache.hawq.pxf.plugins.hdfs.StringPassResolver')FORMAT
> 'CSV'(DELIMITER = E',');
>
>
> On 05/18/2016 03:02 PM, jin tao wrote:
>
>> Hi,
>>
>> I installed hawq 2.0 and pxf 3.0 in a cluster using ambari successfully.
>> 1 master,3 salves,4 pxf client on each machine.
>> While I use PXF to query data on hdfs,it
>> shows:java.lang.ClassNotFoundException: HdfsDataFragmenter.
>> the DDL is :
>> create external table test_pxf(
>> a int,
>> b char(1)
>> )
>> LOCATION
>> ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=HdfsDataFragmenter&ACCESSOR=LineBreakAccessor&Resolver=TextResolver')FORMAT
>> 'CSV'(DELIMITER = E',');
>>
>> when I run:
>> postgres=# select * from test_pxf;
>> ERROR:  remote component error (500) from '192.168.81.11:51200': type
>> Exception report   message java.lang.ClassNotFoundException:
>> HdfsDataFragmenter description   The server encountered an internal error
>> that prevented it from fulfilling this request. exception
>> javax.servlet.ServletException: java.lang.ClassNotFoundException:
>> HdfsDataFragmenter (libchurl.c:878)
>>
>> Pleas anyone could help me to fix this issue?
>> Thanks a lot.
>>
>> Bset  regards!
>>
>> jin tao
>>
>
>


-- 
shivram mani

Re: PXF-java.lang.ClassNotFoundException: HdfsDataFragmenter

Posted by jin tao <to...@outlook.com>.
Thanks.

resolved it by using the full java class path.

the correct ddl:
create external table test_pxf(
a int,
b char(1)
)
LOCATION 
('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=org.apache.hawq.pxf.plugins.hdfs.HdfsDataFragmenter&ACCESSOR=org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor&Resolver=org.apache.hawq.pxf.plugins.hdfs.StringPassResolver')FORMAT 
'CSV'(DELIMITER = E',');

On 05/18/2016 03:02 PM, jin tao wrote:
> Hi,
>
> I installed hawq 2.0 and pxf 3.0 in a cluster using ambari successfully.
> 1 master,3 salves,4 pxf client on each machine.
> While I use PXF to query data on hdfs,it 
> shows:java.lang.ClassNotFoundException: HdfsDataFragmenter.
> the DDL is :
> create external table test_pxf(
> a int,
> b char(1)
> )
> LOCATION 
> ('pxf://vb2.hdp:51200/tmpdata/test.csv?Fragmenter=HdfsDataFragmenter&ACCESSOR=LineBreakAccessor&Resolver=TextResolver')FORMAT 
> 'CSV'(DELIMITER = E',');
>
> when I run:
> postgres=# select * from test_pxf;
> ERROR:  remote component error (500) from '192.168.81.11:51200': type  
> Exception report   message java.lang.ClassNotFoundException: 
> HdfsDataFragmenter description   The server encountered an internal 
> error that prevented it from fulfilling this request. exception 
> javax.servlet.ServletException: java.lang.ClassNotFoundException: 
> HdfsDataFragmenter (libchurl.c:878)
>
> Pleas anyone could help me to fix this issue?
> Thanks a lot.
>
> Bset  regards!
>
> jin tao