You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Amit Shah <am...@gmail.com> on 2016/03/01 07:19:41 UTC

Re: HBase Phoenix Integration

Hi Sergey,

I get lot of compilation errors when I compile the source code
for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
compilation succeeds when the changes to include cloudera dependent
versions are not included. The only difference between the code changes
suggested on the stackoverflow post and mine is the cloudera cdh version. I
am using cdh 5.5.2. I didn't quite follow the reason behind the code
changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>
wrote:

> Hi Amit,
>
> Switching to 4.3 means you need HBase 0.98. What kind of problem you
> experienced after building 4.6 from sources with changes suggested on
> StackOverflow?
>
> Thanks,
> Sergey
>
> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> > An update -
> >
> > I was able to execute "./sqlline.py <zookeeper-server-name>" command but
> I
> > get the same exception as I mentioned earlier.
> >
> > Later I tried following the steps mentioned on this link with phoenix
> 4.3.0
> > but I still get an error this time with a different stack trace
> (attached to
> > this mail)
> >
> > Any help would be appreciated
> >
> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
> >>
> >> Hi Murugesan,
> >>
> >> What preconditions would I need on the server to execute the python
> >> script? I have Python 2.7.5 installed on the zookeeper server. If I just
> >> copy the sqlline script to the /etc/hbase/conf directory and execute it
> I
> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
> version
> >> server and core phoenix jars in HBase/lib directory on the master and
> region
> >> servers.
> >>
> >> Traceback (most recent call last):
> >>   File "./sqlline.py", line 25, in <module>
> >>     import phoenix_utils
> >> ImportError: No module named phoenix_utils
> >>
> >> Pardon me for my knowledge about python.
> >>
> >> Thanks,
> >> Amit
> >>
> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
> >> wrote:
> >>>
> >>> Did you test and confirm your phoenix shell from the zookeeper server?
> >>>
> >>> cd /etc/hbase/conf
> >>>
> >>> > phoenix-sqlline.py <zookeeperserver>:2181
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Amit Shah [mailto:amits.84@gmail.com]
> >>> Sent: Friday, February 26, 2016 4:45 AM
> >>> To: user@phoenix.apache.org
> >>> Subject: HBase Phoenix Integration
> >>>
> >>>
> >>>
> >>> Hello,
> >>>
> >>>
> >>>
> >>> I have been trying to install phoenix on my cloudera hbase cluster.
> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
> >>>
> >>>
> >>>
> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the master
> and
> >>> region servers and restarted the hbase cluster. I copied the
> corresponding
> >>> client jar on my SQuirrel client but I get an exception on connect.
> Pasted
> >>> below. The connection url is
> “jdbc:phoenix:<zookeeper-server-name>:2181".
> >>>
> >>> I even tried compiling the source by adding cloudera dependencies as
> >>> suggested on this post but didn't succeed.
> >>>
> >>>
> >>>
> >>> Any suggestions to make this work?
> >>>
> >>>
> >>>
> >>> Thanks,
> >>>
> >>> Amit.
> >>>
> >>>
> >>>
> >>> ________________________________________________________________
> >>>
> >>>
> >>>
> >>> Caused by:
> >>>
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
> >>>
> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
> >>>
> >>>             at
> >>>
> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> >>>
> >>>             at java.lang.Thread.run(Thread.java:745)
> >>>
> >>> Caused by: java.lang.NoSuchMethodError:
> >>>
> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
> >>>
> >>>             ... 10 more
> >>>
> >>>
> >>>
> >>> P.S - The full stacktrace is attached in the mail.
> >>
> >>
> >
>

Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 

Thanks,
Sun.






From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 


RE: RE: HBase Phoenix Integration

Posted by Dor Ben Dov <do...@amdocs.com>.
Sun
Are you using it in production ? I mean Hbase and Phoenix ?

Dor

From: Fulin Sun [mailto:sunfl@certusnet.com.cn]
Sent: יום ג 01 מרץ 2016 10:43
To: user
Subject: Re: RE: HBase Phoenix Integration

No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also
give me no luck.


________________________________
________________________________

From: Dor Ben Dov<ma...@amdocs.com>
Date: 2016-03-01 16:39
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration
Sun
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ?

Dor

From: Fulin Sun [mailto:sunfl@certusnet.com.cn]
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration

Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former.
Hope some guy can explain this and issue an workaround.

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this :
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/



Thanks,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 15:37
To: user<ma...@phoenix.apache.org>; jamestaylor<ma...@apache.org>
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>> wrote:
James,
Do you have any problems working with Phoenix latest with CDH 5.5.X ?

Dor

From: James Taylor [mailto:jamestaylor@apache.org<ma...@apache.org>]
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration

Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com>> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com>> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com<ma...@gmail.com>]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org<ma...@phoenix.apache.org>
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>


This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp


RE: Re: HBase Phoenix Integration

Posted by Dor Ben Dov <do...@amdocs.com>.
Thanks Michael for the details.
Dor

From: Michael McAllister [mailto:mmcallister@homeaway.com]
Sent: יום ד 02 מרץ 2016 01:58
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration

Technically, it depends on which version of HDP you are on. Here are the versions:-

HDP 2.1 = Apache Phoenix 4.0
HDP 2.2 = Apache Phoenix 4.2
HDP 2.3 = Apache Phoenix 4.4
HDP 2.4 = Apache Phoenix 4.4

(From this page -> http://hortonworks.com/hdp/whats-new/)

Michael McAllister
Staff Data Warehouse Engineer | Decision Systems
mmcallister@HomeAway.com<ma...@HomeAway.com> | C: 512.423.7447 | skype: michael.mcallister.ha<ma...@hotmail.com> | webex: https://h.a/mikewebex
[Description: Description: cid:3410354473_30269081]
This electronic communication (including any attachment) is confidential.  If you are not an intended recipient of this communication, please be advised that any disclosure, dissemination, distribution, copying or other use of this communication or any attachment is strictly prohibited.  If you have received this communication in error, please notify the sender immediately by reply e-mail and promptly destroy all electronic and printed copies of this communication and any attachment.

From: Bulvik, Noam [mailto:Noam.Bulvik@teoco.com]
Sent: Tuesday, March 01, 2016 5:10 AM
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration

4.4

From: Dor Ben Dov [mailto:dor.ben-dov@amdocs.com]
Sent: Tuesday, March 1, 2016 12:34 PM
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration

Any one knows here which version of Phoenix being used in HortonWorks bundle ?
Dor

From: Amit Shah [mailto:amits.84@gmail.com]
Sent: יום ג 01 מרץ 2016 12:33
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: Re: Re: HBase Phoenix Integration

Hi Sun,

In my deployment I have only one zookeeper node. I do not have cluster. What was your command line string to connect? Did you specify the port number?
I specify this ./sqlline.py <zookeeper-server-name>:2181

Regards,
Amit.

On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi, Amit
I had successfully built the git repo according to your file change. But when I try to use sqlline to connect to Phoenix,
I ran into the following error:

while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the regionservers being killed abnormally.

Had you met this issue when you use in your scenerio ? If so, please suggest how to resolve this.

Thanks.

 Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Error: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0

________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 18:00
To: user<ma...@phoenix.apache.org>
Subject: Re: Re: HBase Phoenix Integration
Sure Sun.
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ?
Thanks a lot.

Best,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 17:22
To: user<ma...@phoenix.apache.org>
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also
give me no luck.


________________________________
________________________________

From: Dor Ben Dov<ma...@amdocs.com>
Date: 2016-03-01 16:39
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration
Sun
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ?

Dor

From: Fulin Sun [mailto:sunfl@certusnet.com.cn<ma...@certusnet.com.cn>]
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration

Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former.
Hope some guy can explain this and issue an workaround.

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this :
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/

Thanks,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 15:37
To: user<ma...@phoenix.apache.org>; jamestaylor<ma...@apache.org>
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>> wrote:
James,
Do you have any problems working with Phoenix latest with CDH 5.5.X ?

Dor

From: James Taylor [mailto:jamestaylor@apache.org<ma...@apache.org>]
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration

Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com>> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com>> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com<ma...@gmail.com>]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org<ma...@phoenix.apache.org>
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>


This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp





________________________________

PRIVILEGED AND CONFIDENTIAL
PLEASE NOTE: The information contained in this message is privileged and confidential, and is intended only for the use of the individual to whom it is addressed and others who have been specifically authorized to receive it. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, or if any problems occur with transmission, please contact sender. Thank you.

RE: Re: HBase Phoenix Integration

Posted by Michael McAllister <mm...@homeaway.com>.
Technically, it depends on which version of HDP you are on. Here are the versions:-

HDP 2.1 = Apache Phoenix 4.0
HDP 2.2 = Apache Phoenix 4.2
HDP 2.3 = Apache Phoenix 4.4
HDP 2.4 = Apache Phoenix 4.4

(From this page -> http://hortonworks.com/hdp/whats-new/)

Michael McAllister
Staff Data Warehouse Engineer | Decision Systems
mmcallister@HomeAway.com<ma...@HomeAway.com> | C: 512.423.7447 | skype: michael.mcallister.ha<ma...@hotmail.com> | webex: https://h.a/mikewebex
[Description: Description: cid:3410354473_30269081]
This electronic communication (including any attachment) is confidential.  If you are not an intended recipient of this communication, please be advised that any disclosure, dissemination, distribution, copying or other use of this communication or any attachment is strictly prohibited.  If you have received this communication in error, please notify the sender immediately by reply e-mail and promptly destroy all electronic and printed copies of this communication and any attachment.

From: Bulvik, Noam [mailto:Noam.Bulvik@teoco.com]
Sent: Tuesday, March 01, 2016 5:10 AM
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration

4.4

From: Dor Ben Dov [mailto:dor.ben-dov@amdocs.com]
Sent: Tuesday, March 1, 2016 12:34 PM
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration

Any one knows here which version of Phoenix being used in HortonWorks bundle ?
Dor

From: Amit Shah [mailto:amits.84@gmail.com]
Sent: יום ג 01 מרץ 2016 12:33
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: Re: Re: HBase Phoenix Integration

Hi Sun,

In my deployment I have only one zookeeper node. I do not have cluster. What was your command line string to connect? Did you specify the port number?
I specify this ./sqlline.py <zookeeper-server-name>:2181

Regards,
Amit.

On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi, Amit
I had successfully built the git repo according to your file change. But when I try to use sqlline to connect to Phoenix,
I ran into the following error:

while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the regionservers being killed abnormally.

Had you met this issue when you use in your scenerio ? If so, please suggest how to resolve this.

Thanks.

 Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Error: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0

________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 18:00
To: user<ma...@phoenix.apache.org>
Subject: Re: Re: HBase Phoenix Integration
Sure Sun.
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ?
Thanks a lot.

Best,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 17:22
To: user<ma...@phoenix.apache.org>
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also
give me no luck.


________________________________
________________________________

From: Dor Ben Dov<ma...@amdocs.com>
Date: 2016-03-01 16:39
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration
Sun
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ?

Dor

From: Fulin Sun [mailto:sunfl@certusnet.com.cn<ma...@certusnet.com.cn>]
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration

Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former.
Hope some guy can explain this and issue an workaround.

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this :
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/

Thanks,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 15:37
To: user<ma...@phoenix.apache.org>; jamestaylor<ma...@apache.org>
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>> wrote:
James,
Do you have any problems working with Phoenix latest with CDH 5.5.X ?

Dor

From: James Taylor [mailto:jamestaylor@apache.org<ma...@apache.org>]
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration

Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com>> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com>> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com<ma...@gmail.com>]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org<ma...@phoenix.apache.org>
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>


This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp





________________________________

PRIVILEGED AND CONFIDENTIAL
PLEASE NOTE: The information contained in this message is privileged and confidential, and is intended only for the use of the individual to whom it is addressed and others who have been specifically authorized to receive it. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, or if any problems occur with transmission, please contact sender. Thank you.

RE: Re: HBase Phoenix Integration

Posted by "Bulvik, Noam" <No...@teoco.com>.
4.4

From: Dor Ben Dov [mailto:dor.ben-dov@amdocs.com]
Sent: Tuesday, March 1, 2016 12:34 PM
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration

Any one knows here which version of Phoenix being used in HortonWorks bundle ?
Dor

From: Amit Shah [mailto:amits.84@gmail.com]
Sent: יום ג 01 מרץ 2016 12:33
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: Re: Re: HBase Phoenix Integration

Hi Sun,

In my deployment I have only one zookeeper node. I do not have cluster. What was your command line string to connect? Did you specify the port number?
I specify this ./sqlline.py <zookeeper-server-name>:2181

Regards,
Amit.

On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi, Amit
I had successfully built the git repo according to your file change. But when I try to use sqlline to connect to Phoenix,
I ran into the following error:

while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the regionservers being killed abnormally.

Had you met this issue when you use in your scenerio ? If so, please suggest how to resolve this.

Thanks.

 Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Error: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0

________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 18:00
To: user<ma...@phoenix.apache.org>
Subject: Re: Re: HBase Phoenix Integration
Sure Sun.
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ?
Thanks a lot.

Best,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 17:22
To: user<ma...@phoenix.apache.org>
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also
give me no luck.


________________________________
________________________________

From: Dor Ben Dov<ma...@amdocs.com>
Date: 2016-03-01 16:39
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration
Sun
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ?

Dor

From: Fulin Sun [mailto:sunfl@certusnet.com.cn<ma...@certusnet.com.cn>]
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration

Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former.
Hope some guy can explain this and issue an workaround.

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this :
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/

Thanks,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 15:37
To: user<ma...@phoenix.apache.org>; jamestaylor<ma...@apache.org>
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>> wrote:
James,
Do you have any problems working with Phoenix latest with CDH 5.5.X ?

Dor

From: James Taylor [mailto:jamestaylor@apache.org<ma...@apache.org>]
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration

Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com>> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com>> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com<ma...@gmail.com>]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org<ma...@phoenix.apache.org>
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>


This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp





________________________________

PRIVILEGED AND CONFIDENTIAL
PLEASE NOTE: The information contained in this message is privileged and confidential, and is intended only for the use of the individual to whom it is addressed and others who have been specifically authorized to receive it. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, or if any problems occur with transmission, please contact sender. Thank you.

RE: Re: HBase Phoenix Integration

Posted by Dor Ben Dov <do...@amdocs.com>.
Any one knows here which version of Phoenix being used in HortonWorks bundle ?
Dor

From: Amit Shah [mailto:amits.84@gmail.com]
Sent: יום ג 01 מרץ 2016 12:33
To: user@phoenix.apache.org
Subject: Re: Re: HBase Phoenix Integration

Hi Sun,

In my deployment I have only one zookeeper node. I do not have cluster. What was your command line string to connect? Did you specify the port number?
I specify this ./sqlline.py <zookeeper-server-name>:2181

Regards,
Amit.

On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi, Amit
I had successfully built the git repo according to your file change. But when I try to use sqlline to connect to Phoenix,
I ran into the following error:

while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the regionservers being killed abnormally.

Had you met this issue when you use in your scenerio ? If so, please suggest how to resolve this.

Thanks.

 Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Error: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0

________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 18:00
To: user<ma...@phoenix.apache.org>
Subject: Re: Re: HBase Phoenix Integration
Sure Sun.
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ?
Thanks a lot.

Best,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 17:22
To: user<ma...@phoenix.apache.org>
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn>> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also
give me no luck.


________________________________
________________________________

From: Dor Ben Dov<ma...@amdocs.com>
Date: 2016-03-01 16:39
To: user@phoenix.apache.org<ma...@phoenix.apache.org>
Subject: RE: Re: HBase Phoenix Integration
Sun
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ?

Dor

From: Fulin Sun [mailto:sunfl@certusnet.com.cn<ma...@certusnet.com.cn>]
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration

Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former.
Hope some guy can explain this and issue an workaround.

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this :
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/

Thanks,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 15:37
To: user<ma...@phoenix.apache.org>; jamestaylor<ma...@apache.org>
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>> wrote:
James,
Do you have any problems working with Phoenix latest with CDH 5.5.X ?

Dor

From: James Taylor [mailto:jamestaylor@apache.org<ma...@apache.org>]
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration

Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com>> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com>> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com<ma...@gmail.com>]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org<ma...@phoenix.apache.org>
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>


This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp





Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi Amit
That sounds reasonable. I tried that just now but still get unexpected exits of regionserver.
Maybe my CDH environment has some issue that could influence this. I would check a little more 
and get some feedback. 
Thanks. 






From: Amit Shah
Date: 2016-03-01 19:09
To: user
Subject: Re: Re: HBase Phoenix Integration
Hi Sun,

Yes, that sounds weird. I'm not sure if it would help but I am using CDH 5.5.2. I do copy phoenix-server, client and the core jar on all the hbase region and master servers. After the jar copy, restart hbase master, region-server and zookeeper. 

Regards,
Amit.

On Tue, Mar 1, 2016 at 4:05 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
Hi, Amit
The command line is ./sqlline.py <zkServer>:2181 . I had no idea why all regionservers would be killed 
when I issue the command initially. Is this because createing SYSTEM tables would cause regionserver down?
But I did not find any error message from the regionserver log. That is supre weird. 






From: Amit Shah
Date: 2016-03-01 19:02
To: user
Subject: Re: Re: HBase Phoenix Integration
Hi Sun,

In my deployment I have only one zookeeper node. I do not have cluster. What was your command line string to connect? Did you specify the port number?
I specify this ./sqlline.py <zookeeper-server-name>:2181

Regards,
Amit.

On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
Hi, Amit
I had successfully built the git repo according to your file change. But when I try to use sqlline to connect to Phoenix,
I ran into the following error: 

while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the regionservers being killed abnormally. 

Had you met this issue when you use in your scenerio ? If so, please suggest how to resolve this. 

Thanks.

 Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Error: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0




From: Amit Shah
Date: 2016-03-01 18:00
To: user
Subject: Re: Re: HBase Phoenix Integration
Sure Sun. 
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ? 
Thanks a lot. 

Best,
Sun.






From: Amit Shah
Date: 2016-03-01 17:22
To: user
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also 
give me no luck. 







From: Dor Ben Dov
Date: 2016-03-01 16:39
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration
Sun 
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ? 
 
Dor
 
From: Fulin Sun [mailto:sunfl@certusnet.com.cn] 
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration
 
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 
 
If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 


Thanks,
Sun.
 




 
From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
 
Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 
 





Re: Re: HBase Phoenix Integration

Posted by Amit Shah <am...@gmail.com>.
Hi Sun,

Yes, that sounds weird. I'm not sure if it would help but I am using CDH
5.5.2. I do copy phoenix-server, client and the core jar on all the hbase
region and master servers. After the jar copy, restart hbase master,
region-server and zookeeper.

Regards,
Amit.

On Tue, Mar 1, 2016 at 4:05 PM, Fulin Sun <su...@certusnet.com.cn> wrote:

> Hi, Amit
> The command line is ./sqlline.py <zkServer>:2181 . I had no idea why all
> regionservers would be killed
> when I issue the command initially. Is this because createing SYSTEM
> tables would cause regionserver down?
> But I did not find any error message from the regionserver log. That is
> supre weird.
>
> ------------------------------
> ------------------------------
>
>
> *From:* Amit Shah <am...@gmail.com>
> *Date:* 2016-03-01 19:02
> *To:* user <us...@phoenix.apache.org>
> *Subject:* Re: Re: HBase Phoenix Integration
> Hi Sun,
>
> In my deployment I have only one zookeeper node. I do not have cluster.
> What was your command line string to connect? Did you specify the port
> number?
> I specify this ./sqlline.py <zookeeper-server-name>:2181
>
> Regards,
> Amit.
>
> On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
>
>> Hi, Amit
>> I had successfully built the git repo according to your file change. But
>> when I try to use sqlline to connect to Phoenix,
>> I ran into the following error:
>>
>> while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the
>> regionservers being killed abnormally.
>>
>> Had you met this issue when you use in your scenerio ? If so, please
>> suggest how to resolve this.
>>
>> Thanks.
>>
>>  Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
>>
>> 16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
>> Error: Failed after attempts=36, exceptions:
>>
>> Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
>>
>> org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
>>
>> Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0
>>
>> ------------------------------
>>
>> *From:* Amit Shah <am...@gmail.com>
>> *Date:* 2016-03-01 18:00
>> *To:* user <us...@phoenix.apache.org>
>> *Subject:* Re: Re: HBase Phoenix Integration
>> Sure Sun.
>> PFA.
>>
>> Regards,
>> Amit.
>>
>> On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
>>
>>> Hi Amit,
>>> Glad you found a temporory  fix for that. Can you share the relative
>>> java file you modified ?
>>> Thanks a lot.
>>>
>>> Best,
>>> Sun.
>>>
>>> ------------------------------
>>> ------------------------------
>>>
>>>
>>> *From:* Amit Shah <am...@gmail.com>
>>> *Date:* 2016-03-01 17:22
>>> *To:* user <us...@phoenix.apache.org>
>>> *Subject:* Re: RE: HBase Phoenix Integration
>>> Hi All,
>>>
>>> I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I
>>> resolved the compilation errors by commenting out the usage of
>>> BinaryCompatibleIndexKeyValueDecoder and
>>> BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only
>>> get used in secondary indexing. This is a temporary fix but yes it works !
>>>
>>> Hope that helps.
>>> Waiting to see the phoenix-cloudera fix for the latest phoenix version
>>> 4.7 especially since 4.7 has some new features.
>>>
>>> Thanks,
>>> Amit.
>>>
>>> On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn>
>>> wrote:
>>>
>>>> No idea. I had only searched for this relatively latest post for
>>>> supporting phoenix with CDH 5.5.x
>>>> However, I cannot connect to phoenix according to the post guide.
>>>> Compiling the git repo had also
>>>> give me no luck.
>>>>
>>>>
>>>> ------------------------------
>>>> ------------------------------
>>>>
>>>>
>>>> *From:* Dor Ben Dov <do...@amdocs.com>
>>>> *Date:* 2016-03-01 16:39
>>>> *To:* user@phoenix.apache.org
>>>> *Subject:* RE: Re: HBase Phoenix Integration
>>>>
>>>> Sun
>>>>
>>>> This is an old post there, do you know or are there any news about
>>>> Cloudera Adopting the new Apache Phoenix 4.7 ?
>>>>
>>>>
>>>>
>>>> Dor
>>>>
>>>>
>>>>
>>>> *From:* Fulin Sun [mailto:sunfl@certusnet.com.cn]
>>>> *Sent:* יום ג 01 מרץ 2016 09:14
>>>> *To:* user; James Taylor
>>>> *Subject:* Re: Re: HBase Phoenix Integration
>>>>
>>>>
>>>>
>>>> Hi Amit
>>>>
>>>> Yeah. Meet the same error message when doing mvn package. I compared
>>>> between the apache phoenix 4.6.0-hbase-1.0
>>>>
>>>> code with this repo code for CDH 5.5.1 , I did not find the abstract
>>>> class BinaryCompatiblePhoenixBaseDecoder in the former.
>>>>
>>>> Hope some guy can explain this and issue an workaround.
>>>>
>>>>
>>>>
>>>> If no way to resolve this, I would still be using the Cloudera-Labs
>>>> phoenix version from this :
>>>>
>>>>
>>>> https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/
>>>>
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> Sun.
>>>>
>>>>
>>>> ------------------------------
>>>> ------------------------------
>>>>
>>>>
>>>>
>>>> *From:* Amit Shah <am...@gmail.com>
>>>>
>>>> *Date:* 2016-03-01 15:37
>>>>
>>>> *To:* user <us...@phoenix.apache.org>; jamestaylor
>>>> <ja...@apache.org>
>>>>
>>>> *Subject:* Re: HBase Phoenix Integration
>>>>
>>>> Hi James,
>>>>
>>>> I get a compilation error along with multiple warnings when
>>>> packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
>>>>
>>>>
>>>>
>>>> Also I realized that the pom.xml indicates the branch is for cloudera
>>>> CDH version 5.5.1. Do you know if it would work for the latest CDH version
>>>> 5.5.2?
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> Amit.
>>>>
>>>>
>>>>
>>>> On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>
>>>> wrote:
>>>>
>>>> James,
>>>>
>>>> Do you have any problems working with Phoenix latest with CDH 5.5.X ?
>>>>
>>>>
>>>>
>>>> Dor
>>>>
>>>>
>>>>
>>>> *From:* James Taylor [mailto:jamestaylor@apache.org]
>>>> *Sent:* יום ג 01 מרץ 2016 08:24
>>>> *To:* user
>>>> *Cc:* Murugesan, Rani
>>>> *Subject:* Re: HBase Phoenix Integration
>>>>
>>>>
>>>>
>>>> Hi Amit,
>>>>
>>>>
>>>>
>>>> For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of
>>>> Andrew Purtell:
>>>> https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> James
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
>>>>
>>>> Hi Sergey,
>>>>
>>>>
>>>>
>>>> I get lot of compilation errors when I compile the source code
>>>> for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
>>>> compilation succeeds when the changes to include cloudera dependent
>>>> versions are not included. The only difference between the code changes
>>>> suggested on the stackoverflow post and mine is the cloudera cdh version. I
>>>> am using cdh 5.5.2. I didn't quite follow the reason behind the code
>>>> changes needed in phoenix when deployed on CDH.
>>>>
>>>>
>>>>
>>>> Thanks,
>>>>
>>>> Amit.
>>>>
>>>>
>>>>
>>>> On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <
>>>> sergeysoldatov@gmail.com> wrote:
>>>>
>>>> Hi Amit,
>>>>
>>>> Switching to 4.3 means you need HBase 0.98. What kind of problem you
>>>> experienced after building 4.6 from sources with changes suggested on
>>>> StackOverflow?
>>>>
>>>> Thanks,
>>>> Sergey
>>>>
>>>>
>>>> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
>>>> > An update -
>>>> >
>>>> > I was able to execute "./sqlline.py <zookeeper-server-name>" command
>>>> but I
>>>> > get the same exception as I mentioned earlier.
>>>> >
>>>> > Later I tried following the steps mentioned on this link with phoenix
>>>> 4.3.0
>>>> > but I still get an error this time with a different stack trace
>>>> (attached to
>>>> > this mail)
>>>> >
>>>> > Any help would be appreciated
>>>> >
>>>> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>
>>>> wrote:
>>>> >>
>>>> >> Hi Murugesan,
>>>> >>
>>>> >> What preconditions would I need on the server to execute the python
>>>> >> script? I have Python 2.7.5 installed on the zookeeper server. If I
>>>> just
>>>> >> copy the sqlline script to the /etc/hbase/conf directory and execute
>>>> it I
>>>> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
>>>> version
>>>> >> server and core phoenix jars in HBase/lib directory on the master
>>>> and region
>>>> >> servers.
>>>> >>
>>>> >> Traceback (most recent call last):
>>>> >>   File "./sqlline.py", line 25, in <module>
>>>> >>     import phoenix_utils
>>>> >> ImportError: No module named phoenix_utils
>>>> >>
>>>> >> Pardon me for my knowledge about python.
>>>> >>
>>>> >> Thanks,
>>>> >> Amit
>>>> >>
>>>> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ranmurug@visa.com
>>>> >
>>>> >> wrote:
>>>> >>>
>>>> >>> Did you test and confirm your phoenix shell from the zookeeper
>>>> server?
>>>> >>>
>>>> >>> cd /etc/hbase/conf
>>>> >>>
>>>> >>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> From: Amit Shah [mailto:amits.84@gmail.com]
>>>> >>> Sent: Friday, February 26, 2016 4:45 AM
>>>> >>> To: user@phoenix.apache.org
>>>> >>> Subject: HBase Phoenix Integration
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> Hello,
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> I have been trying to install phoenix on my cloudera hbase cluster.
>>>> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the
>>>> master and
>>>> >>> region servers and restarted the hbase cluster. I copied the
>>>> corresponding
>>>> >>> client jar on my SQuirrel client but I get an exception on connect.
>>>> Pasted
>>>> >>> below. The connection url is
>>>> “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>> >>>
>>>> >>> I even tried compiling the source by adding cloudera dependencies as
>>>> >>> suggested on this post but didn't succeed.
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> Any suggestions to make this work?
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> Thanks,
>>>> >>>
>>>> >>> Amit.
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> ________________________________________________________________
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> Caused by:
>>>> >>>
>>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>>> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>>> >>>
>>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>> >>>
>>>> >>>             at
>>>> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>> >>>
>>>> >>>             at
>>>> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>> >>>
>>>> >>>             at
>>>> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>> >>>
>>>> >>>             at java.lang.Thread.run(Thread.java:745)
>>>> >>>
>>>> >>> Caused by: java.lang.NoSuchMethodError:
>>>> >>>
>>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>> >>>
>>>> >>>             at
>>>> >>>
>>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>> >>>
>>>> >>>             ... 10 more
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> P.S - The full stacktrace is attached in the mail.
>>>> >>
>>>> >>
>>>> >
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> This message and the information contained herein is proprietary and
>>>> confidential and subject to the Amdocs policy statement, you may review at
>>>> http://www.amdocs.com/email_disclaimer.asp
>>>>
>>>>
>>>>
>>>>
>>>
>>
>

Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi, Amit
The command line is ./sqlline.py <zkServer>:2181 . I had no idea why all regionservers would be killed 
when I issue the command initially. Is this because createing SYSTEM tables would cause regionserver down?
But I did not find any error message from the regionserver log. That is supre weird. 






From: Amit Shah
Date: 2016-03-01 19:02
To: user
Subject: Re: Re: HBase Phoenix Integration
Hi Sun,

In my deployment I have only one zookeeper node. I do not have cluster. What was your command line string to connect? Did you specify the port number?
I specify this ./sqlline.py <zookeeper-server-name>:2181

Regards,
Amit.

On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
Hi, Amit
I had successfully built the git repo according to your file change. But when I try to use sqlline to connect to Phoenix,
I ran into the following error: 

while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the regionservers being killed abnormally. 

Had you met this issue when you use in your scenerio ? If so, please suggest how to resolve this. 

Thanks.

 Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Error: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0




From: Amit Shah
Date: 2016-03-01 18:00
To: user
Subject: Re: Re: HBase Phoenix Integration
Sure Sun. 
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ? 
Thanks a lot. 

Best,
Sun.






From: Amit Shah
Date: 2016-03-01 17:22
To: user
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also 
give me no luck. 







From: Dor Ben Dov
Date: 2016-03-01 16:39
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration
Sun 
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ? 
 
Dor
 
From: Fulin Sun [mailto:sunfl@certusnet.com.cn] 
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration
 
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 
 
If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 


Thanks,
Sun.
 




 
From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
 
Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 
 




Re: Re: HBase Phoenix Integration

Posted by Amit Shah <am...@gmail.com>.
Hi Sun,

In my deployment I have only one zookeeper node. I do not have cluster.
What was your command line string to connect? Did you specify the port
number?
I specify this ./sqlline.py <zookeeper-server-name>:2181

Regards,
Amit.

On Tue, Mar 1, 2016 at 3:38 PM, Fulin Sun <su...@certusnet.com.cn> wrote:

> Hi, Amit
> I had successfully built the git repo according to your file change. But
> when I try to use sqlline to connect to Phoenix,
> I ran into the following error:
>
> while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the
> regionservers being killed abnormally.
>
> Had you met this issue when you use in your scenerio ? If so, please
> suggest how to resolve this.
>
> Thanks.
>
>  Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
>
> 16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> Error: Failed after attempts=36, exceptions:
>
> Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
>
> org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
>
> Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0
>
> ------------------------------
>
> *From:* Amit Shah <am...@gmail.com>
> *Date:* 2016-03-01 18:00
> *To:* user <us...@phoenix.apache.org>
> *Subject:* Re: Re: HBase Phoenix Integration
> Sure Sun.
> PFA.
>
> Regards,
> Amit.
>
> On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
>
>> Hi Amit,
>> Glad you found a temporory  fix for that. Can you share the relative java
>> file you modified ?
>> Thanks a lot.
>>
>> Best,
>> Sun.
>>
>> ------------------------------
>> ------------------------------
>>
>>
>> *From:* Amit Shah <am...@gmail.com>
>> *Date:* 2016-03-01 17:22
>> *To:* user <us...@phoenix.apache.org>
>> *Subject:* Re: RE: HBase Phoenix Integration
>> Hi All,
>>
>> I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I
>> resolved the compilation errors by commenting out the usage of
>> BinaryCompatibleIndexKeyValueDecoder and
>> BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only
>> get used in secondary indexing. This is a temporary fix but yes it works !
>>
>> Hope that helps.
>> Waiting to see the phoenix-cloudera fix for the latest phoenix version
>> 4.7 especially since 4.7 has some new features.
>>
>> Thanks,
>> Amit.
>>
>> On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
>>
>>> No idea. I had only searched for this relatively latest post for
>>> supporting phoenix with CDH 5.5.x
>>> However, I cannot connect to phoenix according to the post guide.
>>> Compiling the git repo had also
>>> give me no luck.
>>>
>>>
>>> ------------------------------
>>> ------------------------------
>>>
>>>
>>> *From:* Dor Ben Dov <do...@amdocs.com>
>>> *Date:* 2016-03-01 16:39
>>> *To:* user@phoenix.apache.org
>>> *Subject:* RE: Re: HBase Phoenix Integration
>>>
>>> Sun
>>>
>>> This is an old post there, do you know or are there any news about
>>> Cloudera Adopting the new Apache Phoenix 4.7 ?
>>>
>>>
>>>
>>> Dor
>>>
>>>
>>>
>>> *From:* Fulin Sun [mailto:sunfl@certusnet.com.cn]
>>> *Sent:* יום ג 01 מרץ 2016 09:14
>>> *To:* user; James Taylor
>>> *Subject:* Re: Re: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hi Amit
>>>
>>> Yeah. Meet the same error message when doing mvn package. I compared
>>> between the apache phoenix 4.6.0-hbase-1.0
>>>
>>> code with this repo code for CDH 5.5.1 , I did not find the abstract
>>> class BinaryCompatiblePhoenixBaseDecoder in the former.
>>>
>>> Hope some guy can explain this and issue an workaround.
>>>
>>>
>>>
>>> If no way to resolve this, I would still be using the Cloudera-Labs
>>> phoenix version from this :
>>>
>>>
>>> https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/
>>>
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Sun.
>>>
>>>
>>> ------------------------------
>>> ------------------------------
>>>
>>>
>>>
>>> *From:* Amit Shah <am...@gmail.com>
>>>
>>> *Date:* 2016-03-01 15:37
>>>
>>> *To:* user <us...@phoenix.apache.org>; jamestaylor
>>> <ja...@apache.org>
>>>
>>> *Subject:* Re: HBase Phoenix Integration
>>>
>>> Hi James,
>>>
>>> I get a compilation error along with multiple warnings when
>>> packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
>>>
>>>
>>>
>>> Also I realized that the pom.xml indicates the branch is for cloudera
>>> CDH version 5.5.1. Do you know if it would work for the latest CDH version
>>> 5.5.2?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>
>>> wrote:
>>>
>>> James,
>>>
>>> Do you have any problems working with Phoenix latest with CDH 5.5.X ?
>>>
>>>
>>>
>>> Dor
>>>
>>>
>>>
>>> *From:* James Taylor [mailto:jamestaylor@apache.org]
>>> *Sent:* יום ג 01 מרץ 2016 08:24
>>> *To:* user
>>> *Cc:* Murugesan, Rani
>>> *Subject:* Re: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hi Amit,
>>>
>>>
>>>
>>> For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of
>>> Andrew Purtell:
>>> https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
>>>
>>>
>>>
>>> Thanks,
>>>
>>> James
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
>>>
>>> Hi Sergey,
>>>
>>>
>>>
>>> I get lot of compilation errors when I compile the source code
>>> for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
>>> compilation succeeds when the changes to include cloudera dependent
>>> versions are not included. The only difference between the code changes
>>> suggested on the stackoverflow post and mine is the cloudera cdh version. I
>>> am using cdh 5.5.2. I didn't quite follow the reason behind the code
>>> changes needed in phoenix when deployed on CDH.
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <
>>> sergeysoldatov@gmail.com> wrote:
>>>
>>> Hi Amit,
>>>
>>> Switching to 4.3 means you need HBase 0.98. What kind of problem you
>>> experienced after building 4.6 from sources with changes suggested on
>>> StackOverflow?
>>>
>>> Thanks,
>>> Sergey
>>>
>>>
>>> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
>>> > An update -
>>> >
>>> > I was able to execute "./sqlline.py <zookeeper-server-name>" command
>>> but I
>>> > get the same exception as I mentioned earlier.
>>> >
>>> > Later I tried following the steps mentioned on this link with phoenix
>>> 4.3.0
>>> > but I still get an error this time with a different stack trace
>>> (attached to
>>> > this mail)
>>> >
>>> > Any help would be appreciated
>>> >
>>> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>> >>
>>> >> Hi Murugesan,
>>> >>
>>> >> What preconditions would I need on the server to execute the python
>>> >> script? I have Python 2.7.5 installed on the zookeeper server. If I
>>> just
>>> >> copy the sqlline script to the /etc/hbase/conf directory and execute
>>> it I
>>> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
>>> version
>>> >> server and core phoenix jars in HBase/lib directory on the master and
>>> region
>>> >> servers.
>>> >>
>>> >> Traceback (most recent call last):
>>> >>   File "./sqlline.py", line 25, in <module>
>>> >>     import phoenix_utils
>>> >> ImportError: No module named phoenix_utils
>>> >>
>>> >> Pardon me for my knowledge about python.
>>> >>
>>> >> Thanks,
>>> >> Amit
>>> >>
>>> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>>> >> wrote:
>>> >>>
>>> >>> Did you test and confirm your phoenix shell from the zookeeper
>>> server?
>>> >>>
>>> >>> cd /etc/hbase/conf
>>> >>>
>>> >>> > phoenix-sqlline.py <zookeeperserver>:2181
>>> >>>
>>> >>>
>>> >>>
>>> >>>
>>> >>>
>>> >>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> >>> Sent: Friday, February 26, 2016 4:45 AM
>>> >>> To: user@phoenix.apache.org
>>> >>> Subject: HBase Phoenix Integration
>>> >>>
>>> >>>
>>> >>>
>>> >>> Hello,
>>> >>>
>>> >>>
>>> >>>
>>> >>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>> >>>
>>> >>>
>>> >>>
>>> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the master
>>> and
>>> >>> region servers and restarted the hbase cluster. I copied the
>>> corresponding
>>> >>> client jar on my SQuirrel client but I get an exception on connect.
>>> Pasted
>>> >>> below. The connection url is
>>> “jdbc:phoenix:<zookeeper-server-name>:2181".
>>> >>>
>>> >>> I even tried compiling the source by adding cloudera dependencies as
>>> >>> suggested on this post but didn't succeed.
>>> >>>
>>> >>>
>>> >>>
>>> >>> Any suggestions to make this work?
>>> >>>
>>> >>>
>>> >>>
>>> >>> Thanks,
>>> >>>
>>> >>> Amit.
>>> >>>
>>> >>>
>>> >>>
>>> >>> ________________________________________________________________
>>> >>>
>>> >>>
>>> >>>
>>> >>> Caused by:
>>> >>>
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> >>>
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>> >>>
>>> >>>             at
>>> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>> >>>
>>> >>>             at
>>> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>> >>>
>>> >>>             at
>>> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>> >>>
>>> >>>             at java.lang.Thread.run(Thread.java:745)
>>> >>>
>>> >>> Caused by: java.lang.NoSuchMethodError:
>>> >>>
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>> >>>
>>> >>>             at
>>> >>>
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>> >>>
>>> >>>             ... 10 more
>>> >>>
>>> >>>
>>> >>>
>>> >>> P.S - The full stacktrace is attached in the mail.
>>> >>
>>> >>
>>> >
>>>
>>>
>>>
>>>
>>>
>>> This message and the information contained herein is proprietary and
>>> confidential and subject to the Amdocs policy statement, you may review at
>>> http://www.amdocs.com/email_disclaimer.asp
>>>
>>>
>>>
>>>
>>
>

Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi, Amit
I had successfully built the git repo according to your file change. But when I try to use sqlline to connect to Phoenix,
I ran into the following error: 

while dev-1,dev-2,dev-3 are my zookeeper hosts. I can still see the regionservers being killed abnormally. 

Had you met this issue when you use in your scenerio ? If so, please suggest how to resolve this. 

Thanks.

 Connecting to jdbc:phoenix:dev-1,dev-2,dev-3
16/03/01 18:04:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Error: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0 (state=08000,code=101)
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36, exceptions:
Tue Mar 01 18:05:30 CST 2016, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69350: row 'SYSTEM.SEQUENCE,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=dev-2,60020,1456826584858, seqNum=0




From: Amit Shah
Date: 2016-03-01 18:00
To: user
Subject: Re: Re: HBase Phoenix Integration
Sure Sun. 
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ? 
Thanks a lot. 

Best,
Sun.






From: Amit Shah
Date: 2016-03-01 17:22
To: user
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also 
give me no luck. 







From: Dor Ben Dov
Date: 2016-03-01 16:39
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration
Sun 
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ? 
 
Dor
 
From: Fulin Sun [mailto:sunfl@certusnet.com.cn] 
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration
 
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 
 
If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 


Thanks,
Sun.
 




 
From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
 
Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 
 



Re: Re: HBase Phoenix Integration

Posted by Amit Shah <am...@gmail.com>.
Sure Sun.
PFA.

Regards,
Amit.

On Tue, Mar 1, 2016 at 2:58 PM, Fulin Sun <su...@certusnet.com.cn> wrote:

> Hi Amit,
> Glad you found a temporory  fix for that. Can you share the relative java
> file you modified ?
> Thanks a lot.
>
> Best,
> Sun.
>
> ------------------------------
> ------------------------------
>
>
> *From:* Amit Shah <am...@gmail.com>
> *Date:* 2016-03-01 17:22
> *To:* user <us...@phoenix.apache.org>
> *Subject:* Re: RE: HBase Phoenix Integration
> Hi All,
>
> I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I
> resolved the compilation errors by commenting out the usage of
> BinaryCompatibleIndexKeyValueDecoder and
> BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only
> get used in secondary indexing. This is a temporary fix but yes it works !
>
> Hope that helps.
> Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7
> especially since 4.7 has some new features.
>
> Thanks,
> Amit.
>
> On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
>
>> No idea. I had only searched for this relatively latest post for
>> supporting phoenix with CDH 5.5.x
>> However, I cannot connect to phoenix according to the post guide.
>> Compiling the git repo had also
>> give me no luck.
>>
>>
>> ------------------------------
>> ------------------------------
>>
>>
>> *From:* Dor Ben Dov <do...@amdocs.com>
>> *Date:* 2016-03-01 16:39
>> *To:* user@phoenix.apache.org
>> *Subject:* RE: Re: HBase Phoenix Integration
>>
>> Sun
>>
>> This is an old post there, do you know or are there any news about
>> Cloudera Adopting the new Apache Phoenix 4.7 ?
>>
>>
>>
>> Dor
>>
>>
>>
>> *From:* Fulin Sun [mailto:sunfl@certusnet.com.cn]
>> *Sent:* יום ג 01 מרץ 2016 09:14
>> *To:* user; James Taylor
>> *Subject:* Re: Re: HBase Phoenix Integration
>>
>>
>>
>> Hi Amit
>>
>> Yeah. Meet the same error message when doing mvn package. I compared
>> between the apache phoenix 4.6.0-hbase-1.0
>>
>> code with this repo code for CDH 5.5.1 , I did not find the abstract
>> class BinaryCompatiblePhoenixBaseDecoder in the former.
>>
>> Hope some guy can explain this and issue an workaround.
>>
>>
>>
>> If no way to resolve this, I would still be using the Cloudera-Labs
>> phoenix version from this :
>>
>>
>> https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/
>>
>>
>>
>>
>> Thanks,
>>
>> Sun.
>>
>>
>> ------------------------------
>> ------------------------------
>>
>>
>>
>> *From:* Amit Shah <am...@gmail.com>
>>
>> *Date:* 2016-03-01 15:37
>>
>> *To:* user <us...@phoenix.apache.org>; jamestaylor
>> <ja...@apache.org>
>>
>> *Subject:* Re: HBase Phoenix Integration
>>
>> Hi James,
>>
>> I get a compilation error along with multiple warnings when
>> packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
>>
>>
>>
>> Also I realized that the pom.xml indicates the branch is for cloudera CDH
>> version 5.5.1. Do you know if it would work for the latest CDH version
>> 5.5.2?
>>
>>
>>
>> Thanks,
>>
>> Amit.
>>
>>
>>
>> On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>
>> wrote:
>>
>> James,
>>
>> Do you have any problems working with Phoenix latest with CDH 5.5.X ?
>>
>>
>>
>> Dor
>>
>>
>>
>> *From:* James Taylor [mailto:jamestaylor@apache.org]
>> *Sent:* יום ג 01 מרץ 2016 08:24
>> *To:* user
>> *Cc:* Murugesan, Rani
>> *Subject:* Re: HBase Phoenix Integration
>>
>>
>>
>> Hi Amit,
>>
>>
>>
>> For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of
>> Andrew Purtell:
>> https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
>>
>>
>>
>> Thanks,
>>
>> James
>>
>>
>>
>>
>>
>>
>>
>> On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Sergey,
>>
>>
>>
>> I get lot of compilation errors when I compile the source code
>> for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
>> compilation succeeds when the changes to include cloudera dependent
>> versions are not included. The only difference between the code changes
>> suggested on the stackoverflow post and mine is the cloudera cdh version. I
>> am using cdh 5.5.2. I didn't quite follow the reason behind the code
>> changes needed in phoenix when deployed on CDH.
>>
>>
>>
>> Thanks,
>>
>> Amit.
>>
>>
>>
>> On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>
>> wrote:
>>
>> Hi Amit,
>>
>> Switching to 4.3 means you need HBase 0.98. What kind of problem you
>> experienced after building 4.6 from sources with changes suggested on
>> StackOverflow?
>>
>> Thanks,
>> Sergey
>>
>>
>> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
>> > An update -
>> >
>> > I was able to execute "./sqlline.py <zookeeper-server-name>" command
>> but I
>> > get the same exception as I mentioned earlier.
>> >
>> > Later I tried following the steps mentioned on this link with phoenix
>> 4.3.0
>> > but I still get an error this time with a different stack trace
>> (attached to
>> > this mail)
>> >
>> > Any help would be appreciated
>> >
>> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>> >>
>> >> Hi Murugesan,
>> >>
>> >> What preconditions would I need on the server to execute the python
>> >> script? I have Python 2.7.5 installed on the zookeeper server. If I
>> just
>> >> copy the sqlline script to the /etc/hbase/conf directory and execute
>> it I
>> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
>> version
>> >> server and core phoenix jars in HBase/lib directory on the master and
>> region
>> >> servers.
>> >>
>> >> Traceback (most recent call last):
>> >>   File "./sqlline.py", line 25, in <module>
>> >>     import phoenix_utils
>> >> ImportError: No module named phoenix_utils
>> >>
>> >> Pardon me for my knowledge about python.
>> >>
>> >> Thanks,
>> >> Amit
>> >>
>> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> >> wrote:
>> >>>
>> >>> Did you test and confirm your phoenix shell from the zookeeper server?
>> >>>
>> >>> cd /etc/hbase/conf
>> >>>
>> >>> > phoenix-sqlline.py <zookeeperserver>:2181
>> >>>
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> From: Amit Shah [mailto:amits.84@gmail.com]
>> >>> Sent: Friday, February 26, 2016 4:45 AM
>> >>> To: user@phoenix.apache.org
>> >>> Subject: HBase Phoenix Integration
>> >>>
>> >>>
>> >>>
>> >>> Hello,
>> >>>
>> >>>
>> >>>
>> >>> I have been trying to install phoenix on my cloudera hbase cluster.
>> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>> >>>
>> >>>
>> >>>
>> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the master
>> and
>> >>> region servers and restarted the hbase cluster. I copied the
>> corresponding
>> >>> client jar on my SQuirrel client but I get an exception on connect.
>> Pasted
>> >>> below. The connection url is
>> “jdbc:phoenix:<zookeeper-server-name>:2181".
>> >>>
>> >>> I even tried compiling the source by adding cloudera dependencies as
>> >>> suggested on this post but didn't succeed.
>> >>>
>> >>>
>> >>>
>> >>> Any suggestions to make this work?
>> >>>
>> >>>
>> >>>
>> >>> Thanks,
>> >>>
>> >>> Amit.
>> >>>
>> >>>
>> >>>
>> >>> ________________________________________________________________
>> >>>
>> >>>
>> >>>
>> >>> Caused by:
>> >>>
>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>> >>>
>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>> >>>
>> >>>             at java.lang.Thread.run(Thread.java:745)
>> >>>
>> >>> Caused by: java.lang.NoSuchMethodError:
>> >>>
>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>> >>>
>> >>>             ... 10 more
>> >>>
>> >>>
>> >>>
>> >>> P.S - The full stacktrace is attached in the mail.
>> >>
>> >>
>> >
>>
>>
>>
>>
>>
>> This message and the information contained herein is proprietary and
>> confidential and subject to the Amdocs policy statement, you may review at
>> http://www.amdocs.com/email_disclaimer.asp
>>
>>
>>
>>
>

Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi Amit,
Glad you found a temporory  fix for that. Can you share the relative java file you modified ? 
Thanks a lot. 

Best,
Sun.






From: Amit Shah
Date: 2016-03-01 17:22
To: user
Subject: Re: RE: HBase Phoenix Integration
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I resolved the compilation errors by commenting out the usage of BinaryCompatibleIndexKeyValueDecoder and BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7 especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also 
give me no luck. 







From: Dor Ben Dov
Date: 2016-03-01 16:39
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration
Sun 
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ? 
 
Dor
 
From: Fulin Sun [mailto:sunfl@certusnet.com.cn] 
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration
 
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 
 
If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 


Thanks,
Sun.
 




 
From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
 
Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 
 


Re: RE: HBase Phoenix Integration

Posted by Amit Shah <am...@gmail.com>.
Hi All,

I got some success in deploying phoenix 4.6-HBase-1.0 on CDH 5.5.2. I
resolved the compilation errors by commenting out the usage of
BinaryCompatibleIndexKeyValueDecoder and
BinaryCompatibleCompressedIndexKeyValueDecoder classes since they only get
used in secondary indexing. This is a temporary fix but yes it works !

Hope that helps.
Waiting to see the phoenix-cloudera fix for the latest phoenix version 4.7
especially since 4.7 has some new features.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 2:13 PM, Fulin Sun <su...@certusnet.com.cn> wrote:

> No idea. I had only searched for this relatively latest post for
> supporting phoenix with CDH 5.5.x
> However, I cannot connect to phoenix according to the post guide.
> Compiling the git repo had also
> give me no luck.
>
>
> ------------------------------
> ------------------------------
>
>
> *From:* Dor Ben Dov <do...@amdocs.com>
> *Date:* 2016-03-01 16:39
> *To:* user@phoenix.apache.org
> *Subject:* RE: Re: HBase Phoenix Integration
>
> Sun
>
> This is an old post there, do you know or are there any news about
> Cloudera Adopting the new Apache Phoenix 4.7 ?
>
>
>
> Dor
>
>
>
> *From:* Fulin Sun [mailto:sunfl@certusnet.com.cn]
> *Sent:* יום ג 01 מרץ 2016 09:14
> *To:* user; James Taylor
> *Subject:* Re: Re: HBase Phoenix Integration
>
>
>
> Hi Amit
>
> Yeah. Meet the same error message when doing mvn package. I compared
> between the apache phoenix 4.6.0-hbase-1.0
>
> code with this repo code for CDH 5.5.1 , I did not find the abstract class
> BinaryCompatiblePhoenixBaseDecoder in the former.
>
> Hope some guy can explain this and issue an workaround.
>
>
>
> If no way to resolve this, I would still be using the Cloudera-Labs
> phoenix version from this :
>
>
> https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/
>
>
>
>
> Thanks,
>
> Sun.
>
>
> ------------------------------
> ------------------------------
>
>
>
> *From:* Amit Shah <am...@gmail.com>
>
> *Date:* 2016-03-01 15:37
>
> *To:* user <us...@phoenix.apache.org>; jamestaylor <ja...@apache.org>
>
> *Subject:* Re: HBase Phoenix Integration
>
> Hi James,
>
> I get a compilation error along with multiple warnings when
> packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
>
>
>
> Also I realized that the pom.xml indicates the branch is for cloudera CDH
> version 5.5.1. Do you know if it would work for the latest CDH version
> 5.5.2?
>
>
>
> Thanks,
>
> Amit.
>
>
>
> On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>
> wrote:
>
> James,
>
> Do you have any problems working with Phoenix latest with CDH 5.5.X ?
>
>
>
> Dor
>
>
>
> *From:* James Taylor [mailto:jamestaylor@apache.org]
> *Sent:* יום ג 01 מרץ 2016 08:24
> *To:* user
> *Cc:* Murugesan, Rani
> *Subject:* Re: HBase Phoenix Integration
>
>
>
> Hi Amit,
>
>
>
> For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of
> Andrew Purtell:
> https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
>
>
>
> Thanks,
>
> James
>
>
>
>
>
>
>
> On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
>
> Hi Sergey,
>
>
>
> I get lot of compilation errors when I compile the source code
> for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
> compilation succeeds when the changes to include cloudera dependent
> versions are not included. The only difference between the code changes
> suggested on the stackoverflow post and mine is the cloudera cdh version. I
> am using cdh 5.5.2. I didn't quite follow the reason behind the code
> changes needed in phoenix when deployed on CDH.
>
>
>
> Thanks,
>
> Amit.
>
>
>
> On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>
> wrote:
>
> Hi Amit,
>
> Switching to 4.3 means you need HBase 0.98. What kind of problem you
> experienced after building 4.6 from sources with changes suggested on
> StackOverflow?
>
> Thanks,
> Sergey
>
>
> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> > An update -
> >
> > I was able to execute "./sqlline.py <zookeeper-server-name>" command but
> I
> > get the same exception as I mentioned earlier.
> >
> > Later I tried following the steps mentioned on this link with phoenix
> 4.3.0
> > but I still get an error this time with a different stack trace
> (attached to
> > this mail)
> >
> > Any help would be appreciated
> >
> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
> >>
> >> Hi Murugesan,
> >>
> >> What preconditions would I need on the server to execute the python
> >> script? I have Python 2.7.5 installed on the zookeeper server. If I just
> >> copy the sqlline script to the /etc/hbase/conf directory and execute it
> I
> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
> version
> >> server and core phoenix jars in HBase/lib directory on the master and
> region
> >> servers.
> >>
> >> Traceback (most recent call last):
> >>   File "./sqlline.py", line 25, in <module>
> >>     import phoenix_utils
> >> ImportError: No module named phoenix_utils
> >>
> >> Pardon me for my knowledge about python.
> >>
> >> Thanks,
> >> Amit
> >>
> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
> >> wrote:
> >>>
> >>> Did you test and confirm your phoenix shell from the zookeeper server?
> >>>
> >>> cd /etc/hbase/conf
> >>>
> >>> > phoenix-sqlline.py <zookeeperserver>:2181
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Amit Shah [mailto:amits.84@gmail.com]
> >>> Sent: Friday, February 26, 2016 4:45 AM
> >>> To: user@phoenix.apache.org
> >>> Subject: HBase Phoenix Integration
> >>>
> >>>
> >>>
> >>> Hello,
> >>>
> >>>
> >>>
> >>> I have been trying to install phoenix on my cloudera hbase cluster.
> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
> >>>
> >>>
> >>>
> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the master
> and
> >>> region servers and restarted the hbase cluster. I copied the
> corresponding
> >>> client jar on my SQuirrel client but I get an exception on connect.
> Pasted
> >>> below. The connection url is
> “jdbc:phoenix:<zookeeper-server-name>:2181".
> >>>
> >>> I even tried compiling the source by adding cloudera dependencies as
> >>> suggested on this post but didn't succeed.
> >>>
> >>>
> >>>
> >>> Any suggestions to make this work?
> >>>
> >>>
> >>>
> >>> Thanks,
> >>>
> >>> Amit.
> >>>
> >>>
> >>>
> >>> ________________________________________________________________
> >>>
> >>>
> >>>
> >>> Caused by:
> >>>
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
> >>>
> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
> >>>
> >>>             at
> >>>
> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> >>>
> >>>             at java.lang.Thread.run(Thread.java:745)
> >>>
> >>> Caused by: java.lang.NoSuchMethodError:
> >>>
> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
> >>>
> >>>             ... 10 more
> >>>
> >>>
> >>>
> >>> P.S - The full stacktrace is attached in the mail.
> >>
> >>
> >
>
>
>
>
>
> This message and the information contained herein is proprietary and
> confidential and subject to the Amdocs policy statement, you may review at
> http://www.amdocs.com/email_disclaimer.asp
>
>
>
>

Re: RE: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
No idea. I had only searched for this relatively latest post for supporting phoenix with CDH 5.5.x
However, I cannot connect to phoenix according to the post guide. Compiling the git repo had also 
give me no luck. 







From: Dor Ben Dov
Date: 2016-03-01 16:39
To: user@phoenix.apache.org
Subject: RE: Re: HBase Phoenix Integration
Sun 
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ? 
 
Dor
 
From: Fulin Sun [mailto:sunfl@certusnet.com.cn] 
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration
 
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 
 
If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 


Thanks,
Sun.
 




 
From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
 
Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 
 

RE: Re: HBase Phoenix Integration

Posted by Dor Ben Dov <do...@amdocs.com>.
Sun
This is an old post there, do you know or are there any news about Cloudera Adopting the new Apache Phoenix 4.7 ?

Dor

From: Fulin Sun [mailto:sunfl@certusnet.com.cn]
Sent: יום ג 01 מרץ 2016 09:14
To: user; James Taylor
Subject: Re: Re: HBase Phoenix Integration

Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former.
Hope some guy can explain this and issue an workaround.

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this :
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/


Thanks,
Sun.

________________________________
________________________________

From: Amit Shah<ma...@gmail.com>
Date: 2016-03-01 15:37
To: user<ma...@phoenix.apache.org>; jamestaylor<ma...@apache.org>
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>> wrote:
James,
Do you have any problems working with Phoenix latest with CDH 5.5.X ?

Dor

From: James Taylor [mailto:jamestaylor@apache.org<ma...@apache.org>]
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration

Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com>> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com>> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com<ma...@gmail.com>]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org<ma...@phoenix.apache.org>
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>


This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp


Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi , Amit
Not work for me currently. I used the parcel to start hbase and phoenix, then it killed 
all the regionservers with no error message from the regionserver log. I had no idea 
why this would happen. I would try a little more and let u know asap when I had some 
good news.
Best,
Sun.






From: Amit Shah
Date: 2016-03-01 16:25
To: user
CC: James Taylor
Subject: Re: Re: HBase Phoenix Integration
Hi Sun,

Does the Cloudera-Labs phoenix version 4.5.2 work for you? I had tried the parcel but it didn't work for me. Do you have the steps to make phoenix work on cloudera CDH 5.5? 

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:43 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 

Thanks,
Sun.






From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 



Re: Re: HBase Phoenix Integration

Posted by Amit Shah <am...@gmail.com>.
Hi Sun,

Does the Cloudera-Labs phoenix version 4.5.2 work for you? I had tried the
parcel but it didn't work for me. Do you have the steps to make phoenix
work on cloudera CDH 5.5?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:43 PM, Fulin Sun <su...@certusnet.com.cn> wrote:

> Hi Amit
> Yeah. Meet the same error message when doing mvn package. I compared
> between the apache phoenix 4.6.0-hbase-1.0
> code with this repo code for CDH 5.5.1 , I did not find the abstract class
> BinaryCompatiblePhoenixBaseDecoder in the former.
> Hope some guy can explain this and issue an workaround.
>
> If no way to resolve this, I would still be using the Cloudera-Labs
> phoenix version from this :
>
> https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/
>
>
> Thanks,
> Sun.
>
> ------------------------------
> ------------------------------
>
>
> *From:* Amit Shah <am...@gmail.com>
> *Date:* 2016-03-01 15:37
> *To:* user <us...@phoenix.apache.org>; jamestaylor <ja...@apache.org>
> *Subject:* Re: HBase Phoenix Integration
> Hi James,
> I get a compilation error along with multiple warnings when
> packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.
>
> Also I realized that the pom.xml indicates the branch is for cloudera CDH
> version 5.5.1. Do you know if it would work for the latest CDH version
> 5.5.2?
>
> Thanks,
> Amit.
>
> On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com>
> wrote:
>
>> James,
>>
>> Do you have any problems working with Phoenix latest with CDH 5.5.X ?
>>
>>
>>
>> Dor
>>
>>
>>
>> *From:* James Taylor [mailto:jamestaylor@apache.org]
>> *Sent:* יום ג 01 מרץ 2016 08:24
>> *To:* user
>> *Cc:* Murugesan, Rani
>> *Subject:* Re: HBase Phoenix Integration
>>
>>
>>
>> Hi Amit,
>>
>>
>>
>> For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of
>> Andrew Purtell:
>> https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
>>
>>
>>
>> Thanks,
>>
>> James
>>
>>
>>
>>
>>
>>
>>
>> On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Sergey,
>>
>>
>>
>> I get lot of compilation errors when I compile the source code
>> for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
>> compilation succeeds when the changes to include cloudera dependent
>> versions are not included. The only difference between the code changes
>> suggested on the stackoverflow post and mine is the cloudera cdh version. I
>> am using cdh 5.5.2. I didn't quite follow the reason behind the code
>> changes needed in phoenix when deployed on CDH.
>>
>>
>>
>> Thanks,
>>
>> Amit.
>>
>>
>>
>> On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>
>> wrote:
>>
>> Hi Amit,
>>
>> Switching to 4.3 means you need HBase 0.98. What kind of problem you
>> experienced after building 4.6 from sources with changes suggested on
>> StackOverflow?
>>
>> Thanks,
>> Sergey
>>
>>
>> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
>> > An update -
>> >
>> > I was able to execute "./sqlline.py <zookeeper-server-name>" command
>> but I
>> > get the same exception as I mentioned earlier.
>> >
>> > Later I tried following the steps mentioned on this link with phoenix
>> 4.3.0
>> > but I still get an error this time with a different stack trace
>> (attached to
>> > this mail)
>> >
>> > Any help would be appreciated
>> >
>> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>> >>
>> >> Hi Murugesan,
>> >>
>> >> What preconditions would I need on the server to execute the python
>> >> script? I have Python 2.7.5 installed on the zookeeper server. If I
>> just
>> >> copy the sqlline script to the /etc/hbase/conf directory and execute
>> it I
>> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
>> version
>> >> server and core phoenix jars in HBase/lib directory on the master and
>> region
>> >> servers.
>> >>
>> >> Traceback (most recent call last):
>> >>   File "./sqlline.py", line 25, in <module>
>> >>     import phoenix_utils
>> >> ImportError: No module named phoenix_utils
>> >>
>> >> Pardon me for my knowledge about python.
>> >>
>> >> Thanks,
>> >> Amit
>> >>
>> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> >> wrote:
>> >>>
>> >>> Did you test and confirm your phoenix shell from the zookeeper server?
>> >>>
>> >>> cd /etc/hbase/conf
>> >>>
>> >>> > phoenix-sqlline.py <zookeeperserver>:2181
>> >>>
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> From: Amit Shah [mailto:amits.84@gmail.com]
>> >>> Sent: Friday, February 26, 2016 4:45 AM
>> >>> To: user@phoenix.apache.org
>> >>> Subject: HBase Phoenix Integration
>> >>>
>> >>>
>> >>>
>> >>> Hello,
>> >>>
>> >>>
>> >>>
>> >>> I have been trying to install phoenix on my cloudera hbase cluster.
>> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>> >>>
>> >>>
>> >>>
>> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the master
>> and
>> >>> region servers and restarted the hbase cluster. I copied the
>> corresponding
>> >>> client jar on my SQuirrel client but I get an exception on connect.
>> Pasted
>> >>> below. The connection url is
>> “jdbc:phoenix:<zookeeper-server-name>:2181".
>> >>>
>> >>> I even tried compiling the source by adding cloudera dependencies as
>> >>> suggested on this post but didn't succeed.
>> >>>
>> >>>
>> >>>
>> >>> Any suggestions to make this work?
>> >>>
>> >>>
>> >>>
>> >>> Thanks,
>> >>>
>> >>> Amit.
>> >>>
>> >>>
>> >>>
>> >>> ________________________________________________________________
>> >>>
>> >>>
>> >>>
>> >>> Caused by:
>> >>>
>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>> >>>
>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>> >>>
>> >>>             at java.lang.Thread.run(Thread.java:745)
>> >>>
>> >>> Caused by: java.lang.NoSuchMethodError:
>> >>>
>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>> >>>
>> >>>             ... 10 more
>> >>>
>> >>>
>> >>>
>> >>> P.S - The full stacktrace is attached in the mail.
>> >>
>> >>
>> >
>>
>>
>>
>>
>> This message and the information contained herein is proprietary and
>> confidential and subject to the Amdocs policy statement, you may review at
>> http://www.amdocs.com/email_disclaimer.asp
>>
>
>

Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi Amit
Yeah. Meet the same error message when doing mvn package. I compared between the apache phoenix 4.6.0-hbase-1.0
code with this repo code for CDH 5.5.1 , I did not find the abstract class BinaryCompatiblePhoenixBaseDecoder in the former. 
Hope some guy can explain this and issue an workaround. 

If no way to resolve this, I would still be using the Cloudera-Labs phoenix version from this : 
https://blog.cloudera.com/blog/2015/11/new-apache-phoenix-4-5-2-package-from-cloudera-labs/ 

Thanks,
Sun.






From: Amit Shah
Date: 2016-03-01 15:37
To: user; jamestaylor
Subject: Re: HBase Phoenix Integration
Hi James,
I get a compilation error along with multiple warnings when packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH version 5.5.1. Do you know if it would work for the latest CDH version 5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:
James, 
Do you have any problems working with Phoenix latest with CDH 5.5.X ? 
 
Dor
 
From: James Taylor [mailto:jamestaylor@apache.org] 
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
 
Hi Amit,
 
For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
 
Thanks,
James
 
 
 
On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,
 
I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.
 
Thanks,
Amit.
 
On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>
 
 
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at http://www.amdocs.com/email_disclaimer.asp 


Re: HBase Phoenix Integration

Posted by Amit Shah <am...@gmail.com>.
Hi James,
I get a compilation error along with multiple warnings when
packaging 4.6-HBase-1.0-cdh5.5 branch. Attached is the error.

Also I realized that the pom.xml indicates the branch is for cloudera CDH
version 5.5.1. Do you know if it would work for the latest CDH version
5.5.2?

Thanks,
Amit.

On Tue, Mar 1, 2016 at 12:05 PM, Dor Ben Dov <do...@amdocs.com> wrote:

> James,
>
> Do you have any problems working with Phoenix latest with CDH 5.5.X ?
>
>
>
> Dor
>
>
>
> *From:* James Taylor [mailto:jamestaylor@apache.org]
> *Sent:* יום ג 01 מרץ 2016 08:24
> *To:* user
> *Cc:* Murugesan, Rani
> *Subject:* Re: HBase Phoenix Integration
>
>
>
> Hi Amit,
>
>
>
> For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of
> Andrew Purtell:
> https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5
>
>
>
> Thanks,
>
> James
>
>
>
>
>
>
>
> On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
>
> Hi Sergey,
>
>
>
> I get lot of compilation errors when I compile the source code
> for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
> compilation succeeds when the changes to include cloudera dependent
> versions are not included. The only difference between the code changes
> suggested on the stackoverflow post and mine is the cloudera cdh version. I
> am using cdh 5.5.2. I didn't quite follow the reason behind the code
> changes needed in phoenix when deployed on CDH.
>
>
>
> Thanks,
>
> Amit.
>
>
>
> On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>
> wrote:
>
> Hi Amit,
>
> Switching to 4.3 means you need HBase 0.98. What kind of problem you
> experienced after building 4.6 from sources with changes suggested on
> StackOverflow?
>
> Thanks,
> Sergey
>
>
> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> > An update -
> >
> > I was able to execute "./sqlline.py <zookeeper-server-name>" command but
> I
> > get the same exception as I mentioned earlier.
> >
> > Later I tried following the steps mentioned on this link with phoenix
> 4.3.0
> > but I still get an error this time with a different stack trace
> (attached to
> > this mail)
> >
> > Any help would be appreciated
> >
> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
> >>
> >> Hi Murugesan,
> >>
> >> What preconditions would I need on the server to execute the python
> >> script? I have Python 2.7.5 installed on the zookeeper server. If I just
> >> copy the sqlline script to the /etc/hbase/conf directory and execute it
> I
> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
> version
> >> server and core phoenix jars in HBase/lib directory on the master and
> region
> >> servers.
> >>
> >> Traceback (most recent call last):
> >>   File "./sqlline.py", line 25, in <module>
> >>     import phoenix_utils
> >> ImportError: No module named phoenix_utils
> >>
> >> Pardon me for my knowledge about python.
> >>
> >> Thanks,
> >> Amit
> >>
> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
> >> wrote:
> >>>
> >>> Did you test and confirm your phoenix shell from the zookeeper server?
> >>>
> >>> cd /etc/hbase/conf
> >>>
> >>> > phoenix-sqlline.py <zookeeperserver>:2181
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Amit Shah [mailto:amits.84@gmail.com]
> >>> Sent: Friday, February 26, 2016 4:45 AM
> >>> To: user@phoenix.apache.org
> >>> Subject: HBase Phoenix Integration
> >>>
> >>>
> >>>
> >>> Hello,
> >>>
> >>>
> >>>
> >>> I have been trying to install phoenix on my cloudera hbase cluster.
> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
> >>>
> >>>
> >>>
> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the master
> and
> >>> region servers and restarted the hbase cluster. I copied the
> corresponding
> >>> client jar on my SQuirrel client but I get an exception on connect.
> Pasted
> >>> below. The connection url is
> “jdbc:phoenix:<zookeeper-server-name>:2181".
> >>>
> >>> I even tried compiling the source by adding cloudera dependencies as
> >>> suggested on this post but didn't succeed.
> >>>
> >>>
> >>>
> >>> Any suggestions to make this work?
> >>>
> >>>
> >>>
> >>> Thanks,
> >>>
> >>> Amit.
> >>>
> >>>
> >>>
> >>> ________________________________________________________________
> >>>
> >>>
> >>>
> >>> Caused by:
> >>>
> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
> >>>
> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
> >>>
> >>>             at
> >>>
> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
> >>>
> >>>             at
> >>>
> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
> >>>
> >>>             at
> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
> >>>
> >>>             at java.lang.Thread.run(Thread.java:745)
> >>>
> >>> Caused by: java.lang.NoSuchMethodError:
> >>>
> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
> >>>
> >>>             at
> >>>
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
> >>>
> >>>             ... 10 more
> >>>
> >>>
> >>>
> >>> P.S - The full stacktrace is attached in the mail.
> >>
> >>
> >
>
>
>
>
> This message and the information contained herein is proprietary and
> confidential and subject to the Amdocs policy statement, you may review at
> http://www.amdocs.com/email_disclaimer.asp
>

RE: HBase Phoenix Integration

Posted by Dor Ben Dov <do...@amdocs.com>.
James,
Do you have any problems working with Phoenix latest with CDH 5.5.X ?

Dor

From: James Taylor [mailto:jamestaylor@apache.org]
Sent: יום ג 01 מרץ 2016 08:24
To: user
Cc: Murugesan, Rani
Subject: Re: HBase Phoenix Integration

Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com>> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com>> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com>> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com<ma...@gmail.com>]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org<ma...@phoenix.apache.org>
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>



This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement,
you may review at http://www.amdocs.com/email_disclaimer.asp

Re: Re: HBase Phoenix Integration

Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi, James
I had encounter an maven build issue using this git repo for CDH 5.5.1
The error info is like the following : 

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.0:compile (default-compile) on project phoenix-core: Compilation failure
[ERROR] /usr/local/sunfl/phoenix/phoenix-for-cloudera-4.6-HBase-1.0-cdh5.5/phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/wal/IndexedWALEditCodec.java:[215,21] cannot find symbol
[ERROR] symbol:   method getDataInput(java.io.InputStream)
[ERROR] location: class org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec.BinaryCompatiblePhoenixBaseDecoder

I referenced the related source code from this link : https://github.com/chiastic-security/phoenix-for-cloudera/blob/4.6-HBase-1.0-cdh5.5/phoenix-core/src/main/java/org/apache/hadoop/hbase/regionserver/wal/IndexedWALEditCodec.java#L215 
It seems that the BinaryCompatiblePhoenixBaseDecoder's constructor has called an undefined symbol getDataInput. No idea how to modify this part and hope you can guide a little.

Best,
Sun.





 
From: James Taylor
Date: 2016-03-01 14:23
To: user
CC: Murugesan, Rani
Subject: Re: HBase Phoenix Integration
Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew Purtell: https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:
Hi Sergey,

I get lot of compilation errors when I compile the source code for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source compilation succeeds when the changes to include cloudera dependent versions are not included. The only difference between the code changes suggested on the stackoverflow post and mine is the cloudera cdh version. I am using cdh 5.5.2. I didn't quite follow the reason behind the code changes needed in phoenix when deployed on CDH.

Thanks,
Amit.

On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com> wrote:
Hi Amit,

Switching to 4.3 means you need HBase 0.98. What kind of problem you
experienced after building 4.6 from sources with changes suggested on
StackOverflow?

Thanks,
Sergey

On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
> An update -
>
> I was able to execute "./sqlline.py <zookeeper-server-name>" command but I
> get the same exception as I mentioned earlier.
>
> Later I tried following the steps mentioned on this link with phoenix 4.3.0
> but I still get an error this time with a different stack trace (attached to
> this mail)
>
> Any help would be appreciated
>
> On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>>
>> Hi Murugesan,
>>
>> What preconditions would I need on the server to execute the python
>> script? I have Python 2.7.5 installed on the zookeeper server. If I just
>> copy the sqlline script to the /etc/hbase/conf directory and execute it I
>> get the below import errors. Note this time I had 4.5.2-HBase-1.0 version
>> server and core phoenix jars in HBase/lib directory on the master and region
>> servers.
>>
>> Traceback (most recent call last):
>>   File "./sqlline.py", line 25, in <module>
>>     import phoenix_utils
>> ImportError: No module named phoenix_utils
>>
>> Pardon me for my knowledge about python.
>>
>> Thanks,
>> Amit
>>
>> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> wrote:
>>>
>>> Did you test and confirm your phoenix shell from the zookeeper server?
>>>
>>> cd /etc/hbase/conf
>>>
>>> > phoenix-sqlline.py <zookeeperserver>:2181
>>>
>>>
>>>
>>>
>>>
>>> From: Amit Shah [mailto:amits.84@gmail.com]
>>> Sent: Friday, February 26, 2016 4:45 AM
>>> To: user@phoenix.apache.org
>>> Subject: HBase Phoenix Integration
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> I have been trying to install phoenix on my cloudera hbase cluster.
>>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>>>
>>>
>>>
>>> I copied the server & core jar (version 4.6-HBase-1.0) on the master and
>>> region servers and restarted the hbase cluster. I copied the corresponding
>>> client jar on my SQuirrel client but I get an exception on connect. Pasted
>>> below. The connection url is “jdbc:phoenix:<zookeeper-server-name>:2181".
>>>
>>> I even tried compiling the source by adding cloudera dependencies as
>>> suggested on this post but didn't succeed.
>>>
>>>
>>>
>>> Any suggestions to make this work?
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Amit.
>>>
>>>
>>>
>>> ________________________________________________________________
>>>
>>>
>>>
>>> Caused by:
>>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>>>
>>>             at
>>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>>>
>>>             at
>>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>>>
>>>             at
>>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>>>
>>>             at java.lang.Thread.run(Thread.java:745)
>>>
>>> Caused by: java.lang.NoSuchMethodError:
>>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>>>
>>>             at
>>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>>>
>>>             ... 10 more
>>>
>>>
>>>
>>> P.S - The full stacktrace is attached in the mail.
>>
>>
>



Re: HBase Phoenix Integration

Posted by James Taylor <ja...@apache.org>.
Hi Amit,

For Phoenix 4.6 on CDH, try using this git repo instead, courtesy of Andrew
Purtell:
https://github.com/chiastic-security/phoenix-for-cloudera/tree/4.6-HBase-1.0-cdh5.5

Thanks,
James



On Mon, Feb 29, 2016 at 10:19 PM, Amit Shah <am...@gmail.com> wrote:

> Hi Sergey,
>
> I get lot of compilation errors when I compile the source code
> for 4.6-HBase-1.0 branch or v4.7.0-HBase-1.0-rc3 tag. Note that the source
> compilation succeeds when the changes to include cloudera dependent
> versions are not included. The only difference between the code changes
> suggested on the stackoverflow post and mine is the cloudera cdh version. I
> am using cdh 5.5.2. I didn't quite follow the reason behind the code
> changes needed in phoenix when deployed on CDH.
>
> Thanks,
> Amit.
>
> On Tue, Mar 1, 2016 at 1:15 AM, Sergey Soldatov <se...@gmail.com>
> wrote:
>
>> Hi Amit,
>>
>> Switching to 4.3 means you need HBase 0.98. What kind of problem you
>> experienced after building 4.6 from sources with changes suggested on
>> StackOverflow?
>>
>> Thanks,
>> Sergey
>>
>> On Sun, Feb 28, 2016 at 10:49 PM, Amit Shah <am...@gmail.com> wrote:
>> > An update -
>> >
>> > I was able to execute "./sqlline.py <zookeeper-server-name>" command
>> but I
>> > get the same exception as I mentioned earlier.
>> >
>> > Later I tried following the steps mentioned on this link with phoenix
>> 4.3.0
>> > but I still get an error this time with a different stack trace
>> (attached to
>> > this mail)
>> >
>> > Any help would be appreciated
>> >
>> > On Sat, Feb 27, 2016 at 8:03 AM, Amit Shah <am...@gmail.com> wrote:
>> >>
>> >> Hi Murugesan,
>> >>
>> >> What preconditions would I need on the server to execute the python
>> >> script? I have Python 2.7.5 installed on the zookeeper server. If I
>> just
>> >> copy the sqlline script to the /etc/hbase/conf directory and execute
>> it I
>> >> get the below import errors. Note this time I had 4.5.2-HBase-1.0
>> version
>> >> server and core phoenix jars in HBase/lib directory on the master and
>> region
>> >> servers.
>> >>
>> >> Traceback (most recent call last):
>> >>   File "./sqlline.py", line 25, in <module>
>> >>     import phoenix_utils
>> >> ImportError: No module named phoenix_utils
>> >>
>> >> Pardon me for my knowledge about python.
>> >>
>> >> Thanks,
>> >> Amit
>> >>
>> >> On Fri, Feb 26, 2016 at 11:26 PM, Murugesan, Rani <ra...@visa.com>
>> >> wrote:
>> >>>
>> >>> Did you test and confirm your phoenix shell from the zookeeper server?
>> >>>
>> >>> cd /etc/hbase/conf
>> >>>
>> >>> > phoenix-sqlline.py <zookeeperserver>:2181
>> >>>
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> From: Amit Shah [mailto:amits.84@gmail.com]
>> >>> Sent: Friday, February 26, 2016 4:45 AM
>> >>> To: user@phoenix.apache.org
>> >>> Subject: HBase Phoenix Integration
>> >>>
>> >>>
>> >>>
>> >>> Hello,
>> >>>
>> >>>
>> >>>
>> >>> I have been trying to install phoenix on my cloudera hbase cluster.
>> >>> Cloudera version is CDH5.5.2 while HBase version is 1.0.
>> >>>
>> >>>
>> >>>
>> >>> I copied the server & core jar (version 4.6-HBase-1.0) on the master
>> and
>> >>> region servers and restarted the hbase cluster. I copied the
>> corresponding
>> >>> client jar on my SQuirrel client but I get an exception on connect.
>> Pasted
>> >>> below. The connection url is
>> “jdbc:phoenix:<zookeeper-server-name>:2181".
>> >>>
>> >>> I even tried compiling the source by adding cloudera dependencies as
>> >>> suggested on this post but didn't succeed.
>> >>>
>> >>>
>> >>>
>> >>> Any suggestions to make this work?
>> >>>
>> >>>
>> >>>
>> >>> Thanks,
>> >>>
>> >>> Amit.
>> >>>
>> >>>
>> >>>
>> >>> ________________________________________________________________
>> >>>
>> >>>
>> >>>
>> >>> Caused by:
>> >>>
>> org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException):
>> >>> org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.CATALOG:
>> >>>
>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1319)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:11715)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7388)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1776)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1758)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32209)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2034)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
>> >>>
>> >>>             at
>> >>>
>> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
>> >>>
>> >>>             at
>> >>> org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
>> >>>
>> >>>             at java.lang.Thread.run(Thread.java:745)
>> >>>
>> >>> Caused by: java.lang.NoSuchMethodError:
>> >>>
>> org.apache.hadoop.hbase.client.Scan.setRaw(Z)Lorg/apache/hadoop/hbase/client/Scan;
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildDeletedTable(MetaDataEndpointImpl.java:1016)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1092)
>> >>>
>> >>>             at
>> >>>
>> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1266)
>> >>>
>> >>>             ... 10 more
>> >>>
>> >>>
>> >>>
>> >>> P.S - The full stacktrace is attached in the mail.
>> >>
>> >>
>> >
>>
>
>