You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by "Saurabh Malviya (samalviy)" <sa...@cisco.com> on 2016/07/19 22:50:32 UTC
Hbase Es -Quava lib conflict
Hi,
I am addressing one issue to make Hbase and ES work together in same spark project
https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-HBase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
If anyone have any pointer let me know, Even Hbase-shaded-client does not help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic search failed in that case.
Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
at common.TaskTracker$.updateStatus(TaskTracker.scala:55)
Re: Hbase Es -Quava lib conflict
Posted by Ted Yu <yu...@gmail.com>.
This seems related: HBASE-14963
On Tue, Jul 19, 2016 at 3:50 PM, Saurabh Malviya (samalviy) <
samalviy@cisco.com> wrote:
> Hi,
>
> I am addressing one issue to make Hbase and ES work together in same spark
> project
>
>
> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-HBase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>
> If anyone have any pointer let me know, Even Hbase-shaded-client does not
> help. If I removed quava reference ""com.google.guava" % "guava" % "18.0""
> It will works but Elastic search failed in that case.
>
> Exception in thread "main" java.lang.IllegalAccessError: tried to access
> method com.google.common.base.Stopwatch.<init>()V from class
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator
> at
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
> at
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
> at
> org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
> at
> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
> at
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
> at
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
> at
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
> at
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
> at
> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
> at
> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
> at
> org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
> at
> org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
> at
> org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
> at
> org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
> at
> org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
> at common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>
>
>
Re: Hbase Es -Quava lib conflict
Posted by Sean Busbey <bu...@cloudera.com>.
that's part of our mapreduce support. for it, you currently need to
use the hbase-shaded-server artifact.
On Thu, Jul 21, 2016 at 1:23 PM, Saurabh Malviya (samalviy)
<sa...@cisco.com> wrote:
> With Shaded client it is not able to find below class
>
> import org.apache.hadoop.hbase.mapred.TableOutputFormat
>
>
> -----Original Message-----
> From: Sean Busbey [mailto:busbey@cloudera.com]
> Sent: Wednesday, July 20, 2016 12:00 PM
> To: user <us...@hbase.apache.org>
> Subject: Re: Hbase Es -Quava lib conflict
>
> why do you have a dependency on o.a.hbase:hbase, o.a.hbase:hbase-server, and o.a.hbase:hbase-common? If you have those, then the shaded client won't do you any good. You should only need the hbase-shaded-client artifact.
>
> There hasn't been a CDH release with a functioning shaded client yet.
> AFAIK, the first ones will be 1.2.0-cdh5.7.2 and 1.2.0-cdh5.8.0. What version is the cluster you are trying to work with?
>
> On Wed, Jul 20, 2016 at 1:15 PM, Saurabh Malviya (samalviy) <sa...@cisco.com> wrote:
>> This is my sbt looks like
>>
>> val hbaseVersion = "1.0.0-cdh5.5.0"
>>
>> "org.apache.hbase" % "hbase" % hbaseVersion,
>> "org.apache.hbase" % "hbase-server" % hbaseVersion,
>> "org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded client as well not working (Used all version upto 1.2.1)
>> "org.apache.hbase" % "hbase-common" % hbaseVersion,
>> "org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile",
>> "org.elasticsearch" % "elasticsearch" % "2.3.3",
>> "com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove this elastic search will not work.
>>
>>
>> -----Original Message-----
>> From: Sean Busbey [mailto:busbey@cloudera.com]
>> Sent: Wednesday, July 20, 2016 10:25 AM
>> To: user <us...@hbase.apache.org>
>> Subject: Re: Hbase Es -Quava lib conflict
>>
>> how are you making use of hbase shaded client? that module should remove this issue entirely.
>>
>> On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) <sa...@cisco.com> wrote:
>>> Hi,
>>>
>>> I am addressing one issue to make Hbase and ES work together in same
>>> spark project
>>>
>>> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-H
>>> B
>>> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>>>
>>> If anyone have any pointer let me know, Even Hbase-shaded-client does not help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic search failed in that case.
>>>
>>> Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
>>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
>>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
>>> at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
>>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
>>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
>>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
>>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
>>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
>>> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
>>> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
>>> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
>>> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
>>> at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
>>> at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
>>> at
>>> common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>>>
>>>
>>
>>
>>
>> --
>> busbey
>
>
>
> --
> busbey
--
busbey
RE: Hbase Es -Quava lib conflict
Posted by "Saurabh Malviya (samalviy)" <sa...@cisco.com>.
With Shaded client it is not able to find below class
import org.apache.hadoop.hbase.mapred.TableOutputFormat
-----Original Message-----
From: Sean Busbey [mailto:busbey@cloudera.com]
Sent: Wednesday, July 20, 2016 12:00 PM
To: user <us...@hbase.apache.org>
Subject: Re: Hbase Es -Quava lib conflict
why do you have a dependency on o.a.hbase:hbase, o.a.hbase:hbase-server, and o.a.hbase:hbase-common? If you have those, then the shaded client won't do you any good. You should only need the hbase-shaded-client artifact.
There hasn't been a CDH release with a functioning shaded client yet.
AFAIK, the first ones will be 1.2.0-cdh5.7.2 and 1.2.0-cdh5.8.0. What version is the cluster you are trying to work with?
On Wed, Jul 20, 2016 at 1:15 PM, Saurabh Malviya (samalviy) <sa...@cisco.com> wrote:
> This is my sbt looks like
>
> val hbaseVersion = "1.0.0-cdh5.5.0"
>
> "org.apache.hbase" % "hbase" % hbaseVersion,
> "org.apache.hbase" % "hbase-server" % hbaseVersion,
> "org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded client as well not working (Used all version upto 1.2.1)
> "org.apache.hbase" % "hbase-common" % hbaseVersion,
> "org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile",
> "org.elasticsearch" % "elasticsearch" % "2.3.3",
> "com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove this elastic search will not work.
>
>
> -----Original Message-----
> From: Sean Busbey [mailto:busbey@cloudera.com]
> Sent: Wednesday, July 20, 2016 10:25 AM
> To: user <us...@hbase.apache.org>
> Subject: Re: Hbase Es -Quava lib conflict
>
> how are you making use of hbase shaded client? that module should remove this issue entirely.
>
> On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) <sa...@cisco.com> wrote:
>> Hi,
>>
>> I am addressing one issue to make Hbase and ES work together in same
>> spark project
>>
>> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-H
>> B
>> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>>
>> If anyone have any pointer let me know, Even Hbase-shaded-client does not help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic search failed in that case.
>>
>> Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
>> at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
>> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
>> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
>> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
>> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
>> at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
>> at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
>> at
>> common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>>
>>
>
>
>
> --
> busbey
--
busbey
Re: Hbase Es -Quava lib conflict
Posted by Sean Busbey <bu...@cloudera.com>.
why do you have a dependency on o.a.hbase:hbase,
o.a.hbase:hbase-server, and o.a.hbase:hbase-common? If you have those,
then the shaded client won't do you any good. You should only need the
hbase-shaded-client artifact.
There hasn't been a CDH release with a functioning shaded client yet.
AFAIK, the first ones will be 1.2.0-cdh5.7.2 and 1.2.0-cdh5.8.0. What
version is the cluster you are trying to work with?
On Wed, Jul 20, 2016 at 1:15 PM, Saurabh Malviya (samalviy)
<sa...@cisco.com> wrote:
> This is my sbt looks like
>
> val hbaseVersion = "1.0.0-cdh5.5.0"
>
> "org.apache.hbase" % "hbase" % hbaseVersion,
> "org.apache.hbase" % "hbase-server" % hbaseVersion,
> "org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded client as well not working (Used all version upto 1.2.1)
> "org.apache.hbase" % "hbase-common" % hbaseVersion,
> "org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile",
> "org.elasticsearch" % "elasticsearch" % "2.3.3",
> "com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove this elastic search will not work.
>
>
> -----Original Message-----
> From: Sean Busbey [mailto:busbey@cloudera.com]
> Sent: Wednesday, July 20, 2016 10:25 AM
> To: user <us...@hbase.apache.org>
> Subject: Re: Hbase Es -Quava lib conflict
>
> how are you making use of hbase shaded client? that module should remove this issue entirely.
>
> On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) <sa...@cisco.com> wrote:
>> Hi,
>>
>> I am addressing one issue to make Hbase and ES work together in same
>> spark project
>>
>> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-HB
>> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>>
>> If anyone have any pointer let me know, Even Hbase-shaded-client does not help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic search failed in that case.
>>
>> Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
>> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
>> at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
>> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
>> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
>> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
>> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
>> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
>> at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
>> at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
>> at
>> common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>>
>>
>
>
>
> --
> busbey
--
busbey
RE: Hbase Es -Quava lib conflict
Posted by "Saurabh Malviya (samalviy)" <sa...@cisco.com>.
This is my sbt looks like
val hbaseVersion = "1.0.0-cdh5.5.0"
"org.apache.hbase" % "hbase" % hbaseVersion,
"org.apache.hbase" % "hbase-server" % hbaseVersion,
"org.apache.hbase" % "hbase-client" % hbaseVersion, -- > Used shaded client as well not working (Used all version upto 1.2.1)
"org.apache.hbase" % "hbase-common" % hbaseVersion,
"org.elasticsearch" % "elasticsearch-hadoop" % "5.0.0-alpha4" % "compile",
"org.elasticsearch" % "elasticsearch" % "2.3.3",
"com.google.guava" % "guava" % "18.0" --> This is the culprit -IF I remove this elastic search will not work.
-----Original Message-----
From: Sean Busbey [mailto:busbey@cloudera.com]
Sent: Wednesday, July 20, 2016 10:25 AM
To: user <us...@hbase.apache.org>
Subject: Re: Hbase Es -Quava lib conflict
how are you making use of hbase shaded client? that module should remove this issue entirely.
On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy) <sa...@cisco.com> wrote:
> Hi,
>
> I am addressing one issue to make Hbase and ES work together in same
> spark project
>
> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-HB
> ase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>
> If anyone have any pointer let me know, Even Hbase-shaded-client does not help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic search failed in that case.
>
> Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
> at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
> at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
> at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
> at
> common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>
>
--
busbey
Re: Hbase Es -Quava lib conflict
Posted by Sean Busbey <bu...@cloudera.com>.
how are you making use of hbase shaded client? that module should
remove this issue entirely.
On Tue, Jul 19, 2016 at 5:50 PM, Saurabh Malviya (samalviy)
<sa...@cisco.com> wrote:
> Hi,
>
> I am addressing one issue to make Hbase and ES work together in same spark project
>
> https://community.cloudera.com/t5/Storage-Random-Access-HDFS/Apache-HBase-Shaded-Client-1-1-x-with-Cloudera-Hbase-1-0-0-CDH-5/td-p/35505
>
> If anyone have any pointer let me know, Even Hbase-shaded-client does not help. If I removed quava reference ""com.google.guava" % "guava" % "18.0"" It will works but Elastic search failed in that case.
>
> Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator
> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:596)
> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:580)
> at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:559)
> at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateMeta(ConnectionManager.java:1185)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1152)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1126)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1331)
> at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1155)
> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:370)
> at org.apache.hadoop.hbase.client.AsyncProcess.submit(AsyncProcess.java:321)
> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:206)
> at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:183)
> at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1425)
> at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1018)
> at common.TaskTracker$.updateStatus(TaskTracker.scala:55)
>
>
--
busbey