You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Stephen Boesch <ja...@gmail.com> on 2014/06/28 05:21:07 UTC
HBase 0.96+ with Spark 1.0+
The present trunk is built and tested against HBase 0.94.
I have tried various combinations of versions of HBase 0.96+ and Spark 1.0+
and all end up with
14/06/27 20:11:15 INFO HttpServer: Starting HTTP Server
[error] (run-main-0) java.lang.SecurityException: class
"javax.servlet.FilterRegistration"'s signer information does not match
signer information of other classes in the same package
java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
signer information does not match signer information of other classes in
the same package
at java.lang.ClassLoader.checkCerts(ClassLoader.java:952)
I have tried a number of different ways to exclude javax.servlet related
jars. But none have avoided this error.
Anyone have a (small-ish) build.sbt that works with later versions of HBase?
Re: HBase 0.96+ with Spark 1.0+
Posted by Stephen Boesch <ja...@gmail.com>.
Hi Siyuan,
Thanks for the input. We are preferring to use the SparkBuild.scala
instead of maven. I did not see any protobuf.version related settings in
that file. But - as noted by Sean Owen - in any case the issue we are
facing presently is about the duplicate incompatible javax.servlet entries
- apparently from the org.mortbay artifacts.
2014-06-28 6:01 GMT-07:00 Siyuan he <hs...@gmail.com>:
> Hi Stephen,
>
> I am using spark1.0+ HBase0.96.2. This is what I did:
> 1) rebuild spark using: mvn -Dhadoop.version=2.3.0
> -Dprotobuf.version=2.5.0 -DskipTests clean package
> 2) In spark-env.sh, set SPARK_CLASSPATH =
> /path-to/hbase-protocol-0.96.2-hadoop2.jar
>
> Hopefully it can help.
> Siyuan
>
>
> On Sat, Jun 28, 2014 at 8:52 AM, Stephen Boesch <ja...@gmail.com> wrote:
>
>>
>> Thanks Sean. I had actually already added exclusion rule for
>> org.mortbay.jetty - and that had not resolved it.
>>
>> Just in case I used your precise formulation:
>>
>> val excludeMortbayJetty = ExclusionRule(organization =
>> "org.mortbay.jetty")
>> ..
>> ,("org.apache.spark" % "spark-core_2.10" % sparkVersion
>> withSources()).excludeAll(excludeMortbayJetty)
>> ,("org.apache.spark" % "spark-sql_2.10" % sparkVersion
>> withSources()).excludeAll(excludeMortbayJetty)
>>
>> However the same error still recurs:
>>
>> 14/06/28 05:48:35 INFO HttpServer: Starting HTTP Server
>> [error] (run-main-0) java.lang.SecurityException: class
>> "javax.servlet.FilterRegistration"'s signer information does not match
>> signer information of other classes in the same package
>> java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
>> signer information does not match signer information of other classes in
>> the same package
>>
>>
>>
>>
>> 2014-06-28 4:22 GMT-07:00 Sean Owen <so...@cloudera.com>:
>>
>> This sounds like an instance of roughly the same item as in
>>> https://issues.apache.org/jira/browse/SPARK-1949 Have a look at
>>> adding that exclude to see if it works.
>>>
>>> On Fri, Jun 27, 2014 at 10:21 PM, Stephen Boesch <ja...@gmail.com>
>>> wrote:
>>> > The present trunk is built and tested against HBase 0.94.
>>> >
>>> >
>>> > I have tried various combinations of versions of HBase 0.96+ and Spark
>>> 1.0+
>>> > and all end up with
>>> >
>>> > 14/06/27 20:11:15 INFO HttpServer: Starting HTTP Server
>>> > [error] (run-main-0) java.lang.SecurityException: class
>>> > "javax.servlet.FilterRegistration"'s signer information does not match
>>> > signer information of other classes in the same package
>>> > java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
>>> > signer information does not match signer information of other classes
>>> in the
>>> > same package
>>> > at java.lang.ClassLoader.checkCerts(ClassLoader.java:952)
>>> >
>>> >
>>> > I have tried a number of different ways to exclude javax.servlet
>>> related
>>> > jars. But none have avoided this error.
>>> >
>>> > Anyone have a (small-ish) build.sbt that works with later versions of
>>> HBase?
>>> >
>>> >
>>>
>>
>>
>
Re: HBase 0.96+ with Spark 1.0+
Posted by Siyuan he <hs...@gmail.com>.
Hi Stephen,
I am using spark1.0+ HBase0.96.2. This is what I did:
1) rebuild spark using: mvn -Dhadoop.version=2.3.0 -Dprotobuf.version=2.5.0
-DskipTests clean package
2) In spark-env.sh, set SPARK_CLASSPATH =
/path-to/hbase-protocol-0.96.2-hadoop2.jar
Hopefully it can help.
Siyuan
On Sat, Jun 28, 2014 at 8:52 AM, Stephen Boesch <ja...@gmail.com> wrote:
>
> Thanks Sean. I had actually already added exclusion rule for
> org.mortbay.jetty - and that had not resolved it.
>
> Just in case I used your precise formulation:
>
> val excludeMortbayJetty = ExclusionRule(organization = "org.mortbay.jetty")
> ..
> ,("org.apache.spark" % "spark-core_2.10" % sparkVersion
> withSources()).excludeAll(excludeMortbayJetty)
> ,("org.apache.spark" % "spark-sql_2.10" % sparkVersion
> withSources()).excludeAll(excludeMortbayJetty)
>
> However the same error still recurs:
>
> 14/06/28 05:48:35 INFO HttpServer: Starting HTTP Server
> [error] (run-main-0) java.lang.SecurityException: class
> "javax.servlet.FilterRegistration"'s signer information does not match
> signer information of other classes in the same package
> java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
> signer information does not match signer information of other classes in
> the same package
>
>
>
>
> 2014-06-28 4:22 GMT-07:00 Sean Owen <so...@cloudera.com>:
>
> This sounds like an instance of roughly the same item as in
>> https://issues.apache.org/jira/browse/SPARK-1949 Have a look at
>> adding that exclude to see if it works.
>>
>> On Fri, Jun 27, 2014 at 10:21 PM, Stephen Boesch <ja...@gmail.com>
>> wrote:
>> > The present trunk is built and tested against HBase 0.94.
>> >
>> >
>> > I have tried various combinations of versions of HBase 0.96+ and Spark
>> 1.0+
>> > and all end up with
>> >
>> > 14/06/27 20:11:15 INFO HttpServer: Starting HTTP Server
>> > [error] (run-main-0) java.lang.SecurityException: class
>> > "javax.servlet.FilterRegistration"'s signer information does not match
>> > signer information of other classes in the same package
>> > java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
>> > signer information does not match signer information of other classes
>> in the
>> > same package
>> > at java.lang.ClassLoader.checkCerts(ClassLoader.java:952)
>> >
>> >
>> > I have tried a number of different ways to exclude javax.servlet related
>> > jars. But none have avoided this error.
>> >
>> > Anyone have a (small-ish) build.sbt that works with later versions of
>> HBase?
>> >
>> >
>>
>
>
Re: HBase 0.96+ with Spark 1.0+
Posted by Stephen Boesch <ja...@gmail.com>.
Thanks Sean. I had actually already added exclusion rule for
org.mortbay.jetty - and that had not resolved it.
Just in case I used your precise formulation:
val excludeMortbayJetty = ExclusionRule(organization = "org.mortbay.jetty")
..
,("org.apache.spark" % "spark-core_2.10" % sparkVersion
withSources()).excludeAll(excludeMortbayJetty)
,("org.apache.spark" % "spark-sql_2.10" % sparkVersion
withSources()).excludeAll(excludeMortbayJetty)
However the same error still recurs:
14/06/28 05:48:35 INFO HttpServer: Starting HTTP Server
[error] (run-main-0) java.lang.SecurityException: class
"javax.servlet.FilterRegistration"'s signer information does not match
signer information of other classes in the same package
java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
signer information does not match signer information of other classes in
the same package
2014-06-28 4:22 GMT-07:00 Sean Owen <so...@cloudera.com>:
> This sounds like an instance of roughly the same item as in
> https://issues.apache.org/jira/browse/SPARK-1949 Have a look at
> adding that exclude to see if it works.
>
> On Fri, Jun 27, 2014 at 10:21 PM, Stephen Boesch <ja...@gmail.com>
> wrote:
> > The present trunk is built and tested against HBase 0.94.
> >
> >
> > I have tried various combinations of versions of HBase 0.96+ and Spark
> 1.0+
> > and all end up with
> >
> > 14/06/27 20:11:15 INFO HttpServer: Starting HTTP Server
> > [error] (run-main-0) java.lang.SecurityException: class
> > "javax.servlet.FilterRegistration"'s signer information does not match
> > signer information of other classes in the same package
> > java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
> > signer information does not match signer information of other classes in
> the
> > same package
> > at java.lang.ClassLoader.checkCerts(ClassLoader.java:952)
> >
> >
> > I have tried a number of different ways to exclude javax.servlet related
> > jars. But none have avoided this error.
> >
> > Anyone have a (small-ish) build.sbt that works with later versions of
> HBase?
> >
> >
>
Re: HBase 0.96+ with Spark 1.0+
Posted by Sean Owen <so...@cloudera.com>.
This sounds like an instance of roughly the same item as in
https://issues.apache.org/jira/browse/SPARK-1949 Have a look at
adding that exclude to see if it works.
On Fri, Jun 27, 2014 at 10:21 PM, Stephen Boesch <ja...@gmail.com> wrote:
> The present trunk is built and tested against HBase 0.94.
>
>
> I have tried various combinations of versions of HBase 0.96+ and Spark 1.0+
> and all end up with
>
> 14/06/27 20:11:15 INFO HttpServer: Starting HTTP Server
> [error] (run-main-0) java.lang.SecurityException: class
> "javax.servlet.FilterRegistration"'s signer information does not match
> signer information of other classes in the same package
> java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
> signer information does not match signer information of other classes in the
> same package
> at java.lang.ClassLoader.checkCerts(ClassLoader.java:952)
>
>
> I have tried a number of different ways to exclude javax.servlet related
> jars. But none have avoided this error.
>
> Anyone have a (small-ish) build.sbt that works with later versions of HBase?
>
>