You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by yeshwanth kumar <ye...@gmail.com> on 2016/04/05 21:12:00 UTC
choosing between hbase-spark / spark-hbase
i have cloudera cluster,
i am exploring spark with HBase,
after going through this blog
http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
i found two options for using Spark with HBase,
Cloudera's Spark on HBase or
Apache hbase-spark.
do they have significance difference?
which one should i use,
can someone please point me out to their API documentation.
i did searched for documentation, but couldn't find it.
Thanks,
-Yeshwanth
Can you Imagine what I would do if I could do all I can - Art of War
Re: choosing between hbase-spark / spark-hbase
Posted by Ted Yu <yu...@gmail.com>.
For 2.0.0-SNAPSHOT version, you should build trunk by yourself.
For 1.2.0-cdh5.7.0 , please contact cdh mailing list.
On Sun, Apr 10, 2016 at 7:09 PM, yeshwanth kumar <ye...@gmail.com>
wrote:
> Thank you for the reply,
>
> i am having trouble in finding out the dependency in maven repository, the
> only dependency i can find is
>
> <dependency>
> <groupId>org.apache.hbase</groupId>
> <artifactId>hbase-spark</artifactId>
> <version>1.2.0-cdh5.7.0</version>
> </dependency>
>
> from cloudera maven repository,
>
> dependency specified in this page, was not able to resolve
>
> http://hbase.apache.org/hbase-spark/dependency-info.html
>
> do i need to build it from the trunk?
>
> please let me know
>
> Thanks,
> Yeshwanth
>
> -Yeshwanth
> Can you Imagine what I would do if I could do all I can - Art of War
>
> On Tue, Apr 5, 2016 at 5:30 PM, Ted Yu <yu...@gmail.com> wrote:
>
> > There are some outstanding bug fixes, e.g. HBASE-15333, for hbase-spark
> > module.
> >
> > FYI
> >
> > On Tue, Apr 5, 2016 at 2:36 PM, Nkechi Achara <nk...@googlemail.com>
> > wrote:
> >
> > > So Hbase-spark is a continuation of the spark on hbase project, but
> > within
> > > the Hbase project.
> > > They are not any significant differences apart from the fact that Spark
> > on
> > > hbase is not updated.
> > > Dependent on the version you are using it would be more beneficial to
> use
> > > Hbase-Spark
> > >
> > > Kay
> > > On 5 Apr 2016 9:12 pm, "yeshwanth kumar" <ye...@gmail.com>
> wrote:
> > >
> > > > i have cloudera cluster,
> > > > i am exploring spark with HBase,
> > > >
> > > > after going through this blog
> > > >
> > > >
> > > >
> > >
> >
> http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
> > > >
> > > > i found two options for using Spark with HBase,
> > > >
> > > > Cloudera's Spark on HBase or
> > > > Apache hbase-spark.
> > > >
> > > > do they have significance difference?
> > > > which one should i use,
> > > >
> > > > can someone please point me out to their API documentation.
> > > > i did searched for documentation, but couldn't find it.
> > > >
> > > >
> > > > Thanks,
> > > > -Yeshwanth
> > > > Can you Imagine what I would do if I could do all I can - Art of War
> > > >
> > >
> >
>
Re: choosing between hbase-spark / spark-hbase
Posted by yeshwanth kumar <ye...@gmail.com>.
Thank you for the reply,
i am having trouble in finding out the dependency in maven repository, the
only dependency i can find is
<dependency>
<groupId>org.apache.hbase</groupId>
<artifactId>hbase-spark</artifactId>
<version>1.2.0-cdh5.7.0</version>
</dependency>
from cloudera maven repository,
dependency specified in this page, was not able to resolve
http://hbase.apache.org/hbase-spark/dependency-info.html
do i need to build it from the trunk?
please let me know
Thanks,
Yeshwanth
-Yeshwanth
Can you Imagine what I would do if I could do all I can - Art of War
On Tue, Apr 5, 2016 at 5:30 PM, Ted Yu <yu...@gmail.com> wrote:
> There are some outstanding bug fixes, e.g. HBASE-15333, for hbase-spark
> module.
>
> FYI
>
> On Tue, Apr 5, 2016 at 2:36 PM, Nkechi Achara <nk...@googlemail.com>
> wrote:
>
> > So Hbase-spark is a continuation of the spark on hbase project, but
> within
> > the Hbase project.
> > They are not any significant differences apart from the fact that Spark
> on
> > hbase is not updated.
> > Dependent on the version you are using it would be more beneficial to use
> > Hbase-Spark
> >
> > Kay
> > On 5 Apr 2016 9:12 pm, "yeshwanth kumar" <ye...@gmail.com> wrote:
> >
> > > i have cloudera cluster,
> > > i am exploring spark with HBase,
> > >
> > > after going through this blog
> > >
> > >
> > >
> >
> http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
> > >
> > > i found two options for using Spark with HBase,
> > >
> > > Cloudera's Spark on HBase or
> > > Apache hbase-spark.
> > >
> > > do they have significance difference?
> > > which one should i use,
> > >
> > > can someone please point me out to their API documentation.
> > > i did searched for documentation, but couldn't find it.
> > >
> > >
> > > Thanks,
> > > -Yeshwanth
> > > Can you Imagine what I would do if I could do all I can - Art of War
> > >
> >
>
Re: choosing between hbase-spark / spark-hbase
Posted by Ted Yu <yu...@gmail.com>.
There are some outstanding bug fixes, e.g. HBASE-15333, for hbase-spark
module.
FYI
On Tue, Apr 5, 2016 at 2:36 PM, Nkechi Achara <nk...@googlemail.com>
wrote:
> So Hbase-spark is a continuation of the spark on hbase project, but within
> the Hbase project.
> They are not any significant differences apart from the fact that Spark on
> hbase is not updated.
> Dependent on the version you are using it would be more beneficial to use
> Hbase-Spark
>
> Kay
> On 5 Apr 2016 9:12 pm, "yeshwanth kumar" <ye...@gmail.com> wrote:
>
> > i have cloudera cluster,
> > i am exploring spark with HBase,
> >
> > after going through this blog
> >
> >
> >
> http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
> >
> > i found two options for using Spark with HBase,
> >
> > Cloudera's Spark on HBase or
> > Apache hbase-spark.
> >
> > do they have significance difference?
> > which one should i use,
> >
> > can someone please point me out to their API documentation.
> > i did searched for documentation, but couldn't find it.
> >
> >
> > Thanks,
> > -Yeshwanth
> > Can you Imagine what I would do if I could do all I can - Art of War
> >
>
Re: choosing between hbase-spark / spark-hbase
Posted by Nkechi Achara <nk...@googlemail.com>.
So Hbase-spark is a continuation of the spark on hbase project, but within
the Hbase project.
They are not any significant differences apart from the fact that Spark on
hbase is not updated.
Dependent on the version you are using it would be more beneficial to use
Hbase-Spark
Kay
On 5 Apr 2016 9:12 pm, "yeshwanth kumar" <ye...@gmail.com> wrote:
> i have cloudera cluster,
> i am exploring spark with HBase,
>
> after going through this blog
>
>
> http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/
>
> i found two options for using Spark with HBase,
>
> Cloudera's Spark on HBase or
> Apache hbase-spark.
>
> do they have significance difference?
> which one should i use,
>
> can someone please point me out to their API documentation.
> i did searched for documentation, but couldn't find it.
>
>
> Thanks,
> -Yeshwanth
> Can you Imagine what I would do if I could do all I can - Art of War
>