Why is there a spark plugin?

[Cheyenne Forbes <ch...@gmail.com>]

 Why would/should I care about spark/spark plugin when I already have
phoenix?

Re: Why is there a spark plugin?

[Josh Mahonin <jm...@gmail.com>]

Hi,

It's a good question, and in short, I think Phoenix and Spark overall serve
orthogonal use cases.

If all of your needs are met with the Phoenix JDBC interface, you likely
have no need for Spark at all. However, if you have data in HBase/Phoenix
and would like to leverage Spark functionality, such as MLLib or GraphX,
then the phoenix-spark integration provides a way to do so. The
phoenix-spark documentation has a brief example of applying PageRank using
GraphX to a Phoenix table [1]

Best,

Josh

[1] https://phoenix.apache.org/phoenix_spark.html

On Wed, Nov 16, 2016 at 10:20 PM, Christopher Tarnas <
cft@biotiquesystems.com> wrote:

> It is not an either or, you can use both - hence the plugin. Phoenix is
> great at OLTP type workloads and Spark is better at OLAP and machine
> learning.
>
> -chris
>
> > On Nov 16, 2016, at 6:56 PM, Cheyenne Forbes <
> cheyenne.osanu.forbes@gmail.com> wrote:
> >
> > so why would I choose Phoenix over Spark?
>

Re: Why is there a spark plugin?

[Christopher Tarnas <cf...@biotiquesystems.com>]

It is not an either or, you can use both - hence the plugin. Phoenix is great at OLTP type workloads and Spark is better at OLAP and machine learning. 

-chris

> On Nov 16, 2016, at 6:56 PM, Cheyenne Forbes <ch...@gmail.com> wrote:
> 
> so why would I choose Phoenix over Spark?

Re: Why is there a spark plugin?

[Cheyenne Forbes <ch...@gmail.com>]

so why would I choose Phoenix over Spark?

Re: Why is there a spark plugin?

[Christopher Tarnas <cf...@biotiquesystems.com>]

Spark is much, much more than just a way to perform SQL. 

-chris

> On Nov 16, 2016, at 7:13 AM, Cheyenne Forbes <ch...@gmail.com> wrote:
> 
> Why would/should I care about spark/spark plugin when I already have phoenix?