You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Publius <t_...@yahoo.com> on 2015/08/18 00:33:47 UTC

spark

Hello
what is the difference between Hadoop and Spark?
How is Spark better? 

Re: spark

Posted by Jay Vyas <ja...@gmail.com>.
For a start compare sparks word count with mapreduce word count.

Then compare sparksql with hive.

If you get that far for the final exersize, Find out for yourself by running bigpetstore-mapreduce and bigpetstore-spark side by side :).  They are two similar applications which generate data sets and process them for etl and product recommendations which we are curating in Apache bigtop.



> On Aug 17, 2015, at 6:33 PM, Publius <t_...@yahoo.com> wrote:
> 
> Hello
> 
> what is the difference between Hadoop and Spark?
> 
> How is Spark better? 
> 

Re: spark

Posted by Jay Vyas <ja...@gmail.com>.
For a start compare sparks word count with mapreduce word count.

Then compare sparksql with hive.

If you get that far for the final exersize, Find out for yourself by running bigpetstore-mapreduce and bigpetstore-spark side by side :).  They are two similar applications which generate data sets and process them for etl and product recommendations which we are curating in Apache bigtop.



> On Aug 17, 2015, at 6:33 PM, Publius <t_...@yahoo.com> wrote:
> 
> Hello
> 
> what is the difference between Hadoop and Spark?
> 
> How is Spark better? 
> 

Re: spark

Posted by Jay Vyas <ja...@gmail.com>.
For a start compare sparks word count with mapreduce word count.

Then compare sparksql with hive.

If you get that far for the final exersize, Find out for yourself by running bigpetstore-mapreduce and bigpetstore-spark side by side :).  They are two similar applications which generate data sets and process them for etl and product recommendations which we are curating in Apache bigtop.



> On Aug 17, 2015, at 6:33 PM, Publius <t_...@yahoo.com> wrote:
> 
> Hello
> 
> what is the difference between Hadoop and Spark?
> 
> How is Spark better? 
> 

Re: spark

Posted by Jay Vyas <ja...@gmail.com>.
For a start compare sparks word count with mapreduce word count.

Then compare sparksql with hive.

If you get that far for the final exersize, Find out for yourself by running bigpetstore-mapreduce and bigpetstore-spark side by side :).  They are two similar applications which generate data sets and process them for etl and product recommendations which we are curating in Apache bigtop.



> On Aug 17, 2015, at 6:33 PM, Publius <t_...@yahoo.com> wrote:
> 
> Hello
> 
> what is the difference between Hadoop and Spark?
> 
> How is Spark better? 
>