[jira] [Comment Edited] (BIGTOP-1535) Add Spark ETL script to BigPetStore

["jay vyas (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221450#comment-14221450 ] 

jay vyas edited comment on BIGTOP-1535 at 11/21/14 9:20 PM:
------------------------------------------------------------

yup ! i can fix in the commit . 

also id suggest (just a suggestion)that  in general its betterto  consolidate some of these commits where possible (i.e. maybe one bps patch per day) - since from bigtops perspective petstore updates dont need to be super granular.

this is great work i will review this tonite also


was (Author: jayunit100):
yup ! i can fix in the commit . 

also id suggest (just a suggestion)that  in general its betterto  consolidate some of these commits where possible - since from bigtops perspective petstore updates dont need to be super granular.

this is great work i will review this tonite also

> Add Spark ETL script to BigPetStore
> -----------------------------------
>
>                 Key: BIGTOP-1535
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1535
>             Project: Bigtop
>          Issue Type: Sub-task
>          Components: blueprints
>            Reporter: RJ Nowling
>            Assignee: RJ Nowling
>         Attachments: bps_spark_etl.patch
>
>
> We should add script that reads the results from the data generator and normalizes the data and splits it into separate tables (ETL).  It would be nice to use Spark SQL but it is not required.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)