Re: release announcement + thinking about demos

[Jignesh Patel <jm...@gmail.com>]

Great idea Marc about making an announcement. And a big CONGRATULATIONS to you, the team and our mentors for getting us here. This is a huge accomplishment!!

Building on Harshad’s idea for a terse description, how about: High performance auto-managed SQL data processing platform that can be used in a variety of settings, including serverless frameworks. 

IMHO, I think the self-managed/zero-knobs approach aspect of Quickstep is quite timely given the next evolution beyond traditional micro-services (which really never did data quite right). We need to emphasize it more centrally going forward, I think. 

More concretely, I’m wondering if it might make sense to put a demo together with Airflow or TensorFlow to highlight this aspect of Quickstep. We can pick a general-purpose programming language, such as Python, and generate a simple API to Quickstep from that language. The serverless nature of Quickstep means there is zero configuration needed. This is sweet for rapid prototyping, and even more. 

Assuming we have a Python API (both TensorFlow and Airflow are friendly to this API), we can think of building a data workflow that has some aspect of data ingest, cleaning, selecting/subsetting, and model building. Quickstep could be used in the data-heavy portions. 

What would be so cool about this demo? Imagine the data is stored in a cloud file system. Load up this workflows in a container and it works without any database configuration (you can’t get that with any other data platform that I can think of). Want to upgrade? Simply spin up a container with more resources, rerun the pipeline. Quickstep auto-detects, auto-scales, and does not require any parameter tuning. Zero knobs is ideal for such deployments that I think are crucial, and not just for “toy” settings. Today you can go get a 64core boxes with TB memory for about a dollar/hour (if you allow pre-emption). You can do a lot in that box, and Quickstep can help. 

I think a few demos may get more people interested in Quickstep. Comments? Other ideas? 

Cheers,
Jignesh 

On 3/25/17, 10:07 AM, "Harshad Deshmukh" <ha...@cs.wisc.edu> wrote:

    Hi Marc,
    
    I don't know about the Apache protocol, so may be the mentors may have something to say about that.
    
    How about saying high performance,  relational data processing engine developed in C++?
    
    The release is very exciting! I will start another thread regarding publicity of the release.
    
    Sent from Outlook for Android
    
    
    From: Marc Spehlmann
    Sent: Saturday, March 25, 9:57 AM
    Subject: release announcement
    To: dev@quickstep.incubator.apache.org
    
    Hello quickstep, I am going to send an announce email to a few of the other apache lists later today. Is there anything special about this release that we want to mention (besides that it's our first release)? If not, that's fine, I will send this email: ___ The Apache Quickstep (incubating) team is pleased to announce the release of Quickstep 0.1.0 (our very first release!) Quickstep is a high-performance C++ SQL database. The release is available at: https://quickstep.incubator.apache.org/release Thank you, The Apache Quickstep (incubating) team ___ --Marc
    

Re: release announcement + thinking about demos

[Marc Spehlmann <sp...@gmail.com>]

I think the terse description is good. Though if we want to use
'serverless', I think it might be good to have a demo or a blog post
describing how it's used that way. (maybe we do already -- I know Hakan was
using openLambda at one point w/ qs).

__

The demo idea sounds cool. Quickstep can run benchmarks really really fast,
but I think you're right in that having a demo with a use case that would
convince users  of QS's other uses would be good for adoption. Especially
if the serverless community is lacking a relational database.



On Sat, Mar 25, 2017 at 5:02 PM, Jignesh Patel <jm...@gmail.com>
wrote:

> Great idea Marc about making an announcement. And a big CONGRATULATIONS to
> you, the team and our mentors for getting us here. This is a huge
> accomplishment!!
>
> Building on Harshad’s idea for a terse description, how about: High
> performance auto-managed SQL data processing platform that can be used in a
> variety of settings, including serverless frameworks.
>
> IMHO, I think the self-managed/zero-knobs approach aspect of Quickstep is
> quite timely given the next evolution beyond traditional micro-services
> (which really never did data quite right). We need to emphasize it more
> centrally going forward, I think.
>
> More concretely, I’m wondering if it might make sense to put a demo
> together with Airflow or TensorFlow to highlight this aspect of Quickstep.
> We can pick a general-purpose programming language, such as Python, and
> generate a simple API to Quickstep from that language. The serverless
> nature of Quickstep means there is zero configuration needed. This is sweet
> for rapid prototyping, and even more.
>
> Assuming we have a Python API (both TensorFlow and Airflow are friendly to
> this API), we can think of building a data workflow that has some aspect of
> data ingest, cleaning, selecting/subsetting, and model building. Quickstep
> could be used in the data-heavy portions.
>
> What would be so cool about this demo? Imagine the data is stored in a
> cloud file system. Load up this workflows in a container and it works
> without any database configuration (you can’t get that with any other data
> platform that I can think of). Want to upgrade? Simply spin up a container
> with more resources, rerun the pipeline. Quickstep auto-detects,
> auto-scales, and does not require any parameter tuning. Zero knobs is ideal
> for such deployments that I think are crucial, and not just for “toy”
> settings. Today you can go get a 64core boxes with TB memory for about a
> dollar/hour (if you allow pre-emption). You can do a lot in that box, and
> Quickstep can help.
>
> I think a few demos may get more people interested in Quickstep. Comments?
> Other ideas?
>
> Cheers,
> Jignesh
>
> On 3/25/17, 10:07 AM, "Harshad Deshmukh" <ha...@cs.wisc.edu> wrote:
>
>     Hi Marc,
>
>     I don't know about the Apache protocol, so may be the mentors may have
> something to say about that.
>
>     How about saying high performance,  relational data processing engine
> developed in C++?
>
>     The release is very exciting! I will start another thread regarding
> publicity of the release.
>
>     Sent from Outlook for Android
>
>
>     From: Marc Spehlmann
>     Sent: Saturday, March 25, 9:57 AM
>     Subject: release announcement
>     To: dev@quickstep.incubator.apache.org
>
>     Hello quickstep, I am going to send an announce email to a few of the
> other apache lists later today. Is there anything special about this
> release that we want to mention (besides that it's our first release)? If
> not, that's fine, I will send this email: ___ The Apache Quickstep
> (incubating) team is pleased to announce the release of Quickstep 0.1.0
> (our very first release!) Quickstep is a high-performance C++ SQL database.
> The release is available at: https://quickstep.incubator.
> apache.org/release Thank you, The Apache Quickstep (incubating) team ___
> --Marc
>
>
>
>