You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by Saksham Srivastava <sa...@outlook.com> on 2017/10/09 14:15:28 UTC

Building a query service using Zeppelin

Hi,


We have been evaluating Zeppelin to develop a programmatic(API-driven) universal query execution platform.

A platform which can:

  *   Accept and validate any query (spark-sql, sql, hive, elastic-search etc)
  *   Run the query
  *   Track the status
  *   Stop the query.
  *   Also, support multiple queries and workflow.

We evaluated quite a few frameworks and then finally chose Zeppelin over others considering:

  *   Zeppelin is an ASF project.
  *   The community is lively and helpful.
  *   The API driven approach of Zeppelin which will help mashup more APIs and create pipelines.

We would like to contribute more to Zeppelin by contributing code, raising and fixing issues and adding more APIs and interpreters.

What does the community think of this, please feel forward to reply with suggestions or questions.


Thanks,

Saksham

Re: Zeppelin 0.8 ETA

Posted by Jeff Zhang <zj...@gmail.com>.

I just send out the RC vote mail, please help verify it, thanks



<te...@yahoo.com.invalid>于2018年5月9日周三 上午7:24写道：

> Hi All
>
> Please let me know the release date of the apache zeppelin 0.8.
>
> P.S. The website shows it is still in development.
>
> Thanks
> Denny
>

Re: Zeppelin 0.8 ETA

Posted by te...@yahoo.com.INVALID.

Hi All

Please let me know the release date of the apache zeppelin 0.8.

P.S. The website shows it is still in development.

Thanks
Denny

Re: Building a query service using Zeppelin

Posted by Saksham Srivastava <sa...@outlook.com>.

Hi Moon,

Thanks for the feedback. I have published a blog on how we built the entire system.

https://medium.com/media-iq-tech/how-we-built-a-universal-query-execution-engine-using-zeppelin-part-1-1640d9928a48

Thanks,

Saksham

________________________________
From: moon soo Lee <mo...@apache.org>
Sent: Monday, October 9, 2017 11:17:12 PM
To: dev@zeppelin.apache.org
Subject: Re: Building a query service using Zeppelin

Hi Saksham,

Thanks for sharing your plan.
Programmatic universal query execution platform sounds interesting.

I saw a lot of users use Zeppelin with various SQL backends.
Your plan definitely looks like help many other users, too. If i can add
few more idea

* Search available table, columns
* Preview table contents
* Table level, column level, row level access control

Those are some feedbacks and requests from Zeppelin users i met, who have
SQL backends. Technical point of view, query syntax are different in each
SQL backends. So to provide features above, need to leverage ORM (e.g.
hibernate), probably.

Thanks,
moon

On Mon, Oct 9, 2017 at 7:15 AM Saksham Srivastava <sa...@outlook.com>
wrote:

> Hi,
>
>
> We have been evaluating Zeppelin to develop a programmatic(API-driven)
> universal query execution platform.
>
> A platform which can:
>
>   *   Accept and validate any query (spark-sql, sql, hive, elastic-search
> etc)
>   *   Run the query
>   *   Track the status
>   *   Stop the query.
>   *   Also, support multiple queries and workflow.
>
> We evaluated quite a few frameworks and then finally chose Zeppelin over
> others considering:
>
>   *   Zeppelin is an ASF project.
>   *   The community is lively and helpful.
>   *   The API driven approach of Zeppelin which will help mashup more APIs
> and create pipelines.
>
> We would like to contribute more to Zeppelin by contributing code, raising
> and fixing issues and adding more APIs and interpreters.
>
> What does the community think of this, please feel forward to reply with
> suggestions or questions.
>
>
> Thanks,
>
> Saksham
>

Re: Building a query service using Zeppelin

Posted by moon soo Lee <mo...@apache.org>.

Hi Saksham,

Thanks for sharing your plan.
Programmatic universal query execution platform sounds interesting.

I saw a lot of users use Zeppelin with various SQL backends.
Your plan definitely looks like help many other users, too. If i can add
few more idea

* Search available table, columns
* Preview table contents
* Table level, column level, row level access control

Those are some feedbacks and requests from Zeppelin users i met, who have
SQL backends. Technical point of view, query syntax are different in each
SQL backends. So to provide features above, need to leverage ORM (e.g.
hibernate), probably.

Thanks,
moon

On Mon, Oct 9, 2017 at 7:15 AM Saksham Srivastava <sa...@outlook.com>
wrote:

> Hi,
>
>
> We have been evaluating Zeppelin to develop a programmatic(API-driven)
> universal query execution platform.
>
> A platform which can:
>
>   *   Accept and validate any query (spark-sql, sql, hive, elastic-search
> etc)
>   *   Run the query
>   *   Track the status
>   *   Stop the query.
>   *   Also, support multiple queries and workflow.
>
> We evaluated quite a few frameworks and then finally chose Zeppelin over
> others considering:
>
>   *   Zeppelin is an ASF project.
>   *   The community is lively and helpful.
>   *   The API driven approach of Zeppelin which will help mashup more APIs
> and create pipelines.
>
> We would like to contribute more to Zeppelin by contributing code, raising
> and fixing issues and adding more APIs and interpreters.
>
> What does the community think of this, please feel forward to reply with
> suggestions or questions.
>
>
> Thanks,
>
> Saksham
>