You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@incubator.apache.org by Sharad Agarwal <sh...@apache.org> on 2014/10/06 13:51:41 UTC
[VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Following the discussion earlier in the thread
https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
I would like to call a Vote for accepting Lens as a new incubator project.
The proposal is available at:
https://wiki.apache.org/incubator/LensProposal
Vote is open till Oct 09, 2014 4 PM PST.
[ ] +1 accept Lens in the Incubator
[ ] +/-0
[ ] -1 because...
Only Votes from Incubator PMC members are binding, but all are welcome to
express their thoughts.
I am +1 (non-binding).
Thanks
Sharad
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Tx for starting this, Sharad!
+1, binding.
Thanks,
+Vinod
On Oct 6, 2014, at 4:51 AM, Sharad Agarwal <sh...@apache.org> wrote:
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
>
> Thanks
> Sharad
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Suresh Srinivas <su...@hortonworks.com>.
+1 (binding)
Sent from phone
> On Oct 8, 2014, at 12:20 PM, Joe Brockmeier <jz...@zonker.net> wrote:
>
>> On Mon, Oct 6, 2014, at 06:51 AM, Sharad Agarwal wrote:
>> [ ] +1 accept Lens in the Incubator
>
> +1 (binding)
>
> Best,
>
> jzb
> --
> Joe Brockmeier
> jzb@zonker.net
> Twitter: @jzb
> http://www.dissociatedpress.net/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Joe Brockmeier <jz...@zonker.net>.
On Mon, Oct 6, 2014, at 06:51 AM, Sharad Agarwal wrote:
> [ ] +1 accept Lens in the Incubator
+1 (binding)
Best,
jzb
--
Joe Brockmeier
jzb@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by sebb <se...@gmail.com>.
It looks like the version [1] of the Wiki page that was active at the
time of the vote was:
https://wiki.apache.org/incubator/LensProposal?rev=4
[1] https://wiki.apache.org/incubator/LensProposal?action=info
For the record, the current contents of that version are appended below:
-------------- cut here ------------
Lens
Abstract
Lens is a platform that enables multi-dimensional queries in a unified
way over datasets stored in multiple warehouses. Lens integrates
Apache Hive with other data warehouses by tiering them together to
form logical data cubes.
Proposal
Lens provides a unified Cube abstraction for data stored in different
stores. Lens tiers multiple data warehouses for unified representation
and efficient access. It provides SQL-like Cube query language to
query and describe data sets organized in data cubes. It enables users
to run queries against Facts and Dimensions that can span multiple
physical tables stored in different stores.
The primary use cases that Lens aims to solve:
Facilitate analytical queries by providing the OLAP like Cube abstraction
Data Discovery by providing single metadata layer for data stored in
different stores
Unified access to data by integrating Hive with other traditional data
warehouses
Background
Apache Hive is a data warehouse that facilitates querying and managing
large datasets stored in distributed storage systems like HDFS. It
provides SQL like language called HiveQL aka HQL. Apache Hive is a
widely used platform in various organizations for doing adhoc
analytical queries. In a typical Data warehouse scenario, the data is
multi-dimensional and organized into Facts and Dimensions to form Data
Cubes. Lens provides this logical layer to enable querying and manage
data as Cubes. The Lens project is actively being developed at InMobi
to provide the higher level of analytical abstraction to query data
stored in different storages including Hive and beyond seamlessly.
Rationale
The Lens project aims to ease the analytical querying capabilities and
cut the data-silos by providing a single view of data across multiple
data stores. Conceiving data as a cube with hierarchical dimensions
leads to conceptually straightforward operations to facilitate
analysis. Integrating Apache Hive with other traditional warehouses
provides the opportunity to optimize on the query execution cost by
tiering the data across multiple warehouses. Lens provides
Access to data Cubes via Cube Query language similar to HiveQL.
Driver based architecture to allow for plugging systems like Hive and
other warehouses such as columnar data RDBMS.
Cost based engine selection that provides optimal use of resources by
selecting the best execution engine for a given query.
In a typical Data warehouse, data is organized in Cubes with multiple
dimensions and measures. This facilitates the analysis by conceiving
the data in terms of Facts and Dimensions instead of physical tables.
Lens aims to provide this logical Cube abstraction on Data warehouses
like Hive and other traditional warehouses.
Initial Goals
Donate the Lens source code and documentation to Apache Software Foundation
Build a user and developer community
Support Hive and other Columnar data warehouses
Support full query life cycle management
Add authentication for querying cubes
Provide detailed query statistics
Long Term Goals
Here are some longer-term capabilities that would be added to Lens
Add authorization for managing and querying Cubes
Provide REST and CLI for full Admin controls
Capability to schedule queries
Query caching
Integrate with Apache Spark. Creating Spark RDD from Lens query
Integrate with Apache Optiq
Current Status
The project is actively developed at InMobi. The first version is
deployed at InMobi 4 months back. This version allows querying
dimension and fact data stored in Hive over CLI. The source code and
documentation is hosted at GitHub.
Meritocracy
We intend to build a diverse developer and user community for the
project following the Apache meritocracy model. We want to encourage
contributors from multiple organizations, provide plenty of support to
new developers and welcome them to be committers.
Community
Currently the project is being developed at InMobi. We hope to extend
our contributor and user base significantly in the future and build a
solid open source community around Lens. Core Developers Lens is
currently being developed by Amareshwari Sriramadasu, Sharad Agarwal
and Jaideep Dhok from InMobi, and Sreekanth Ramakrishnan who is
currently employed by SoftwareAG. Raghavendra Singh from InMobi has
built the QA automation for Lens.
Alignment
The ASF is a natural home to Lens as it is for Apache Hadoop, Apache
Hive, Apache Spark and other emerging projects in Big Data space. We
believe in any enterprise, multiple data warehouses will co-exist, as
not all workloads are cost effective to run on single one. Apache Hive
is one of the crucial data warehouse along with upcoming projects like
Apache Spark in Hadoop ecosystem. Lens will benefit in working in
close proximity with these projects. The traditional Columnar data
warehouses complement Apache Hive as certain workloads continue to be
cost effective to run in traditional columnar data warehouses. Having
multiple data warehouses leads to data silos that Lens aims to cut
within the enterprise and provide a holistic unified access to data.
Known Risks
Orphaned products & Reliance on Salaried Developers
There is little risk of Lens getting orphaned, as Lens is key part of
the Data Platform stack at InMobi. The core Lens developers plan to
work on it full-time. We think Lens will bring value in the Big Data
space and we plan to grow the community of users and contributors.
Inexperience with Open Source
All the core developers have long and significant experience in Apache
projects and Hadoop ecosystem. Amareshwari Sriramadasu has long
standing contributions to Apache Hadoop MapReduce and Apache Hive, she
being PMC member of Hadoop and a committer of Hive. Sharad Agarwal is
a PMC member of Hadoop and contributed to Hadoop YARN and Hadoop
MapReduce. Srikanth Sundarrajan is a PMC member of Apache Falcon.
Sreekanth Ramakrishnan is committer of Apache Hadoop. Jaideep Dhok has
contributed patches to Apache Hive. Gunther is a PMC member of Apache
Hive. Vikram is a committer of Apache Hive.
Homogeneous Developers
The initial developers are employed by Hortonworks, InMobi and
SoftwareAG. We are committed to recruiting additional committers from
other companies based on their contribution to the project.
Reliance on Salaried Developers
The majority of initial committers are paid by their employee to
contribute to the project and few are contributing in their spare
time. Once the project has a community built, we are committed to
recruit committers and developers from outside the current core
developers.
Relationships with Other Apache Products
Lens is deeply integrated with other Apache projects. Lens uses and
extends Apache Hive HCatalog to store and manage the Data cubes. It
uses HDFS and Hive session management libraries. Lens has the
driver-based architecture that allows for adding multiple execution
drivers. Apart from integrating Apache Hive, it can be integrated with
Apache Spark over Spark SQL or Shark, Apache Drill, Apache Tajo and
Apache Phoenix. In future we want to use Apache Optiq in Lens for
query optimization and cost based driver selection.
An Excessive Fascination with the Apache Brand
The project is conceived from beginning to be in line with the Apache
philosophy. As the core developers have good experience with Apache,
the source code organization, build, review and commit process are
highly influenced by Apache. We believe that Apache will be a solid
home for Lens to grow and build the open source community. We have
also described the reasons in the Rationale and Alignment sections.
Documentation
http://inmobi.github.io/grill/
Initial Source
The source is currently in github repository at: https://github.com/inmobi/grill
Source and Intellectual Property Submission Plan
The complete Lens code is already under Apache Software License 2.
External Dependencies
The dependencies all have Apache compatible licenses. These include
Apache 2.0, BSD, MIT, EPL and CDDL licensed dependencies.
Cryptography
None
Required Resources
Mailing lists
lens-dev AT incubator DOT apache DOT org
lens-commits AT incubator DOT apache DOT org
lens-private AT incubator DOT apache DOT org
Subversion Directory
Git is the preferred source control system: git:// git.apache.org/incubator-lens
Issue Tracking
JIRA Lens (LENS)
Initial Committers
Amareshwari Sriramadasu (amareshwari AT apache DOT org)
Gunther Hagleitner (gunther AT apache DOT org)
Jaideep Dhok (jaideep.dhok AT Inmobi DOT com)
Raghavendra Singh (raghavendra.singh AT Inmobi DOT com)
Sharad Agarwal (sharad AT apache DOT org)
Sreekanth Ramakrishnan (sreekanth AT apache DOT org)
Srikanth Sundarrajan (sriksun AT apache DOT org)
Suma Shivaprasad (suma.shivaprasad AT Inmobi DOT com)
Vikram Dixit (vikram AT apache DOT org)
Affiliations
Amareshwari SR (InMobi)
Gunther Hagleitner (Hortonworks)
Jaideep Dhok (InMobi)
Raghavendra Singh (InMobi)
Sharad Agarwal (InMobi)
Sreekanth Ramakrishnan (SoftwareAG)
Srikanth Sundarrajan (InMobi)
Suma Shivaprasad (InMobi)
Vikram Dixit (Hortonworks)
Sponsors
Champion
Vinod K <vinodkv AT apache DOT org> (Apache Member)
Nominated Mentors
Chris Douglas (Microsoft)
Jacob Homan (Microsoft)
Jean Baptiste Onofre (Talend)
Vinod K (Hortonworks)
Sponsoring Entity
Incubator PMC
LensProposal (last edited 2014-09-23 08:22:15 by AmareshwariSriramadasu)
-------------- cut here ------------
On 6 October 2014 12:51, Sharad Agarwal <sh...@apache.org> wrote:
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
>
> Thanks
> Sharad
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Amareshwari Sriramdasu <am...@apache.org>.
+1
Thanks
Amareshwari
On Mon, Oct 6, 2014 at 9:10 PM, Jakob Homan <jg...@gmail.com> wrote:
> +1 (binding)
>
> On Mon, Oct 6, 2014 at 6:59 AM, Alan D. Cabrera <li...@toolazydogs.com>
> wrote:
>
> > +1 - binding
> >
> >
> > Regards,
> > Alan
> >
> > On Oct 6, 2014, at 4:51 AM, Sharad Agarwal <sh...@apache.org> wrote:
> >
> > > Following the discussion earlier in the thread
> > >
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> > > I would like to call a Vote for accepting Lens as a new incubator
> > project.
> > >
> > > The proposal is available at:
> > > https://wiki.apache.org/incubator/LensProposal
> > >
> > > Vote is open till Oct 09, 2014 4 PM PST.
> > >
> > > [ ] +1 accept Lens in the Incubator
> > > [ ] +/-0
> > > [ ] -1 because...
> > >
> > > Only Votes from Incubator PMC members are binding, but all are welcome
> to
> > > express their thoughts.
> > > I am +1 (non-binding).
> > >
> > > Thanks
> > > Sharad
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Jakob Homan <jg...@gmail.com>.
+1 (binding)
On Mon, Oct 6, 2014 at 6:59 AM, Alan D. Cabrera <li...@toolazydogs.com>
wrote:
> +1 - binding
>
>
> Regards,
> Alan
>
> On Oct 6, 2014, at 4:51 AM, Sharad Agarwal <sh...@apache.org> wrote:
>
> > Following the discussion earlier in the thread
> > https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> > I would like to call a Vote for accepting Lens as a new incubator
> project.
> >
> > The proposal is available at:
> > https://wiki.apache.org/incubator/LensProposal
> >
> > Vote is open till Oct 09, 2014 4 PM PST.
> >
> > [ ] +1 accept Lens in the Incubator
> > [ ] +/-0
> > [ ] -1 because...
> >
> > Only Votes from Incubator PMC members are binding, but all are welcome to
> > express their thoughts.
> > I am +1 (non-binding).
> >
> > Thanks
> > Sharad
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by "Alan D. Cabrera" <li...@toolazydogs.com>.
+1 - binding
Regards,
Alan
On Oct 6, 2014, at 4:51 AM, Sharad Agarwal <sh...@apache.org> wrote:
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
>
> Thanks
> Sharad
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Mon, Oct 6, 2014 at 4:51 AM, Sharad Agarwal <sh...@apache.org> wrote:
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
+1 (binding)
Thanks,
Roman.
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Seetharam Venkatesh <ve...@innerzeal.com>.
+1 (non-binding).
Thanks!
On Mon, Oct 6, 2014 at 10:05 AM, Chris Douglas <cd...@apache.org> wrote:
> +1 (binding) -C
>
> On Mon, Oct 6, 2014 at 4:51 AM, Sharad Agarwal <sh...@apache.org> wrote:
> > Following the discussion earlier in the thread
> > https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> > I would like to call a Vote for accepting Lens as a new incubator
> project.
> >
> > The proposal is available at:
> > https://wiki.apache.org/incubator/LensProposal
> >
> > Vote is open till Oct 09, 2014 4 PM PST.
> >
> > [ ] +1 accept Lens in the Incubator
> > [ ] +/-0
> > [ ] -1 because...
> >
> > Only Votes from Incubator PMC members are binding, but all are welcome to
> > express their thoughts.
> > I am +1 (non-binding).
> >
> > Thanks
> > Sharad
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
--
Regards,
Venkatesh
“Perfection (in design) is achieved not when there is nothing more to add,
but rather when there is nothing more to take away.”
- Antoine de Saint-Exupéry
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Chris Douglas <cd...@apache.org>.
+1 (binding) -C
On Mon, Oct 6, 2014 at 4:51 AM, Sharad Agarwal <sh...@apache.org> wrote:
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
>
> Thanks
> Sharad
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called
Grill)
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
+1 (binding)
Regards
JB
On 10/06/2014 01:51 PM, Sharad Agarwal wrote:
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
>
> Thanks
> Sharad
>
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by jan i <ja...@apache.org>.
On Oct 6, 2014 1:51 PM, "Sharad Agarwal" <sh...@apache.org> wrote:
>
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
+1 binding.
Jan i
>
> Thanks
> Sharad
Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
Posted by Ashish <pa...@gmail.com>.
+1 (non-binding)
On Mon, Oct 6, 2014 at 5:21 PM, Sharad Agarwal <sh...@apache.org> wrote:
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
>
> Thanks
> Sharad
>
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal
RE: [VOTE] Accept Lens into the Apache Incubator (earlier called
Grill)
Posted by Srikanth Sundarrajan <sr...@hotmail.com>.
+1 (non-binding)
Srikanth Sundarrajan
> Date: Mon, 6 Oct 2014 17:21:41 +0530
> Subject: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
> From: sharad@apache.org
> To: general@incubator.apache.org
>
> Following the discussion earlier in the thread
> https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
> I would like to call a Vote for accepting Lens as a new incubator project.
>
> The proposal is available at:
> https://wiki.apache.org/incubator/LensProposal
>
> Vote is open till Oct 09, 2014 4 PM PST.
>
> [ ] +1 accept Lens in the Incubator
> [ ] +/-0
> [ ] -1 because...
>
> Only Votes from Incubator PMC members are binding, but all are welcome to
> express their thoughts.
> I am +1 (non-binding).
>
> Thanks
> Sharad