You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hawq.apache.org by Ed Espino <es...@apache.org> on 2017/03/31 18:04:49 UTC
DRAFT: ASF HAWQ Incubator PMC report for April 2017
Team HAWQ,
Below is the draft ASF HAWQ Incubator PMC report for April 2017, covering
Q1 2017 activity.
It is posted at http://wiki.apache.org/incubator/April2017
Please let me know if you have any comments or suggestions and I will update
the report.
Regards,
-=e
--
*Ed Espino*
--------------------
HAWQ
Apache HAWQ is a Hadoop native SQL query engine that combines the key
technological advantages of MPP database with the scalability and
convenience
of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
delivers industry-leading performance and linear scalability. It provides
users the tools to confidently and successfully interact with petabyte range
data sets. HAWQ provides users with a complete, standards compliant SQL
interface.
HAWQ has been incubating since 2015-09-04.
Three most important issues to address in the move towards graduation:
1. Continue to improve the project's release cadence. To this end we
plan on expanding automation services to support increased
developer participation.
2. Continue to expand the community, by adding new contributors and
focusing on making sure that there's a much more robust level of
conversations and discussions happening around roadmaps and
feature development on the public dev mailing list.
3. Expand release artifacts to include the delivery of binary
artifacts. We expect the project to significantly refine the
binary release process in several key areas.
Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
1. Nothing urgent at this time.
How has the community developed since the last report?
1. Two Meetups took place in Beijing, China:
* HAWQ Meetup (January 123, 2017)
- HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
Engineer
- HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
- Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
Senior Engineer
* HAWQ Meetup (March 23, 2017)
- Apache HAWQ Exploration Step by Step - Configuration, Build,
Deployment and Debug by Xiang Sheng, Pivotal Software
Engineer
- Transaction Management in Apache HAWQ by Ming Li, Pivotal
Senior Software Engineer
- Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
Database Expert in Alibaba Cloud
2. A significant push by the dev community has been made to review
and merge the project's Pull Requests (PR). As of March 30, 2017,
eight of the nine open PRs have been opened in the last ten
days. The PR opened on Sep 2016 is targeted to be merged after
the Apache 2.2.0.0 release.
3. Recent porting efforts:
- Persistent Systems Engineers are actively engaging the dev
community on their HAWQ porting efforts to RHEL 7.1 on S390
platform.
- Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
published on dev list.
4. Ruilong Huo has volunteered to be the Release Manager (RM) for
the upcoming 2.2.0.0 release
How has the project developed since the last report?
1. Apache HAWQ 2.1.0.0 (source code only) has been released.
2. Apache HAWQ 2.2.0.0 release proposed (source code and first
binary release). This is the 3rd release as an incubating
project.
Release page:
https://cwiki.apache.org/confluence/display/HAWQ/Apache+HAWQ+2.2.0.0-incubating+Release
Release hightlights:
* CentOS 7.x Support
* Ranger Integration
* PXF ORC Profile
* Bug Fixes
3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
member) is publishing (to dev email list) a regular HAWQ Graduation
update for the
project.
* HAWQ graduation update (January, 17, 2017)
https://lists.apache.org/thread.html/cd37e2b48d4bbc9fe4a9cea47f8247a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
* Apache HAWQ graduation update (Mar 1st, 2017)
https://lists.apache.org/thread.html/3a1e454f8c706dd71b1690c3ae74a157ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
4. The Apache HAWQ website has been updated to provide clearer
access to download release artifacts.
How would you assess the podling's maturity?
Please feel free to add your own commentary.
[ ] Initial setup
[ ] Working towards first release
[X] Community building
[X] Nearing graduation
[ ] Other:
Date of last release:
2017-02-28
When were the last committers or PMC members elected?
Podling committers (3) added:
Lisa Owen: January 31, 2017
Jane Beckman: February 1, 2017
Kyle Dunn: March 2, 2017
PPMC member (1) added:
Paul Guo: March 10, 2017
Signed-off-by:
[ ](hawq) Alan Gates
Comments:
[ ](hawq) Konstantin Boudnik
Comments:
[ ](hawq) Justin Erenkrantz
Comments:
[ ](hawq) Thejas Nair
Comments:
[ ](hawq) Roman Shaposhnik
Comments:
IPMC/Shepherd notes:
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
I'd like to a quick moment to thank all HAWQ community members that
provided feedback on the Apache HAWQ Incubator April 2017 report
<https://wiki.apache.org/incubator/April2017>. YOU ARE SIMPLY THE BEST!!!
-=e
On Fri, Mar 31, 2017 at 11:04 AM, Ed Espino <es...@apache.org> wrote:
> Team HAWQ,
>
> Below is the draft ASF HAWQ Incubator PMC report for April 2017, covering
> Q1 2017 activity.
>
> It is posted at http://wiki.apache.org/incubator/April2017
>
> Please let me know if you have any comments or suggestions and I will update
> the report.
>
> Regards,
> -=e
>
> --
> *Ed Espino*
>
>
> --------------------
> HAWQ
>
> Apache HAWQ is a Hadoop native SQL query engine that combines the key
> technological advantages of MPP database with the scalability and
> convenience
> of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> delivers industry-leading performance and linear scalability. It provides
> users the tools to confidently and successfully interact with petabyte
> range
> data sets. HAWQ provides users with a complete, standards compliant SQL
> interface.
>
> HAWQ has been incubating since 2015-09-04.
>
> Three most important issues to address in the move towards graduation:
>
> 1. Continue to improve the project's release cadence. To this end we
> plan on expanding automation services to support increased
> developer participation.
>
> 2. Continue to expand the community, by adding new contributors and
> focusing on making sure that there's a much more robust level of
> conversations and discussions happening around roadmaps and
> feature development on the public dev mailing list.
>
> 3. Expand release artifacts to include the delivery of binary
> artifacts. We expect the project to significantly refine the
> binary release process in several key areas.
>
> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> aware of?
>
> 1. Nothing urgent at this time.
>
> How has the community developed since the last report?
>
> 1. Two Meetups took place in Beijing, China:
>
> * HAWQ Meetup (January 123, 2017)
>
> - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> Engineer
> - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> Senior Engineer
>
> * HAWQ Meetup (March 23, 2017)
>
> - Apache HAWQ Exploration Step by Step - Configuration, Build,
> Deployment and Debug by Xiang Sheng, Pivotal Software
> Engineer
> - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> Senior Software Engineer
> - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> Database Expert in Alibaba Cloud
>
> 2. A significant push by the dev community has been made to review
> and merge the project's Pull Requests (PR). As of March 30, 2017,
> eight of the nine open PRs have been opened in the last ten
> days. The PR opened on Sep 2016 is targeted to be merged after
> the Apache 2.2.0.0 release.
>
> 3. Recent porting efforts:
>
> - Persistent Systems Engineers are actively engaging the dev
> community on their HAWQ porting efforts to RHEL 7.1 on S390
> platform.
>
> - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> published on dev list.
>
> 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> the upcoming 2.2.0.0 release
>
> How has the project developed since the last report?
>
> 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>
> 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> binary release). This is the 3rd release as an incubating
> project.
>
> Release page:
>
> https://cwiki.apache.org/confluence/display/HAWQ/
> Apache+HAWQ+2.2.0.0-incubating+Release
>
> Release hightlights:
>
> * CentOS 7.x Support
> * Ranger Integration
> * PXF ORC Profile
> * Bug Fixes
>
> 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> member) is publishing (to dev email list) a regular HAWQ Graduation
> update for the
> project.
>
> * HAWQ graduation update (January, 17, 2017)
> https://lists.apache.org/thread.html/cd37e2b48d4bbc9fe4a9cea47f8247
> a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>
> * Apache HAWQ graduation update (Mar 1st, 2017)
> https://lists.apache.org/thread.html/3a1e454f8c706dd71b1690c3ae74a1
> 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>
> 4. The Apache HAWQ website has been updated to provide clearer
> access to download release artifacts.
>
> How would you assess the podling's maturity?
> Please feel free to add your own commentary.
>
> [ ] Initial setup
> [ ] Working towards first release
> [X] Community building
> [X] Nearing graduation
> [ ] Other:
>
> Date of last release:
>
> 2017-02-28
>
> When were the last committers or PMC members elected?
>
> Podling committers (3) added:
> Lisa Owen: January 31, 2017
> Jane Beckman: February 1, 2017
> Kyle Dunn: March 2, 2017
>
> PPMC member (1) added:
> Paul Guo: March 10, 2017
>
> Signed-off-by:
>
> [ ](hawq) Alan Gates
> Comments:
> [ ](hawq) Konstantin Boudnik
> Comments:
> [ ](hawq) Justin Erenkrantz
> Comments:
> [ ](hawq) Thejas Nair
> Comments:
> [ ](hawq) Roman Shaposhnik
> Comments:
>
> IPMC/Shepherd notes:
>
>
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Vineet Goel <vv...@apache.org>.
Looks great !
On Fri, Mar 31, 2017 at 9:17 PM Ed Espino <es...@apache.org> wrote:
> Ruilong,
>
> Thanks buddy. January 123!!! :) a typo indeed. I have updated the report.
>
> -=e
>
> On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>
> > Hi Ed,
> >
> > One typo is that HAWQ Meetup is on January 12, 2017.
> >
> > Best regards,
> > Ruilong Huo
> >
> > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
> >
> > > Team HAWQ,
> > >
> > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
> covering
> > > Q1 2017 activity.
> > >
> > > It is posted at http://wiki.apache.org/incubator/April2017
> > >
> > > Please let me know if you have any comments or suggestions and I will
> > update
> > > the report.
> > >
> > > Regards,
> > > -=e
> > >
> > > --
> > > *Ed Espino*
> > >
> > >
> > > --------------------
> > > HAWQ
> > >
> > > Apache HAWQ is a Hadoop native SQL query engine that combines the key
> > > technological advantages of MPP database with the scalability and
> > > convenience
> > > of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> > > delivers industry-leading performance and linear scalability. It
> provides
> > > users the tools to confidently and successfully interact with petabyte
> > > range
> > > data sets. HAWQ provides users with a complete, standards compliant SQL
> > > interface.
> > >
> > > HAWQ has been incubating since 2015-09-04.
> > >
> > > Three most important issues to address in the move towards graduation:
> > >
> > > 1. Continue to improve the project's release cadence. To this end we
> > > plan on expanding automation services to support increased
> > > developer participation.
> > >
> > > 2. Continue to expand the community, by adding new contributors and
> > > focusing on making sure that there's a much more robust level of
> > > conversations and discussions happening around roadmaps and
> > > feature development on the public dev mailing list.
> > >
> > > 3. Expand release artifacts to include the delivery of binary
> > > artifacts. We expect the project to significantly refine the
> > > binary release process in several key areas.
> > >
> > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> > > aware of?
> > >
> > > 1. Nothing urgent at this time.
> > >
> > > How has the community developed since the last report?
> > >
> > > 1. Two Meetups took place in Beijing, China:
> > >
> > > * HAWQ Meetup (January 123, 2017)
> > >
> > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> > > Engineer
> > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> > > Senior Engineer
> > >
> > > * HAWQ Meetup (March 23, 2017)
> > >
> > > - Apache HAWQ Exploration Step by Step - Configuration, Build,
> > > Deployment and Debug by Xiang Sheng, Pivotal Software
> > > Engineer
> > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> > > Senior Software Engineer
> > > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> > > Database Expert in Alibaba Cloud
> > >
> > > 2. A significant push by the dev community has been made to review
> > > and merge the project's Pull Requests (PR). As of March 30, 2017,
> > > eight of the nine open PRs have been opened in the last ten
> > > days. The PR opened on Sep 2016 is targeted to be merged after
> > > the Apache 2.2.0.0 release.
> > >
> > > 3. Recent porting efforts:
> > >
> > > - Persistent Systems Engineers are actively engaging the dev
> > > community on their HAWQ porting efforts to RHEL 7.1 on S390
> > > platform.
> > >
> > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> > > published on dev list.
> > >
> > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> > > the upcoming 2.2.0.0 release
> > >
> > > How has the project developed since the last report?
> > >
> > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> > >
> > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> > > binary release). This is the 3rd release as an incubating
> > > project.
> > >
> > > Release page:
> > >
> > > https://cwiki.apache.org/confluence/display/HAWQ/
> > > Apache+HAWQ+2.2.0.0-incubating+Release
> > >
> > > Release hightlights:
> > >
> > > * CentOS 7.x Support
> > > * Ranger Integration
> > > * PXF ORC Profile
> > > * Bug Fixes
> > >
> > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> > > member) is publishing (to dev email list) a regular HAWQ
> Graduation
> > > update for the
> > > project.
> > >
> > > * HAWQ graduation update (January, 17, 2017)
> > > https://lists.apache.org/thread.html/
> > cd37e2b48d4bbc9fe4a9cea47f8247
> > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> > >
> > > * Apache HAWQ graduation update (Mar 1st, 2017)
> > > https://lists.apache.org/thread.html/
> > 3a1e454f8c706dd71b1690c3ae74a1
> > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> > >
> > > 4. The Apache HAWQ website has been updated to provide clearer
> > > access to download release artifacts.
> > >
> > > How would you assess the podling's maturity?
> > > Please feel free to add your own commentary.
> > >
> > > [ ] Initial setup
> > > [ ] Working towards first release
> > > [X] Community building
> > > [X] Nearing graduation
> > > [ ] Other:
> > >
> > > Date of last release:
> > >
> > > 2017-02-28
> > >
> > > When were the last committers or PMC members elected?
> > >
> > > Podling committers (3) added:
> > > Lisa Owen: January 31, 2017
> > > Jane Beckman: February 1, 2017
> > > Kyle Dunn: March 2, 2017
> > >
> > > PPMC member (1) added:
> > > Paul Guo: March 10, 2017
> > >
> > > Signed-off-by:
> > >
> > > [ ](hawq) Alan Gates
> > > Comments:
> > > [ ](hawq) Konstantin Boudnik
> > > Comments:
> > > [ ](hawq) Justin Erenkrantz
> > > Comments:
> > > [ ](hawq) Thejas Nair
> > > Comments:
> > > [ ](hawq) Roman Shaposhnik
> > > Comments:
> > >
> > > IPMC/Shepherd notes:
> > >
> > >
> > >
> >
>
>
>
> --
> *Ed Espino*
>
Re: PXF JDBC plugin
Posted by Jon Roberts <jr...@pivotal.io>.
https://issues.apache.org/jira/browse/HAWQ-1445
Jon Roberts
On Tue, Apr 25, 2017 at 6:31 AM, Jon Roberts <jr...@pivotal.io> wrote:
> No I did not. My post was intended to start a discussion about the plugin
> and I thought the original contributor would chime in. But I can make the
> tickets now if you think that is the best way to move forward.
>
> Jon Roberts
> Principal Engineer | jroberts@pivotal.io | 615-426-8661 <(615)%20426-8661>
>
> On Tue, Apr 25, 2017 at 2:58 AM, Michael Pearce <Mi...@ig.com>
> wrote:
>
>> Hi Jon,
>>
>> Did you make JIRA issues for the two improvements you suggested to be
>> made?
>>
>> Cheers
>> Mike
>>
>> On 04/04/2017, 04:15, "Michael Pearce" <Mi...@ig.com> wrote:
>>
>> Hi Jon
>>
>> I think on issue 1 and 2 are valid improvements that can be made, add
>> some Jira's for these. Looking at issue 1 it seems quite trivial for
>> someone to contribute the solution for.
>>
>> On the question front:
>>
>> 1) from my understanding and using this plugin so far this is what
>> the partion by interval allows you to control the number of partitions that
>> would be generated, e.g. This is why the sample in document has 1 year so
>> it only creates 2 fragments. You can also partition by an enum field here
>> the number of partitions is the number of enums.
>>
>> 2) I haven't checked specifically, saying that I haven't run into an
>> issue when trialling this myself. Obviously this is contributed by Devin he
>> will be the definitive source here. Though I guess can always specially
>> test these scenarios.
>>
>> Sent using OWA for iPhone
>> ________________________________________
>> From: Jon Roberts <jr...@pivotal.io>
>> Sent: Monday, April 3, 2017 11:57:59 PM
>> To: dev@hawq.incubator.apache.org
>> Subject: Re: PXF JDBC plugin
>>
>> https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
>>
>> Issue 1: Security
>> The example has the username and password in the connection string.
>>
>> LOCATION ('pxf://localhost:51200/demodb.myclass'
>> '?PROFILE=JDBC'
>> '&JDBC_DRIVER=com.mysql.jdbc.Driver'
>> '&DB_URL=jdbc:mysql://
>> 192.168.200.6:3306/demodb&USER=root&PASS=root'
>> )
>>
>> Any chance we can get this changed to a connection profile that
>> points to a
>> file outside of the database? For Greenplum database and S3, the
>> LOCATION
>> syntax includes "config=/path/to/config_file". The config_file
>> contains
>> the S3 credentials. This seems like a good pattern to follow.
>>
>> As it is right now, anyone that can connect to the database will be
>> able to
>> see the username and password of the JDBC connection.
>>
>> Issue 2: Extra Properties
>>
>> Some JDBC drivers will need many additional properties beyond the URL
>> and
>> this requires setting it with a put to a Properties variable. An
>> example
>> of this is Oracle's defaultRowPrefetch property that needs to be
>> updated
>> from the default of 10 which is designed for OLTP to something larger
>> like
>> 2000 which is more ideal for data extracts.
>>
>> Additionally, you will need the ability to set the isolation level
>> which is
>> done with setTransactionIsolation on the Connection. I don't believe
>> you
>> can set this on the connection URL either. Many SQL Server and DB2
>> database still don't use snapshot isolation and use dirty reads
>> instead.
>> Without a dirty read here, your query will block modifications to the
>> table
>> with a "blocking lock".
>>
>> So for the configuration file will need both an extra properties
>> variable
>> that is delimited so you can multiple and a isolation level indicator.
>>
>> Questions.
>> 1. How do you manage the maximum number of pxf instances? For
>> example, if
>> you partition like this:
>> "PARTITION_BY=cdate:date&RANGE=2008-01-01:2010-01-01&INTERVAL=1:day",
>> will
>> you create 730 pxf instances and thus 730 concurrent queries to the
>> source
>> database?
>> 2. Have you tested special characters like null, escape, carriage
>> return,
>> newline, and your delimiter? Maybe that is handled automatically by
>> pxfwritable_import so this isn't an issue.
>>
>>
>>
>> Jon Roberts
>> Principal Engineer | jroberts@pivotal.io | 615-426-8661
>>
>> On Mon, Apr 3, 2017 at 3:18 PM, Michael Pearce <Michael.Pearce@ig.com
>> >
>> wrote:
>>
>> > I mean the readme file :) at that location.
>> > ________________________________________
>> > From: Michael Pearce
>> > Sent: Monday, April 3, 2017 9:15:48 PM
>> > To: dev@hawq.incubator.apache.org
>> > Subject: Re: PXF JDBC plugin
>> >
>> > On master there is the document that was added.
>> >
>> > https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
>> >
>> > Reading this I think answers some of the questions.
>> >
>> >
>> >
>> >
>> >
>> > Sent using OWA for iPhone
>> > ________________________________________
>> > From: Vineet Goel <vv...@apache.org>
>> > Sent: Monday, April 3, 2017 6:33:07 PM
>> > To: dev@hawq.incubator.apache.org
>> > Subject: Re: PXF JDBC plugin
>> >
>> > Devin and others,
>> >
>> > It would be great if you can expand a bit more on the
>> implementation or
>> > point to a document?
>> >
>> > Thanks!
>> >
>> >
>> >
>> > On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io>
>> wrote:
>> >
>> > > JDBC PXF is pretty exciting. Are there details on how this works?
>> > >
>> > > Does PXF randomly pick a segment to connect to the JDBC source or
>> do you
>> > > specify a particular node to execute the query? I'm assuming it
>> isn't a
>> > > parallel query so you don't flood the JDBC source with x number of
>> > "select
>> > > *" queries but I could be wrong.
>> > >
>> > > How do you register the JDBC connection string with PXF?
>> > >
>> > > How do you manage credentials?
>> > >
>> > > How do you register the JDBC jar files?
>> > >
>> > >
>> > > Jon Roberts
>> > >
>> > > On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org>
>> wrote:
>> > >
>> > > > Thank you Michael, this is a well-deserved report highlight. I
>> have
>> > added
>> > > > the following to the report:
>> > > >
>> > > > 3. Community contribution highlight(s):
>> > > >
>> > > > * Leveraging the extensible PXF design, a JDBC PXF plugin
>> > > > was contributed by Devin Jia (github id: jiadexin). This
>> > > > contribution came from the community and not from the
>> > > > company which originally donated HAWQ to the ASF.
>> > > >
>> > > > Warm regrds,
>> > > > -=e
>> > > >
>> > > > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
>> > > > michael.andre.pearce@me.com> wrote:
>> > > >
>> > > > >
>> > > > > I would add note about the new JDBC PXF plugin being
>> contributed by
>> > > Devin
>> > > > > Jia. (Kudos to him)
>> > > > >
>> > > > > It's a good show of the community contributing and growing
>> outside of
>> > > > just
>> > > > > Pivotal staff (I think for incubator review this is
>> important) and
>> > also
>> > > > the
>> > > > > benefit of the extensible PXF design the project has done.
>> > >
>> > The information contained in this email is strictly confidential
>> and for
>> > the use of the addressee only, unless otherwise indicated. If you
>> are not
>> > the intended recipient, please do not read, copy, use or disclose
>> to others
>> > this message or any attachment. Please also notify the sender by
>> replying
>> > to this email or by telephone (+44(020 7896 0011) and then delete
>> the email
>> > and any copies of it. Opinions, conclusion (etc) that do not relate
>> to the
>> > official business of this company shall be understood as neither
>> given nor
>> > endorsed by it. IG is a trading name of IG Markets Limited (a
>> company
>> > registered in England and Wales, company number 04008957) and IG
>> Index
>> > Limited (a company registered in England and Wales, company number
>> > 01190902). Registered address at Cannon Bridge House, 25 Dowgate
>> Hill,
>> > London EC4R 2YA. Both IG Markets Limited (register number 195355)
>> and IG
>> > Index Limited (register number 114059) are authorised and regulated
>> by the
>> > Financial Conduct Authority.
>> >
>>
>>
>> The information contained in this email is strictly confidential and for
>> the use of the addressee only, unless otherwise indicated. If you are not
>> the intended recipient, please do not read, copy, use or disclose to others
>> this message or any attachment. Please also notify the sender by replying
>> to this email or by telephone (+44(020 7896 0011) and then delete the email
>> and any copies of it. Opinions, conclusion (etc) that do not relate to the
>> official business of this company shall be understood as neither given nor
>> endorsed by it. IG is a trading name of IG Markets Limited (a company
>> registered in England and Wales, company number 04008957) and IG Index
>> Limited (a company registered in England and Wales, company number
>> 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill,
>> London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG
>> Index Limited (register number 114059) are authorised and regulated by the
>> Financial Conduct Authority.
>>
>
>
Re: PXF JDBC plugin
Posted by Jon Roberts <jr...@pivotal.io>.
No I did not. My post was intended to start a discussion about the plugin
and I thought the original contributor would chime in. But I can make the
tickets now if you think that is the best way to move forward.
Jon Roberts
Principal Engineer | jroberts@pivotal.io | 615-426-8661
On Tue, Apr 25, 2017 at 2:58 AM, Michael Pearce <Mi...@ig.com>
wrote:
> Hi Jon,
>
> Did you make JIRA issues for the two improvements you suggested to be made?
>
> Cheers
> Mike
>
> On 04/04/2017, 04:15, "Michael Pearce" <Mi...@ig.com> wrote:
>
> Hi Jon
>
> I think on issue 1 and 2 are valid improvements that can be made, add
> some Jira's for these. Looking at issue 1 it seems quite trivial for
> someone to contribute the solution for.
>
> On the question front:
>
> 1) from my understanding and using this plugin so far this is what the
> partion by interval allows you to control the number of partitions that
> would be generated, e.g. This is why the sample in document has 1 year so
> it only creates 2 fragments. You can also partition by an enum field here
> the number of partitions is the number of enums.
>
> 2) I haven't checked specifically, saying that I haven't run into an
> issue when trialling this myself. Obviously this is contributed by Devin he
> will be the definitive source here. Though I guess can always specially
> test these scenarios.
>
> Sent using OWA for iPhone
> ________________________________________
> From: Jon Roberts <jr...@pivotal.io>
> Sent: Monday, April 3, 2017 11:57:59 PM
> To: dev@hawq.incubator.apache.org
> Subject: Re: PXF JDBC plugin
>
> https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
>
> Issue 1: Security
> The example has the username and password in the connection string.
>
> LOCATION ('pxf://localhost:51200/demodb.myclass'
> '?PROFILE=JDBC'
> '&JDBC_DRIVER=com.mysql.jdbc.Driver'
> '&DB_URL=jdbc:mysql://
> 192.168.200.6:3306/demodb&USER=root&PASS=root'
> )
>
> Any chance we can get this changed to a connection profile that points
> to a
> file outside of the database? For Greenplum database and S3, the
> LOCATION
> syntax includes "config=/path/to/config_file". The config_file
> contains
> the S3 credentials. This seems like a good pattern to follow.
>
> As it is right now, anyone that can connect to the database will be
> able to
> see the username and password of the JDBC connection.
>
> Issue 2: Extra Properties
>
> Some JDBC drivers will need many additional properties beyond the URL
> and
> this requires setting it with a put to a Properties variable. An
> example
> of this is Oracle's defaultRowPrefetch property that needs to be
> updated
> from the default of 10 which is designed for OLTP to something larger
> like
> 2000 which is more ideal for data extracts.
>
> Additionally, you will need the ability to set the isolation level
> which is
> done with setTransactionIsolation on the Connection. I don't believe
> you
> can set this on the connection URL either. Many SQL Server and DB2
> database still don't use snapshot isolation and use dirty reads
> instead.
> Without a dirty read here, your query will block modifications to the
> table
> with a "blocking lock".
>
> So for the configuration file will need both an extra properties
> variable
> that is delimited so you can multiple and a isolation level indicator.
>
> Questions.
> 1. How do you manage the maximum number of pxf instances? For
> example, if
> you partition like this:
> "PARTITION_BY=cdate:date&RANGE=2008-01-01:2010-01-01&INTERVAL=1:day",
> will
> you create 730 pxf instances and thus 730 concurrent queries to the
> source
> database?
> 2. Have you tested special characters like null, escape, carriage
> return,
> newline, and your delimiter? Maybe that is handled automatically by
> pxfwritable_import so this isn't an issue.
>
>
>
> Jon Roberts
> Principal Engineer | jroberts@pivotal.io | 615-426-8661
>
> On Mon, Apr 3, 2017 at 3:18 PM, Michael Pearce <Mi...@ig.com>
> wrote:
>
> > I mean the readme file :) at that location.
> > ________________________________________
> > From: Michael Pearce
> > Sent: Monday, April 3, 2017 9:15:48 PM
> > To: dev@hawq.incubator.apache.org
> > Subject: Re: PXF JDBC plugin
> >
> > On master there is the document that was added.
> >
> > https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
> >
> > Reading this I think answers some of the questions.
> >
> >
> >
> >
> >
> > Sent using OWA for iPhone
> > ________________________________________
> > From: Vineet Goel <vv...@apache.org>
> > Sent: Monday, April 3, 2017 6:33:07 PM
> > To: dev@hawq.incubator.apache.org
> > Subject: Re: PXF JDBC plugin
> >
> > Devin and others,
> >
> > It would be great if you can expand a bit more on the implementation
> or
> > point to a document?
> >
> > Thanks!
> >
> >
> >
> > On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io>
> wrote:
> >
> > > JDBC PXF is pretty exciting. Are there details on how this works?
> > >
> > > Does PXF randomly pick a segment to connect to the JDBC source or
> do you
> > > specify a particular node to execute the query? I'm assuming it
> isn't a
> > > parallel query so you don't flood the JDBC source with x number of
> > "select
> > > *" queries but I could be wrong.
> > >
> > > How do you register the JDBC connection string with PXF?
> > >
> > > How do you manage credentials?
> > >
> > > How do you register the JDBC jar files?
> > >
> > >
> > > Jon Roberts
> > >
> > > On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org>
> wrote:
> > >
> > > > Thank you Michael, this is a well-deserved report highlight. I
> have
> > added
> > > > the following to the report:
> > > >
> > > > 3. Community contribution highlight(s):
> > > >
> > > > * Leveraging the extensible PXF design, a JDBC PXF plugin
> > > > was contributed by Devin Jia (github id: jiadexin). This
> > > > contribution came from the community and not from the
> > > > company which originally donated HAWQ to the ASF.
> > > >
> > > > Warm regrds,
> > > > -=e
> > > >
> > > > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> > > > michael.andre.pearce@me.com> wrote:
> > > >
> > > > >
> > > > > I would add note about the new JDBC PXF plugin being
> contributed by
> > > Devin
> > > > > Jia. (Kudos to him)
> > > > >
> > > > > It's a good show of the community contributing and growing
> outside of
> > > > just
> > > > > Pivotal staff (I think for incubator review this is important)
> and
> > also
> > > > the
> > > > > benefit of the extensible PXF design the project has done.
> > >
> > The information contained in this email is strictly confidential and
> for
> > the use of the addressee only, unless otherwise indicated. If you
> are not
> > the intended recipient, please do not read, copy, use or disclose to
> others
> > this message or any attachment. Please also notify the sender by
> replying
> > to this email or by telephone (+44(020 7896 0011) and then delete
> the email
> > and any copies of it. Opinions, conclusion (etc) that do not relate
> to the
> > official business of this company shall be understood as neither
> given nor
> > endorsed by it. IG is a trading name of IG Markets Limited (a company
> > registered in England and Wales, company number 04008957) and IG
> Index
> > Limited (a company registered in England and Wales, company number
> > 01190902). Registered address at Cannon Bridge House, 25 Dowgate
> Hill,
> > London EC4R 2YA. Both IG Markets Limited (register number 195355)
> and IG
> > Index Limited (register number 114059) are authorised and regulated
> by the
> > Financial Conduct Authority.
> >
>
>
> The information contained in this email is strictly confidential and for
> the use of the addressee only, unless otherwise indicated. If you are not
> the intended recipient, please do not read, copy, use or disclose to others
> this message or any attachment. Please also notify the sender by replying
> to this email or by telephone (+44(020 7896 0011) and then delete the email
> and any copies of it. Opinions, conclusion (etc) that do not relate to the
> official business of this company shall be understood as neither given nor
> endorsed by it. IG is a trading name of IG Markets Limited (a company
> registered in England and Wales, company number 04008957) and IG Index
> Limited (a company registered in England and Wales, company number
> 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill,
> London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG
> Index Limited (register number 114059) are authorised and regulated by the
> Financial Conduct Authority.
>
Re: PXF JDBC plugin
Posted by Michael Pearce <Mi...@ig.com>.
Hi Jon,
Did you make JIRA issues for the two improvements you suggested to be made?
Cheers
Mike
On 04/04/2017, 04:15, "Michael Pearce" <Mi...@ig.com> wrote:
Hi Jon
I think on issue 1 and 2 are valid improvements that can be made, add some Jira's for these. Looking at issue 1 it seems quite trivial for someone to contribute the solution for.
On the question front:
1) from my understanding and using this plugin so far this is what the partion by interval allows you to control the number of partitions that would be generated, e.g. This is why the sample in document has 1 year so it only creates 2 fragments. You can also partition by an enum field here the number of partitions is the number of enums.
2) I haven't checked specifically, saying that I haven't run into an issue when trialling this myself. Obviously this is contributed by Devin he will be the definitive source here. Though I guess can always specially test these scenarios.
Sent using OWA for iPhone
________________________________________
From: Jon Roberts <jr...@pivotal.io>
Sent: Monday, April 3, 2017 11:57:59 PM
To: dev@hawq.incubator.apache.org
Subject: Re: PXF JDBC plugin
https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
Issue 1: Security
The example has the username and password in the connection string.
LOCATION ('pxf://localhost:51200/demodb.myclass'
'?PROFILE=JDBC'
'&JDBC_DRIVER=com.mysql.jdbc.Driver'
'&DB_URL=jdbc:mysql://
192.168.200.6:3306/demodb&USER=root&PASS=root'
)
Any chance we can get this changed to a connection profile that points to a
file outside of the database? For Greenplum database and S3, the LOCATION
syntax includes "config=/path/to/config_file". The config_file contains
the S3 credentials. This seems like a good pattern to follow.
As it is right now, anyone that can connect to the database will be able to
see the username and password of the JDBC connection.
Issue 2: Extra Properties
Some JDBC drivers will need many additional properties beyond the URL and
this requires setting it with a put to a Properties variable. An example
of this is Oracle's defaultRowPrefetch property that needs to be updated
from the default of 10 which is designed for OLTP to something larger like
2000 which is more ideal for data extracts.
Additionally, you will need the ability to set the isolation level which is
done with setTransactionIsolation on the Connection. I don't believe you
can set this on the connection URL either. Many SQL Server and DB2
database still don't use snapshot isolation and use dirty reads instead.
Without a dirty read here, your query will block modifications to the table
with a "blocking lock".
So for the configuration file will need both an extra properties variable
that is delimited so you can multiple and a isolation level indicator.
Questions.
1. How do you manage the maximum number of pxf instances? For example, if
you partition like this:
"PARTITION_BY=cdate:date&RANGE=2008-01-01:2010-01-01&INTERVAL=1:day", will
you create 730 pxf instances and thus 730 concurrent queries to the source
database?
2. Have you tested special characters like null, escape, carriage return,
newline, and your delimiter? Maybe that is handled automatically by
pxfwritable_import so this isn't an issue.
Jon Roberts
Principal Engineer | jroberts@pivotal.io | 615-426-8661
On Mon, Apr 3, 2017 at 3:18 PM, Michael Pearce <Mi...@ig.com>
wrote:
> I mean the readme file :) at that location.
> ________________________________________
> From: Michael Pearce
> Sent: Monday, April 3, 2017 9:15:48 PM
> To: dev@hawq.incubator.apache.org
> Subject: Re: PXF JDBC plugin
>
> On master there is the document that was added.
>
> https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
>
> Reading this I think answers some of the questions.
>
>
>
>
>
> Sent using OWA for iPhone
> ________________________________________
> From: Vineet Goel <vv...@apache.org>
> Sent: Monday, April 3, 2017 6:33:07 PM
> To: dev@hawq.incubator.apache.org
> Subject: Re: PXF JDBC plugin
>
> Devin and others,
>
> It would be great if you can expand a bit more on the implementation or
> point to a document?
>
> Thanks!
>
>
>
> On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io> wrote:
>
> > JDBC PXF is pretty exciting. Are there details on how this works?
> >
> > Does PXF randomly pick a segment to connect to the JDBC source or do you
> > specify a particular node to execute the query? I'm assuming it isn't a
> > parallel query so you don't flood the JDBC source with x number of
> "select
> > *" queries but I could be wrong.
> >
> > How do you register the JDBC connection string with PXF?
> >
> > How do you manage credentials?
> >
> > How do you register the JDBC jar files?
> >
> >
> > Jon Roberts
> >
> > On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org> wrote:
> >
> > > Thank you Michael, this is a well-deserved report highlight. I have
> added
> > > the following to the report:
> > >
> > > 3. Community contribution highlight(s):
> > >
> > > * Leveraging the extensible PXF design, a JDBC PXF plugin
> > > was contributed by Devin Jia (github id: jiadexin). This
> > > contribution came from the community and not from the
> > > company which originally donated HAWQ to the ASF.
> > >
> > > Warm regrds,
> > > -=e
> > >
> > > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> > > michael.andre.pearce@me.com> wrote:
> > >
> > > >
> > > > I would add note about the new JDBC PXF plugin being contributed by
> > Devin
> > > > Jia. (Kudos to him)
> > > >
> > > > It's a good show of the community contributing and growing outside of
> > > just
> > > > Pivotal staff (I think for incubator review this is important) and
> also
> > > the
> > > > benefit of the extensible PXF design the project has done.
> >
> The information contained in this email is strictly confidential and for
> the use of the addressee only, unless otherwise indicated. If you are not
> the intended recipient, please do not read, copy, use or disclose to others
> this message or any attachment. Please also notify the sender by replying
> to this email or by telephone (+44(020 7896 0011) and then delete the email
> and any copies of it. Opinions, conclusion (etc) that do not relate to the
> official business of this company shall be understood as neither given nor
> endorsed by it. IG is a trading name of IG Markets Limited (a company
> registered in England and Wales, company number 04008957) and IG Index
> Limited (a company registered in England and Wales, company number
> 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill,
> London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG
> Index Limited (register number 114059) are authorised and regulated by the
> Financial Conduct Authority.
>
The information contained in this email is strictly confidential and for the use of the addressee only, unless otherwise indicated. If you are not the intended recipient, please do not read, copy, use or disclose to others this message or any attachment. Please also notify the sender by replying to this email or by telephone (+44(020 7896 0011) and then delete the email and any copies of it. Opinions, conclusion (etc) that do not relate to the official business of this company shall be understood as neither given nor endorsed by it. IG is a trading name of IG Markets Limited (a company registered in England and Wales, company number 04008957) and IG Index Limited (a company registered in England and Wales, company number 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill, London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG Index Limited (register number 114059) are authorised and regulated by the Financial Conduct Authority.
Re: PXF JDBC plugin
Posted by Michael Pearce <Mi...@ig.com>.
Hi Jon
I think on issue 1 and 2 are valid improvements that can be made, add some Jira's for these. Looking at issue 1 it seems quite trivial for someone to contribute the solution for.
On the question front:
1) from my understanding and using this plugin so far this is what the partion by interval allows you to control the number of partitions that would be generated, e.g. This is why the sample in document has 1 year so it only creates 2 fragments. You can also partition by an enum field here the number of partitions is the number of enums.
2) I haven't checked specifically, saying that I haven't run into an issue when trialling this myself. Obviously this is contributed by Devin he will be the definitive source here. Though I guess can always specially test these scenarios.
Sent using OWA for iPhone
________________________________________
From: Jon Roberts <jr...@pivotal.io>
Sent: Monday, April 3, 2017 11:57:59 PM
To: dev@hawq.incubator.apache.org
Subject: Re: PXF JDBC plugin
https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
Issue 1: Security
The example has the username and password in the connection string.
LOCATION ('pxf://localhost:51200/demodb.myclass'
'?PROFILE=JDBC'
'&JDBC_DRIVER=com.mysql.jdbc.Driver'
'&DB_URL=jdbc:mysql://
192.168.200.6:3306/demodb&USER=root&PASS=root'
)
Any chance we can get this changed to a connection profile that points to a
file outside of the database? For Greenplum database and S3, the LOCATION
syntax includes "config=/path/to/config_file". The config_file contains
the S3 credentials. This seems like a good pattern to follow.
As it is right now, anyone that can connect to the database will be able to
see the username and password of the JDBC connection.
Issue 2: Extra Properties
Some JDBC drivers will need many additional properties beyond the URL and
this requires setting it with a put to a Properties variable. An example
of this is Oracle's defaultRowPrefetch property that needs to be updated
from the default of 10 which is designed for OLTP to something larger like
2000 which is more ideal for data extracts.
Additionally, you will need the ability to set the isolation level which is
done with setTransactionIsolation on the Connection. I don't believe you
can set this on the connection URL either. Many SQL Server and DB2
database still don't use snapshot isolation and use dirty reads instead.
Without a dirty read here, your query will block modifications to the table
with a "blocking lock".
So for the configuration file will need both an extra properties variable
that is delimited so you can multiple and a isolation level indicator.
Questions.
1. How do you manage the maximum number of pxf instances? For example, if
you partition like this:
"PARTITION_BY=cdate:date&RANGE=2008-01-01:2010-01-01&INTERVAL=1:day", will
you create 730 pxf instances and thus 730 concurrent queries to the source
database?
2. Have you tested special characters like null, escape, carriage return,
newline, and your delimiter? Maybe that is handled automatically by
pxfwritable_import so this isn't an issue.
Jon Roberts
Principal Engineer | jroberts@pivotal.io | 615-426-8661
On Mon, Apr 3, 2017 at 3:18 PM, Michael Pearce <Mi...@ig.com>
wrote:
> I mean the readme file :) at that location.
> ________________________________________
> From: Michael Pearce
> Sent: Monday, April 3, 2017 9:15:48 PM
> To: dev@hawq.incubator.apache.org
> Subject: Re: PXF JDBC plugin
>
> On master there is the document that was added.
>
> https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
>
> Reading this I think answers some of the questions.
>
>
>
>
>
> Sent using OWA for iPhone
> ________________________________________
> From: Vineet Goel <vv...@apache.org>
> Sent: Monday, April 3, 2017 6:33:07 PM
> To: dev@hawq.incubator.apache.org
> Subject: Re: PXF JDBC plugin
>
> Devin and others,
>
> It would be great if you can expand a bit more on the implementation or
> point to a document?
>
> Thanks!
>
>
>
> On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io> wrote:
>
> > JDBC PXF is pretty exciting. Are there details on how this works?
> >
> > Does PXF randomly pick a segment to connect to the JDBC source or do you
> > specify a particular node to execute the query? I'm assuming it isn't a
> > parallel query so you don't flood the JDBC source with x number of
> "select
> > *" queries but I could be wrong.
> >
> > How do you register the JDBC connection string with PXF?
> >
> > How do you manage credentials?
> >
> > How do you register the JDBC jar files?
> >
> >
> > Jon Roberts
> >
> > On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org> wrote:
> >
> > > Thank you Michael, this is a well-deserved report highlight. I have
> added
> > > the following to the report:
> > >
> > > 3. Community contribution highlight(s):
> > >
> > > * Leveraging the extensible PXF design, a JDBC PXF plugin
> > > was contributed by Devin Jia (github id: jiadexin). This
> > > contribution came from the community and not from the
> > > company which originally donated HAWQ to the ASF.
> > >
> > > Warm regrds,
> > > -=e
> > >
> > > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> > > michael.andre.pearce@me.com> wrote:
> > >
> > > >
> > > > I would add note about the new JDBC PXF plugin being contributed by
> > Devin
> > > > Jia. (Kudos to him)
> > > >
> > > > It's a good show of the community contributing and growing outside of
> > > just
> > > > Pivotal staff (I think for incubator review this is important) and
> also
> > > the
> > > > benefit of the extensible PXF design the project has done.
> >
> The information contained in this email is strictly confidential and for
> the use of the addressee only, unless otherwise indicated. If you are not
> the intended recipient, please do not read, copy, use or disclose to others
> this message or any attachment. Please also notify the sender by replying
> to this email or by telephone (+44(020 7896 0011) and then delete the email
> and any copies of it. Opinions, conclusion (etc) that do not relate to the
> official business of this company shall be understood as neither given nor
> endorsed by it. IG is a trading name of IG Markets Limited (a company
> registered in England and Wales, company number 04008957) and IG Index
> Limited (a company registered in England and Wales, company number
> 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill,
> London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG
> Index Limited (register number 114059) are authorised and regulated by the
> Financial Conduct Authority.
>
The information contained in this email is strictly confidential and for the use of the addressee only, unless otherwise indicated. If you are not the intended recipient, please do not read, copy, use or disclose to others this message or any attachment. Please also notify the sender by replying to this email or by telephone (+44(020 7896 0011) and then delete the email and any copies of it. Opinions, conclusion (etc) that do not relate to the official business of this company shall be understood as neither given nor endorsed by it. IG is a trading name of IG Markets Limited (a company registered in England and Wales, company number 04008957) and IG Index Limited (a company registered in England and Wales, company number 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill, London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG Index Limited (register number 114059) are authorised and regulated by the Financial Conduct Authority.
Re: PXF JDBC plugin
Posted by Jon Roberts <jr...@pivotal.io>.
https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
Issue 1: Security
The example has the username and password in the connection string.
LOCATION ('pxf://localhost:51200/demodb.myclass'
'?PROFILE=JDBC'
'&JDBC_DRIVER=com.mysql.jdbc.Driver'
'&DB_URL=jdbc:mysql://
192.168.200.6:3306/demodb&USER=root&PASS=root'
)
Any chance we can get this changed to a connection profile that points to a
file outside of the database? For Greenplum database and S3, the LOCATION
syntax includes "config=/path/to/config_file". The config_file contains
the S3 credentials. This seems like a good pattern to follow.
As it is right now, anyone that can connect to the database will be able to
see the username and password of the JDBC connection.
Issue 2: Extra Properties
Some JDBC drivers will need many additional properties beyond the URL and
this requires setting it with a put to a Properties variable. An example
of this is Oracle's defaultRowPrefetch property that needs to be updated
from the default of 10 which is designed for OLTP to something larger like
2000 which is more ideal for data extracts.
Additionally, you will need the ability to set the isolation level which is
done with setTransactionIsolation on the Connection. I don't believe you
can set this on the connection URL either. Many SQL Server and DB2
database still don't use snapshot isolation and use dirty reads instead.
Without a dirty read here, your query will block modifications to the table
with a "blocking lock".
So for the configuration file will need both an extra properties variable
that is delimited so you can multiple and a isolation level indicator.
Questions.
1. How do you manage the maximum number of pxf instances? For example, if
you partition like this:
"PARTITION_BY=cdate:date&RANGE=2008-01-01:2010-01-01&INTERVAL=1:day", will
you create 730 pxf instances and thus 730 concurrent queries to the source
database?
2. Have you tested special characters like null, escape, carriage return,
newline, and your delimiter? Maybe that is handled automatically by
pxfwritable_import so this isn't an issue.
Jon Roberts
Principal Engineer | jroberts@pivotal.io | 615-426-8661
On Mon, Apr 3, 2017 at 3:18 PM, Michael Pearce <Mi...@ig.com>
wrote:
> I mean the readme file :) at that location.
> ________________________________________
> From: Michael Pearce
> Sent: Monday, April 3, 2017 9:15:48 PM
> To: dev@hawq.incubator.apache.org
> Subject: Re: PXF JDBC plugin
>
> On master there is the document that was added.
>
> https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
>
> Reading this I think answers some of the questions.
>
>
>
>
>
> Sent using OWA for iPhone
> ________________________________________
> From: Vineet Goel <vv...@apache.org>
> Sent: Monday, April 3, 2017 6:33:07 PM
> To: dev@hawq.incubator.apache.org
> Subject: Re: PXF JDBC plugin
>
> Devin and others,
>
> It would be great if you can expand a bit more on the implementation or
> point to a document?
>
> Thanks!
>
>
>
> On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io> wrote:
>
> > JDBC PXF is pretty exciting. Are there details on how this works?
> >
> > Does PXF randomly pick a segment to connect to the JDBC source or do you
> > specify a particular node to execute the query? I'm assuming it isn't a
> > parallel query so you don't flood the JDBC source with x number of
> "select
> > *" queries but I could be wrong.
> >
> > How do you register the JDBC connection string with PXF?
> >
> > How do you manage credentials?
> >
> > How do you register the JDBC jar files?
> >
> >
> > Jon Roberts
> >
> > On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org> wrote:
> >
> > > Thank you Michael, this is a well-deserved report highlight. I have
> added
> > > the following to the report:
> > >
> > > 3. Community contribution highlight(s):
> > >
> > > * Leveraging the extensible PXF design, a JDBC PXF plugin
> > > was contributed by Devin Jia (github id: jiadexin). This
> > > contribution came from the community and not from the
> > > company which originally donated HAWQ to the ASF.
> > >
> > > Warm regrds,
> > > -=e
> > >
> > > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> > > michael.andre.pearce@me.com> wrote:
> > >
> > > >
> > > > I would add note about the new JDBC PXF plugin being contributed by
> > Devin
> > > > Jia. (Kudos to him)
> > > >
> > > > It's a good show of the community contributing and growing outside of
> > > just
> > > > Pivotal staff (I think for incubator review this is important) and
> also
> > > the
> > > > benefit of the extensible PXF design the project has done.
> >
> The information contained in this email is strictly confidential and for
> the use of the addressee only, unless otherwise indicated. If you are not
> the intended recipient, please do not read, copy, use or disclose to others
> this message or any attachment. Please also notify the sender by replying
> to this email or by telephone (+44(020 7896 0011) and then delete the email
> and any copies of it. Opinions, conclusion (etc) that do not relate to the
> official business of this company shall be understood as neither given nor
> endorsed by it. IG is a trading name of IG Markets Limited (a company
> registered in England and Wales, company number 04008957) and IG Index
> Limited (a company registered in England and Wales, company number
> 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill,
> London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG
> Index Limited (register number 114059) are authorised and regulated by the
> Financial Conduct Authority.
>
Re: PXF JDBC plugin
Posted by Michael Pearce <Mi...@ig.com>.
I mean the readme file :) at that location.
________________________________________
From: Michael Pearce
Sent: Monday, April 3, 2017 9:15:48 PM
To: dev@hawq.incubator.apache.org
Subject: Re: PXF JDBC plugin
On master there is the document that was added.
https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
Reading this I think answers some of the questions.
Sent using OWA for iPhone
________________________________________
From: Vineet Goel <vv...@apache.org>
Sent: Monday, April 3, 2017 6:33:07 PM
To: dev@hawq.incubator.apache.org
Subject: Re: PXF JDBC plugin
Devin and others,
It would be great if you can expand a bit more on the implementation or
point to a document?
Thanks!
On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io> wrote:
> JDBC PXF is pretty exciting. Are there details on how this works?
>
> Does PXF randomly pick a segment to connect to the JDBC source or do you
> specify a particular node to execute the query? I'm assuming it isn't a
> parallel query so you don't flood the JDBC source with x number of "select
> *" queries but I could be wrong.
>
> How do you register the JDBC connection string with PXF?
>
> How do you manage credentials?
>
> How do you register the JDBC jar files?
>
>
> Jon Roberts
>
> On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org> wrote:
>
> > Thank you Michael, this is a well-deserved report highlight. I have added
> > the following to the report:
> >
> > 3. Community contribution highlight(s):
> >
> > * Leveraging the extensible PXF design, a JDBC PXF plugin
> > was contributed by Devin Jia (github id: jiadexin). This
> > contribution came from the community and not from the
> > company which originally donated HAWQ to the ASF.
> >
> > Warm regrds,
> > -=e
> >
> > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> > michael.andre.pearce@me.com> wrote:
> >
> > >
> > > I would add note about the new JDBC PXF plugin being contributed by
> Devin
> > > Jia. (Kudos to him)
> > >
> > > It's a good show of the community contributing and growing outside of
> > just
> > > Pivotal staff (I think for incubator review this is important) and also
> > the
> > > benefit of the extensible PXF design the project has done.
>
The information contained in this email is strictly confidential and for the use of the addressee only, unless otherwise indicated. If you are not the intended recipient, please do not read, copy, use or disclose to others this message or any attachment. Please also notify the sender by replying to this email or by telephone (+44(020 7896 0011) and then delete the email and any copies of it. Opinions, conclusion (etc) that do not relate to the official business of this company shall be understood as neither given nor endorsed by it. IG is a trading name of IG Markets Limited (a company registered in England and Wales, company number 04008957) and IG Index Limited (a company registered in England and Wales, company number 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill, London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG Index Limited (register number 114059) are authorised and regulated by the Financial Conduct Authority.
Re: PXF JDBC plugin
Posted by Michael Pearce <Mi...@ig.com>.
On master there is the document that was added.
https://github.com/apache/incubator-hawq/tree/master/pxf/pxf-jdbc
Reading this I think answers some of the questions.
Sent using OWA for iPhone
________________________________________
From: Vineet Goel <vv...@apache.org>
Sent: Monday, April 3, 2017 6:33:07 PM
To: dev@hawq.incubator.apache.org
Subject: Re: PXF JDBC plugin
Devin and others,
It would be great if you can expand a bit more on the implementation or
point to a document?
Thanks!
On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io> wrote:
> JDBC PXF is pretty exciting. Are there details on how this works?
>
> Does PXF randomly pick a segment to connect to the JDBC source or do you
> specify a particular node to execute the query? I'm assuming it isn't a
> parallel query so you don't flood the JDBC source with x number of "select
> *" queries but I could be wrong.
>
> How do you register the JDBC connection string with PXF?
>
> How do you manage credentials?
>
> How do you register the JDBC jar files?
>
>
> Jon Roberts
>
> On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org> wrote:
>
> > Thank you Michael, this is a well-deserved report highlight. I have added
> > the following to the report:
> >
> > 3. Community contribution highlight(s):
> >
> > * Leveraging the extensible PXF design, a JDBC PXF plugin
> > was contributed by Devin Jia (github id: jiadexin). This
> > contribution came from the community and not from the
> > company which originally donated HAWQ to the ASF.
> >
> > Warm regrds,
> > -=e
> >
> > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> > michael.andre.pearce@me.com> wrote:
> >
> > >
> > > I would add note about the new JDBC PXF plugin being contributed by
> Devin
> > > Jia. (Kudos to him)
> > >
> > > It's a good show of the community contributing and growing outside of
> > just
> > > Pivotal staff (I think for incubator review this is important) and also
> > the
> > > benefit of the extensible PXF design the project has done.
>
The information contained in this email is strictly confidential and for the use of the addressee only, unless otherwise indicated. If you are not the intended recipient, please do not read, copy, use or disclose to others this message or any attachment. Please also notify the sender by replying to this email or by telephone (+44(020 7896 0011) and then delete the email and any copies of it. Opinions, conclusion (etc) that do not relate to the official business of this company shall be understood as neither given nor endorsed by it. IG is a trading name of IG Markets Limited (a company registered in England and Wales, company number 04008957) and IG Index Limited (a company registered in England and Wales, company number 01190902). Registered address at Cannon Bridge House, 25 Dowgate Hill, London EC4R 2YA. Both IG Markets Limited (register number 195355) and IG Index Limited (register number 114059) are authorised and regulated by the Financial Conduct Authority.
Re: PXF JDBC plugin
Posted by Vineet Goel <vv...@apache.org>.
Devin and others,
It would be great if you can expand a bit more on the implementation or
point to a document?
Thanks!
On Mon, Apr 3, 2017 at 7:53 AM Jon Roberts <jr...@pivotal.io> wrote:
> JDBC PXF is pretty exciting. Are there details on how this works?
>
> Does PXF randomly pick a segment to connect to the JDBC source or do you
> specify a particular node to execute the query? I'm assuming it isn't a
> parallel query so you don't flood the JDBC source with x number of "select
> *" queries but I could be wrong.
>
> How do you register the JDBC connection string with PXF?
>
> How do you manage credentials?
>
> How do you register the JDBC jar files?
>
>
> Jon Roberts
>
> On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org> wrote:
>
> > Thank you Michael, this is a well-deserved report highlight. I have added
> > the following to the report:
> >
> > 3. Community contribution highlight(s):
> >
> > * Leveraging the extensible PXF design, a JDBC PXF plugin
> > was contributed by Devin Jia (github id: jiadexin). This
> > contribution came from the community and not from the
> > company which originally donated HAWQ to the ASF.
> >
> > Warm regrds,
> > -=e
> >
> > On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> > michael.andre.pearce@me.com> wrote:
> >
> > >
> > > I would add note about the new JDBC PXF plugin being contributed by
> Devin
> > > Jia. (Kudos to him)
> > >
> > > It's a good show of the community contributing and growing outside of
> > just
> > > Pivotal staff (I think for incubator review this is important) and also
> > the
> > > benefit of the extensible PXF design the project has done.
>
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Jon Roberts <jr...@pivotal.io>.
JDBC PXF is pretty exciting. Are there details on how this works?
Does PXF randomly pick a segment to connect to the JDBC source or do you
specify a particular node to execute the query? I'm assuming it isn't a
parallel query so you don't flood the JDBC source with x number of "select
*" queries but I could be wrong.
How do you register the JDBC connection string with PXF?
How do you manage credentials?
How do you register the JDBC jar files?
Jon Roberts
On Sat, Apr 1, 2017 at 5:05 PM, Ed Espino <es...@apache.org> wrote:
> Thank you Michael, this is a well-deserved report highlight. I have added
> the following to the report:
>
> 3. Community contribution highlight(s):
>
> * Leveraging the extensible PXF design, a JDBC PXF plugin
> was contributed by Devin Jia (github id: jiadexin). This
> contribution came from the community and not from the
> company which originally donated HAWQ to the ASF.
>
> Warm regrds,
> -=e
>
> On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
> michael.andre.pearce@me.com> wrote:
>
> >
> > I would add note about the new JDBC PXF plugin being contributed by Devin
> > Jia. (Kudos to him)
> >
> > It's a good show of the community contributing and growing outside of
> just
> > Pivotal staff (I think for incubator review this is important) and also
> the
> > benefit of the extensible PXF design the project has done.
> >
> > On 1 Apr 2017, at 18:05, Ed Espino <es...@apache.org> wrote:
> >
> > Paul,
> >
> > Thank you for the input. I have added your suggestions to the report.
> >
> > Cheers,
> > -=e
> >
> > On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <pa...@gmail.com> wrote:
> >
> >> Maybe we could include the change for the doc and homepage into the
> >> report?
> >> We have an open source doc now and the home page is more friendly to
> >> users.
> >>
> >> 2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
> >>
> >>> Lili,
> >>>
> >>> I have updated the report. Thank you for the contributions.
> >>>
> >>> -=e
> >>>
> >>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
> >>>
> >>>> Hi Ed,
> >>>>
> >>>> The Apache HAWQ website has been updated to provide clearer
> >>>> access to download release artifacts.
> >>>>
> >>>> We also updated the website to add more information:
> >>>> 1. Add more community activities and recorded videos:
> >>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
> >>>> 2. Add design documents for certain components:
> >>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
> >>>>
> >>>> Thanks
> >>>> Lili
> >>>>
> >>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
> >>>>
> >>>> > Ruilong,
> >>>> >
> >>>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
> >>>> report.
> >>>> >
> >>>> > -=e
> >>>> >
> >>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io>
> wrote:
> >>>> >
> >>>> > > Hi Ed,
> >>>> > >
> >>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
> >>>> > >
> >>>> > > Best regards,
> >>>> > > Ruilong Huo
> >>>> > >
> >>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org>
> >>>> wrote:
> >>>> > >
> >>>> > > > Team HAWQ,
> >>>> > > >
> >>>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
> >>>> > covering
> >>>> > > > Q1 2017 activity.
> >>>> > > >
> >>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
> >>>> > > >
> >>>> > > > Please let me know if you have any comments or suggestions and I
> >>>> will
> >>>> > > update
> >>>> > > > the report.
> >>>> > > >
> >>>> > > > Regards,
> >>>> > > > -=e
> >>>> > > >
> >>>> > > > --
> >>>> > > > *Ed Espino*
> >>>> > > >
> >>>> > > >
> >>>> > > > --------------------
> >>>> > > > HAWQ
> >>>> > > >
> >>>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines
> the
> >>>> key
> >>>> > > > technological advantages of MPP database with the scalability
> and
> >>>> > > > convenience
> >>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS
> >>>> natively. HAWQ
> >>>> > > > delivers industry-leading performance and linear scalability. It
> >>>> > provides
> >>>> > > > users the tools to confidently and successfully interact with
> >>>> petabyte
> >>>> > > > range
> >>>> > > > data sets. HAWQ provides users with a complete, standards
> >>>> compliant SQL
> >>>> > > > interface.
> >>>> > > >
> >>>> > > > HAWQ has been incubating since 2015-09-04.
> >>>> > > >
> >>>> > > > Three most important issues to address in the move towards
> >>>> graduation:
> >>>> > > >
> >>>> > > > 1. Continue to improve the project's release cadence. To this
> >>>> end we
> >>>> > > > plan on expanding automation services to support increased
> >>>> > > > developer participation.
> >>>> > > >
> >>>> > > > 2. Continue to expand the community, by adding new
> contributors
> >>>> and
> >>>> > > > focusing on making sure that there's a much more robust
> >>>> level of
> >>>> > > > conversations and discussions happening around roadmaps and
> >>>> > > > feature development on the public dev mailing list.
> >>>> > > >
> >>>> > > > 3. Expand release artifacts to include the delivery of binary
> >>>> > > > artifacts. We expect the project to significantly refine
> the
> >>>> > > > binary release process in several key areas.
> >>>> > > >
> >>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need
> >>>> to be
> >>>> > > > aware of?
> >>>> > > >
> >>>> > > > 1. Nothing urgent at this time.
> >>>> > > >
> >>>> > > > How has the community developed since the last report?
> >>>> > > >
> >>>> > > > 1. Two Meetups took place in Beijing, China:
> >>>> > > >
> >>>> > > > * HAWQ Meetup (January 123, 2017)
> >>>> > > >
> >>>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> >>>> > > > Engineer
> >>>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior
> >>>> Engineer
> >>>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big
> Data
> >>>> > > > Senior Engineer
> >>>> > > >
> >>>> > > > * HAWQ Meetup (March 23, 2017)
> >>>> > > >
> >>>> > > > - Apache HAWQ Exploration Step by Step - Configuration,
> >>>> Build,
> >>>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
> >>>> > > > Engineer
> >>>> > > > - Transaction Management in Apache HAWQ by Ming Li,
> Pivotal
> >>>> > > > Senior Software Engineer
> >>>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen
> >>>> Xia,
> >>>> > > > Database Expert in Alibaba Cloud
> >>>> > > >
> >>>> > > > 2. A significant push by the dev community has been made to
> >>>> review
> >>>> > > > and merge the project's Pull Requests (PR). As of March 30,
> >>>> 2017,
> >>>> > > > eight of the nine open PRs have been opened in the last ten
> >>>> > > > days. The PR opened on Sep 2016 is targeted to be merged
> >>>> after
> >>>> > > > the Apache 2.2.0.0 release.
> >>>> > > >
> >>>> > > > 3. Recent porting efforts:
> >>>> > > >
> >>>> > > > - Persistent Systems Engineers are actively engaging the
> dev
> >>>> > > > community on their HAWQ porting efforts to RHEL 7.1 on
> S390
> >>>> > > > platform.
> >>>> > > >
> >>>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> >>>> > > > published on dev list.
> >>>> > > >
> >>>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM)
> >>>> for
> >>>> > > > the upcoming 2.2.0.0 release
> >>>> > > >
> >>>> > > > How has the project developed since the last report?
> >>>> > > >
> >>>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> >>>> > > >
> >>>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> >>>> > > > binary release). This is the 3rd release as an incubating
> >>>> > > > project.
> >>>> > > >
> >>>> > > > Release page:
> >>>> > > >
> >>>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
> >>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
> >>>> > > >
> >>>> > > > Release hightlights:
> >>>> > > >
> >>>> > > > * CentOS 7.x Support
> >>>> > > > * Ranger Integration
> >>>> > > > * PXF ORC Profile
> >>>> > > > * Bug Fixes
> >>>> > > >
> >>>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ
> PPMC
> >>>> > > > member) is publishing (to dev email list) a regular HAWQ
> >>>> > Graduation
> >>>> > > > update for the
> >>>> > > > project.
> >>>> > > >
> >>>> > > > * HAWQ graduation update (January, 17, 2017)
> >>>> > > > https://lists.apache.org/thread.html/
> >>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
> >>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> >>>> > > >
> >>>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
> >>>> > > > https://lists.apache.org/thread.html/
> >>>> > > 3a1e454f8c706dd71b1690c3ae74a1
> >>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> >>>> > > >
> >>>> > > > 4. The Apache HAWQ website has been updated to provide clearer
> >>>> > > > access to download release artifacts.
> >>>> > > >
> >>>> > > > How would you assess the podling's maturity?
> >>>> > > > Please feel free to add your own commentary.
> >>>> > > >
> >>>> > > > [ ] Initial setup
> >>>> > > > [ ] Working towards first release
> >>>> > > > [X] Community building
> >>>> > > > [X] Nearing graduation
> >>>> > > > [ ] Other:
> >>>> > > >
> >>>> > > > Date of last release:
> >>>> > > >
> >>>> > > > 2017-02-28
> >>>> > > >
> >>>> > > > When were the last committers or PMC members elected?
> >>>> > > >
> >>>> > > > Podling committers (3) added:
> >>>> > > > Lisa Owen: January 31, 2017
> >>>> > > > Jane Beckman: February 1, 2017
> >>>> > > > Kyle Dunn: March 2, 2017
> >>>> > > >
> >>>> > > > PPMC member (1) added:
> >>>> > > > Paul Guo: March 10, 2017
> >>>> > > >
> >>>> > > > Signed-off-by:
> >>>> > > >
> >>>> > > > [ ](hawq) Alan Gates
> >>>> > > > Comments:
> >>>> > > > [ ](hawq) Konstantin Boudnik
> >>>> > > > Comments:
> >>>> > > > [ ](hawq) Justin Erenkrantz
> >>>> > > > Comments:
> >>>> > > > [ ](hawq) Thejas Nair
> >>>> > > > Comments:
> >>>> > > > [ ](hawq) Roman Shaposhnik
> >>>> > > > Comments:
> >>>> > > >
> >>>> > > > IPMC/Shepherd notes:
> >>>> > > >
> >>>> > > >
> >>>> > > >
> >>>> > >
> >>>> >
> >>>> >
> >>>> >
> >>>> > --
> >>>> > *Ed Espino*
> >>>> >
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> *Ed Espino*
> >>>
> >>
> >>
> >
> >
> > --
> > *Ed Espino*
> >
> >
>
>
> --
> *Ed Espino*
>
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Thank you Michael, this is a well-deserved report highlight. I have added
the following to the report:
3. Community contribution highlight(s):
* Leveraging the extensible PXF design, a JDBC PXF plugin
was contributed by Devin Jia (github id: jiadexin). This
contribution came from the community and not from the
company which originally donated HAWQ to the ASF.
Warm regrds,
-=e
On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
michael.andre.pearce@me.com> wrote:
>
> I would add note about the new JDBC PXF plugin being contributed by Devin
> Jia. (Kudos to him)
>
> It's a good show of the community contributing and growing outside of just
> Pivotal staff (I think for incubator review this is important) and also the
> benefit of the extensible PXF design the project has done.
>
> On 1 Apr 2017, at 18:05, Ed Espino <es...@apache.org> wrote:
>
> Paul,
>
> Thank you for the input. I have added your suggestions to the report.
>
> Cheers,
> -=e
>
> On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <pa...@gmail.com> wrote:
>
>> Maybe we could include the change for the doc and homepage into the
>> report?
>> We have an open source doc now and the home page is more friendly to
>> users.
>>
>> 2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
>>
>>> Lili,
>>>
>>> I have updated the report. Thank you for the contributions.
>>>
>>> -=e
>>>
>>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>>>
>>>> Hi Ed,
>>>>
>>>> The Apache HAWQ website has been updated to provide clearer
>>>> access to download release artifacts.
>>>>
>>>> We also updated the website to add more information:
>>>> 1. Add more community activities and recorded videos:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>>>> 2. Add design documents for certain components:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>>>
>>>> Thanks
>>>> Lili
>>>>
>>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>>>
>>>> > Ruilong,
>>>> >
>>>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
>>>> report.
>>>> >
>>>> > -=e
>>>> >
>>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>>>> >
>>>> > > Hi Ed,
>>>> > >
>>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>>>> > >
>>>> > > Best regards,
>>>> > > Ruilong Huo
>>>> > >
>>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org>
>>>> wrote:
>>>> > >
>>>> > > > Team HAWQ,
>>>> > > >
>>>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>>>> > covering
>>>> > > > Q1 2017 activity.
>>>> > > >
>>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>>>> > > >
>>>> > > > Please let me know if you have any comments or suggestions and I
>>>> will
>>>> > > update
>>>> > > > the report.
>>>> > > >
>>>> > > > Regards,
>>>> > > > -=e
>>>> > > >
>>>> > > > --
>>>> > > > *Ed Espino*
>>>> > > >
>>>> > > >
>>>> > > > --------------------
>>>> > > > HAWQ
>>>> > > >
>>>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the
>>>> key
>>>> > > > technological advantages of MPP database with the scalability and
>>>> > > > convenience
>>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS
>>>> natively. HAWQ
>>>> > > > delivers industry-leading performance and linear scalability. It
>>>> > provides
>>>> > > > users the tools to confidently and successfully interact with
>>>> petabyte
>>>> > > > range
>>>> > > > data sets. HAWQ provides users with a complete, standards
>>>> compliant SQL
>>>> > > > interface.
>>>> > > >
>>>> > > > HAWQ has been incubating since 2015-09-04.
>>>> > > >
>>>> > > > Three most important issues to address in the move towards
>>>> graduation:
>>>> > > >
>>>> > > > 1. Continue to improve the project's release cadence. To this
>>>> end we
>>>> > > > plan on expanding automation services to support increased
>>>> > > > developer participation.
>>>> > > >
>>>> > > > 2. Continue to expand the community, by adding new contributors
>>>> and
>>>> > > > focusing on making sure that there's a much more robust
>>>> level of
>>>> > > > conversations and discussions happening around roadmaps and
>>>> > > > feature development on the public dev mailing list.
>>>> > > >
>>>> > > > 3. Expand release artifacts to include the delivery of binary
>>>> > > > artifacts. We expect the project to significantly refine the
>>>> > > > binary release process in several key areas.
>>>> > > >
>>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need
>>>> to be
>>>> > > > aware of?
>>>> > > >
>>>> > > > 1. Nothing urgent at this time.
>>>> > > >
>>>> > > > How has the community developed since the last report?
>>>> > > >
>>>> > > > 1. Two Meetups took place in Beijing, China:
>>>> > > >
>>>> > > > * HAWQ Meetup (January 123, 2017)
>>>> > > >
>>>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>>>> > > > Engineer
>>>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior
>>>> Engineer
>>>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>>>> > > > Senior Engineer
>>>> > > >
>>>> > > > * HAWQ Meetup (March 23, 2017)
>>>> > > >
>>>> > > > - Apache HAWQ Exploration Step by Step - Configuration,
>>>> Build,
>>>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>>>> > > > Engineer
>>>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>>>> > > > Senior Software Engineer
>>>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen
>>>> Xia,
>>>> > > > Database Expert in Alibaba Cloud
>>>> > > >
>>>> > > > 2. A significant push by the dev community has been made to
>>>> review
>>>> > > > and merge the project's Pull Requests (PR). As of March 30,
>>>> 2017,
>>>> > > > eight of the nine open PRs have been opened in the last ten
>>>> > > > days. The PR opened on Sep 2016 is targeted to be merged
>>>> after
>>>> > > > the Apache 2.2.0.0 release.
>>>> > > >
>>>> > > > 3. Recent porting efforts:
>>>> > > >
>>>> > > > - Persistent Systems Engineers are actively engaging the dev
>>>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>>>> > > > platform.
>>>> > > >
>>>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>>>> > > > published on dev list.
>>>> > > >
>>>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM)
>>>> for
>>>> > > > the upcoming 2.2.0.0 release
>>>> > > >
>>>> > > > How has the project developed since the last report?
>>>> > > >
>>>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>>>> > > >
>>>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>>>> > > > binary release). This is the 3rd release as an incubating
>>>> > > > project.
>>>> > > >
>>>> > > > Release page:
>>>> > > >
>>>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>>>> > > >
>>>> > > > Release hightlights:
>>>> > > >
>>>> > > > * CentOS 7.x Support
>>>> > > > * Ranger Integration
>>>> > > > * PXF ORC Profile
>>>> > > > * Bug Fixes
>>>> > > >
>>>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>>>> > > > member) is publishing (to dev email list) a regular HAWQ
>>>> > Graduation
>>>> > > > update for the
>>>> > > > project.
>>>> > > >
>>>> > > > * HAWQ graduation update (January, 17, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > 3a1e454f8c706dd71b1690c3ae74a1
>>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>>>> > > > access to download release artifacts.
>>>> > > >
>>>> > > > How would you assess the podling's maturity?
>>>> > > > Please feel free to add your own commentary.
>>>> > > >
>>>> > > > [ ] Initial setup
>>>> > > > [ ] Working towards first release
>>>> > > > [X] Community building
>>>> > > > [X] Nearing graduation
>>>> > > > [ ] Other:
>>>> > > >
>>>> > > > Date of last release:
>>>> > > >
>>>> > > > 2017-02-28
>>>> > > >
>>>> > > > When were the last committers or PMC members elected?
>>>> > > >
>>>> > > > Podling committers (3) added:
>>>> > > > Lisa Owen: January 31, 2017
>>>> > > > Jane Beckman: February 1, 2017
>>>> > > > Kyle Dunn: March 2, 2017
>>>> > > >
>>>> > > > PPMC member (1) added:
>>>> > > > Paul Guo: March 10, 2017
>>>> > > >
>>>> > > > Signed-off-by:
>>>> > > >
>>>> > > > [ ](hawq) Alan Gates
>>>> > > > Comments:
>>>> > > > [ ](hawq) Konstantin Boudnik
>>>> > > > Comments:
>>>> > > > [ ](hawq) Justin Erenkrantz
>>>> > > > Comments:
>>>> > > > [ ](hawq) Thejas Nair
>>>> > > > Comments:
>>>> > > > [ ](hawq) Roman Shaposhnik
>>>> > > > Comments:
>>>> > > >
>>>> > > > IPMC/Shepherd notes:
>>>> > > >
>>>> > > >
>>>> > > >
>>>> > >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > *Ed Espino*
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> *Ed Espino*
>>>
>>
>>
>
>
> --
> *Ed Espino*
>
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Thank you Michael, this is a well-deserved report highlight. I have added
the following to the report:
3. Community contribution highlight(s):
* Leveraging the extensible PXF design, a JDBC PXF plugin
was contributed by Devin Jia (github id: jiadexin). This
contribution came from the community and not from the
company which originally donated HAWQ to the ASF.
Warm regrds,
-=e
On Sat, Apr 1, 2017 at 1:14 PM, Michael André Pearce <
michael.andre.pearce@me.com> wrote:
>
> I would add note about the new JDBC PXF plugin being contributed by Devin
> Jia. (Kudos to him)
>
> It's a good show of the community contributing and growing outside of just
> Pivotal staff (I think for incubator review this is important) and also the
> benefit of the extensible PXF design the project has done.
>
> On 1 Apr 2017, at 18:05, Ed Espino <es...@apache.org> wrote:
>
> Paul,
>
> Thank you for the input. I have added your suggestions to the report.
>
> Cheers,
> -=e
>
> On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <pa...@gmail.com> wrote:
>
>> Maybe we could include the change for the doc and homepage into the
>> report?
>> We have an open source doc now and the home page is more friendly to
>> users.
>>
>> 2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
>>
>>> Lili,
>>>
>>> I have updated the report. Thank you for the contributions.
>>>
>>> -=e
>>>
>>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>>>
>>>> Hi Ed,
>>>>
>>>> The Apache HAWQ website has been updated to provide clearer
>>>> access to download release artifacts.
>>>>
>>>> We also updated the website to add more information:
>>>> 1. Add more community activities and recorded videos:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>>>> 2. Add design documents for certain components:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>>>
>>>> Thanks
>>>> Lili
>>>>
>>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>>>
>>>> > Ruilong,
>>>> >
>>>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
>>>> report.
>>>> >
>>>> > -=e
>>>> >
>>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>>>> >
>>>> > > Hi Ed,
>>>> > >
>>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>>>> > >
>>>> > > Best regards,
>>>> > > Ruilong Huo
>>>> > >
>>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org>
>>>> wrote:
>>>> > >
>>>> > > > Team HAWQ,
>>>> > > >
>>>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>>>> > covering
>>>> > > > Q1 2017 activity.
>>>> > > >
>>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>>>> > > >
>>>> > > > Please let me know if you have any comments or suggestions and I
>>>> will
>>>> > > update
>>>> > > > the report.
>>>> > > >
>>>> > > > Regards,
>>>> > > > -=e
>>>> > > >
>>>> > > > --
>>>> > > > *Ed Espino*
>>>> > > >
>>>> > > >
>>>> > > > --------------------
>>>> > > > HAWQ
>>>> > > >
>>>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the
>>>> key
>>>> > > > technological advantages of MPP database with the scalability and
>>>> > > > convenience
>>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS
>>>> natively. HAWQ
>>>> > > > delivers industry-leading performance and linear scalability. It
>>>> > provides
>>>> > > > users the tools to confidently and successfully interact with
>>>> petabyte
>>>> > > > range
>>>> > > > data sets. HAWQ provides users with a complete, standards
>>>> compliant SQL
>>>> > > > interface.
>>>> > > >
>>>> > > > HAWQ has been incubating since 2015-09-04.
>>>> > > >
>>>> > > > Three most important issues to address in the move towards
>>>> graduation:
>>>> > > >
>>>> > > > 1. Continue to improve the project's release cadence. To this
>>>> end we
>>>> > > > plan on expanding automation services to support increased
>>>> > > > developer participation.
>>>> > > >
>>>> > > > 2. Continue to expand the community, by adding new contributors
>>>> and
>>>> > > > focusing on making sure that there's a much more robust
>>>> level of
>>>> > > > conversations and discussions happening around roadmaps and
>>>> > > > feature development on the public dev mailing list.
>>>> > > >
>>>> > > > 3. Expand release artifacts to include the delivery of binary
>>>> > > > artifacts. We expect the project to significantly refine the
>>>> > > > binary release process in several key areas.
>>>> > > >
>>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need
>>>> to be
>>>> > > > aware of?
>>>> > > >
>>>> > > > 1. Nothing urgent at this time.
>>>> > > >
>>>> > > > How has the community developed since the last report?
>>>> > > >
>>>> > > > 1. Two Meetups took place in Beijing, China:
>>>> > > >
>>>> > > > * HAWQ Meetup (January 123, 2017)
>>>> > > >
>>>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>>>> > > > Engineer
>>>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior
>>>> Engineer
>>>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>>>> > > > Senior Engineer
>>>> > > >
>>>> > > > * HAWQ Meetup (March 23, 2017)
>>>> > > >
>>>> > > > - Apache HAWQ Exploration Step by Step - Configuration,
>>>> Build,
>>>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>>>> > > > Engineer
>>>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>>>> > > > Senior Software Engineer
>>>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen
>>>> Xia,
>>>> > > > Database Expert in Alibaba Cloud
>>>> > > >
>>>> > > > 2. A significant push by the dev community has been made to
>>>> review
>>>> > > > and merge the project's Pull Requests (PR). As of March 30,
>>>> 2017,
>>>> > > > eight of the nine open PRs have been opened in the last ten
>>>> > > > days. The PR opened on Sep 2016 is targeted to be merged
>>>> after
>>>> > > > the Apache 2.2.0.0 release.
>>>> > > >
>>>> > > > 3. Recent porting efforts:
>>>> > > >
>>>> > > > - Persistent Systems Engineers are actively engaging the dev
>>>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>>>> > > > platform.
>>>> > > >
>>>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>>>> > > > published on dev list.
>>>> > > >
>>>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM)
>>>> for
>>>> > > > the upcoming 2.2.0.0 release
>>>> > > >
>>>> > > > How has the project developed since the last report?
>>>> > > >
>>>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>>>> > > >
>>>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>>>> > > > binary release). This is the 3rd release as an incubating
>>>> > > > project.
>>>> > > >
>>>> > > > Release page:
>>>> > > >
>>>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>>>> > > >
>>>> > > > Release hightlights:
>>>> > > >
>>>> > > > * CentOS 7.x Support
>>>> > > > * Ranger Integration
>>>> > > > * PXF ORC Profile
>>>> > > > * Bug Fixes
>>>> > > >
>>>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>>>> > > > member) is publishing (to dev email list) a regular HAWQ
>>>> > Graduation
>>>> > > > update for the
>>>> > > > project.
>>>> > > >
>>>> > > > * HAWQ graduation update (January, 17, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > 3a1e454f8c706dd71b1690c3ae74a1
>>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>>>> > > > access to download release artifacts.
>>>> > > >
>>>> > > > How would you assess the podling's maturity?
>>>> > > > Please feel free to add your own commentary.
>>>> > > >
>>>> > > > [ ] Initial setup
>>>> > > > [ ] Working towards first release
>>>> > > > [X] Community building
>>>> > > > [X] Nearing graduation
>>>> > > > [ ] Other:
>>>> > > >
>>>> > > > Date of last release:
>>>> > > >
>>>> > > > 2017-02-28
>>>> > > >
>>>> > > > When were the last committers or PMC members elected?
>>>> > > >
>>>> > > > Podling committers (3) added:
>>>> > > > Lisa Owen: January 31, 2017
>>>> > > > Jane Beckman: February 1, 2017
>>>> > > > Kyle Dunn: March 2, 2017
>>>> > > >
>>>> > > > PPMC member (1) added:
>>>> > > > Paul Guo: March 10, 2017
>>>> > > >
>>>> > > > Signed-off-by:
>>>> > > >
>>>> > > > [ ](hawq) Alan Gates
>>>> > > > Comments:
>>>> > > > [ ](hawq) Konstantin Boudnik
>>>> > > > Comments:
>>>> > > > [ ](hawq) Justin Erenkrantz
>>>> > > > Comments:
>>>> > > > [ ](hawq) Thejas Nair
>>>> > > > Comments:
>>>> > > > [ ](hawq) Roman Shaposhnik
>>>> > > > Comments:
>>>> > > >
>>>> > > > IPMC/Shepherd notes:
>>>> > > >
>>>> > > >
>>>> > > >
>>>> > >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > *Ed Espino*
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> *Ed Espino*
>>>
>>
>>
>
>
> --
> *Ed Espino*
>
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Michael André Pearce <mi...@me.com>.
I would add note about the new JDBC PXF plugin being contributed by Devin Jia. (Kudos to him)
It's a good show of the community contributing and growing outside of just Pivotal staff (I think for incubator review this is important) and also the benefit of the extensible PXF design the project has done.
> On 1 Apr 2017, at 18:05, Ed Espino <es...@apache.org> wrote:
>
> Paul,
>
> Thank you for the input. I have added your suggestions to the report.
>
> Cheers,
> -=e
>
>> On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <pa...@gmail.com> wrote:
>> Maybe we could include the change for the doc and homepage into the report?
>> We have an open source doc now and the home page is more friendly to users.
>>
>> 2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
>>> Lili,
>>>
>>> I have updated the report. Thank you for the contributions.
>>>
>>> -=e
>>>
>>>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>>>> Hi Ed,
>>>>
>>>> The Apache HAWQ website has been updated to provide clearer
>>>> access to download release artifacts.
>>>>
>>>> We also updated the website to add more information:
>>>> 1. Add more community activities and recorded videos:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>>>> 2. Add design documents for certain components:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>>>
>>>> Thanks
>>>> Lili
>>>>
>>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>>>
>>>> > Ruilong,
>>>> >
>>>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the report.
>>>> >
>>>> > -=e
>>>> >
>>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>>>> >
>>>> > > Hi Ed,
>>>> > >
>>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>>>> > >
>>>> > > Best regards,
>>>> > > Ruilong Huo
>>>> > >
>>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>>>> > >
>>>> > > > Team HAWQ,
>>>> > > >
>>>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>>>> > covering
>>>> > > > Q1 2017 activity.
>>>> > > >
>>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>>>> > > >
>>>> > > > Please let me know if you have any comments or suggestions and I will
>>>> > > update
>>>> > > > the report.
>>>> > > >
>>>> > > > Regards,
>>>> > > > -=e
>>>> > > >
>>>> > > > --
>>>> > > > *Ed Espino*
>>>> > > >
>>>> > > >
>>>> > > > --------------------
>>>> > > > HAWQ
>>>> > > >
>>>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the key
>>>> > > > technological advantages of MPP database with the scalability and
>>>> > > > convenience
>>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
>>>> > > > delivers industry-leading performance and linear scalability. It
>>>> > provides
>>>> > > > users the tools to confidently and successfully interact with petabyte
>>>> > > > range
>>>> > > > data sets. HAWQ provides users with a complete, standards compliant SQL
>>>> > > > interface.
>>>> > > >
>>>> > > > HAWQ has been incubating since 2015-09-04.
>>>> > > >
>>>> > > > Three most important issues to address in the move towards graduation:
>>>> > > >
>>>> > > > 1. Continue to improve the project's release cadence. To this end we
>>>> > > > plan on expanding automation services to support increased
>>>> > > > developer participation.
>>>> > > >
>>>> > > > 2. Continue to expand the community, by adding new contributors and
>>>> > > > focusing on making sure that there's a much more robust level of
>>>> > > > conversations and discussions happening around roadmaps and
>>>> > > > feature development on the public dev mailing list.
>>>> > > >
>>>> > > > 3. Expand release artifacts to include the delivery of binary
>>>> > > > artifacts. We expect the project to significantly refine the
>>>> > > > binary release process in several key areas.
>>>> > > >
>>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
>>>> > > > aware of?
>>>> > > >
>>>> > > > 1. Nothing urgent at this time.
>>>> > > >
>>>> > > > How has the community developed since the last report?
>>>> > > >
>>>> > > > 1. Two Meetups took place in Beijing, China:
>>>> > > >
>>>> > > > * HAWQ Meetup (January 123, 2017)
>>>> > > >
>>>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>>>> > > > Engineer
>>>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
>>>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>>>> > > > Senior Engineer
>>>> > > >
>>>> > > > * HAWQ Meetup (March 23, 2017)
>>>> > > >
>>>> > > > - Apache HAWQ Exploration Step by Step - Configuration, Build,
>>>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>>>> > > > Engineer
>>>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>>>> > > > Senior Software Engineer
>>>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
>>>> > > > Database Expert in Alibaba Cloud
>>>> > > >
>>>> > > > 2. A significant push by the dev community has been made to review
>>>> > > > and merge the project's Pull Requests (PR). As of March 30, 2017,
>>>> > > > eight of the nine open PRs have been opened in the last ten
>>>> > > > days. The PR opened on Sep 2016 is targeted to be merged after
>>>> > > > the Apache 2.2.0.0 release.
>>>> > > >
>>>> > > > 3. Recent porting efforts:
>>>> > > >
>>>> > > > - Persistent Systems Engineers are actively engaging the dev
>>>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>>>> > > > platform.
>>>> > > >
>>>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>>>> > > > published on dev list.
>>>> > > >
>>>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
>>>> > > > the upcoming 2.2.0.0 release
>>>> > > >
>>>> > > > How has the project developed since the last report?
>>>> > > >
>>>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>>>> > > >
>>>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>>>> > > > binary release). This is the 3rd release as an incubating
>>>> > > > project.
>>>> > > >
>>>> > > > Release page:
>>>> > > >
>>>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>>>> > > >
>>>> > > > Release hightlights:
>>>> > > >
>>>> > > > * CentOS 7.x Support
>>>> > > > * Ranger Integration
>>>> > > > * PXF ORC Profile
>>>> > > > * Bug Fixes
>>>> > > >
>>>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>>>> > > > member) is publishing (to dev email list) a regular HAWQ
>>>> > Graduation
>>>> > > > update for the
>>>> > > > project.
>>>> > > >
>>>> > > > * HAWQ graduation update (January, 17, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > 3a1e454f8c706dd71b1690c3ae74a1
>>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>>>> > > > access to download release artifacts.
>>>> > > >
>>>> > > > How would you assess the podling's maturity?
>>>> > > > Please feel free to add your own commentary.
>>>> > > >
>>>> > > > [ ] Initial setup
>>>> > > > [ ] Working towards first release
>>>> > > > [X] Community building
>>>> > > > [X] Nearing graduation
>>>> > > > [ ] Other:
>>>> > > >
>>>> > > > Date of last release:
>>>> > > >
>>>> > > > 2017-02-28
>>>> > > >
>>>> > > > When were the last committers or PMC members elected?
>>>> > > >
>>>> > > > Podling committers (3) added:
>>>> > > > Lisa Owen: January 31, 2017
>>>> > > > Jane Beckman: February 1, 2017
>>>> > > > Kyle Dunn: March 2, 2017
>>>> > > >
>>>> > > > PPMC member (1) added:
>>>> > > > Paul Guo: March 10, 2017
>>>> > > >
>>>> > > > Signed-off-by:
>>>> > > >
>>>> > > > [ ](hawq) Alan Gates
>>>> > > > Comments:
>>>> > > > [ ](hawq) Konstantin Boudnik
>>>> > > > Comments:
>>>> > > > [ ](hawq) Justin Erenkrantz
>>>> > > > Comments:
>>>> > > > [ ](hawq) Thejas Nair
>>>> > > > Comments:
>>>> > > > [ ](hawq) Roman Shaposhnik
>>>> > > > Comments:
>>>> > > >
>>>> > > > IPMC/Shepherd notes:
>>>> > > >
>>>> > > >
>>>> > > >
>>>> > >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > *Ed Espino*
>>>> >
>>>
>>>
>>>
>>> --
>>> Ed Espino
>>
>
>
>
> --
> Ed Espino
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Michael André Pearce <mi...@me.com>.
I would add note about the new JDBC PXF plugin being contributed by Devin Jia. (Kudos to him)
It's a good show of the community contributing and growing outside of just Pivotal staff (I think for incubator review this is important) and also the benefit of the extensible PXF design the project has done.
> On 1 Apr 2017, at 18:05, Ed Espino <es...@apache.org> wrote:
>
> Paul,
>
> Thank you for the input. I have added your suggestions to the report.
>
> Cheers,
> -=e
>
>> On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <pa...@gmail.com> wrote:
>> Maybe we could include the change for the doc and homepage into the report?
>> We have an open source doc now and the home page is more friendly to users.
>>
>> 2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
>>> Lili,
>>>
>>> I have updated the report. Thank you for the contributions.
>>>
>>> -=e
>>>
>>>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>>>> Hi Ed,
>>>>
>>>> The Apache HAWQ website has been updated to provide clearer
>>>> access to download release artifacts.
>>>>
>>>> We also updated the website to add more information:
>>>> 1. Add more community activities and recorded videos:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>>>> 2. Add design documents for certain components:
>>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>>>
>>>> Thanks
>>>> Lili
>>>>
>>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>>>
>>>> > Ruilong,
>>>> >
>>>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the report.
>>>> >
>>>> > -=e
>>>> >
>>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>>>> >
>>>> > > Hi Ed,
>>>> > >
>>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>>>> > >
>>>> > > Best regards,
>>>> > > Ruilong Huo
>>>> > >
>>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>>>> > >
>>>> > > > Team HAWQ,
>>>> > > >
>>>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>>>> > covering
>>>> > > > Q1 2017 activity.
>>>> > > >
>>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>>>> > > >
>>>> > > > Please let me know if you have any comments or suggestions and I will
>>>> > > update
>>>> > > > the report.
>>>> > > >
>>>> > > > Regards,
>>>> > > > -=e
>>>> > > >
>>>> > > > --
>>>> > > > *Ed Espino*
>>>> > > >
>>>> > > >
>>>> > > > --------------------
>>>> > > > HAWQ
>>>> > > >
>>>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the key
>>>> > > > technological advantages of MPP database with the scalability and
>>>> > > > convenience
>>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
>>>> > > > delivers industry-leading performance and linear scalability. It
>>>> > provides
>>>> > > > users the tools to confidently and successfully interact with petabyte
>>>> > > > range
>>>> > > > data sets. HAWQ provides users with a complete, standards compliant SQL
>>>> > > > interface.
>>>> > > >
>>>> > > > HAWQ has been incubating since 2015-09-04.
>>>> > > >
>>>> > > > Three most important issues to address in the move towards graduation:
>>>> > > >
>>>> > > > 1. Continue to improve the project's release cadence. To this end we
>>>> > > > plan on expanding automation services to support increased
>>>> > > > developer participation.
>>>> > > >
>>>> > > > 2. Continue to expand the community, by adding new contributors and
>>>> > > > focusing on making sure that there's a much more robust level of
>>>> > > > conversations and discussions happening around roadmaps and
>>>> > > > feature development on the public dev mailing list.
>>>> > > >
>>>> > > > 3. Expand release artifacts to include the delivery of binary
>>>> > > > artifacts. We expect the project to significantly refine the
>>>> > > > binary release process in several key areas.
>>>> > > >
>>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
>>>> > > > aware of?
>>>> > > >
>>>> > > > 1. Nothing urgent at this time.
>>>> > > >
>>>> > > > How has the community developed since the last report?
>>>> > > >
>>>> > > > 1. Two Meetups took place in Beijing, China:
>>>> > > >
>>>> > > > * HAWQ Meetup (January 123, 2017)
>>>> > > >
>>>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>>>> > > > Engineer
>>>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
>>>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>>>> > > > Senior Engineer
>>>> > > >
>>>> > > > * HAWQ Meetup (March 23, 2017)
>>>> > > >
>>>> > > > - Apache HAWQ Exploration Step by Step - Configuration, Build,
>>>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>>>> > > > Engineer
>>>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>>>> > > > Senior Software Engineer
>>>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
>>>> > > > Database Expert in Alibaba Cloud
>>>> > > >
>>>> > > > 2. A significant push by the dev community has been made to review
>>>> > > > and merge the project's Pull Requests (PR). As of March 30, 2017,
>>>> > > > eight of the nine open PRs have been opened in the last ten
>>>> > > > days. The PR opened on Sep 2016 is targeted to be merged after
>>>> > > > the Apache 2.2.0.0 release.
>>>> > > >
>>>> > > > 3. Recent porting efforts:
>>>> > > >
>>>> > > > - Persistent Systems Engineers are actively engaging the dev
>>>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>>>> > > > platform.
>>>> > > >
>>>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>>>> > > > published on dev list.
>>>> > > >
>>>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
>>>> > > > the upcoming 2.2.0.0 release
>>>> > > >
>>>> > > > How has the project developed since the last report?
>>>> > > >
>>>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>>>> > > >
>>>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>>>> > > > binary release). This is the 3rd release as an incubating
>>>> > > > project.
>>>> > > >
>>>> > > > Release page:
>>>> > > >
>>>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>>>> > > >
>>>> > > > Release hightlights:
>>>> > > >
>>>> > > > * CentOS 7.x Support
>>>> > > > * Ranger Integration
>>>> > > > * PXF ORC Profile
>>>> > > > * Bug Fixes
>>>> > > >
>>>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>>>> > > > member) is publishing (to dev email list) a regular HAWQ
>>>> > Graduation
>>>> > > > update for the
>>>> > > > project.
>>>> > > >
>>>> > > > * HAWQ graduation update (January, 17, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>>>> > > > https://lists.apache.org/thread.html/
>>>> > > 3a1e454f8c706dd71b1690c3ae74a1
>>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>>>> > > >
>>>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>>>> > > > access to download release artifacts.
>>>> > > >
>>>> > > > How would you assess the podling's maturity?
>>>> > > > Please feel free to add your own commentary.
>>>> > > >
>>>> > > > [ ] Initial setup
>>>> > > > [ ] Working towards first release
>>>> > > > [X] Community building
>>>> > > > [X] Nearing graduation
>>>> > > > [ ] Other:
>>>> > > >
>>>> > > > Date of last release:
>>>> > > >
>>>> > > > 2017-02-28
>>>> > > >
>>>> > > > When were the last committers or PMC members elected?
>>>> > > >
>>>> > > > Podling committers (3) added:
>>>> > > > Lisa Owen: January 31, 2017
>>>> > > > Jane Beckman: February 1, 2017
>>>> > > > Kyle Dunn: March 2, 2017
>>>> > > >
>>>> > > > PPMC member (1) added:
>>>> > > > Paul Guo: March 10, 2017
>>>> > > >
>>>> > > > Signed-off-by:
>>>> > > >
>>>> > > > [ ](hawq) Alan Gates
>>>> > > > Comments:
>>>> > > > [ ](hawq) Konstantin Boudnik
>>>> > > > Comments:
>>>> > > > [ ](hawq) Justin Erenkrantz
>>>> > > > Comments:
>>>> > > > [ ](hawq) Thejas Nair
>>>> > > > Comments:
>>>> > > > [ ](hawq) Roman Shaposhnik
>>>> > > > Comments:
>>>> > > >
>>>> > > > IPMC/Shepherd notes:
>>>> > > >
>>>> > > >
>>>> > > >
>>>> > >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > *Ed Espino*
>>>> >
>>>
>>>
>>>
>>> --
>>> Ed Espino
>>
>
>
>
> --
> Ed Espino
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Paul,
Thank you for the input. I have added your suggestions to the report.
Cheers,
-=e
On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <pa...@gmail.com> wrote:
> Maybe we could include the change for the doc and homepage into the report?
> We have an open source doc now and the home page is more friendly to users.
>
> 2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
>
>> Lili,
>>
>> I have updated the report. Thank you for the contributions.
>>
>> -=e
>>
>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>>
>>> Hi Ed,
>>>
>>> The Apache HAWQ website has been updated to provide clearer
>>> access to download release artifacts.
>>>
>>> We also updated the website to add more information:
>>> 1. Add more community activities and recorded videos:
>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>>> 2. Add design documents for certain components:
>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>>
>>> Thanks
>>> Lili
>>>
>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>>
>>> > Ruilong,
>>> >
>>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
>>> report.
>>> >
>>> > -=e
>>> >
>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>>> >
>>> > > Hi Ed,
>>> > >
>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>>> > >
>>> > > Best regards,
>>> > > Ruilong Huo
>>> > >
>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>>> > >
>>> > > > Team HAWQ,
>>> > > >
>>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>>> > covering
>>> > > > Q1 2017 activity.
>>> > > >
>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>>> > > >
>>> > > > Please let me know if you have any comments or suggestions and I
>>> will
>>> > > update
>>> > > > the report.
>>> > > >
>>> > > > Regards,
>>> > > > -=e
>>> > > >
>>> > > > --
>>> > > > *Ed Espino*
>>> > > >
>>> > > >
>>> > > > --------------------
>>> > > > HAWQ
>>> > > >
>>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the
>>> key
>>> > > > technological advantages of MPP database with the scalability and
>>> > > > convenience
>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively.
>>> HAWQ
>>> > > > delivers industry-leading performance and linear scalability. It
>>> > provides
>>> > > > users the tools to confidently and successfully interact with
>>> petabyte
>>> > > > range
>>> > > > data sets. HAWQ provides users with a complete, standards
>>> compliant SQL
>>> > > > interface.
>>> > > >
>>> > > > HAWQ has been incubating since 2015-09-04.
>>> > > >
>>> > > > Three most important issues to address in the move towards
>>> graduation:
>>> > > >
>>> > > > 1. Continue to improve the project's release cadence. To this
>>> end we
>>> > > > plan on expanding automation services to support increased
>>> > > > developer participation.
>>> > > >
>>> > > > 2. Continue to expand the community, by adding new contributors
>>> and
>>> > > > focusing on making sure that there's a much more robust level
>>> of
>>> > > > conversations and discussions happening around roadmaps and
>>> > > > feature development on the public dev mailing list.
>>> > > >
>>> > > > 3. Expand release artifacts to include the delivery of binary
>>> > > > artifacts. We expect the project to significantly refine the
>>> > > > binary release process in several key areas.
>>> > > >
>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to
>>> be
>>> > > > aware of?
>>> > > >
>>> > > > 1. Nothing urgent at this time.
>>> > > >
>>> > > > How has the community developed since the last report?
>>> > > >
>>> > > > 1. Two Meetups took place in Beijing, China:
>>> > > >
>>> > > > * HAWQ Meetup (January 123, 2017)
>>> > > >
>>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>>> > > > Engineer
>>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
>>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>>> > > > Senior Engineer
>>> > > >
>>> > > > * HAWQ Meetup (March 23, 2017)
>>> > > >
>>> > > > - Apache HAWQ Exploration Step by Step - Configuration,
>>> Build,
>>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>>> > > > Engineer
>>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>>> > > > Senior Software Engineer
>>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen
>>> Xia,
>>> > > > Database Expert in Alibaba Cloud
>>> > > >
>>> > > > 2. A significant push by the dev community has been made to
>>> review
>>> > > > and merge the project's Pull Requests (PR). As of March 30,
>>> 2017,
>>> > > > eight of the nine open PRs have been opened in the last ten
>>> > > > days. The PR opened on Sep 2016 is targeted to be merged after
>>> > > > the Apache 2.2.0.0 release.
>>> > > >
>>> > > > 3. Recent porting efforts:
>>> > > >
>>> > > > - Persistent Systems Engineers are actively engaging the dev
>>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>>> > > > platform.
>>> > > >
>>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>>> > > > published on dev list.
>>> > > >
>>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
>>> > > > the upcoming 2.2.0.0 release
>>> > > >
>>> > > > How has the project developed since the last report?
>>> > > >
>>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>>> > > >
>>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>>> > > > binary release). This is the 3rd release as an incubating
>>> > > > project.
>>> > > >
>>> > > > Release page:
>>> > > >
>>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>>> > > >
>>> > > > Release hightlights:
>>> > > >
>>> > > > * CentOS 7.x Support
>>> > > > * Ranger Integration
>>> > > > * PXF ORC Profile
>>> > > > * Bug Fixes
>>> > > >
>>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>>> > > > member) is publishing (to dev email list) a regular HAWQ
>>> > Graduation
>>> > > > update for the
>>> > > > project.
>>> > > >
>>> > > > * HAWQ graduation update (January, 17, 2017)
>>> > > > https://lists.apache.org/thread.html/
>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>>> > > >
>>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>>> > > > https://lists.apache.org/thread.html/
>>> > > 3a1e454f8c706dd71b1690c3ae74a1
>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>>> > > >
>>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>>> > > > access to download release artifacts.
>>> > > >
>>> > > > How would you assess the podling's maturity?
>>> > > > Please feel free to add your own commentary.
>>> > > >
>>> > > > [ ] Initial setup
>>> > > > [ ] Working towards first release
>>> > > > [X] Community building
>>> > > > [X] Nearing graduation
>>> > > > [ ] Other:
>>> > > >
>>> > > > Date of last release:
>>> > > >
>>> > > > 2017-02-28
>>> > > >
>>> > > > When were the last committers or PMC members elected?
>>> > > >
>>> > > > Podling committers (3) added:
>>> > > > Lisa Owen: January 31, 2017
>>> > > > Jane Beckman: February 1, 2017
>>> > > > Kyle Dunn: March 2, 2017
>>> > > >
>>> > > > PPMC member (1) added:
>>> > > > Paul Guo: March 10, 2017
>>> > > >
>>> > > > Signed-off-by:
>>> > > >
>>> > > > [ ](hawq) Alan Gates
>>> > > > Comments:
>>> > > > [ ](hawq) Konstantin Boudnik
>>> > > > Comments:
>>> > > > [ ](hawq) Justin Erenkrantz
>>> > > > Comments:
>>> > > > [ ](hawq) Thejas Nair
>>> > > > Comments:
>>> > > > [ ](hawq) Roman Shaposhnik
>>> > > > Comments:
>>> > > >
>>> > > > IPMC/Shepherd notes:
>>> > > >
>>> > > >
>>> > > >
>>> > >
>>> >
>>> >
>>> >
>>> > --
>>> > *Ed Espino*
>>> >
>>>
>>
>>
>>
>> --
>> *Ed Espino*
>>
>
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Paul,
Thank you for the input. I have added your suggestions to the report.
Cheers,
-=e
On Sat, Apr 1, 2017 at 2:55 AM, Paul Guo <pa...@gmail.com> wrote:
> Maybe we could include the change for the doc and homepage into the report?
> We have an open source doc now and the home page is more friendly to users.
>
> 2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
>
>> Lili,
>>
>> I have updated the report. Thank you for the contributions.
>>
>> -=e
>>
>> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>>
>>> Hi Ed,
>>>
>>> The Apache HAWQ website has been updated to provide clearer
>>> access to download release artifacts.
>>>
>>> We also updated the website to add more information:
>>> 1. Add more community activities and recorded videos:
>>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>>> 2. Add design documents for certain components:
>>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>>
>>> Thanks
>>> Lili
>>>
>>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>>
>>> > Ruilong,
>>> >
>>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
>>> report.
>>> >
>>> > -=e
>>> >
>>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>>> >
>>> > > Hi Ed,
>>> > >
>>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>>> > >
>>> > > Best regards,
>>> > > Ruilong Huo
>>> > >
>>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>>> > >
>>> > > > Team HAWQ,
>>> > > >
>>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>>> > covering
>>> > > > Q1 2017 activity.
>>> > > >
>>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>>> > > >
>>> > > > Please let me know if you have any comments or suggestions and I
>>> will
>>> > > update
>>> > > > the report.
>>> > > >
>>> > > > Regards,
>>> > > > -=e
>>> > > >
>>> > > > --
>>> > > > *Ed Espino*
>>> > > >
>>> > > >
>>> > > > --------------------
>>> > > > HAWQ
>>> > > >
>>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the
>>> key
>>> > > > technological advantages of MPP database with the scalability and
>>> > > > convenience
>>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively.
>>> HAWQ
>>> > > > delivers industry-leading performance and linear scalability. It
>>> > provides
>>> > > > users the tools to confidently and successfully interact with
>>> petabyte
>>> > > > range
>>> > > > data sets. HAWQ provides users with a complete, standards
>>> compliant SQL
>>> > > > interface.
>>> > > >
>>> > > > HAWQ has been incubating since 2015-09-04.
>>> > > >
>>> > > > Three most important issues to address in the move towards
>>> graduation:
>>> > > >
>>> > > > 1. Continue to improve the project's release cadence. To this
>>> end we
>>> > > > plan on expanding automation services to support increased
>>> > > > developer participation.
>>> > > >
>>> > > > 2. Continue to expand the community, by adding new contributors
>>> and
>>> > > > focusing on making sure that there's a much more robust level
>>> of
>>> > > > conversations and discussions happening around roadmaps and
>>> > > > feature development on the public dev mailing list.
>>> > > >
>>> > > > 3. Expand release artifacts to include the delivery of binary
>>> > > > artifacts. We expect the project to significantly refine the
>>> > > > binary release process in several key areas.
>>> > > >
>>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to
>>> be
>>> > > > aware of?
>>> > > >
>>> > > > 1. Nothing urgent at this time.
>>> > > >
>>> > > > How has the community developed since the last report?
>>> > > >
>>> > > > 1. Two Meetups took place in Beijing, China:
>>> > > >
>>> > > > * HAWQ Meetup (January 123, 2017)
>>> > > >
>>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>>> > > > Engineer
>>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
>>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>>> > > > Senior Engineer
>>> > > >
>>> > > > * HAWQ Meetup (March 23, 2017)
>>> > > >
>>> > > > - Apache HAWQ Exploration Step by Step - Configuration,
>>> Build,
>>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>>> > > > Engineer
>>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>>> > > > Senior Software Engineer
>>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen
>>> Xia,
>>> > > > Database Expert in Alibaba Cloud
>>> > > >
>>> > > > 2. A significant push by the dev community has been made to
>>> review
>>> > > > and merge the project's Pull Requests (PR). As of March 30,
>>> 2017,
>>> > > > eight of the nine open PRs have been opened in the last ten
>>> > > > days. The PR opened on Sep 2016 is targeted to be merged after
>>> > > > the Apache 2.2.0.0 release.
>>> > > >
>>> > > > 3. Recent porting efforts:
>>> > > >
>>> > > > - Persistent Systems Engineers are actively engaging the dev
>>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>>> > > > platform.
>>> > > >
>>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>>> > > > published on dev list.
>>> > > >
>>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
>>> > > > the upcoming 2.2.0.0 release
>>> > > >
>>> > > > How has the project developed since the last report?
>>> > > >
>>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>>> > > >
>>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>>> > > > binary release). This is the 3rd release as an incubating
>>> > > > project.
>>> > > >
>>> > > > Release page:
>>> > > >
>>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>>> > > >
>>> > > > Release hightlights:
>>> > > >
>>> > > > * CentOS 7.x Support
>>> > > > * Ranger Integration
>>> > > > * PXF ORC Profile
>>> > > > * Bug Fixes
>>> > > >
>>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>>> > > > member) is publishing (to dev email list) a regular HAWQ
>>> > Graduation
>>> > > > update for the
>>> > > > project.
>>> > > >
>>> > > > * HAWQ graduation update (January, 17, 2017)
>>> > > > https://lists.apache.org/thread.html/
>>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>>> > > >
>>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>>> > > > https://lists.apache.org/thread.html/
>>> > > 3a1e454f8c706dd71b1690c3ae74a1
>>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>>> > > >
>>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>>> > > > access to download release artifacts.
>>> > > >
>>> > > > How would you assess the podling's maturity?
>>> > > > Please feel free to add your own commentary.
>>> > > >
>>> > > > [ ] Initial setup
>>> > > > [ ] Working towards first release
>>> > > > [X] Community building
>>> > > > [X] Nearing graduation
>>> > > > [ ] Other:
>>> > > >
>>> > > > Date of last release:
>>> > > >
>>> > > > 2017-02-28
>>> > > >
>>> > > > When were the last committers or PMC members elected?
>>> > > >
>>> > > > Podling committers (3) added:
>>> > > > Lisa Owen: January 31, 2017
>>> > > > Jane Beckman: February 1, 2017
>>> > > > Kyle Dunn: March 2, 2017
>>> > > >
>>> > > > PPMC member (1) added:
>>> > > > Paul Guo: March 10, 2017
>>> > > >
>>> > > > Signed-off-by:
>>> > > >
>>> > > > [ ](hawq) Alan Gates
>>> > > > Comments:
>>> > > > [ ](hawq) Konstantin Boudnik
>>> > > > Comments:
>>> > > > [ ](hawq) Justin Erenkrantz
>>> > > > Comments:
>>> > > > [ ](hawq) Thejas Nair
>>> > > > Comments:
>>> > > > [ ](hawq) Roman Shaposhnik
>>> > > > Comments:
>>> > > >
>>> > > > IPMC/Shepherd notes:
>>> > > >
>>> > > >
>>> > > >
>>> > >
>>> >
>>> >
>>> >
>>> > --
>>> > *Ed Espino*
>>> >
>>>
>>
>>
>>
>> --
>> *Ed Espino*
>>
>
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Paul Guo <pa...@gmail.com>.
Maybe we could include the change for the doc and homepage into the report?
We have an open source doc now and the home page is more friendly to users.
2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
> Lili,
>
> I have updated the report. Thank you for the contributions.
>
> -=e
>
> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>
>> Hi Ed,
>>
>> The Apache HAWQ website has been updated to provide clearer
>> access to download release artifacts.
>>
>> We also updated the website to add more information:
>> 1. Add more community activities and recorded videos:
>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>> 2. Add design documents for certain components:
>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>
>> Thanks
>> Lili
>>
>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>
>> > Ruilong,
>> >
>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
>> report.
>> >
>> > -=e
>> >
>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>> >
>> > > Hi Ed,
>> > >
>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>> > >
>> > > Best regards,
>> > > Ruilong Huo
>> > >
>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>> > >
>> > > > Team HAWQ,
>> > > >
>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>> > covering
>> > > > Q1 2017 activity.
>> > > >
>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>> > > >
>> > > > Please let me know if you have any comments or suggestions and I
>> will
>> > > update
>> > > > the report.
>> > > >
>> > > > Regards,
>> > > > -=e
>> > > >
>> > > > --
>> > > > *Ed Espino*
>> > > >
>> > > >
>> > > > --------------------
>> > > > HAWQ
>> > > >
>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the
>> key
>> > > > technological advantages of MPP database with the scalability and
>> > > > convenience
>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively.
>> HAWQ
>> > > > delivers industry-leading performance and linear scalability. It
>> > provides
>> > > > users the tools to confidently and successfully interact with
>> petabyte
>> > > > range
>> > > > data sets. HAWQ provides users with a complete, standards compliant
>> SQL
>> > > > interface.
>> > > >
>> > > > HAWQ has been incubating since 2015-09-04.
>> > > >
>> > > > Three most important issues to address in the move towards
>> graduation:
>> > > >
>> > > > 1. Continue to improve the project's release cadence. To this end
>> we
>> > > > plan on expanding automation services to support increased
>> > > > developer participation.
>> > > >
>> > > > 2. Continue to expand the community, by adding new contributors
>> and
>> > > > focusing on making sure that there's a much more robust level
>> of
>> > > > conversations and discussions happening around roadmaps and
>> > > > feature development on the public dev mailing list.
>> > > >
>> > > > 3. Expand release artifacts to include the delivery of binary
>> > > > artifacts. We expect the project to significantly refine the
>> > > > binary release process in several key areas.
>> > > >
>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to
>> be
>> > > > aware of?
>> > > >
>> > > > 1. Nothing urgent at this time.
>> > > >
>> > > > How has the community developed since the last report?
>> > > >
>> > > > 1. Two Meetups took place in Beijing, China:
>> > > >
>> > > > * HAWQ Meetup (January 123, 2017)
>> > > >
>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>> > > > Engineer
>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>> > > > Senior Engineer
>> > > >
>> > > > * HAWQ Meetup (March 23, 2017)
>> > > >
>> > > > - Apache HAWQ Exploration Step by Step - Configuration,
>> Build,
>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>> > > > Engineer
>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>> > > > Senior Software Engineer
>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen
>> Xia,
>> > > > Database Expert in Alibaba Cloud
>> > > >
>> > > > 2. A significant push by the dev community has been made to review
>> > > > and merge the project's Pull Requests (PR). As of March 30,
>> 2017,
>> > > > eight of the nine open PRs have been opened in the last ten
>> > > > days. The PR opened on Sep 2016 is targeted to be merged after
>> > > > the Apache 2.2.0.0 release.
>> > > >
>> > > > 3. Recent porting efforts:
>> > > >
>> > > > - Persistent Systems Engineers are actively engaging the dev
>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>> > > > platform.
>> > > >
>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>> > > > published on dev list.
>> > > >
>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
>> > > > the upcoming 2.2.0.0 release
>> > > >
>> > > > How has the project developed since the last report?
>> > > >
>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>> > > >
>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>> > > > binary release). This is the 3rd release as an incubating
>> > > > project.
>> > > >
>> > > > Release page:
>> > > >
>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>> > > >
>> > > > Release hightlights:
>> > > >
>> > > > * CentOS 7.x Support
>> > > > * Ranger Integration
>> > > > * PXF ORC Profile
>> > > > * Bug Fixes
>> > > >
>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>> > > > member) is publishing (to dev email list) a regular HAWQ
>> > Graduation
>> > > > update for the
>> > > > project.
>> > > >
>> > > > * HAWQ graduation update (January, 17, 2017)
>> > > > https://lists.apache.org/thread.html/
>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>> > > >
>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>> > > > https://lists.apache.org/thread.html/
>> > > 3a1e454f8c706dd71b1690c3ae74a1
>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>> > > >
>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>> > > > access to download release artifacts.
>> > > >
>> > > > How would you assess the podling's maturity?
>> > > > Please feel free to add your own commentary.
>> > > >
>> > > > [ ] Initial setup
>> > > > [ ] Working towards first release
>> > > > [X] Community building
>> > > > [X] Nearing graduation
>> > > > [ ] Other:
>> > > >
>> > > > Date of last release:
>> > > >
>> > > > 2017-02-28
>> > > >
>> > > > When were the last committers or PMC members elected?
>> > > >
>> > > > Podling committers (3) added:
>> > > > Lisa Owen: January 31, 2017
>> > > > Jane Beckman: February 1, 2017
>> > > > Kyle Dunn: March 2, 2017
>> > > >
>> > > > PPMC member (1) added:
>> > > > Paul Guo: March 10, 2017
>> > > >
>> > > > Signed-off-by:
>> > > >
>> > > > [ ](hawq) Alan Gates
>> > > > Comments:
>> > > > [ ](hawq) Konstantin Boudnik
>> > > > Comments:
>> > > > [ ](hawq) Justin Erenkrantz
>> > > > Comments:
>> > > > [ ](hawq) Thejas Nair
>> > > > Comments:
>> > > > [ ](hawq) Roman Shaposhnik
>> > > > Comments:
>> > > >
>> > > > IPMC/Shepherd notes:
>> > > >
>> > > >
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > *Ed Espino*
>> >
>>
>
>
>
> --
> *Ed Espino*
>
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Paul Guo <pa...@gmail.com>.
Maybe we could include the change for the doc and homepage into the report?
We have an open source doc now and the home page is more friendly to users.
2017-04-01 13:52 GMT+08:00 Ed Espino <es...@apache.org>:
> Lili,
>
> I have updated the report. Thank you for the contributions.
>
> -=e
>
> On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
>
>> Hi Ed,
>>
>> The Apache HAWQ website has been updated to provide clearer
>> access to download release artifacts.
>>
>> We also updated the website to add more information:
>> 1. Add more community activities and recorded videos:
>> https://cwiki.apache.org/confluence/display/HAWQ/Community
>> 2. Add design documents for certain components:
>> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>>
>> Thanks
>> Lili
>>
>> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>>
>> > Ruilong,
>> >
>> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
>> report.
>> >
>> > -=e
>> >
>> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>> >
>> > > Hi Ed,
>> > >
>> > > One typo is that HAWQ Meetup is on January 12, 2017.
>> > >
>> > > Best regards,
>> > > Ruilong Huo
>> > >
>> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>> > >
>> > > > Team HAWQ,
>> > > >
>> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
>> > covering
>> > > > Q1 2017 activity.
>> > > >
>> > > > It is posted at http://wiki.apache.org/incubator/April2017
>> > > >
>> > > > Please let me know if you have any comments or suggestions and I
>> will
>> > > update
>> > > > the report.
>> > > >
>> > > > Regards,
>> > > > -=e
>> > > >
>> > > > --
>> > > > *Ed Espino*
>> > > >
>> > > >
>> > > > --------------------
>> > > > HAWQ
>> > > >
>> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the
>> key
>> > > > technological advantages of MPP database with the scalability and
>> > > > convenience
>> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively.
>> HAWQ
>> > > > delivers industry-leading performance and linear scalability. It
>> > provides
>> > > > users the tools to confidently and successfully interact with
>> petabyte
>> > > > range
>> > > > data sets. HAWQ provides users with a complete, standards compliant
>> SQL
>> > > > interface.
>> > > >
>> > > > HAWQ has been incubating since 2015-09-04.
>> > > >
>> > > > Three most important issues to address in the move towards
>> graduation:
>> > > >
>> > > > 1. Continue to improve the project's release cadence. To this end
>> we
>> > > > plan on expanding automation services to support increased
>> > > > developer participation.
>> > > >
>> > > > 2. Continue to expand the community, by adding new contributors
>> and
>> > > > focusing on making sure that there's a much more robust level
>> of
>> > > > conversations and discussions happening around roadmaps and
>> > > > feature development on the public dev mailing list.
>> > > >
>> > > > 3. Expand release artifacts to include the delivery of binary
>> > > > artifacts. We expect the project to significantly refine the
>> > > > binary release process in several key areas.
>> > > >
>> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to
>> be
>> > > > aware of?
>> > > >
>> > > > 1. Nothing urgent at this time.
>> > > >
>> > > > How has the community developed since the last report?
>> > > >
>> > > > 1. Two Meetups took place in Beijing, China:
>> > > >
>> > > > * HAWQ Meetup (January 123, 2017)
>> > > >
>> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
>> > > > Engineer
>> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
>> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
>> > > > Senior Engineer
>> > > >
>> > > > * HAWQ Meetup (March 23, 2017)
>> > > >
>> > > > - Apache HAWQ Exploration Step by Step - Configuration,
>> Build,
>> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
>> > > > Engineer
>> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
>> > > > Senior Software Engineer
>> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen
>> Xia,
>> > > > Database Expert in Alibaba Cloud
>> > > >
>> > > > 2. A significant push by the dev community has been made to review
>> > > > and merge the project's Pull Requests (PR). As of March 30,
>> 2017,
>> > > > eight of the nine open PRs have been opened in the last ten
>> > > > days. The PR opened on Sep 2016 is targeted to be merged after
>> > > > the Apache 2.2.0.0 release.
>> > > >
>> > > > 3. Recent porting efforts:
>> > > >
>> > > > - Persistent Systems Engineers are actively engaging the dev
>> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
>> > > > platform.
>> > > >
>> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
>> > > > published on dev list.
>> > > >
>> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
>> > > > the upcoming 2.2.0.0 release
>> > > >
>> > > > How has the project developed since the last report?
>> > > >
>> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>> > > >
>> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
>> > > > binary release). This is the 3rd release as an incubating
>> > > > project.
>> > > >
>> > > > Release page:
>> > > >
>> > > > https://cwiki.apache.org/confluence/display/HAWQ/
>> > > > Apache+HAWQ+2.2.0.0-incubating+Release
>> > > >
>> > > > Release hightlights:
>> > > >
>> > > > * CentOS 7.x Support
>> > > > * Ranger Integration
>> > > > * PXF ORC Profile
>> > > > * Bug Fixes
>> > > >
>> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
>> > > > member) is publishing (to dev email list) a regular HAWQ
>> > Graduation
>> > > > update for the
>> > > > project.
>> > > >
>> > > > * HAWQ graduation update (January, 17, 2017)
>> > > > https://lists.apache.org/thread.html/
>> > > cd37e2b48d4bbc9fe4a9cea47f8247
>> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>> > > >
>> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
>> > > > https://lists.apache.org/thread.html/
>> > > 3a1e454f8c706dd71b1690c3ae74a1
>> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>> > > >
>> > > > 4. The Apache HAWQ website has been updated to provide clearer
>> > > > access to download release artifacts.
>> > > >
>> > > > How would you assess the podling's maturity?
>> > > > Please feel free to add your own commentary.
>> > > >
>> > > > [ ] Initial setup
>> > > > [ ] Working towards first release
>> > > > [X] Community building
>> > > > [X] Nearing graduation
>> > > > [ ] Other:
>> > > >
>> > > > Date of last release:
>> > > >
>> > > > 2017-02-28
>> > > >
>> > > > When were the last committers or PMC members elected?
>> > > >
>> > > > Podling committers (3) added:
>> > > > Lisa Owen: January 31, 2017
>> > > > Jane Beckman: February 1, 2017
>> > > > Kyle Dunn: March 2, 2017
>> > > >
>> > > > PPMC member (1) added:
>> > > > Paul Guo: March 10, 2017
>> > > >
>> > > > Signed-off-by:
>> > > >
>> > > > [ ](hawq) Alan Gates
>> > > > Comments:
>> > > > [ ](hawq) Konstantin Boudnik
>> > > > Comments:
>> > > > [ ](hawq) Justin Erenkrantz
>> > > > Comments:
>> > > > [ ](hawq) Thejas Nair
>> > > > Comments:
>> > > > [ ](hawq) Roman Shaposhnik
>> > > > Comments:
>> > > >
>> > > > IPMC/Shepherd notes:
>> > > >
>> > > >
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > *Ed Espino*
>> >
>>
>
>
>
> --
> *Ed Espino*
>
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Lili,
I have updated the report. Thank you for the contributions.
-=e
On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
> Hi Ed,
>
> The Apache HAWQ website has been updated to provide clearer
> access to download release artifacts.
>
> We also updated the website to add more information:
> 1. Add more community activities and recorded videos:
> https://cwiki.apache.org/confluence/display/HAWQ/Community
> 2. Add design documents for certain components:
> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>
> Thanks
> Lili
>
> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>
> > Ruilong,
> >
> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
> report.
> >
> > -=e
> >
> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
> >
> > > Hi Ed,
> > >
> > > One typo is that HAWQ Meetup is on January 12, 2017.
> > >
> > > Best regards,
> > > Ruilong Huo
> > >
> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
> > >
> > > > Team HAWQ,
> > > >
> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
> > covering
> > > > Q1 2017 activity.
> > > >
> > > > It is posted at http://wiki.apache.org/incubator/April2017
> > > >
> > > > Please let me know if you have any comments or suggestions and I will
> > > update
> > > > the report.
> > > >
> > > > Regards,
> > > > -=e
> > > >
> > > > --
> > > > *Ed Espino*
> > > >
> > > >
> > > > --------------------
> > > > HAWQ
> > > >
> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the key
> > > > technological advantages of MPP database with the scalability and
> > > > convenience
> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively.
> HAWQ
> > > > delivers industry-leading performance and linear scalability. It
> > provides
> > > > users the tools to confidently and successfully interact with
> petabyte
> > > > range
> > > > data sets. HAWQ provides users with a complete, standards compliant
> SQL
> > > > interface.
> > > >
> > > > HAWQ has been incubating since 2015-09-04.
> > > >
> > > > Three most important issues to address in the move towards
> graduation:
> > > >
> > > > 1. Continue to improve the project's release cadence. To this end
> we
> > > > plan on expanding automation services to support increased
> > > > developer participation.
> > > >
> > > > 2. Continue to expand the community, by adding new contributors and
> > > > focusing on making sure that there's a much more robust level of
> > > > conversations and discussions happening around roadmaps and
> > > > feature development on the public dev mailing list.
> > > >
> > > > 3. Expand release artifacts to include the delivery of binary
> > > > artifacts. We expect the project to significantly refine the
> > > > binary release process in several key areas.
> > > >
> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> > > > aware of?
> > > >
> > > > 1. Nothing urgent at this time.
> > > >
> > > > How has the community developed since the last report?
> > > >
> > > > 1. Two Meetups took place in Beijing, China:
> > > >
> > > > * HAWQ Meetup (January 123, 2017)
> > > >
> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> > > > Engineer
> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> > > > Senior Engineer
> > > >
> > > > * HAWQ Meetup (March 23, 2017)
> > > >
> > > > - Apache HAWQ Exploration Step by Step - Configuration, Build,
> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
> > > > Engineer
> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> > > > Senior Software Engineer
> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> > > > Database Expert in Alibaba Cloud
> > > >
> > > > 2. A significant push by the dev community has been made to review
> > > > and merge the project's Pull Requests (PR). As of March 30,
> 2017,
> > > > eight of the nine open PRs have been opened in the last ten
> > > > days. The PR opened on Sep 2016 is targeted to be merged after
> > > > the Apache 2.2.0.0 release.
> > > >
> > > > 3. Recent porting efforts:
> > > >
> > > > - Persistent Systems Engineers are actively engaging the dev
> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
> > > > platform.
> > > >
> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> > > > published on dev list.
> > > >
> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> > > > the upcoming 2.2.0.0 release
> > > >
> > > > How has the project developed since the last report?
> > > >
> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> > > >
> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> > > > binary release). This is the 3rd release as an incubating
> > > > project.
> > > >
> > > > Release page:
> > > >
> > > > https://cwiki.apache.org/confluence/display/HAWQ/
> > > > Apache+HAWQ+2.2.0.0-incubating+Release
> > > >
> > > > Release hightlights:
> > > >
> > > > * CentOS 7.x Support
> > > > * Ranger Integration
> > > > * PXF ORC Profile
> > > > * Bug Fixes
> > > >
> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> > > > member) is publishing (to dev email list) a regular HAWQ
> > Graduation
> > > > update for the
> > > > project.
> > > >
> > > > * HAWQ graduation update (January, 17, 2017)
> > > > https://lists.apache.org/thread.html/
> > > cd37e2b48d4bbc9fe4a9cea47f8247
> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> > > >
> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
> > > > https://lists.apache.org/thread.html/
> > > 3a1e454f8c706dd71b1690c3ae74a1
> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> > > >
> > > > 4. The Apache HAWQ website has been updated to provide clearer
> > > > access to download release artifacts.
> > > >
> > > > How would you assess the podling's maturity?
> > > > Please feel free to add your own commentary.
> > > >
> > > > [ ] Initial setup
> > > > [ ] Working towards first release
> > > > [X] Community building
> > > > [X] Nearing graduation
> > > > [ ] Other:
> > > >
> > > > Date of last release:
> > > >
> > > > 2017-02-28
> > > >
> > > > When were the last committers or PMC members elected?
> > > >
> > > > Podling committers (3) added:
> > > > Lisa Owen: January 31, 2017
> > > > Jane Beckman: February 1, 2017
> > > > Kyle Dunn: March 2, 2017
> > > >
> > > > PPMC member (1) added:
> > > > Paul Guo: March 10, 2017
> > > >
> > > > Signed-off-by:
> > > >
> > > > [ ](hawq) Alan Gates
> > > > Comments:
> > > > [ ](hawq) Konstantin Boudnik
> > > > Comments:
> > > > [ ](hawq) Justin Erenkrantz
> > > > Comments:
> > > > [ ](hawq) Thejas Nair
> > > > Comments:
> > > > [ ](hawq) Roman Shaposhnik
> > > > Comments:
> > > >
> > > > IPMC/Shepherd notes:
> > > >
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > *Ed Espino*
> >
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Lili,
I have updated the report. Thank you for the contributions.
-=e
On Fri, Mar 31, 2017 at 10:44 PM, Lili Ma <lm...@pivotal.io> wrote:
> Hi Ed,
>
> The Apache HAWQ website has been updated to provide clearer
> access to download release artifacts.
>
> We also updated the website to add more information:
> 1. Add more community activities and recorded videos:
> https://cwiki.apache.org/confluence/display/HAWQ/Community
> 2. Add design documents for certain components:
> https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
>
> Thanks
> Lili
>
> On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
>
> > Ruilong,
> >
> > Thanks buddy. January 123!!! :) a typo indeed. I have updated the
> report.
> >
> > -=e
> >
> > On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
> >
> > > Hi Ed,
> > >
> > > One typo is that HAWQ Meetup is on January 12, 2017.
> > >
> > > Best regards,
> > > Ruilong Huo
> > >
> > > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
> > >
> > > > Team HAWQ,
> > > >
> > > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
> > covering
> > > > Q1 2017 activity.
> > > >
> > > > It is posted at http://wiki.apache.org/incubator/April2017
> > > >
> > > > Please let me know if you have any comments or suggestions and I will
> > > update
> > > > the report.
> > > >
> > > > Regards,
> > > > -=e
> > > >
> > > > --
> > > > *Ed Espino*
> > > >
> > > >
> > > > --------------------
> > > > HAWQ
> > > >
> > > > Apache HAWQ is a Hadoop native SQL query engine that combines the key
> > > > technological advantages of MPP database with the scalability and
> > > > convenience
> > > > of Hadoop. HAWQ reads data from and writes data to HDFS natively.
> HAWQ
> > > > delivers industry-leading performance and linear scalability. It
> > provides
> > > > users the tools to confidently and successfully interact with
> petabyte
> > > > range
> > > > data sets. HAWQ provides users with a complete, standards compliant
> SQL
> > > > interface.
> > > >
> > > > HAWQ has been incubating since 2015-09-04.
> > > >
> > > > Three most important issues to address in the move towards
> graduation:
> > > >
> > > > 1. Continue to improve the project's release cadence. To this end
> we
> > > > plan on expanding automation services to support increased
> > > > developer participation.
> > > >
> > > > 2. Continue to expand the community, by adding new contributors and
> > > > focusing on making sure that there's a much more robust level of
> > > > conversations and discussions happening around roadmaps and
> > > > feature development on the public dev mailing list.
> > > >
> > > > 3. Expand release artifacts to include the delivery of binary
> > > > artifacts. We expect the project to significantly refine the
> > > > binary release process in several key areas.
> > > >
> > > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> > > > aware of?
> > > >
> > > > 1. Nothing urgent at this time.
> > > >
> > > > How has the community developed since the last report?
> > > >
> > > > 1. Two Meetups took place in Beijing, China:
> > > >
> > > > * HAWQ Meetup (January 123, 2017)
> > > >
> > > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> > > > Engineer
> > > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> > > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> > > > Senior Engineer
> > > >
> > > > * HAWQ Meetup (March 23, 2017)
> > > >
> > > > - Apache HAWQ Exploration Step by Step - Configuration, Build,
> > > > Deployment and Debug by Xiang Sheng, Pivotal Software
> > > > Engineer
> > > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> > > > Senior Software Engineer
> > > > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> > > > Database Expert in Alibaba Cloud
> > > >
> > > > 2. A significant push by the dev community has been made to review
> > > > and merge the project's Pull Requests (PR). As of March 30,
> 2017,
> > > > eight of the nine open PRs have been opened in the last ten
> > > > days. The PR opened on Sep 2016 is targeted to be merged after
> > > > the Apache 2.2.0.0 release.
> > > >
> > > > 3. Recent porting efforts:
> > > >
> > > > - Persistent Systems Engineers are actively engaging the dev
> > > > community on their HAWQ porting efforts to RHEL 7.1 on S390
> > > > platform.
> > > >
> > > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> > > > published on dev list.
> > > >
> > > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> > > > the upcoming 2.2.0.0 release
> > > >
> > > > How has the project developed since the last report?
> > > >
> > > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> > > >
> > > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> > > > binary release). This is the 3rd release as an incubating
> > > > project.
> > > >
> > > > Release page:
> > > >
> > > > https://cwiki.apache.org/confluence/display/HAWQ/
> > > > Apache+HAWQ+2.2.0.0-incubating+Release
> > > >
> > > > Release hightlights:
> > > >
> > > > * CentOS 7.x Support
> > > > * Ranger Integration
> > > > * PXF ORC Profile
> > > > * Bug Fixes
> > > >
> > > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> > > > member) is publishing (to dev email list) a regular HAWQ
> > Graduation
> > > > update for the
> > > > project.
> > > >
> > > > * HAWQ graduation update (January, 17, 2017)
> > > > https://lists.apache.org/thread.html/
> > > cd37e2b48d4bbc9fe4a9cea47f8247
> > > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> > > >
> > > > * Apache HAWQ graduation update (Mar 1st, 2017)
> > > > https://lists.apache.org/thread.html/
> > > 3a1e454f8c706dd71b1690c3ae74a1
> > > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> > > >
> > > > 4. The Apache HAWQ website has been updated to provide clearer
> > > > access to download release artifacts.
> > > >
> > > > How would you assess the podling's maturity?
> > > > Please feel free to add your own commentary.
> > > >
> > > > [ ] Initial setup
> > > > [ ] Working towards first release
> > > > [X] Community building
> > > > [X] Nearing graduation
> > > > [ ] Other:
> > > >
> > > > Date of last release:
> > > >
> > > > 2017-02-28
> > > >
> > > > When were the last committers or PMC members elected?
> > > >
> > > > Podling committers (3) added:
> > > > Lisa Owen: January 31, 2017
> > > > Jane Beckman: February 1, 2017
> > > > Kyle Dunn: March 2, 2017
> > > >
> > > > PPMC member (1) added:
> > > > Paul Guo: March 10, 2017
> > > >
> > > > Signed-off-by:
> > > >
> > > > [ ](hawq) Alan Gates
> > > > Comments:
> > > > [ ](hawq) Konstantin Boudnik
> > > > Comments:
> > > > [ ](hawq) Justin Erenkrantz
> > > > Comments:
> > > > [ ](hawq) Thejas Nair
> > > > Comments:
> > > > [ ](hawq) Roman Shaposhnik
> > > > Comments:
> > > >
> > > > IPMC/Shepherd notes:
> > > >
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > *Ed Espino*
> >
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Lili Ma <lm...@pivotal.io>.
Hi Ed,
The Apache HAWQ website has been updated to provide clearer
access to download release artifacts.
We also updated the website to add more information:
1. Add more community activities and recorded videos:
https://cwiki.apache.org/confluence/display/HAWQ/Community
2. Add design documents for certain components:
https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
Thanks
Lili
On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
> Ruilong,
>
> Thanks buddy. January 123!!! :) a typo indeed. I have updated the report.
>
> -=e
>
> On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>
> > Hi Ed,
> >
> > One typo is that HAWQ Meetup is on January 12, 2017.
> >
> > Best regards,
> > Ruilong Huo
> >
> > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
> >
> > > Team HAWQ,
> > >
> > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
> covering
> > > Q1 2017 activity.
> > >
> > > It is posted at http://wiki.apache.org/incubator/April2017
> > >
> > > Please let me know if you have any comments or suggestions and I will
> > update
> > > the report.
> > >
> > > Regards,
> > > -=e
> > >
> > > --
> > > *Ed Espino*
> > >
> > >
> > > --------------------
> > > HAWQ
> > >
> > > Apache HAWQ is a Hadoop native SQL query engine that combines the key
> > > technological advantages of MPP database with the scalability and
> > > convenience
> > > of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> > > delivers industry-leading performance and linear scalability. It
> provides
> > > users the tools to confidently and successfully interact with petabyte
> > > range
> > > data sets. HAWQ provides users with a complete, standards compliant SQL
> > > interface.
> > >
> > > HAWQ has been incubating since 2015-09-04.
> > >
> > > Three most important issues to address in the move towards graduation:
> > >
> > > 1. Continue to improve the project's release cadence. To this end we
> > > plan on expanding automation services to support increased
> > > developer participation.
> > >
> > > 2. Continue to expand the community, by adding new contributors and
> > > focusing on making sure that there's a much more robust level of
> > > conversations and discussions happening around roadmaps and
> > > feature development on the public dev mailing list.
> > >
> > > 3. Expand release artifacts to include the delivery of binary
> > > artifacts. We expect the project to significantly refine the
> > > binary release process in several key areas.
> > >
> > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> > > aware of?
> > >
> > > 1. Nothing urgent at this time.
> > >
> > > How has the community developed since the last report?
> > >
> > > 1. Two Meetups took place in Beijing, China:
> > >
> > > * HAWQ Meetup (January 123, 2017)
> > >
> > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> > > Engineer
> > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> > > Senior Engineer
> > >
> > > * HAWQ Meetup (March 23, 2017)
> > >
> > > - Apache HAWQ Exploration Step by Step - Configuration, Build,
> > > Deployment and Debug by Xiang Sheng, Pivotal Software
> > > Engineer
> > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> > > Senior Software Engineer
> > > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> > > Database Expert in Alibaba Cloud
> > >
> > > 2. A significant push by the dev community has been made to review
> > > and merge the project's Pull Requests (PR). As of March 30, 2017,
> > > eight of the nine open PRs have been opened in the last ten
> > > days. The PR opened on Sep 2016 is targeted to be merged after
> > > the Apache 2.2.0.0 release.
> > >
> > > 3. Recent porting efforts:
> > >
> > > - Persistent Systems Engineers are actively engaging the dev
> > > community on their HAWQ porting efforts to RHEL 7.1 on S390
> > > platform.
> > >
> > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> > > published on dev list.
> > >
> > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> > > the upcoming 2.2.0.0 release
> > >
> > > How has the project developed since the last report?
> > >
> > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> > >
> > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> > > binary release). This is the 3rd release as an incubating
> > > project.
> > >
> > > Release page:
> > >
> > > https://cwiki.apache.org/confluence/display/HAWQ/
> > > Apache+HAWQ+2.2.0.0-incubating+Release
> > >
> > > Release hightlights:
> > >
> > > * CentOS 7.x Support
> > > * Ranger Integration
> > > * PXF ORC Profile
> > > * Bug Fixes
> > >
> > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> > > member) is publishing (to dev email list) a regular HAWQ
> Graduation
> > > update for the
> > > project.
> > >
> > > * HAWQ graduation update (January, 17, 2017)
> > > https://lists.apache.org/thread.html/
> > cd37e2b48d4bbc9fe4a9cea47f8247
> > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> > >
> > > * Apache HAWQ graduation update (Mar 1st, 2017)
> > > https://lists.apache.org/thread.html/
> > 3a1e454f8c706dd71b1690c3ae74a1
> > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> > >
> > > 4. The Apache HAWQ website has been updated to provide clearer
> > > access to download release artifacts.
> > >
> > > How would you assess the podling's maturity?
> > > Please feel free to add your own commentary.
> > >
> > > [ ] Initial setup
> > > [ ] Working towards first release
> > > [X] Community building
> > > [X] Nearing graduation
> > > [ ] Other:
> > >
> > > Date of last release:
> > >
> > > 2017-02-28
> > >
> > > When were the last committers or PMC members elected?
> > >
> > > Podling committers (3) added:
> > > Lisa Owen: January 31, 2017
> > > Jane Beckman: February 1, 2017
> > > Kyle Dunn: March 2, 2017
> > >
> > > PPMC member (1) added:
> > > Paul Guo: March 10, 2017
> > >
> > > Signed-off-by:
> > >
> > > [ ](hawq) Alan Gates
> > > Comments:
> > > [ ](hawq) Konstantin Boudnik
> > > Comments:
> > > [ ](hawq) Justin Erenkrantz
> > > Comments:
> > > [ ](hawq) Thejas Nair
> > > Comments:
> > > [ ](hawq) Roman Shaposhnik
> > > Comments:
> > >
> > > IPMC/Shepherd notes:
> > >
> > >
> > >
> >
>
>
>
> --
> *Ed Espino*
>
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Lili Ma <lm...@pivotal.io>.
Hi Ed,
The Apache HAWQ website has been updated to provide clearer
access to download release artifacts.
We also updated the website to add more information:
1. Add more community activities and recorded videos:
https://cwiki.apache.org/confluence/display/HAWQ/Community
2. Add design documents for certain components:
https://cwiki.apache.org/confluence/display/HAWQ/Tech+Documents
Thanks
Lili
On Sat, Apr 1, 2017 at 12:16 PM, Ed Espino <es...@apache.org> wrote:
> Ruilong,
>
> Thanks buddy. January 123!!! :) a typo indeed. I have updated the report.
>
> -=e
>
> On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>
> > Hi Ed,
> >
> > One typo is that HAWQ Meetup is on January 12, 2017.
> >
> > Best regards,
> > Ruilong Huo
> >
> > On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
> >
> > > Team HAWQ,
> > >
> > > Below is the draft ASF HAWQ Incubator PMC report for April 2017,
> covering
> > > Q1 2017 activity.
> > >
> > > It is posted at http://wiki.apache.org/incubator/April2017
> > >
> > > Please let me know if you have any comments or suggestions and I will
> > update
> > > the report.
> > >
> > > Regards,
> > > -=e
> > >
> > > --
> > > *Ed Espino*
> > >
> > >
> > > --------------------
> > > HAWQ
> > >
> > > Apache HAWQ is a Hadoop native SQL query engine that combines the key
> > > technological advantages of MPP database with the scalability and
> > > convenience
> > > of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> > > delivers industry-leading performance and linear scalability. It
> provides
> > > users the tools to confidently and successfully interact with petabyte
> > > range
> > > data sets. HAWQ provides users with a complete, standards compliant SQL
> > > interface.
> > >
> > > HAWQ has been incubating since 2015-09-04.
> > >
> > > Three most important issues to address in the move towards graduation:
> > >
> > > 1. Continue to improve the project's release cadence. To this end we
> > > plan on expanding automation services to support increased
> > > developer participation.
> > >
> > > 2. Continue to expand the community, by adding new contributors and
> > > focusing on making sure that there's a much more robust level of
> > > conversations and discussions happening around roadmaps and
> > > feature development on the public dev mailing list.
> > >
> > > 3. Expand release artifacts to include the delivery of binary
> > > artifacts. We expect the project to significantly refine the
> > > binary release process in several key areas.
> > >
> > > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> > > aware of?
> > >
> > > 1. Nothing urgent at this time.
> > >
> > > How has the community developed since the last report?
> > >
> > > 1. Two Meetups took place in Beijing, China:
> > >
> > > * HAWQ Meetup (January 123, 2017)
> > >
> > > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> > > Engineer
> > > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> > > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> > > Senior Engineer
> > >
> > > * HAWQ Meetup (March 23, 2017)
> > >
> > > - Apache HAWQ Exploration Step by Step - Configuration, Build,
> > > Deployment and Debug by Xiang Sheng, Pivotal Software
> > > Engineer
> > > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> > > Senior Software Engineer
> > > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> > > Database Expert in Alibaba Cloud
> > >
> > > 2. A significant push by the dev community has been made to review
> > > and merge the project's Pull Requests (PR). As of March 30, 2017,
> > > eight of the nine open PRs have been opened in the last ten
> > > days. The PR opened on Sep 2016 is targeted to be merged after
> > > the Apache 2.2.0.0 release.
> > >
> > > 3. Recent porting efforts:
> > >
> > > - Persistent Systems Engineers are actively engaging the dev
> > > community on their HAWQ porting efforts to RHEL 7.1 on S390
> > > platform.
> > >
> > > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> > > published on dev list.
> > >
> > > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> > > the upcoming 2.2.0.0 release
> > >
> > > How has the project developed since the last report?
> > >
> > > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> > >
> > > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> > > binary release). This is the 3rd release as an incubating
> > > project.
> > >
> > > Release page:
> > >
> > > https://cwiki.apache.org/confluence/display/HAWQ/
> > > Apache+HAWQ+2.2.0.0-incubating+Release
> > >
> > > Release hightlights:
> > >
> > > * CentOS 7.x Support
> > > * Ranger Integration
> > > * PXF ORC Profile
> > > * Bug Fixes
> > >
> > > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> > > member) is publishing (to dev email list) a regular HAWQ
> Graduation
> > > update for the
> > > project.
> > >
> > > * HAWQ graduation update (January, 17, 2017)
> > > https://lists.apache.org/thread.html/
> > cd37e2b48d4bbc9fe4a9cea47f8247
> > > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> > >
> > > * Apache HAWQ graduation update (Mar 1st, 2017)
> > > https://lists.apache.org/thread.html/
> > 3a1e454f8c706dd71b1690c3ae74a1
> > > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> > >
> > > 4. The Apache HAWQ website has been updated to provide clearer
> > > access to download release artifacts.
> > >
> > > How would you assess the podling's maturity?
> > > Please feel free to add your own commentary.
> > >
> > > [ ] Initial setup
> > > [ ] Working towards first release
> > > [X] Community building
> > > [X] Nearing graduation
> > > [ ] Other:
> > >
> > > Date of last release:
> > >
> > > 2017-02-28
> > >
> > > When were the last committers or PMC members elected?
> > >
> > > Podling committers (3) added:
> > > Lisa Owen: January 31, 2017
> > > Jane Beckman: February 1, 2017
> > > Kyle Dunn: March 2, 2017
> > >
> > > PPMC member (1) added:
> > > Paul Guo: March 10, 2017
> > >
> > > Signed-off-by:
> > >
> > > [ ](hawq) Alan Gates
> > > Comments:
> > > [ ](hawq) Konstantin Boudnik
> > > Comments:
> > > [ ](hawq) Justin Erenkrantz
> > > Comments:
> > > [ ](hawq) Thejas Nair
> > > Comments:
> > > [ ](hawq) Roman Shaposhnik
> > > Comments:
> > >
> > > IPMC/Shepherd notes:
> > >
> > >
> > >
> >
>
>
>
> --
> *Ed Espino*
>
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Ruilong,
Thanks buddy. January 123!!! :) a typo indeed. I have updated the report.
-=e
On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
> Hi Ed,
>
> One typo is that HAWQ Meetup is on January 12, 2017.
>
> Best regards,
> Ruilong Huo
>
> On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>
> > Team HAWQ,
> >
> > Below is the draft ASF HAWQ Incubator PMC report for April 2017, covering
> > Q1 2017 activity.
> >
> > It is posted at http://wiki.apache.org/incubator/April2017
> >
> > Please let me know if you have any comments or suggestions and I will
> update
> > the report.
> >
> > Regards,
> > -=e
> >
> > --
> > *Ed Espino*
> >
> >
> > --------------------
> > HAWQ
> >
> > Apache HAWQ is a Hadoop native SQL query engine that combines the key
> > technological advantages of MPP database with the scalability and
> > convenience
> > of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> > delivers industry-leading performance and linear scalability. It provides
> > users the tools to confidently and successfully interact with petabyte
> > range
> > data sets. HAWQ provides users with a complete, standards compliant SQL
> > interface.
> >
> > HAWQ has been incubating since 2015-09-04.
> >
> > Three most important issues to address in the move towards graduation:
> >
> > 1. Continue to improve the project's release cadence. To this end we
> > plan on expanding automation services to support increased
> > developer participation.
> >
> > 2. Continue to expand the community, by adding new contributors and
> > focusing on making sure that there's a much more robust level of
> > conversations and discussions happening around roadmaps and
> > feature development on the public dev mailing list.
> >
> > 3. Expand release artifacts to include the delivery of binary
> > artifacts. We expect the project to significantly refine the
> > binary release process in several key areas.
> >
> > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> > aware of?
> >
> > 1. Nothing urgent at this time.
> >
> > How has the community developed since the last report?
> >
> > 1. Two Meetups took place in Beijing, China:
> >
> > * HAWQ Meetup (January 123, 2017)
> >
> > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> > Engineer
> > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> > Senior Engineer
> >
> > * HAWQ Meetup (March 23, 2017)
> >
> > - Apache HAWQ Exploration Step by Step - Configuration, Build,
> > Deployment and Debug by Xiang Sheng, Pivotal Software
> > Engineer
> > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> > Senior Software Engineer
> > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> > Database Expert in Alibaba Cloud
> >
> > 2. A significant push by the dev community has been made to review
> > and merge the project's Pull Requests (PR). As of March 30, 2017,
> > eight of the nine open PRs have been opened in the last ten
> > days. The PR opened on Sep 2016 is targeted to be merged after
> > the Apache 2.2.0.0 release.
> >
> > 3. Recent porting efforts:
> >
> > - Persistent Systems Engineers are actively engaging the dev
> > community on their HAWQ porting efforts to RHEL 7.1 on S390
> > platform.
> >
> > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> > published on dev list.
> >
> > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> > the upcoming 2.2.0.0 release
> >
> > How has the project developed since the last report?
> >
> > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> >
> > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> > binary release). This is the 3rd release as an incubating
> > project.
> >
> > Release page:
> >
> > https://cwiki.apache.org/confluence/display/HAWQ/
> > Apache+HAWQ+2.2.0.0-incubating+Release
> >
> > Release hightlights:
> >
> > * CentOS 7.x Support
> > * Ranger Integration
> > * PXF ORC Profile
> > * Bug Fixes
> >
> > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> > member) is publishing (to dev email list) a regular HAWQ Graduation
> > update for the
> > project.
> >
> > * HAWQ graduation update (January, 17, 2017)
> > https://lists.apache.org/thread.html/
> cd37e2b48d4bbc9fe4a9cea47f8247
> > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> >
> > * Apache HAWQ graduation update (Mar 1st, 2017)
> > https://lists.apache.org/thread.html/
> 3a1e454f8c706dd71b1690c3ae74a1
> > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> >
> > 4. The Apache HAWQ website has been updated to provide clearer
> > access to download release artifacts.
> >
> > How would you assess the podling's maturity?
> > Please feel free to add your own commentary.
> >
> > [ ] Initial setup
> > [ ] Working towards first release
> > [X] Community building
> > [X] Nearing graduation
> > [ ] Other:
> >
> > Date of last release:
> >
> > 2017-02-28
> >
> > When were the last committers or PMC members elected?
> >
> > Podling committers (3) added:
> > Lisa Owen: January 31, 2017
> > Jane Beckman: February 1, 2017
> > Kyle Dunn: March 2, 2017
> >
> > PPMC member (1) added:
> > Paul Guo: March 10, 2017
> >
> > Signed-off-by:
> >
> > [ ](hawq) Alan Gates
> > Comments:
> > [ ](hawq) Konstantin Boudnik
> > Comments:
> > [ ](hawq) Justin Erenkrantz
> > Comments:
> > [ ](hawq) Thejas Nair
> > Comments:
> > [ ](hawq) Roman Shaposhnik
> > Comments:
> >
> > IPMC/Shepherd notes:
> >
> >
> >
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
Ruilong,
Thanks buddy. January 123!!! :) a typo indeed. I have updated the report.
-=e
On Fri, Mar 31, 2017 at 7:18 PM, Ruilong Huo <rh...@pivotal.io> wrote:
> Hi Ed,
>
> One typo is that HAWQ Meetup is on January 12, 2017.
>
> Best regards,
> Ruilong Huo
>
> On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
>
> > Team HAWQ,
> >
> > Below is the draft ASF HAWQ Incubator PMC report for April 2017, covering
> > Q1 2017 activity.
> >
> > It is posted at http://wiki.apache.org/incubator/April2017
> >
> > Please let me know if you have any comments or suggestions and I will
> update
> > the report.
> >
> > Regards,
> > -=e
> >
> > --
> > *Ed Espino*
> >
> >
> > --------------------
> > HAWQ
> >
> > Apache HAWQ is a Hadoop native SQL query engine that combines the key
> > technological advantages of MPP database with the scalability and
> > convenience
> > of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> > delivers industry-leading performance and linear scalability. It provides
> > users the tools to confidently and successfully interact with petabyte
> > range
> > data sets. HAWQ provides users with a complete, standards compliant SQL
> > interface.
> >
> > HAWQ has been incubating since 2015-09-04.
> >
> > Three most important issues to address in the move towards graduation:
> >
> > 1. Continue to improve the project's release cadence. To this end we
> > plan on expanding automation services to support increased
> > developer participation.
> >
> > 2. Continue to expand the community, by adding new contributors and
> > focusing on making sure that there's a much more robust level of
> > conversations and discussions happening around roadmaps and
> > feature development on the public dev mailing list.
> >
> > 3. Expand release artifacts to include the delivery of binary
> > artifacts. We expect the project to significantly refine the
> > binary release process in several key areas.
> >
> > Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> > aware of?
> >
> > 1. Nothing urgent at this time.
> >
> > How has the community developed since the last report?
> >
> > 1. Two Meetups took place in Beijing, China:
> >
> > * HAWQ Meetup (January 123, 2017)
> >
> > - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> > Engineer
> > - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> > - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> > Senior Engineer
> >
> > * HAWQ Meetup (March 23, 2017)
> >
> > - Apache HAWQ Exploration Step by Step - Configuration, Build,
> > Deployment and Debug by Xiang Sheng, Pivotal Software
> > Engineer
> > - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> > Senior Software Engineer
> > - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> > Database Expert in Alibaba Cloud
> >
> > 2. A significant push by the dev community has been made to review
> > and merge the project's Pull Requests (PR). As of March 30, 2017,
> > eight of the nine open PRs have been opened in the last ten
> > days. The PR opened on Sep 2016 is targeted to be merged after
> > the Apache 2.2.0.0 release.
> >
> > 3. Recent porting efforts:
> >
> > - Persistent Systems Engineers are actively engaging the dev
> > community on their HAWQ porting efforts to RHEL 7.1 on S390
> > platform.
> >
> > - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> > published on dev list.
> >
> > 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> > the upcoming 2.2.0.0 release
> >
> > How has the project developed since the last report?
> >
> > 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
> >
> > 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> > binary release). This is the 3rd release as an incubating
> > project.
> >
> > Release page:
> >
> > https://cwiki.apache.org/confluence/display/HAWQ/
> > Apache+HAWQ+2.2.0.0-incubating+Release
> >
> > Release hightlights:
> >
> > * CentOS 7.x Support
> > * Ranger Integration
> > * PXF ORC Profile
> > * Bug Fixes
> >
> > 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> > member) is publishing (to dev email list) a regular HAWQ Graduation
> > update for the
> > project.
> >
> > * HAWQ graduation update (January, 17, 2017)
> > https://lists.apache.org/thread.html/
> cd37e2b48d4bbc9fe4a9cea47f8247
> > a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
> >
> > * Apache HAWQ graduation update (Mar 1st, 2017)
> > https://lists.apache.org/thread.html/
> 3a1e454f8c706dd71b1690c3ae74a1
> > 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
> >
> > 4. The Apache HAWQ website has been updated to provide clearer
> > access to download release artifacts.
> >
> > How would you assess the podling's maturity?
> > Please feel free to add your own commentary.
> >
> > [ ] Initial setup
> > [ ] Working towards first release
> > [X] Community building
> > [X] Nearing graduation
> > [ ] Other:
> >
> > Date of last release:
> >
> > 2017-02-28
> >
> > When were the last committers or PMC members elected?
> >
> > Podling committers (3) added:
> > Lisa Owen: January 31, 2017
> > Jane Beckman: February 1, 2017
> > Kyle Dunn: March 2, 2017
> >
> > PPMC member (1) added:
> > Paul Guo: March 10, 2017
> >
> > Signed-off-by:
> >
> > [ ](hawq) Alan Gates
> > Comments:
> > [ ](hawq) Konstantin Boudnik
> > Comments:
> > [ ](hawq) Justin Erenkrantz
> > Comments:
> > [ ](hawq) Thejas Nair
> > Comments:
> > [ ](hawq) Roman Shaposhnik
> > Comments:
> >
> > IPMC/Shepherd notes:
> >
> >
> >
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ruilong Huo <rh...@pivotal.io>.
Hi Ed,
One typo is that HAWQ Meetup is on January 12, 2017.
Best regards,
Ruilong Huo
On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
> Team HAWQ,
>
> Below is the draft ASF HAWQ Incubator PMC report for April 2017, covering
> Q1 2017 activity.
>
> It is posted at http://wiki.apache.org/incubator/April2017
>
> Please let me know if you have any comments or suggestions and I will update
> the report.
>
> Regards,
> -=e
>
> --
> *Ed Espino*
>
>
> --------------------
> HAWQ
>
> Apache HAWQ is a Hadoop native SQL query engine that combines the key
> technological advantages of MPP database with the scalability and
> convenience
> of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> delivers industry-leading performance and linear scalability. It provides
> users the tools to confidently and successfully interact with petabyte
> range
> data sets. HAWQ provides users with a complete, standards compliant SQL
> interface.
>
> HAWQ has been incubating since 2015-09-04.
>
> Three most important issues to address in the move towards graduation:
>
> 1. Continue to improve the project's release cadence. To this end we
> plan on expanding automation services to support increased
> developer participation.
>
> 2. Continue to expand the community, by adding new contributors and
> focusing on making sure that there's a much more robust level of
> conversations and discussions happening around roadmaps and
> feature development on the public dev mailing list.
>
> 3. Expand release artifacts to include the delivery of binary
> artifacts. We expect the project to significantly refine the
> binary release process in several key areas.
>
> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> aware of?
>
> 1. Nothing urgent at this time.
>
> How has the community developed since the last report?
>
> 1. Two Meetups took place in Beijing, China:
>
> * HAWQ Meetup (January 123, 2017)
>
> - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> Engineer
> - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> Senior Engineer
>
> * HAWQ Meetup (March 23, 2017)
>
> - Apache HAWQ Exploration Step by Step - Configuration, Build,
> Deployment and Debug by Xiang Sheng, Pivotal Software
> Engineer
> - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> Senior Software Engineer
> - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> Database Expert in Alibaba Cloud
>
> 2. A significant push by the dev community has been made to review
> and merge the project's Pull Requests (PR). As of March 30, 2017,
> eight of the nine open PRs have been opened in the last ten
> days. The PR opened on Sep 2016 is targeted to be merged after
> the Apache 2.2.0.0 release.
>
> 3. Recent porting efforts:
>
> - Persistent Systems Engineers are actively engaging the dev
> community on their HAWQ porting efforts to RHEL 7.1 on S390
> platform.
>
> - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> published on dev list.
>
> 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> the upcoming 2.2.0.0 release
>
> How has the project developed since the last report?
>
> 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>
> 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> binary release). This is the 3rd release as an incubating
> project.
>
> Release page:
>
> https://cwiki.apache.org/confluence/display/HAWQ/
> Apache+HAWQ+2.2.0.0-incubating+Release
>
> Release hightlights:
>
> * CentOS 7.x Support
> * Ranger Integration
> * PXF ORC Profile
> * Bug Fixes
>
> 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> member) is publishing (to dev email list) a regular HAWQ Graduation
> update for the
> project.
>
> * HAWQ graduation update (January, 17, 2017)
> https://lists.apache.org/thread.html/cd37e2b48d4bbc9fe4a9cea47f8247
> a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>
> * Apache HAWQ graduation update (Mar 1st, 2017)
> https://lists.apache.org/thread.html/3a1e454f8c706dd71b1690c3ae74a1
> 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>
> 4. The Apache HAWQ website has been updated to provide clearer
> access to download release artifacts.
>
> How would you assess the podling's maturity?
> Please feel free to add your own commentary.
>
> [ ] Initial setup
> [ ] Working towards first release
> [X] Community building
> [X] Nearing graduation
> [ ] Other:
>
> Date of last release:
>
> 2017-02-28
>
> When were the last committers or PMC members elected?
>
> Podling committers (3) added:
> Lisa Owen: January 31, 2017
> Jane Beckman: February 1, 2017
> Kyle Dunn: March 2, 2017
>
> PPMC member (1) added:
> Paul Guo: March 10, 2017
>
> Signed-off-by:
>
> [ ](hawq) Alan Gates
> Comments:
> [ ](hawq) Konstantin Boudnik
> Comments:
> [ ](hawq) Justin Erenkrantz
> Comments:
> [ ](hawq) Thejas Nair
> Comments:
> [ ](hawq) Roman Shaposhnik
> Comments:
>
> IPMC/Shepherd notes:
>
>
>
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ed Espino <es...@apache.org>.
I'd like to a quick moment to thank all HAWQ community members that
provided feedback on the Apache HAWQ Incubator April 2017 report
<https://wiki.apache.org/incubator/April2017>. YOU ARE SIMPLY THE BEST!!!
-=e
On Fri, Mar 31, 2017 at 11:04 AM, Ed Espino <es...@apache.org> wrote:
> Team HAWQ,
>
> Below is the draft ASF HAWQ Incubator PMC report for April 2017, covering
> Q1 2017 activity.
>
> It is posted at http://wiki.apache.org/incubator/April2017
>
> Please let me know if you have any comments or suggestions and I will update
> the report.
>
> Regards,
> -=e
>
> --
> *Ed Espino*
>
>
> --------------------
> HAWQ
>
> Apache HAWQ is a Hadoop native SQL query engine that combines the key
> technological advantages of MPP database with the scalability and
> convenience
> of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> delivers industry-leading performance and linear scalability. It provides
> users the tools to confidently and successfully interact with petabyte
> range
> data sets. HAWQ provides users with a complete, standards compliant SQL
> interface.
>
> HAWQ has been incubating since 2015-09-04.
>
> Three most important issues to address in the move towards graduation:
>
> 1. Continue to improve the project's release cadence. To this end we
> plan on expanding automation services to support increased
> developer participation.
>
> 2. Continue to expand the community, by adding new contributors and
> focusing on making sure that there's a much more robust level of
> conversations and discussions happening around roadmaps and
> feature development on the public dev mailing list.
>
> 3. Expand release artifacts to include the delivery of binary
> artifacts. We expect the project to significantly refine the
> binary release process in several key areas.
>
> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> aware of?
>
> 1. Nothing urgent at this time.
>
> How has the community developed since the last report?
>
> 1. Two Meetups took place in Beijing, China:
>
> * HAWQ Meetup (January 123, 2017)
>
> - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> Engineer
> - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> Senior Engineer
>
> * HAWQ Meetup (March 23, 2017)
>
> - Apache HAWQ Exploration Step by Step - Configuration, Build,
> Deployment and Debug by Xiang Sheng, Pivotal Software
> Engineer
> - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> Senior Software Engineer
> - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> Database Expert in Alibaba Cloud
>
> 2. A significant push by the dev community has been made to review
> and merge the project's Pull Requests (PR). As of March 30, 2017,
> eight of the nine open PRs have been opened in the last ten
> days. The PR opened on Sep 2016 is targeted to be merged after
> the Apache 2.2.0.0 release.
>
> 3. Recent porting efforts:
>
> - Persistent Systems Engineers are actively engaging the dev
> community on their HAWQ porting efforts to RHEL 7.1 on S390
> platform.
>
> - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> published on dev list.
>
> 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> the upcoming 2.2.0.0 release
>
> How has the project developed since the last report?
>
> 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>
> 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> binary release). This is the 3rd release as an incubating
> project.
>
> Release page:
>
> https://cwiki.apache.org/confluence/display/HAWQ/
> Apache+HAWQ+2.2.0.0-incubating+Release
>
> Release hightlights:
>
> * CentOS 7.x Support
> * Ranger Integration
> * PXF ORC Profile
> * Bug Fixes
>
> 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> member) is publishing (to dev email list) a regular HAWQ Graduation
> update for the
> project.
>
> * HAWQ graduation update (January, 17, 2017)
> https://lists.apache.org/thread.html/cd37e2b48d4bbc9fe4a9cea47f8247
> a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>
> * Apache HAWQ graduation update (Mar 1st, 2017)
> https://lists.apache.org/thread.html/3a1e454f8c706dd71b1690c3ae74a1
> 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>
> 4. The Apache HAWQ website has been updated to provide clearer
> access to download release artifacts.
>
> How would you assess the podling's maturity?
> Please feel free to add your own commentary.
>
> [ ] Initial setup
> [ ] Working towards first release
> [X] Community building
> [X] Nearing graduation
> [ ] Other:
>
> Date of last release:
>
> 2017-02-28
>
> When were the last committers or PMC members elected?
>
> Podling committers (3) added:
> Lisa Owen: January 31, 2017
> Jane Beckman: February 1, 2017
> Kyle Dunn: March 2, 2017
>
> PPMC member (1) added:
> Paul Guo: March 10, 2017
>
> Signed-off-by:
>
> [ ](hawq) Alan Gates
> Comments:
> [ ](hawq) Konstantin Boudnik
> Comments:
> [ ](hawq) Justin Erenkrantz
> Comments:
> [ ](hawq) Thejas Nair
> Comments:
> [ ](hawq) Roman Shaposhnik
> Comments:
>
> IPMC/Shepherd notes:
>
>
>
--
*Ed Espino*
Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017
Posted by Ruilong Huo <rh...@pivotal.io>.
Hi Ed,
One typo is that HAWQ Meetup is on January 12, 2017.
Best regards,
Ruilong Huo
On Sat, Apr 1, 2017 at 2:04 AM, Ed Espino <es...@apache.org> wrote:
> Team HAWQ,
>
> Below is the draft ASF HAWQ Incubator PMC report for April 2017, covering
> Q1 2017 activity.
>
> It is posted at http://wiki.apache.org/incubator/April2017
>
> Please let me know if you have any comments or suggestions and I will update
> the report.
>
> Regards,
> -=e
>
> --
> *Ed Espino*
>
>
> --------------------
> HAWQ
>
> Apache HAWQ is a Hadoop native SQL query engine that combines the key
> technological advantages of MPP database with the scalability and
> convenience
> of Hadoop. HAWQ reads data from and writes data to HDFS natively. HAWQ
> delivers industry-leading performance and linear scalability. It provides
> users the tools to confidently and successfully interact with petabyte
> range
> data sets. HAWQ provides users with a complete, standards compliant SQL
> interface.
>
> HAWQ has been incubating since 2015-09-04.
>
> Three most important issues to address in the move towards graduation:
>
> 1. Continue to improve the project's release cadence. To this end we
> plan on expanding automation services to support increased
> developer participation.
>
> 2. Continue to expand the community, by adding new contributors and
> focusing on making sure that there's a much more robust level of
> conversations and discussions happening around roadmaps and
> feature development on the public dev mailing list.
>
> 3. Expand release artifacts to include the delivery of binary
> artifacts. We expect the project to significantly refine the
> binary release process in several key areas.
>
> Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
> aware of?
>
> 1. Nothing urgent at this time.
>
> How has the community developed since the last report?
>
> 1. Two Meetups took place in Beijing, China:
>
> * HAWQ Meetup (January 123, 2017)
>
> - HAWQ2.X New Features - Yanqing Wen, Pivotal HAWQ Senior
> Engineer
> - HAWQ Elasticity - Huan Zhang, Pivotal HAWQ Senior Engineer
> - Data Lake and HAWQ Integration - Wenbin Lu, EMC Big Data
> Senior Engineer
>
> * HAWQ Meetup (March 23, 2017)
>
> - Apache HAWQ Exploration Step by Step - Configuration, Build,
> Deployment and Debug by Xiang Sheng, Pivotal Software
> Engineer
> - Transaction Management in Apache HAWQ by Ming Li, Pivotal
> Senior Software Engineer
> - Max Compute - A SQL engine based on Apache HAWQ by Chen Xia,
> Database Expert in Alibaba Cloud
>
> 2. A significant push by the dev community has been made to review
> and merge the project's Pull Requests (PR). As of March 30, 2017,
> eight of the nine open PRs have been opened in the last ten
> days. The PR opened on Sep 2016 is targeted to be merged after
> the Apache 2.2.0.0 release.
>
> 3. Recent porting efforts:
>
> - Persistent Systems Engineers are actively engaging the dev
> community on their HAWQ porting efforts to RHEL 7.1 on S390
> platform.
>
> - Ubuntu 16.04.2 LTS (Xenial Xerus) porting notes have been
> published on dev list.
>
> 4. Ruilong Huo has volunteered to be the Release Manager (RM) for
> the upcoming 2.2.0.0 release
>
> How has the project developed since the last report?
>
> 1. Apache HAWQ 2.1.0.0 (source code only) has been released.
>
> 2. Apache HAWQ 2.2.0.0 release proposed (source code and first
> binary release). This is the 3rd release as an incubating
> project.
>
> Release page:
>
> https://cwiki.apache.org/confluence/display/HAWQ/
> Apache+HAWQ+2.2.0.0-incubating+Release
>
> Release hightlights:
>
> * CentOS 7.x Support
> * Ranger Integration
> * PXF ORC Profile
> * Bug Fixes
>
> 3. Paul Guo (paulguo@gmail.com - committer and recent HAWQ PPMC
> member) is publishing (to dev email list) a regular HAWQ Graduation
> update for the
> project.
>
> * HAWQ graduation update (January, 17, 2017)
> https://lists.apache.org/thread.html/cd37e2b48d4bbc9fe4a9cea47f8247
> a2a614fa9643171937db9568ed@%3Cdev.hawq.apache.org%3E
>
> * Apache HAWQ graduation update (Mar 1st, 2017)
> https://lists.apache.org/thread.html/3a1e454f8c706dd71b1690c3ae74a1
> 57ef42eefde2185c780e2a57a2@%3Cdev.hawq.apache.org%3E
>
> 4. The Apache HAWQ website has been updated to provide clearer
> access to download release artifacts.
>
> How would you assess the podling's maturity?
> Please feel free to add your own commentary.
>
> [ ] Initial setup
> [ ] Working towards first release
> [X] Community building
> [X] Nearing graduation
> [ ] Other:
>
> Date of last release:
>
> 2017-02-28
>
> When were the last committers or PMC members elected?
>
> Podling committers (3) added:
> Lisa Owen: January 31, 2017
> Jane Beckman: February 1, 2017
> Kyle Dunn: March 2, 2017
>
> PPMC member (1) added:
> Paul Guo: March 10, 2017
>
> Signed-off-by:
>
> [ ](hawq) Alan Gates
> Comments:
> [ ](hawq) Konstantin Boudnik
> Comments:
> [ ](hawq) Justin Erenkrantz
> Comments:
> [ ](hawq) Thejas Nair
> Comments:
> [ ](hawq) Roman Shaposhnik
> Comments:
>
> IPMC/Shepherd notes:
>
>
>