You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Xuefu Zhang <xz...@cloudera.com> on 2015/11/02 19:09:15 UTC
Dev meetup Nov 2015
Hi all,
Apache Hive community is considering a developer meetup in the middle of
this month. While we are finalizing the venue, I'd like to invite you to
plan to join, and even better, to give talk in the event.
We consider the center of the meetup would be around the quality aspect of
the Project, and like to establish a collaborative effort in improving
Hive's quality. In the meantime, any topic will be considered.
Please let me or Thejas know if you'd like to give a talk.
Detailed venue and agenda will be given soon. Look forward to meeting you
in two weeks!
Regards,
Xuefu
Re: Dev meetup Nov 2015
Posted by Gopal Vijayaraghavan <go...@apache.org>.
Hi,
I've attached the LLAP Slides from the meetup to that.
For those who missed the meeting, I've recreated the demo as a video.
http://people.apache.org/~gopalv/LLAP.gif
TL;DR - The data-set is the TPC-DS 1000Gb scale data-set & I'm running
2x160Gb LLAP instances (16 physical cores each), with 16Gb caches (so
net-cache size of 32Gb).
LLAP - 890 milliseconds
Tez - 9.47 seconds
MR2 - 183 seconds
Cheers,
Gopal
On 11/18/15, 2:00 PM, "Thejas Nair" <th...@gmail.com> wrote:
>Thanks to all who attended the meetup. There were great talks and
>discussions!
>
>Here are the slides -
>https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentatio
>ns-November2015HiveContributorMeetup
>
>
>On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
>> HI folks,
>>
>> Here is the talks that are scheduled for Monday's meetup. As you can see
>> that we have a full schedule, speakers please constrain your talk within
>> the given slot.
>>
>> 1. Lessons learned from enterprise users (Xuefu, 5m)
>> 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m)
>> 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m)
>> 4. Correctness issue reporting and tracking guideline (Carl, 5m)
>> 5. Dynamic dependency resolution and classloader issues (Anthony, 10m)
>> 6. A query syntax validation tool for Hive. (Szehon, 15m)
>> 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m)
>> 8. Uber's plan for Hive and our expected feature from the overall dev
>> community (Mohammad Islam, 15m)
>> 9. Update on LLAP (Gopal V Vijayaraghavan, 10m)
>>
>> See you all there!
>>
>> --Xuefu
>>
>> On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
>>
>>> Hi all,
>>>
>>> As an update, here is the link to the meetup:
>>> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please
>>> RSVP as soon as possible because the organizers do need a headcount
>>>before
>>> the event.
>>>
>>> Also, we are finalizing a list of talks. If you plan to give a talk,
>>> please let the organizer know.
>>>
>>> Thanks,
>>> Xuefu
>>>
>>>
>>> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang <xz...@cloudera.com>
>>>wrote:
>>>
>>>> Hi all,
>>>>
>>>> Apache Hive community is considering a developer meetup in the middle
>>>>of
>>>> this month. While we are finalizing the venue, I'd like to invite you
>>>>to
>>>> plan to join, and even better, to give talk in the event.
>>>>
>>>> We consider the center of the meetup would be around the quality
>>>>aspect
>>>> of the Project, and like to establish a collaborative effort in
>>>>improving
>>>> Hive's quality. In the meantime, any topic will be considered.
>>>>
>>>> Please let me or Thejas know if you'd like to give a talk.
>>>>
>>>> Detailed venue and agenda will be given soon. Look forward to meeting
>>>>you
>>>> in two weeks!
>>>>
>>>> Regards,
>>>>
>>>> Xuefu
>>>>
>>>
>>>
>
Re: Dev meetup Nov 2015
Posted by Dmitry Tolpeko <dm...@gmail.com>.
Thejas, thank you for sharing the slides!
On Thu, Nov 19, 2015 at 1:00 AM, Thejas Nair <th...@gmail.com> wrote:
> Thanks to all who attended the meetup. There were great talks and
> discussions!
>
> Here are the slides -
>
> https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentations-November2015HiveContributorMeetup
>
>
> On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
> > HI folks,
> >
> > Here is the talks that are scheduled for Monday's meetup. As you can see
> > that we have a full schedule, speakers please constrain your talk within
> > the given slot.
> >
> > 1. Lessons learned from enterprise users (Xuefu, 5m)
> > 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m)
> > 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m)
> > 4. Correctness issue reporting and tracking guideline (Carl, 5m)
> > 5. Dynamic dependency resolution and classloader issues (Anthony, 10m)
> > 6. A query syntax validation tool for Hive. (Szehon, 15m)
> > 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m)
> > 8. Uber's plan for Hive and our expected feature from the overall dev
> > community (Mohammad Islam, 15m)
> > 9. Update on LLAP (Gopal V Vijayaraghavan, 10m)
> >
> > See you all there!
> >
> > --Xuefu
> >
> > On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
> >
> >> Hi all,
> >>
> >> As an update, here is the link to the meetup:
> >> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please
> >> RSVP as soon as possible because the organizers do need a headcount
> before
> >> the event.
> >>
> >> Also, we are finalizing a list of talks. If you plan to give a talk,
> >> please let the organizer know.
> >>
> >> Thanks,
> >> Xuefu
> >>
> >>
> >> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang <xz...@cloudera.com>
> wrote:
> >>
> >>> Hi all,
> >>>
> >>> Apache Hive community is considering a developer meetup in the middle
> of
> >>> this month. While we are finalizing the venue, I'd like to invite you
> to
> >>> plan to join, and even better, to give talk in the event.
> >>>
> >>> We consider the center of the meetup would be around the quality aspect
> >>> of the Project, and like to establish a collaborative effort in
> improving
> >>> Hive's quality. In the meantime, any topic will be considered.
> >>>
> >>> Please let me or Thejas know if you'd like to give a talk.
> >>>
> >>> Detailed venue and agenda will be given soon. Look forward to meeting
> you
> >>> in two weeks!
> >>>
> >>> Regards,
> >>>
> >>> Xuefu
> >>>
> >>
> >>
>
Re: Dev meetup Nov 2015
Posted by Xuefu Zhang <xz...@cloudera.com>.
Thanks for archiving the slides, Thejas! Yes, the meetup is very
successful. Thanks to all for presenting or attending to Hortonworks for
hosting.
I think there were several topics that were brought up in the meetup
deserving further discussion, such as data correctness issue, qtest
destiny, quality collaboration, etc. Before we totally forget, I think we
should resume the discussion so that we have certain actionable items.
Thus, I'm going to trigger a couple of [DISCUSSION] threads as a start.
Others please feel free to start discussions that you think important.
Your feedback is greatly appreciated.
Thanks,
Xuefu
On Wed, Nov 18, 2015 at 2:00 PM, Thejas Nair <th...@gmail.com> wrote:
> Thanks to all who attended the meetup. There were great talks and
> discussions!
>
> Here are the slides -
>
> https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentations-November2015HiveContributorMeetup
>
>
> On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
> > HI folks,
> >
> > Here is the talks that are scheduled for Monday's meetup. As you can see
> > that we have a full schedule, speakers please constrain your talk within
> > the given slot.
> >
> > 1. Lessons learned from enterprise users (Xuefu, 5m)
> > 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m)
> > 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m)
> > 4. Correctness issue reporting and tracking guideline (Carl, 5m)
> > 5. Dynamic dependency resolution and classloader issues (Anthony, 10m)
> > 6. A query syntax validation tool for Hive. (Szehon, 15m)
> > 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m)
> > 8. Uber's plan for Hive and our expected feature from the overall dev
> > community (Mohammad Islam, 15m)
> > 9. Update on LLAP (Gopal V Vijayaraghavan, 10m)
> >
> > See you all there!
> >
> > --Xuefu
> >
> > On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
> >
> >> Hi all,
> >>
> >> As an update, here is the link to the meetup:
> >> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please
> >> RSVP as soon as possible because the organizers do need a headcount
> before
> >> the event.
> >>
> >> Also, we are finalizing a list of talks. If you plan to give a talk,
> >> please let the organizer know.
> >>
> >> Thanks,
> >> Xuefu
> >>
> >>
> >> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang <xz...@cloudera.com>
> wrote:
> >>
> >>> Hi all,
> >>>
> >>> Apache Hive community is considering a developer meetup in the middle
> of
> >>> this month. While we are finalizing the venue, I'd like to invite you
> to
> >>> plan to join, and even better, to give talk in the event.
> >>>
> >>> We consider the center of the meetup would be around the quality aspect
> >>> of the Project, and like to establish a collaborative effort in
> improving
> >>> Hive's quality. In the meantime, any topic will be considered.
> >>>
> >>> Please let me or Thejas know if you'd like to give a talk.
> >>>
> >>> Detailed venue and agenda will be given soon. Look forward to meeting
> you
> >>> in two weeks!
> >>>
> >>> Regards,
> >>>
> >>> Xuefu
> >>>
> >>
> >>
>
Re: Dev meetup Nov 2015
Posted by Thejas Nair <th...@gmail.com>.
Thanks to all who attended the meetup. There were great talks and discussions!
Here are the slides -
https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentations-November2015HiveContributorMeetup
On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
> HI folks,
>
> Here is the talks that are scheduled for Monday's meetup. As you can see
> that we have a full schedule, speakers please constrain your talk within
> the given slot.
>
> 1. Lessons learned from enterprise users (Xuefu, 5m)
> 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m)
> 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m)
> 4. Correctness issue reporting and tracking guideline (Carl, 5m)
> 5. Dynamic dependency resolution and classloader issues (Anthony, 10m)
> 6. A query syntax validation tool for Hive. (Szehon, 15m)
> 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m)
> 8. Uber's plan for Hive and our expected feature from the overall dev
> community (Mohammad Islam, 15m)
> 9. Update on LLAP (Gopal V Vijayaraghavan, 10m)
>
> See you all there!
>
> --Xuefu
>
> On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
>
>> Hi all,
>>
>> As an update, here is the link to the meetup:
>> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please
>> RSVP as soon as possible because the organizers do need a headcount before
>> the event.
>>
>> Also, we are finalizing a list of talks. If you plan to give a talk,
>> please let the organizer know.
>>
>> Thanks,
>> Xuefu
>>
>>
>> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang <xz...@cloudera.com> wrote:
>>
>>> Hi all,
>>>
>>> Apache Hive community is considering a developer meetup in the middle of
>>> this month. While we are finalizing the venue, I'd like to invite you to
>>> plan to join, and even better, to give talk in the event.
>>>
>>> We consider the center of the meetup would be around the quality aspect
>>> of the Project, and like to establish a collaborative effort in improving
>>> Hive's quality. In the meantime, any topic will be considered.
>>>
>>> Please let me or Thejas know if you'd like to give a talk.
>>>
>>> Detailed venue and agenda will be given soon. Look forward to meeting you
>>> in two weeks!
>>>
>>> Regards,
>>>
>>> Xuefu
>>>
>>
>>
Re: Dev meetup Nov 2015
Posted by Xuefu Zhang <xz...@cloudera.com>.
HI folks,
Here is the talks that are scheduled for Monday's meetup. As you can see
that we have a full schedule, speakers please constrain your talk within
the given slot.
1. Lessons learned from enterprise users (Xuefu, 5m)
2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m)
3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m)
4. Correctness issue reporting and tracking guideline (Carl, 5m)
5. Dynamic dependency resolution and classloader issues (Anthony, 10m)
6. A query syntax validation tool for Hive. (Szehon, 15m)
7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m)
8. Uber's plan for Hive and our expected feature from the overall dev
community (Mohammad Islam, 15m)
9. Update on LLAP (Gopal V Vijayaraghavan, 10m)
See you all there!
--Xuefu
On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang <xz...@cloudera.com> wrote:
> Hi all,
>
> As an update, here is the link to the meetup:
> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please
> RSVP as soon as possible because the organizers do need a headcount before
> the event.
>
> Also, we are finalizing a list of talks. If you plan to give a talk,
> please let the organizer know.
>
> Thanks,
> Xuefu
>
>
> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang <xz...@cloudera.com> wrote:
>
>> Hi all,
>>
>> Apache Hive community is considering a developer meetup in the middle of
>> this month. While we are finalizing the venue, I'd like to invite you to
>> plan to join, and even better, to give talk in the event.
>>
>> We consider the center of the meetup would be around the quality aspect
>> of the Project, and like to establish a collaborative effort in improving
>> Hive's quality. In the meantime, any topic will be considered.
>>
>> Please let me or Thejas know if you'd like to give a talk.
>>
>> Detailed venue and agenda will be given soon. Look forward to meeting you
>> in two weeks!
>>
>> Regards,
>>
>> Xuefu
>>
>
>
Re: Dev meetup Nov 2015
Posted by Xuefu Zhang <xz...@cloudera.com>.
Hi all,
As an update, here is the link to the meetup:
http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please
RSVP as soon as possible because the organizers do need a headcount before
the event.
Also, we are finalizing a list of talks. If you plan to give a talk, please
let the organizer know.
Thanks,
Xuefu
On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang <xz...@cloudera.com> wrote:
> Hi all,
>
> Apache Hive community is considering a developer meetup in the middle of
> this month. While we are finalizing the venue, I'd like to invite you to
> plan to join, and even better, to give talk in the event.
>
> We consider the center of the meetup would be around the quality aspect of
> the Project, and like to establish a collaborative effort in improving
> Hive's quality. In the meantime, any topic will be considered.
>
> Please let me or Thejas know if you'd like to give a talk.
>
> Detailed venue and agenda will be given soon. Look forward to meeting you
> in two weeks!
>
> Regards,
>
> Xuefu
>