Re: [HANGOUT] Topics for 05/01/2018

[Gautam Parai <gp...@mapr.com>]

Hi all,


Here are the meeting minutes:


Attendees: Aman, Gautam, Hanumath, Jyothsna, Karthik, Paul Makkar, Pritesh, Sorabh, Tim


Topics discussed:


Unnest/Lateral - Sorabh mentioned that the execution side of changes are in Apache Drill. The planning side of changes is going through Apache Calcite review and close to completion. The next steps would be to work on more advanced usecases e.g. nested level unnest/lateral.


Resource Management(RM) - Tim described the two approaches being considered by him and Vlad - static/dynamic. Dynamic RM would require substantial changes to underlying Drill architecture and is not being considered for now. Static RM along with planner side changes (for more accurate mem estimation) and admission control is planned for now.


Any_value aggregate function - This aggregate function can be used to get `any value` for a column (or within groups of that column). This arose in context of the secondary index support for complex types in Drill. I would create an Apache JIRA and add more details and share it with the community.


Batch sizing for project - Karthik explained his design doc for batch sizing for project which requires projecting different columns and evaluating expressions. Fixed/variable length types and sizing expressions. Sizing is only based on output batch size and NOT incoming batch size. For expressions he is proposing annotations - the creator will have to annotate the udf so Drill can figure out how to estimate its size.


Please add to the notes in case I missed or misunderstood anything. Thanks!


Gautam


________________________________
From: Gautam Parai <gp...@mapr.com>
Sent: Monday, April 30, 2018 1:53:46 PM
To: dev@drill.apache.org; user@drill.apache.org
Subject: [HANGOUT] Topics for 05/01/2018

Hi all,

We will have a Drill hangout tomorrow (Tuesday May 1) at 10 AM Pacific Time. Please suggest topics by replying to this thread or bring them up during the hangout.

Hangout link:  https://urldefense.proofpoint.com/v2/url?u=https-3A__plus.google.com_hangouts_-5F_event_ci4rdiju8bv04a64efj5fedd0lc&d=DwIFAw&c=cskdkSMqhcnjZxdQVpwTXg&r=jGaWXfAULy7L7yLSDM6rFQ&m=WED3lepY_zTnY-lDfHxhDWIlMw3VKANkW0iQu5FFrkI&s=N0UtWs-KDoE5koI9hSiULag28iNA5JJfXOLB5JnNv-0&e=

Thanks,
Gautam