You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Swapan Shridhar <ss...@hortonworks.com> on 2016/03/22 20:29:42 UTC
Review Request 45175: Fix the 'tez-interactive-site.xml'. Added new
properties, fixed values of existing props.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45175/
-----------------------------------------------------------
Review request for Ambari, Jaimin Jetly and Sumit Mohanty.
Bugs: AMBARI-15518
https://issues.apache.org/jira/browse/AMBARI-15518
Repository: ambari
Description
-------
Fix the 'tez-interactive-site.xml'. Added new properties, fixed values of existing props, added description.
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml c4dee3e
Diff: https://reviews.apache.org/r/45175/diff/
Testing
-------
Yes. Said props value enable LLAP and Hive Interactive to come up properly.
Thanks,
Swapan Shridhar
Re: Review Request 45175: Fix the 'tez-interactive-site.xml'. Added
new properties, fixed values of existing props.
Posted by Jaimin Jetly <ja...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45175/#review124869
-----------------------------------------------------------
Ship it!
Ship It!
- Jaimin Jetly
On March 22, 2016, 7:29 p.m., Swapan Shridhar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/45175/
> -----------------------------------------------------------
>
> (Updated March 22, 2016, 7:29 p.m.)
>
>
> Review request for Ambari, Jaimin Jetly and Sumit Mohanty.
>
>
> Bugs: AMBARI-15518
> https://issues.apache.org/jira/browse/AMBARI-15518
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Fix the 'tez-interactive-site.xml'. Added new properties, fixed values of existing props, added description.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml c4dee3e
>
> Diff: https://reviews.apache.org/r/45175/diff/
>
>
> Testing
> -------
>
> Yes. Said props value enable LLAP and Hive Interactive to come up properly.
>
>
> Thanks,
>
> Swapan Shridhar
>
>
Re: Review Request 45175: Fix the 'tez-interactive-site.xml'. Added
new properties, fixed values of existing props.
Posted by Swapan Shridhar <ss...@hortonworks.com>.
> On March 22, 2016, 8:32 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml, line 390
> > <https://reviews.apache.org/r/45175/diff/1/?file=1311014#file1311014line390>
> >
> > Why is this not a multiple of 8 or even 64?
>
> Swapan Shridhar wrote:
> This value is in MB. So will still stay aligned on 8 byte boundary.
682 is generally taken default. But our YARN setting Scheduler -> yarn.scheduler.capacity.root.default.maximum-capacity is not proper. Default is 0.2 GB.. Thus, when LLAP shows up creating 2 instances and at the same time some Service check creating YRAN app comes up. Everything hangs. and times out.
Currently, I modify yarn.scheduler.capacity.root.default.maximum-capacity value (=1 (1 GB) helps). Because LLAP creates 2 instance (341 *2) and Hive Interactive creates 1 (341 *2 + 341) stays in 1024 MB limit.
- Swapan
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45175/#review124878
-----------------------------------------------------------
On March 22, 2016, 7:29 p.m., Swapan Shridhar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/45175/
> -----------------------------------------------------------
>
> (Updated March 22, 2016, 7:29 p.m.)
>
>
> Review request for Ambari, Jaimin Jetly and Sumit Mohanty.
>
>
> Bugs: AMBARI-15518
> https://issues.apache.org/jira/browse/AMBARI-15518
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Fix the 'tez-interactive-site.xml'. Added new properties, fixed values of existing props, added description.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml c4dee3e
>
> Diff: https://reviews.apache.org/r/45175/diff/
>
>
> Testing
> -------
>
> Yes. Said props value enable LLAP and Hive Interactive to come up properly.
>
>
> Thanks,
>
> Swapan Shridhar
>
>
Re: Review Request 45175: Fix the 'tez-interactive-site.xml'. Added
new properties, fixed values of existing props.
Posted by Swapan Shridhar <ss...@hortonworks.com>.
> On March 22, 2016, 8:32 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml, line 390
> > <https://reviews.apache.org/r/45175/diff/1/?file=1311014#file1311014line390>
> >
> > Why is this not a multiple of 8 or even 64?
This value is in MB. So will still stay aligned on 8 byte boundary.
- Swapan
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45175/#review124878
-----------------------------------------------------------
On March 22, 2016, 7:29 p.m., Swapan Shridhar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/45175/
> -----------------------------------------------------------
>
> (Updated March 22, 2016, 7:29 p.m.)
>
>
> Review request for Ambari, Jaimin Jetly and Sumit Mohanty.
>
>
> Bugs: AMBARI-15518
> https://issues.apache.org/jira/browse/AMBARI-15518
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Fix the 'tez-interactive-site.xml'. Added new properties, fixed values of existing props, added description.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml c4dee3e
>
> Diff: https://reviews.apache.org/r/45175/diff/
>
>
> Testing
> -------
>
> Yes. Said props value enable LLAP and Hive Interactive to come up properly.
>
>
> Thanks,
>
> Swapan Shridhar
>
>
Re: Review Request 45175: Fix the 'tez-interactive-site.xml'. Added
new properties, fixed values of existing props.
Posted by Swapan Shridhar <ss...@hortonworks.com>.
> On March 22, 2016, 8:32 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml, line 390
> > <https://reviews.apache.org/r/45175/diff/1/?file=1311014#file1311014line390>
> >
> > Why is this not a multiple of 8 or even 64?
>
> Swapan Shridhar wrote:
> This value is in MB. So will still stay aligned on 8 byte boundary.
>
> Swapan Shridhar wrote:
> 682 is generally taken default. But our YARN setting Scheduler -> yarn.scheduler.capacity.root.default.maximum-capacity is not proper. Default is 0.2 GB.. Thus, when LLAP shows up creating 2 instances and at the same time some Service check creating YRAN app comes up. Everything hangs. and times out.
>
> Currently, I modify yarn.scheduler.capacity.root.default.maximum-capacity value (=1 (1 GB) helps). Because LLAP creates 2 instance (341 *2) and Hive Interactive creates 1 (341 *2 + 341) stays in 1024 MB limit.
"yarn.scheduler.capacity.maximum-am-resource-percent" instead of "" yarn.scheduler.capacity.root.default.maximum-capacity
- Swapan
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45175/#review124878
-----------------------------------------------------------
On March 22, 2016, 7:29 p.m., Swapan Shridhar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/45175/
> -----------------------------------------------------------
>
> (Updated March 22, 2016, 7:29 p.m.)
>
>
> Review request for Ambari, Jaimin Jetly and Sumit Mohanty.
>
>
> Bugs: AMBARI-15518
> https://issues.apache.org/jira/browse/AMBARI-15518
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Fix the 'tez-interactive-site.xml'. Added new properties, fixed values of existing props, added description.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml c4dee3e
>
> Diff: https://reviews.apache.org/r/45175/diff/
>
>
> Testing
> -------
>
> Yes. Said props value enable LLAP and Hive Interactive to come up properly.
>
>
> Thanks,
>
> Swapan Shridhar
>
>
Re: Review Request 45175: Fix the 'tez-interactive-site.xml'. Added
new properties, fixed values of existing props.
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45175/#review124878
-----------------------------------------------------------
ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml (line 390)
<https://reviews.apache.org/r/45175/#comment187572>
Why is this not a multiple of 8 or even 64?
- Alejandro Fernandez
On March 22, 2016, 7:29 p.m., Swapan Shridhar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/45175/
> -----------------------------------------------------------
>
> (Updated March 22, 2016, 7:29 p.m.)
>
>
> Review request for Ambari, Jaimin Jetly and Sumit Mohanty.
>
>
> Bugs: AMBARI-15518
> https://issues.apache.org/jira/browse/AMBARI-15518
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Fix the 'tez-interactive-site.xml'. Added new properties, fixed values of existing props, added description.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/tez-interactive-site.xml c4dee3e
>
> Diff: https://reviews.apache.org/r/45175/diff/
>
>
> Testing
> -------
>
> Yes. Said props value enable LLAP and Hive Interactive to come up properly.
>
>
> Thanks,
>
> Swapan Shridhar
>
>