You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Aravindan Vijayan <av...@hortonworks.com> on 2017/09/12 16:58:56 UTC
Review Request 62250: AMBARI-21939 : Ambari HDFS Heatmaps are not
showing data (Not Applicable) for bytes read,
bytes written & DataNode Process Network I/O Utilization
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62250/
-----------------------------------------------------------
Review request for Ambari, Dmytro Sen, Jayush Luniya, and Sid Wagle.
Bugs: AMBARI-21939
https://issues.apache.org/jira/browse/AMBARI-21939
Repository: ambari
Description
-------
PROBLEM: HDFS Heatmaps are not showing data (Not Applicable) for bytes read, bytes written & DataNode Process Network I/O Utilization
EXPECTED BEHAVIOUR: Heatmaps should show data
ACTUAL BEHAVIOUR: Data is being shown as Not Applicable (Grey Box)
ANALYSIS
This is reproducible in Ambari 2.2.2 and Ambari 2.5.1.0. If you go to HDFS, then click on Heatmaps, you can see the API call go to
fields=host_components/metrics/dfs/datanode/bytes_written._rate
however this returns no values. If you remove ._rate then you can see the values which you would expect.
Attach one or more files to this issue
Diffs
-----
ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog260.java 9e145c0
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/widgets.json bcfb2cc
ambari-server/src/main/resources/stacks/HDP/2.3/services/HDFS/widgets.json eeb9ff8
ambari-server/src/main/resources/stacks/PERF/1.0/services/FAKEHDFS/widgets.json 7a793f8
ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog260Test.java db6ebc1
Diff: https://reviews.apache.org/r/62250/diff/1/
Testing
-------
Manually tested.
UpgradeCatalog260 test added.
Thanks,
Aravindan Vijayan
Re: Review Request 62250: AMBARI-21939 : Ambari HDFS Heatmaps are not
showing data (Not Applicable) for bytes read,
bytes written & DataNode Process Network I/O Utilization
Posted by Aravindan Vijayan <av...@hortonworks.com>.
> On Sept. 12, 2017, 5:07 p.m., Dmytro Sen wrote:
> > ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/widgets.json
> > Line 340 (original), 340 (patched)
> > <https://reviews.apache.org/r/62250/diff/1/?file=1820223#file1820223line340>
> >
> > Make sure to update the same for HDP 3.0 in trunk (../HDFS/3.0.0.3.0/widgets.json)
Dmytro, I have created a patch for trunk and attached to the jira. There were some differences in the widget definition in the trunk branch. I did not need to make changes to any of the HDFS stack widget definition files.
- Aravindan
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62250/#review185215
-----------------------------------------------------------
On Sept. 12, 2017, 4:58 p.m., Aravindan Vijayan wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62250/
> -----------------------------------------------------------
>
> (Updated Sept. 12, 2017, 4:58 p.m.)
>
>
> Review request for Ambari, Dmytro Sen, Jayush Luniya, and Sid Wagle.
>
>
> Bugs: AMBARI-21939
> https://issues.apache.org/jira/browse/AMBARI-21939
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: HDFS Heatmaps are not showing data (Not Applicable) for bytes read, bytes written & DataNode Process Network I/O Utilization
>
> EXPECTED BEHAVIOUR: Heatmaps should show data
>
> ACTUAL BEHAVIOUR: Data is being shown as Not Applicable (Grey Box)
>
> ANALYSIS
> This is reproducible in Ambari 2.2.2 and Ambari 2.5.1.0. If you go to HDFS, then click on Heatmaps, you can see the API call go to
> fields=host_components/metrics/dfs/datanode/bytes_written._rate
> however this returns no values. If you remove ._rate then you can see the values which you would expect.
> Attach one or more files to this issue
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog260.java 9e145c0
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/widgets.json bcfb2cc
> ambari-server/src/main/resources/stacks/HDP/2.3/services/HDFS/widgets.json eeb9ff8
> ambari-server/src/main/resources/stacks/PERF/1.0/services/FAKEHDFS/widgets.json 7a793f8
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog260Test.java db6ebc1
>
>
> Diff: https://reviews.apache.org/r/62250/diff/1/
>
>
> Testing
> -------
>
> Manually tested.
> UpgradeCatalog260 test added.
>
>
> Thanks,
>
> Aravindan Vijayan
>
>
Re: Review Request 62250: AMBARI-21939 : Ambari HDFS Heatmaps are not
showing data (Not Applicable) for bytes read,
bytes written & DataNode Process Network I/O Utilization
Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62250/#review185215
-----------------------------------------------------------
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/widgets.json
Line 340 (original), 340 (patched)
<https://reviews.apache.org/r/62250/#comment261500>
Make sure to update the same for HDP 3.0 in trunk (../HDFS/3.0.0.3.0/widgets.json)
- Dmytro Sen
On Sept. 12, 2017, 4:58 p.m., Aravindan Vijayan wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62250/
> -----------------------------------------------------------
>
> (Updated Sept. 12, 2017, 4:58 p.m.)
>
>
> Review request for Ambari, Dmytro Sen, Jayush Luniya, and Sid Wagle.
>
>
> Bugs: AMBARI-21939
> https://issues.apache.org/jira/browse/AMBARI-21939
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: HDFS Heatmaps are not showing data (Not Applicable) for bytes read, bytes written & DataNode Process Network I/O Utilization
>
> EXPECTED BEHAVIOUR: Heatmaps should show data
>
> ACTUAL BEHAVIOUR: Data is being shown as Not Applicable (Grey Box)
>
> ANALYSIS
> This is reproducible in Ambari 2.2.2 and Ambari 2.5.1.0. If you go to HDFS, then click on Heatmaps, you can see the API call go to
> fields=host_components/metrics/dfs/datanode/bytes_written._rate
> however this returns no values. If you remove ._rate then you can see the values which you would expect.
> Attach one or more files to this issue
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog260.java 9e145c0
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/widgets.json bcfb2cc
> ambari-server/src/main/resources/stacks/HDP/2.3/services/HDFS/widgets.json eeb9ff8
> ambari-server/src/main/resources/stacks/PERF/1.0/services/FAKEHDFS/widgets.json 7a793f8
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog260Test.java db6ebc1
>
>
> Diff: https://reviews.apache.org/r/62250/diff/1/
>
>
> Testing
> -------
>
> Manually tested.
> UpgradeCatalog260 test added.
>
>
> Thanks,
>
> Aravindan Vijayan
>
>
Re: Review Request 62250: AMBARI-21939 : Ambari HDFS Heatmaps are not
showing data (Not Applicable) for bytes read,
bytes written & DataNode Process Network I/O Utilization
Posted by Jayush Luniya <jl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62250/#review185250
-----------------------------------------------------------
Ship it!
Ship It!
- Jayush Luniya
On Sept. 12, 2017, 4:58 p.m., Aravindan Vijayan wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62250/
> -----------------------------------------------------------
>
> (Updated Sept. 12, 2017, 4:58 p.m.)
>
>
> Review request for Ambari, Dmytro Sen, Jayush Luniya, and Sid Wagle.
>
>
> Bugs: AMBARI-21939
> https://issues.apache.org/jira/browse/AMBARI-21939
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: HDFS Heatmaps are not showing data (Not Applicable) for bytes read, bytes written & DataNode Process Network I/O Utilization
>
> EXPECTED BEHAVIOUR: Heatmaps should show data
>
> ACTUAL BEHAVIOUR: Data is being shown as Not Applicable (Grey Box)
>
> ANALYSIS
> This is reproducible in Ambari 2.2.2 and Ambari 2.5.1.0. If you go to HDFS, then click on Heatmaps, you can see the API call go to
> fields=host_components/metrics/dfs/datanode/bytes_written._rate
> however this returns no values. If you remove ._rate then you can see the values which you would expect.
> Attach one or more files to this issue
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog260.java 9e145c0
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/widgets.json bcfb2cc
> ambari-server/src/main/resources/stacks/HDP/2.3/services/HDFS/widgets.json eeb9ff8
> ambari-server/src/main/resources/stacks/PERF/1.0/services/FAKEHDFS/widgets.json 7a793f8
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog260Test.java db6ebc1
>
>
> Diff: https://reviews.apache.org/r/62250/diff/1/
>
>
> Testing
> -------
>
> Manually tested.
> UpgradeCatalog260 test added.
>
>
> Thanks,
>
> Aravindan Vijayan
>
>
Re: Review Request 62250: AMBARI-21939 : Ambari HDFS Heatmaps are not
showing data (Not Applicable) for bytes read,
bytes written & DataNode Process Network I/O Utilization
Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62250/#review185246
-----------------------------------------------------------
Ship it!
Ship It!
- Sid Wagle
On Sept. 12, 2017, 4:58 p.m., Aravindan Vijayan wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62250/
> -----------------------------------------------------------
>
> (Updated Sept. 12, 2017, 4:58 p.m.)
>
>
> Review request for Ambari, Dmytro Sen, Jayush Luniya, and Sid Wagle.
>
>
> Bugs: AMBARI-21939
> https://issues.apache.org/jira/browse/AMBARI-21939
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: HDFS Heatmaps are not showing data (Not Applicable) for bytes read, bytes written & DataNode Process Network I/O Utilization
>
> EXPECTED BEHAVIOUR: Heatmaps should show data
>
> ACTUAL BEHAVIOUR: Data is being shown as Not Applicable (Grey Box)
>
> ANALYSIS
> This is reproducible in Ambari 2.2.2 and Ambari 2.5.1.0. If you go to HDFS, then click on Heatmaps, you can see the API call go to
> fields=host_components/metrics/dfs/datanode/bytes_written._rate
> however this returns no values. If you remove ._rate then you can see the values which you would expect.
> Attach one or more files to this issue
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog260.java 9e145c0
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/widgets.json bcfb2cc
> ambari-server/src/main/resources/stacks/HDP/2.3/services/HDFS/widgets.json eeb9ff8
> ambari-server/src/main/resources/stacks/PERF/1.0/services/FAKEHDFS/widgets.json 7a793f8
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog260Test.java db6ebc1
>
>
> Diff: https://reviews.apache.org/r/62250/diff/1/
>
>
> Testing
> -------
>
> Manually tested.
> UpgradeCatalog260 test added.
>
>
> Thanks,
>
> Aravindan Vijayan
>
>