You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2015/02/24 16:15:39 UTC
Review Request 31357: AMS: ResultSpooler spill files are left behind
in /tmp folder
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31357/
-----------------------------------------------------------
Review request for Ambari and Myroslav Papirkovskyy.
Bugs: AMBARI-9771
https://issues.apache.org/jira/browse/AMBARI-9771
Repository: ambari
Description
-------
I've seen behavior, described in PHOENIX-1395, on Ambari cluster (200 nodes)
After 3 days running, /tmp folder is full of ResultSpool files
[root@perf-200-20feb-b-ams-1 ~]# ls -la /tmp/
total 4238768
drwxrwxrwt. 6 root root 4096 Feb 23 10:13 .
dr-xr-xr-x. 24 root root 4096 Feb 20 14:55 ..
drwxr-xr-x. 2 hdfs root 4096 Feb 20 16:46 hadoop-hdfs
drwxr-xr-x. 2 ams hadoop 4096 Feb 20 18:19 hsperfdata_ams
drwxrwxrwt. 2 root root 4096 Feb 20 14:16 .ICE-unix
drwxr-xr-x. 5 ams hadoop 4096 Feb 20 18:20 Jetty_0_0_0_0_6188_applicationhistory____g7149g
-rw-r--r--. 1 root root 617 Feb 20 14:16 keyfile.1115.pub
-rwxrwxrwx. 1 root root 2557032 Feb 20 17:59 libyjpagent.so
-rw-r--r--. 1 ams hadoop 16676205 Feb 22 11:36 ResultSpooler1083719173569401088.bin
-rw-r--r--. 1 ams hadoop 71227095 Feb 22 02:10 ResultSpooler1095642585411691664.bin
-rw-r--r--. 1 ams hadoop 48685977 Feb 22 11:32 ResultSpooler1119370459591752039.bin
-rw-r--r--. 1 ams hadoop 64366788 Feb 21 02:24 ResultSpooler1249566735083013570.bin
-rw-r--r--. 1 ams hadoop 102519737 Feb 21 15:15 ResultSpooler1434399174629975447.bin
-rw-r--r--. 1 ams hadoop 62280357 Feb 21 07:04 ResultSpooler1523399749056056116.bin
-rw-r--r--. 1 ams hadoop 99096145 Feb 21 23:28 ResultSpooler1591731371355221216.bin
-rw-r--r--. 1 ams hadoop 33274946 Feb 22 07:42 ResultSpooler1763163145889847809.bin
-rw-r--r--. 1 ams hadoop 29906801 Feb 22 06:45 ResultSpooler1924668033838582502.bin
-rw-r--r--. 1 ams hadoop 79817760 Feb 20 18:19 ResultSpooler2061194340898298157.bin
-rw-r--r--. 1 ams hadoop 39832796 Feb 22 11:32 ResultSpooler2084948115978783352.bin
-rw-r--r--. 1 ams hadoop 16340565 Feb 22 11:07 ResultSpooler2151011123128612740.bin
-
Diffs
-----
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java af05d93
Diff: https://reviews.apache.org/r/31357/diff/
Testing
-------
[INFO] ambari-metrics .................................... SUCCESS [0.902s]
[INFO] Ambari Metrics Common ............................. SUCCESS [3.730s]
[INFO] Ambari Metrics Hadoop Sink ........................ SUCCESS [3.699s]
[INFO] Ambari Metrics Flume Sink ......................... SUCCESS [1.508s]
[INFO] Ambari Metrics Kafka Sink ......................... SUCCESS [3.103s]
[INFO] Ambari Metrics Storm Sink ......................... SUCCESS [2.021s]
[INFO] Ambari Metrics Collector .......................... SUCCESS [4:44.470s]
[INFO] Ambari Metrics Monitor ............................ SUCCESS [7.022s]
[INFO] Ambari Metrics Assembly ........................... SUCCESS [2:37.007s]
Thanks,
Dmytro Sen
Re: Review Request 31357: AMS: ResultSpooler spill files are left
behind in /tmp folder
Posted by Myroslav Papirkovskyy <mp...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31357/#review73818
-----------------------------------------------------------
Ship it!
Ship It!
- Myroslav Papirkovskyy
On Лют. 24, 2015, 5:15 після полудня, Dmytro Sen wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31357/
> -----------------------------------------------------------
>
> (Updated Лют. 24, 2015, 5:15 після полудня)
>
>
> Review request for Ambari and Myroslav Papirkovskyy.
>
>
> Bugs: AMBARI-9771
> https://issues.apache.org/jira/browse/AMBARI-9771
>
>
> Repository: ambari
>
>
> Description
> -------
>
> I've seen behavior, described in PHOENIX-1395, on Ambari cluster (200 nodes)
> After 3 days running, /tmp folder is full of ResultSpool files
> [root@perf-200-20feb-b-ams-1 ~]# ls -la /tmp/
> total 4238768
> drwxrwxrwt. 6 root root 4096 Feb 23 10:13 .
> dr-xr-xr-x. 24 root root 4096 Feb 20 14:55 ..
> drwxr-xr-x. 2 hdfs root 4096 Feb 20 16:46 hadoop-hdfs
> drwxr-xr-x. 2 ams hadoop 4096 Feb 20 18:19 hsperfdata_ams
> drwxrwxrwt. 2 root root 4096 Feb 20 14:16 .ICE-unix
> drwxr-xr-x. 5 ams hadoop 4096 Feb 20 18:20 Jetty_0_0_0_0_6188_applicationhistory____g7149g
> -rw-r--r--. 1 root root 617 Feb 20 14:16 keyfile.1115.pub
> -rwxrwxrwx. 1 root root 2557032 Feb 20 17:59 libyjpagent.so
> -rw-r--r--. 1 ams hadoop 16676205 Feb 22 11:36 ResultSpooler1083719173569401088.bin
> -rw-r--r--. 1 ams hadoop 71227095 Feb 22 02:10 ResultSpooler1095642585411691664.bin
> -rw-r--r--. 1 ams hadoop 48685977 Feb 22 11:32 ResultSpooler1119370459591752039.bin
> -rw-r--r--. 1 ams hadoop 64366788 Feb 21 02:24 ResultSpooler1249566735083013570.bin
> -rw-r--r--. 1 ams hadoop 102519737 Feb 21 15:15 ResultSpooler1434399174629975447.bin
> -rw-r--r--. 1 ams hadoop 62280357 Feb 21 07:04 ResultSpooler1523399749056056116.bin
> -rw-r--r--. 1 ams hadoop 99096145 Feb 21 23:28 ResultSpooler1591731371355221216.bin
> -rw-r--r--. 1 ams hadoop 33274946 Feb 22 07:42 ResultSpooler1763163145889847809.bin
> -rw-r--r--. 1 ams hadoop 29906801 Feb 22 06:45 ResultSpooler1924668033838582502.bin
> -rw-r--r--. 1 ams hadoop 79817760 Feb 20 18:19 ResultSpooler2061194340898298157.bin
> -rw-r--r--. 1 ams hadoop 39832796 Feb 22 11:32 ResultSpooler2084948115978783352.bin
> -rw-r--r--. 1 ams hadoop 16340565 Feb 22 11:07 ResultSpooler2151011123128612740.bin
> -
>
>
> Diffs
> -----
>
> ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java af05d93
>
> Diff: https://reviews.apache.org/r/31357/diff/
>
>
> Testing
> -------
>
> [INFO] ambari-metrics .................................... SUCCESS [0.902s]
> [INFO] Ambari Metrics Common ............................. SUCCESS [3.730s]
> [INFO] Ambari Metrics Hadoop Sink ........................ SUCCESS [3.699s]
> [INFO] Ambari Metrics Flume Sink ......................... SUCCESS [1.508s]
> [INFO] Ambari Metrics Kafka Sink ......................... SUCCESS [3.103s]
> [INFO] Ambari Metrics Storm Sink ......................... SUCCESS [2.021s]
> [INFO] Ambari Metrics Collector .......................... SUCCESS [4:44.470s]
> [INFO] Ambari Metrics Monitor ............................ SUCCESS [7.022s]
> [INFO] Ambari Metrics Assembly ........................... SUCCESS [2:37.007s]
>
>
> Thanks,
>
> Dmytro Sen
>
>