You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Krish Donald <go...@gmail.com> on 2019/07/26 21:49:05 UTC
Cheat Sheet for Unix based OS, Performance troubleshooting
Any one has Cheat Sheet for Unix based OS, Performance troubleshooting ?
Re: Cheat Sheet for Unix based OS, Performance troubleshooting
Posted by Jon Haddad <jo...@jonhaddad.com>.
http://www.brendangregg.com/linuxperf.html
On Sat, Jul 27, 2019 at 2:45 AM Paul Chandler <pa...@redshots.com> wrote:
> I have always found Amy's Cassandra 2.1 tuning guide great for the Linux
> performance tuning:
> https://tobert.github.io/pages/als-cassandra-21-tuning-guide.html
>
> Sent from my iPhone
>
> On 26 Jul 2019, at 23:49, Krish Donald <go...@gmail.com> wrote:
>
> Any one has Cheat Sheet for Unix based OS, Performance troubleshooting ?
>
>
Re: Cheat Sheet for Unix based OS, Performance troubleshooting
Posted by Julien Laurenceau <ju...@pepitedata.com>.
Hi,
My personnal favorites when Prometheus is not there and/or insufficient
are:
- iostat -> log all disk metrics volume by volume
- nmon -> logs all metrics, but cannot see volume by volume IOPS
- nmonvisualizer
Regards
JL
# Monitor
## install dstat nmon iostat ioperf sar
## install nmonvisualizer java app : it parses nmon and iostat logs
--------
dstat -tcndylpm --top-cpu --disk-tps
iotop
sar -d 10
export S_TIME_FORMAT=ISO; iostat -tNxm 10 180 > iostat.$HOSTNAME.log
nmon -f -t -r test -s 10 -c 180
https://nmonvisualizer.github.io/nmonvisualizer/
-------
# Disk
smartctl -a /dev/sda
fio --name write_zookeeperlike --rate_iops=1 --eta-newline=5s
--filename=fio-tempfile-$(uuidgen).dat --rw=randwrite --size=1g
--blocksize=4k --ioengine=libaio --fsync=1 --iodepth=1 --direct=1
--numjobs=1 --runtime=60 --group_reporting
fio --name write_hdfslike --eta-newline=5s
--filename=fio-tempfile-$(uuidgen).dat --rw=randwrite --size=20g
--io_size=1024g --blocksize=128m --ioengine=libaio --fsync=1 --iodepth=1
--direct=1 --numjobs=8 --runtime=180 --group_reporting
-------------------
sudo iptables -L
Now to add a rule to the INPUT chain to drop 3% of incoming packets on
computer B:
$ sudo iptables -A INPUT -m statistic --mode random --probability 0.03 -j
DROP
iperf -c 192.168.1.5 -u -t 60
This rule should drop packet 100, 300, 500, 700, ... for only one of the
connections (with source port 39912):
$ sudo iptables -A INPUT -p udp --sport 39912 -m statistic --mode nth
--every 200 --packet 100 -j DROP
------------------------------------------------------------
Network delay OVERALL :
echo "simulating slowdown infrastructure on interface $DEV to IP:$IP for
port:$PORT";
tc qdisc del dev $DEV root
tc qdisc add dev $DEV handle 1: root htb
tc class add dev $DEV parent 1: classid 1:15 htb rate 1000Mbps
tc qdisc add dev $DEV parent 1:15 handle 11 netem delay 4000ms 2000ms
distribution normal
tc filter add dev $DEV parent 1:0 prio 1 protocol ip handle 11 fw flowid
1:15
# for all port :
# iptables -A OUTPUT -t mangle -d "$IP" -j MARK --set-mark 11
# for specific port
iptables -A OUTPUT -t mangle -d "$IP" -p tcp --dport ${PORT} -j MARK
--set-mark 11
((the undo script is here:))
iptables -D OUTPUT -t mangle -d "$IP" -j MARK --set-mark 11
tc qdisc del dev $DEV root
Le sam. 27 juil. 2019 à 11:45, Paul Chandler <pa...@redshots.com> a écrit :
> I have always found Amy's Cassandra 2.1 tuning guide great for the Linux
> performance tuning:
> https://tobert.github.io/pages/als-cassandra-21-tuning-guide.html
>
> Sent from my iPhone
>
> On 26 Jul 2019, at 23:49, Krish Donald <go...@gmail.com> wrote:
>
> Any one has Cheat Sheet for Unix based OS, Performance troubleshooting ?
>
>
Re: Cheat Sheet for Unix based OS, Performance troubleshooting
Posted by Paul Chandler <pa...@redshots.com>.
I have always found Amy's Cassandra 2.1 tuning guide great for the Linux performance tuning: https://tobert.github.io/pages/als-cassandra-21-tuning-guide.html
Sent from my iPhone
> On 26 Jul 2019, at 23:49, Krish Donald <go...@gmail.com> wrote:
>
> Any one has Cheat Sheet for Unix based OS, Performance troubleshooting ?