PDA

View Full Version : DSS Server stats (check_sys)


markstaller
03-29-2007, 01:39 PM
Referring to my previous post regarding server stats (check_sys);
After hitting "remove" several (5+) times, it works and is also fast.
I had a high load (for whatever reason as nothing was active on the DSS), but since my RAID-5 is still migrating from 64k to 256k (nearly 48h now, sigh!) there might be some explanations..

Now regarding check_sys, which I see the first time after the hint from To-M:
- it seems open to anyone without auth ? No big issue for me but maybe noticable
- I'm missing some valuable things: IOWait CPU, Block/Disk-IO

For anybody interested, I'm monitoring most already with MRTG remotely, my config below.
Some notes on this:
- Ethernet stats are limited (read: useless) to smthg. above 100MBit/s due to 32bit counter overflow. The DSS doesn't provide ifHCInOctets/ifHCOutOctets (64bit counters) to workaround.. I'm also monitoring the Switch to get the traffic..
- I haven't worked out the DiskIO-counters yet, which would be very interesting. Somehow I'd need some hints which devices are what as my counters for sdaX don't show the same as block-io (which they should in testbed). Any explanantion appreciated..
- What is *really* missing from the snmp in DSS is hrStorageTable which could be used to monitor volume-usage (commented out below)
Just replace SNMPCOMMUNITY and dss-hostname to use.

(config in next post due to 10k char size limit)

markstaller
03-29-2007, 01:44 PM
#-#Total[dss-hostname_3]: Totals dss-hostname in Location Interface eth0 / x.y.30.40
Target[dss-hostname_3]: ifInOctets.3&ifOutOctets.3:SNMPCOMMUNITY@dss-hostname:::::2
SetEnv[dss-hostname_3]: MRTG_INT_IP="x.y.30.40" MRTG_INT_DESCR="eth0"
Legend1[dss-hostname_3]: Avg Input Traffic Bytes/sec
Legend2[dss-hostname_3]: Avg Output Traffic Bytes/sec
Legend3[dss-hostname_3]: Maximal Input Traffic Bytes/sec
Legend4[dss-hostname_3]: Maximal Output Traffic Bytes/sec
MaxBytes[dss-hostname_3]: 125000000
Directory[dss-hostname_3]: dss-hostname
Title[dss-hostname_3]: eth0 Traffic -- dss
PageTop[dss-hostname_3]: <H1>eth0 Traffic -- dss</H1>
<TABLE>
<TR><TD>System:</TD> <TD>dss in Location</TD></TR>
<TR><TD>Maintainer:</TD> <TD>hostmaster@elabnet.de</TD></TR>
<TR><TD>Description:</TD><TD>eth0 </TD></TR>
<TR><TD>ifType:</TD> <TD>ethernetCsmacd (6)</TD></TR>
<TR><TD>ifName:</TD> <TD>eth0</TD></TR>
<TR><TD>Max Speed:</TD> <TD>125 MBytes/s / 1000 Mbits/s</TD></TR>
<TR><TD>Ip:</TD> <TD>x.y.30.40 ()</TD></TR>
<TR><TD><b>Traffic totals:</b></TD><TD><a href=/mrtg-rrd/totals/dss-hostname_3.total.2004.html>2004</a>&nbsp;<a href=/mrtg-rrd/totals/dss-hostname_3.total.2005.html>2005</a>&nbsp;<a href=/mrtg-rrd/totals/dss-hostname_3.total.2006.html>2006</a>&nbsp;<a href=/mrtg-rrd/totals/dss-hostname_3.total.2007.html>2007</a></TD></TR>

</TABLE>
# ---------------------------------------------------------------------
Target[dss-hostname_3-UCastpkts]: ifInUcastPkts.3&ifOutUcastPkts.3:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname_3-UCastpkts]: dss-hostname/detail
YLegend[dss-hostname_3-UCastpkts]: Unicast pkts/s
ShortLegend[dss-hostname_3-UCastpkts]: pkts/s
Legend1[dss-hostname_3-UCastpkts]: Avg Input Unicast Packets
Legend2[dss-hostname_3-UCastpkts]: Avg Output Unicast Packets
Legend3[dss-hostname_3-UCastpkts]: Max Input Unicast Packets
Legend4[dss-hostname_3-UCastpkts]: Max Output Unicast Packets
LegendI[dss-hostname_3-UCastpkts]: ifInUcast:
LegendO[dss-hostname_3-UCastpkts]: IfOutUcast:
MaxBytes[dss-hostname_3-UCastpkts]: 168918
Options[dss-hostname_3-UCastpkts]: growright, nopercent
Title[dss-hostname_3-UCastpkts]: eth0 Unicast Packets -- dss
PageTop[dss-hostname_3-UCastpkts]: <H1>eth0 Unicast Packets -- dss</H1>
# ---------------------------------------------------------------------
Target[dss-hostname_3-errors]: ifInErrors.3&ifOutErrors.3:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname_3-errors]: dss-hostname/detail
YLegend[dss-hostname_3-errors]: IfErrors
ShortLegend[dss-hostname_3-errors]: err/min
Legend1[dss-hostname_3-errors]: Avg Input Errors
Legend2[dss-hostname_3-errors]: Avg Output Errors
Legend3[dss-hostname_3-errors]: Max Input Errors
Legend4[dss-hostname_3-errors]: Max Output Errors
LegendI[dss-hostname_3-errors]: In:
LegendO[dss-hostname_3-errors]: Out:
WithPeak[dss-hostname_3-errors]: ymw
MaxBytes[dss-hostname_3-errors]: 168918
Options[dss-hostname_3-errors]: growright, nopercent, perminute
Title[dss-hostname_3-errors]: eth0 Errors -- dss
PageTop[dss-hostname_3-errors]: <H1>eth0 Errors -- dss</H1>

#---------------------------------------------------------------
# User vs System CPU usage
Target[dss-hostname.cpu-usage-raw]: ssCpuRawUser.0&ssCpuRawSystem.0:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.cpu-usage-raw]: dss-hostname
Options[dss-hostname.cpu-usage-raw]: nopercent,growright
WithPeak[dss-hostname.cpu-usage-raw]: ymw
MaxBytes[dss-hostname.cpu-usage-raw]: 100
AbsMax[dss-hostname.cpu-usage-raw]: 1000
Title[dss-hostname.cpu-usage-raw]: dss-hostname CPU usage User/System
PageTop[dss-hostname.cpu-usage-raw]: <H1>dss-hostname CPU usage User/System </H1>
Unscaled[dss-hostname.cpu-usage-raw]: ymwd
ShortLegend[dss-hostname.cpu-usage-raw]: %
YLegend[dss-hostname.cpu-usage-raw]: CPU Utilization
Legend1[dss-hostname.cpu-usage-raw]: User CPU %
Legend2[dss-hostname.cpu-usage-raw]: System CPU %
Legend3[dss-hostname.cpu-usage-raw]: Peak User CPU %
Legend4[dss-hostname.cpu-usage-raw]: Peak System CPU %
LegendI[dss-hostname.cpu-usage-raw]: User CPU
LegendO[dss-hostname.cpu-usage-raw]: System CPU
#---------------------------------------------------------------
# Nice vs Idle CPU usage
Target[dss-hostname.cpu-nice-idle]: ssCpuRawNice.0&ssCpuRawIdle.0:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.cpu-nice-idle]: dss-hostname
Options[dss-hostname.cpu-nice-idle]: nopercent,growright
WithPeak[dss-hostname.cpu-nice-idle]: ymw
MaxBytes[dss-hostname.cpu-nice-idle]: 100
AbsMax[dss-hostname.cpu-nice-idle]: 1000
Title[dss-hostname.cpu-nice-idle]: dss-hostname CPU usage Nice/Idle
PageTop[dss-hostname.cpu-nice-idle]: <H1>dss-hostname CPU usage Nice/Idle</H1>
Unscaled[dss-hostname.cpu-nice-idle]: ymwd
ShortLegend[dss-hostname.cpu-nice-idle]: %
YLegend[dss-hostname.cpu-nice-idle]: CPU Utilization
Legend1[dss-hostname.cpu-nice-idle]: Nice CPU %
Legend2[dss-hostname.cpu-nice-idle]: Idle CPU %
Legend3[dss-hostname.cpu-nice-idle]: Peak Nice CPU %
Legend4[dss-hostname.cpu-nice-idle]: Peak Idle CPU %
LegendI[dss-hostname.cpu-nice-idle]: Nice CPU
LegendO[dss-hostname.cpu-nice-idle]: Idle CPU
#---------------------------------------------------------------
# IOWait vs Kernel CPU usage
Target[dss-hostname.cpu-wait-kernel]: ssCpuRawWait.0&ssCpuRawKernel.0:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.cpu-wait-kernel]: dss-hostname
Options[dss-hostname.cpu-wait-kernel]: nopercent,growright
WithPeak[dss-hostname.cpu-wait-kernel]: ymw
MaxBytes[dss-hostname.cpu-wait-kernel]: 100
AbsMax[dss-hostname.cpu-wait-kernel]: 1000
Title[dss-hostname.cpu-wait-kernel]: dss-hostname CPU usage IOwait/Kernel
PageTop[dss-hostname.cpu-wait-kernel]: <H1>dss-hostname CPU usage IOwait/Kernel</H1>
Unscaled[dss-hostname.cpu-wait-kernel]: ymwd
ShortLegend[dss-hostname.cpu-wait-kernel]: %
YLegend[dss-hostname.cpu-wait-kernel]: CPU Utilization
Legend1[dss-hostname.cpu-wait-kernel]: IOwait CPU %
Legend2[dss-hostname.cpu-wait-kernel]: Kernel CPU %
Legend3[dss-hostname.cpu-wait-kernel]: Peak IOwait CPU %
Legend4[dss-hostname.cpu-wait-kernel]: Peak Kernel CPU %
LegendI[dss-hostname.cpu-wait-kernel]: IOwait CPU
LegendO[dss-hostname.cpu-wait-kernel]: Kernel CPU
#---------------------------------------------------------------
# IRQ vs SoftIRQ CPU usage
Target[dss-hostname.cpu-irq-sirq]: ssCpuRawInterrupt.0&ssCpuRawSoftIRQ.0:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.cpu-irq-sirq]: dss-hostname
Options[dss-hostname.cpu-irq-sirq]: nopercent,growright
WithPeak[dss-hostname.cpu-irq-sirq]: ymw
MaxBytes[dss-hostname.cpu-irq-sirq]: 100
AbsMax[dss-hostname.cpu-irq-sirq]: 1000
Title[dss-hostname.cpu-irq-sirq]: dss-hostname CPU usage IRQ
PageTop[dss-hostname.cpu-irq-sirq]: <H1>dss-hostname CPU usage IRQ</H1>
Unscaled[dss-hostname.cpu-irq-sirq]: ymwd
ShortLegend[dss-hostname.cpu-irq-sirq]: %
YLegend[dss-hostname.cpu-irq-sirq]: CPU Utilization
Legend1[dss-hostname.cpu-irq-sirq]: IRQ CPU %
Legend2[dss-hostname.cpu-irq-sirq]: SoftIRQ CPU %
Legend3[dss-hostname.cpu-irq-sirq]: Peak IRQ CPU %
Legend4[dss-hostname.cpu-irq-sirq]: Peak SoftIRQ CPU %
LegendI[dss-hostname.cpu-irq-sirq]: IRQ CPU
LegendO[dss-hostname.cpu-irq-sirq]: SoftIRQ CPU
#---------------------------------------------------------------
# System Load SNMP
Target[dss-hostname.load]: laLoadInt.1&laLoadInt.2:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.load]: dss-hostname
Options[dss-hostname.load]: nopercent,gauge,growright
WithPeak[dss-hostname.load]: ymw
Title[dss-hostname.load]: dss-hostname load
PageTop[dss-hostname.load]: <h1>dss-hostname load </h1>
MaxBytes[dss-hostname.load]: 2000
AbsMax[dss-hostname.load]: 10000
YLegend[dss-hostname.load]: dss-hostname load * 100
ShortLegend[dss-hostname.load]: &nbsp;
Legend1[dss-hostname.load]: Load avg 1min (*100)
Legend2[dss-hostname.load]: Load avg 5min (*100)
Legend3[dss-hostname.load]: Peak Load avg 1min (*100)
Legend4[dss-hostname.load]: Peak Load avg 5min (*100)
LegendI[dss-hostname.load]: Load avg 1min
LegendO[dss-hostname.load]: Load avg 5min
#---------------------------------------------------------------------
Target[dss-hostname.mem-buf-cache]: memBuffer.0&memCached.0:SNMPCOMMUNITY@dss-hostname:::::2 * 1024
Directory[dss-hostname.mem-buf-cache]: dss-hostname
Options[dss-hostname.mem-buf-cache]: gauge,growright,nopercent
WithPeak[dss-hostname.mem-buf-cache]: ymw
Title[dss-hostname.mem-buf-cache]: Mem Buffer/Cache usage -- dss-hostname
PageTop[dss-hostname.mem-buf-cache]: <h1>Mem Buffer/Cache usage -- dss-hostname</h1><br>
MaxBytes[dss-hostname.mem-buf-cache]: 4294967296
YLegend[dss-hostname.mem-buf-cache]: Mem usage
ShortLegend[dss-hostname.mem-buf-cache]: Bytes
Legend1[dss-hostname.mem-buf-cache]: Used Buffer
Legend2[dss-hostname.mem-buf-cache]: Used Cached
Legend3[dss-hostname.mem-buf-cache]: Peak Buffer
Legend4[dss-hostname.mem-buf-cache]: Peak Cached
LegendI[dss-hostname.mem-buf-cache]: Buffer
LegendO[dss-hostname.mem-buf-cache]: Cached
#---------------------------------------------------------------
# Swapping
Target[dss-hostname.swappio]: ssRawSwapIn.0&ssRawSwapOut.0:SNMPCOMMUNITY@dss-hostname:::::2 * 512
Directory[dss-hostname.swappio]: dss-hostname
Options[dss-hostname.swappio]: nopercent,growright
WithPeak[dss-hostname.swappio]: ymw
MaxBytes[dss-hostname.swappio]: 100000000
Title[dss-hostname.swappio]: dss-hostname swapping
PageTop[dss-hostname.swappio]: <H1>dss-hostname swapping</H1>
ShortLegend[dss-hostname.swappio]: Bytes/s
YLegend[dss-hostname.swappio]: Swapped Bytes/s
Legend1[dss-hostname.swappio]: Swap In
Legend2[dss-hostname.swappio]: Swap Out
Legend3[dss-hostname.swappio]: Peak Swap In
Legend4[dss-hostname.swappio]: Peak Swap Out
LegendI[dss-hostname.swappio]: Swap In
LegendO[dss-hostname.swappio]: Swap Out

markstaller
03-29-2007, 01:45 PM
#---------------------------------------------------------------
# IO-blocks
Target[dss-hostname.io-blocks]: ssIORawSent.0&ssIORawReceived.0:SNMPCOMMUNITY@dss-hostname:::::2 * 512
Directory[dss-hostname.io-blocks]: dss-hostname
Options[dss-hostname.io-blocks]: nopercent,growright
WithPeak[dss-hostname.io-blocks]: ymw
MaxBytes[dss-hostname.io-blocks]: 100000000
Title[dss-hostname.io-blocks]: dss-hostname Block I/O
PageTop[dss-hostname.io-blocks]: <H1>dss-hostname Block I/O</H1>
ShortLegend[dss-hostname.io-blocks]: Bytes/s
YLegend[dss-hostname.io-blocks]: Block I/O (Bytes/s)
Legend1[dss-hostname.io-blocks]: Sent (read)
Legend2[dss-hostname.io-blocks]: Received (write)
Legend3[dss-hostname.io-blocks]: Peak Sent
Legend4[dss-hostname.io-blocks]: Peak Received
LegendI[dss-hostname.io-blocks]: Sent
LegendO[dss-hostname.io-blocks]: Received
#---------------------------------------------------------------
# IRQ / Context-switches
Target[dss-hostname.irq-context]: ssRawInterrupts.0&ssRawContexts.0:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.irq-context]: dss-hostname
Options[dss-hostname.irq-context]: nopercent,growright
WithPeak[dss-hostname.irq-context]: ymw
MaxBytes[dss-hostname.irq-context]: 10000000
Title[dss-hostname.irq-context]: dss-hostname Ints/Context-switches
PageTop[dss-hostname.irq-context]: <H1>dss-hostname Ints/Context-switches</H1>
ShortLegend[dss-hostname.irq-context]: /s
YLegend[dss-hostname.irq-context]: Int/Context-switches
Legend1[dss-hostname.irq-context]: Interrupts
Legend2[dss-hostname.irq-context]: Context-switches
Legend3[dss-hostname.irq-context]: Peak Interrupts
Legend4[dss-hostname.irq-context]: Peak Context-switches
LegendI[dss-hostname.irq-context]: Interrupts
LegendO[dss-hostname.irq-context]: Ctx-switches


#---------------------------------------------------------------------
# HOST-RESOURCES-MIB
#Target[dss-hostname.diskuse]: 1.3.6.1.2.1.25.2.3.1.6.4&1.3.6.1.2.1.25.2.3.1.6.9:SNMPCOMMUNITY@dss-hostname / 1.3.6.1.2.1.25.2.3.1.5.4&1.3.6.1.2.1.25.2.3.1.5.9:SNMPCOMMUNITY@dss-hostname *100
#Directory[dss-hostname.diskuse]: dss-hostname
#Options[dss-hostname.diskuse]: gauge,growright,nopercent
#WithPeak[dss-hostname.diskuse]: ymw
#Title[dss-hostname.diskuse]: Disk usage / -- dss-hostname
#PageTop[dss-hostname.diskuse]: <h1>Disk usage / -- dss-hostname</h1><br>
#MaxBytes[dss-hostname.diskuse]: 100
#YLegend[dss-hostname.diskuse]: Disk usage
#ShortLegend[dss-hostname.diskuse]: %
#Unscaled[dss-hostname.diskuse]: ymwd
#Legend1[dss-hostname.diskuse]: Used Volume /
#Legend2[dss-hostname.diskuse]: Used backup-vol
#Legend3[dss-hostname.diskuse]: Peak used Volume /
#Legend4[dss-hostname.diskuse]: Peak used backup-vol
#LegendI[dss-hostname.diskuse]: /
#LegendO[dss-hostname.diskuse]: backup-vol
#---------------------------------------------------------------------
#Target[dss-hostname.diskuse2]: 1.3.6.1.2.1.25.2.3.1.6.7&1.3.6.1.2.1.25.2.3.1.6.9:SNMPCOMMUNITY@dss-hostname / 1.3.6.1.2.1.25.2.3.1.5.7&1.3.6.1.2.1.25.2.3.1.5.9:SNMPCOMMUNITY@dss-hostname *100
#Directory[dss-hostname.diskuse2]: dss-hostname
#Options[dss-hostname.diskuse2]: gauge,growright,nopercent
#WithPeak[dss-hostname.diskuse2]: ymw
#Title[dss-hostname.diskuse2]: Disk usage volumes2 -- dss-hostname
#PageTop[dss-hostname.diskuse2]: <h1>Disk usage volumes2 -- dss-hostname</h1><br>
#MaxBytes[dss-hostname.diskuse2]: 100
#YLegend[dss-hostname.diskuse2]: Disk usage
#ShortLegend[dss-hostname.diskuse2]: %
#Unscaled[dss-hostname.diskuse2]: ymwd
#Legend1[dss-hostname.diskuse2]: Used install-vol
#Legend2[dss-hostname.diskuse2]: Used backup-vol
#Legend3[dss-hostname.diskuse2]: Peak used install-vol
#Legend4[dss-hostname.diskuse2]: Peak used backup-vol
#LegendI[dss-hostname.diskuse2]: install-vol
#LegendO[dss-hostname.diskuse2]: backup-vol
#---------------------------------------------------------------------
#Target[dss-hostname.vmuse]: 1.3.6.1.2.1.25.2.3.1.6.2&1.3.6.1.2.1.25.2.3.1.6.3:SNMPCOMMUNITY@dss-hostname:::::2 * 1024
#Directory[dss-hostname.vmuse]: dss-hostname
#Options[dss-hostname.vmuse]: gauge,growright
#WithPeak[dss-hostname.vmuse]: ymw
#Title[dss-hostname.vmuse]: VM usage -- dss-hostname
#PageTop[dss-hostname.vmuse]: <h1>VM usage -- dss-hostname</h1><br>
#MaxBytes1[dss-hostname.vmuse]: 1057112064
#MaxBytes2[dss-hostname.vmuse]: 1538117632
#YLegend[dss-hostname.vmuse]: Mem usage
#ShortLegend[dss-hostname.vmuse]: Bytes
#Legend1[dss-hostname.vmuse]: Used RAM
#Legend2[dss-hostname.vmuse]: Used Swap
#Legend3[dss-hostname.vmuse]: Peak used RAM
#Legend4[dss-hostname.vmuse]: Peak used Swap
#LegendI[dss-hostname.vmuse]: RAM
#LegendO[dss-hostname.vmuse]: Swap

# DiskIO-MIB
#---------------------------------------------------------------
# Bytes IO
Target[dss-hostname.dskio-1]: 1.3.6.1.4.1.2021.13.15.1.1.3.51&1.3.6.1.4.1.2021.13.15.1.1.4.51:SNMPCOMMUNITY@dss-hostname:::::2 + 1.3.6.1.4.1.2021.13.15.1.1.3.58&1.3.6.1.4.1.2021.13.15.1.1.4.58:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.dskio-1]: dss-hostname
Options[dss-hostname.dskio-1]: nopercent,growright
WithPeak[dss-hostname.dskio-1]: ymw
MaxBytes[dss-hostname.dskio-1]: 1000000000
Title[dss-hostname.dskio-1]: dss-hostname Disk1 I/O
PageTop[dss-hostname.dskio-1]: <H1>dss-hostname Disk1 I/O</H1>
ShortLegend[dss-hostname.dskio-1]: Bytes/s
YLegend[dss-hostname.dskio-1]: Disk I/O (Bytes/s)
Legend1[dss-hostname.dskio-1]: Read
Legend2[dss-hostname.dskio-1]: Written
Legend3[dss-hostname.dskio-1]: Peak Read
Legend4[dss-hostname.dskio-1]: Peak Written
LegendI[dss-hostname.dskio-1]: Read
LegendO[dss-hostname.dskio-1]: Written
#---------------------------------------------------------------
# IO requ
Target[dss-hostname.dskioreq-1]: 1.3.6.1.4.1.2021.13.15.1.1.5.51&1.3.6.1.4.1.2021.13.15.1.1.6.51:SNMPCOMMUNITY@dss-hostname:::::2 + 1.3.6.1.4.1.2021.13.15.1.1.5.58&1.3.6.1.4.1.2021.13.15.1.1.6.58:SNMPCOMMUNITY@dss-hostname:::::2
Directory[dss-hostname.dskioreq-1]: dss-hostname
Options[dss-hostname.dskioreq-1]: nopercent,growright
WithPeak[dss-hostname.dskioreq-1]: ymw
MaxBytes[dss-hostname.dskioreq-1]: 100000
Title[dss-hostname.dskioreq-1]: dss-hostname Disk1 I/O req
PageTop[dss-hostname.dskioreq-1]: <H1>dss-hostname Disk1 I/O req</H1>
ShortLegend[dss-hostname.dskioreq-1]: Req/s
YLegend[dss-hostname.dskioreq-1]: Disk I/O (Req/s)
Legend1[dss-hostname.dskioreq-1]: Read
Legend2[dss-hostname.dskioreq-1]: Write
Legend3[dss-hostname.dskioreq-1]: Peak Read
Legend4[dss-hostname.dskioreq-1]: Peak Write
LegendI[dss-hostname.dskioreq-1]: Read
LegendO[dss-hostname.dskioreq-1]: Write