Quote Originally Posted by zeki893
i forgot to mention i'm using balance-rr bonded with 2x Intel Corporation PRO/1000 PT Dual Port Server Adapter and 2xBroadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12)

on the router i have a netiron mlx configured a link aggregation with the 4 ports.
i see about 200-300Mbps on each port when i run the bonnie++ with a max at around 750Mbps so i think that translates to about 93MBps

i ran hd tach and i'm averaging about 45MBps.

When i have bonnie++ running on one target and hd tach on another i see the performance on hd tach drop to average 10-20MBps

So are these results I'm getting normal? Is this the hardware limit of my setup?

I just want to make sure I'm not underperforming. If I am, what I can do to improve its performance?
G'day,
One way to review the "Raw" speed of your array, is to download the logs and look for the tests.log, in there you should see a hdparm test, what is the result?
On one system we have 12x 1TB Seagates on an Adaptec 5405 all in a Raid6 and the raw speed was 135.01 MB/sec, yet the Network speed was <10MB/s (fault was with the Intel drivers in DSS)
Also, with balance-rr, as far as I know this is switch independent(as opposed to 802.3ad), so I don't know the affect if you also bond the switch ports?
Also, when you combine cards with different chipsets into a bonded interface you can get issues with incompatibilities there too. (Fault tolerance works, but not load balance.)
Try putting all the traffic through a single card and see if it makes a difference, as we had a problem with the Intel Pro1000's try using just one and compare with the Broadcom.

Rgds Ben