DSS v7 up50 - slow cluster performane with 10Gbe

[Tommy]

Hi,

i'm testing dss v7 with vmware ESXi 5.5 and have a strange situation. At the moment i have only one linux machine on the cluster and the result from harddisk performance is the following:

Command (1GB):
"dd if=/dev/zero of=/root/testfile bs=1G count=1 oflag=direct"

Running cluster:
"1073741824 Bytes (1,1 GB) kopiert, 12,5809 s, 85,3 MB/s"

Shutting down one node and degrade cluster (a or b - regardless of which):
"1073741824 Bytes (1,1 GB) kopiert, 1,42768 s, 482 MB/s"

Hardware setup (each node):
Replication: 2x 10Gbe (bond0, rr)
iSCSI: 2x 10Gbe (MPIO)
WebGUI: 1GBit

If i test the network speed between the nodes from console (add-ons), i got 6-7GBit for each 10Gbe interface. Its also the same with jumbo frames.

Is there any way to solve this problem? I will be grateful

PS: sorry for my english

[Gr-R]

What are your RAID cache settings?
Have you tweaked the initiator advanced properties to match DSS V7?
===
QueuedCommands=8
DataDigest=None
MaxOutstandingR2T=32
InitialR2T=No
FirstBurstLength=65536
MaxRecvDataSegmentLength=1048576
HeaderDigest=None
MaxXmitDataSegmentLength=1048576
ImmediateData=Yes
MaxBurstLength=1048576

[Tommy]

RAID: HP P420/2GB BBWC, 2x 200GB SSD SmartCache

After tweaking initiator its better, but it could be more. In compared to degraded cluster.
"1073741824 Bytes (1,1 GB) kopiert, 4,77698 s, 225 MB/s"

[Gr-R]

you may want to check how the caching is set on the raid. If I recall correctly, you may set different percentages for read or write on the card.

[Tommy]

yes, you're right. 70% read / 30% write

[Gr-R]

you might try different cache values based on your testing.
balance-rr is the least sophisticated bond, this should not be a problem.

[Tommy]

Maybe its a problem with balance-rr bonding mode?