Lsi Megaraid Sata Ii 300x-8

Hi,

I've very poor performance with my OPEN-E ISCSI. Manual copy of files with different size brings only 14 MB/s and Backup of 684 GB to ISCSI Target needs 18 hours to complete.

My hardware:
Supermicro Board X6DH8-XG2
LSI Megaraid Sata II 300X-8LP 128 MB Cache (w/o Battery)
8GB RAM
2 x XEON 2,8 GHz
6 x 1 TB Seagate ES2 as HW-Raid 5
2 x Dualport INTEL PRO 1000 Server NIC in Round-rr bonding
1 Target with 4 TB (File I/O)

I tried several settings an tuning options but nothing happend, the performance is never better than 22 MB/s.

Has anybody similar configuration or any tips for tuning my config? Is the Controller my bottleneck and if so, what Controller should be used??

Thanks

Do you have cache enabled in the raid controller, Have you enabled WB in the luns.
What do you get for disk write speed (hdparm) in the logs
I have been getting better results with MPIO than with bonding.
Have you checked your host or iSCSI initator settings to rule them out.

Hi,

yes cache is enabled on controller and WB on luns.

hdparm report:
*-----------------------------------------------------------------------------*
hdparm -t /dev/sda
*-----------------------------------------------------------------------------*
/dev/sda:
Timing buffered disk reads: 56 MB in 3.06 seconds = 18.27 MB/sec
*-----------------------------------------------------------------------------*
hdparm -t /dev/sdb
*-----------------------------------------------------------------------------*
/dev/sdb:
Timing buffered disk reads: 408 MB in 3.00 seconds = 135.88 MB/sec
*-----------------------------------------------------------------------------*
hdparm -t /dev/sdc
*-----------------------------------------------------------------------------*
/dev/sdc:
Timing buffered disk reads: 128 MB in 3.04 seconds = 42.16 MB/sec
*-----------------------------------------------------------------------------*
hdparm -t /dev/sdd
*-----------------------------------------------------------------------------*
/dev/sdd:
Timing buffered disk reads: 98 MB in 3.00 seconds = 32.64 MB/sec

On another testmachine with only softwareraid 5 and older harddisks, i got this hdparm:
/dev/md0:
Timing buffered disk reads: 512 MB in 3.00 seconds = 170.47 MB/sec

Check you Raid controller config should be getting better disk reads.
What are you getting in ifconfig for the NIC's , are you dropping any packets?
can we see your iscsi deamon properties

I've done some more testing and here are the results:
1. change raid controller drivesettings from cached I/O to Direct I/O
2. delete all targets and create them new using File I/O
3. delete the bonding

here is the hdparm:

*-----------------------------------------------------------------------------*
hdparm -t /dev/sdb
*-----------------------------------------------------------------------------*
/dev/sdb:
Timing buffered disk reads: 844 MB in 3.01 seconds = 280.80 MB/sec
*-----------------------------------------------------------------------------*
hdparm -t /dev/sdc
*-----------------------------------------------------------------------------*
/dev/sdc:
Timing buffered disk reads: 800 MB in 3.00 seconds = 266.25 MB/sec
*-----------------------------------------------------------------------------*
hdparm -t /dev/sdd
*-----------------------------------------------------------------------------*
/dev/sdd:
Timing buffered disk reads: 822 MB in 3.00 seconds = 273.76 MB/sec

Is there anything else i can do to speed up my system?

What about the tuning options in open-e? I've read that there can be done by changing some parameters.

I forgot:
*-----------------------------------------------------------------------------*
ifconfig -a
*-----------------------------------------------------------------------------*

eth0 Link encap:Ethernet HWaddr 00:30:48:79:5E:D0
inet addr:10.0.0.200 Bcast:10.0.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:669244 errors:0 dropped:0 overruns:0 frame:0
TX packets:5744245 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:948912030 (904.9 MiB) TX bytes:419638425 (400.1 MiB)
Base address:0x3000 Memory:dd300000-dd320000

eth1 Link encap:Ethernet HWaddr 00:30:48:79:5E:D1
inet addr:10.0.0.201 Bcast:10.0.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:8576954 errors:0 dropped:0 overruns:0 frame:0
TX packets:626987 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:4282156554 (3.9 GiB) TX bytes:78363728 (74.7 MiB)
Base address:0x3040 Memory:dd320000-dd340000

eth2 Link encap:Ethernet HWaddr 00:04:23:AF:2F:00
inet addr:10.0.0.202 Bcast:10.0.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5981255 errors:0 dropped:0 overruns:0 frame:0
TX packets:627633 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:367457688 (350.4 MiB) TX bytes:79418583 (75.7 MiB)
Base address:0x4000 Memory:dd640000-dd660000

eth3 Link encap:Ethernet HWaddr 00:04:23:AF:2F:01
inet addr:10.0.0.203 Bcast:10.0.0.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:720098 errors:0 dropped:0 overruns:0 frame:0
TX packets:627016 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1033922350 (986.0 MiB) TX bytes:78329063 (74.7 MiB)
Base address:0x4040 Memory:dd660000-dd680000

my ifconfig seems to be ok, no dropped packets.

Try these settings

maxRecvDataSegmentLen=262144
MaxBurstLength=16776192
Maxxmitdatasegment=262144
maxoutstandingr2t=8
InitialR2T=No
ImmediateData=Yes

Tried all but is always slow. How can i set up MPIO? Is there a How-To ?