Oops!

I have to take this back. I didn't realize I had my DSS Management IP added to the multipath of my 2 ISCSI nics, so that multipath -ll command showed 3 total active connections when when there should have been 2. The traffic was going out over my DSS mangement nic which has an MTU of 1500 instead of the 2 NICS that had Jumbo Frames enabled and an MTU=9000.

Fixed it and ran the test and getting the same throughput for the XEN servers as well as the Xenserver servers, about 85MB/s.