Active Active replication

I am getting about 1000MBs read and 100MBs write using iometer, in a combined of test 66% read and 33% write I am getting 1100MBs which we are happy with. However as soon as I enable replication we are using a 10GB network direct connection the combined test goes down to 650MBs and the single write test goes down to 280MBs. So it is clear that replication is the issue. I have tested the network card speeds using the test add-on and the speeds are good. I have tried jumbo frames but no difference it just seems I can't saturate the 10GB link.

Would Infiniband cards be better for replication

Try some DRDB tunings:
http://www.drbd.org/users-guide/s-th...ut-tuning.html