Ok, I am still not understanding something. In the "How to Setup DSS V6 iSCSI Failover with XenServer using Multipath", on page 3, there is a diagram. It lists all of the interfaces on both the primary and the secondary nodes as "Auxiliary connection (Heartbeat)". But if the physical interface that is connected to a switch is not on a trunked port with VLAN how would that heartbeat work as the Virtual IP (on a different subnet) would be the only one routable. Thus when the primary is working and has the Virtual IP on eth1 and eth2, the secondary has not IP on a routable subnet since it's physical interface IP would not be routable (unless the port is connected to is trunked).
What am I missing or not understanding here? This is making my setup of Open-E DSS extremely difficult and frustrating.