I don't quite understand your diagram, but if your base question is:

Should I dedicate a NIC for iSCSI traffic

Then the answer is YES.

Many have even dedicated physical switches (such as myself) for iSCSI traffic. Jumbo frames helps, but is not mandatory.