You can add a separate service console port so you end up with two. Then you can connect to the VM Host from either network with the Client.