Adding NICs is one problem, but replacing them is even more complicated.
Now, I know!

Some information of old unused card (eth4) is still somewere in setup data and new card is recognised as new one (eth5), doesn't matter, it is the same type. Reset network settings is required and setup all NICs again.

So native hot-plugable PCIe practically doesn't work!