Well, i didn't try to change the video memory setting in the bios, i just added a 512Mo DIMM, so i reach 1Go RAM on my test computer.
Finally, i thinks it is not a big problem really, first because RAM dimm's are cheap this year, second because my production server has 2 Gigs, and last, i don't see serious file servers with less that 1Go. (And NAS-R3 is for serious file servers... no ? )
Maybe you should just specify in the server requirement that 768Mo is a minimum if the video card make use of shared memory.