Sounds like you need an EMI filter on the incoming power to the VFD, although if the mouse is your only issue, I'd try a different mouse first. A mouse is cheaper. It might just be that you have a poorly shielded mouse!
You can get EMI filters on ebay
Cheers
Dave