Hello,
The problem is, what kind of noise is coursing this problem.
If it is a spike or puls from a quit high frequency what is coursing is problem, you can try to solder a 5nF capacitor paralel on the switch or even better as near as possible on the computer or breakoutboard.
But it even couldt be a bad connection.
Wotje