RC Filter -> Resistor + Capacitor
This is what I did:

The red area is the RC filter and the rest is an inverter (N-Channel Mosfet) because @NeoTO said using it with the invert option and also forcing a cleaner on/off state.
I selected the values by choosing an R (500) significantly lower than the Pullup (10k). Based on that I choose a time constant of 10ms and calculated 20µF for C. I didn't measure with the scope, I just pulled the 10ms out of thin air, they might be one or two orders of magnitude to large.
But that doesn't matter because I am probing at 50mm/min, the 10ms will lead to 8µm offset, which stays constant and can be included into the calibration.