In your case, Id call an S100000 as previously posted, then measure the result. Lets say you get a real rpm of 3000 , so then select configure pulleys, and set the pulley max to 3000.
Now select S3000M3, and the spindle will then do 3000RPM, then select S1500 , what RPM do you get? Should be close to 1500 if your vfd is linear. Slowly decrease will the voltage is too low to run it, then set that S speed as the pulley minimum, then check linearity and see what happens.. Is it better?
Art