That means the problem is in your wiring or breakout. Next connect the cable back to the port but disconnect from the breakout and check at the cable by grounding its pin to ground. If that lights up the LEDs then check your breakout with a voltmeter when you are operating the limits.
Hood