I don't see anything out of the ordinary. Maybe the switch is binding a little and not able to return in the one direction? How does it feel each way when you move in by hand?
When I cancel the switch manually, it is stiff like expected. Also, when I turn the wheel in a turn I do not hear the distinct "click" "click" like the cancel cam is being engaged. This just does not seem like rocket science, yet it eludes me!