Based on my understanding of your description, no -- I can't say that I do. I gave it a test on my end -- created a toggle as a child of a widget. Put a script on the widget that reacts to OnClick (and gave it a collider). In OnClick I set the SetActive state to the opposite of what it is now, targeting the child game object (the toggle). All works as expected.