Sounds like you may have anchoring set up in a way where you have certain widgets anchored to others, and have some update in OnEnable/Start while others in Update or something similar.
Keep in mind you can always simply set panel's alpha to 0. This will hide that panel exactly the same way as disabling it would, but it won't mess up your anchoring. Performance will be the same.