Answer by MetalStorm80

Using an else statement it would work the first time but then have the original issue the second time. The way I solved it was to make a bool that you set to try when it was changed and then change it back to false in LateUpdate(). That way it could not run both scenarios in one frame. I am sure there is a way better method to do this but it works now so for now it is good. Thanks for the response.