Yes, you were right. I tried dropping it on an empty gameobject and had similar results. Somehow when I created the anchor the scale was not set to 1, 1, 1 (it was at 360,360). So when I dropped my stuff in, all the scales adjusted and it screwed everything up.
Thanks and sorry for the dumb question.