When you shrink a large font down to a smaller size in a label, the visual look of it will be inferior to that of a font that's using the pixel-appropriate size. How noticeable this is depends on the font itself. I'd say try it -- if it looks good enough, stick to it.
