I have to say the widgets you created look very slick.
In regards to your question... what I would do is have only one extra panel, or at least one panel per touch. When touching something, reposition the panel to match the dimensions of whatever you're touching, and do your animation inside it. When you touch something else, move the panel and repeat the process.