You have to duplicate it like this
UIPanel1 (with clip)
-Grid1
-- Sprites1
UITexture (z value lower than UIpanel 1)
UIPanel2 (same clip)
-Grid2
-- Sprites2
Have your input only affect UIPanel 1 and make UIPanel 1 copy its settings (position, clip rect etc) to UIpanel 2 when it is updated.