I think I solved the problem, apparently if you have both Keyboard and Controller enabled on the UICamera this issue happens, I just disabled one and it works fine, controller is waiting for animation but have the hold option, keyboard scrolls fast but no hold option.
Try clicking faster, keep mashing at the same pace, you will notice it skips.