Yeah, that's not a bug. It's just how the scroll bar works. Scroll bar represents the difference between the content of the scroll view and the scroll view's rectangle. UICenterOnChild lets you have padding on the sides, and the scroll view + scroll bar is not designed to take it into account. I may add support for it in some future version, but for the time being the current behaviour is intentional.
I suggest you use different means of navigation -- swiping around the actual scroll view for example -- and not by dragging the scroll bar. In fact, I would suggest you to use the scroll bar as a means of displaying the position only. Remove the collider from it so that it's not interactable.