This is called the "overview gutter", and it's not exactly a scrollbar. It displays a variety of useful markers - current scrolling, bookmark positions, breakpoints, compiler errors, and more.
To disable it, see the "IDE Options > Editor > Display > Show overview gutter" option.
By the way, colors are configured in the category "IDE Options > Editor > Display > Colors".