They ARE centered. The caption is bottom-aligned (that's how it should be), and the icons are centered vertically in the remaining space above the captions - compare the "neu" with "öffnen".
BTW, there is also the option TToolbar.List which put the captions to the right of the icons.