This obviously is a widget issue.
The autosize for label sounds like it is dominating the whole panel so all clicks maybe going to the label
One can detect that if one was to implement the OnClick for the label with a Beep etc.
The label is a Graphic Type control so maybe another Graphic type control should be tested like a TShape, one that can receive mouse clicks.