If you are using linux, I would avoid using the richmemo component as it seems to have bugs and can (somehow) foul up your entire lazarus install.
I'm told that it works fine though on windows with no problems.
And it seems to me that it does handle underline as well as all the other richtext features.