Have you tried the other one?
Although I never tried Allegro, but it sounds nice. Here what they said about it:
"... create 3D graphics, define a GUI and almost anything you need to create your own games. And you can do it in good old Pascal or the modern Object Pascal. Also, if you do it the right way, your program will run in Windows and Linux with few or not changes! It may work even in MacOS systems ..."
Also, you should give Castle Game Engine a try. I ever asked question about its usage, and the author is very supportive. And the great is you can export your game to run on Android and IOS devices. Lazarus motto is "Write Once Compile Anywhere", so don't limit yourself to write games only for desktop computers.