Did you eventually try it?
Other than CGE LSP server, there is also
https://github.com/genericptr/pascal-language-server. Both share the same lineage, although their code bases have diverged considerably.
I've tested both in Vim 9 using
yegappan LSP client. In FPC context the tricky part is for the LSP server to figure out where all the relevant source files are. Relevant here means all the source files, including from 3rd party libraries, required to build the program in question. In Lazarus this info is in .lpi / .lpk files.
(For clangd, the LSP server for C and C++, and sourcekit-lsp, the same for Swift, they both work with a compile_commands.json file to determine where the 'root' of the source tree is.)
I've not used CGE LSP with VS Code for a CGE project. No reason to doubt this combo works well as advertised, so presumably there's a CGE-equivalent to .lpi / .lpk files that contain the necessary info.