I tried installing over 3.8 but
Some general advice / This may or may not be related to your issues.With major version updates it may be better (but not always necessary) to uninstall the old. Sometimes units got moved to a different folder, and when installing over the existing older version, then that unit suddenly exists twice.
Though if you don't get errors about "duplicate ...." then it may be ok.
In general, when installing over, your first rebuild should be "clean all" => see the checkbox in menu "Tools" > "Configure build Lazarus".
when I try to rebuild the IDE I get errors counserning some components like Rx and others.
"RX" is a 3rd party component. It is likely (I don't know) that it needs to be updated for the new release of Lazarus. I haven't checked, there may already be an update available.
I guess you installed it via OPM. In that case you might have to go to OPM again, and trigger an update yourself.
3rd party updates are not automatically updated when you install a new Lazarus version.
You may also want to mention your OS. Sometimes that makes a difference, and someone with the same OS might know, but doesn't answer because they don't know you have the same OS...
If you are on Windows, you can use the "second install" checkbox of the installer to make a totally new and independent install. That means you can test everything, without any danger to your existing install.
After checking the "2nd install" you will be ask for a config path, which should be a new empty folder.
Once installed, you will have to install all the packages, since the 2nd install will not know the config of the first install.
If you want to test projects in the 2nd install, either backup first, or in your first install use "Export project".