Micro, if you want to keep multiple versions, then your options are limited. Its easily achieved by building from source but if you already have a package installed, you must manage the path issues.
You can and should start Lazarus with a command line switch that points to the appropriate config directory for that particular Lazarus install. Easily done by creating a lazarus.cfg file in the lazarus build/working directory.
--pcp=/home/dbannon/bin/Lazarus/LazConfigs/lazarus_3.2
or
--pcp=c:\Lazarus\LazConfigs\lazarus_3_2
Subtract 5 points if you use the user name "dbannon". You can copy the old config directory and use that as a starting point for the new install (but I wonder if going from 2.2.4 to 3.4 might be a big jump). To try you would copy the config to a suitable dir, the Lazarus code to another suitable dir and do -
$> make bigide
// create the lazarus.cfg file
$> make useride
$> ./lazarus
If you get error messages, you may need to restore the config manually, just blow away the config directory and -
$> make clean bigide
$> ./lazarus
In all cases, don't run "make install" start lazarus directly from its build/working directory, where your lazarus.cfg file its too.
Davo