" See \ debug windows \ assembler "
"see" => "View"
And that makes it a Lazarus topic.
For background info, there is a "FP IDE", that works in a dos box, much like old turbo pascal.
---------------------
On the topic:
The asm window, has a green arrow (in front of the input field, on the top toolbar of that window).
This arrow gets you to the current (E/R)IP
Hover with the mouse, to see the description of the button in a hint.
As for going to the caller, you need to use the stack window (from the same menu). Each entry in the stack has a context menu with an entry "view assembler"
If for some reason the stack window is not showing you any caller info, then the stack is unreadable and the info not available. That means that none of the windows could in any way offer you a way to get to the caller.
But if the stack window works normal, then you can get to the asm entry from there.