Respond only to events of the control you're interested in. For example, if you need to grab mouse moves from a memo, add a handler for the OnMouseMove of the memo. In that case, once the focus has moved to the menu and while there, events for the memo shouldn't trigger.
Also you could (in theory) check in your idle timer which control has the focus and act as needed: exit if it's the TMainMenu, etc.