Mind, you also get all other normal edit stuff that Windows provides.
Like the emoji IME => Left-Windows key and "." (dot). Windows adds that to almost everything that can get input. I don't know any simple way to prevent that (I would guess, that within the IME API there will be ways, but not easy).
If you install (Windows features) support for Arabic, or other Right-to-Left languages, then that will also reflect on TEdit/TMemo (e.g. there are keycombos to toggle them between RTL and LTR). That applies to all edits in any app on Window (except custom ones like SynEdit).
But then, if someone has support for such a language installed, they would want that.
If you install support (Windows features) for Chinese or Japanese, you get the IME for those languages, so you can enter text according to those languages.
And if an IME is active that alters the sequence of KeyDown/KeyPress/KeyUp that your edit receives.... (even for custom controls like SynEdit)