It's probably missing a flush somewhere. You could report this as a bug.
In the meantime, there is a property CloseLogFileBetweenWrites. But it's not on the baseclass, only on the class TLazLoggerFile used in the LazLogger unit.
So if you use the LazLoggerBase unit, to switch off logging, then that does not compile.