Yes, technically you can insert an image in an mp3 file, but it deviates from the standard.
(I wrote the mp3 decoder for delphi back in the days and 100% pascal. It contains a bug, though, the resolution is one bit short, but it works, and nobody complained.. at the time I did not pay attention to signed or unsigned.)