OpenAL works on RPi Zero. And comes with an example for wave play.
It is in the standard distribution.
Bass is a bit too heavy and has horrible delay, but easy to use.
Mp3 can be done with ffmpeg, but possibly OpenAL too.
Otherwise I have a native MP3 unit, but that is old (written in 2002) and may not work without adapting some code. (that's a unit that actually plays mp3's, not just returns header info. Haven't touch the code since I released it, not entirely mine)