Ah, old MP3 players of course can be quite picky regarding metadata as well, not just supported file formats.
I ended up having to do two things for the files in the final mix, strip ogg metadata and rewrite it only with the most basic info like artist, title, etc, and then for mp3 files, I had to get rid of ID3v2.4 info and replace it with ID3v2.3. With these fixes my old iaudio player can display the info correctly and play the files without choking.
Script updated, with some extra info on how I did it
#mp3 #ogg #ffmpeg #id3v2 #shell #script