If I have access to a game's .fsb files, could their .ogg files be extracted and somehow rearranged?

I’ve been tinkering with a game’s .fsb files, to the point where I could successfully change several of the characters’ voices by switching two .fsb files with the same-named ogg files. These files are not playable, which leads me to assume that they are compressed using the same key.

Would it be possible to “mix-and-match” .ogg files from different .fsb files and “rebuild” an entirely new file?