DSP Plugin DataDrop Decoding

FMOD Engine
,
1

I’m struggling again with my rnbo wrapper and would like to add the capability to populate buffers through the fmod studio authoring.
After looking through the documentation, the best way to do that is through dspsetparamdata with the FMOD_DSP_PARAMETER_DATA_TYPE_USER flag, I think.

I have however two questions:

  1. RNBO expects raw pcm values. When using the default datadrop interface it sends the whole file to the plugin, of course. Is there a clever way to decode the data received in the callback through the fmod api? (Like it’s probably done for the convolution plugin.) If not I’d have to decode this myself using a lightweight, third-party library like miniaudio. My question here is basically how this is solved in the stock convolution plugin.
  2. Is it possible to retrieve the filename as this is not passed to the plugin? (Also in the convolution plugin the filename gets displayed) else I’d have to do a workaround to assign the buffers with a default name.

Thanks a lot in advance!

2

Solved it for now with dr_wav and dr_mp3, which works really well (:

The second question isn’t relevant anymore - i found a direct way internally, that works also great.

3

Also somehow related to this. When building the banks, the audio files are included raw, which is great and makes the current solution work luckily.
However, it would also be great if the assets could be compressed the same way as when they’re included normally or again how it’s done with the convolution plugin, where the file-size is somehow reduced by half compared to raw WAV. It’s probably not possible as there is some proprietary code involved, or it can also very well be that I’m missing something.
I appreciate any answer :).

4

Our convolution reverb culls anything too quiet to make an audible difference during the convolution operation, which is what the dark grey section of the Impulse Response Graphic represents.
That is a pretty targeted optimization for impulse responses, and I’m not sure we could apply it more generally to other DataDrop scenarios.
Perhaps if we were to identify the dropped data as an audio file we could encode it with the rest of the audio assets instead of passing back raw bytes?

5

Ah, that makes sense, thanks for the clarification.

But yes, that would be phenomenal. But that would probably involve quite some changes so that the channel count and sample-rate would also be reported in the callback.
One can dream (:

Thanks again!