# Sound callbacks in iOS background mode **URL:** \ **Category:** FMOD Engine\ **Tags:** ios\ **Created:** [May 25, 2023, 10:37pm UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256 "2023-05-25T22:37:26Z")\ **Posts on this page:** 10\ **Page:** 1
**Author:** ![andy55](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/andy55/32/5016_2.png) [@andy55](https://qa.fmod.com/u/andy55)\ **Post date:** [May 25, 2023, 10:37pm UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/1 "2023-05-25T22:37:26Z")
Hi warriors, iOS background audio going nicely here under Unity, but I need a trigger to start the next audio track when the current track completes. Normally, there is [setCallback()](https://www.fmod.com/docs/2.02/api/core-api-channelcontrol.html#channelcontrol_setcallback) + [FMOD\_CHANNELCONTROL\_CALLBACK\_END](https://www.fmod.com/docs/2.02/api/core-api-channelcontrol.html#fmod_channelcontrol_callback_type), but apparently under iOS background mode, that callback doesn’t get fired until the app returns to the foreground. What options are there to detect the end of a sound (stream) under these conditions? Thanks! ---
**Author:** ![Leah\_FMOD](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/leah_fmod/32/3685_2.png) [@Leah\_FMOD](https://qa.fmod.com/u/Leah_FMOD)\ **Post date:** [May 31, 2023, 12:22am UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/2 "2023-05-31T00:22:54Z")
Hi, As per our docs on [Lock Screen & Background Audio](https://www.fmod.com/docs/2.02/api/platforms-ios.html#lock-screen-background-audio) on iOS, if you choose an AudioSession category that supports background audio, and enable background audio in your info property list, FMOD should work with iOS background mode as it normally does - have you done both of these things? Also, I recall from one of your previous posts that you were only using the Core API, so just to clarify, are you using the FMOD for Unity integration, or your own C# wrapper? ---
**Author:** ![andy55](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/andy55/32/5016_2.png) [@andy55](https://qa.fmod.com/u/andy55)\ **Post date:** [May 31, 2023, 1:17pm UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/3 "2023-05-31T13:17:44Z")
Hello! Indeed, iOS setup seems to be in order – background audio is otherwise working. 1. On start of a track, we hand a new http stream to FMOD in Unity via: 2. Each frame `getOpenState()` is called. On the first `OPENSTATE.READY` for a track, `system.playSound()` is called and `channel.setCallback()` is bound. 3. When the channel callback sees `CHANNELCONTROL_CALLBACK_TYPE.END` it prints to log and do an iOS callback that queues `UnityBatchPlayerLoop()` to trigger a Unity `Update()` pass. 4. When _not_ in background mode, things work as expected (once Update() sees a `OPENSTATE.READY` during playback, it initiates starting a new track). Perhaps the callback is only pushed from inside something like `system.update()` so therefore is not made until the Unity update loop resumes? ---
**Author:** ![Leah\_FMOD](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/leah_fmod/32/3685_2.png) [@Leah\_FMOD](https://qa.fmod.com/u/Leah_FMOD)\ **Post date:** [June 6, 2023, 5:45am UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/4 "2023-06-06T05:45:07Z")
Thanks for the detailed repro! I’ve done some testing on my end, and I’m able to reproduce what you describe - i.e. `CHANNELCONTROL_CALLBACK` not firing when in background mode - when the `AVAudioSession` is configured incorrectly. If background audio capability is enabled in XCode (info.plist or target platform capabilities), and I set the app’s AudioSession to use the `option: AVAudioSessionCategoryOptionMixWithOthers`, then `CHANNELCONTROL_CALLBACK_TYPE.END` is fired as expected even when backgrounded. Please give that a shot and see whether it resolves your issue. ---
**Author:** ![andy55](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/andy55/32/5016_2.png) [@andy55](https://qa.fmod.com/u/andy55)\ **Post date:** [June 7, 2023, 11:09pm UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/5 "2023-06-07T23:09:09Z")
Hi, this is great news. Will get back as soon as I can confirm, thank you Leah!! ---
**Author:** ![andy55](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/andy55/32/5016_2.png) [@andy55](https://qa.fmod.com/u/andy55)\ **Post date:** [June 9, 2023, 1:57pm UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/6 "2023-06-09T13:57:31Z")
Hi Leah, Strangely, adding `...MixWithOthers` (with category `AVAudioSessionCategoryPlayback`) the background event still not not fire here. Unfortunately, even if it did, `...MixWithOthers` removes the lock screen play control center (play/pause, prev/next, etc) which would be an issue since we are building a music player. I have confirmed `UIBackgroundModes` contains `audio` (and also added `fetch` just in case that matters). If I am not mistaken, the app wouldn’t even be playing in the background if this was not set correctly. This has been quite frustrating and time consuming your assistance is much appreciated! Any other thoughts? Hmm, what else could have caused the change you saw over there? Drew ---
**Author:** ![Leah\_FMOD](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/leah_fmod/32/3685_2.png) [@Leah\_FMOD](https://qa.fmod.com/u/Leah_FMOD)\ **Post date:** [June 16, 2023, 5:02am UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/7 "2023-06-16T05:02:35Z")
Sorry for the delayed response! In my previous testing, I did notice that while the `CHANNELCONTROL_CALLBACK_TYPE.END` callback fires, audio that would normally loop while the application is focused doesn’t resume while in background mode, which is likely due to how FMOD is tied to Unity’s update loop with our integration. I should be able to give it a further test with the extra information you’ve provided sometime next week, but in the meantime, by the “background event” not firing do you mean that the `CHANNELCONTROL_CALLBACK_TYPE.END` callback isn’t fired? Or that the callback fires, but the dependent behaviour (i.e. `UnityBatchPlayerLoop()`) doesn’t occur? ---
**Author:** ![andy55](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/andy55/32/5016_2.png) [@andy55](https://qa.fmod.com/u/andy55)\ **Post date:** [June 16, 2023, 5:47am UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/8 "2023-06-16T05:47:24Z")
Great question Leah and feeling good you’re looking at this. Let’s say I use the above steps to consume a http streamed mp3 or aac that is exactly 10 minutes long. Typically a mobile device is playing in background audio mode, where basically iOS is like a cop itching to shut you down if you are idle or or consume too much. At the 9:59.9 point, the stream is consumed and `getOpenState()` would normally return `OPENSTATE.READY` _if_ the Unity Update() loop was active. But we install the `CHANNELCONTROL_CALLBACK_TYPE.END` callback, and that is used to kick the Unity machinery into action for ~2 secs. But the callback doesn’t appear until the app is moved back into the foreground app (which could be any number of seconds or minutes later). This `StayAwake` code is already working well for the managing the buttons on the iOS lock screen (so the events they push are carried out). So the callback doesn’t seem to be making it out of FMOD since the Unity log message below doesn’t show up until the app is activated: ```auto [AOT.MonoPInvokeCallback(typeof(FMOD.CHANNELCONTROL_CALLBACK))] public static RESULT ChannelCallback(IntPtr channelcontrol, CHANNELCONTROL_TYPE controltype, CHANNELCONTROL_CALLBACK_TYPE callbacktype, IntPtr commanddata1, IntPtr commanddata2) { if (callbacktype == CHANNELCONTROL_CALLBACK_TYPE.END) { Logger.Debug($"ChannelCallback: {controltype}, {callbacktype}"); NowPlaying.StayAwake(); } return RESULT.OK; } ``` iOS: ```auto #define STAY_AWAKE_INTERVAL 2.0 double gAwakeUntil = 0; extern "C" void iOS_StayAwake() { bool asleep = gAwakeUntil <= 0; gAwakeUntil = CACurrentMediaTime() + STAY_AWAKE_INTERVAL; // bump the wakeup time forward if (asleep) { [NSTimer scheduledTimerWithTimeInterval:.01 repeats:YES block:^(NSTimer * _Nonnull timer) { UnityBatchPlayerLoop(); if (gAwakeUntil < CACurrentMediaTime()) { gAwakeUntil = 0; NSLog(@"\nENTER SLEEP\n"); [timer invalidate]; } }]; } } // Unrelated but shows StayAwake() used to carry out events pushed to Unity MPRemoteCommandHandlerStatus dispatchUnityMessage(const char* method, const char* msg) { UnitySendMessage("NowPlayingEvents", method, msg); iOS_StayAwake(); return MPRemoteCommandHandlerStatusSuccess; } ``` ---
**Author:** ![Leah\_FMOD](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/leah_fmod/32/3685_2.png) [@Leah\_FMOD](https://qa.fmod.com/u/Leah_FMOD)\ **Post date:** [June 20, 2023, 6:12am UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/9 "2023-06-20T06:12:04Z")
So: The only way I’m able to replicate your issue with the channel end callback never firing is if I never set up the AudioSession incorrectly/don’t set it up at all. When I set up the AudioSession correctly, it works as expected, but using your code in the channel callback results in calling `UnityBatchPlayerUpdate()` from the FMOD thread, not the main thread, causing a crash. As a result, you will likely need to move your `UnityBatchPlayerLoop()` call to the main thread to achieve the desired behavior. Below is an Objective C plugin that sets up the audio session, and creates the timer used to call `UnityBatchPlayerLoop()` from the main thread, when and only when the application has been suspended. I’m not sure if it will exactly fit what you’re looking for, especially since the timer is a no-op when the application is in focus, but it should serve as an example of what to do: ```auto #import #import bool shouldExecute = false; extern "C" void SetUpAudioSession() { AVAudioSession* audioSession = [AVAudioSession sharedInstance]; [audioSession setCategory: AVAudioSessionCategoryPlayback mode: AVAudioSessionModeDefault options: AVAudioSessionCategoryOptionDuckOthers error: nil]; [audioSession setActive: YES error: nil]; } extern "C" void SetUpTimer(){ NSLog(@"\nTIMER STARTED\n"); [NSTimer scheduledTimerWithTimeInterval:.01 repeats:YES block:^(NSTimer * _Nonnull timer) { if (shouldExecute){ UnityBatchPlayerLoop(); } }]; } extern "C" void iOS_Suspended() { NSLog(@"\nSUSPENDED\n"); shouldExecute = true; } extern "C" void iOS_Resumed() { NSLog(@"\nRESUMED\n"); shouldExecute = false; } ``` I call `SetUpAudioSession()` and `SetUpTimer()` in `MonoBehavior.Awake()`, which will allow FMOD to remain active in the background, and set up the timer used to update Unity while backgrounded. `iOS_Suspended()` and `iOS_Resumed()` are called from `MonoBehavior.OnApplicationFocus(focus)` on `focus = false` and `focus = true` respectively, to make the timer only update Unity when suspended. I hope that this helps point you in the right direction. ---
**Author:** ![andy55](https://yyz2.discourse-cdn.com/flex036/user_avatar/qa.fmod.com/andy55/32/5016_2.png) [@andy55](https://qa.fmod.com/u/andy55)\ **Post date:** [June 20, 2023, 1:21pm UTC](https://qa.fmod.com/t/sound-callbacks-in-ios-background-mode/20256/10 "2023-06-20T13:21:36Z")
Thank you so much for your support in this Leah. It means a lot here and you’ve won us over in our relationship with FMOD moving forward. Will report back as we figure this out. Thanks!