• Open Menu Close Menu
  • Apple
  • Shopping Bag
  • Apple
  • Mac
  • iPad
  • iPhone
  • Watch
  • TV
  • Music
  • Support
  • Search apple.com
  • Shopping Bag

Lists

Open Menu Close Menu
  • Terms and Conditions
  • Lists hosted on this site
  • Email the Postmaster
  • Tips for posting to public mailing lists
Re: RemoteIO Question
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: RemoteIO Question

  • Subject: Re: RemoteIO Question
  • From: Pier <email@hidden>
  • Date: Wed, 07 Nov 2012 16:58:43 +0800
Following this I wondered if I could do a AudioUnitAddRenderNotify on the eventual mixed output 0 of remoteIO - I'm getting error -50 when rendering, i.e. the following code. It's strange because the code works for my recordingCallback for input 1. Any ideas? 

I'm finally starting to understand remoteIO - it is basically a input/output interface, the input 1 doesn't really "flow" to the output 0.

static OSStatus mixedRecordingCallback(void *inRefCon,

                                         AudioUnitRenderActionFlags *ioActionFlags,

                                         const AudioTimeStamp *inTimeStamp,

                                         UInt32 inBusNumber,

                                         UInt32 inNumberFrames,

                                         AudioBufferList *ioData)

{

    RIO *rio = (RIO*)inRefCon;

    AudioUnit rioUnit = rio->theAudioUnit;

    //ExtAudioFileRef eaf = rio->outEAF;

    AudioBufferList abl = rio->audioBufferList;

    

    SInt32 samples[NUMBER_OF_SAMPLES]; // A large enough size to not have to worry about buffer overrun

    abl.mNumberBuffers = 1;

    abl.mBuffers[0].mData = &samples;

    abl.mBuffers[0].mNumberChannels = 1;

    abl.mBuffers[0].mDataByteSize = inNumberFrames  * sizeof(SInt16);

    

    OSStatus result;

    result = AudioUnitRender(rioUnit,

                             ioActionFlags,

                             inTimeStamp,

                             0,

                             inNumberFrames,

                             &abl); // <-- ERROR : -50



On Wed, Nov 7, 2012 at 4:46 PM, Pier <email@hidden> wrote:
Hi Hari, 

I couldn't get pre-render to work for me, managed to get my desired effect (monitoring and playback of a pre-saved buffer into bus 0 and 1 of mixer input) by doing the following code and getting the recordingCallback to write to my monitoring buffer, which the monitoringCallback of the mixer input gets data from. 

However, now I would like to record this "mixed" signal (of both monitoring and pre-saved buffer) and find that I have already "used" up my remoteIO input bus and output bus for recording mic and playback to speakers respectively. 

Again, I'm stuck...  :/ Could the only choice be to mix manually?
If I go back to trying to get AudioUnitAddRenderNotify to work does it free up the inputBus on remoteIO for me to record ? 

    AURenderCallbackStruct callbackStruct;

    callbackStruct.inputProc = recordingCallback;

    callbackStruct.inputProcRefCon = &rio;

    status = AudioUnitSetProperty(_remoteIOUnit, 

                                  kAudioOutputUnitProperty_SetInputCallback, 

                                  kAudioUnitScope_Global, 

                                  kInputBus, 

                                  &callbackStruct, 

                                  sizeof(callbackStruct));

    if (noErr != status) { NSLog(@"Set input callback error"); return; }


Pier. 



On Wed, Nov 7, 2012 at 10:51 AM, Pier <email@hidden> wrote:
Hi Hari, 

Following your advice I did this. 

    // Enable IO for recording

    UInt32 flag = 1;

    status = AudioUnitSetProperty(_remoteIOUnit,

                                  kAudioOutputUnitProperty_EnableIO, 

                                  kAudioUnitScope_Input, 

                                  1,

                                  &flag, 

                                  sizeof(flag));

    // Enable IO for playback

    status = AudioUnitSetProperty(_remoteIOUnit, 

                                  kAudioOutputUnitProperty_EnableIO, 

                                  kAudioUnitScope_Output, 

                                  0,

                                  &flag, 

                                  sizeof(flag));


    AURenderCallbackStruct callbackStruct;

    callbackStruct.inputProc = recordingCallback;

    callbackStruct.inputProcRefCon = &rio;

    status = AudioUnitAddRenderNotify(_remoteIOUnit, callbackStruct.inputProc,  callbackStruct.inputProcRefCon);



When I debug recordingCallback during runtime

    // Only do pre render on bus 1

    if (*ioActionFlags & kAudioUnitRenderAction_PostRender || inBusNumber != 1) {

        return noErr;

    }


It never gets past this line as inBusNumber is always 0. It doesn't seem to be called twice for each bus as you mentioned - am I doing something wrong? 

Thanks. 

Pier. 

 

Instead you need the third type which I call a Processor.  It’s still an RCB (attached this time via AudioUnitAddRenderNotify())  and many people use them in lieu of an input bus RCB to *generate* audio – that’s fine.  Their code needs to be slightly different because, unlike input and output bus RCBs the audio unit calls it *twice* for *each bus* on every round – once with the kAudioUnitRenderAction_PreRender flag set and one with the ...PostRender flag.  Your RCB code needs to begin with a conditional to prevent it from running when it shouldn’t.  For example:

 

// Only do pre render on bus 1

if (*ioActionFlags & kAudioUnitRenderAction_PostRender || inBusNumber != 1) {

    return noErr;

}

 

So for your scenario, you want one of these “Processor” Render Callbacks on your RemoteIO.  You then store the data in ioData into an external ring buffer (like Mike Tyson’s rightfully famous TPCircularBuffer) pointed to by your inRefCon.  You can then pull from this ring buffer in your “Generator” render callback attached to your mixer input.

 

Again though, I’ve not done much work with the mic.  In an effort to deal with the single RemoteIO limitation but still use the AUMultichannelMixer, this setup is a bit circular (will the Mixer’s input RCB be called *after* the RemoteIO’s Pre_Render phase even though the Mixer occurs first in the graph? anyone?), so if it doesn’t work as expected, I’m sorry!  Hopefully someone else with experience rocking the mic will chime in...

 

Accelerate is a set of functions for leveraging the ARM processors ultra-fast floating point vector operations, “vector” being synonymous with “buffer”.  The vDSP functions are the ones to look at: https://developer.apple.com/library/mac/#documentation/Accelerate/Reference/vDSPRef/Reference/reference.html

 

For example to add (mix) two (Float32) buffers:

 

vDSP_vadd(source1Ptr,  1, source2Ptr, 1, destBufferPtr, 1, sizeInFrames);

 

The “1”’s are “stride” = the difference in array indices between two related samples.  If your buffers were interlaced you’d use 2.

 

Hope that gets you started...

 

Gratefully,

Hari Karam Singh

 

══════════════════════════════════════

"Finally, an app that breaks you out of the 2 inch screen!"

 

Sound Wand ~ A real musical instrument that fits in your pocket!

 

http://soundwandapp.com | Tw | Fb | Yt | Sc

 

══════════════════════════════════════

Club 15CC
An Inspirational Media and Technology Studio

London, UK
+44 (0) 207 394 8587
+44 (0) 779 055 6418

http://club15cc.com/

 

Part of Amritvela

 

From: Pier [mailto:email@hidden]
Sent: 06 November 2012 10:41
To: email@hidden
Cc: email@hidden
Subject: Re: RemoteIO Question

 

Hi Hari, 

 

Thanks for confirming my suspicions. I was just reading your blog this morning regarding mixing - not sure I understand it all though! 

I'm not sure what this means : 2. Render Notify attached to RemoteIO which processes the prerender phase on bus 1 (i.e., if (bus != 1 || !(ioFlags & k...PreRender)) return noErr; ) and which stores the mic data in a ring buffer

Could you explain a bit more? :D

 

I was tempted to go the manual mixing route when I read about the Multichannel Mixer AudioUnit. This is the first time I've heard of the Accelerate framework - what advantages does it offer with regards to this? 

 

Thanks much. 

 

Pier. 

 

On Tue, Nov 6, 2012 at 6:23 PM, Hari Karam Singh <email@hidden> wrote:

Hi Pier,

 

I’ve just been through something similar.  I believe that answer is yes, you may only have one RemoteIO unit.  Also you definitely need a RemoteIO as the last unit to send the audio to the hardware.   Reference: http://lists.apple.com/archives/coreaudio-api/2009/Apr/msg00042.html

 

I’ve not much experience with using the mic, but I would think you could accomplish what you need with the following setup:

 

1. Mixer output bus 0 -> Remote IO Input bus 0

2. Render Notify attached to RemoteIO which processes the prerender phase on bus 1 (i.e., if (bus != 1 || !(ioFlags & k...PreRender)) return noErr; ) and which stores the mic data in a ring buffer

3. Attach a custom render callback to Mixer input bus 0 which reads from the ring buffer

4. Attach your other source to mixer input bus 1

 

You could also skip the mixer unit entirely and do the mixing manually inside of the RemoteIO’s render notify callback using the lightning fast vDSP functions in the Accelerate framework.

 

Gratefully,

Hari Karam Singh

 

http://soundwandapp.com/

http://club15cc.com/

 

From: coreaudio-api-bounces+harikaram=email@hidden [mailto:coreaudio-api-bounces+harikaram=email@hidden] On Behalf Of Pier
Sent: 06 November 2012 08:22
To: email@hidden
Subject: RemoteIO Question

 

Hi, 

 

I'm trying to do this 

 

 

**RemoteIO1 (for recording to buffer) -> Mixer -> RemoteIO2 (for playback of output)** 

 

RemoteIO1 is used for 2 purposes

1) To feed audio into the mixer channel 0

2) To record audio from mic to a buffer 

 

The Mixer 

1) Takes audio from RemoteIO - input 0

2) Mixes the audio from (1) with audio from the buffer - input1

 

RemoteIO2

1) Takes the mixed audio and sends it to playback 

 

Initially I thought that I could just playback from mixer output but the following gives me an error. Can I confirm that I need another RemoteIO to do playback? 

 

    // Enable Mixer for playback

    status = AudioUnitSetProperty(_mixerUnit,

                                  kAudioOutputUnitProperty_EnableIO,

                                  kAudioUnitScope_Output,

                                  mixerOutputBus,

                                  &flag,

                                  sizeof(flag));

    

    if (noErr != status) { NSLog(@"Enable Mixer for playback error"); return; }

 

Also, I did the following test and realised there seems to be only one RemoteIO available (addresses for inputComponent and inputComponent2 are the same) 

    

    // Get component

    AudioComponent inputComponent = AudioComponentFindNext(NULL, &desc);

    AudioComponent inputComponent2 = AudioComponentFindNext(NULL, &desc);

 

Is it true that I can only have one instance of RemoteIO in my app? If so, what are the alternatives for the 2nd RemoteIO? 

 

Thanks. 

 

Pier. 

 




 _______________________________________________
Do not post admin requests to the list. They will be ignored.
Coreaudio-api mailing list      (email@hidden)
Help/Unsubscribe/Update your Subscription:

This email sent to email@hidden
References: 
 >RemoteIO Question (From: Pier <email@hidden>)
 >RE: RemoteIO Question (From: Hari Karam Singh <email@hidden>)
 >Re: RemoteIO Question (From: Pier <email@hidden>)
 >RE: RemoteIO Question (From: Hari Karam Singh <email@hidden>)
 >Re: RemoteIO Question (From: Pier <email@hidden>)
 >Re: RemoteIO Question (From: Pier <email@hidden>)

  • Prev by Date: Re: RemoteIO Question
  • Next by Date: RE: RemoteIO Question
  • Previous by thread: Re: RemoteIO Question
  • Next by thread: RE: RemoteIO Question
  • Index(es):
    • Date
    • Thread