Search code examples
ioscore-audioaugraph

How to add kAudioUnitSubType_LowPassFilter in a AUGraph?


I am trying to add kAudioUnitSubType_LowPassFilter to an AUGraph but do not succeed in that.

I implemented the following code:

// create a new AUGraph
[Utilities checkError:NewAUGraph(&self.info->mGraph)
            operation: "Couldn't create a new AUGraph"];

AUNode rioNode;
AUNode lpfNode;

// Create filter audio unit
AudioComponentDescription lpfAU_description;
lpfAU_description.componentType = kAudioUnitType_Effect;
lpfAU_description.componentSubType = kAudioUnitSubType_LowPassFilter;
lpfAU_description.componentFlags = 0;
lpfAU_description.componentFlagsMask = 0;
lpfAU_description.componentManufacturer = kAudioUnitManufacturer_Apple;


// Create RemoteIO audio unit
AudioComponentDescription rioAU_description;
rioAU_description.componentType = kAudioUnitType_Output;
rioAU_description.componentSubType = kAudioUnitSubType_RemoteIO;
rioAU_description.componentManufacturer = kAudioUnitManufacturer_Apple;
rioAU_description.componentFlags = 0;
rioAU_description.componentFlagsMask = 0;

[Utilities checkError:AUGraphAddNode(self.info->mGraph, &rioAU_description, &rioNode)
            operation: "Couldn't add Graph Node"];
[Utilities checkError:AUGraphAddNode(self.info->mGraph, &lpfAU_description, &lpfNode )
            operation: "Couldn't add Graph Node"];

// Open graph
[Utilities checkError:AUGraphOpen(self.info->mGraph)
            operation: "Couldn't open graph"];

// Get audio units
[Utilities checkError:AUGraphNodeInfo(self.info->mGraph, lpfNode, NULL, &self.info->lpfUnit)
            operation: "Couldn't link node to audio unit"];

[Utilities checkError:AUGraphNodeInfo(self.info->mGraph, rioNode, NULL, &self.info->rioUnit)
            operation: "Couldn't link node to audio unit"];

// Make connections
[Utilities checkError:AUGraphConnectNodeInput(self.info->mGraph, rioNode, 1, lpfNode, 1)
            operation: "Couldn't connect remoteIO output scope bus 1 to filter input scope bus 1"];// input -> filter

[Utilities checkError: AUGraphConnectNodeInput(self.info->mGraph, lpfNode, 0, rioNode, 0)
            operation: "Couldn't connect filter output scope bus 0 to remoteIO input scope bus 0"]; // filter -> output

// Enable IO for input and output (recording and playing)
AudioUnitElement kRemoteIOInputScopeMic = 1;
AudioUnitElement kRemoteIOOutputScopeSpeaker = 0;

UInt32 enableInput = 1;
[Utilities checkError:AudioUnitSetProperty (self.info->rioUnit,
                                            kAudioOutputUnitProperty_EnableIO,
                                            kAudioUnitScope_Input,
                                            kRemoteIOInputScopeMic,
                                            &enableInput,
                                            sizeof(enableInput))
            operation: "Couldn't enable RIO input"];

// set up the rio unit for playback
UInt32 enableOutput = 1;
[Utilities checkError:AudioUnitSetProperty (self.info->rioUnit,
                                            kAudioOutputUnitProperty_EnableIO,
                                            kAudioUnitScope_Output,
                                            kRemoteIOOutputScopeSpeaker,
                                            &enableOutput,
                                            sizeof(enableOutput))
            operation: "Couldn't enable RIO output"];

// Set property to low-pass filter
AudioUnitSetParameter(self.info->lpfUnit,
                      kLowPassParam_CutoffFrequency,
                      kAudioUnitScope_Global,
                      0,
                      1000,
                      0);



// Set callbacks
// Callback for input
AURenderCallbackStruct callbackStruct;
callbackStruct.inputProc = recordingCallback;
callbackStruct.inputProcRefCon = (__bridge void*) self;


[Utilities checkError: AudioUnitSetProperty(self.info->rioUnit,
                                            kAudioOutputUnitProperty_SetInputCallback,
                                            kAudioUnitScope_Global,
                                            1, // Input bus
                                            &callbackStruct,
                                            sizeof(AURenderCallbackStruct))
            operation: "AudioUnitSetProperty set RenderCalback"];

// Callback to render data
callbackStruct.inputProc = renderCallback;
callbackStruct.inputProcRefCon = (__bridge void*) self;


[Utilities checkError: AudioUnitSetProperty(self.info->rioUnit,
                                            kAudioUnitProperty_SetRenderCallback,
                                            kAudioUnitScope_Input, //kAudioUnitScope_Global, ????
                                            0, // Output bus
                                            &callbackStruct,
                                            sizeof(AURenderCallbackStruct))
            operation: "AudioUnitSetProperty set RenderCalback"];

[Utilities checkError: AUGraphInitialize(self.info->mGraph)
            operation: "Couldn't initialize graph"];


// Input ASBD
AudioStreamBasicDescription inputasbd;
UInt32 propSize = sizeof(inputasbd);
[Utilities checkError:AudioUnitGetProperty(self.info->rioUnit,
                                           kAudioUnitProperty_StreamFormat,
                                           kAudioUnitScope_Input,
                                           1,
                                           &inputasbd,
                                           &propSize)
            operation:"Failed to get stream format of microphone input scope"];

// Output ASBD
AudioStreamBasicDescription outputasbd;
UInt32 typeByteSize   = sizeof(float);
outputasbd.mBitsPerChannel   = 8 * typeByteSize;
outputasbd.mChannelsPerFrame = 1;
outputasbd.mBytesPerFrame    = typeByteSize * outputasbd.mChannelsPerFrame;
outputasbd.mFormatFlags      = kAudioFormatFlagIsFloat | kAudioFormatFlagIsNonInterleaved;
outputasbd.mFormatID         = kAudioFormatLinearPCM;
outputasbd.mFramesPerPacket  = 1;
outputasbd.mBytesPerPacket   = outputasbd.mFramesPerPacket * outputasbd.mBytesPerFrame;
outputasbd.mSampleRate       = inputasbd.mSampleRate;

// Set stream format to output scope of input bus
[Utilities checkError:AudioUnitSetProperty (self.info->rioUnit,
                                            kAudioUnitProperty_StreamFormat,
                                            kAudioUnitScope_Output,
                                            1,
                                            &inputasbd,
                                            sizeof (AudioStreamBasicDescription))
            operation: "Couldn't set ASBD for RIO on output scope / bus 1"];

// Set format on inputscope of output bus
[Utilities checkError:AudioUnitSetProperty(self.info->rioUnit,
                                           kAudioUnitProperty_StreamFormat,
                                           kAudioUnitScope_Input,
                                           0,
                                           &outputasbd,
                                           sizeof(AudioStreamBasicDescription))
            operation: "Couldn't set ASBD for RIO on input scope / bus 0"];


// Start AUGraph
[Utilities checkError:AUGraphStart(self.info->mGraph)
        operation: "Couldn't start AUGraph"];

But unfortunately the AU Graph couldn't start with this code (OSStatus -10863). When I remove the filter by commenting out the AUGraphConnectNodeInput methods or use the remoteIO AU directly audio is played from the mic to speaker without problems.

Could anybody give me a hint what I do wrong with configuring kAudioUnitSubType_LowPassFilter?


Solution

  • EDIT 2:

    Change your ASBD to stereo. The filter requires it.

    I think AUGraphConnectNodeInput(self.info->mGraph, rioNode, 1, lpfNode, 1) is supposed to be AUGraphConnectNodeInput(self.info->mGraph, rioNode, 1, lpfNode, 0). The inDestInputNumber argument is essentially the input bus, and the filters just have one bus, so that argument should be bus 0; If that doesn't fix things, post what's going on in your setStreamFormatWithInputASBD method (if relevant). Either way, I usually will set all of my output ASBDs explicitly to match the input of the unit it is connected to.

    Given a graph like this inUnit->unitA->unitB->outUnit set ASBDs using this pattern:

    (pseudo code for audioUnitGetProperty and setproperty for ASBD)

    unitB.outputASBD = outUnit.inputASBD; 
    unitA.outputASBD = unitB.inputASBD; 
    inUnit.outputASBD = unitA.inputASBD; 
    

    Sometimes this isn't necessary, but sometimes it is! Most of the filters take a mandatory stereo float ASBD as input.