Filter architecture for an adaptive noise canceler in a personal audio device

FILTER ARCHITECTURE FOR AN ADAPTIVE NOISE CANCELER IN A PERSONAL

AUDIO DEVICE

FIELD OF THE INVENTION

[0001] The present invention relates generally to personal audio devices such as wireless telephones that include adaptive noise cancellation (ANC), and more specifically, to a filter architecture for implementing ANC in a personal audio device.

BACKGROUND OF THE INVENTION

[0002] Wireless telephones, such as mobile/cellular telephones, cordless telephones, and other consumer audio devices, such as mp3 players, are in widespread use. Performance of such devices with respect to intelligibility can be improved by providing noise canceling using a microphone to measure ambient acoustic events and then using signal processing to insert an anti-noise signal into the output of the device to cancel the ambient acoustic events.

[0003] The acoustic environment around personal audio devices such as wireless telephones provides a challenge for the implementation of ANC. In particular, conditions such as nearby voice activity, wind, mechanical noise on the device housing or unstable operation of the ANC system typically requires reset of the adaptive filter that generates the noise-canceling (anti- noise) signal. Since resetting the adaptive results in no noise canceling until the adaptive filter re- adapts, any time an event occurs that disrupts the operation of the ANC system, cancellation of ambient noise is disrupted, as well.

[0004] Therefore, it would be desirable to provide a personal audio device, including a wireless telephone, that provides noise cancellation that provides adequate performance under dynamically changing operating conditions. It would further be desirable to provide a mechanism for resetting an ANC system that does not cause the total loss of noise canceling while the ANC system re-adapts.

DISCLOSURE OF THE INVENTION

[0005] The above stated objective of providing a personal audio device providing adequate noise cancellation performance in dynamically changing operating conditions and that does not cause total loss of the correct anti-noise signal when the adaptive filter is reset, is accomplished in a personal audio device, a method of operation, and an integrated circuit.

[0006] The personal audio device includes a housing, with a transducer mounted on the housing for reproducing an audio signal that includes both source audio for playback to a listener and an anti- noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer, which may include the integrated circuit to provide adaptive noise-canceling (ANC) functionality. The method is a method of operation of the personal audio device and integrated circuit. A reference microphone is mounted on the housing to provide a reference microphone signal indicative of the ambient audio sounds. The personal audio device further includes an ANC processing circuit within the housing for adaptively generating an anti-noise signal from the reference microphone signal using one or more adaptive filters, such that the anti-noise signal causes substantial cancellation of the ambient audio sounds.

[0007] At least one of the one or more adaptive filters is partitioned into a first filter portion having a fixed frequency response that is combined with a variable frequency response of a second filter portion. The partitioned filter may be the adaptive filter that filters the reference microphone signal to generate the anti-noise signal. An error microphone may be included for controlling the adaptation of the anti-noise signal to cancel the ambient audio sounds and for correcting for the electro-acoustic path from the output of the processing circuit through the transducer. A secondary path adaptive filter may be used to generate an error signal from the error microphone signal and the secondary path adaptive filter may be partitioned, alone or in combination with partitioning of the adaptive filter that filters the reference microphone signal to generate the anti-noise signal.

[0008] The foregoing and other objectives, features, and advantages of the invention will be apparent from the following, more particular, description of the preferred embodiment of the invention, as illustrated in the accompanying drawings.

DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is an illustration of a wireless telephone 10 in accordance with an embodiment of the present invention.

[0010] Figure 2 is a block diagram of circuits within wireless telephone 10 in accordance with an embodiment of the present invention.

[0011] Figure 3 is a block diagram depicting signal processing circuits and functional blocks within an ANC circuit 30 A that can be used to implement ANC circuit 30 of Figure 2 in accordance with an embodiment of the present invention.

[0011] Figure 4 is a block diagram depicting signal processing circuits and functional blocks within an ANC circuit 30B that can be used to implement ANC circuit 30 of Figure 2 in accordance with another embodiment of the present invention.

[0012] Figure 5 is a block diagram depicting signal processing circuits and functional blocks within an ANC circuit 30C that can be used to implement ANC circuit 30 of Figure 2 in accordance with yet another embodiment of the present invention. [0013] Figure 6 is a block diagram depicting signal processing circuits and functional blocks within an integrated circuit in accordance with an embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

[0014] The present invention encompasses noise canceling techniques and circuits that can be implemented in a personal audio device, such as a wireless telephone. The personal audio device includes an adaptive noise canceling (ANC) circuit that measures the ambient acoustic environment and generates an anti-noise signal that is injected in the speaker (or other transducer) output to cancel ambient acoustic events. A reference microphone is provided to measure the ambient acoustic environment and an error microphone may be included for controlling the adaptation of the anti-noise signal to cancel the ambient audio sounds and for correcting for the electro-acoustic path from the output of the processing circuit through the transducer. Under certain operating conditions, e.g., when the ambient environment is one that the ANC circuit cannot adapt to, one that overloads the reference microphone, or causes the ANC circuit to operate improperly or in an

unstable/chaotic manner, the adaptive filter(s) implementing the ANC circuit must generally be reset. The present invention uses one or more partitioned filters having a fixed frequency response portion and a variable frequency response portion to implement the adaptive filters that control generation of the anti-noise signal. When the response of the partitioned filter is reset, the filter response is restored to a nominal response, or another response selected for recovery from the disruptive condition, providing an immediate anti-noise response that, while initially not adapted to the ambient audio condition, provides some degree of noise-cancellation while the ANC circuit re-adapts. Further, the partitioned filter configuration can provide increased stability, since only a portion of the filter adapts, the amount of deviation from a nominal response can be reduced. Leakage can also be introduced to provide a time-dependent restoration of the adaptive filter response to a nominal response, which provides further stability in operation.

[0015] Referring now to Figure 1, a wireless telephone 10 is illustrated in accordance with an embodiment of the present invention and is shown in proximity to a human ear 5. Illustrated wireless telephone 10 is an example of a device in which techniques in accordance with embodiments of the invention may be employed, but it is understood that not all of the elements or configurations embodied in illustrated wireless telephone 10, or in the circuits depicted in subsequent illustrations, are required in order to practice the invention recited in the Claims.

Wireless telephone 10 includes a transducer, such as speaker SPKR that reproduces distant speech received by wireless telephone 10, along with other local audio events such as ringtones, stored audio program material, injection of near-end speech (i.e., the speech of the user of wireless telephone 10) to provide a balanced conversational perception, and other audio that requires reproduction by wireless telephone 10, such as sources from web-pages or other network communications received by wireless telephone 10 and audio indications, such as low battery and other system event notifications. A near-speech microphone NS is provided to capture near-end speech, which is transmitted from wireless telephone 10 to the other conversation participant(s).

[0016] Wireless telephone 10 includes adaptive noise canceling (A C) circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R is provided for measuring the ambient acoustic environment and is positioned away from the typical position of a user's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. A third microphone, error microphone E, is provided in order to further improve the ANC operation by providing a measure of the ambient audio combined with the audio reproduced by speaker SPKR close to ear 5, when wireless telephone 10 is in close proximity to ear 5. Exemplary circuit 14 within wireless telephone 10 includes an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near speech microphone NS and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 12 containing the wireless telephone transceiver. In other embodiments of the invention, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that contains control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on- a-chip integrated circuit.

[0017] In general, the ANC techniques of the present invention measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, the ANC processing circuits of illustrated wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events at error microphone E. Since acoustic path P(z) extends from reference microphone R to error microphone E, the ANC circuits are essentially estimating acoustic path P(z) combined with removing effects of an electro-acoustic path S(z) that represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment, which is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone is not firmly pressed to ear 5. While the illustrated wireless telephone 10 includes a two microphone A C system with a third near speech microphone NS, some aspects of the present invention may be practiced in a system that does not include separate error and reference microphones, or a wireless telephone uses near speech microphone NS to perform the function of the reference microphone R. Also, in personal audio devices designed only for audio playback, near speech microphone NS will generally not be included, and the near- speech signal paths in the circuits described in further detail below can be omitted, without changing the scope of the invention.

[0018] Referring now to Figure 2, circuits within wireless telephone 10 are shown in a block diagram. CODEC integrated circuit 20 includes an analog-to-digital converter (ADC) 21A for receiving the reference microphone signal and generating a digital representation ref of the reference microphone signal, an ADC 21B for receiving the error microphone signal and generating a digital representation err of the error microphone signal, and an ADC 21C for receiving the near speech microphone signal and generating a digital representation ns of the error microphone signal. CODEC IC 20 generates an output for driving speaker SPKR from an amplifier Al, which amplifies the output of a digital-to-analog converter (DAC) 23 that receives the output of a combiner 26. Combiner 26 combines audio signals from internal audio sources 24, the anti-noise signal generated by ANC circuit 30, which by convention has the same polarity as the noise in reference microphone signal ref and is therefore subtracted by combiner 26, a portion of near speech signal ns so that the user of wireless telephone 10 hears their own voice in proper relation to downlink speech ds, which is received from radio frequency (RF) integrated circuit 22 and is also combined by combiner 26. Near speech signal ns is also provided to RF integrated circuit 22 and is transmitted as uplink speech to the service provider via antenna ANT.

[0019] Referring now to Figure 3, details are shown of an ANC circuit 30A, in accordance with an embodiment of the present invention, that may be used to implement ANC circuit 30 of Figure 2. A fixed filter portion 32A has a response W_FKED(Z) and an adaptive filter portion 32B having a response W_ADAPT(Z) are coupled in parallel to receive reference microphone signal ref and under ideal circumstances, adaptive filter portion 32B adapts its transfer function W_ADAPT(Z) SO that W_ADAPT(Z) + W_FIXED(Z) is equal to P(z)/S(z) to generate the correct anti-noise signal, which is provided to an output combiner 36A that combines the anti-noise signal with the audio to be reproduced by the transducer, as exemplified by combiner 26 of Figure 2. The coefficients of adaptive filter portion 32B are controlled by a leaky W coefficient control block 31 that uses a correlation of two signals to determine the response of adaptive filter portion 32B, which generally minimizes the error, in a least-mean squares sense, between those components of reference microphone signal ref present in error microphone signal err. The signals compared by leaky W coefficient control block 31 are the reference microphone signal ref as shaped by a copy of an estimate of the response of path S(z) provided by filter 35 and another signal that includes error microphone signal err. By transforming reference microphone signal ref with a copy of the estimate of the response of path S(z), SE_COPY(Z), and minimizing the difference between the resultant signal and error microphone signal err, adaptive filter portion 32B adapts to the desired response W_ADAPT(Z) = P(z)/S(z) - W_FIXED(Z).

[0020] Leaky W coefficient control block 31 is leaky in that response W_ADAPT(Z) normalizes to flat or otherwise predetermined response over time when no error input is provided to cause leaky LMS coefficient controller 31 to adapt. A flat response, W_ADAPT(Z) = 0, allows response W_FIXED(Z) to be set to a desired default, i.e., start-up or reset, response so that the total response of fixed filter portion 32A and adaptive filter portion 32B tends toward response W_FIXED(Z) over time. Providing a leaky response adaptation prevents long-term instabilities that might arise under certain environmental conditions, and in general makes the system more robust against particular sensitivities of the ANC response. An exemplary leakage control equation is given by:

W_k+i = (1 - Γ) · W_k + μ · e_k · X_k

where μ = 2^_normalized-^stepsize and normalized_stepsize is a control value to control the step between each increment of k, Γ = 2^"normallzed-^leakage₅ where normalized_leakage is a control value that determines the amount of leakage, e_k is the magnitude of the error signal, X_k is the magnitude of the reference microphone signal ref after filtering by the secondary path estimate copy provided by the response of filter 35, W_k is the starting magnitude of the amplitude response of adaptive filter portion 32B and where W_k+i are the updated coefficients of adaptive filter portion 32B. The leakage of leakage of LMS coefficient controller 31 may be increased when events are detected that indicate that the response of adaptive filter portion 32B may assume an incorrect value, e.g., the leakage of LMS coefficient controller 31 can be increased when near-end speech is detected, so that the anti- noise signal is eventually generated from the fixed response, until the near-end speech has ended and the adaptive filter can again adapt to cancel the ambient environment at the listener's ear.

[0021] The step size implemented by LMS coefficient controller 31 may have a fixed or selectable rate, as well as a fixed or selectable degree of leakage, as mentioned above. If the leakage is set to restore the response of adaptive filter portion 32B to a zero response, then the response of fixed filter portion 32A with respect to the maximum possible response variation of the adaptive filter portion 32B determines the degree to which the leakage can affect the anti-noise signal generation. The response of fixed filter portion 32A may also be made selectable, such that although the response of fixed filter portion 32A is not dynamically adapted as for adaptive filter portion 32B, the response of fixed filter portion 32A may be selected for particular environments, particular devices, particular users or in response to detection of particular audio events. To customize the device, historical values of the combined response of adaptive filter portion 32B and fixed filter portion 32A may be applied as the response to fixed filter portion 32A, at start-up or in response to an audio event, so that adaptive filter portion 32B only needs to adapt to vary the combined response from that of the historic response, which may be selected from among multiple historic values. Similarly, the initial response of the adaptive filter portion 32B may also be selected, alone or in combination with the selection of the initial response of the adaptive filter portion 32B. A coefficient storage 37 is coupled to LMS coefficient controller 31 to record and subsequently select historical and/or predetermined coefficient sets, which may be selected in response to an event detection block 39 detecting an ambient audio event.

[0022] In addition to error microphone signal err, the signal compared to the output of filter 35 by W coefficient control block 31 includes an inverted amount of downlink audio signal ds that has been processed by filter response SE(z), of which response SECOPY(Z) is a copy. By injecting an inverted amount of downlink audio signal ds, adaptive portion filter 32B is prevented from adapting to the relatively large amount of downlink audio present in error microphone signal err, and by transforming that inverted copy of downlink audio signal ds with the estimate of the response of path S(z), the downlink audio that is removed from error microphone signal err before comparison should match the expected version of downlink audio signal ds reproduced at error microphone signal err, since the electrical and acoustical path of S(z) is the path taken by downlink audio signal ds to arrive at error microphone E. Filter 35 is not an adaptive filter, per se, but has an adjustable response that is tuned to match the response of an adaptive filter 34 that is used to estimate the response of acoustical path S(z), so that the response of filter 35 tracks the adapting of adaptive filter 34.

[0023] To implement the above, adaptive filter 34 has coefficients controlled by SE coefficient control block 33, which compares downlink audio signal ds and error microphone signal err after removal of the above-described filtered downlink audio signal ds, that has been filtered by adaptive filter 34 to represent the expected downlink audio delivered to error microphone E, and which is removed from the output of adaptive filter 34 by a combiner 36. SE coefficient control block 33 correlates the actual downlink speech signal ds with the components of downlink audio signal ds that are present in error microphone signal err. Adaptive filter 34 is thereby adapted to generate a signal from downlink audio signal ds, that when subtracted from error microphone signal err, contains the content of error microphone signal err that is not due to downlink audio signal ds.

[0024] Referring now to Figure 4, details are shown of another ANC circuit 30B, in accordance with another embodiment of the present invention, that may be used to implement ANC circuit 30 of Figure 2. The operation and structure of ANC circuit 30B is similar to that of ANC circuit 30 A of Figure 3, so only differences between them will be described in detail below. ANC circuit 30B includes a secondary path filter that is also split into two portions: A fixed filter portion 34C has a response SE_FIXED(Z) and an adaptive filter portion 34D having a response SE_ADAPT(Z) are coupled in parallel to filter downlink audio signal ds for generation of the error signal as described above. Adaptive filter portion 34D has coefficients controlled by a leaky SE coefficient control block 33 A, which has a leakage characteristic similar to that described above with reference to Figure 3, although leaky SE coefficient control block 33A may have a different time constant and leakage amount or step size from that of leaky W coefficient control block 31. While not separately illustrated herein, the present invention includes embodiments in which only the secondary path response is partitioned into fixed and adaptive portions. In such embodiments, fixed filter portion 34C and adaptive filter portion 34D are provided, but fixed filter portion 32A and adaptive filter portion 32B are replaced by a single non-partitioned adaptive filter that filters reference microphone signal ref to generate the anti-noise signal.

[0025] Referring now to Figure 5, details are shown of another ANC circuit 30C, in accordance with another embodiment of the present invention, that may be used to implement ANC circuit 30 of Figure 2. The operation and structure of ANC circuit 30C is similar to that of ANC circuit 30B of Figure 4, so only differences between them will be described in detail below. In each of the partitioned filters formed by filter portions 32A,32B and by filter portions 34C, 34D, the filter portions are cascaded in a serial connection, so that, in the depicted embodiment, the adaptive response of filter portions 32B and 34D are superimposed on the fixed responses of filter portions 32A and 34C, respectively. Therefore, leaky coefficient control blocks 31 A and 33B differ from their counterparts in Figure 4, in that the responses are multiplied rather than added. Any combination of series or parallel connection of fixed/variable filter portions on either the secondary path or the direct path between reference microphone signal ref and the anti-noise signal may be implemented in one or both of the secondary and direct paths, in accordance with different embodiments of the invention.

[0026] Referring now to Figure 6, a block diagram of an ANC system is shown for illustrating ANC techniques in accordance with an embodiment of the invention, as may be implemented within CODEC integrated circuit 20. Reference microphone signal ref is generated by a delta-sigma ADC 41A that operates at 64 times oversampling and the output of which is decimated by a factor of two by a decimator 42A to yield a 32 times oversampled signal. A delta-sigma shaper 43A spreads the energy of images outside of bands in which a resultant response of a parallel pair of filter stages 44A and 44B will have significant response. Filter stage 44B has a fixed response W_FIXED(Z) that is generally predetermined to provide a starting point at the estimate of P(z)/S(z) for the particular design of wireless telephone 10 for a typical user. An adaptive portion W_ADAPT(Z) of the response of the estimate of P(z)/S(z) is provided by adaptive filter stage 44 A ,which is controlled by a leaky least-means-squared (LMS) coefficient controller 54A.

[0027] In the system depicted in Figure 6, the reference microphone signal is filtered by a copy SE_COPY(Z) of the estimate of the response of path S(z), by a filter 51 that has a response SE_COPY(Z), the output of which is decimated by a factor of 32 by a decimator 52A to yield a baseband audio signal that is provided, through an infinite impulse response (IIR) filter 53A to leaky LMS 54A. Filter 51 is not an adaptive filter, per se, but has an adjustable response that is tuned to match the combined response of filters 55A and 55B, so that the response of filter 51 tracks the adapting of SE(z).The error microphone signal err is generated by a delta-sigma ADC 41C that operates at 64 times oversampling and the output of which is decimated by a factor of two by a decimator 42B to yield a 32 times oversampled signal. As in the systems of Figure 3 and Figure 4, an amount of downlink audio ds that has been filtered by an adaptive filter to apply response S(z) is removed from error microphone signal err by a combiner 46C, the output of which is decimated by a factor of 32 by a decimator 52C to yield a baseband audio signal that is provided, through an infinite impulse response (IIR) filter 53B to leaky LMS 54A. Response S(z) is produced by another parallel set of filter stages 55A and 55B, one of which, filter stage 55B has fixed response SEnx_ED(z), and the other of which, filter stage 55A has an adaptive response SE_ADAPT(Z) controlled by leaky LMS coefficient controller 54B. The outputs of filter stages 55A and 55B are combined by a combiner 46E. Similar to the implementation of filter response W(z) described above, response SE_HXED(Z) is generally a predetermined response known to provide a suitable starting point under various operating conditions for electrical/acoustical path S(z). Filter 51 is a copy of adaptive filter

55A/55B, but is not itself an adaptive filter, i.e., filter 51 does not separately adapt in response to its own output, and filter 51 can be implemented using a single stage or a dual stage. A separate control value is provided in the system of Figure 6 to control the response of filter 51, which is shown as a single filter stage. However, filter 51 could alternatively be implemented using two parallel stages and the same control value used to control adaptive filter stage 55A could then be used to control the adjustable filter portion in the implementation of filter 51. The inputs to leaky LMS control block 54B are also at baseband, provided by decimating a combination of downlink audio signal ds and internal audio ia, generated by a combiner 46H, by a decimator 52B that decimates by a factor of 32, and another input is provided by decimating the output of a combiner 46C that has removed the signal generated from the combined outputs of adaptive filter stage 55A and filter stage 55B that are combined by another combiner 46E. The output of combiner 46C represents error microphone signal err with the components due to downlink audio signal ds removed, which is provided to LMS control block 54B after decimation by decimator 52C. The other input to LMS control block 54B is the baseband signal produced by decimator 52B. [0028] The above arrangement of baseband and oversampled signaling provides for simplified control and reduced power consumed in the adaptive control blocks, such as leaky LMS controllers 54A and 54B, while providing the tap flexibility afforded by implementing adaptive filter stages 44A-44B, 55A-55B and filter 51 at the oversampled rates. The remainder of the system of Figure 6 includes combiner 46H that combines downlink audio ds with internal audio ia, the output of which is provided to the input of a combiner 46D that adds a portion of near-end microphone signal ns that has been generated by sigma-delta ADC 41B and filtered by a sidetone attenuator 56 to prevent feedback conditions. The output of combiner 46D is shaped by a sigma-delta shaper 43B that provides inputs to filter stages 55 A and 55B that has been shaped to shift images outside of bands where filter stages 55A and 55B will have significant response.

[0029] In accordance with an embodiment of the invention, the output of combiner 46D is also combined with the output of adaptive filter stages 44A-44B that have been processed by a control chain that includes a corresponding hard mute block 45 A, 45B for each of the filter stages, a combiner 46A that combines the outputs of hard mute blocks 45 A, 45B, a soft mute 47 and then a soft limiter 48 to produce the anti-noise signal that is subtracted by a combiner 46B with the source audio output of combiner 46D. The output of combiner 46B is interpolated up by a factor of two by an interpolator 49 and then reproduced by a sigma-delta DAC 50 operated at the 64x oversampling rate. The output of DAC 50 is provided to amplifier Al, which generates the signal delivered to speaker SPKR. [0030] Each or some of the elements in the system of Figure 6, as well as in the exemplary circuits of Figure 2, Figure 3 and Figure 4, can be implemented directly in logic, or by a processor such as a digital signal processing (DSP) core executing program instructions that perform operations such as the adaptive filtering and LMS coefficient computations. While the DAC and ADC stages are generally implemented with dedicated mixed-signal circuits, the architecture of the ANC system of the present invention will generally lend itself to a hybrid approach in which logic may be, for example, used in the highly oversampled sections of the design, while program code or microcode- driven processing elements are chosen for the more complex, but lower rate operations such as computing the taps for the adaptive filters and/or responding to detected events such as those described herein,

[0031] While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing and other changes in form, and details may be made therein without departing from the spirit and scope of the invention.