Hearing aid and a method for enhancing speech intelligibility
Abstract
A hearing aid has a microphone, a processor and an output transducer, which isadapted for obtaining an estimate of a sound environment, determining an estimateof the speech intelligibility according to the sound environment estimate, and foradapting the transfer function of the hearing aid processor in order to enhance thespeech intelligibility index. The method achieves an adaptation of the processortransfer function suitable for optimizing the speech intelligibility in a particular soundenvironment. Means for obtaining a sound environment estimate and fordetermining the speech intelligibility index may be incorporated in the hearing aidprocessor, or they may be wholly or partially implemented in an external processingmeans, adapted for communicating data to the hearing aid processor via anappropriate link.

Term
Term ended
Expired 12 July 2022, 4.2 years ago.
- Priority and filed
- Granted
- Expired
- Today
24 claims: 3 independent, 21 dependent
- 1CA 02492091 2008-01-29 THE EMBODIMENTS OF THE PRESENT INVENTION IN WHICH AN EXCLUSIVE PROPERTY OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS:-221. A method of processing a signal in a hearing aid, the hearing aid having a microphone, a processor having a transfer function, and an output transducer, the method comprising the steps of splitting an input signal into a number of individual frequency bands, determining the transfer function as a gain vector, obtaining one or more estimates of a sound environment by calculating a signal level and a noise level in each of the individual frequency bands, calculating a speech intelligibility index based on the estimate of the sound environment and the transfer function of the processor, and iteratively varying gain levels of the individual frequency bands up or down in order to maximise the speech intelligibility index.
- 1214. A hearing aid with an input transducer, a processor and an acoustic output transducer, said processor comprising a filter block, a signal and noise estimator, a gain control, at least one summation point, and means for enhancing speech intelligibility, said means for enhancing speech intelligibility comprising a loudness model means, a hearing loss vector means and a speech enhancement unit adapted for calculating a speech intelligibility index based on signals from the signal and noise estimator, the hearing loss vector means and the loudness model means.
- 1517. A method of fitting a hearing aid to a sound environment, comprising selecting a setting for an initial hearing aid transfer function according to a general fitting rule, obtaining an estimate of the sound environment by calculating signal levels and noise levels in distinct frequency bands, calculating a speech intelligibility index based on the estimate of the sound environment and the initial transfer function, and adapting an initial setting to provide a modified transfer function suitable for enhancing speech intelligibility. . I .· I ι · I CA 02492091 2005-06-02 -2518. The method according to claim 17, further comprising executing the step of adapting the initial transfer function in an external fitting system connected to the hearing aid, and transferring the modified setting to a programme memory in the hearing aid.
- 1821. The method according to claims 19 or 20, further comprising calculating a loudness of an output signal from the gain vector and comparing the loudness to a loudness limit, said loudness limit vector representing the loudness of the unamplified sound, and adjusting the gain vector in order to keep the loudness less than, or equal to the loudness limit.
Independent claims4
136 paragraphs in 26 sections, as filed
CA 02492091 2008-12-29
-1HEARING AID AND A METHOD FOR ENHANCING SPEECH INTELLIGIBILITY
FIELD OFTHE INVENTION
The present invention relates to a hearing aid and to a method for enhancing speech intelligibility. The invention further relates to adaptation of hearing aids to specific sound environments. More specifically, the invention relates toa hearing aid with means for real-time enhancement ofthe intelligibility of speech in a noisy sound environment. Additionally, it relates to a method of improving listening comfort by means of adjusting frequency band gain in the hearing aid according to real-time determinations of speech intelligibility and loudness.
BACKGROUND OF THE INVENTION
A modern hearing aid comprises one or more microphones, a signal processor, some means of controlling the signal processor, a loudspeaker or telephone, and, possibly, a telecoil for use in locations fitted with telecoil systems. The means for controlling the signal processor may comprise means for changing between different hearing programmes, e.g. a first programme for use in a quiet sound environment, a second programme for use in a noisier sound environment, a third programme for telecoil use, etc.
Prior to use, the hearing aid must be fitted to the individual user. The fitting procedure basically comprises adapting the level dependent transferfunction, or frequency response, to best compensate the user’s hearing loss according to the particular circumstances such as the user’s hearing impairment and the specific hearing aid selected. The selected settings of the parameters governing the transfer function are stored in the hearing aid. The setting can later be changed through a repetition of the fitting procedure, e.g. to account for a change in impairment. In case of multiprogram hearing aids, the adaptation procedure may be carried out once for each programme, selecting settings dedicated to take specific sound environments into account.
According to the state of the art, hearing aids process sound in a number of frequency bands with facilities for specifying gain levels according to some predefined input/gain-curves in the respective bands.
CA 02492091 2005-06-02
-2The input processing may further comprise some means of compressing the signal in order to control the dynamic range of the output of the hearing aid. This compression can be regarded as an automatic adjustment of the gain levels for the purpose of improving the listening comfort of the user of the hearing aid. Compression may be implemented in the way described in the international application WO 99/34642 A1.
Advanced hearing aids may further comprise anti-feedback routines for continuously measuring input levels and output levels in respective frequency bands for the purpose of continuously controlling acoustic feedback howl through lowering of the gain settings in the respective bands when necessary.
However, in all these “predefined” gain adjustment methods, the gain levels are modified according to functions that have been predefined during the programming/fitting of the hearing aid to reflect requirements for generalized situations.
In the past, various researchers have suggested models for the prediction of the intelligibility of speech after a transmission through a linear system. The most well-known of these models is the “articulation index”, Al, the “speech intelligibility index”, SII, and the “speech transmission index”, STI, but other indices exist.
Determinations of speech intelligibility have been used to assess the quality of speech signals in telephone lines at the Bell Laboratories (H. Fletcher and R. H. Galt “The perception of speech and its relation to telephony,” J. Acoust. Soc. Am. 22,89-151 (1950)). Speech intelligibility is also an important issue when planning and designing concert halls, churches, auditoriums and public address (PA) systems.
US-6 289 247 B1 discloses a method for processing a signal in a cochlear prosthesis, said prosthesis having a microphone, a speech processor, and an output transducer, said method incorporating the step of obtaining an estimate of a sound environment by splitting the input signal into N frequency channels, rectifying the output from the N frequency channels, comparing the channel-split, rectified input signal with stored coefficients in a pulse template table. The rectified signal in a particular frequency band is then processed and optimized based on this
CA 02492091 2005-06-02
-3comparison for the purpose of determining an estimate of the speech intelligibility according to the sound environment estimate. The estimate of the speech intelligibility is used to choose one among a set of stored speech processing strategies.
However, the method disclosed by US-6 289 247 B1 is tailored to the processing of speech for reproduction by a set of electrodes implantable in a human cochlea, and the selectable speech processing strategies are unsuitable for reproduction by the output transducer of a conventional acoustic hearing aid. The method is also based on a fixed set of parameters and is thus rather inflexible. An adaptive method for enhancing speech intelligibility in a conventional hearing aid is thus desirable.
The ANSI S3.5-1969 standard (revised 1997) provides methods forthe calculation of the speech intelligibility index, Sil. The Sil makes it possible to predict the intelligible amount of the transmitted speech information, and thus, the speech intelligibility in a linear transmission system. The Sil is a function of the system’s transfer function, i.e. indirectly of the speech spectrum at the output of the system. Furthermore, it is possible to take both the effects of a masking noise and the effects of a hearing aid user’s hearing loss into account in the SI I.
According to this ANSI standard, Sil includes a frequency weighting dependent band, as the different frequencies in a speech spectrum differ in importance with regard to Sil. The Sil does, however, account forthe intelligibility of the complete speech spectrum, calculated as the sum of values for a number of individual frequency bands.
The Sil is always a number between 0 (speech is not intelligible at all) and 1 (speech is fully intelligible). The SI I is, in fact, an objective measure of the system’s ability to convey individual phonemes, and thus, hopefully, of making it possible forthe listener to understand what is being said. It does not take language, dialect, or lack of oratorical gift with the speaker into account.
In an article “Predicting Speech Intelligibility in Rooms from the
Modulation Transfer Function” (Acoustica Vol 46, 1980), T. Houtgast, H. J. M. Steeneken and R. Plomp present a scheme for predicting speech intelligibility in rooms. The scheme is based on the Modulation Transfer Function (MTF), which,
CA 02492091 2005-06-02
-4among other things, takes the effects of the room reverberation, the ambient noise level and the talkers vocal output into account. The MTF can be converted into a single index, the Speech Transmission Index, or STI.
An article “NAL-NL1 : A new procedure for fitting non-linear hearing aids” in The Hearing Journal, April 1999, Vol. 52, No.4 describes a fitting rule selected for maximizing speech intelligibility while keeping overall loudness at a level no greater than that perceived by a normal-hearing person listening to the same sound. A number of audiograms and a number of speech levels have been considered.
Modem fitting of hearing aids also take speech intelligibility into account, but the resulting fitting of a particular hearing aid has always been a compromise based on a theoretically, or empirically derived, fixed estimate. The preferred, contemporary measure of speech intelligibility is the speech intelligibility index, orSII, as this method is well-defined, standardized, and gives fairly consistent results. Thus, this method will be the only one considered in the following, with reference to the ANSI S3.5-1997 standard.
Many of the applications of a calculated speech intelligibility index utilize only a static index value, maybe even derived from conditions that are different from those present where the speech intelligibility index will be applied. These conditions may include reverberation, muffling, a change in the level or spectral density of the noise present, a change in the transfer function of the overall speech transmission path (including the speaker, the listening room, the listener, and some kind of electronic transmission means), distortion, and room damping.
Further, an increase of gain in the hearing aid will always lead to an increase in the loudness of the amplified sound, which may in some cases lead to an unpleasantly high sound level, thus creating loudness discomfort for the hearing aid user.
The loudness of the output of the hearing aid may be calculated according to a loudness model, e.g. by the method described in an article by B. C. J. Moore and B. R. Glasberg “A revision of Zwicker’s loudness model” (Acta Acustica Vol. 82 (1996) 335-345), which proposes a model for calculation of loudness in normal-hearing and hearing-impaired subjects. The model is designed
CA 02492091 2005-06-02
-5for steady state sounds, but an extension of the model allows calculations of loudness of shorter transient-like sounds, too. Reference is made to ISO standard 226 (ISO 1987) concerning equal loudness contours.
A measure for the speech intelligibility may be computed for any particular sound environment and setting of the hearing aid by utilizing any of these known methods. The different estimates of speech intelligibility corresponding to the speech and noise amplified by a hearing aid will be dependent on the gain levels in the different frequency bands of the hearing loss. However, a continuous optimization of speech intelligibility and/or loudness requires continuous analysis of the sound environment and thus involves extensive computations beyond what has been considered feasible for a processor in a hearing aid.
The inventor has realized the fact that it is possible to devise a dedicated, automatic adjustment of the gain settings which may enhance the speech intelligibility while the hearing aid is in use, and which is suitable for implementation in a low power processor, such as a processor in a hearing aid.
This adjustment requires the capability of increasing or decreasing the gain independently in the different bands depending on the current sound situation. For bands with high noise levels, e.g., it may be advantageous to decrease the gain, while an increase of gain can be advantageous in bands with low noise levels, in order to enhance the Sil. However, such a simple strategy will not always be an optimal solution, as the Sil also takes inter-band interactions, such as mutual masking, into account. A precise calculation of the Sil is therefore necessary.
SUMMARY OF THE INVENTION
The object of the invention is to provide a method and a means for enhancing the speech intelligibility in a hearing aid in varying sound environments. It is a further object to do this while at the same time preventing the hearing aid from creating loudness discomfort.
It is a further object of the invention to provide a method and means for enhancing the speech intelligibility in a hearing aid, which can be implemented at low power consumption.
CA 02492091 2008-12-29
-6According to an aspect of the present invention, there is provided a method of processing a signal in a hearing aid, the hearing aid having a microphone, a processor having a transfer function, and an output transducer, comprising the steps of splitting an input signal into a number of individual frequency bands, determining the transfer function as a gain vector, obtaining one or more estimates of a sound environment by calculating a signal level and a noise level in each of the individual frequency bands, calculating a speech intelligibility index based on the estimate of the sound environment and the transfer function of the processor, and iteratively varying gain levels of the individual frequency bands up or down in order to maximize the speech intelligibility index.
The enhancement of the speech intelligibility estimate signifies an enhancement of the speech intelligibility in the sound output of the hearing aid. The method according to the invention achieves an adaptation of the processor transfer function suitable for optimizing the speech intelligibility in a particular sound environment.
The sound environment estimate may be updated as often as necessary, i.e. intermittently, periodically or continuously, as appropriate, in view of considerations such as requirements to data processing and variability of the sound environment. In state of the art digital hearing aids, the processor will process the acoustic signal with a short delay, preferably smaller than 3 ms, to prevent the user from perceiving the delay between the acoustic signal perceived directly and the acoustic signal processed by the hearing aid, as this can be annoying and impair consistent sound perception. Updating of the transfer function can take place at a much lower pace without user discomfort, as changes due to the updating will generally not be noticed. Updating at, e.g. 50 ms intervals, will often be sufficient even for fast changing environments. In case of steady environments, updating may be slower, e.g. on demand.
The means for obtaining the sound environment estimate and for determining the speech intelligibility estimate may be incorporated in the hearing aid processor, or they may be wholly or partially implemented in an external processing means, adapted for communicating data to and from the hearing aid processor by an appropriate link.
CA 02492091 2008-12-29
-7Assuming that calculating the speech intelligibility index, Sil, in realtime would be possible, alot of these problems could be overcome through using the result of these calculations to compensate for the deteriorated speech intelligibility in some way, e.g. by repeatedly altering the transfer function at some convenient point in the sound transmission chain, preferably in the electronic processing means.
If one further assumes that the Sil, which has earlier solely been considered in linear systems, can be calculated and used with an acceptable degree of accuracy in a nonlinear system, the scope of application of the Sil may be expanded considerably. It might then, for instance, be used in systems having some kind of nonlinear transfer function, such as in hearing aids which utilize some kind of compression of the sound signal. This application of the Sil will be especially successful if the hearing aid has long compression time constants which generally make the system more linear.
In order to calculate a real-time Sil, an estimate of the speech level and the noise level must be known at computation time, as these values are required for the calculation. These level estimates can be obtained with fair accuracy in various ways, for instance by using a percentile estimator. It is assumed that a maximum Sil will always exist for a given signal level and a given noise level. If the amplification gain is changed, the Sil will change, too.
As it is not feasible to compute a general relationship between the Sil and a given change in amplification gain analytically, some kind of numerical optimization routine is needed to determine this relationship in order to determine the particular amplification gain that gives the largest Sil value. An implementation of a suitable optimization routine is explained in the detailed part of the specification.
According to an embodiment of the invention, the method further comprises determining the transfer function as a gain vector representing gain values in a number of individual frequency bands in the hearing aid processor, the gain vector being selected for enhancing speech intelligibility. This simplifies the data processing.
According to a method embodied in the invention, the step of iteratively varying the gain values comprises determining for a first part of the frequency bands
CA 02492091 2008-12-29
-8respective gain values suitable for enhancing speech intelligibility, and determining for a second part of the frequency bands respective gain values through interpolation between gain values in respect of the first part of the frequency bands.
This simplifies the data processing through cutting down on the number of frequency bands, wherein a more complex optimization algorithm needs to be executed. The first part of the frequency bands will be selected to generally cover the frequency spectrum, while the second part of the frequency bands will be situated interspersed between the frequency bands of the first part, in order that interpolation will provide good results.
According to another method embodied in the invention, the method further comprises transmitting the speech intelligibility index to an external fitting system connected to the hearing aid. This may provide a piece of information that may be useful to the user or to an audiologist, e.g. in evaluating the performance and the fitting of the hearing aid, circumstances of a particular sound environment, or circumstances particular to the users auditive perception. External fitting systems suitable for communicating with a hearing aid comprising programming devices are described in WO 90/08448 and in WO 94/22276. Other suitable fitting systems are industry standard systems such as HiPRO or NOAH specified by Hearing Instrument Manufacturers’ Software Association (HIMSA).
According to yet another method embodied in the invention, the method further comprises calculating a loudness of an output signal from the gain vector and comparing the loudness to a loudness limit, wherein said loudness limit represents a ratio to a loudness of an unamplified sound in normal hearing listeners, and adjusting the gain vector as appropriate in order to keep the loudness lower than, or equal to, the loudness limit This improves user comfort by ensuring that the loudness of the hearing aid output signal stays within a comfortable range.
The method according to another embodiment of the invention further comprises adjusting the gain vector by multiplying it with a scalar factor selected in such a way that the loudness is lower than, or equal to, the corresponding loudness limit value. This provides a simple implementation of the loudness control.
According to a method embodied in the invention, the method further comprises adjusting each gain value in the gain vector in such a way that the
CA 02492091 2005-06-02
-9loudness of the gain values is lower than, or equal to, the corresponding loudness limit value.
According to a method embodied in the invention, the method further comprises determining the speech intelligibility index as an articulation index.
According to another method embodied in the invention, the method further comprises determining the speech intelligibility index as a modulation transmission index.
According to yet another method embodied in the invention, the further method comprises determining the speech intelligibility index as a speech transmission index.
The method according to another embodiment of the invention further comprises determining a signal level estimate and a noise level estimate of the sound environment as respective percentile values of the sound environment. These estimates may be obtained by a statistical analysis of the sound signal over time. One method comprises identifying, through level analysis, time frames where signal is present, averaging the sound level within those time frames to produce the signal level estimate, and averaging the levels within remaining time frames to produce the noise level estimate.
According to a method embodied in the invention, the method further comprises processing the signal level in real time while updating the transfer function intermittently.
According to another method embodied in the invention, the method further comprises processing the signal level in real time while updating the transfer function on a user request.
According to yet another method embodied in the invention, the method further comprises the steps of determining a speech intelligibility index as a function of the signal level values, the noise level values, and a hearing loss vector.
According to a second aspect of the invention, there is provided a hearing aid with an input transducer, a processor, and an acoustic output transducer, said processor comprising a filter block, a signal and noise estimator, a gain control, at least one summation point, and means for enhancing speech
CA 02492091 2005-06-02
-10intelligibility, said means for enhancing speech intelligibility comprising a loudness model means, a hearing loss vector means and a speech enhancement unit adapted for calculating a speech intelligibility index based on signals from the signal and noise estimator, the hearing loss vector means and the loudness model means.
The hearing loss vector comprises a set of values representing hearing deficiency measurements taken in various frequency bands. The hearing aid according to the invention in this aspect provides a piece of information, which may be used in adaptive signal processing in the hearing aid for enhancing speech intelligibility, or it may be presented to the user or to a fitter, e.g. by visual or acoustic means.
According to an embodiment of the invention, the hearing aid further comprises means for enhancing speech intelligibility by way of applying appropriate adjustments (AG) to a number of gain levels in a number of individual frequency bands in the hearing aid.
According to another embodiment, the hearing aid further comprises means for comparing the loudness corresponding to the adjusted gain values in the individual frequency bands in the hearing aid to a corresponding loudness limit value, said loudness limit value representing a ratio to the loudness of the unamplified sound, and means for adjusting the respective gain values as appropriate in order to keep the loudness lower than, or equal to, the loudness limit value.
According to a third aspect of the present invention, there is provided a method of fitting a hearing aid to a sound environment, comprising selecting a setting for an initial hearing aid transfer function according to a general fitting rule, obtaining an estimate of the sound environment by calculating signal levels and noise levels in distinct frequency bands, calculating a speech intelligibility index based on the estimate of the sound environment and the initial transfer function, and adapting an initial transfer setting to provide a modified transfer function suitable for enhancing the speech intelligibility.
By this method, the hearing aid is adapted to a specific environment, which permits an adaptation targeted for superior speech intelligibility in that environment.
CA 02492091 2008-12-29
-11BRIEF DESCRIPTION OF THE DRAWINGS
The invention will now be described in more detail with reference to the accompanying drawings, where:
Fig. 1 shows a schematic block diagram of a hearing aid with speech optimization means according to an embodiment of the invention;
Fig. 2 is a flow chart showing a preferred optimization algorithm utilizing a variant of the ‘steepest gradient’ method;
Fig. 3 is a flow chart showing calculation of speech intelligibility using the SII method;
Fig. 4 is a graph showing different gain values during individual steps of the iteration algorithm in Fig. 2, and;
Fig. 5 is a schematic representation of a programming device communicating with a hearing aid according to the invention.
DETAILED DESCRIPTION OF THE INVENTION
The hearing aid 22 in Fig. 1 comprises a microphone 1 connected to a block splitting means 2, which further connects to a filter block 3. The block splitting means 2 may apply an ordinary, temporal, optionally weighted windowing function, and the filter block 3 may preferably comprise a predefined set of low pass, band pass and high pass filters defining the different frequency bands in the hearing aid 22.
The total output from the filter block 3 is fed to a multiplication point 10, and the output from the separate bands 1, 2, ... M in filter block 3 are fed to respective inputs of a signal and noise estimator 4. The outputs from the separate filter bands are shown in Fig. 1 by a single, bolder, signal line. The signal level and noise level estimator may be implemented as a percentile estimator, e.g. of the kind presented in the international application WO 98/27787 A1.
The output of multiplication point 10 is further connected to a loudspeaker 12 via a block overlap means 11. The signal and noise estimator 4 is connected to a loudness model means 7 by two multi-band signal paths carrying two separate signal parts, S (signal) and N (noise), which two signal parts are also fed to a speech optimization unit 8. The output of the loudness model means 7 is further connected to the output of the speech optimization unit 8.
CA 02492091 2005-06-02
-12The loudness model means 7 uses the S and N signal parts in an existing loudness model in order to ensure that the subsequently calculated gain values from the speech optimization unit 8 do not produce a loudness of the output signal of the hearing aid 22 that exceeds a predetermined loudness L<sub>o</sub>, which is the loudness of the unamplified sound for normal hearing subjects.
The hearing loss model means 6 may advantageously be a representation of the hearing loss compensation profile already stored in the working hearing aid 22, fitted to a particular user without necessarily taking speech intelligibility into consideration.
The signal and noise estimator 4 is further connected to an AGC means 5, which in turn is connected to one input of a summation point 9, feeding it with the initial gain values g<sub>0</sub> The AGC means 5 is preferably implemented as a multiband compressor, for instance of the kind described in WO 99/34642.
The speech optimization unit 8 comprises means for calculating a new set of optimized gain value changes iteratively, utilizing the algorithm described in the flow chart in Fig. 2. The output of the speech optimization unit 8, AG, is fed to one of the inputs of summation point 9. The output of the summation point 9, g’, is fed to the input of multiplication point 10 and to the speech optimization unit 8. The summation point 9, loudness model means 7 and speech optimization unit 8 form the optimizing part of the hearing aid according to the invention. The speech optimization unit 8 also contains a loudness model.
In the hearing aid 22 in Fig. 1, speech signals and noise signals are picked up by the microphone 1 and split by the block splitting means 2 into a number of temporal blocks or frames. Each of the temporal blocks or frames, which may preferably be approximately 50 ms in length, is processed individually. Thus each block is divided by the filter block 3 into a number of separate frequency bands.
The frequency-divided signal blocks are then split into two separate signal paths where one goes to the signal and noise estimator 4 and the other goes to a multiplication point 10. The signal and noise estimator 4 generates two separate vectors, i.e. N, ‘assumed noise’, and S, 'assumed signal’. These vectors are used by the loudness model means 7, and the speech optimization unit 8 to distinguish between the ‘assumed noise level’ and the ‘assumed signal level*.
CA 02492091 2005-06-02
-13The signal and noise estimator 4 may be implemented as a percentile estimator. A percentile is, by definition, the value for which the cumulative distribution is equal to or below that percentile. The output values from the percentile estimator each correspond to an estimate of a level value below which the signal level lies within a certain percentage of the time during which the signal level is estimated. The vectors preferably correspond to a 10% percentile (the noise, N) and a 90% percentile (the signal, S) respectively, but other percentile figures can be used.
In practice, this means that the noise level vector N comprises the signal levels below which the frequency band signal levels lie during 10% of the time, and the signal level vector S is the signal level below which the frequency band signal levels lie during 90% of the time. Additionally, the signal and noise estimator presents a control signal to the AGC 5 for adjustment of the gain in the different frequency bands. The signal and noise estimator 4 implements a very efficient way of estimating for each block the frequency band levels of noise as well as the frequency band levels of signal.
The gain values g<sub>0</sub> from the AGC 5 are then summed with the gain changes AG in the summation point 9 and presented as a gain vector g’ to the multiplication point 10 and to the speech optimization means 8. The signal vector and the noise vector N from the signal and noise estimator 4 are presented to the signal input and the noise input of the speech optimization unit 8 and the corresponding inputs of the loudness model means 7.
The loudness model means 7 contains a loudness model, which calculates the loudness of the input signal for normal hearing listeners, L<sub>o</sub> A hearing loss model vector H from the hearing loss model means 6 is presented to the input of the speech optimization unit 8.
After optimizing the speech intelligibility, preferably by means of the iterative algorithm shown in Fig. 2, the speech optimization unit 8 presents a new gain change AG to the inputs of summation points 9 and an altered gain value g’ to the multiplication point 10. The summation point 9 adds the output vector AG to the input vector g<sub>0</sub>, thus forming a new, modified vector g’ for the input of the multiplication point 10 and to the speech optimization unit 8. Multiplication point 10
CA 02492091 2005-06-02
-14multiplies the gain vector g’ to the signal from the filter block 3 and presents the resulting, gain adjusted signal to the input of block overlap means 11.
The block overlap means may be implemented as a band interleaving function and a regeneration function for recreating an optimized signal suitable for reproduction. The block overlap means 11 forms the final, speech-optimized signal block and presents this via suitable output means (not shown) to the loudspeaker or hearing aid telephone 12.
Fig. 2 is a flow chart of a preferred speech optimization algorithm comprising a start point block 100 connected to a subsequent block 101, where an initial frequency band number M = 1 is set. In the following step 102, an initial gain value g<sub>0</sub> is set. In step 103, a new gain value g is defined as g<sub>0</sub> plus a gain value increment ΔΘ, followed by the calculation of the proposed speech intelligibility value SI in step 104. After step 104, the speech intelligibility value SI is compared to an initial value Sl<sub>o</sub> in step 105.
If the new SI value is larger than the initial value Sl<sub>o</sub> the routine continues in step 109, where the loudness L is calculated. This new loudness L is compared to the loudness L<sub>o</sub> in step 110. If the loudness L is larger than the loudness L<sub>o</sub>, then the new gain value g<sub>0</sub> is set to g<sub>0</sub> minus the gain value increment AG in step 111. Otherwise, the routine continues in step 106, where the new gain value g is set to g<sub>0</sub> plus the incremental gain value AG. The routine then continues in step 113 by examining the band number M to see if the highest number of frequency bands M<sub>max</sub> has been reached.
If, however, the new SI value calculated in step 104 is smaller than the initial value Sl<sub>o</sub>, the new gain value g<sub>0</sub> is set to g<sub>0</sub> minus a gain value increment AG in step 107.
The proposed speech intelligibility value SI is then calculated again for the new gain value g in step 108.
The proposed speech intelligibility SI is again compared to the initial value Sl<sub>o</sub> in step 112. If the new value SI is larger than the initial value Sl<sub>o</sub>, the routine continues in step 111, where the new gain value g<sub>0</sub> is defined as g<sub>0</sub> minus AG.
CA 02492091 2005-06-02
-15lf neither an increased nor a decreased gain value AG results in an increased SI, the initial gain value g<sub>0</sub> is preserved for frequency band M. The routine continues in step 113 by examining the band number M to see if the highest number of frequency bands M<sub>max</sub> has been reached. If this is not the case, the routine continues via step 115, incrementing the number of the frequency band subject to optimization by one. Otherwise, the routine continues in step 114 by comparing the new SI vector with the old vector Sl<sub>o</sub> to determine if the difference between them is smaller than a tolerance value ε.
If any of the M values of SI calculated in each band in either step 104 or step 108 are substantially different from Sl<sub>o</sub>, i.e. the vectors differ by more than the tolerance value ε, the routine proceeds to step 117, where the iteration counter k is compared to a maximum iteration number k<sub>max</sub>.
If k is smaller than k,,,^, the routine continues in step 116, by defining a new gain increment AG by multiplying the current gain increment with a factor 1/d, where d is a positive number greater than 1, and incrementing the iteration counter k. The routine then continues by iteratively calculating all M<sub>max</sub> frequency bands again in step 101, starting over with the first frequency band M = 1. If k is larger than k<sub>max</sub>, the new individual gain values are transferred to the transfer function ofthe signal processor in step 118 and terminates the optimization routine in step 119. This is also the case if the SI did not increase by more than ε in any band (step 114). Then the need for further optimization no longer exists, and the resulting, speech-optimized gain value vector is transferred to the transfer function ofthe signal processor in step 118 and the optimization routine is terminated in step 119.
In essence, the algorithm traverses the M<sub>max</sub>-dirnensional vector space of M<sub>max</sub> frequency band gain values iteratively, optimizing the gain values for each frequency band with respect to the largest SI value. Practical values for the variables ε and d in this example are ε = 0.005 and d = 2. The number of frequency bands M<sub>max</sub> may be set to 12 or 15 frequency bands. A convenient starting point for AG is 10dB. Simulated tests have shown that the algorithm usually converges after four to six iterations, i.e. a point is reached where the difference between the old Sl<sub>o </sub>vector and the new SI vector becomes negligible and thus execution of subsequent
CA 02492091 2005-06-02
-16iterative steps may be terminated. Thus, this algorithm is very effective in terms of processing requirements and speed of convergence.
The flow chart in Fig. 3 illustrates how the SII values needed by the algorithm in Fig. 2 can be obtained. The SI algorithm according to Fig. 3 implements the steps of each of steps 104 and 108 in Fig. 2, and it is assumed that the speech intelligibility index, SII, is selected as the measurement for speech intelligibility, SI. The SI algorithm initializes in step 301, and in steps 302 and 303 the SI algorithm determines the number of frequency bands M<sub>max</sub>, the frequencies f<sub>0M</sub> for the individual bands, the equivalent signal spectrum level S, the internal noise level N and the hearing threshold T for each frequency band.
In order to utilize the SII calculation, it is necessary to determine the number of individual frequency bands before any calculation is taking place, as the method of calculating several ofthe involved parameters depend on the number and bandwidth of these frequency bands.
The equivalent signal spectrum level S is calculated in step 304 as:
<sup>w)</sup> where E<sub>b</sub> is the SPL ofthe signal at the output ofthe band pass filter with the center frequency f, A(f) is the band pass filter bandwidth and A<sub>0</sub>(f) is the reference bandwidth of 1 Hz. The reference internal noise spectrum N, is obtained in step 305 and used for calculation of the equivalent internal noise spectrum Ν’, and, subsequently, the equivalent masking spectrum level Z,. The latter can be expressed as:
i-l 0.lfe,+3.32C,lotf Ajl '‘+Yio VJJ (2) Z,=101og 10<sup>ow</sup>'+£l0 where Ν’, is the equivalent internal noise spectrum level, B<sub>k</sub>is the larger value of Ν’, and the self-speech masking spectrum level V„ expressed as:
(3) Vj=S-24,
CA 02492091 2008-12-29
-17where I, is the lower frequency band limit for the critical band i.
The equivalent noise spectrum level X’, is calculated in step 306 as:
(5) Χ\ = Χ.+Τ\, where Xj equals the noise level N and Tj is the hearing threshold in the frequency band in question.
In step 307, the equivalent masking spectrum level Z, is compared to the equivalent internal noise spectrum level Ν’„ and, if the equivalent masking spectrum level Z<sub>t</sub> is the largest, the equivalent disturbance spectrum level Dj is made equal to the equivalent masking spectrum level Z, in step 308, and otherwise made equal to the equivalent internal noise spectrum level N’<sub>s</sub> in step 309.
The standard speech spectrum level at normal vocal effort, U,, is obtained in step 310, and the level distortion factor L, is calculated with the aid of this reference value at step 311 as:
(6) (7)
160
The band audibility A, is calculated in step 312 as:
<sup>h</sup> 30 and, finally, the total speech intelligibility index SII is calculated in step 313 as:
(8) 8//=2/,-4, (=1
CA 02492091 2005-06-02
-18where I, is the band importance function used to weight the audibility with respect to speech frequencies, and the speech intelligibility index is summed for each frequency band. The algorithm terminates in step 314, where the calculated Sil value is returned to the calling algorithm (not shown).
The SI I represents a measure of an ability of a system to faithfully reproduce phonemes in speech coherently, and thus, conveying the information in the speech transmitted through the system.
Fig. 4 shows six iterations in the SI I optimizing algorithm according to the invention. Each step shows the final gain values 43, illustrated in Fig. 4 as a number of open circles, corresponding to the optimal SI I in fifteen bands, and the Sil optimizing algorithm adapts a given transfer function 42, illustrated in Fig. 4 as a continuous line, to meet the gain for the optimal gain values 43. The iteration starts at an extra gain of 0 dB in all bands and then makes a step of ±AG in all gain values in iteration step I, and continues by iterating the gain values 42 in step II, III, IV, V and VI in order to adapt the gain values 42 to the optimal Sil values 43.
The optimal gain values 43 are not known to the algorithm prior to computation, but as the individual iteration steps I to VI in Fig. 4 shows, the gain values in the example converges after only six iterations.
Fig. 5 is a schematic diagram showing a hearing aid 22, comprising a microphone 1, a transducer or loudspeaker 12, and a signal processor 53, connected to a hearing aid fitting box 56, comprising a display means 57 and an operating panel 58, via a suitable communication link cable 55.
The communication between the hearing aid 22 and the fitting box 56 is implemented by utilizing the standard hearing aid industry communicating protocols and signaling levels available to those skilled in the art. The hearing aid fitting box comprises a programming device adapted for receiving operator inputs, such as data about the users hearing impairment, reading data from the hearing aid, displaying various information and programming the hearing aid by writing into a memory in the hearing aid suitable programme parameters. Various types of programming devices may be suggested by those skilled in the art. For example, some programming devices are adapted for communicating with a suitably equipped
CA 02492091 2005-06-02
-19hearing aid through a wireless link. Further details about suitable programming devices may be found in WO 90/08448 and in WO 94/22276.
The transfer function of the signal processor 53 of the hearing aid 22 is adapted to enhance speech intelligibility by utilizing the method according to the invention, and further comprises means for communicating the resulting SII value via the link cable 55 to the fitting box 56 for displaying by the display means 57.
The fitting box 56 is able to force a readout of the SII value from the hearing aid 22 on the display means 57 by transmitting appropriate control signals to the hearing aid signal processor 53 via the link cable 55. These control signals instruct the hearing aid signal processor 53 to deliver the calculated SII value to the fitting box 56 via the same link cable 55.
Such a readout of the SII value in a particular sound environment may be of great help to the fitting person and the hearing aid user, as the SII value gives an objective indication of the speech intelligibility experienced by the user of the hearing aid, and appropriate adjustments thus can be made to the operation of the hearing aid processor. It may also be of use by the fitting person by providing clues to whether a bad intelligibility of speech is due to a poor fitting of the hearing aid or may be due to some other cause.
Under most circumstances, the SI I as a function of the transfer function of a sound transmission system has a relatively nice, smooth shape without sharp dips or peaks. If this is assumed to always be the case, a variant of an optimization routine, known as the steepest gradient method, can be used.
If the speech spectrum is split into a number of different frequency bands, for instance by using a set of suitable band pass filters, the frequency bands can be treated independently of each other, and the amplification gain for each frequency band can be adjusted to maximize the SII for that particular frequency band. This makes it possible to take the varying importance of the different speech spectrum frequency bands according to the ANSI standard into account.
In another embodiment, the fitting box incorporates data processing means for receiving a sound input signal from the hearing aid, providing an estimate of the sound environment based on the sound input signal, determining an estimate of the speech intelligibility according to the sound environment estimate and to the
CA 02492091 2005-06-02 transfer function of the hearing aid processor, adapting the transfer function in order to enhance the speech intelligibility estimate, and transmitting data about the modified transfer function to the hearing aid in order to modify the hearing aid programme.
-20The general principles for iterative calculation of the optimal Sil is described in the following. Given a sound transmission system with a known transfer function, an initial value gjk), where k is the iterative optimization step, can be set for each frequency band i in the transfer function.
An initial gain increment, AG, is selected, and the gain value g, is changed by an amount ±AG, for each frequency band. The resulting change in Sil is then determined, and the gain value g<sub>(</sub> for the frequency band i is changed accordingly if Sil is increased by the process in the frequency band in question. This is done independently in all bands. The gain increment AGj is then decreased by multiplying the initial value with a factor 1/d, where d is a positive number larger than 1. If a change in gain in a particular frequency band does not result in any further significant increase in Sil for that frequency band, or if k iterations has been performed without any increase in SI I, the gain value g, for that particular frequency band is left unaltered by the routine.
The iterative optimization routine can be expressed as:
<img file="CA2492091C_D0001.tif" />
Thus, the change in gj is determined by the sign of the gradient only, as opposed to the standard steepest-gradient optimization algorithm. The gain increment AG, may be predefined as expressed in:
(10) AG<sub>SJ)</sub>(k)= max(t,roundfc ·k = 1,2,3...
rather than being determined by the gradient. This saves computation time.
This step size rule and the choice of the best suitable parameters S and D are the result of developing a fast converging iterative search algorithm with a low computational load.
CA 02492091 2005-06-02
-21A possible criterion for convergence of the iterative algorithm is:
<td> (11)</td><td colspan="2"></td>
<td> (12)</td><td></td><td> ,(i-2]<£ and,</td>
<td> (13)</td><td> k^5-k^·</td><td></td>
Thus, the Sil determined by alternatingly closing in on the value SIl<sub>max </sub>between two adjacent gain vectors has to be closer to SI l<sub>max</sub> than a fixed minimum ε, and the iteration is stopped after k<sub>max</sub> steps, even if no optimal Sil value has been found.
This is only an example. The invention covers many other implementations where speech intelligibility is enhanced in real time.
Contents26
7 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7
20 members in 10 offices
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 0200492 | Denmark | W | |
| 0200492 | Denmark | W | |
| PCTDK02000492 | – | – | – |
| WO2002DK00492 | – | – | – |
Members20
| Document | Office | Kind | |
|---|---|---|---|
| CA2492091A1 | Canada | A1 | |
| WO2004008801A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU2002368073A1 | Australia | A1 | |
| EP1522206A1 | European Patent Office (EPO) | A1 | |
| US2005141737A1 | United States of America | A1 | |
| CN1640191A | China | A | |
| JP2005537702A | Japan | A | |
| AU2002368073B2 | Australia | B2 | |
| EP1522206B1 | European Patent Office (EPO) | B1 | |
| AT375072T | Austria | T | |
| ATE375072T1 | Austria | T1 | |
| DK1522206T3 | Denmark | T3 | |
| DE60222813D1 | Germany | D1 | |
| DE60222813T2 | Germany | T2 | |
| CA2492091CThis record | Canada | C | |
| US7599507B2 | United States of America | B2 | |
| US2009304215A1 | United States of America | A1 | |
| JP4694835B2 | Japan | B2 | |
| CN1640191B | China | B | |
| US8107657B2 | United States of America | B2 |
2 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| LapsedLapsedMKLA | MKLA | |
| Examination requestEEER | EEER |
Numbers
- Publication
- 2492091
- Publication, DOCDB
- 2492091
- Publication, EPODOC
- CA2492091
- Application
- 2492091
- Application, DOCDB
- 2492091
- Application, EPODOC
- CA20022492091
Titles2
- English
- HEARING AID AND A METHOD FOR ENHANCING SPEECH INTELLIGIBILITY
- French
- AIDE AUDITIVE ET PROCEDE POUR AMELIORER L'INTELLIGIBILITE D'UN DISCOURS
Classification
- CPC, 8
- G10L21/0208
- G10L21/0232
- G10L2021/065
- H04R25/356
- H04R25/505
- H04R25/70
- H04R2225/43
- G10L21/0364
- IPC, 5
- H04R25 00
- G10L21 02
- G10L21 0208
- G10L21 0232
- G10L21 06