Method and apparatus for determining filter coefficients in a decision-feedback equalizer

BACKGROUND

Field

[1001] The present invention relates generally to equalization of a received signal, and more specifically to hybrid decision feedback equalization.

Background

[1002] The transmission of digital information typically employs a modulator that maps digital information into analog waveforms. The mapping is generally performed on blocks of bits contained in the information sequence to be transmitted. The waveforms may differ in amplitude, phase, frequency or a combination thereof. The information is then transmitted as the corresponding waveform. The process of mapping from the digital domain to the analog domain is referred to as modulation.

[1003] In a wireless communication system, the modulated signal is transmitted over a radio channel. A receiver then demodulates the received signal to extract the original digital information sequence. At the receiver, the transmitted signal is subject to linear distortions introduced by the channel, as well as external additive noise and interference. The characteristics of the channel are generally time varying and are therefore not known a priori to the receiver. Receivers compensate for the distortion and interference introduced by the channel in a variety of ways. One method of compensating for distortion and reducing interference in the received signal employs an equalizer.

Equalization generally encompasses methods used to reduce distortion effects in a communication channel. From the received signal, an equalizer generates estimates of the original digital information.

[1004] Current equalization methods are based on assumptions regarding the received signal. Such assumptions are generally not correct over a variety of coding, modulation and transmission scenarios, and, therefore, these equalizers do not perform well under many conditions. Additionally, current equalizers employing decision feedback often suffer from error propagation effects that amplify the effect of isolated decision errors. Additionally, the decision feedback process involves hard decisions regarding each symbol and does not consider the likelihood that a symbol decision is correct.

[1005] There is, therefore, a need in the art for an equalization method that reduces linear distortion in a received signal over a variety of operating conditions. Still further, there is a need to reduce error propagation in a decision feedback equalizer. Additionally, there is a need to provide a likelihood measure to the decision feedback process.

BRIEF DESCRIPTION OF THE DRAWINGS

[1006] FIG. 1A is a block diagram of components in a communication system.

[1007] FIG. 1B is a detailed portion of the communication system as in FIG.

1A.

[1008] FIG. 2 is a conceptual model of a decision-feedback equalizer within a communication system.

[1009] FIG. 3 is a block diagram of a decision-feedback equalizer as in FIG.

2.

[1010] FIG. 4 is a mathematical model of a symbol level slicer.

[1011] FIG. 5 is an algorithm for optimizing filter coefficients in a decision feedback equalizer.

[1012] FIG. 6 is a Least Mean Square adaptive filtering algorithm for optimizing filter coefficients in a decision feedback equalizer.

[1013] FIG. 7 is a Least Mean Square adaptive filtering algorithm for optimizing filter coefficients in a decision feedback equalizer for a system employing a periodic burst pilot.

[1014] FIG. 8A is a constellation mapping for 8-Phase Shift Keying (PSK).

[1015] FIG. 8B illustrates grid regions used for soft slicer decisions as overlaid on the constellation mapping of FIG. SB.

[1016] FIG. 9A is a constellation mapping for a Binary Phase Shift Keying (BPSK) or 2-PSK case.

[1017] FIG. 9B illustrates grid regions used for soft slicer decisions as overlaid on the constellation mapping of FIG. 9A.

[1018] FIG. 10 is a decision-feedback equalizer implementing a “soft slicing” decision process.

[1019] FIG. 11 is a process for a “soft slicing” decision process.

[1020] FIG. 12 is a process for a “soft slicing” decision process applying a Taylor series computation.

[1021] FIG. 13 is a block diagram □f a “soft slicer.”

[1022] FIG. 14 is a block diagram of a “soft slicer” applying a Taylor series computation.

DETAILED DESCRIPTION

[1023] The word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[1024] FIG. 1A illustrates a portion of the components of a communication system 100. Other blocks and modules may be incorporated into a communication system in addition to those blocks illustrated. Bits produced by a source (not shown) are framed, encoded, and then mapped to symbols in a signaling constellation. The sequence of binary digits provided by the source is referred to as the information sequence. The information sequence is encoded by encoder 102 which outputs a bit sequence. The output of encoder 102 is provided to mapping unit 104, which serves as the interface to the

PCTAJS2003/022594 communication channel. The mapping unit 104 maps the encoder output sequence into symbols y(n) in a complex valued signaling constellation. Further transmit processing, including modulation blocks, as well as the communication channel and analog receiver processing, are modeled by section 120.

[1025] FIG. IB illustrates some of the details included within section 120 of FIG. 1A. As illustrated in FIG. IB, the complex symbols y(n) are modulated onto an analog signal pulse, and the resulting complex baseband waveform is sinuosoidally modulated onto the in-phase and quadrature-phase branches of a carrier signal. The resulting analog signal is transmitted by an RF antenna (not shown) over a communication channel. A variety of modulation schemes may be implemented in this manner, such as M-ary Phase Shift Keying (M-PSK), 2Mary Quadrature Amplitude Modulation (2M QAM), etc.

025 ה] . Each modulation scheme has an associated “signaling constellation” that maps one or more bits to a unique complex symbol. For example, in 4-PSK modulation, two encoded bits are mapped into one of four possible complex values {1,i ,-1,-i}. Hence each complex symbol y(n) can take on four possible values. In general for M-PSK, log2M encoded bits are mapped to one of M possible complex values lying on the complex unit circle.

[1027] Continuing with FIG. 1A, at the receiver, the analog waveform is downconverted, filtered and sampled, such as at a suitable multiple of the Nyquist rate. The resulting samples x(n) are processed by the equalizer 110 which corrects for signal distortions and other noise and interference introduced by the channel, as modeled by section 120. The equalizer 110 outputs estimates of the transmitted symbols y(n). The symbol estimates are then processed by a decoder to determine the original information bits, i.e., the source bits that are the input to encoder 102.

[1028] The combination of a pulse-filter, an l-Q modulator, the channel, and an analog processor in the receiver's front-end, illustrated in FIG. 1A and FIG.

1B, is modeled by a linear filter 106 having an impulse .response {h$ and a ztransform H(z), wherein the interference and noise introduced by the channel are modeled as Additive White Gaussian Noise (AWGN).

[1029] FIG. IB details processing section 120 as including a front end processing unit 122 coupled to baseband filters 126 and 128 for processing the In-phase (Ί)

and Quadrature (Q) components, respectively. Each baseband filter 126, 12S is then coupled to a multiplier 130 and 132, respectively, for multiplication with a :respective carrier. The resultant waveforms are then summed at summing node 134 and transmitted over the communication channel to the receiver. At the receiver, an analog pre-processing unit 142 receives the transmitted signal, which is processed and passed to a matched filter 144. The output of the matched filter . 144 is then provided to an AnalogZDigital (A/D) converter 146. Note that other . modules may be implemented according to design and operational criteria. The components and elements of FIGS. 1A and IB are provided for an understanding of the following discussion and are not intended to be a complete description of a communication system.־

[1030] As discussed hereinabove, the sequence of symbols transmitted are identified as ty(n)}. For the present discussion, assume the symbols (y(n)} are normalized to have mean unit energy, i.e., E|yn|2 =1. If the channel output . were filtered and sampled at the symbol rate (which may or may not be the Nyquist rate), the channel output is given as:

^=Σ^״-ι0) ^+־) k

where η״ is white Gaussian noise with variance {EJN^. The equalizer is usually implemented as a linear filter with coefficients {f!J and defined by a ztransform F(z). Let yn denote the equalizer’s output, wherein χ, is given as:

(1) + ־־׳(& = _k>0 JtX) (2) wherein G(z) = F(z)if(z)and

7'״=ΣΛ7η-ί. (2a) k

Note that the second term within square brackets, [״.], of Equ. (2) represents the Inter-Symbol Interference (IS!) and noise. The first term of Equ. (2) corresponds to the interference associated with past symbols, while the second term corresponds to the interference associated with future symbols. The first term is often referred to as ’causal ISI, whereas the second term is often referred to as anti-causal ISI. If the designer assumes the past symbols are detected correctly, the causal ISI term may be removed. In an ideal case, if the equalizer has knowledge of the constellation symbols y״^,y2_״,K, i.e., constellation symbols transmitted prior to time n, when determining the estimate y״, the equalizer can remove part of the inter-symbol interference by subtracting the first term of [.] of Equ. (2). In practical systems, however, the equalizer only has knowledge of the symbol estimates previously generated, such as v ., .y ,,K . If the interference and noise are small enough, it is reasonable to expect that symbol decisions on the estimate y״ will yield the original transmitted constellation symbol . A device making such symbol decisions is referred to as a slicer and its operation is denoted by σ(.). The receiver could then form an estimate of the causal ISI using the sequence of symbol decisions from the slicer, and subtract this estimate from the equalizer's output to yield:

Λ = Σ A-v* ־ Σ ) (2b) k fo-0 = Σ^Ο׳ (2c) λ>0 (3) assuming a(yw)־־ y^. This is the key principle of Decision Feedback Equalization wherein causal ISI is removed by causally filtering symbol decisions made by a symbol level slicer operating on the equalizer's output.

[1031] FIG. 3 illustrates a communication system 350 employing a Decision Feedback Equalizer (DFE) 340. The communication system 350 is modeled as having an equivalent linear channel 352, which filters the sequence of symbols yB. Noise and interference, yr, is added at summing node 354, and the output, xn, denotes the signal samples as received after front-end processing and sampling at the receiver. The DFE 340 processes xn, and filters xn to generate the estimate y״. The DFE 340 is modeled as having a linear feedforward filter 356 and a linear feedback filter 358. The feedforward filter 356 has tap

WO 20(14/(00665 coefficients designated as {f!J and implements the z-transform F(z). The DFE 340 also includes a purely causal feedback filter 358 coupled to a slicer 360 forming a feedback loop generating an estimate of causal ISI. In other words, the feedback filter 358 removes that part of the ISI from the present symbol estimate caused by previously detected symbols. The causal ISI estimate from the feedback filter 358 is provided to a summing node 308 which subtracts the causal ISI estimate from the output of the feedforward filter 356. The resultant output of the summing node 308 is the equalizer output j״׳. The equalizer output is also an estimate of the transmitted symbol yn and is provided to decoder 364 for determining the original information sequence.

[1032] The slicer 360 processes the equalizer output from the summing node 308 and in response makes a decision as to the original symbol yn- The output of the slicer 360 is then provided to the purely causal feedback filter 358. The feedforward filter 356 is also referred to herein as a Feed Forward Filter (FFF). The feedback filter 358 is also referred to herein as a Feed Back Filter (FBF). In a DFE, optimization of the filter coefficients, both feedforward filter 356 and feedback filter 358, directly affects performance of the equalizer. The device which performs this optimization is designed as Coefficient Optimizer 362 in FIG. 3. There are a variety of methods available for optimizing the filter coefficients. Traditionally, the FFF and FBF coefficients are optimized under the implicit assumption that the slicer's symbol decisions are perfectly reliable and that causal ISI, i.e״ the interference from past symbols, is removed perfectly by the FBF. Under this assumption, the FFF coefficients are optimized such that the residual interference and noise term in Equ. (3) is small. More precisely, the z-transform of the FFF, F(z), is optimized so that in Equ. (3) is close to y״ in a mean-square sense.

[1033] In practice, the FFF and FBF are often implemented by Finite Impulse Response (FIR) filters and during an initial training/preamble/adaptation period, the FFF anc! pbF are ״trained on pilot symbols by assuming perfect slicer performance, i.e., σ(γ״׳3 = (״ This is accomplished by by-passing the slicer and feeding back locally generated (and hence correct) pilot symbols, rather than sliced (hence possibly erroneous) pilot symbol decisions, into the FBF. A variety of algorithms may be implemented for filter coefficient optimization during the training period, including adaptive algorithms such as Least Mean Square (LMS), Recursive Least Squares (RLS), direct matrix inversion, as well as others. Once the training period is completed, the slicer 360 is engaged and the sliced data symbols are fed back through the FBF. (

[1034] Conventional DFE optimization algorithms introduce a variety of potential problems. For systems employing strong coding, the slicer decisions often have a large Symbol Error Rate (SER). For example, an SER of 25% or more is not uncommon for a system employing a medium size constellation, such as 16-QAM, and a low rate turbo code, such as rate of 1/3, when operating at the 1% packet error rate point. On the other hand, the DFE“s FFF and FBF coefficients are conventionally optimized under the incorrect assumption that the slicer's decisions are perfectly reliable.

[1035] Additionally, the FFF and FBF coefficients are optimized assuming the causal ISI is perfectly removed. As a result, the anti-causal ISI is reduced at the expense of greater causal ISI, Conventional DFE optimization algorithms, in terms of the equations provided herein (specifically, Equs. (1)--(3)), lead to gk values which tend to be large for k > 0, but small for k < 0. When the slicer SER is not negligible, however, erroneous symbol decisions infect the FBF and are thereafter subtracted incorrectly. When the gk values for fc>0 are large, the residual interference is thus amplified, possibly resulting in further slicer errors on subsequent symbols. This phenomenon is called error propagation.

[1036] Attempts to mitigate error propagation include feeding back sliced pilot symbols during training, as opposed to training the FFF and FBF by feeding back locally generated (hence correct) pilot samples. The sliced pilot symbols are occasionally in error, forcing the FFF and FBF to adjust accordingly. This method is not without problems. The sliced pilot symbols and sliced data symbols may incur very different error rates as the pilot symbols are typically transmitted via BPSK, i.e., 2-PSK, (or another smaller constellation) but the data symbols are typically transmitted via a larger constellation. As a result, the SER of the pilot symbols and data symbols might be quite different. In this case, as the FFF and FBF coefficients are optimized based on the sliced pilot symbols, the effect of those coefficients in processing the data symbols results in suboptimal performance.

[1037] These problems are resolved by optimizing the FFF and FBF coefficients to account for errors caused by the slicer 350 of FIG. 3. In other words, the Coefficient Optimizer 362 is modified to recognize that the causal IS! may not be removed perfectly due to slicer errors. This approach differs from prior methods which Implicitly assume the slicer is error-free and, therefore, that causal ISI is perfectly removed.

[1038] The .theory behind one embodiment is to model the slicer operation by an independent, identically distributed (i.i.d.) channel, labeled 2(y]y). The channel is :assumed independent of the noise process designated as {77&amp;#1524;} in Equ. (0), and the transmitted symbol sequence designated as {yn}. This channel is completely characterized by its conditional density where y and y denote the slicer's output and the actual transmitted symbol, respectively. Assume such a channel is the cause of symbol errors in the FBF. In practice, &amp;#1470;symbol. errors occur in bursts, because a slicer error &amp;#9633;n the current symbol implies following symbols may have an increased probability of being sliced incorrectly. In the simplified slicer mode! considered herein, the slicer errors are assumed i.i.d.

[1039] FIG. 2 illustrates a conceptual model 300 of a communication system with a decision feedback equalizer. Symbols transmitted, via the communication channel 302 modeled by transfer function H(z) are corrupted by additive noise at summing node 304. The resulting signal is filtered by FFF 306. An estimate of the original transmitted symbol is generated by subtracting an error term at summing node 308. The estimate of the original transmitted symbol is available for decoder 316. The error term is generated by a causal Feedback Filter 310, with transfer function B(z), which filters the outputs of channel Q(y |y) 314. The error term generated by Feedback Filter 310 represents an estimate of the causal ISI present in the output of FFF 306. The channel£2 1&amp;#1523;(y|y) mimics the statistical behavior of slicer 360 in FIG. 3, i.e., the statistical relationship between the input and output of channel 314 is identical to the statistical relationship between the transmitted symbol yn and the corresponding output yn ~ a(yn) of slicer 360. The coefficient optimizer 320 is responsible for optimizing the filter coefficients for the FFF 306 and the FBF 310. Note that the main difference between FIG. 3 and FIG. 2 is the replacement of the slicer 360 with the conceptual model of channel Q(y | y) 314.

[1040] As mentioned hereinabove, the slicer is modeled in FIG. 2 by selecting ,'channel2 &amp;#1524;(y[y) so as to model the statistical behavior of an actual slicer while ignoring the statistical dependence in time of slicer errors. As the actual slicer operates on the output of the equalizer, it follows that the relevant marginal statistics involve residual interference. LetSINR represent the Signalto-lnterference-and-Noise ratio at the output of the equalizer, i.e., at the output of summing node 308 in FIG. 2, Assume the residual interference and noise at -.the equalizer output may be modeled as a zero-mean complex Gaussian random variable Z with independent real and imaginary parts, each with variance rr2, wherein:

σ2 =—-—.(6)

2(SINK)

The marginal statistics are given by the equivalent channel 2(5&amp;#1523;jl)&amp;#1470; wherein: 2(y|y)=PrKy+z)=jf},(7) wherein σ() denotes a minimum distance slicing function given as:

0&amp;#1470;(y) = arg 11™Jy-yf( yeT and Z in Equ. (7) is the zero-mean complex Gaussian random variable, modeling residual interference with properties described hereinabove. FIG. 4 illustrates the channel 2(5&amp;#1523; IT) modeled according to the assumptions and Equations provided hereinabove. Specifically, the mathematical description of 2(5&amp;#1523; j y) 314 in FIG. 2 is illustrated as system 380. The input to the slicer 384 is denoted by y and is modeled as the transmitted symbol y, corrupted by additive noise and interference. The noise and interference is modeled by complex Gaussian random variable Z. The slicer 384 implements a minimum ‘t distance slicing function as described in Equ. (8), resulting in slicer output marked y. The joint statistics connecting y and y constitute the full mathematical description of the model for channel Q(y ] y). The construction of the channel Q(y | y) illustrated in FIG. 4 is novel and differs from prior methods in that the noise Z may have a non-zero variance. Prior methods implicitly assume Z is identically equal to zero. Thus, this model for the slicer is assumed to make decision errors, in contrast to prior methods that assume the slicer is error-free.

[1041] Returning to FIG. 2, let fyand bQ denote the FFF and FBF coefficients selected so as to minimize the mean square error between the transmitted symbol yn (the input of channel 302) and the symbol estimate yn (the output of summing node 308). In other words, the coefficients fQ and bQ are Wiener MMSE optimal. For reasons that will be made clear herein below, these coefficients are referred to as Wiener Hybrid DFE coefficients. The coefficients fQ and bQ may be determined by a standard Wiener-Hopf optimization and are defined by the following equation:

/β _ R-F _ .Pq'R’F.S

Pf (4) wherein RF denotes the covariance of the contents of the FFF, Rs denotes the covariance of the contents of the FBF, RFB denotes the cross-covariance of the contents of the FFF and the FBF, and pF denotes the cross-covariance between the contents of the FFF and the transmitted symbol. These covariances and cross-covariances depend on the linear channel 302 described by H(z). Assuming the symbols in F, i.e., the transmit constellation, are used with equal probability, then pQ is defined as:

Λ2 = ti ΣΣ !5)[&amp;#1500;&amp;#1497;&amp;#1490;) wherein /// denotes the cardinality of Y, i.e., the number of possible symbols in the transmit constellation. Thus, for a given Q(y | y) and channel with ztransform H(z), the MMSE coefficients fa and beare determined by application of Equ. (4) and Equ. (5).

[1042] Recall that Q(y | y) was defined according to Equ. (6) and Equ. (7) by hypothesizing a value of SINR at the equalizer output. Application of Equ. (4) and Equ. (5) then lead to MMSE coefficients^ and bB. When these values for the FFF and FBF coefficients are used in the FFF 306 and FBF 310 in FIG. 2,

WO 20(14/010665 the resulting SINR at the equalizer output may be different from the SINR value originally hypothesized. So the hypothesized SINR value may or may not be consistent. However, a consistent SINR value, and hence a consistent set of MMSE coefficients fQ and bQ, can be found by iterating, i.e., by using the newly found SINR value to define a new channel Q(y | y), finding a new set of corresponding MMSE coefficients, etc. This iterative process may be represented schematically as follows:

(M)&#1524; -> (f0,bD)-> (SINK? ->

In particular an Iterative algorithm may be used for computing the Weiner Hybrid DFE. The algorithm of the present embodiment is illustrated in FIG. 5. The process 400 begins by setting n = 0 at step 402 and selecting SflVR0 arbitrarily. The process continues by determining SINR and computing piSINR') by applying Equs. (5), (6), and (7) at step 404. The filter coefficients fn,b&amp;#1524; are computed at step 406 by using Equ. (4). According to the present embodiment, the process computes SINR~‘ = SINR(Jn,bn,SINR’)a‘t step 408. Note that ,x) denotes the SINR at the output of the equalizer with FFF coefficients f, and FBF coefficients b, and a slicer channel Q(.|.) with SINR x. The slicer channel is defined by Equ. (6) and Equ. (7). if the process converges at decision diamond 410, processing continues to step 412 to set the filter coefficients. If the process has not converged, processing returns to step 404.

[1043] Note that as described in the iterative algorithm of FIG. 5, the value of SINR0 may be chosen arbitrarily. The two extremes, SINR0 =0, SINR0 =®, correspond to starting with a totally unreliable slicer or a perfect slicer, respectively.

[1044] Note that p represents the correlation between the slicer's output and the actual transmitted symbol, and as such, p is a function of the equalizer's output SINR. If the equalizer's output is very noisy, the correlation is small. In this case, the slicer's symbol decisions are largely unreliable and an accurate estimate of the causal ISI is not possible. As expected, in this case, the algorithm of FIG, 5 converges to FFF and FBF coefficients which closely resemble those of a Linear Equalizer, i.e., one where the FBF coefficients are

WO 201)4/010665

constrained to be zero. On the other hand, when the equalizer's output is nearly noiseless, the slicer's correlation p tends to be close to one. In this case, the algorithm of FIG. 5 converges to FFF and FBF coefficients which closely resemble those of an “ideal DFE, i.e., a DFE with a perfectly reliable slicer. In between these extremes, the algorithm of FIG. 5 converges to FFF and FBF coefficients which are a hybrid of .these two limiting extremes. This hybridization is accomplished automatically by the iterative algorithm. For this reason, the FFF and FBF coefficients so obtained are referred to as Hybrid DFE coefficients.

[1045] The embodiment(s) described heretofore require explicit knowledge of the channel H(z) in order to construct the various covariances and crosscovariances of Equ. (4), The Wiener Hybrid FFF and FBF coefficients are then determined by solving Equ. (4) for /β,&amp;#941;β. In practice, however, H(z) is typically not known at the receiver, so an alternate method for determining the Wiener Hybrid DFE coefficients for the FFF and FBF is desirable. An alternate embodiment, referred to as the Adaptive Hybrid DFE, does not require explicit knowledge of the channel H(z). First, define the Mean Squared Error (MSE) as:

Μ5Ε = φη-γ9) 2|&amp;#1524;) = E|yn-ifiX&amp;#1524;-i&amp;#1523;s(Z&amp;#1524;+A2|(&amp;#1524; wherein Xn are the contents of the FFF at time n, Zn are the FBF contents assuming error-free feedback, and A&amp;#1524;are feedback symbol errors introduced by the channel &lt;2(j&amp;#1523;|y) As the errors introduced by g(y|y) are assumed i.i.d. and independent, Equ. (9) may be written as:

MSE &#1470; ψ,-f'X. -b4)£&#1524;,X)b (9a) = E|y,-f*X.-b‘&#1523;Z.|&#1470;+|b|&#1470;E0|5&#1470;>i|&#1470; where Εβ denotes “expectation” with respect to g(y|y). Using the fact that the transmit constellation is normalized to unit energy and the definition of ρβ in Equ. (5), results in:

~ 1 + λβ - - 2pe (9b) where

1&amp;#1503;7&amp;#1494; &amp;#1470;

I 2 I y&amp; yer

Combining Equ. (9b) with Equ. (9a) results in:

MS£=£|y&amp;#1524;-f&amp;#1524;X&amp;#1524;-bJ,Z2|&amp;#1524;+(l+4zpG)||b||2 (9c)

Note that ||b||2 appearing in Equ. (9c) maj&amp;#1523; be interpreted as the energy in the FBF coefficients. Equ. (9c) is the starting point for deriving a variety of adaptive algorithms. For example, to derive an adaptive algorithm based on the Recursive Least-Squares (RLS) method, a new cost function is defined by replacing the statistical . expectation with a sample mean over, for example, n = 1,., N . Standard techniques are then applied to derive a recursive optimizer of this cost function. One embodiment implements.a RLS optimizer of a cost function defined as follows:

(9d) wherein:

¾= (9e)

Note that clq may be referred to as a “modified measure of energy of the feedback filter coefficients” or an “error correction term.” The RLS optimization may be performed on the pilot symbols present in the transmission.

Least Mean Square Algorithm: Another embodiment which optimizes Equ. (9c) is based on the Least Mean Square (LMS) algorithm. The Least Mean Square (LMS) algorithm recursively adjusts the FEF and FBF coefficients of the Hybrid DFE so as to minimize the MSE defined in Equ. (9c). For a fixed channel 0(y|y), a Least Mean Squares (LMS) algorithm updates are given as:

(10a) (10b) wherein MSE is defined m Equ. (9c), μ is the LNiS step-size and Γ denotes dropping the statistical expectation in the definition of Eqn. (9c), Calculating the partial derivatives results in:

+/«.&lt;;

bj+;=(M<2&#1470;A> +^ZX;

= (1-^αβΚ+ΑΖ12)>&#1524; e =y -f&#1524;X -bhZ .( £1046] When the value of μ is chosen suitably small, the sequence of iterations defined by Equ. (11) through Equ. (13) is stable and converges to the set of coefficients which solve Equ. (4). Notice that this sequence of iterations does not require explicitly estimating the covariances and cross-covariances in

Equ. (4).

[1047] FIG. 6 illustrates an LMS algorithm according to one embodiment. The algorithm 500 starts with selection of an initial SINK0 value at step 502. Additionally, the index k is initialized as k=0. At step 504, the value of SINR/ is estimated and p(SJNRk) is calculated or determined from a pre-calculated LookUp Table (LUT). Equ. (11) through Equ. (13) given hereinabove are calculated iteratively, based on the pilot symbols in the transmission, until a convergence criteria is met at step 510&amp;#1470;. Hie result of such iteration determines the values for (fA.,bt). At step 508 the process estimates SINRk+1, which is the SINR at the equalizer output when the FEE and FBF coefficients are (ft.b;). The estimation may be done using the pilot symbols in the transmission. The process then increments the index k. On convergence of SINR1&amp;#1470; at decision diamond 510, the process continues to step 512 to apply the filter coefficients. Else, processing returns to step 504.

[1048] Algorithm with Periodic Pilot Bursts: According to another embodiment, a communication system incorporates periodically transmitted pilot bursts which are used by receivers to adjust the filter coefficients in the receivers’ equalizer. Such adjustment is often referred to as training the equalizer. An example of such a system is a system supporting High Data Rate (HDR) as defined in “IWEIA-IS-856 CDMA2000 High Rate Packet Data Air Interface Specification” (the IS-856 standard). In an HDR system, 96 pilot symbols are

TCT/US2003/022594 .

transmitted every 0.833ms. Each group of .96 pilot symbols is referred to as a pilot burst. In between pilot bursts, the HDR system transmits data symbols intended for receivers. FIG. 7 illustrates an algorithm for applying an LMS-based hybrid DFE in such a system. The algorithm 600 initially sets up SINR0 as equal to 0 or 00 at step 602. The initial choice of SINR is not designated and may not be critical, though for the fastest convergence, SINR0 equal to 00 may be preferred. The index k is also initialized and set equal to 0. At step 604 the . algorithm determines SINR?, and computes p(STNllk) or determines the necessary ' value by consulting a pre-calculated Look-Up Table. The initial values for/and b are set as/0=0 Z>0-0 at step 606. During the (k+l)-th pilot burst, the process iterates Equations (11) through (13) for all chips of the pilot burst, step 608. In the present HDR example, the algorithm 600 iterates for 96 chips of the pilot burst and the final values of/and b are saved. At step 610 the process estimates SINRk+1, using the 96 chips of the preceding pilot burst. During the data portion following the (k+1) pilot burst, the saved values of/and b are loaded into the FFF and the FBF and the data symbols are equalized in standard decision-feedback fashion (step 612). At step 614 the process computes the value of p(S!NRk) and increments k. The process continues to implement the algorithm during demodulation operations.

[1050] The algorithm of FIG. 7 is adaptive for. slowly time-varying channels, as quasi steady state SINR1, and therefore, p(SINRk) are not expected to vary much over the convergence time of the LMS algorithm.

Soft Slicer: As discussed hereinabove, error propagation significantly limits the use of DFEs in communication systems employing channel coding. Because the causal ISI is cancelled by feeding back decisions on individual symbols, a single isolated decision error may lead to a burst of subsequent decision errors, greatly enhancing the residual interference at the equalizer’s output. If the channel code is strong, the probability of a symbol decision error is non-negligible (typically on the order of 25 percent) and error propagation may have serious effects on the performance of the DFE. One method of avoiding the effects incurred by such error propagation is to recognize that the usual minimum distance slicer attaches no confidence-level to symbol decisions. In other words, conventional slicer decisions provide no measure of the accuracy or correctness of symbol decisions.

PC17US2003/022594

If a decision were known to be of questionable accuracy, it might be better to avoid canceling that symbol's contribution to the post-cursor tail, rather than risk compounding the residual interference by subtracting an incorrect decision. -In other words, symbol decisions of low accuracy should not be included in the feedback loop canceling causal ISI.

[1051]. One embodiment of a slicer that incorporates a confidence-level into the decision process will be referred to herein as a soft slicer.” One soft slicer is described by a mathematical model as explained hereinbelow. First, assume the input symbol to the slicer is given as:

y = y + n (14) where y is the transmitted symbol belonging to the constellation and &amp;#1514; consists of residual , noise and intersymbol interference. Assume that y is uniformly distributed over Fso that all constellation points are transmitted with equal probability. Let L(y,y) be a loss function measuring the loss incurred when a slicer decides y when the transmitted symbol is y. An optimum slicer σ-y^y, wherein '1optimum refers to a slicer which minimizes Expected loss, is given by Bayes Rule;

&lt;r(f) = arg E&amp;,y) |f} (15) ye τ

For the Minimum Error Probability (MEP) loss function given as:

<td> Uy,y)=</td><td> ly*y</td><td> (16)</td>

<td colspan="2"> the expected loss results in:</td><td></td>

<td> ^(F,y)</td><td> |f}=Pr^y|fj</td><td> (17)</td>

<td></td><td> =1-Pr^ = y|fj</td><td></td>

<td> and therefore:</td><td></td><td></td>

<td> σ(Υ) = arj</td><td> max Γ j/I</td><td> (18)</td>

Additionally, assuming the interference n is a Gaussian random variable with zero mean and variance σ2&amp;#1470;, then:

a min !&amp;#1503;a 2&amp;#1503;&amp;#1503; ¢7(7) = arg ~ WF19) &amp;#1523;3&amp;#1470;)

3&amp;#1523;£ψ&amp;#1524; II independent of 02&amp;#1470;. This is a traditional “minimum distance” slicer, and although it is Bayes-optimum for the loss function of Equ. (16), the slicer may lead to error propagation for the reasons discussed hereinabove. An alternate slicer design considers the quadratic loss function:

z&amp;#1523;(y,y)=Jy-y|2 (20) which, unlike the MEP loss function, penalizes larger errors more significantly than smaller errors. Following from Equ. (15):

/7) = arg ““ ψ-&lt;|7) (21) y e Ψ 1 = 5{7|7] and the conditional mean equals:

σ(7) = Σ7 ?εψ

<img file="IL202168A_D0001.tif" />

yeT (22)

An important observation is that unlike the slicer of Equ. (19), the slicer of Equ. (22) requires an estimate of the interference and noise variance σ2 (e.q., σ2 =—-—). Note also that the slicer of Equ. (22) corresponds to the k a 2(SINR) centroid of the a posteriori distribution on the constellation symbols, i.e., the centroid of the term in square brackets [.] in Equ. (22). Thus if σζ is large, the assumption of a uniform prior distribution on a symmetric constellation implies a nearly uniform posterior distribution, and hence the centroid is near zero. On the other hand, when ¢72 is small, the posterior distribution has its mass concentrated on the actual transmitted symbol and its neighboring constellation points; the centroid is therefore, close to the transmitted symbol. The slicer in Equ. (22) is thus referred to as a soft slicer”.

[1052] The soft slicer can be used in the adaptive Hybrid DFE with minimum modification. The FFF and FBF coefficients are chosen to optimize the following definition of MSE:

PCTATS2003/022594

M5E = E|y1]-fHXn-bHZn|2 + (l-2pQ+LQ2)||b||2 (23) where pe (2te>

similar to Equ. (5), and 22 is defined as:

^=£&amp;#1470;|f|24) (&amp;#1470;b)

The channel Q(y | y) is defined as:

2(/|)&#1523;) = Ησ(>+ζΜ} ' (25) wherein σ(.) represents the sofi-slicer defined in Eqn. (22) and Z is complex gaussian noise defined in exactly the same way as in Equ. (7). Following an analogous development of the optimization scheme based on the LMS algorithm, we find Equs. (11), (12) and (13) unchanged, except that for the fact that =1+Ζβ2/?ρ is computed based on Equs. (24a), (24b) and the soft-slicer defined in Equ. (25). As before, the leakage factor (l-2/?s +/l2)is SINK dependent and may be determined by a table lookup.

[1054] The computations involved in the soft slicer, namely Equ. (22), may be too complicated for some practical implementations. One embodiment simplifies the slicer design so as to restrict the slicer output to take on at most N values. Equivalently, this amounts to restricting the slicer input to take on at most N values. In other words, the slicer input 7 is quantized to one of N points using a quantizer defined by: Then for k=1,., N, &lt;7(f)is computed as:

σ(Γ) = ^, &amp;#943;&amp;#943;β(Τ) = &amp;#942; (25) wherein:

at=S^|feQ27) .{(;1)1&amp;#1470;)

WO 2(104/010665

[1055] The quantized slicer’s operation can be summarized as: 1) quantize 7 to one of N possible values; and 2) use this value and knowledge of the SINR as indices in a lookup table to determine Y = σ(&amp;#939;). Since the complexity in this design lies in step 1), a further simplification would be to restrict &amp;#942;,.-.Χ to lie on a uniform square grid and then quantize 7 by quantizing its Real and Imaginary parts separately, using a “nearest neighbor” criterion. Such a slicer functionmay be implemented with simple logic, i.e., by first computing the nearest set of neighbors based on Y’s Reai-coordinate, then computing the nearest neighbor in this subset based on Y's Imaginary-coordinate. Additionally, the lookup table may be fairly coarse in SINR, with 1 dB steps sufficient for most implementations. For example, given {crj lookup tables for SlNR=5 dB and SINR=6 dB, the appropriate σ, values for an intermediate SINR value of say, 5.4 dB, may be determined by suitably interpolating between the two LUTs. In other words, the appropriate values at intermediate SINR values may be generated within the slicer device, thus reducing the necessary memory/storage requirements.

[1056] As an illustration of the application of a soft slicer to a Hybrid DFE (HDFE), consider FIGs. 8A and 8B. FIG. BA illustrates an 8-PSK constellation, wherein 8 complex symbols represent the 3 encoded bits mapped for modulation. As illustrated, the circles represent the constellation points used for modulation at the transmitter. The “x” marks indicate the samples as received at the receiver and include noise and interference introduced during transmission. Note that the received samples do not necessarily match the actual constellation symbols. In this case, the receiver decides which constellation symbol was actually sent. Typically, the received points are concentrated around the actual transmitted constellation symbols.

[1057] One method of determining the transmitted symbol from the received samples is to divide the constellation map into pie slices, as illustrated in FIG. 8B. Here the constellation map is divided into 8 slices, 702, 704, 706, 708,710, 712, 714, and 716. The slices are determined, for example, in accordance with a minimum distance metric, which uses the Euclidean distance or separation between two constellation points to select a boundary. A problem exists when the received sample is approximately equidistant (i.e., approximately on the boundary) between two constellation points. In this case, if the decision process were to select the wrong constellation symbol, this error would be propagated in the feedback loop of a DFE. To avoid such errors and the associated amplification in a DFE, a soft slicer is applied that outputs a value not necessarily at a constellation symbol. The soft slicer implicitly determines a confidence level from the received samples. The confidence level provides the system with guidance in evaluating the sample. If the confidence level is low, i.e., an error is likely, the sample is not emphasized in the feedback portion of the equalizer. If the confidence level is high, the sample is considered reliable, and therefore, a suitable symbol estimate derived therefrom may be used in the feedback portion of the equalizer.

[1058] FIG. 9A illustrates a 2-PSK constellation map. Note that decisions made based on the minimum distance from a constellation symbol may result in errors for received samples such as that marked by the “x.” Application of a soft slicer according to one embodiment, divides the constellation map into rectangles as illustrated in FIG. 9B. As plotted, the rectangles, such as rectangle 720, are semi-infinite in the y-direction and not all rectangles encompass constellation symbols. When the slicer's input sample falls within one of the semi-infinite rectangles, a conditional mean value is assigned. Effectively all points within the rectangle are mapped to a common value. This value represents the conditional mean of the transmitted symbol, given the slicer's input sample falls within the rectangle of interest. The mapping of each rectangle to a corresponding conditional mean value is a function &amp;#9633;f the Signal to Interference and Noise Ratio (SINR). For example, a given rectangle may map to σ for SINR at a first level, e.g., SINR = 4dB. The same rectangle may map to σ' for SINR at a second level, e.g., SINR = 5dB. The mapping and associated conditional mean values are stored in lookup tables for easy retrieval. An alternate embodiment calculates the conditional mean value according to a predetermined algorithm. Note that a square or rectangular grid is easily implemented and extensible to more complex constellations.

[1059] FIG. 10 illustrates an Equalizer 800 using a soft slicer. The Equalizer 800 includes an FFF 802 coupled to a summing node 804. The FFF 802 is

ΡΟΤ/&amp;#971;52003/022594 controlled by an adaptive equalization algorithm 808. The adaptive control unit 808 is responsive to an SINR estimation unit 816. In an alternate embodiment, the SINR estimation unit 816 may be implemented as an MSE estimation unit. The SINR estimation unit 816 provides an SINR estimate to a lookup table (LUT) 610. The SINR estimate is used in conjunction with the values stored in LUT 810 to .determine “29'&amp;#1523;β defined according to Equs.

(24a), (24b) and (25). The adaptive equalization algorithm 808 uses the aQ value produced from LUT 810 to update the coefficients of the FFF 802 and the FBF 806, by iterating Ecus. (11), (12) and (13). Recall that Equs. (11), (12) and (13) were based &amp;#9633;n the LMS algorithm and designed to optimize the MSE cost function defined in Equ. (23). In an alternate embodiment, the adaptive equalization algorithm 808 may implement another adaptive filtering algorithm, such as RLS, to optimize the MSE cost function defined in Equ. (23). The FBF 806 outputs an estimate of the causal ISl present in the output of the FFF 802. The FBF806 output is coupled to summing node 804 where it is subtracted from the output of FFF 802. The output of summing node 804, i.e., the estimate of transmitted symbol, is then provided to a decoder 620, fhe SINR/MSE estimation unit 816, and to the soft slicer 812. The soft siicer 812 receives the SINR/MSE estimate from the SINR/MSE estimation unit 816 and generates a further estimate of the transmitted symbol,'and outputs this further symbol estimate for filtering in FBF 806.

[1050] FIG. 11 is a flow chart of a soft slicer process incorporating a soft slicer according to one embodiment. The process first determines a region, such as a grid square or rectangle on the constellation map, corresponding to a quantization of the slicer input sample y, at step 902. A determination is made of the SINR value at step 904. At step 906, the process selects an appropriate mapping as a function of the SINR value. According to one embodiment, separate portions of a memory storage device store separate look up tables. The tables are accessed according to SINR value. At step 908 a conditional mean value is determined from the appropriate mapping and this is the slicer output.

[1061] Another soft slicer embodiment applies a square grid to the constellation map, and uses a Taylor expansion to generate a more accurate conditional mean value. In this embodiment, multiple smaller lookup tables store values corresponding to each SINR value. The process 920 is illustrated in FIG. 12. The region of the soft slicer input y is determined at step 921. At step 922 an SINR value is determined. The SINR value is used to determine appropriate mappings σ&amp;#910; (.) and cr2 (.) at step 924. The region of step 920 is mapped to a value ), wherein i corresponds to the region. A second mapping is then performed at step 926 consistent with the SINR value and the region of step 920 to obtain σ, (y,). A conditional mean value is approximated at step 928 as ¢7] ) + (j) _ y.)(72 (y.). The mappings σ,(.) and σ2(.) are closely related to the zero-th and first derivatives of σ(.) defined in Equ. (22).

[1052] FIG. 13 illustrates a soft slicer 954 according to one embodiment. An SINR estimator 952 receives one or more symbol estimates and outputs an SINR estimate value SINR(n). The SINR(n) may be quantized in an optional quantizer 355, and is provided to memory storage 960, such as a LUT. A symbol estimate corresponding to the soft slicer input is also provided to a quantizer 956, wherein the symbol estimate is quantized and the quantized value is used in conjunction with the SINR estimate to determine a corresponding value stored in the memory storage 960. Note that in one embodiment, the information is stored in rows and columns, wherein the rows correspond to SINR values and the columns correspond to symbol values. Alternate embodiments, however, may store the information in any of a variety of ways, wherein the information is retrievable based on an SINR value and a symbol value. The values stored in the memory storage 960 may be the conditional mean of actual constellation symbol, given the soft slicer input estimate, such as defined in Equs. (22), (26) and. (27). FIG. 14 illustrates a soft slicer 980 according to an alternate embodiment implementing a Taylor series computation. As illustrated, one or more received symbols are provided to an SINR estimator 982 and one symbol estimate, corresponding to the soft slicer input, is also provided directly to the soft slicer 980. Note that the received symbols are corrupted by the transmission channel and therefore are herein also referred to as received “samples.” The SINR estimator 982 provides an SINR estimate SINR(n) to the soft slicer 980. The SINR(n) may be provided to an optional quantizer 986. The SINR(n), quantized or not, is provided to two memory storage units, A 988 and B 990. The soft slicer input symbol estimate is provided to a quantizer 984, the output of which is also provided to the memory storage units A 988 and B 990. The memory storage units A 988 and B 990 store information used to compute the conditional mean values of the actual constellation symbol, given the soft slicer input symbol estimate. Such values may be the zero-th and first derivatives of the conditional mean of the actual constellation symbol, given the soft slicer input symbol estimate, such as given in Equs. (22), (26) and Equ. (27). The SINR(n) value and the quantized symbol value are used to identify the corresponding values in memory storage A 988 and B 990. A summing unit 992 is used to implement the Taylor series computation. The soft slicer input symbol estimate, as well as the quantized value are provided to the summing unit 992. In addition, the values stored in the memory storage units A 988 and B 990 are also provided to summing unit 992. The summing unit 992 uses the inputs to compute an output that is a conditional mean estimate of the actual constellation symbol.While the present invention has been described with respect to a wireless communication system, such a system is provided merely as an example. The concepts described herein are applicable in a variety of communication systems, including, but not limited to wireline communication system, such as implementation in a wireline modem, etc. The present invention is applicable in a high data rate communication system, and allows optimization of resources and capacity in a data communication system by increasing receiver sensitivity and increasing the communication data rate. Those of skill in the art would understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.

[1063] Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

[1064] The various illustrative logical blocks, modules, and circuits described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.

[1065] The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may

PCI/US2003/022594 reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.

[1066] The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[1067] WHAT IS CLAIMED IS: