Modem and method using multidimensional coded modulation.

Description of equivalent WO 8805571 A1

MODEM AND METHOD USING MULTIDIMENSIONAL CODED MODULATION

BACKGROUND

00031. Field of the Invention The present invention relates to transmitting digital data over a band limited channel by using convolutional coding and multidimensional coded modulation.

00042. Background of the Invention

0005U.S. patent 4,077,021 to Csajka et al. used 2-dimensional coding to improve the performance of the modem against Gaussian noise.

0006Although this coding scheme improved the performance of the system against noise, it also doubled the number of points in the signal constellation making the system more susceptible to other impairments. This is mitigated by the use of a multidimensional code, as described in European patent application 85300803.5 to Gallager and U.S. patent

00074,581,601.

0008In a modem using multidimensional coded modulation, to obtain fractional bits per baud, the signal constellation can be divided into inner points and outer points, with one of the uncoded bits indicating for the n 2-dimensional (symbols) whether there are any outer points and at least one uncoded bit to indicate in which of the n bauds the outer point occurs, as shown in the article entitled "Efficient Modulation for Band Limited Channels", G. David Forney et al., IEEE Journal On Selected Areas in Communication, Vol. SAC, 2 September, 1984, pp. 632-645. European patent application 86303165.4 teaches, for a multidimensional coded modulation system, a method wherein the most likely sequence of multidimensional signal points to have been sent is determined from the received signal. In this method, the distance is computed between each received constituent signal (with dimensions fewer than that of the multidimensional constellation) and the nearest constituent signal points in the corresponding constituent subsets. The distance between each received multidimensional signal and the nearest multidimensional signal point in each multidimensional subset is determined based on a combination of distances with respect to constituent subsets corresponding to the multidimensional subset. The most likely sequence is determined based on the distances between each received multidimensional signal and the nearest multidimensional signal point in each multidimensional subset. European patent application 86303165.4, on page 20, second column, first paragraph suggests that an improper number of outer points can be determined from the detected bits and that "Then a modification is made on those four groups to render them together valid". However, no method of accomplishing this "modification" is taught.

SUMMARY OF THE INVENTION

0010A first aspect of the present invention is directed to a method and apparatus having a properly selected convolutional encoder that allows for a branch cost calculator wherein the computational complexity of the branch cost calculations, as described in the Background section, axe reduced considerably so that they can be implemented with the least number of instructions. In particular, this aspect of the present invention makes it unnecessary to determine the branch metric (cost) for each member of a coset and to directly compare all of the branch metrics during each group interval. A convolutional encoder is designed to provide at least one group of at least two of the members of one of the cosets with each of the members of the group having a non-common portion and a common portion. Each of the non-common portions includes at least one non- common component which is different between the at least two members and each of said common portions includes at least one common component which is the same between the at least two members. A branch cost calculator compares at least two non-common portion costs associated with the non-common portions and selects a surviving said non- common portion with a minimum non-common portion cost, whereby the selection of the surviving non-common portion based upon the minimum non-common portion cost determines which of the at least two members has the minimum member costs. Additionally, the present invention makes use of the fact that the encoder provides at least one other group with the same non-common portions and that once the comparison is made and the cost determined for one group, such a determined cost can be used in the other group having the same non-common portions. The utilization of the commonality of components between members combined with the repetition of the non-common portions of one of the groups in at least one other group, first, reduces the computations required to eliminate members within a coset and, second, allows for costs calculated for one group to be used in at least one other group. In the specific embodiments of the present invention shown herein, there are sixteen cosets provided by the encoder with each coset being arranged to have four subcosets having the following characteristics. Each subcoset has two of the groups of members, with each group of members being a pair of the members. The non-common portions of each group define a set, which is repeated in eight other groups. Consequently, the determination of the surviving non-common portion of each set reduces the number of surviving members of all cosets to one-half. Additionally, each subcoset has a group of submembers which includes the non-common portions of both of its pairs of members. Each of the group of submembers is repeated in four cosets of one of four supercosets which means that once the minimum cost submember of each subcoset is determined, this cost can be used for four subcosets.

0011In a second aspect of the present invention, it has been discovered that the comparisons of each branch for the allowable sequence of inner and outer points can be done after the Viterbi decoder, albeit, suboptimally without adverse effects,- which in turn reduces the complexity of the calculations required in the branch cost calculator. This reduces the complexity of computations considerably with very little degradation of performance. BRIEF DESCRIPTION OF THE DRAWINGS

0012Further objects and advantages of the present invention will become apparent as the following description proceeds, taken in conjunction with the accompanying drawings in which: FIGURE 1 shows a block diagram of a transmitter of a modem of the present invention and the channel.

0013FIGURE 2A shows the upper two quadrants of the complex plane of the signal constellation used with the present invention.

0014FIGURE 2B shows the lower two quadrants of the complex plane of the signal constellation of the present invention.

0015FIGURE 3 shows a fragmented portion of the upper, right hand quadrant of the signal constellation and illustrates the distance properties in the constellation.

0016FIGURE 4 shows a data packet utilized in the present invention. FIGURE 5 is a schematic diagram of a portion of the convolutional encoder which generates the subset-selecting bits.

0017FIGURE 6 shows a frame of the subset-selecting bits generated by the convolutional encoder.

0018FIGURE 7 shows the structure of the convolutional encoder. FIGURE 8 shows two states of the trellis with the branches shown between the present state zero and the next state zero.

0019FIGURE 9 is a block diagram of the receiver of the present invention.

0020FIGURE 10 is a flow chart of the branch metric calculator of the present invention.

0021FIGURE 11 is a flow chart of the branch metric calculator of the -present invention.

0022FIGURE 12 is a flow chart of the branch metric calculator of the present invention. FIGURE 13 is a flow chart of the branch metric calculator of the present invention.

0023FIGURE 14 is a flow chart of the Viterbi decoder of the present invention. DETAILED DESCRIPTION OF PREFERRED EMBODIMENT

0024Referring to FIGURE 1, there is shown a block diagram of the generalized structure of a transmitter 10 of a modem 12 in which the present invention is implemented. In the transmitter 10 an information bit stream 14 is made up of serial digital data from a data source (not shown). From the information bit stream 14, bit sequences of fixed length are taken by a serial to parallel converter 16 to form packets of bits which are passed on to a convolutional encoder 18. A portion of the bits of each packet, symbol-selecting bits 20, are passed through the convolutional encoder 18 to a symbol generator 22. The remaining portion

002524 of the bits of the packet are passed on to the convolutional encoder 18. The convolutional encoder 18 preferably, but not necessarily, is an encoder which allows for 2n dimensional coded modulation. In the preferred embodiment, for each packet, a portion of the output of the convolutional encoder 18, i.e., subset-selecting bits 26, form a frame of an even number of bits, i.e., the subset-selection bits in a frame consist of 2n bits. In other implementations, the frame can have an odd number of bits. The subset-selecting bits 26 are passed to the symbol generator 22. For each received packet, the subset-selecting bits 26 and symbol- selecting bits 20 form an output of the encoder 18 that will be identified as the expanded bit sequence. The symbol generator 22 typically uses a pair (i.e., bit group) of the 2n subset-selecting bits each baud (i.e., symbol interval/modulation period) to specify one of four subsets into which a symbol constellation is partitioned. The symbol-selecting bits 20 are used by the symbol generator 22 to select a symbol (i.e., signal point in constellation) from each subset. Consequently, each packet from the converter 16 is mapped onto a group of n 2-dimensional symbols in n bauds (one group interval), where n is > 1 and defines a multidimensional point (symbol) 28. The multidimensional symbols 28, in a conventional manner, are filtered by bandwidth limiting filters and used to modulate a carrier in modulator and filter means 30 to provide a modulated carrier signal 32 to a band limited channel 34. The symbol generator 22 and modulator and filtering means 30 define a multidimensional coded modulation means 35. The specific structure of the transmitter 10 will now be described. The modem 12 in which the present invention is preferably, but not necessarily, implemented transmits data at a rate of 19,200 bits per second. The symbol constellation 36 used by the symbol generator 22 of FIGURE 1 is shown in FIGURES 2A and 2B, with upper two quadrants and lower two quadrants of the complex plane of the constellation 36 being shown, respectively, in FIGURES 2A and 2B. For purposes of illustration, the transmitter 10 uses eight dimensional coded modulation. The baud rate is 2742.86 symbols per second with 7 bits per baud. The constellation 36 has 160 complex 2-dimensional symbols, i.e., signal points, with each symbol having a specific alphanumerieal identifier. The symbols are divided into outer and inner points, with a circle around each signal point that is an outside point. The symbol constellation 36 also is divided into four subsets A0, Al, B0, Bl, which are the first portion of the symbol identifier. After the subset identifier, separately for both inner or outer symbol groups, the symbols within each subset are designated in the symbol identifier by the number after the hyphen. For example, the symbol identifier "AO-5" for a circled point indicates an outer point from the subset A0, with that particular point being designated by number 5 within the outer points of the subset A0. In summary, the constellation is not only partitioned into four subsets of A0, Al, B0, and Bl, but the constellation is also divided into a portion having inner points and a portion having outer points. Although the preferred embodiment has four subsets, different numbers and arrangements of subsets are possible. Each subset is represented by a two bit number shown in

0026Table 1.

0027Subset Subset Index

MSB LSB

A0 0 0

0030Bl 0 1

B0 1 0

0032Al 1 1

0033TABLE 1 Thus, the subset-selecting bits 26 of FIGURE 1 form an output of the (m, m-1) convolutional encoder 18 of FIGURE 1 which can be represented by n 2-dimensional subsets of the form shown in Table 1. The integer m is equal to 2n plus the number of symbol selecting bits. MSB and LSB stand for most significant bit and least significant bit, respectively.

0034To better illustrate the subset to symbol mapping provided by the symbol generator 22, a portion of the first quadrant of the symbol constellation 36 shown in FIGURE 2A is enlarged and shown in FIGURE 3. The symbols of the constellation 36 are on a square grid of the complex plane. From FIGURE 3 it can be seen that the maximum Euclidean distance of 2 1 /2 (d) occurs between AO and Al as well as between BO and Bl. The minimum distance of d is between AO and BO, AO and Bl, Al and BO and Al and Bl. The maximum Hamming distance also occurs between AO and Al, as well as between BO and Bl.

0035FIGURE 4 shows a packet of data generated by the serial to parallel converter 16 of FIGURE 1 which comprises 28 bits which go to the convolutional encoder 18. The bits Xg-x₂8 ^{are tiιe} symbol-selecting bits 20. As shown in FIGURE 5, bits X x₂, 3, X , 5, Xg, and x-₇ form the input bits 24 to convolutional encoder 18 of FIGURE 1. As shown in

0036FIGURES 5 and 6, the output bits y-, yg, ^, y₄, y₃, y₂, y and y_Q of the encoder 18 are grouped into four bit groups (y- yg), (y^ ^), (y- y₂) and ( i Y_Q) that defines a frame 48 of bits of FIGURE 6. As will be explained hereinafter, bits X₁ -X7 form only a portion of the expanded bit sequence output of the encoder 18 of FIGURE 1. FIGURES 5 and 6 shows the assignment of bit groups for each baud in the frame 48, with each bit group 50 defining a bit pair in the preferred embodiment. Each frame 48 has the duration of a group interval (time interval) that is four bauds in duration. Via Table 1, each bit group 50 of FIGURE 5 corresponds to one of the four 2-dimensional subsets A0, Al, BO and Bl. A symbol is transmitted from one of the 2-dimensional subsets in each of the four bauds. When viewed on a multidimensional level, each frame 48 of FIGURE 6 of eight bit output of the encoder 18 of FIGURE 1 corresponds to one of 256 8-dimensional symbol subsets, with each multidimensional symbol subset corresponding to a different combination of four 2- dimensional symbol subsets. For example, the multidimensional symbol subset Al BO AO BO (11100010) corresponds to 2-dimensional symbol subsets (11), (10), (00) and (10).

0037From this point on we will use superscripts to indicate the order of the bits inside the frame and subscripts to refer to the frame number in which the bits occurs. For example, referring to frame 48 in FIGURE 6,

00387 bit X7 occurring in the nth frame will be referred to as x . Table 2 shows the assignment of points from inner and outer points of the constellation 36 shown in FIGURES 2A-2B for different values of p, Q 1 π x , x and x Bit x indicates whether the frame 48 of n ' n n n

0039FIGURE 6 has any outer points or not. If the frame 48 (i.e., one of the

0040Q i n bauds of the frame) were to have an outer point, then the dibit x n n would indicate in which baud (and therefore bit group) the outer point would occur. In Table 2, "Inner" means inner point and "Outer" means outer point.

00418 q .10 n baud 1 baud 2 baud 3 baud 4

0042Inner Inner Inner Inner

0043Outer Inner Inner Inner

0044Inner Outer Inner Inner

0045Inner Inner Outer Inner

0046Inner Inner Inner Outer

TABLE 2

0048Table 3 shows how the symbol-selecting bits 20 of FIGURES 1 and 4

00498 are assigned with each group of x and x 10 n' 8

0050X X 9 10 baud 1 baud 2 n n n baud 3 baud 4

0051X X - X X 9 - _vX23 24 28

0052X - X n x¹³ 14 18 n n n n n n n

005314 18

00540 X X 1 1 --XX 13 X X --XX X 19 -X 23 x²⁴-x²⁸ n n n n n n n n

00551 1 15 16 18 19 23 24 28

00561 Xx --Xx X^x --- ^xX - X n n n n n -X n x n -x n

00571 1 15 16 20 21 23 24 28

00580 X X --Xx X X --XX X n n n n n -X n x n -x n

00591 1 15 16 20 21 25

00601 Xx --x Xx --Xx X -X 26 2 n n n n n n x -x 8 n n

TABLE 3

0062FIGURE 7 shows the convolutional encoder 18 of FIGURES 1 and 5 in detail. The encoder 18 is a 64 state (8, 7) encoder. As previously described, the input bits to the encoder are x , where i = 1 through 28 and the output bits are y , where i = 0 through 28. As is well-known, the encoder adds one redundancy bit; however, in the preferred embodiment the encoder adds less than one bit per baud of redundancy into the system. Encoders with redundancies greater than one bit (and therefore redundancy of one or greater per baud) can be used with the

00638 28 present invention. Input bits x through x are passed through n o n o unchanged and unused to become output bits y through y . Inputs 4 7 x n -x n are used but p and become output bits create the output bits <img file="WO8805571A1_D0001.tif" /> identified as t subset- selecting bits . The <img file="WO8805571A1_D0002.tif" /> convolutional encoder 18 includes four modulo 2 adders 52, 54, 56, and 58,

00643 2 ^' 1 each connected to receive at least some of the bits x n ,' x n ,' and x n . The encoder 18 includes six delay elements 60, 62, 64, 66, 68, and 70, with each element providing a delay of one group interval (four bauds). The input bit is fed to the modulo adders 52 and 58 via line 70a, the input bit x 2 is ^Ω fed to the modulo adders 54 and 58 via line 70b, and the input bit x is fed to the modulo adders 56 and 58 via line 70c. With a one n ₃ group interval delay, the bit x ₁ is fed to the modulo adders 52 and 58 via line 70d, the bit x 2 . is fe ⁿd~ to the modulo adders 54 and 58 via line

00651 ⁿ 70e, and the bit x . is fed to the modulo adders 52, 54 and 56 via line n-1 -

00667 Of. With a two group interval delay, the bit _ is fed to the modulo adders 54 and 58 via line 70g, the bit x _ is fed to the modulo adders 52 and 56 via line 7 Oh, and the bit x 1 _ ⁿ is fed to the modulo adders 54 and 56 via line 70 i. The bit x is fed to the modulo adders 52, 54, and 56 via line 70j. The bit x 6 is f ⁿed to the modulo adders 52, 54, and 58 via line 70k. The 4 bit x 5ⁿ is fed to the modulo adders 52, 56, and 58 via line

00674 ⁿ 701. The bit x is fed to the modulo adders 54, 56 and 58 via line 70m. n

0068With reference to FIGURE 7, the input-output relationships of the subset-selecting bits 26 of the encoder 18 are as follows:

00697 7 y ^JΏ = n y 6 6 n = x n y ^Jn⁵ = ^χ n⁵

00704 y ^Jn y ^Jn³<img file="WO8805571A1_D0003.tif" />

0071y ^Jn² = x n³ D²©x n²© ^x n¹ (D ©D²) © ^ x n⁷ ©-^/ x n⁶ © n⁴

0072y¹ = x² D²©x¹ (1 ©D 0D²) ©x⁷©x⁵©x⁴

0073y° = x³ ( 1 © D 0 D²) © x² ( 1 © D) © x¹ © x⁶ © x⁵ © x⁴^Jn n -' -^ n ^- - n ~' n -^ n - n

0074(Equations 1)

0075where D is a delay element and means an exclusive OR operation.

0076The convolutional encoder 18 of FIGURE 1 is a finite state device which passes through a succession of states, with each state being separated in time by one group interval. Referring to the trellis diagrams in FIGURE 8, the encoder 18 of FIGURE 1 has 64 possible states (not all shown). Due to the fact that the encoder 18 has three binary inputs, for a given present state, only 8 of the next states are permissible, i.e., can be reached from the present state. Which next state occurs is a function of the present state and on the combination of the x 1 , x 2 , and x 3 bits n ' n ' n received each group interval. Each permissible transition from one state to another state is identified by a coset of parallel branches. In general, the trellis can be used to diagram all permissible transitions between the present state to the next state of the encoder, although only the parallel branches 74 between present state 0 and next state 0 are shown in FIGURE 8. There are 256 possible branches which exist in the trellis. These 256 branches are subdivided into two groups of 128 branches each. The branches from a present state to a next state can be either from one or the other group. Extending from the present state 0, 128 branches exist in the trellis 72, with 16 branches (one coset) going to each of 8 permissible next states (only one set of 16 is shown). Likewise, 128 branches can extend from each present state in the same manner and this is extended continuously between adjacent states separated by group intervals. In the preferred embodiment, the group used of the two groups of 128 branches alternates with the states, e.g., state 0 using one group and state 1 using the other group and. so on.

0077From FIGURE 7 and the Equations 1 for encoder 18 of FIGURE 1, it can be shown that x , x , x⁵ and x do not affect the n ' n ' n n states. In other words, changing any one or all of these bits does not change the state. Hence, between any two given states occurring at successive group intervals, there will be the previously described sixteen parallel branches, with each of the sixteen branches having a different multidimensional symbol subset associated with it, as shown in

0078FIGURE 8. As previously mentioned, this set of sixteen parallel branches is referred to as a coset. The 256 branches can be decomposed into 16 cosets. Hence, between a present state and each of 8 next permissible states, there will be 16 branches with each branch being labeled by one of the 16 multidimensional symbol subsets of a given coset. With respect to FIGURE 8, in the preferred embodiment, 8 of the cosets are assigned to even number states and 8 are assigned to odd number states. For the purposes of illustration, only those multidimensional symbol subsets of the coset associated with the branches going from present state 0 to next state 0 are shown in FIGURE 8. The multidimensional symbol subsets associated with each branch can be indexed by integers ranging from 0 to 255. The index can be expressed as:

0079Index of 8 dimensional subset = 64(ϊndex of subset for baud 4) + 16(index of subset for baud 3) + 4(Index of subset for baud 2) + index of subset for baud 1.

0080As to the multidimensional symbol subsets associated with each branch, the 2-dimensional subsets therein preferably, but not necessarily, are arranged as a frame of subsets for bauds 4, 3, 2, 1, in that order. The encoder 18 transmits 29 bits in 4 bauds or 7.25 bits per baud.

0081A receiver 80 of the modem is generally shown in the block diagram of FIGURE 9 and includes a demodulator 82. The noise affected modulated carrier signal is received over the channel 34 and in a conventional manner that will not be detailed herein is passed through the demodulator 82 (which is normally preceded by a Hubert filter and passband equalizer) to produce a baseband signal consisting of a stream of received 2-dimensional symbol signals.

0082The decoding process is repeated for each frame of received subset-defining bits (e.g., bits defining a multidimensional symbol subset), which is the received version of the frame transmitted and shown in

0083FIGURE 6. To accomplish this, in the receiver 80 of FIGURE 10, the receiver operation is synchronized to the frames of the incoming signal i.e., the receiver must know the beginning of each frame. In other words, the receiver must determine which bit group in the received frame of subset-defining bits corresponds to the bit group ( -^ y₀) in the transmitted subset-defining bits. Having found this starting bit group, the receiver frame of received subset-defining bits is synchronized with the trans itter frame of subset-defining bits.

0084Referring to FIGURE 9, the operation of slicer 102 will be described. Each received multidimensional signal provides information in the form of the multidimensional subsets of the multidimensional points sent. As previously mentioned, the received 8-dimensional signal can be decomposed into four 2-dimensional signals which occur consecutively. More specifically, each frame of the received multidimensional signal can be represented as R(l), R(2), R(3), and R(4), where:

0085R( J ) = [ RX( J) , RY( J) ] , 1 &lt; J &lt; 4 (Equation 2)

0086In a first embodiment of the branch metric computer 100 of the present invention (to be described hereinafter) the inner and outer points are taken into account in the cost calculations. Consequently a symbol (ideal point) in the signal constellation can be represented as:

0087IDL( , L , N) = [ IDLX (K, L, N) , IDLY(K, L, N) ] (Equation 3)

0088where K = 0 means that the point is inner K = 1 means that the point is outer L = 1 means that the point belongs to subset AO L = 2 means that the point belongs to subset Bl L = 3 means that the point belongs to subset BO

0089L = 4 means that the point belongs to subset Al and N = index of the point in the subset.

0090In the first embodiment, N can take on values from 0 to 31, if the point belongs to the inner part of the constellation (that part comprised of inner points) and N = 0 to 7 for points on the outer part of the constellation (that part comprised of outer points). For each K, L and

0091J, the slicer 102 finds the N = N_mjn, such that

0092| R( J ) - IDL(K , L , N . ) | &lt; | R( J) - IDL( K, L, N) | where | R(J ) - IDL( K, L , W ) | ² - f RX(J) - IDLX( , L , M) | ²+

0093[RΪ(J) - IDLY( , L , M) |²

0094(Equation 4)

0095The slicer 102 thus finds eight nearest points for the received signal of each baud. Of these eight ideal points, four are inner points and four are outer points. A pair of Inner and outer points belong to each of the four subset AO, BO, Bl and Al. For each baud of the four baud frames, we can denote the Euclidean distance (metric) between each of the ideal point and the received point as d[J, K(J), L(J), N _mjn(J) Thus d [J, K(J) , L(J) , N _mi&lt;;^j) ] = | R(J) - IDLC (J) , L(J) , N _mi J) l |

0096^* (Equation 5)

0097In a second embodiment of the branch metric calculator 100 of the present invention wherein no distinction is made between inner and outer points, the "K" terms are removed from the above equations, and the slicer 102 thus finds the four nearest points to the received signal for each baud, regardless of whether the nearest point is an inner point or an outer point. Only the costs (metrics) of the four nearest points to the received signal are needed for the branch metric (cost) calculator 100 of the second embodiment and there is no need for keeping track of the points themselves. However, as will be described hereinafter, for the Viterbi decoder 104 of the seeoπd embodiment, it is necessary to calculate Equations 4 and 5 for both inner and outer points (K = 0 and 1), but only for the subsets of the estimated multidimensional symbol subset. For each baud there needs to be only one inner and one outer point determined (L has a single value each baud as defined by the estimated multidimensional symbol subset.)

0098A branch metric (cost) is the distance between a received multidimensional signal and possible multidimensional symbol from the multidimensional symbol subset corresponding to the branch ^" of the trellis. A Viterbi decoder (to be described hereinafter) computes a cumulative path metric for each of the survivor paths during each frame. This cumulative path metric (cost) is the arithmetic sum of the metrics of the individual branches which form the particular path.

0099The branch metric calculator 100 selects for each coset (group of 16 parallel branches each) that branch, i.e., multidimensional symbol subset, which has the minimum branch metric, which results in reducing the number of contending branches from 256 to 16. As will be discussed hereinafter, only one branch of each coset can be a candidate to be part of one of the surviving paths of the trellis during the decoding process. Thus, the described reduction by a factor of 16 of the contending branches is based upon which branch of said coset represents the multidimensional symbol subset which is closest to the received multidimensional signal.

0100The present invention concerns the computations performed by the branch cost calculator 100. In a brute force implementation of a branch metric computer, the branch metric calculator 100 would compute the branch metric term, which can be either equal to or proportional to ^dBRANCH<^{!) where d}BRANCH <^!> ^{is d}-^fined by

0101^dBRANCH ω = [d²d, K(l), L(l), N_min(1)) + d²(2, K(2), L(2), N_m}n(2)) + d²(3, K(3), L(3), N_min(3)) + d²(4, K(4), L(4), N_min(4))J

0102(Equation 6)

0103As previously explained, each branch of the trellis corresponds to a possible multidimensional symbol subset (therefore a four baud signal in the frame) and in this embodiment there are 256 branches, as identified by multidimensional symbol subsets A0 A0 A0 A0 through Al Al Al Al. For each multidimensional symbol subset, five possible signal combinations of 2-dimensional symbols can be constructed having inner

0104(In) and outer (Out) points (symbols) as shown in Table 4. In In In Out

0105In In Out In

0106In Out In In

0107Out In In In

0108In In In In TABLE 4

0109In Table 4 we assume that the right most signal of the frame belongs to the first baud and the left most signal is that of the fourth baud. In the case where inner and outer points are to be taken into account, the brute force computation of Equation 6 would be done for each of the five combinations shown in Table 4 and the combination with the least value is chosen as the metric for the branch. After this reduction, we have 256, d 2 values, one for each of the 256 branches, with each squared distance d 2 value representing the squared distances between the received 2- dimensional signal and the contending 2-dϊmensional symbol subsets. As previously mentioned, the contending branches are next reduced from 256 to 16, based upon selecting the lowest cost branch for each coset.

0110The present invention is directed toward making it unnecessary to determine the branch metric for each branch and to directly compare all of the branch metrics (cost) during each group interval. As will be discussed in detail, in looking for commonality in certain components, i.e., 2-dimensional symbol subsets, the brute force approach can be avoided. In order to avoid confusion with similar terms, in the following discussion, the term "component" will be used in place of "2-dimensional symbol subset".

0111As previously described, a branch is associated with a unique multidimensional symbol subset, which is a sequence of components and has n components. Each multidimensional symbol subset of a coset is defined as being a "member" of that coset. A submember of a member consists of part of the components of the member. The submember does not have all of the components of the member and only has components that form some part of the member in the same bauds. If two or more members (or submembers) have the same components for the same bauds, they are said to have common components, if not they are said to have non-common components in those bauds. The present invention makes use of the fact that several members have a common submember and the cost of this common submember (once calculated) can be used for all the members of any coset which has this common submember without having to be calculated repeatedly. With respect to FIGURE 8, it is important to note that the parallel branches 74 between states are merely added to conceptually illustrate that when the convolutional encoder passes from one state to another, as shown by the lines connecting the states, one of a plurality of multidimensional symbol subsets have been generated. Of course, the lines do not physically exist and what in fact exists is only a number representative of the multidimensional symbol subset.

0112The 256 multidimensional symbol subsets (members) associated with 256 branches of the trellis for the encoder of FIGURE 6 are provided in Table 5.

SUPERCOSET 1

0114Coset 7 Coset 4 Coset 9 Coset 10

A0A0B1A1 A0A0B1A0 A0A0B0B1 A0A0B0B0

A0B1A0A0 A0B1A0A1 A0B1A1B0 A0B1A1B1

A0B0A1A0 A0B0A1A1 AOBOAOBO A0B0A0B1

A0A1B0A1 A0A1B0A0 A0A1B1B1 A0A1B1B0

0119B1A0B0B0 B1A0B0B1 B1A0B1A0 B1A0B1A1 B1B1A1B1 B1B1A1B0 B1B1A0A1 B1B1A0A0 B1B0A0B1 B1B0A0B0 B1B0A1A1 B1B0A1A0 B1A1B1B0 B1A1B1B1 B1A1B0A0 B1A1B0A1

0120B0A0B0B1 B0A0B0BO B0A0B1A1 B0A0B1A0 B0B1A1B0 B0B1A1B1 B0B1A0A0 B0B1A0A1 B0B0A0B0 B0B0A0B1 B0B0A1A0 B0B0A1A1 B0A1B1B1 B0A1B1B0 B0A1B0A1 BOAIBOAO A1A0B1A0 A1A0B1A1 A1A0B0B0 A1A0B0B1 A1B1A0A1 A1B1A0A0 A1B1A1B1 A1B1A1B0 A1B0A1A1 A1B0A1A0 A1B0A0B1 A1B0A0B0 A1A1B0A0 A1A1B0A1 A1A1B1B0 A1A1B1B1

SUPERCOSET 2

0122Coset 5 Coset 6 Coset 11 Coset 8

A0A0B1B1 A0A0B1B0 A0A0B0A1 AOAOBOAO

A0B1A0B0 A0B1A0B1 A0B1A1A0 A0B1A1A1

A0B0A1B0 A0B0A1B1 AOBOAOAO A0B0A0A1

A0A1B0B1 A0A1B0B0 A0A1B1A1 A0A1B1A0

0127B1A0BOA0 B1A0B0A1 B1A0B1B0 B1A0B1B1 B1B1A1A1 B1B1A1A0 B1B1A0B1 B1B1A0B0 B1B0A0A1 B1B0A0A0 B1B0A1B1 B1B0A1B0 B1A1B1A0 B1A1B1A1 B1A1B0BO B1A1B0B1

0128B0A0B0A1 BOAOBOAO B0A0B1B1 B0A0B1B0 B0B1A1A0 B0B1A1A1 B0B1A0B0 B0B1A0B1 BOBOAOAO B0B0A0A1 B0B0A1B0 B1B0A1B1 B0A1B1A1 B0A1B1A0 BOA1B0B1 B1A1B0B0

A1A0B1B0 A1A0B1B1 A1A0B0A0 A1A0B0A1

A1B1A0B1 A1B1A0B0 A1B1A1A1 A1B1A1A0

A1B0A1B1 A1B0A1B0 A1B0A0A1 A1B0A0A0

A1A1B0B0 A1A1B0B1 A1A1B1A0 A1A1B1A1

SUPERCOSET 3

0134Coset 15 Coset 12 Coset 1 Coset 2

0135AOAOAIAI AOAOAIAO AOAOAOBl AOAOAOBO

0136A0B1BOAO A0B1B0A1 A0B1B1BO A0B1B1B1 A0B0B 1A0 A0B0B1A1 AOBOBOBO A0B0B0B1 A0A1A0A1 A0A 1A0A0 A0A1A1B1 A0A1A1B0

B1A0A0B0 B1A0AOB1 B1A0A1A0 B1A0A1A1

B1B1B1B1 B1B1B1B0 B1B1B0A1 B1B1B0A0

B1B0B0B1 B1B0B0B0 B1B0B1A1 B1B0B1A0

B1A1A1B0 B1A1A1B1 B1A1A0A0 B1A1A0A1

B0A0A0B1 BOAOAOBO B0A0A1A1 B0A0A1A0

B0B1B1B0 B0B1B1B1 B0B1B0A0 B0B1B0A1

BOBOBOBO B0B0B0B1 B0BOB1AO B0B0B1A1

10 B0A1A1B1 B0A1A1B0 B0A1A0A1 B0A1A0A0

0145A1A0A1A0 A1A0A1A1 A1A0A0B0 A1A0A0B1 A1B1B0A1 A1B1B0A0 A1B1B1B1 A1B1B1B0 A1B0B1A1 A1B0B1A0 A1B0B0B1 A1B0B0B0 A1A1A0A0 A1A1A0A1 A1A1A1B0 A1A1A1B1

15 SUPERCOSET 4

0147Coset 13 Coset 14 Coset 3 Coset 0

0148A0A0A1B1 A0A0A1B0 AOAOAOAl AOAOAOAO

A0B1B0B0 A0B1B0B1 A0B1B1A0 A0B1B1A1

A0B0B1B0 A0B0B1B1 AOBOBOAO A0B0B0A1

20 A0A1A0B1 A0A1A0B0 A0A1A1A1 A0A1A1A0

0152B1A0A0A0 B1A0A0A1 B1A0A1B0 B1A0A1B1 B1B1B1A1 B1B1B1A0 B1B1B0B1 B1B1B0B0 B1B0B0A1 B1B0B0A0 B1B0B1B1 B1B0B1B0 B1A1A1A0 B1A1A1A1 B1A1A0B0 B1A1A0B1

015325 B0A0A0A1 BOAOAOAO B0A0A1B1 B0A0A1B0 B0B1B1A0 B0B1B1A1 B0B1B0B0 B0B1B0B1 BOB0B0AO BOB0B0A1 B0B0B1B0 B0B0B1B1 B0A1A1A1 BOA1A1A0 B0A1A0B1 B0A1A0B0

0154A1A0A1BO A1A0A1B1 A1A0A0A0 A1A0A0A1 A1B1B0B1 A1B1B0B0 A1B1B1A1 A1B1B1A0 A1B0B1B1 A1B0B1B0 A1B0B0A1 A1B0B0A0 A1A1A0B0 A1A1A0B1 A1A1A1A0 A1A1A1A1

TABLE 5

0156Referring to Table 5, the 256 multidimensional symbol subsets are tabulated into sixteen cosets, with there being 16 members for each coset. The left most component is that of the fourth baud, the next is that of third baud, the next is that of second baud and the right most is that of first baud. The order of the components within a given member are predetermined; however, it should be understood that this order can be reversed, i.e., the first component can be for the first baud and the last component for the fourth baud.

0157According to the present invention, the arrangement of cosets and the members in each coset brings out the commonality of the components. This commonality reduces the number of calculations needed to compute the value of the branch cost as given by Equation 6. Hereafter, it will be seen that use of this commonality reduces computations in two ways. First, it reduces the computations required to eliminate members within a coset. Second, costs calculated for one coset can be used in the other cosets. Hereafter, the preferred arrangement of the first embodiment of the present invention will be described, with the properties generated by such arrangements being also described.

0158In Table 5, the cosets are grouped into four sets. The set of four cosets is identified as a supercoset. Similarly, each coset is divided into four sets, with each set having four members. This set is identified as a subcoset. According to the present invention, the members within a coset are arranged so that the four members of a subcoset have a property that the left most component is common for all. As an example, subcoset 1 belonging to coset 15 is as follows: Fourth Baud

0159AO AO Al Al

0160AO Bl BO AO

0161AO BO Bl AO

0162AO Al AO Al

0163For the purposes of identification for each coset, the top most subcoset in each coset is identified as subcoset 1, with each one thereafter being progressively numbered until the bottom one, which is subcoset four. The four cosets which belong to the same supercoset have what is defined as a common three member property. This property can be stated as follows.

0164Any subcoset in a coset can be transformed to one of the subcoset in each of the other cosets belonging to the same supercoset by just changing the common components, i.e., the components within the same baud that are the same for all four members of the subcoset. Although the four components of four members in baud four consist of the same component, for this description and in the claims, they will be referred to in the plural, i.e., components. Likewise, wherever there is a repetition of a common component in the same baud, when referring to the group, the term "components" is used. These common components will be referred to as the common-subeoset-components. As an example, the subcoset

0165AO AO Al Al

0166AO Bl BO AO

0167AO BO Bl AO

0168AO Al AO Al

0169belonging to coset 15 can be transformed to subcoset of coset 12.

0170Al AO Al Al ^•

0171Al Bl BO AO

0172Al BO Bl AO

0173Al Al AO Al In other words, by changing the first column of common subset components from AO's of subcoset 1 of coset 15 to Al's, BO's, or Bl's one obtains, respectively, subcoset 4 of coset 12, subcoset 3 of coset 1, or subcoset 2 of coset 2, all of which are in the same supercoset. This type of relationship holds true for all cosets within all supercosets.

0174In addition to the commonality in one column of four components, for each subcoset there is commonality of two pairs of components in a second column. More particularly, for example, in coset 15, in the column for baud one, there are two common components of Al's and two common components of AO's. It is important to note that commonality is determined with reference to comparisons made between components of different members, not with components of the same member. Because each member has its components in a row, the commonality appears in the columns, although this could be reversed. Referring to Table 5, there are sixteen submembers containing the components for baud three and baud two, which can be split into eight sets of two submembers each. In each subcoset, the component of each submember (consisting of two components) are the non-common components. In other words, with respect to each set, the components of each submember are non-common components relative to the components of the other submember when a comparison is made between components of the two submembers of the same baud. These sets are shown in Table 6.

0175FIRST GROUP Baud Three Baud Two Baud Three Baud Two

0176AO Al AO AO

0177- (1) (3)

0178Al AO Al Al

0179BO Bl BO BO

0180(2) (4) Bl BO Bl Bl SECOND GROUP

0181Baud Three Baud Two Baud Three Baud Two

0182AO Bl AO BO

0183(5) (7)

0184Al BO Al Bl

0185BO Al BO AO

0186(6) (8)

0187Bl AO Bl Al

TABLE 6

0189Submember sets (1), (2), (3) and (4) of the first group are common to the supercoset 3 containing cosets 15, 12, 1 and 2, as well as to the supercoset 4 containing cosets 13, 14, 3 and 0. Similarly, submember sets (5), (6), (7), and (8) of Group Two are common to supercoset 1 containing cosets 7, 4, 9, and 10 as well as supercoset 2 containing cosets 5, 6, 11 and 8. The subcosets in cosets 7, 4, 9, and 10 illustrate this point as follows in

0190Table 7.

0191B0 A0B0 Bl B0 A0B0 B0 Al A0B0 B0 Al A0B0 Bl B0 A1B1 Bl B0 A1B1 B0 Al A1B1 B0 Al A1B1 Bl

0192B0 B0A0 B0 B0 B0A0 Bl Al B0A0 Bl Al B1A1 B0

0193B0 B1A1 B0 B0 B1A1 Bl Al BΪA1 Bl Al B0A0 B0

0194Coset 7 Coset 4 Coset 9 Coset 10

TABLE 7

0196It can be seen that the submembers

0197A0 B0 Al Bl

0198B0 A0 Bl Al (two of the sets of Table 6) are common to the subcosets shown in Table 7. Additionally, the members of each subcoset are categorized into two pairs, with each pair having one of the sets. With respect only to the members of each pair of members, each submember forming part of the set is defined as the non-common portion of the member and the balance of each member that does not form part of the set is defined as the common portion of the member. In determining the member of each pair forming one of the sets with the minimum metric (cost), it can be determined by comparing only the summed costs of the two different components, thereby eliminating the need to sum the cost of all four components prior to comparing the cumulative metrics. Consequently, within each coset there are eight pairs of members having commonality, when compared with each other, in two common components. When further grouped into subcosets, each subcoset has common components for all members in one baud.

0199As a result of the commonality in two of the columns previously described, there is no commonality in the other two columns, i.e., the two columns for bauds three and two, as dictated by the encoder used in embodiment shown. More specifically, each of the four components AO, Al, BO, and Bl can be found, in differing members in both bauds three and two. The lack of commonality is contained within these two bauds. With this particular encoder, there will be commonality In two bauds, one with all components being in common and the other with two pairs being common. By selecting convolutional encoders having the above described commonality in two columns, with the four submembers of three bauds each being repeated in four cosets, the embodiments of the present invention have maximized the use of such commonality. However, other encoders have different patterns of commonality wherein the present invention would find use, even though such commonality may not be as useful. Moreover, with respect to the "common portion and the "non- common" portion of each branch, for the - purposes of defining the invention in the claims, the components of each portion do not have to be adjacent to each other. For example, although the submembers of Table 6 comprise two "non-common components" which are adjacent to each other and two "common components" which are separated, other encoder schemes might lead to the non-common components being separated and so on.

0200As previously discussed in the cost calculations, it is necessary to determine which of the 16 members for each coset has the smallest cost. There is a cost associated with each member and that member having the lowest summed cost (minimum metric) of its components is to be determined. In doing the comparison within a given subcoset, the components for the fourth baud do not affect the elimination of a member. Likewise, when comparing the first pair of members and the second pair of members, the commonality in the first baud eliminates the cost of the components of the first baud from being a factor. For this step of the comparison, only the components of bauds two and three, i.e., the sets defined in Table 6, need to be considered. Moreover, this set reappears in eight cosets. Hence, the cost computations between pairs of submembers of Table 6 need to be done only once, even though these submembers occur in eight different subcosets. By doing the cost calculations for each set, there is a reduction of eight to one.

0201Moreover, as previously described, the components for bauds three, two and one, which define four submembers, are repeated four times. Therefore, the cost computations done for four submembers in one coset can be used for the submembers in three other cosets. Hence, the cost computation is reduced by a factor of four.

0202With reference to the first embodiment, another factor for reduction can be seen by looking at Table 2. As previously discussed, the outer point occurs only in one baud of a multidimensional-symbol-subset. In the first embodiment of the branch cost metric calculator 100 of FIGURE 9 wherein the cost calculations are to be performed for each combination of inner and outer pointers, an algorithm to minimize the number of computations can be based on the following principle which we will denote as principle of algorithm one,- which is used in the first embodiment. With algorithm one, as previously described, the slicer 102 of FIGURE 9 computes the cost (metric or distance) of the nearest inner and outer point of each component (subset) to the received signal in each baud. According to the invention, if for any component in any baud the outer point is closer than the inner point, then for all subsequent bauds for computing the submember or member cost containing that component only inner points will be considered. Otherwise, the minimum of the costs of inner and outer point are again considered. In computing the branch cost, the cost of baud three is added to baud two and the resulting cost is added to the cost of baud one and the second resulting cost is added to the cost of baud four. With respect to the first embodiment, referring to the flow chart of FIGURE 10, steps involved in the process of branch computation are as follows:

02031. At block 110 slicer 102 of FIGURE 9 computes the distance of the received point from the closest inner and outer points for each component in each baud, as specified in Equations 3, 4 and 5.

02042. After a counter is incremented at block 111, at block 112, for the component for baud two, the determination is made as to whether the cost is smaller for the inner or outer point. The inner or outer point is chosen based upon whether inner cost is smaller or outer cost is smaller.

02053. With the members arranged according to Table 5, the submember cost are formed for submembers of baud three and baud two. There are sixteen submembers which are shown in Table 6:

A0AO A0B1 A0B0 - A0A1

B1A0 B1B1 B1B0 B1A1

B0A0 B0B1 B0BO B0A1

A1A0 A1B1 A1B0 A1A1

TABLE 6

0211The submember costs are calculated as follows. Referring to blocks 114, 116 and 118, if for any component in baud two, the minimum is for an outer point as determined at the block 114, then baud three is assumed to be an inner point at the block 118 and then for a submember containing that baud two component the cost of the inner point of the corresponding subset for baud three is added at the block 120. Otherwise, it is determined at the block 116 whether the inner or outer point of baud three has the minimum cost and at block 120 this minimum cost is added to the cost of the component at baud two. For example, for submember B0A0, component BO represents baud three and component AO represents baud two. If for component AO the outer point is chosen, then for component BO an inner point is chosen at the block 118. Otherwise, the minimum of the inner cost and outer cost for component BO is chosen in baud three at the block 116. This is repeated through a loop including blocks 111 and 122 until these calculations have been done for all 16 of the above described submembers.

02124. The sixteen submembers (two components), as previously described, are separated into 8 sets (pairs) of Table 6, at block 124. The cost for each has already been determined. The costs of each pair are compared and the surviving submember with the lowest cost is selected at block 126. Since these pairs of submembers are in every subcoset, comparing their cost to eliminate the submember of higher cost thus reduces the total number of comparisons to be made.

02135. There will be eight survivor members in the comparison process in the block 126. By individually adding the cost of the four components of baud one to each of these survivors, 32 costs are formed for three- component submembers, each of which will be a sum of three costs, as illustrated in Table 7.

0214Minimum of (A0A0 and A1A1), then add cost of [AO, Bl, BO, and Al]

0215Minimum of (B1B1 and B0B0), then add cost of [AO, Bl, BO, and Al]

0216Minimum of (A0A1 and A1A0), then add cost of [AO, Bl, BO, and Al]

0217Minimum of (B0B1 and B1B0), then add cost of [AO, Bl, BO, and Al]

0218Minimum of (AOBO and A1B1), then add cost of [AO, Bl, BO, and Al]

0219Minimum of (B1A1 and B0A0), then add cost of [AO, Bl, BO, and Al] Minimum of (A0B1 and A1B0), then add cost of [AO, Bl, BO, and Al]

0220Minimum of (B1A0 and B0A1), then add cost of [AO, Bl, BO, and Al]

TABLE 7

0222From Table 7, it is seen that four three-component submembers result when each surviving two-component submember has the components of baud one added thereto, which are all of the components AO, Bl, BO and AO. This addition of baud one components, one at a time, generates half of the three-component submembers that exist in Table 5. Utilizing this relationship, the flow chart of FIGURE 11 demonstrates how the three-component submembers are generated. Again the principle of algorithm one is applied. Counters for the submembers, components, and other variables used later are initialized at block 128 and the submember counter is incremented at block 130. As mandated by loop 131, for each of the two-component submembers for bauds three and two, at block 132 a determination is made as to whether each two-component submember has an outer point in either component. If there is an outer point therein, then the component for baud one (as determined by a component counter) is assumed to be an inner point and one of four three-component members formed by use of the current two-component member is defined at block 136. If there is no outer point, then one of the four three-component members derived from a given two-component member is defined at block 138. Based upon the component values of 1, 2, 3, and 4, the baud one component added is AO, Bl, BO and Al, respectively, at the blocks 136 and 138. At block 140, the costs of the inner and outer points for baud one are compared and the minimum cost component of the two is selected.

0223Once the appropriate cost has been determined at the block 140 or the block 136, then the cost of the three-component submember is calculated at block 143 by adding the two-component member cost -to the appropriate cost of the component for baud one. The component counter is incremented at block 144. Via decision blocks 141 and 142, each of the four components are used. Each of the four three-component submembers having as part thereof one of the eight two-component submembers is formed via loop 145. After all eight two-component submembers are processed through the loop 131, the program exits via decision block 146.

02246. The three-component submembers from which the subcosets can be constructed are shown in Table 8.

0225A0A1A1 A0A1B0 A0B1B0 A0B1A1 B1B0A0 B1B0B1 B1A0B1 B1A0A0 B0B1A0 B0B1B1 B0A1B1 B0A1A0 A1A0A1 A1A0B0 A1B0B0 A1B0A1

0226A0A0B0 AOA0A0 A0B0A0 A0B0B1 B1B1B1 B1B1A1 B1A1A1 B1A1B0 B0BOB1 B0B0A1 B0A0A1 B0A0B0 A1A1B0 A1A1A0 A1B1A0 A1B1B1

0227A0A0B1 A0A0A1 A0B0A1 AOBOBO B1B1B0 B1B1A0 B1A1A0 B1A1B1 BOBOBO BOBOAO BOAOAO B0A0B1 A1A1B1 A1A1A1 A1B1A1 A1B1B0

0228A0A1A0 A0A1B1 A0B1B1 A0B1A0 B1B0A1 B1B0B0 B1A0BO B1A0A1 B0B1A1 B0B1B0 B0A1B0 B0A1A1 A1A0A0 A1A0B1 A1B0B1 A1B0A0

TABLE 8

0230Referring to Table 8, as previously mentioned, the four three-component submembers of bauds three, two, and one found in each coset are repeated four times within a given supercoset. The four three-component submembers will be identified as a submember group. Consequently, within each supercoset, there are only four unique submember groups and among all the supercosets, there are 16 unique submember groups. In Table 8, the columns of submember groups are arranged in columns, going from left to right, from supercosets three, four, one, and two, respectively. Referring to Table 8, all of the 64 three-component submembers for bauds three, two and one are shown. Out of these 64 submembers, 32 have been eliminated in block 126 by taking the commonality of the two-component submembers. Referring to the flow chart of FIGURE 12, for each of the submember groups, the cost of the two surviving three-component submembers are compared, with the one having the minimum cost being selected and retained. There will be sixteen of these in total. Referring to the flow chart, after the submember group counter is incremented at block 148 and the one surviving three-component submember is selected at block 150 for each submember group as dictated by block 152.

02317. Next, the member of each subcoset with the least cost is formed by adding to the cost of the one surviving three-component submember to the cost of the corresponding component of baud four. At this point there is left four members and their associated cost for each coset, i.e., one for each subcoset. Three comparisons are made for each eoset to obtain the minimum cost member for each coset with an allowable sequence.

0232Referring to the flow chart of FIGURE 12, again the rule is that, if the prior three-component submember contained an outer point as determined at bloek 154, then to the submember defined at block 156, the cost of the inner point for baud four is added at block 162. If there is no outer point, and for the member defined at block 156, the smaller cost of the two costs, one for the inner point and one for the outer point, is determined at block 150. As to the four-component members being defined in blocks 156 and 160, this is merely a matter of sequentially associating the baud four component (subset) to the appropriate submember. Each surviving three-component branch has the four components of baud four added thereto to generate the four members in four cosets of the same supercoset, as defined by the loop having blocks 164, 168 and 166. This is repeated for each surviving three-component submember as dictated by the loop having blocks 170 and 153. The cost of baud four is added to the three-component cost at block 162 and this is repeated for all 64 members. At this point, there is left the costs of four members for each coset. At block 174 three comparisons are made for each coset to obtain the minimum cost member. Due to blocks 172, 176, 178, and 180, the comparisons are made three times for each coset, so that a single member and member cost is arrived at for each of the 16 cosets with an allowable sequence. There is a tenfold reduction in the number of comparison and the number of additions is reduced by a factor of 34. While this is a suboptimum decoder, its performance is close to the ideal maximum likelihood decoder for high signal to noise ratio.

0233Contrary to the first embodiment, in the second embodiment of the present invention, the branch metric calculator 100 of FIGURE 9 does not take into account whether a point is an inner point or an outer point. A second algorithm is used which requires a lesser number of operations than algorithm one of the first embodiment and will be referred to as algorithm two. In algorithm two no distinction is made between the cost of inner and outer points. The algorithm will now be described in detail and basically results in a simplified version of the first and has the following steps, with Tables 7 and 8 being again applicable. 1) For each baud, the cost of the closest point in each component (subset) to the received point in slicer 102 as previously described. 2) Next, the cost of the component in baud two is added to the cost of the component in baud three to form sixteen costs for submembers with two-components. 3) Next, eight comparisons of the sixteen submembers are made, which leaves eight submembers. Each comparison involves a pair of submembers having the same common component in baud one. 4) The cost of component of baud one is added to the cost of the surviving submembers.

0234There are 32 additions and 32 new costs will be formed. 5) Sixteen comparisons are made between pairs of three-component submembers of the same subcoset to come up with sixteen three-component member costs. 6) The cost of the appropriate component in baud four is added to the three-component submember to form 64 costs of 64 branches. 7) The four costs in each coset are compared to find the lowest cost of each coset.

0235The number of additions for algorithm two is the same as the number of additions for algorithm one. The number of comparisons for algorithm 2 Is less than the number of comparisons for algorithm one by sixteen. However the overall complexity of algorithm two is smaller than that of algorithm one. For example, the slicer 102 of FIGURE 9 for algorithm two has to do half the number of computations as the slicer for algorithm one, since the former does not have to search for inner and outer points separately. In algorithm one, for the case of all inner points the members are needed during each addition. These members are tested to determine if the previous submember contains any outer point or not. Depending upon whether the previous submembers contained any outer point or not the subsequent instructions will have to be branched to the right location. This increases the number of instruction cycles needed to code the algorithm.

0236Generally, the Viterbi decoder 104 for the first embodiment of the present invention in the receiver 80 uses the received multidimensional signals to estimate the original path of the encoder 18 through the trellis, such trellis being discussed with respect to FIGURE 8. The maximum likelihood path is determined by finding the possible sequence of multidimensional symbol subsets (which trellis path) which is closest to the sequence of received multidimensional signals. During every frame, the receiver computes the minimum cost path and from the path history, determines the estimated multidimensional symbol.

0237As is well-known, the Viterbi decoder 104, during each frame (group interval) extends each of the surviving paths to their successor state at the next frame. The metric (cost) of the extended path is obtained by adding the metric of the survivor to the branch metric of the corresponding branch which extends the path. The survivor at the next frame at a given state is found by comparing the metrics of all the extended paths which connect to a given state and choosing the inimum. More specifically, extending the paths' histories can be mathematically characterized by computing:

0238c( i , n ) = Minimum {c( j , n- 1 ) + r( i , j ) } (Equation 7) j where c(j, -n-1) is the surviving metric of the jth state at time t = (ⁿ~DTf_rarnej ^rn \₎ is ^tne branch metric of the output branch which connects the jth state at time t = (n-l)Tf to the ϊth state at t = T^. c(i, n), the cost at the ith state at time t = nT^, is obtained by minimizing over all j which are connected to state i. Thus, the path history of the surviving paths is extended. Once the path history is extended the decoder 104 finds the minimum cost path among the survivors, and from the path history outputs the best estimate of the multidimensional symbol subset for the group interval to a convolutional decoder 106. The delay between the present frame and the present estimate (of the past symbol) can be 3v frames, where v is the constraint length of the convolutional encoder 18 and in this case is 6.

0239From the retained knowledge of the received multidimensional signal sequence and from the knowledge of the closest multidimensional symbol subset of the maximum likelihood path, the best estimate of the transmitted multidimensional symbol (point) is obtained. From the estimated, transmitted multidimensional signal the convolutional decoder 106 produces the packet data. Finally a serial to parallel converter 108 converts this packet to serial data.

0240The Viterbi decoder 104 of FIGURE 9 for the second embodiment of the present invention is exactly the same conventional arrangement, except as follows. Once the minimum cost sequence is found and the corresponding member has been estimated at the receiver, it is necessary to determine (with knowledge of the corresponding received sequence, i.e., received multidimensional signal) which sequence of inner and outer points is closest to the received sequence which has just been estimated. As previously described and shown in Table -4, each member can be composed of five possible signal combinations of inner and outer points (2-dimensional symbols). The inner and outer points of the signal constellation are defined in Tables 2 and 3. It has been discovered by the inventors that in the second embodiment the component costs of nearest Ideal points can be used in the branch cost calculations (regardless of whether the nearest point is an inner or outer point) without significant loss in performance, if any resultant Impermissible sequence of inner and outer signal points is corrected in the Viterbi decoder. After the determination of the best estimate of a member (which forms a part of the minimum cost path), there is known 1) the received multidimensional signal, i.e., multidimensional point (symbol) received, and 2) the best estimate of the member, i.e., a multidimensional symbol subset. Instead of merely selecting the ideal multidimensional symbol (four 2-dimensional symbols) from the multidimensional symbol subset that is closest to the received multidimensional signal, the Viterbi decoder 104 calculates BRANCH® °^ Equation 6 five times, one for each of the five combinations of Table 4. In Equation 6; the "L" term is defined by the known member and the "K" term is defined by the particular sequence of inner and outer points. Consequently, there are five summed costs associated with the five combinations, and the combination with the minimum (smallest) summed eost is selected to be the multidimensional symbol provided to the convolutional decoder 106.

0241The slicer output of the cost of the closest (in Euclidean distance) 2-dimensional symbol for each 2-dimensional symbol subset for each baud is used by the branch cost calculator. However, for the Viterbi decoder 104 of FIGURE 9, the slicer must provide for each best estimated member (multidimensional-symbol-subset) the cost of the closest inner point and outer point, but only for those 2-dimensional symbol subsets of the best estimated member. Referring to the flow chart of FIGURE 16, this is done at block 182 for each best estimated member determined by the Viterbi decoder. Consequently, there are two 2-dimensional costs for each baud for a given best estimated member. At block 184, five multidimensional symbols are selected from the best estimated multidimensϊonal-symbol-subset (member) that have the sequences of inner and outer 2-dimensional symbols (components) shown in Table 4. At block 186, the 2-dimensional cost provided above are summed to define a ember (multidimensional cost), i.e. ^R R ANC H^^ °^ ^1^uat^^on ^, for each of the five multidimensional symbols. At block 188, the multidimensional symbol with the minimum multidimensional cost (metric) is selected by the Viterbi decoder to be outputted to the convolutional decoder 106 and is defined as being the best estimated multidimensional symbol selected from the best estimated multidimensional-symbol-subset based upon the knowledge of the received multidimensional signal and the requirement of meeting one of the permissible sequences of Table 4.

0242For the purpose of this disclosure including the claims "multidimensions" shall mean more than 2-dimensions.

0243The modem in which the present invention is implemented is a microprocessor based modem. As will be appreciated by those in the art, the microprocessor-based modem control and data processing circuits also typically include the usual data storage elements (e.g., ROM for program control storage and the like, and RAM for variable input/output/intermediate result data, etc.) conventionally associated with a microprocessor CPU for performing desired manipulation of digital signals in accordance with a stored program. In the presently preferred exemplary embodiment, these already present microprocessor CPU, ROM and RAM elements are also utilized to perform the functions of the present invention. With the present invention, the modem functions are implemented in Texas Instrument's TMS -32020 processors. With respect to FIGURE 1, all of the transmitter modem functions therein are preferable, but not necessarily, performed by the digital signal processor. As is well-known, after filtering in block 30, a D/A converter and antialasing filters are used. With respect to FIGURE 9, all of the receiver modem functions of FIGURE 9 are preferably, but not necessarily, performed by the digital signal processor. As is well-known, prior to demodulation, the received signal is processed by an A/D converter and filters.

0244Referring back to the discussion of the convolutional encoder of - i Λ π c U

0245FIGURE 7, the dep ^rendence of y -' n ,' y-'n ,' y-' n and y ^Jn on x n ,' xn ,' xn ■ and x n in Equation 1 can be expressed by the vector: (Equation 8) <img file="WO8805571A1_D0004.tif" /> where the first row corresponds to y 3 , the second row to y 2 , the third

02461 0 ^{n n •} row to y and the fourth row to y . By interchanging the rows, a total of

024724 different vectors can be obtained. Since for each arrangement of the vector there is a convolutional encoder, it then follows that there are 24 different convolutional encoders which can be realized and for each of the encoders a receiver with reduced number of computations - using the principles of this invention - can be designed.

0248With respect to FIGURE 7, as merely a matter of convenience the unchanged bits y 4 through y 28 are shown as being part of the inputs and outputs of the eonvolutional encoder, although they pass through the eonvolutional encoder unchanged and of that group only bits y 4 through y 7 are used by the encoder. However, with respect to the claims, it is clear that the unchanged bits do not have to be considered as part of the convolutional encoder. The convolutional encoder outputs

0249, 6 5 4 3 2 1 0 .. . .. .. , .

0250(y ^Jn ^Jn ^Jn n y ^Jn ^Jn ^Jn y ^Jn _\) satisfy ^J the parity ^J check equation:

0251H T¹- (Equation 9)

0252where ^■ y*- = (y ^J n y ^Jn y ^Jn y ^Jn y ^v y ^Jn y ^Jn y ^Jn )

0253H = (H⁸(D) H⁷(D) H⁶(D) H⁵(D) H⁴(D) H³(D) H²(D) H^D) H°(D) where D is the delay operator and T means transpose. Here

0254H^X(D) = a v D^v © ^^ a v- .i D^{v_ 1} © a_n 0 where i = 0 7 a, = 0 or 1 and 1 = 0 v where v is the constraint length of the encoder. In the present embodiment, the constraint length of the encoder is six, since there are six shift registers. The concept of the parity check equation and constraint length are well-known in the literature of convolutional codes as shown by U.S. patent 4,601,044 to Kromer et al. For the present encoder the parity check equation is given by

0255^P = *n-6 © *n-2 © sr_-l © »n © V6 © ".-5 r ⁶

0256© ^y_n-4 © *» © -i © ^y„-4 © ?n-3 © *n_-2

0257<img file="WO8805571A1_D0005.tif" />

0258<*>: © ^π-6 © &5 © *n-3 © © *π-6

0259© ^yn- © ^n © δ © y_-₅ © yn- © V3 øύ 1 π-_ © ^+) ^yn ii--1 i © — - ^ π © ^— y_n π--6o © -3 © y°= o

0260(Equation 10) The total number of terms in the parity check equation is an even number. As a result, if each of the output of the encoder is inverted, i.e., y goes to y, then P is still zero, because of the even number of terms in the parity check equation. Whenever there is a phase hit of 180 degrees, the received points are 180 degrees from the transmitted points. Under this condition, the received 2-dimensional subsets are changed as follows:

0261, 2k- 1 2k-2, . ,-21.-1 -2k-2.

0262(y_π y_n ) s°es ^fco (y_n y_n ) As we pointed out earlier, the parity check equation P remains zero even though y goes to y . In other words, for all the various encoders, even with 180 degrees phase shift, the output sequence satisfies the parity check equation.

0263Although particular embodiments of the invention have been shown and described here, there is no intention to thereby limit the invention to the details of such embodiments. On the contrary, the intention is to cover all modifications, alternatives, embodiments,. usages and equivalents of the subject invention as fall within the spirit and scope of the invention, specification and the appended claims.