Method and system for detecting non-linear devices

RELATED APPLICATION DATA

0001This application is a continuation of U.S. application Ser. No. 12/864,526, filed Sep. 15, 2010, now U.S. Pat. No. 8,559,532, which is a national stage application under 35 U.S.C. 371 of International Application No. PCT/US2009/032020, having an international filing date of Jan. 26, 2009, which designated the United States, which PCT application claims the benefit of and priority under 35 U.S.C. §119(e) to U.S. Patent Application No. 61/062,805, filed Jan. 29, 2008, entitled “Method and System for Detecting Unfiltered Devices Affecting DSL Service,” each of which are incorporated herein by reference in their entirety.

BACKGROUND

Field of the Invention

0002Exemplary aspects of the invention relate to communications systems. More specifically, exemplary aspects of the invention relate to communications systems and nonlinear device detection that affects DSL communications. These exemplary aspects can be directed toward xDSL-type communications systems as well as packet-based systems, powerline communications systems, coaxial-based communications systems, home networking systems and the like.

SUMMARY

0003One of the most problematic aspects of Digital Subscriber Line (DSL) communications is the in-home environment. One of the most troubling aspects of the in-home environment is the presence of unfiltered devices connected to the telephone line such as telephones, answering machines and fax machines. Many of these devices impose nonlinear behavior on transmitted signals. Harmonic frequencies arising from these nonlinearities generate a disturbance(s) that is often the dominant noise source limiting data rates and loop reach of DSL systems.

0004Devices that either directly or indirectly impose nonlinear effects on communication signals will be referred to as nonlinear devices. A device can impose nonlinear behavior on a communication signal in one of many ways. For example, the nonlinear device could receive a communication signal and then actively transmit a nonlinearly distorted version of either the communication signal or its own signal back onto the line where it interferes with the original communication signal. This occurs, for example, when the components in a telephone are forced outside of their linear operating range by, for example, a DSL signal. A nonlinear device could also change the output impedance of a communications channel causing an impedance mismatch at the communications channel interface. This consequently could increase the amount of echo at the interface and drive the front-end of the communications device outside of its own linear operating range

0005One purpose of certain exemplary embodiments of this invention is to detect nonlinear devices that affect DSL communications, and upon their detection, generate, for example, a message that recommends corrective action such as the insertion of a micro-filter between the nonlinear device and the communications channel.

0006Exemplary, non-limiting aspects of the invention include the following: <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0007">1. A module capable of detecting the presence of a nonlinear device by comparing at least one first noise value to at least one second noise value, wherein the first noise value is from a first link having a first transmit power level and the second noise value is from a second link having a second different transmit power level.</li><li id="ul0001-0002" num="0008">2. A method of detecting the presence of a nonlinear device comprising:</li><li id="ul0001-0003" num="0009">comparing at least one first noise value to at least one second noise value, wherein the first noise value is from a first link having a first transmit power level and the second noise value is from a second link having a second different transmit power level.</li><li id="ul0001-0004" num="0010">3. A module capable of detecting the presence of a nonlinear device comprising:</li><li id="ul0001-0005" num="0011">means for comparing at least one first noise value to at least one second noise value, wherein the first noise value is from a first link having a first transmit power level and the second noise value is from a second link having a second different transmit power level.</li><li id="ul0001-0006" num="0012">4. An information storage media comprising information that when executed compares at least one first noise value to at least one second noise value, wherein the first noise value is from a first link having a first transmit power level and the second noise value is from a second link having a second different transmit power level.</li><li id="ul0001-0007" num="0013">5. Any one of aspects 1-4, wherein the first transmit power level is for at least one subcarrier in the first link and the second transmit power level is different, and for the at least one subcarrier in the second link.</li><li id="ul0001-0008" num="0014">6. Any one of aspects 1-4, wherein the first noise value corresponds to a noise measurement on at least one subcarrier.</li><li id="ul0001-0009" num="0015">7. Any one of aspects 1-4, wherein the second noise value corresponds to a noise measurement on at least one subcarrier.</li><li id="ul0001-0010" num="0016">8. Any one of aspects 1-4, wherein the first noise value and the second noise value correspond to a noise measurement on at least one subcarrier.</li><li id="ul0001-0011" num="0017">9. A module capable of detecting the presence of a nonlinear device by comparing at least one first parameter value to at least one second parameter value, wherein</li><li id="ul0001-0012" num="0018">the first parameter value is from a first link having a first transmit power level and the second parameter value is from a second link having a second different transmit power level.</li><li id="ul0001-0013" num="0019">10. A method of detecting the presence of a nonlinear device comprising:</li><li id="ul0001-0014" num="0020">comparing at least one first parameter value to at least one second parameter value, wherein the first parameter value is from a first link having a first transmit power level and the second parameter value is from a second link having a second different transmit power level.</li><li id="ul0001-0015" num="0021">11. A module capable of detecting the presence of a nonlinear device comprising:</li><li id="ul0001-0016" num="0022">means for comparing at least one first parameter value to at least one second parameter value, wherein the first parameter value is from a first link having a first transmit power level and the second parameter value is from a second link having a second different transmit power level.</li><li id="ul0001-0017" num="0023">12. A computer-readable storage media having stored thereon processer executable instructions that when executed compares at least one first parameter value to at least one second parameter value, wherein the first parameter value is from a first link having a first transmit power level and the second parameter value is from a second link having a second different transmit power level.</li><li id="ul0001-0018" num="0024">13. Any one of aspects 9-12, wherein the first transmit power level is for at least one subcarrier in the first link and the second transmit power level is different, and for the at least one subcarrier in the second link.</li><li id="ul0001-0019" num="0025">14. Any one of aspects 9-12, wherein the first parameter value corresponds to at least one of a noise measurement or an SNR measurement on at least one subcarrier.</li><li id="ul0001-0020" num="0026">15. Any one of aspects 9-12, wherein the second parameter value corresponds to at least one of a noise measurement or an SNR measurement on at least one subcarrier.</li><li id="ul0001-0021" num="0027">16. Any one of aspects 9-12, wherein the first parameter value and the second parameter value correspond to at least one of a noise measurement or an SNR measurement on at least one subcarrier.</li><li id="ul0001-0022" num="0028">17. Any of the above aspects above wherein a user is notified of the detection of a non-linear device.</li><li id="ul0001-0023" num="0029">18. Any of the above aspects above wherein additional links are performed to identify additional non-linear devices.</li></ul>

0030Packet-based communication networks, such as in-home packet based networks, the newly consented ITU G.hn Recommendation, Powerline networks (e.g. Homeplug), phoneline networks (e.g., HPNA) and coax networks (e.g., MOCA) have similar problems with non-linear device interference. Many of these devices impose nonlinear behavior on transmitted signals. Harmonic frequencies arising from these nonlinearities generate a disturbance(s) that is often the dominant noise source limiting data rates and coverage in these networks.

0031Another purpose of certain exemplary embodiments of this invention is to detect nonlinear devices that affect in-home networks, and upon their detection, generate, for example, a message that recommends corrective action such as the insertion of a micro-filter between the nonlinear device and the communications channel, remove the non-linear device from the network or move the non-linear device to a different network in the home.

0032Exemplary, non-limiting aspects of the invention also include the following: <ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0033">1. A module capable of detecting the presence of a nonlinear device by comparing at least one first noise value to at least one second noise value, wherein the first noise value is from a first packet transmission having a first transmit power level and the second noise value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0002" num="0034">2. A method of detecting the presence of a nonlinear device comprising:</li><li id="ul0002-0003" num="0035">comparing at least one first noise value to at least one second noise value, wherein the first noise value is from a first packet transmission having a first transmit power level and the second noise value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0004" num="0036">3. A module capable of detecting the presence of a nonlinear device comprising:</li><li id="ul0002-0005" num="0037">means for comparing at least one first noise value to at least one second noise value, wherein the first noise value is from a first packet transmission having a first transmit power level and the second noise value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0006" num="0038">4. An information storage media comprising information that when executed compares at least one first noise value to at least one second noise value, wherein the first noise value is from a first packet transmission having a first transmit power level and the second noise value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0007" num="0039">5. Any one of aspects 1-4, wherein the first transmit power level is for at least one subcarrier in the first packet transmission and the second transmit power level is different, and for the at least one subcarrier in the second packet transmission.</li><li id="ul0002-0008" num="0040">6. Any one of aspects 1-4, wherein the first noise value corresponds to a noise measurement on at least one subcarrier.</li><li id="ul0002-0009" num="0041">7. Any one of aspects 1-4, wherein the second noise value corresponds to a noise measurement on at least one subcarrier.</li><li id="ul0002-0010" num="0042">8. Any one of aspects 1-4, wherein the first noise value and the second noise value correspond to a noise measurement on at least one subcarrier.</li><li id="ul0002-0011" num="0043">9. A module capable of detecting the presence of a nonlinear device by comparing at least one first parameter value to at least one second parameter value, wherein</li><li id="ul0002-0012" num="0044">the first parameter value is from a first packet transmission having a first transmit power level and the second parameter value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0013" num="0045">10. A method of detecting the presence of a nonlinear device comprising:</li><li id="ul0002-0014" num="0046">comparing at least one first parameter value to at least one second parameter value, wherein the first parameter value is from a first packet transmission having a first transmit power level and the second parameter value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0015" num="0047">11. A module capable of detecting the presence of a nonlinear device comprising:</li><li id="ul0002-0016" num="0048">means for comparing at least one first parameter value to at least one second parameter value, wherein the first parameter value is from a first packet transmission having a first transmit power level and the second parameter value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0017" num="0049">12. A computer-readable storage media having stored thereon processer executable instructions that when executed compares at least one first parameter value to at least one second parameter value, wherein the first parameter value is from a first packet transmission having a first transmit power level and the second parameter value is from a second packet transmission having a second different transmit power level.</li><li id="ul0002-0018" num="0050">13. Any one of aspects 9-12, wherein the first transmit power level is for at least one subcarrier in the first packet transmission and the second transmit power level is different, and for the at least one subcarrier in the second packet transmission.</li><li id="ul0002-0019" num="0051">14. Any one of aspects 9-12, wherein the first parameter value corresponds to at least one of a noise measurement or an SNR measurement on at least one subcarrier.</li><li id="ul0002-0020" num="0052">15. Any one of aspects 9-12, wherein the second parameter value corresponds to at least one of a noise measurement or an SNR measurement on at least one subcarrier.</li><li id="ul0002-0021" num="0053">16. Any one of aspects 9-12, wherein the first parameter value and the second parameter value correspond to at least one of a noise measurement or an SNR measurement on at least one subcarrier.</li><li id="ul0002-0022" num="0054">17. Any of the above aspects above wherein a user is notified of the detection of a non-linear device.</li><li id="ul0002-0023" num="0055">18. Any of the above aspects above wherein additional packet transmissions are performed to identify additional non-linear devices.</li></ul>

0056These and other features and advantages of this invention are described in, or are apparent from, the following detailed description of the exemplary embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS

The exemplary embodiments of the invention will be described in detail, with reference to the following figures wherein:

<figref idref="DRAWINGS">FIG. 1</figref> illustrates an exemplary communication system according this invention.

<figref idref="DRAWINGS">FIGS. 2-3</figref> are a flowchart outlining an exemplary method for unfiltered device detection according this invention.

<figref idref="DRAWINGS">FIGS. 4-5</figref> are a flowchart outlining an exemplary method for unfiltered device detection in a packet-based network according this invention.

DETAILED DESCRIPTION

0061The exemplary embodiments of this invention will be described in relation to nonlinear device detection and effect mitigation in an xDSL environment. However, it should be appreciated, that in general, the systems and methods of this invention will work equally well for any type of communication system in any environment.

0062The exemplary systems and methods of this invention will also be described in relation to multicarrier modems, such as xDSL modems and VDSL modems, and associated communication hardware, software and communication channels. However, to avoid unnecessarily obscuring the present invention, the following description omits well-known structures and devices that may be shown in block diagram form or otherwise summarized.

0063For purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the present invention. It should be appreciated however that the present invention may be practiced in a variety of ways beyond the specific details set forth herein.

0064Furthermore, while the exemplary embodiments illustrated herein show the various components of the system collocated, it is to be appreciated that the various components of the system can be located at distant portions of a distributed network, such as a communications network and/or the Internet, or within a dedicated secure, unsecured and/or encrypted system. Thus, it should be appreciated that the components of the system can be combined into one or more devices, such as a modem, linecard, or collocated on a particular node of a distributed network, such as a telecommunications network. As will be appreciated from the following description, and for reasons of computational efficiency, the components of the system can be arranged at any location within a distributed network without affecting the operation of the system. For example, the various components can be located in a Central Office modem (CO, ATU-C, VTU-O), a Customer Premises modem (CPE, ATU-R, VTU-R), an xDSL management device, or some combination thereof. Similarly, one or more functional portions of the system could be distributed between a modem and an associated computing device.

0065Furthermore, it should be appreciated that the various links, including communications channel, connecting the elements (not shown) can be wired or wireless links, or any combination thereof, or any other known or later developed element(s) that is capable of supplying and/or communicating data to and from the connected elements. The term module as used herein can refer to any known or later developed hardware, software, firmware, or combination thereof that is capable of performing the functionality associated with that element. The terms determine, calculate and compute, and variations thereof, as used herein are used interchangeably and include any type of methodology, process, mathematical operation or technique. Transmitting modem and transmitting transceiver as well as receiving modem and receiving transceiver are used interchangeably herein.

0066Moreover, while some of the exemplary embodiments described herein are directed toward a transmitter portion of a transceiver performing certain functionality, this disclosure is intended to include corresponding receiver-side functionality in both the same transceiver and/or another transceiver.

0067Certain exemplary embodiments of this invention relate to multi-carrier communications links such as discrete multi-tone (DMT). The term link is used to describe the process of initializing two transceivers and entering into steady state data transmission mode. Also, the terms transceiver and modem have the same meaning and are used interchangeably and steady state data transmission mode is also referred to as “Showtime.”

0068The exemplary method may use standard-compliant links (i.e., as specified in published DSL standards such as ITU-T G.992.3/5 and G.993.2, which are incorporated herein by reference in their entirety), but it is not restricted to standard compliant links. The individual carriers used for the link will be referred to as “subcarriers” or “subchannels”. Generally, each link is full duplex, comprising both an upstream direction and a downstream direction. A Power Spectral Density (PSD) is transmitted in both directions. For standard compliant DSL as well as some nonstandard xDSL links, these PSDs are configurable, usually by adjusting subcarrier masks, PSD masks, nominal PSD levels, etc.

0069For standard compliant xDSL links (as well as some nonstandard DSL links), it also is possible to observe the signal-to-noise ratios (SNRs) for each of the upstream and/or downstream subcarriers used for the link. For recent ITU DSL standards (ADSL2 and beyond), this can be accomplished if the link is performed in the Loop Diagnostics Mode as defined by ITU standards for DSL, or alternatively the SNRs can be read from the MIB by using a messaging channel during Showtime, which is term used to denote the steady-state data transmission mode for DSL. If SNRs are not available (such as with ITU G992.1 and T1.413 ADSL standards), then the bit allocations per subcarrier, fine gain allocations per subcarrier, and the average SNR margin may be used to estimate the SNR per subcarrier.

0070In the following description, the collective upstream and downstream PSDs that are transmitted for a particular link will be referred to as a PSD profile. The term monitoring subcarriers will be used to refer to the one or more subcarriers for which observations are recorded and used to determine whether an unfiltered nonlinear device is connected to the line. Note that the monitoring subcarriers may come from the upstream, the downstream, or both (whatever is observable).

0071One aspect of the exemplary method is to observe how the received noise changes between two links as the transmit signal is changed. Harmful unfiltered nonlinear devices will generate significant noise that depends on the transmitted signals; therefore, this additional noise can be quantified to some extent by comparing the observed noise for two different transmit signals.

0072The total noise can be determined from the SNR if the received signal is known. The received signal may be read directly in some non-standard systems, or it may be determined from the known transmit signal and channel attenuation, which is sometimes the case in standard-compliant links, but often with a relatively large error.

0073To circumvent this problem, certain embodiments of this invention only consider the change in noise between two links with the same channel attenuation. This differential comparison makes it unnecessary to accurately know the channel attenuation. Let the SNRs for links <b>1</b> and <b>2</b> be given by: <br /><i>SNR</i>1=<i>S</i>1<i>/N</i>1 and <i>SNR</i>2<i>=S</i>2<i>/N</i>2,

0074respectively, where S<b>1</b> and S<b>2</b> are the transmitted signals and N<b>1</b> and N<b>2</b> are the received noises. If S<b>1</b> and S<b>2</b> are known, then <br /><i>N</i>1<i>/N</i>2=(<i>S</i>1<i>*SNR</i>2)/(<i>S</i>2<i>*SNR</i>1).

0075Note that the transmitted signals S<b>1</b> and S<b>2</b> must take into account any masks and/or gains that are included within the SNR calculation.

0076While some of the exemplary embodiments described herein compare measured noises for the two links (or packets) by explicitly formulating their relationship to one another numerically, it should be appreciated that this comparison could be implemented by using a machine learning technology that compares measured noises for the two links (or packets). The machine learning module could be trained with a set of data in which a variety of nonlinear devices are present under different line conditions, as well as different situations in which no nonlinear devices are present under different line conditions. The inputs to such a machine learning module could be any combination of parameters that are measured or derived, including transmitted signals, SNRs and noises.

0077<figref idref="DRAWINGS">FIG. 1</figref> illustrates a communications system <b>100</b> that includes a modem <b>200</b>, a nonlinear device <b>110</b>, microfilter <b>120</b>, modem <b>300</b> and nonlinear device <b>130</b> all connected by communications channel <b>5</b>. The modem <b>200</b> comprises a transmit power level module <b>210</b>, a comparing module <b>220</b>, a SNR module <b>230</b>, a noise module <b>240</b>, a PSD profile module <b>250</b>, memory <b>260</b>, processor <b>270</b>, a reporting/instruction module <b>280</b> and unfiltered device management module <b>290</b>.

0078In operation, the modem <b>200</b>, in cooperation with the unfiltered device management module <b>290</b>, the PSD profile module and memory <b>260</b>, initiates a link over the communications channel <b>5</b> with a particular PSD profile. The unfiltered device management module <b>290</b> waits for the link to succeed or fail.

0079If the SNR and transmit signal levels are observable, by the SNR module <b>230</b> and transmit power level module <b>210</b>, respectively, only when a link is successful, then random environmental fluctuations (such as crosstalk, AM radio interference, etc.) may cause links to fail. If the link fails, it may be necessary to repeat the link attempt using the same PSD profile.

0080If SNR and transmit signal levels can be observed for each of the monitoring subcarriers for the link attempt in the previous step, the next process is skipped with operation continuing to the Link<b>1</b> process.

0081If the SNR and transmit signal levels cannot be observed for each of the monitoring subcarriers for the link attempt in the previous step, then additional links may be attempted with alternative PSD profiles. Generally these alternative PSD profiles should be more robust against noise and/or unfiltered devices so that at least some information can be garnered. Later it will be described what it means for a PSD profile to be robust.

0082If alternate PSD profiles are available, and in conjunction with the PSD profile module <b>250</b>, an alternate PSD profile is used. If no other PSD profiles are available, then it cannot be known whether a harmful unfiltered device is present. It may be the case that a harmful unfiltered device is present and is preventing all PSD profiles from linking, or it may be the case that some other type of impairment is present and is preventing all PSD profiles from linking. In this case, the reporting/instruction module <b>280</b> can create a report indicating that it is unknown whether an unfiltered device is present and skip the remaining steps. This report can then be forwarded to any appropriate destination.

0083Link<b>1</b> Process

0084In the Link<b>1</b> process, the SNR and transmit signal levels are stored with the cooperation of the memory <b>260</b>, processor <b>270</b> and unfiltered device management module <b>290</b> as Link<b>1</b> and then the signal-to-noise ratios SNR<b>1</b> and transmit signal levels S<b>1</b> for each of the monitoring subcarriers recorded for the link established in the above operation. The link setting used to obtain SNR<b>1</b> and S<b>1</b> will be denoted Link<b>1</b>.

0085If the link is successful, this usually will be possible. If the link fails, it sometimes might still be possible if special access is available to the information.

0086Also, if it is possible to determine the approximate line conditions from the available data (e.g., attenuation, loop length, noise levels), then those can optionally be recorded and stored as well to better assist with the following steps. If no other PSD profiles are available, then the operation continues to the second link process.

0087Otherwise, another link is initiated with a different PSD profile with the cooperation of the PSD profile module <b>250</b>. The monitoring subcarriers used for Link<b>1</b> should be included in this link attempt. All controllable link parameters except for those controlling the PSD profile should be set exactly the same for this link attempt as for Link<b>1</b>. If line conditions were recorded from Link<b>1</b>, then they can be used to help guide the choice of which PSD profile and monitoring subcarriers to choose for this link attempt. The unfiltered device management module <b>290</b> then waits for this link attempt to succeed or fail.

0088Again, to guard against random environmental fluctuations, it may be necessary to repeat this link attempt with the same PSD profile if the SNR and transmit signal levels are not observable upon failure.

0089If either SNR or transmit signal levels can be observed for each of the monitoring subcarriers for the link attempt in the previous step, then the rest of the process is skipped and operation continues to the recording process.

0090If SNR and transmit signal levels cannot be observed for each of the monitoring subcarriers for the link attempt in the previous step, then additional links may be attempted with alternative PSD profiles. Again, generally these alternative PSD profiles should be more robust against noise and/or unfiltered devices. If no other PSD profiles are available, then the operation continues to the second link process.

0091If alternate PSD profiles are available, an alternate PSD profile is used the process jumps back up to initiate another link with a different PSD profile.

0092Next, the signal-to-noise ratios SNR<b>2</b> and transmit signal levels S<b>2</b> for each of the monitoring subcarriers for the link established above are stored and recorded with the cooperation of the memory <b>260</b>, SNR module <b>230</b> and transmit power level module <b>210</b>. If the link is successful, this usually will be possible. If the link fails, it sometimes might still be possible if special access is available to the information.

0093The comparing module <b>220</b> in cooperation with the noise module <b>240</b>, processor <b>270</b> and memory <b>260</b> then determine the noise change N<b>1</b>/N<b>2</b>=(S<b>1</b>*SNR<b>2</b>) /(S<b>2</b>* SNR<b>1</b>) across the monitoring subcarriers. (Note that in some cases S<b>1</b> will be the same as S<b>2</b>, which means that the reciprocal ratio of the SNRs can be used directly.)

0094Next, it is determined whether the noise change N<b>1</b>/N<b>2</b> is reasonable. A noise change is reasonable if one of the noises is expected to be similar or significantly larger than the other, but it is observed to be significantly smaller.

0095If the noise change across the monitoring subcarriers is not reasonable, then something must have gone wrong with the experiment. In this case, no further steps are performed. The operation is then terminated and in conjunction with the reporting module <b>280</b>, a report is generated indicating that the result is unknown, or it can be repeated to see if this particular result is anomalous, perhaps caused by a sporadic noise source.

0096Next, it is determine whether the noise change N<b>1</b>/N<b>2</b> is significant. The noise change is significant if it crosses some threshold. This threshold can roughly be set to the noise change that the least harmful unfiltered device will impose, while also limiting the probability that the noise change would be significant if there were no unfiltered device present. The following outcomes can be observed and reported with the cooperation of the reporting module <b>280</b> to the user: <ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0097">i) If the noise change on monitoring subcarriers significant, then a harmful unfiltered may be present on the line. In this case, this result can be reported with all remaining operational steps skipped.</li><li id="ul0003-0002" num="0098">ii) If the noise change on monitoring subcarriers is not significant, then it is unlikely that a harmful unfiltered device is present on the line. In this case, report this result and skip all remaining operational steps.</li></ul>

0099Second Link Process

0100This second link process is executed only if data set Link<b>1</b> was able to be collected, but no others were able to be collected. Furthermore, at least one additional PSD profile was used, but the SNR and transmit signal information could not be collected for any PSD profiles except that corresponding to Link<b>1</b>.

0101A primary cause of link failure is insufficient SNR across the utilized subcarriers. Assume that this is the reason why SNR and transmit signal information could not be collected for any PSD profiles except that corresponding to Link<b>1</b>. For all practical purposes, this places an upper-bound on the SNR that is present across the monitoring subcarriers. This upper bound can easily be determined. Let this SNR upper-bound be denoted as SNRb. Furthermore, the known PSD profiles can be used to estimate the minimum Sb, which can be used to determine the upper-bound of the noise change N<b>1</b>/Nb=(S<b>1</b>*SNRb)/(Sb*SNR<b>1</b>) across the monitoring subcarriers. (Note that the minimum Sb cannot be known exactly in some cases if fine gains are applied by the modems independently and not observable, but in these cases it may be sufficient to neglect fine gains.)

0102The processor <b>270</b> and memory <b>260</b> determine whether the upper bound on noise change N<b>1</b>/Nb is reasonable. In this case, a noise change is reasonable if it is expected to be similar to or smaller than the upper bound, but it is observed to be significantly larger.

0103If the noise change bound across the monitoring subcarriers is not reasonable, then something must have gone wrong with the experiment. In this case, the additional steps below are not performed. The process can then terminate and report that the result is unknown, or it can be repeated to see if this particular result is anomalous, perhaps caused by a sporadic noise source.

0104Next, it is determined whether the upper bound on noise change N<b>1</b>/Nb is significant, as defined above. The following outcomes can be observed and reported to the user: <ul id="ul0004" list-style="none"><li id="ul0004-0001" num="0105">i) If the noise change on monitoring subcarriers is significant, then a harmful unfiltered device may be present on the line. In this case, a report and/or instructions are generated with operation ending.</li><li id="ul0004-0002" num="0106">ii) If the noise change on monitoring subcarriers is not significant, then it is unlikely that a harmful unfiltered device is present on the line. In this case, this result can be reported with all remaining processed skipped.</li></ul>

0107Not all steps above are necessary for the exemplary operation to detect unfiltered devices because portions may be executed independently to better estimate whether an unfiltered device is present on the loop.

0108For all of the links mentioned above, data already available from previous links may be utilized instead of re-initiating a new link as long as it is known that line conditions (e.g., channel attenuation, background noise, link settings other than PSD profile, etc.) have not changed substantially between the links being compared.

0109Note that in all of the cases above, additional links may be established (repeat steps above, comparing all links to one another) to gain confidence that a harmful unfiltered device is or is not present on the line.

0110Each time that the steps described above are exercised, the presence of harmful unfiltered devices can be detected. If the presence of a harmful unfiltered device is detected, it cannot be determined (using only the above steps) exactly how many harmful unfiltered devices are present. To accomplish this, the user is instructed to first locate and remove or filter at least one harmful unfiltered device, and then the above steps repeated. This process can be iterated until there are no more harmful unfiltered devices detected. This iterative process allows the user to determine how many harmful unfiltered devices are present on the twisted-pair line.

0111In the steps given above, it is not explicitly stated what PSD profiles or which monitoring subcarriers to use. This is because there are numerous types of modem combinations that operate in numerous service areas under different noise conditions in the presence of different unfiltered devices. There is no one best set of PSD profiles or monitoring subcarriers that can be used. They must be chosen on a case-by-case basis. The best PSD profiles and monitoring subcarriers for a given type of situation can be determined prior to fielding the system and stored in lookup tables, or it can be computed dynamically as the conditions are discovered. In general, PSD profiles and monitoring subcarriers are best chosen to satisfy at least three guidelines:

0112If comparing two successful links, the PSD profiles and monitoring subcarriers should be chosen to maximize the change in noise on the monitoring tones between the two links that is attributable to the inclusion of harmful unfiltered devices. In other words, if there is no harmful unfiltered device, then the change in noise should be minimized; but if there is a harmful unfiltered device, then the change in noise should be maximized. If care is not taken to minimize the change in noise when there is no unfiltered device, then false positives may result. If care is not taken to maximize the change in noise when there is an unfiltered device, then false negatives may result.

0113If the monitoring subcarriers cannot be observed when a link fails, then the PSD profiles should be chosen to be sufficiently robust so that a link can be established. A link is more robust if it generally results in a higher probability that the link can be established. For example, the inclusion of more subcarriers or higher transmit power levels can make a PSD profile more robust. Similarly, subcarrier masks can be arranged to make a PSD profile more robust against unfiltered nonlinear devices.

0114For all links initiated, link settings usually should be set to maximize the probability that relevant data can be collected. For example, because it may not be necessary to remain in Showtime for any extended period of time, the required SNR margin often can be set very low. Similarly, one should not set a minimum data rate requirement beyond any imposed by the standard or modem implementations. By allowing links to occur with fewer constraints, the system can potentially link and acquire data on more “difficult” lines (e.g., longer lines and/or lines that contain high noise).

0115A confidence metric can be also formulated that quantifies the extent to which it is known that an unfiltered device is present on the line. This can be formulated in terms of a probability given the information that is known, or some other metric that is informative to the user.

0116If one or more harmful unfiltered devices are detected, a data rate impact estimate can be made to determine the effect that the devices are having on the data rates (upstream and downstream) compared with the hypothetical situation in which the devices were to be removed.

0117Certain exemplary advantages are achieved through this process: <ul id="ul0005" list-style="none"><li id="ul0005-0001" num="0118">1. The exemplary process can utilize standard compliant data collection and initialization procedures. This includes the data collection and initialization procedures specified ITU and ANSI DSL standards, such as G.992.1/0.3/0.5 and G.993.2. Because it is possible (although not necessary) to utilize standard-compliant DSL links to acquire the data rather than relying on a proprietary implementation that might not be implemented on some modems, more modems can utilize the exemplary method because the vast majority of DSL modems are effectively standard compliant.</li><li id="ul0005-0002" num="0119">2. The exemplary process can utilize standard compliant sending of data from the far-end modem to the central office, which enables data collection to be initiated and results made available remotely (e.g., from a central office far from the CPE modem and unfiltered devices) without requiring a communication channel other than the DSL link itself used to perform the measurement.</li></ul>

0120An exemplary method of detecting unfiltered devices will be described in relation to <figref idref="DRAWINGS">FIGS. 2-3</figref>.

0121Control begins in step S<b>100</b> with control continuing to step S<b>105</b>. In step S<b>105</b>, a link with a particular PSD profile is initiated. Next, a determination is made whether the link succeeded. If the link succeeded, control continues to step S<b>120</b>. Otherwise, control jumps back to step S<b>105</b>. Next, if the SNR and transmit signal levels are observable only when a link is successful, then it is noted that random environmental fluctuations (such as crosstalk, AM radio interference, etc.) may cause links to fail, so it may be necessary to repeat the link attempt using the same PSD profile if the link fails.

0122If SNR and transmit signal levels can be observed in step S<b>120</b> for each of the monitoring subcarriers for the link attempt in the previous step, then control continues to step S<b>125</b>.

0123In step S<b>115</b>, and if the SNR and transmit signal levels cannot be observed for each of the monitoring subcarriers for the link attempt in the previous step, then additional links may be attempted with alternative PSD profiles. Generally these alternative PSD profiles should be more robust (as discussed later) against noise and/or unfiltered devices so that at least some information can be garnered. If alternate PSD profiles are available, control continues back to step S<b>110</b> using an alternate PSD profile.

0124In step S<b>115</b>, and if no other PSD profiles are available, then it cannot be known whether a harmful unfiltered device is present. It may be the case that a harmful unfiltered device is present and is preventing all PSD profiles from linking, or it may be the case that some other type of impairment is present and is preventing all PSD profiles from linking. In this case, a report can be generated that it is unknown whether an unfiltered device is present and the process ends.

0125In step S<b>125</b>, the signal-to-noise ratios SNR<b>1</b> and transmit signal levels S<b>1</b> for each of the monitoring subcarriers for the link established in the first step are stored as Link<b>1</b>. If the link is successful, this usually will be possible. If the link fails, it sometimes might still be possible if special access is available to the information. Additionally, if it is possible to determine the approximate line conditions from the available data (e.g., attenuation, loop length, noise levels), then those can optionally also be recorded and stored to better guide the following steps.

0126Then, in step S<b>130</b>, a determination is made whether additional PSD profiles are available. If additional PSD profiles are available, control continues to step S<b>135</b>. Otherwise, control jumps to step S<b>155</b>.

0127In step S<b>135</b>, another link is initiated with a different PSD profile. The monitoring subcarriers used for Link<b>1</b> should be included in this link attempt. All controllable link parameters except for those controlling the PSD profile should be set exactly the same for this link attempt as for Link<b>1</b>. If line conditions were recorded from Link<b>1</b>, then they can be used to help guide the choice of which PSD profile and monitoring subcarriers to choose for this link attempt. As in step S<b>110</b>, the process waits for this link attempt to succeed or fail. Also, again, to guard against random environmental fluctuations, it may be necessary to repeat this link attempt with the same PSD profile if the SNR and transmit signal levels are not observable upon failure. Control then continues to step S<b>140</b>.

0128In step S<b>140</b>, if either SNR or transmit signal levels can be observed for each of the monitoring subcarriers for the link attempt in the previous step, control jumps to step S<b>150</b>. Otherwise control continues to step S<b>145</b>.

0129In step S<b>145</b>, if SNR and transmit signal levels cannot be observed for each of the monitoring subcarriers for the link attempt in the previous step, then additional links may be attempted with alternative PSD profiles. Again, generally these alternative PSD profiles should be more robust against noise and/or unfiltered devices. If no other PSD profiles are available, control jumps to step S<b>155</b> with control otherwise returning to step S<b>135</b> where an alternate PSD profile is used.

0130In step S<b>150</b>, the signal-to-noise ratios SNR<b>2</b> and transmit signal levels S<b>2</b> are stored for each of the monitoring subcarriers for the link established in step S<b>135</b>. If the link is successful, this usually will be possible. If the link fails, it sometimes might still be possible if special access is available to the information.

0131Next, in step S<b>200</b>, the noise change N<b>1</b>/N<b>2</b>=(S<b>1</b>*SNR<b>2</b>)/(S<b>2</b>*SNR<b>1</b>) across the monitoring subcarriers is determined. (Note that in some cases S<b>1</b> will be the same as S<b>2</b>, which means that the reciprocal ratio of the SNRs can be used directly.) Then, in step S<b>210</b> it is determined whether the noise change N<b>1</b>/N<b>2</b> is reasonable. A noise change is reasonable if one of the noises is expected to be similar or significantly larger than the other, but it is observed to be significantly smaller.

0132If the noise change across the monitoring subcarriers is not reasonable, control continues to step S<b>220</b> in that something must have gone wrong with the experiment. In this case, a report is generated in step S<b>220</b> indicating that the result is unknown. Optionally, the test can be repeated to see if this particular result is anomalous, perhaps caused by a sporadic noise source with control continuing to step S<b>230</b> where the control sequence ends.

0133If the noise change is reasonable, control continues to step S<b>240</b> where it is determined whether the noise change N<b>1</b>/N<b>2</b> is significant. The noise change is significant with control passing to step S<b>250</b> if the noise crosses a threshold. This threshold can roughly be set to the noise change that the least harmful unfiltered device will impose, while also limiting the probability that the noise change would be significant if there were no unfiltered device present. The following outcomes can be observed and reported to the user: <ul id="ul0006" list-style="none"><li id="ul0006-0001" num="0134">i) If the noise change on monitoring subcarriers is significant, then a harmful unfiltered may be present on the line. In this case, this can be reported and/or instructions generated with control ending (steps S<b>250</b> and S<b>260</b>)</li><li id="ul0006-0002" num="0135">ii) If the noise change on monitoring subcarriers is not significant, then it is unlikely that a harmful unfiltered device is present on the line and this can be reported with control ending. (Steps S<b>270</b> and S<b>280</b>)</li></ul>

0136Step S<b>155</b> is performed only if data set Link<b>1</b> was able to be collected, but no others were able to be collected. Furthermore, at least one additional PSD profile was used, but the SNR and transmit signal information could not be collected for any PSD profiles except that corresponding to Link<b>1</b>.

0137A primary cause of link failure is insufficient SNR across the utilized subcarriers. One can assume that this is the reason why SNR and transmit signal information could not be collected for any PSD profiles except that corresponding to Link<b>1</b>. As discussed, for all practical purposes, this places an upper-bound on the SNR that is present across the monitoring subcarriers. This upper bound can easily be determined as outlined above.

0138IN step S<b>160</b>, a determination is made whether the upper bound on noise change N<b>1</b>/Nb is reasonable. In this case, a noise change is reasonable if it is expected to be similar to or smaller than the upper bound, but it is observed to be significantly larger with control continuing to step S<b>175</b>.

0139If the noise change bound across the monitoring subcarriers is not reasonable, then something must have gone wrong with the experiment and control continues to step S<b>165</b>. In this case, the exemplary method can terminate and report that the result is unknown, or it can be repeated to see if this particular result is anomalous, perhaps caused by a sporadic noise source. (Steps S<b>165</b> and S<b>170</b>)

0140If the upper bound is reasonable, control continues to step S<b>175</b>. In step S<b>175</b>, a determination is made whether the upper bound on noise change N<b>1</b>/Nb is significant, as defined above. The following outcomes can be observed and reported to the user: <ul id="ul0007" list-style="none"><li id="ul0007-0001" num="0141">i) If the noise change on monitoring subcarriers is significant, then a harmful unfiltered device may be present on the line. In this case, a report and/or instructions can be generated with control continuing to step S<b>185</b> where the control sequence ends.</li><li id="ul0007-0002" num="0142">ii) If the noise change on monitoring subcarriers is not significant, then it is unlikely that a harmful unfiltered device is present on the line. In this case, a report and/or instructions can be generated with control continuing to step S<b>195</b> where the control sequence ends.</li></ul>

0143An exemplary method of detecting unfiltered devices in packet-based networks will be described in relation to <figref idref="DRAWINGS">FIGS. 4-5</figref>. In that the process for detecting unfiltered devices in a packet-based environment is similar to the above described embodiment, the communications system <b>100</b> will not be re-described. It is to be appreciated however, that the general functionality described above as to the operation of the components/modules illustrated in <figref idref="DRAWINGS">FIG. 1</figref> can be applied to packet-based network embodiment described below.

0144Specifically, control begins in step S<b>300</b> with control continuing to step S<b>305</b>. In step S<b>305</b>, a packet is transmitted with a particular PSD profile. Next, a determination is made whether the packet was received successfully. If the packet was received successfully, control continues to step S<b>320</b>. Otherwise, control jumps back to step S<b>305</b>. Next, if the SNR and transmit signal levels are observable only when a packet reception is successful, then it is noted that random environmental fluctuations (such as crosstalk, AM radio interference, etc.) may cause packet reception to fail, so it may be necessary to repeat the packet transmission attempt using the same PSD profile if the packet reception fails.

0145If SNR and transmit signal levels can be observed in step S<b>320</b> for each of the monitoring one or more subcarriers for the packet transmission attempt in the previous step, then control continues to step S<b>325</b>.

0146In step S<b>315</b>, and if the SNR and transmit signal levels cannot be observed for each of the monitoring subcarriers for the packet transmission attempt in the previous step, then additional packet transmissions may be attempted with alternative PSD profiles. Generally these alternative PSD profiles should be more robust (as discussed later) against noise and/or unfiltered devices so that at least some information can be garnered. If alternate PSD profiles are available, control continues back to step S<b>310</b> using an alternate PSD profile.

0147In step S<b>315</b>, and if no other PSD profiles are available, then it cannot be known whether a harmful unfiltered device is present. It may be the case that a harmful unfiltered device is present and is preventing all PSD profiles from packet reception, or it may be the case that some other type of impairment is present and is preventing all PSD profiles from successful packet reception. In this case, a report can be generated that it is unknown whether an unfiltered device is present and the process ends.

0148In step S<b>325</b>, the signal-to-noise ratios SNR<b>1</b> and transmit signal levels S<b>1</b> for each of the monitoring subcarriers for the first packet transmission are established in the first step are stored as Packet<b>1</b>. Additionally, if it is possible to determine the approximate line conditions from the available data (e.g., attenuation, loop length, noise levels), then those can optionally also be recorded and stored to better guide the following steps.

0149Then, in step S<b>330</b>, a determination is made whether additional PSD profiles are available. If additional PSD profiles are available, control continues to step S<b>335</b>. Otherwise, control jumps to step S<b>360</b>.

0150In step S<b>335</b>, another packet transmission is initiated with a different PSD profile. The monitoring subcarriers used for Packet<b>1</b> should be included in this packet transmission attempt. All controllable packet transmission parameters except for those controlling the PSD profile should be set exactly the same for this packet transmission attempt as for Packet<b>1</b>. If line conditions were recorded from Packet<b>1</b>, then they can be used to help guide the choice of which PSD profile and monitoring subcarriers to choose for this packet transmission attempt. As in step S<b>310</b>, the process waits for this Packet reception attempt to succeed or fail. Also, again, to guard against random environmental fluctuations, it may be necessary to repeat this packet transmission attempt with the same PSD profile if the SNR and transmit signal levels are not observable upon failure. Control then continues to step S<b>340</b>.

0151In step S<b>340</b>, if either SNR or transmit signal levels can be observed for each of the monitoring subcarriers for the packet transmission attempt in the previous step, control jumps to step S<b>350</b>. Otherwise control continues to step S<b>345</b>.

0152In step S<b>345</b>, if SNR and transmit signal levels cannot be observed for each of the monitoring subcarriers for the packet reception attempt in the previous step, then additional packet transmission may be attempted with alternative PSD profiles. Again, generally these alternative PSD profiles should be more robust against noise and/or unfiltered devices. If no other PSD profiles are available, control jumps to step S<b>360</b> with control otherwise returning to step S<b>335</b> where an alternate PSD profile is used.

0153In step S<b>350</b>, the signal-to-noise ratios SNR<b>2</b> and transmit signal levels S<b>2</b> are stored for each of the monitoring subcarriers for the packet transmission established in step S<b>335</b>.

0154Next, in step S<b>400</b>, the noise change N<b>1</b>/N<b>2</b>=(S<b>1</b>*SNR<b>2</b>)/(S<b>2</b>*SNR<b>1</b>) across the monitoring subcarriers is determined. (Note that in some cases S<b>1</b> will be the same as S<b>2</b>, which means that the reciprocal ratio of the SNRs can be used directly.) Then, in step S<b>410</b> it is determined whether the noise change N<b>1</b>/N<b>2</b> is reasonable. A noise change is reasonable if one of the noises is expected to be similar or significantly larger than the other, but it is observed to be significantly smaller.

0155If the noise change across the monitoring subcarriers is not reasonable, control continues to step S<b>420</b> in that something must have gone wrong with the experiment. In this case, a report is generated in step S<b>420</b> indicating that the result is unknown. Optionally, the test can be repeated to see if this particular result is anomalous, perhaps caused by a sporadic noise source with control continuing to step S<b>430</b> where the control sequence ends.

0156If the noise change is reasonable, control continues to step S<b>440</b> where it is determined whether the noise change N<b>1</b>/N<b>2</b> is significant. The noise change is significant with control passing to step S<b>450</b> if the noise crosses a threshold. This threshold can roughly be set to the noise change that the least harmful unfiltered device will impose, while also limiting the probability that the noise change would be significant if there were no unfiltered device present. The following outcomes can be observed and reported to the user: <ul id="ul0008" list-style="none"><li id="ul0008-0001" num="0157">i) If the noise change on monitoring subcarriers is significant, then a harmful unfiltered may be present on the line. In this case, this can be reported and/or instructions generated with control ending (steps S<b>450</b> and S<b>460</b>)</li><li id="ul0008-0002" num="0158">ii) If the noise change on monitoring subcarriers is not significant, then it is unlikely that a harmful unfiltered device is present on the line and this can be reported with control ending. (Steps S<b>470</b> and S<b>480</b>)</li></ul>

0159In step S<b>360</b>, a determination is made whether the upper bound on noise change N<b>1</b>/Nb is reasonable. In this case, a noise change is reasonable if it is expected to be similar to or smaller than the upper bound, but it is observed to be significantly larger with control continuing to step S<b>375</b>.

0160If the noise change bound across the monitoring subcarriers is not reasonable, then something must have gone wrong with the experiment and control continues to step S<b>365</b>. In this case, the exemplary method can terminate and report that the result is unknown, or it can be repeated to see if this particular result is anomalous, perhaps caused by a sporadic noise source. (Steps S<b>365</b> and S<b>370</b>)

0161If the upper bound is reasonable, control continues to step S<b>375</b>. In step S<b>375</b>, a determination is made whether the upper bound on noise change N<b>1</b>/Nb is significant, as defined above. The following outcomes can be observed and reported to the user: <ul id="ul0009" list-style="none"><li id="ul0009-0001" num="0162">i) If the noise change on monitoring subcarriers is significant, then a harmful unfiltered device may be present on the line. In this case, a report and/or instructions can be generated with control continuing to step S<b>385</b> where the control sequence ends.</li><li id="ul0009-0002" num="0163">ii) If the noise change on monitoring subcarriers is not significant, then it is unlikely that a harmful unfiltered device is present on the line. In this case, a report and/or instructions can be generated with control continuing to step S<b>395</b> where the control sequence ends.</li></ul>

0164While the above-described flowcharts have been discussed in relation to a particular sequence of events, it should be appreciated that changes to this sequence can occur without materially effecting the operation of the invention. Additionally, the exact sequence of events need not occur as set forth in the exemplary embodiments, but rather the steps can be performed by one or the other transceiver in the communication system. Additionally, the exemplary techniques illustrated herein are not limited to the specifically illustrated embodiments but can also be utilized with the other exemplary embodiments and each described feature is individually and separately claimable.

0165The above-described methods and systems and can be implemented in a software module, a software and/or hardware testing module, a telecommunications test device, a DSL modem, an ADSL modem, an xDSL modem, a VDSL modem, a G.hn transceiver, a linecard, a powerline modem, a wired or wireless modem, test equipment, a multicarrier transceiver, a wired and/or wireless wide/local area network system, a satellite communication system, network-based communication systems, such as an IP, Ethernet or ATM system, a modem equipped with diagnostic capabilities, or the like, or on a separate programmed general purpose computer having a communications device or in conjunction with any of the following communications protocols: CDSL, ADSL2, ADSL2+, VDSL1, VDSL2, HDSL, DSL Lite, IDSL, RADSL, SDSL, UDSL, or the like.

0166Additionally, the systems, methods and protocols of this invention can be implemented on a special purpose computer, a programmed microprocessor or microcontroller and peripheral integrated circuit element(s), an ASIC or other integrated circuit, a digital signal processor, a flashable device, a hard-wired electronic or logic circuit such as discrete element circuit, a programmable logic device such as PLD, PLA, FPGA, PAL, a modem, a transmitter/receiver, any comparable means, or the like. In general, any device capable of implementing a state machine that is in turn capable of implementing the methodology illustrated herein can be used to implement the various methods, protocols and techniques according to this invention.

0167Furthermore, the disclosed methods may be readily implemented in software using object or object-oriented software development environments that provide portable source code that can be used on a variety of computer or workstation platforms. Alternatively, the disclosed system may be implemented partially or fully in hardware using standard logic circuits or VLSI design. Whether software or hardware is used to implement the systems in accordance with this invention is dependent on the speed and/or efficiency requirements of the system, the particular function, and the particular software or hardware systems or microprocessor or microcomputer systems being utilized. The communication systems, methods and protocols illustrated herein can be readily implemented in hardware and/or software using any known or later developed systems or structures, devices and/or software by those of ordinary skill in the applicable art from the functional description provided herein and with a general basic knowledge of the computer and telecommunications arts.

0168Moreover, the disclosed methods may be readily implemented in software, which can be stored on a computer-readable storage medium, and executed on programmed general-purpose computer with the cooperation of a controller and memory, a special purpose computer, a microprocessor, or the like. In these instances, the systems and methods of this invention can be implemented as program embedded on personal computer such as an applet, JAVA® or CGI script, as a resource residing on a server or computer workstation, as a routine embedded in a dedicated communication system or system component, or the like. The system can also be implemented by physically incorporating the system and/or method into a software and/or hardware system, such as the hardware and software systems of a testing module or device.

0169While the invention is described in terms of exemplary embodiments, it should be appreciated that individual aspects of the invention could be separately claimed and one or more of the features of the various embodiments can be combined.

0170It is therefore apparent that there has been provided, in accordance with the present invention, systems and methods for detecting unfiltered device(s). While this invention has been described in conjunction with a number of embodiments, it is evident that many alternatives, modifications and variations would be or are apparent to those of ordinary skill in the applicable arts. Accordingly, it is intended to embrace all such alternatives, modifications, equivalents and variations that are within the spirit and scope of this invention.