Voice interaction analysis module

id="INS-S-00001" date="20090210"

CROSS-

REFERENCE TO RELATED APPLICATIONS

0001<i>Notice: More than one reissue application has been filed for the reissue of U.S. Pat. No. <b>6</b>,<b>757</b>,<b>361</b>. The reissue applications are: “Voice Interaction Analysis Module,” Ser. No. <b>11</b>/<b>509</b>,<b>553</b>, filed on Aug. <b>24</b>, <b>2006</b></i>(<i>the present application</i>)<i>; “Machine Learning Based Upon Feedback From Contact Center Analysis,” Ser. No. <b>11</b>/<b>509</b>,<b>550</b>, filed on Aug. <b>24</b>, <b>2006</b>; “Distributed Analysis of Voice Interaction Data,” Ser. No. <b>11</b>/<b>509</b>,<b>554</b>, filed on Aug. <b>24</b>, <b>2006</b>; “Distributed Recording of Voice Interaction Data,” Ser. No. <b>11</b>/<b>509</b>,<b>552</b>, filed on Aug. <b>24</b>, <b>2006</b>; “VoIP Voice Interaction Monitor,” Ser. No. <b>11</b>/<b>509</b>,<b>549</b>, filed on Aug. <b>24</b>, <b>2006</b>; “VoIP Voice Interaction Recorder,” Ser. No. <b>11</b>/<b>509</b>,<b>551</b>, filed on Aug. <b>24</b>, <b>2006</b>; and, “Communication Management System for Network</i>-<i>Based Telephones,” Ser. No. <b>11</b>/<b>583</b>,<b>381</b>, filed on Oct. <b>19</b>, <b>2006</b>, all of which are divisional reissues of “Signal Monitoring Apparatus Analyzing Voice Communication Content,” Ser. No. <b>11</b>/<b>477</b>,<b>124</b>, filed on Jun. <b>28</b>, <b>2006</b>, which is a reissue of U.S. Pat. No. <b>6</b>,<b>757</b>,<b>361</b>, issued on Jun. <b>29</b>, <b>2004</b>. </i>

BACKGROUND OF THE INVENTION

0002The present invention relates to signal monitoring apparatus and in particular, but riot exclusively to telecommunications monitoring apparatus which may be arranged for monitoring a plurality of telephone conversations.

DESCRIPTION OF THE RELATED ART

0003Telecommunications networks are increasingly being used for the access of information and for carrying out commercial and/or financial transactions. In order to safeguard such use of the networks, it has become appropriate to record the two-way telecommunications traffic, whether voice traffic or data traffic, that arises as such transactions are carried out. The recording of such traffic is intended particularly to safeguard against abusive and fraudulent use of the telecommunications network for such purposes.

0004More recently, so-called “call-centers” have been established at which operative personnel are established to deal with enquiries and transactions required of the commercial entity having established the call-center. An example of the increasing use of such call-centers is the increasing use of “telephone banking” services and the telephone ordering of retail goods.

0005Although the telecommunications traffic handled by such call-centers is monitored in an attempt to preserve the integrity of the call-centre, the manner in which such communications networks, and their related call-centers, are monitored are disadvantageously limited having regard to the data/information that can be provided concerning the traffic arising in association with the call-center.

0006For example, in large call-centers, it is difficult for supervisors to establish with any confidence that they have accurately, and effectively, monitored the quality of all their staff's work so as to establish, for example, how well their staff are handling customers' enquiries and/or transaction requirements, or how well their staff are seeking to market/publicise a particular product etc.

SUMMARY OF THE INVENTION

0007The present invention seeks to provide for telecommunications monitoring apparatus having advantages over known such apparatus.

0008According to one aspect of the present invention there is provided signal monitoring apparatus comprising: <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0009">means for monitoring signals representing communications traffic;</li><li id="ul0002-0002" num="0010">means for identifying at least one predetermined parameter by analysing the content of at least one monitored signal;</li><li id="ul0002-0003" num="0011">means for recording the occurrence of the identified parameter;</li><li id="ul0002-0004" num="0012">means for identifying the traffic stream associated with the identified parameter;</li><li id="ul0002-0005" num="0013">means for analysing the recorded data relating to the said occurrence; and</li><li id="ul0002-0006" num="0014">means, responsive to the analysis of the said recorded data, for controlling the handling of communications traffic within the apparatus.</li></ul></li></ul>

0015Preferably, the means for controlling the handling of the communications traffic serves to identify at least one section of traffic relative to another.

0016Also, the means for controlling may serve to influence further monitoring actions within the apparatus.

0017Advantageously, the analysed contents of the at least one signal comprise the interaction between at least two signals of traffic representing an at least two-way conversation. In particular, the at least two interacting signals relate to portions of interruption or stiltedness within the traffic.

0018Preferably, the means for monitoring signals can include means for recording signals.

0019Preferably, the means for recording the occurrence of the parameter comprises means for providing, in real time, a possibly instantaneous indication of said occurrence, and/or comprises means for storing, permanently or otherwise, information relating to said occurrence.

0020Dependent upon the particular parameter, or parameters, relevant to a call-center provider, the present invention advantageously allows for the improved monitoring of traffic so as to identify which one(s) of a possible plurality of data or voice interactions might warrant further investigation whilst also allowing for statistical trends to be recorded and analysed.

0021The apparatus is advantageously arranged for monitoring speech signals and indeed any form of telecommunication traffic.

0022For example, by analysing a range of parameters of the signals representing traffic such as speech, data or video, patterns, trends and anomalies within a plurality of interactions can be readily identified and these can then be used for example, to influence future automated analysis, and rank or grade the conversations and/or highlight conversations likely to be worthy of detailed investigation or playback by the call-center provider. The means for monitoring the telecommunications signals may be advantageously arranged to monitor a plurality of separate two-way voice, data or video conversations, and this makes the apparatus particularly advantageous for use within a call-centre.

0023The means for monitoring the telecommunications signals advantageously arranged to monitor the signals digitally by any one variety of appropriate means which typically involve the use of high impedance taps into the network and which have little, or no, effect on the actual network.

0024It should of course be appreciated that the invention can be arranged for monitoring telecommunications signals transmitted over any appropriate medium, for example a hardwired network comprising twisted pair or co-axial lines or indeed a telecommunications medium employing radio waves.

0025In cases where the monitored signal is not already in digital form, the apparatus can advantageously include analogue/digital conversion means for operating on the signal produced by the aforesaid means for monitoring the telecommunications signals.

0026It should also be appreciated that the present invention can comprise means for achieving passive monitoring of a telecommunications network or call-centre etc.

0027The means for identifying the at least one predetermined parameter advantageously includes a Digital Signal Processor which can be arranged or operate in accordance with any appropriate algorithm. Preferably, the signal processing required by the means for identifying the at least one parameter can advantageously be arranged to be provided by spare capacity arising in the Digital Signal Processors found within the apparatus and primarily arranged for controlling the monitoring, compression and/or recording of signals.

0028As mentioned above, the particular parameters arranged to be identified by the apparatus can be selected from those that are considered appropriate to the requirements of, for example, the call-centre provider.

0029However, for further illustration, the following is a non-exhaustive list of parameters that could be identified in accordance with the present invention and assuming that the telecommunications traffic concerned comprises a plurality of two-way telephone interactions such as conversations: <ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0000"><ul id="ul0004" list-style="none"><li id="ul0004-0001" num="0030">non-voice elements within predominantly voice-related interactions for example dialing, Interactive Voice Response Systems, and recorded speech such as interactive voice response prompts, computer synthesized speech or background noise such as line noise;</li><li id="ul0004-0002" num="0031">the relationship between transmissions in each direction, for example the delay occurring, or the overlap between, transmissions in opposite directions;</li><li id="ul0004-0003" num="0032">the amplitude envelope of the signals, so as to determine caller anger or apisodes of shouting;</li><li id="ul0004-0004" num="0033">the frequency spectrum of the signal in various frequency bands;</li><li id="ul0004-0005" num="0034">advanced parameters characterizing the actual speaker which may advantageously be used in speech authentication;</li><li id="ul0004-0006" num="0035">measures of the speed of interaction, for example for determining the ratio of word to inter-word pauses;</li><li id="ul0004-0007" num="0036">the language used by the speaker(s);</li><li id="ul0004-0008" num="0037">the sex of the speaker(s);</li><li id="ul0004-0009" num="0038">the presence or absence of particular words, for example word spotting using advanced speech recognition techniques;</li><li id="ul0004-0010" num="0039">the frequency and content of prosody including pauses, repetitions, stutters and nonsensical utterances in the conversation;</li><li id="ul0004-0011" num="0040">vibration or tremor within a voice; and</li><li id="ul0004-0012" num="0041">the confidence/accuracy with which words are recognized by the receiving party to the conversation so as to advantageously identify changes in speech patterns arising from a caller.</li></ul></li></ul>

0042Parameters such as the following, and having no direct relationship to each call's content, can also be monitored: <ul id="ul0005" list-style="none"><li id="ul0005-0001" num="0000"><ul id="ul0006" list-style="none"><li id="ul0006-0001" num="0043">date, time, duration and direction of call:</li><li id="ul0006-0002" num="0044">externally generated “tagging” information for transferred calls or calls to particular customers;</li></ul></li></ul>

0045As will be appreciated, the importance of each of the above parameters and the way in which they can be combined to highlight particular good, or bad, caller interactions can be readily defined by the call-center provider.

0046Advantageously, the apparatus can be arranged so as to afford each of the parameters concerned a particular weighting, or relative value.

0047The apparatus may of course also be arranged to identify the nature of the data monitored, for example whether speech, facsimile, modem or video etc. and the rate at which the signals are monitored can also be recorded and adjusted within the apparatus.

0048According to a further feature of the invention, the means for identifying at least one parameter can be arranged to operate in real time or, alternatively, the telecommunications signals can be recorded so as to be monitored by the means for identifying at least one parameter at some later stage.

0049Advantageously, the means for recording the actual occurrence of the identified parameter(s) can be arranged to identify an absolute value for such occurrences within the communications network and/or call-centre as a whole or, alternatively, the aforementioned recording can be carried out on a per-conversation or a per-caller/operative basis.

0050The means for recording the occurrence of the identified parameter(s) can advantageously be associated means for analysing the results of the information recorded so as to identify patterns, trends and anomalies within the telecommunications network and/or call-center.

0051Advantageously, the means for recording the occurrence of the identified parameter(s) can, in association with the means for identifying the predetermined parameter and the means for monitoring the telecommunications signals, be arranged to record the aforementioned occurrence in each of the two directions of traffic separately.

0052Preferably, the means for identifying the source of the two-way traffic includes means for receiving an identifier tagged on to the traffic so as to identify its source, i.e. the particular operative within the call-centre or the actual caller. Alternatively, means can be provided within the telecommunications monitoring apparatus for determining the terminal number, i.e. the telephone number, of the operative and/or the caller.

0053The aforementioned identification can also be achieved by way of data and/or speech recognition.

0054It should also be appreciated that the present invention can include means for providing an output indicative of the required identification of the at least one predetermined parameter. Such output can be arranged to drive audio and/or visual output means so that the call-centre provider can readily identify that a particular parameter has been identified and in which particular conversation the parameter has occurred. Alternatively, or in addition, the occurrence of the parameter can be recorded, on any appropriate medium for later analysis.

0055Of course, the mere single occurrence of a parameter need not establish an output from such output means and the apparatus can be arranged such that an output is only provided once a decision rule associated with such parameter(s) has been satisfied. Such a decision rule can be arranged such that it depends on present and/or past values of the parameter under consideration and/or other parameters.

0056Further, once a particular conversation has been identified as exhibiting a particular predetermined parameter, or satisfying a decision rule associated with such parameters, the apparatus can be arranged to allow ready access to the telecommunications “line” upon which the conversation is occurring so that the conversation can be interrupted or suspended as required.

0057As mentioned previously, the apparatus can be arranged to function in real time or, alternatively, the apparatus can include recording means arranged particularly to record the telecommunications traffic for later monitoring and analysis.

0058Preferably, the apparatus includes means for reconstructing the signals of the telecommunications traffic to their original form so as, for example, to replay the actual speech as it was delivered to the telecommunications network and/or call-center.

0059The apparatus can therefore advantageously recall the level of amplification, or attenuation, applied to the signal so as to allow for the subsequent analysis of the originating signal with its original amplitude envelope.

0060Further, the apparatus may include feedback means arranged to control the means for monitoring the telecommunications signals responsive to an output from means being provided to identify the source of the conversation in which the parameter has been identified, or the decision rule associated with the parameter has been exceeded.

0061A further embodiment of the present invention comprises an implementation in which means for recording and analysing the monitored signals are built into the actual system providing the transmission of the original signals so that the invention can advantageously take the form of an add-in card to an Automatic Call Distribution System or any other telecommunications system.

0062Also, it will be appreciated that the present invention can be advantageously arranged so as to be incorporated into a call-centre and indeed the present invention can provide for such a call-centre including apparatus as defined above.

0063In accordance with another aspect of. the present invention, there is provided a method of monitoring signals representing communications traffic, and comprising the steps of: <ul id="ul0007" list-style="none"><li id="ul0007-0001" num="0000"><ul id="ul0008" list-style="none"><li id="ul0008-0001" num="0064">identifying at least one predetermined parameter associated with a monitored signal;</li><li id="ul0008-0002" num="0065">recording the occurrence of the identified parameter; and</li><li id="ul0008-0003" num="0066">identifying the traffic stream in which the parameter was identified.</li></ul></li></ul>

0067The invention is therefore particularly advantageous in allowing the monitoring of respective parts of an at least two-way conversation and which may include the of analysis of the interaction of those parts.

0068Of course, the method of the present invention can advantageously be arranged to operate in accordance with the further apparatus features defined above.

BRIEF DESCRIPTION OF THE DRAWINGS

0069The invention is described further hereinafter, by way of example only, with reference to the accompanying drawings in which:

0070<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of a typical recording and analysis system embodying the present invention; and

0071<figref idref="DRAWINGS">FIG. 2</figref> is a diagram illustrating a typical data packetisation format employed within the present invention.

DESCRIPTION OF THE EMBODIMENT

0072As mentioned above, the apparatus can advantageously form part of a call-centre in which a plurality of telephone conversations can be monitored so as to provide the call-centre operator with information relating to the “quality” of the service provided by the call-centre operatives. Of course, the definition of “quality” will vary according to the requirements of the particular call-centre and, more importantly, the requirements of the customers to the call-centre but typical examples are how well the call-centre operatives handle customers telephone calls, or how well an Interactive Voice Response System serves customers calling for, for example, product details.

0073The system generally comprises apparatus for the passive monitoring of voice or data signals, algorithms for the analysis of the monitored signals and, apparatus for the storage and reporting of the results of the analysis.

0074Optional features can include apparatus for recording the actual monitored signals particularly if real time operation is not required, and means for reconstructing the monitored signals into their original form so as to allow for, for example, replay of the speech signal.

0075<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of a recording and analysis system for use in association with a call-centre <b>10</b> which includes an exchange switch <b>14</b> from which four telephone terminals <b>12</b> extend: each of which is used by one of four call-centre operatives handling customer enquiries/transactions via the exchange switch <b>14</b>.

0076The monitoring apparatus <b>16</b> embodying the present invention, comprises a digital voice recorder <b>18</b> which is arranged to monitor the two-way conversation traffic associated with the exchange switch <b>14</b> by way of high impedance taps <b>20</b>, <b>22</b> which are connected respectively to signal lines <b>24</b>, <b>26</b> associated with the exchange switch <b>14</b>. As will be appreciated by the arrows employed for the signal lines <b>24</b>, <b>26</b>, the high impedance tap <b>20</b> is arranged to monitor outgoing voice signals from the call-centre <b>10</b> whereas the high impedance tap <b>22</b> is arranged to monitor incoming signals to the call-centre <b>10</b>. The voice traffic on the lines <b>24</b>, <b>26</b> therefore form a two-way conversation between a call-centre operative using one of the terminals <b>12</b> and a customer (not illustrated).

0077The monitoring apparatus <b>16</b> embodying the present invention further includes a computer telephone link <b>28</b> whereby data traffic appearing at the exchange switch <b>14</b> can be monitored as required.

0078The digital voice recorder <b>18</b> is connected to a network connection <b>30</b> which can be in the form of a wide area network (WAN), a local area network (LAN) or an internal bus of a central processing unit of a computer.

0079Also connected to the network connection <b>30</b> is a replay station <b>32</b>, a configuration management application station <b>34</b>, a station <b>36</b> providing speech and/or data analysis engine(s) and also storage means comprising a first storage means <b>38</b> for the relevant analysis rules and the results obtained and a second storage means <b>40</b> for storage of the data and/or speech monitor.

0080<figref idref="DRAWINGS">FIG. 2</figref> illustrates the typical format of a data packet <b>42</b> used in accordance with the present invention and which comprises a packet header <b>44</b> of typically 48 bytes and a packet header <b>46</b> of typically of 2000 bytes.

0081The packet header is formatted so as to include the packet identification <b>48</b>, the data format <b>50</b>, a date and time stamp <b>52</b>, the relevant channel number within which the data arises <b>54</b>, the gain applied to the signal <b>56</b> and the data length <b>58</b>.

0082The speech, or other data captured in accordance with the apparatus of the present invention, is found within the packet body <b>46</b> and within the format specified within the packet header <b>44</b>.

0083The high impedance taps <b>20</b>, <b>22</b> offer little or no effect on the transmission lines <b>24</b>, <b>26</b> and, if not in digital form, the monitored signal is converted into digital form. For example, when the monitored signal comprises a speech signal, and signal is typically converted to a pulse code modulated (PCM) signal or is compressed as an Adaptive Differential PCM (ADPCM) signal.

0084Further, where signals are transmitted at a constant rate, the time of the start of the recordings is identified, for example by voltage or activity detection, i.e. so-called “vox” level detection, and the time is recorded. With asynchronous data signals, the start time of a data burst, and optionally the intervals between characters, may be recorded in addition to the data characters themselves.

0085The purpose of this is to allow a computer system to model the original signal in appropriate values of time, frequency and amplitude so as to allow the subsequent identification of one or more of the various parameters arising in association with the signal. The digital information describing the original signals is then analysed at station <b>36</b>, in real time or later, to determine the required set of metrics, i.e. parameters, appropriate to the particular application.

0086A particular feature of the system is in recording the two directions of data transmission separately so allowing further analysis of information sent in each direction independently. In analogue telephone systems, this may be achieved by use of a four-wire (as opposed to two-wire) circuit whilst in digital systems, it is the norm to have the two directions of transmission separated onto separate wire pairs. In the data world, the source of each data packet is typically stored alongside the contents of the data packet.

0087A further feature of the system is in recording the level of amplification or attenuation applied to the original signal. This may vary during the monitoring of even a single interaction (e.g. through the use of Automatic Gain Control Circuitry). This allows the subsequent reconstruction and analysis of the original signal amplitude.

0088Another feature of the system is that monitored data may be “tagged” with additional information such as customer account numbers by an external system (e.g. the delivery of additional call information via a call logging port or computer telephony integration (CTI) port).

0089The importance of each of the parameters and the way in which they can be combined to highlight particularly good or bad interactions is defined by the use of the system. One or more such analysis profiles can be held in the system. These profiles determine the weighting given to each of the above parameters.

0090The profiles are normally used to rank a large number of monitored conversations and to identify trends, extremes, anomalies and norms. “Drill-down” techniques are used to permit the user to examine the individual call parameters that result in an aggregate or average score and, further, allow the user to select individual conversations to be replayed to confirm or reject the hypothesis presented by the automated analysis.

0091A particular variant that can be employed in any embodiment of the present invention uses feedback from the user's own scoring of the replayed calls to modify its own analysis algorithms. This may be achieved using neural network techniques or similar giving a system that learns from the user's own view of the quality of recordings.

0092A variant of the system uses its own and/or the scoring/ranking information to determine its further patterns of operation i.e. <ul id="ul0009" list-style="none"><li id="ul0009-0001" num="0000"><ul id="ul0010" list-style="none"><li id="ul0010-0001" num="0093">determining which recorded calls to retain for future analysis,</li><li id="ul0010-0002" num="0094">determining which agents/lines to monitor and how often, and</li><li id="ul0010-0003" num="0095">determining which of the monitored signals to analyse and to what depth.</li></ul></li></ul>

0096In many systems it is impractical to analyse all attributes of all calls hence a sampling algorithm may be defined to determine which calls will be analysed. Further, one or more of the parties can be identified (e.g. by calling-line identifier for the external party or by agent log-on identifiers for the internal party). This allows analysis of the call parameters over a number of calls handled by the same agent or coming from the same customer.

0097The system can use spare capacity on the digital signal processors (DSPs) that control the monitoring, compression or recording of the monitored signals to provide some or all of the analysis required. This allows analysis to proceed more rapidly during those periods when fewer calls are being monitored.

0098Spare CPU capacity on a PC at an agent's desk could be used to analyse the speech. This would comprise a secondary tap into the speech path being recorded as well as using “free” CPU cycles. Such an arrangement advantageously allows for the separation of the two parties, e.g. by tapping the headset/handset connection at the desk. This allows parameters relating to each party to be stored even if the main recording point can only see a mixed signal.

0099A further variant of the system is an implementation in which the systems recording and analysing the monitored signals are built into the system providing the transmission of the original signals (e.g. as an add-in card to an Automatic Call Distribution (ACD) system).

0100The apparatus illustrated is particularly useful for identifying the following parameters: <ul id="ul0011" list-style="none"><li id="ul0011-0001" num="0000"><ul id="ul0012" list-style="none"><li id="ul0012-0001" num="0101">degree of interruption (i.e. overlap between agent talking and customer talking);</li><li id="ul0012-0002" num="0102">comments made during music or on-hold periods;</li><li id="ul0012-0003" num="0103">delays experienced by customers (i.e. the period from the end of their speech to an agent's response);</li><li id="ul0012-0004" num="0104">caller/agent talk ratios, i.e. which agents might be talking too much.</li></ul></li></ul>

0105However, it should be appreciated that the invention could be adapted to identify parameters such as: <ul id="ul0013" list-style="none"><li id="ul0013-0001" num="0000"><ul id="ul0014" list-style="none"><li id="ul0014-0001" num="0106">“relaxed/stressed” profile of a caller or agent (i.e. by determining changes in volume, speed and tone of speech)</li><li id="ul0014-0002" num="0107">frequency of keywords heard (separately from agents and from callers) e.g. are agents remembering to ask follow-up questions about a certain product/service etc; or how often do customers swear at each agent? Or how often do agents swear at customers?</li><li id="ul0014-0003" num="0108">frequency of repeat calls. A combination of line, ID and caller ID can be provided to eliminate different people calling from single switchboard/business number</li><li id="ul0014-0004" num="0109">languages used by callers?</li><li id="ul0014-0005" num="0110">abnormal speech patterns of agents. For example if the speech recognition applied to an agent is consistently and unusually inaccurate for, say, half an hour, the agent should be checked for: drug abuse, excessive tiredness, drunkenness, stress, rush to get away etc.</li></ul></li></ul>

0111It will be appreciated that the illustrated and indeed any embodiments of the present invention can be set up as follows.

0112The Digital Trunk Lines (e.g. T<b>1</b>/E<b>1</b>) can be monitored trunk side and the recorded speed tagged with the direction of speech. A MediaStar Voice Recorder chassis can be provided typically with one or two E<b>1</b>/T<b>1</b> cards plus a number of DSP cards for the more intense speech processing requirements.

0113Much of its work can be done overnight and in time, some could be done by the DSPs in the mediastar's own cards. It is also necessary to remove or at least recongise, periods of music, on-hold periods, IVR rather than real agents speaking etc. thus, bundling with Computer Integrated Telephony Services such as Telephony Services API (TSAPI) in many cases is appropriate.

0114Analysis and parameter identification as described above can then be conducted. However, as noted, if it is not possible to analysed all speech initially, analysis of a recorded signal can be conducted.

0115It any case the monitoring apparatus may be arranged to only search initially for a few keywords although re-play can be conducted so as to look for other keywords.

0116It should be appreciated that the invention is not restricted to the details of the foregoing embodiment. For example, any appropriate form of telecommunications network, or signal transmission media, can be monitored by apparatus according to this invention and the particular parameters identified can be selected, and varied, as required.