Synthesized Voice Authentication Engine
Claim Score by NHIP
Abstract
A system for creating a synthetic voice identifier may include a plurality of synthesized voice authorization (SVA) devices and a biometric combinatory device (BCD). The SVAs may be communicatively coupled to the BCD via a network and may communicate utilizing a markup language. The SVA devices may capture an audio signal of a voice of a user, modify the audio signal with a randomized audio frequency signal to generate a modified audio signal, and communicate, the modified audio signal as a synthesized voice signal associated with the user. The BCD may receive biometric information corresponding to a user, the biometric information comprising at least audio information associated with a voice of the user, receive, at an integration module, location information corresponding to a location of the user, combine, the location information and audio signal information associated with the user to generate a synthesized voice identifier associated with the user, and communicate the synthesized voice identifier to a remote device for use in an authentication process of the user.

Term
10.5 yearsto projected expiry
Projected expiry 31 March 2037, counted from filing; an application has no term until it is granted.
- Priority and filed
- Published
- Today
- Projected expiry
20 claims: 2 independent, 18 dependent
- 1Broadest claimClaim Score 54, average(NHIP)A biometric combinatory device, comprising:a processor;anda non-transitory memory device storing instructions that, when executed by a processor, cause the biometric combinatory device to: receive, at a collection module, biometric information corresponding to a user, the biometric information comprising at least audio information associated with a voice of the user;receive, at an integration module, location information corresponding to a location of the user;combine, by the integration module, the location information and audio signal information associated with the user to generate a synthesized voice identifier associated with the user;communicate, via a network connection, the synthesized voice identifier to a remote device for use in an authentication process of the user.
- 11A system for synthetic voice authentication comprising:receiving, at a collection module of a biometric combinatory device, biometric information corresponding to a user, the biometric information comprising at least audio information associated with a voice of the user;receiving, from a remote voice authorization node, at an integration module, location information corresponding to a location of the user;combining, by an integration module of the biometric combinatory device, the location information and audio signal information associated with the user to generate a synthesized voice identifier associated with the user;communicating via a network connection, the synthesized voice identifier to a remote device for use in an authentication process of the user.
Independent claims2
41 paragraphs in 5 sections, as filed
FIELD OF THE INVENTION
Various aspects of the disclosure relate to voice authentication. More specifically, aspects of the disclosure relate to systems and methods for providing a synthesized voice signal for use for use by individuals in voice authentication for accessing secure locations and/or secure information. Additionally, this disclosure relates to analyzing voice and other biometric information, leveraging information determined through the data analysis to provide more secure authentication of users.
BACKGROUND OF THE INVENTION
Different systems and methods have been used to ensure proper authentication of individuals to prevent unauthorized access to secured physical locations and secured information storage locations. In some cases, different voice authentication techniques may be used to authenticate an individual attempting to access the secured location or information. In many cases, current technologies for securing locations and/or information mainly focus on use of character strings (e.g., a sequence of numbers, a sequence of alphanumeric characters, and the like), traditional voice authentication techniques, or a combination of both. However, traditional voice authentication techniques may not be effective for individuals with disabilities, or even individuals speaking a language foreign to the local geographic area in which the voice authentication security techniques have been implemented. Additionally, traditional voice authentication techniques may be overcome by use of a mimicked vocal pattern, a recorded vocal signal reciting an authorized pass code, and the like. As such, a need has been recognized to improve systems and methods for voice authentication that may be used by an organization to prevent access to secured locations or information by unauthorized individuals, leveraging voice and other biometric information.
SUMMARY OF THE INVENTION
Aspects of the disclosure provide effective, efficient, scalable, and convenient technical solutions that address and overcome the technical problems associated with voice authentication systems and methods used for preventing unauthorized access to physical locations and/or secured information. In particular, one or more aspects of the disclosure provide systems and techniques for managing access to data via a synthesized voice engine that provides a synthesized voice for use by individuals in voice authentication applications and a biometric combinatory device to combine biometric information with voice data and rotating frequencies to provide a personalized and secure voice profile.
A system for creating a synthetic voice identifier may include a plurality of synthesized voice authorization (SVA) devices and a biometric combinatory device (BCD). The SVAs may be communicatively coupled to the BCD via a network and may communicate utilizing a markup language. The SVA devices may capture an audio signal of a voice of a user, modify the audio signal with a randomized audio frequency signal to generate a modified audio signal, and communicate, the modified audio signal as a synthesized voice signal associated with the user. The BCD may receive biometric information corresponding to a user, the biometric information comprising at least audio information associated with a voice of the user, receive, at an integration module, location information corresponding to a location of the user, combine, the location information and audio signal information associated with the user to generate a synthesized voice identifier associated with the user, and communicate the synthesized voice identifier to a remote device for use in an authentication process of the user.
These features, along with many others, are discussed in greater detail below.
BRIEF DESCRIPTION OF THE DRAWINGS
The present disclosure is illustrated by way of example and not limited in the accompanying figures in which like reference numerals indicate similar elements and in which:
<figref idref="DRAWINGS">FIG. 1</figref> shows an illustrative computing environment corresponding to a synthesized voice authentication system according to aspects of this disclosure;
<figref idref="DRAWINGS">FIG. 2</figref> shows an illustrative synthesized voice authentication (SVA) device according to aspects of this disclosure;
<figref idref="DRAWINGS">FIG. 3</figref> shows an illustrative biometric combinatory device according to aspects of this disclosure;
<figref idref="DRAWINGS">FIG. 4</figref> shows an illustrative method for generating a synthesized voice authentication signal according to aspects of this disclosure; and
<figref idref="DRAWINGS">FIG. 5</figref> shows an illustrative method for aggregating and analyzing biometric and synthesized voice authentication signals according to aspects of this disclosure.
DETAILED DESCRIPTION
In the following description of various illustrative embodiments, reference is made to the accompanying drawings, which form a part hereof, and in which is shown, by way of illustration, various embodiments in which aspects of the disclosure may be practiced. It is to be understood that other embodiments may be utilized, and structural and functional modifications may be made, without departing from the scope of the present disclosure.
It is noted that various connections between elements are discussed in the following description. It is noted that these connections are general and, unless specified otherwise, may be direct or indirect, wired or wireless, and that the specification is not intended to be limiting in this respect.
<figref idref="DRAWINGS">FIG. 1</figref> shows an illustrative computing environment corresponding to a synthesized voice authentication system <b>100</b> according to aspects of this disclosure. The synthesized voice authentication system <b>100</b> may include one or more synthesized voice authentication devices (e.g., SVA node <b>11</b><i>a</i>, SVA node <b>11</b><i>b</i>, SVA node <b>11</b><i>c</i>, SVA node <b>11</b><i>n</i>, and the like) communicatively coupled via one or more networks <b>115</b> to a biometric combinatory device (BCD) that may be centrally located as a hub coordinating operation of a plurality of SVA nodes. In some cases, the network <b>115</b> may comprise one or more communications networks (e.g., the Internet, a telecommunications network, a wide area network (WAN), a local area network (LAN), and the like). The biometric combinatory device <b>120</b> may be located on an organization's computing network (e.g., network <b>125</b> that may comprise one or more of a WAN, LAN, or the like) and may be communicatively coupled to a plurality of business unit computing systems <b>140</b> and/or a biometric data repository <b>130</b> securely storing biometric information received from one or more of the SVA nodes <b>110</b><i>a</i>-<b>110</b><i>n</i>, the BCD device <b>120</b>, and/or the one or more business unit computing systems <b>140</b>. In some cases, the biometric data repository may comprise one or more data repositories storing biometric information that may be used as at least a portion of a user authorization and/or verification process. In some cases, the biometric data repository may be located at a central location (e.g., an enterprise data repository at a data center), distributed over a number of servers, local to a geographic region, and/or the like. In an illustrative example, the biometric data repository <b>130</b> may store biometric information such as synthesized voice authentication and verification information associated with a plurality of individuals, biometric information associated with the plurality of individuals including facial recognition information, natural voice information, fingerprint information, and the like. Such information, may be used with the synthesized voice authentication and verification information to provide a greater level of security, confidence and/or reliability that a received synthesized voice authentication request corresponds the intended user.
In some cases, the synthesized voice authentication system <b>100</b> may include one or more devices that may be considered to be computing system comprising an obfuscated voice authentication engine. The synthesized voice authentication system <b>100</b> may be used to in the transition from a standard voice authentication environment to a synthesized and/or hybrid voice authentication environment using a markup language. In some cases, the markup language may be an adaptable markup language, where patterns may be identified over time and incorporated into the markup language to ensure greater security from use of the synthesized voice identifier and/or ensure processing occurs with optimized efficiency, such as by leveraging machine learning and/or artificial intelligence techniques. In a traditional voice authentication system, a voice pattern may be identified based on an analysis of an audio sample of an individual's voice. For example, a person may speak into a microphone to capture a signal representative of that individual's voice, such as to capture a recording of a particular phrase or sound pattern. This captured signal may be processed and analyzed to create a record of a unique audio identifier that may be associated with the particular individual. However, such methods may be subject to potential attempts to improperly bypass any security measures using that audio identifier, such as by another person mimicking the individual's voice, using a captured recording of the individual speaking, and/or the like.
By using the devices of the synthesized voice authentication system <b>100</b>, an institution (e.g., a financial institution, a government organization, an educational institution, or the like) may use one or more devices processing algorithms specifically coded to perform synthetic voice authentication procedures based on a particular profile. In some cases, the synthesized voice authentication devices <b>110</b><i>a</i>-<b>100</b><i>n </i>may be used to generate a synthesized voice for the individual associated with each particular synthesized voice authentication device <b>110</b><i>a</i>-<b>100</b><i>n</i>. In some cases, the synthesized voice authentication devices <b>110</b><i>a</i>-<b>100</b><i>n </i>may allow individuals with disabilities (e.g., a sight impaired individual, a blind individual, an individual with a speech disability, and the like.) to generate a unique synthesized voice pattern for use in authenticating an identity of the associated individual who, in some cases, may not be able to easily take advantage of traditional voice authentication procedures. In some cases, individuals that cannot speak, or who have difficulties in speaking, can leverage the synthesized voice for one or more voice recognition purposes.
In some cases, the biometric combinatory device <b>120</b> may be used as a “trusted” engine for use as a validation point for the plurality of SVA nodes <b>110</b><i>a</i>-<b>110</b><i>n </i>and may, upon proper validation of a synthesized voice, issue a specific value, token, or the like. Unlike traditional voice authentication methods, this system may also be leveraged for use with one or more different languages. In some cases, the synthesized voice authentication system <b>100</b> may be adapted to include and/or merge with the capabilities of one or more different authentication technologies, such as password protection and the like. In some cases, the synthesized voice authentication signal may be combined with traditional or adaptive encryption schemes on the different combinatory points, such as at a particular synthesized voice authentication node (e.g., the SVA node <b>110</b><i>a </i>or the like) to enhance security provided by using the synthesized voice authentication system <b>100</b>. For example, the BCD <b>120</b> may receive a synthesized voice signal from the SVA node <b>110</b><i>a </i>corresponding to a user of the SVA node <b>110</b><i>a</i>. The BCD <b>120</b> may, or may further cause the SVA node <b>110</b><i>a</i>, to include additional user identification information (e.g., biometric information, password information, address information, geolocation information, and the like) that may be stored in the biometric data repository <b>130</b> and/or may be retrieved form one or more of the connected business unit computing systems <b>140</b>. Such information, along with geolocation information of the SVA node, may be used to include an audio signal having a randomized frequency (e.g., at an audible frequency, at an inaudible frequency, and/or the like), along with at least a portion of the user's audio capture, in the generated synthesized voice signal.
In some cases, the SVA <b>110</b><i>a </i>may be configured to provide feedback regarding a status of a voice authentication process, to the user. In some cases, the SVA device <b>110</b><i>a </i>may include a visual indicator device, an audio indicator device, a text-based indicator, haptic feedback, and/or the like.
In some cases, the synthesized voice authentication system <b>100</b> may be used for one or more different network security purposes with respect to the organization providing this functionality. For example, the synthesized voice signal, the SVA nodes, the BCD <b>120</b> may be leveraged to enter secure locations in branches, offices, labs, and the like. In an illustrative example, the synthesized voice authentication system <b>100</b> may include Point-to-Point connection authentication, e.g., an application to beacon authorization process, as a functionality provided for with the use of the voice authentication signal. In such cases, an individual who has requested access to a system may have a synthesized voice signal based on an audio sample provided by the individual, examined to determine whether an existing profile has been identified in the system. In doing so, the synthesized voice authentication system <b>100</b> may increase the reliability of the security and verification procedures of the organization and may provide additional protection against individuals having one or more false profile by ensuring that a stored voice authentication profile may uniquely identify a user and eliminate, or at least minimize, exposure to falsely created profiles. In some cases, some or all of the generation of the synthesized voice signature may be generated on the SVA node <b>110</b><i>a</i>, the biometric combinatory device <b>120</b> or a combination of processing split between the devices. In some cases, the operation of the SVA <b>110</b><i>a</i>, the BCD <b>120</b> may be adapted due to operation of slow speed Internet devices and/or slow network connections.
<figref idref="DRAWINGS">FIG. 2</figref> shows an illustrative synthesized voice authentication (SVA) device <b>210</b>, which may correspond to SVA device <b>110</b><i>a</i>, SVA device <b>110</b><i>b</i>, SVA device <b>110</b><i>c</i>, and SVA device <b>110</b><i>d</i>, according to aspects of this disclosure. The illustrative SVA device <b>210</b> may include a processor <b>212</b>, a non-transitory memory device <b>214</b>, a user interface device, a communications interface that may be used to communicatively couple the SVA device <b>210</b> to one or more networks (e.g., the network <b>115</b>), and one or more input/output (I/O) devices <b>217</b>. The SVA device <b>210</b> may also include one or more sensors for use in capturing or otherwise sensing biometric information of a user of the device <b>210</b>. For example, the SVA device <b>210</b> may include one or more sensors within the device and one or more sensors externally connected to the SVA device <b>210</b>, such as the biometric sensors <b>220</b> which may be communicatively coupled to the SVA device <b>210</b> via an I/O port. The SVA device <b>210</b> may further include one or more of an audio input <b>230</b> (e.g., a microphone), a fingerprint sensor <b>240</b>, a camera <b>250</b> (e.g., a still camera, a video camera, and the like), a location sensor (e.g., a GPS device, a triangulation device such as a telecommunications modem, and the like).
In some cases, the SVA device <b>210</b> may be a stand-alone device dedicated to the function of generating a synthesized voice for an individual. In some cases, the SVD <b>210</b> may be implemented as an application and/or an application programming interface (API) interfacing with an application running on a personal device, such as a personal mobile device (e.g., a mobile phone, a wearable device, a smartwatch, and the like), a laptop computer, a desktop computer, a tablet device, and the like. In some cases, the SVA device <b>210</b> may be a stand-alone device, such as a self-service transaction device, an automated teller machine (ATM), a kiosk, or the like. In some cases, the SVA device may be an external hardware device that may plug into, or otherwise connect, with a personal computing device. For example, the SVA <b>210</b> may connect to a mobile phone, or other such device, as a “dongle” via a hardwired connection (e.g., a universal serial bus (USB) connection, a mini-USB connection, and the like) or via a wireless connection (e.g., a blutetooth connection, a WiFi, connection, a telecommunications network connection, an infrared (IR) communication link, and the like).
In some cases, the SVA device <b>210</b> may communicate, via the network <b>115</b> with the BCD device <b>120</b> using a defined communications protocol and/or a specified markup language to perform handshaking with the device, such that the SVA <b>210</b> may be used as an authentication device for the associated user. In some cases, an individual, may desire to use the SVA <b>210</b> to generate a synthesized voice identifier that may be used for data security and/or authentication purposes. In some cases, the individual may have a disability and may desire to use the synthesized voice identifier to allow use of the added security that the synthesized voice identifier offers. In some cases, the individual may desire to use the synthesized voice identifier to avoid a possibility of an improper impersonation used as an attempt at improper activity at the expense of the individual's credentials. By combining the user's voice signal with additional information that may be incorporated into the voice signal, and/or applied as an overlay over the user's voice signal as, for an example, a “digital watermark”. In doing so, the synthetic voice information may be used to avoid, and minimize the risk of effectiveness, of another person attempting use of mimicry, an impression, and/or vocal recordings in bypassing voice authentication measures to access private user information on a network, performing improper financial activity using the user's credentials, and/or the like.
In some cases, the user's voice signal may be captured using the audio input <b>230</b> and comprise a sample of the user speaking, such as speaking a particular word or phrase. The SVA may capture a geographic location using the location sensor <b>260</b> to identify a current location of the user and the SVA device <b>210</b>. Additionally, the SVA device may capture additional biometric information using one or more biometric sensors, such as the fingerprint sensor <b>240</b>, the camera <b>250</b>, and other such sensor that may be capable of capturing biometric information. In some cases, the biometric information captured may be used in a user authentication procedure for allowing the user access to the SVA device. For example, the SVA device <b>210</b> may capture fingerprint information, retina scan information, facial recognition information with or without text information, or other user verification and/or passwords to facilitate user logon to the SVA device and/or an SVA application running on the SVA device <b>210</b>. Once the user login has been verified, the user may be allowed access to one or more features and/or functionality of the SVA device, including creation and/or use of a synthetic voice identifier. In some cases, the SVA device may be configured to incorporate additional information into the captured user's voice signal to generate a unique synthetic voice identifier for the user. In some cases, the synthetic voice identifier may sound like a normal human voice to human ears. To accomplish this, additional audio information having a different audio frequency may be incorporated into the captured voice signal, that can be used as a “digital audio fingerprint” unique to a particular user. Such frequencies may be selected from a range of frequencies inaudible (e.g., a sub-audible range of frequencies and the like) to the human ear, and/or at power levels that may be heard by a human as being similar to “background” noise in relation the captured voice signal, if heard at all. For example, the synthesized voice identifier may not cause the user's voice to sound artificial (e.g., like a robot). Instead, signals at a desired power level and frequency may be added to the captured voice signal as a sub-audible frequency. However, these added frequencies may act as a digital “fingerprint” for the user's voice. In some cases, the signal overlay may be tracked on recording by storing an electronic code in the background.
<figref idref="DRAWINGS">FIG. 3</figref> shows an illustrative biometric combinatory device <b>320</b> according to aspects of this disclosure. The BCD <b>320</b> may be a stand-alone server, a server cluster, and/or a distributed computer network. The BCD <b>320</b> may include a processor <b>322</b>, a memory device <b>324</b>, a communications interface <b>328</b>, a user interface <b>326</b>, one or more user interface screens <b>327</b>, one or more I/O devices <b>327</b> (e.g., a stylus, a keyboard, a touchscreen, and the like), and a data repository that may be used to store synthesized voice identifiers associated with a plurality of the users. The data repository may include biometric information associated with each user. In some case, the BCD <b>320</b> may be communicatively coupled to the SVA nodes via the communication interface <b>328</b> and the network <b>115</b> and to the plurality of business unit computing systems <b>140</b> and one or more data repositories, such as the biometric information data repository <b>130</b>. In some cases, the BCD <b>320</b> may include an API <b>329</b> that may be used to facilitate, with the SVA nodes <b>110</b><i>a</i>-<i>n</i>, synthetic voice identifier creation and use to authenticate a user's identity in a number of application on an organizations network. For example, the BCD may include one or more software modules including an aggregation engine <b>330</b>, a translation module <b>340</b>, a collection module <b>350</b>, an integration module <b>360</b>, and a validation module <b>370</b>. In some cases, the BCD <b>320</b> may include a firewall to further isolate the BCD <b>320</b> form unwanted external incursion or interferences
In some cases, the aggregation engine <b>330</b> may be implemented in one or more programming languages, such as C or an object-oriented programming language, such as JAVA, C++, or the like. The aggregation engine <b>330</b> may be a biometric information aggregation module of an API that aggregates, analyzes and/or reports biometric activities for the business organization network with a markup language. In some cases, the aggregation engine <b>330</b> may process zoned or un-zoned data analytics in collecting biometric information from one or more devices active on the network (e.g., the SVA <b>210</b>), from one or more business unit computing systems <b>140</b>, and/or may retrieve or store biometric information in the biometric information data repository <b>130</b>, such as by using one or more API functionality. The aggregation engine <b>330</b> may also be implemented as “middleware” to allow different applications running on the organization's computing systems to leverage biometric and synthetic voice identifier information in their user authentication procedures. For example, the BCD <b>320</b> may be implemented on a central server at a data center, where one or more of the business unit computing systems <b>140</b> may send or receive a synthetic voice identifier for verification as part of a user authentication procedure. In an illustrative example, the synthetic voice identifier information may be stored in a block chain configuration for each user, to allow for data segmentation and managing the user information with respect to one or more different access profiles. In some cases, the aggregation engine <b>330</b> may be configured to analyze received voice information to translate to or from different languages, a text to speech format, a speech to text format, and the like. For example, by using parametric text to speech technologies, the aggregation engine <b>330</b> may be capable of isolating and transforming components with a speech data element. The aggregation engine <b>330</b> may also perform compression via a number of lossless data compression methods, such as a Lempel-Ziv compression method, to minimize an amount of data transferred when using the biometric information (e.g., synthetic voice identifier, fingerprint information, retina scan information, and the like) for user authentication, while losing minimal data resolution, when communicating the biometric information between network components, such as SVA nodes, data repositories, business unit computing systems and the like.
In some cases, the aggregation engine <b>330</b> may exchange data in near real time with the SVA nodes, the business unit computing systems <b>140</b> and/or the biometric information data repository <b>130</b>. In addition to biometric information (e.g., voice information, synthetic voice information, retinal scan information, facial recognition information, fingerprint information, and the like), the aggregation engine may also communicate associated information such as a user name, user identifier, a user address, a connection identifier, a geographic location associated with the user, and the like. In an illustrative application, a business unit computing system may leverage fingerprint information when a user requests certain actions, such as opening a large account across borders. In such cases, transactions such as these may face increased scrutiny to avoid and disprove suspicious or improper activities by persons not authorized to take such actions. Certain biometric identifiers may be used for authentication purposes, such as for fingerprint verification. However, these authentication purposes may be circumvented in some cases, such as, by utilizing a synthetic voice identifier that may include additional frequency components randomly generated based on the authorized user's information (e.g., a known location of the user, fingerprint data of the user, and the like), the opportunities for improper activity to succeed are minimized if not eliminated in most cases.
The aggregation engine <b>330</b> of the biometric combinatory device <b>320</b> may be implemented in a server and utilize a markup language for communication and translation, in near real-time, of real-time and/or historical biometric information to different system components via a server-based or web-based application interface. In some cases, the translation module <b>340</b> be used to adapt interpreted language for use in application-to-application functionality, including during initial handshaking. The translation module <b>340</b> may also be used to facilitate data analytics based on structured presentation, via a markup language, specifically tailored for use in communicating biometric and/or synthesized voice information associated with users. In some cases, biometric information, such as the synthesized voice information, may be enhanced with additional data that may be associated with a same user and stored in the biometric data repository <b>130</b> and/or other data repositories. Additionally, the markup language (e.g., a proprietary markup language, and the like) may be configured to support multiple languages with single and/or multiple byte translation to reduce problems that may arise based on multi-language access. In some cases, this support may include translation of information in a first language to corresponding information in a second language.
In some cases, the translation module <b>340</b> may be configured to support single byte input/output data and/or double byte input/output data. In an illustrative example, the translation module <b>340</b> may use a proprietary markup language to provide a nuanced application for synthesized voice recognition, authentication, and verification applications. The markup language may be used to facilitate storage and/or retrieval of biometric information, including synthesized voice information in an organized manner. For example, the markup language may be used to format storage and communication of combined biometric and user information including identifier information (e.g., user identifier, user name, time, date, geographic location, network location, device identifier, phone number, address, email address, and the like). Additional markup language entries may correspond to a type or combination of types of biometric information used, including natural voice information, synthesized voice information, fingerprint information, retina scan information, facial recognition information, and/or the like. Biometric data communicated may be defined in the markup language as whether the biometric data is being transferred in a compressed or uncompressed format. The markup language may also define a location in the communication packets at which the biometric data can be read (e.g., a data container), including handshaking and control words, status words, data container size and/or length, packet count, checksum, and/or the like. In some cases, the markup language may have an entry corresponding to whether the biometric information is historical information, real-time (or near real-time information), or the like. In some cases, the markup-language may be used to define one or more security methods and/or protocols that may be used in the communication of the biometric information.
In some cases, the biometric combinatory device <b>320</b> may include an integration module <b>360</b> for use in integrating additional information (e.g., biometric information, rotating frequency information, geolocation information, and the like) with a natural voice signal to generate a synthesized voice authentication identifier for each of a plurality of users. In some cases, the integration module may perform the integration functionality at a central location (e.g., at a BCD device server, and the like), at distributed locations (e.g., at one or more regional BCD device servers based on geolocation information, business unit information and the like), and/or at remote locations, such as at an SVA node <b>210</b>. In an illustrative example, the integration module <b>360</b> may be configured to receive a voice signal associated with a user and additional information corresponding to the user. In some cases, an SVA node may capture a voice signal (e.g., in response to a user input) associated with a user and may communicate the captured voice signal to the BCD device <b>320</b> with additional information including one or more of a user name, user identifier, a geographic location associated with the use (e.g., a current location, a residence location, and the like), a device identifier of the SVA node, capturing the information, and the like). The integration module may then determine a randomized frequency for inclusion with the captured natural voice signal based on at least the additional information received from the SVA node <b>210</b> and/or user associated information (e.g., user fingerprint biometric information, user retina scan biometric information, and the like) retrieved from a data repository, such as the biometric information data repository <b>130</b>. In an illustrative example, a randomized frequency may be obtained using a number returned from one of a pseudo-random number generator or a true random number generator, where a seed number may correspond to one of a base frequency in a sub-audible range and/or a number associated with biometric information, geolocation information, and/or the like. In an illustrative user verification application, a true random number generator may be used, based on a geolocation of the user device. For example, a latitude value, a longitude value, an address number associated with a latitude and longitude value received from the SVA node <b>210</b> may be used to calculate a true random number to be used in determining the frequency and/or amplitude of an additional signal to enhance the natural voice signal to generate a synthesized voice signal associated with the user. For example, the random number Rnum may be generated by the formula Rnum=RND(GeoVal), where RND( ) is a true random number generator function and GeoVal is a value associated with the geolocation of the user, such as a latitude, a longitude, a value combining the latitude and longitude of the users location, and/or the like. To determine the frequency, this random number may be used as a variable in a frequency determination function. For example, the frequency F may be determined using a formula, such as F=Fbase*(Rnum.*a), where Fbase is a predetermined sub-audible frequency, Rnum is the calculated random number and a is a scalar value for scaling the random number to ensure F remains within a predetermined range. Please note that the equations are shown for illustrative purposes and other such formulas and/or equations may be used.
In many situations, the frequency determination may be done a single time for a communications session. In some cases, a rotating frequency may be used by the integration module <b>360</b>, where the rotating frequency may be determined at a first time associated with a user action, such as when a user attempts to log into an account. In some cases, such as during communications requiring a higher security level, the rotating frequency may change during the duration of the communications while the user is logged into the account. In some cases, the changing of the rotating frequency may be done during a session as a checkpoint during the session to ensure a same individual that logged into the account is participating in the session.
In some cases, a collection module <b>350</b> may be configured to collect input processed by the BCD <b>320</b>. For example, the collection module <b>350</b> may identify a user and/or a business unit associated with the input data and aggregate the data associated with each user and/or business unit individually. In some cases, the collection module may be customized by a user or administrator to generate a report for use internally by the organization, reporting to a central agency, and/or reporting to a government agency when laws, rules and/or regulation require reporting profile based data. In some cases, the collection module may be used to log off each synthesized voice activity for auditing, non-repeating check and other compliance directives.
In an illustrative example, the components of the synthesized voice authentication system <b>100</b> may be used to create and user synthesized voice information for authentication and verification processes to help guarantee data security and/or minimize suspicious and improper activity associated with user accounts. The SVA nodes <b>110</b><i>a</i>-<b>110</b><i>n </i>and the BCD <b>120</b> may, with additional information provided by the biometric data repository <b>130</b> and/or the business unit computing systems <b>140</b>, may be used to generate a synthesized voice for one or more users. In some cases, the SVA <b>110</b> may capture a user's voice in an audio clip and the additional information may be encoded into the audio clip, such as by creating a digital audio watermark, to create a unique identification for a particular user. In some cases, data may be encoded in real time or near real-time. In cases of suspected suspicious activity and/or improper activity, the synthesized voice identifier used by a user may be analyzed, such as by the BCD <b>120</b>, to verify the user's identity and or validate the authentication information. In an illustrative example, an individual may attempt to set up a large (e.g., greater than $100,000) commercial loan. The synthesized voice identifier provided by the user may be analyzed by the BCD <b>120</b> to ensure that the synthesized voice identifier has not already been associated with another individual. If so, the transaction and/or user may be identified for further examination and/or may be reported to local law enforcement for investigation. In some cases, real-time vocal events may be communicated in near real-time to ensure a same individual has continued in the transaction. Such audio communications may be recorded and stored for a predetermined time period. In this way, audio signals may be used to ensure a unique individual is associated with a unique synthesized voice identifier, even those who normally due to disabilities or other reasons, are not capable of using traditional voice recognition techniques. In some cases, a synthesized voice identifier may be paired with other biometric identifiers to ensure greater security, such as by using retina scan information, facial recognition information, fingerprint information and/or the like.
<figref idref="DRAWINGS">FIG. 4</figref> shows an illustrative method <b>400</b> for generating a synthesized voice authentication signal according to aspects of this disclosure. At <b>410</b> a synthetic voice authorization (SVA) device, such as the SVA nodes <b>110</b> of <figref idref="DRAWINGS">FIG. 1</figref> may be configured to capture an audio signal of a voice of the user of the SVA device. In some cases, the SVA device <b>110</b> may capture a real-time, or near real-time, voice signal. In some cases, the SVA device <b>110</b> may capture a recorded audio signal, such as an audio clip or sample having a set duration. In some cases, the SVA node may capture the audio signal in response to an input received via an input device at the SVA node <b>110</b>. In some cases, the SVA node may receive a request to capture an audio input signal from the user in response to a request received via the network <b>115</b>, based on the user attempting to an activity requiring authentication of user credentials and/or secure data handling based on the requested activity. In some cases, at least a portion of the audio sample may be saved in a data repository local to the SVA node <b>110</b> and/or at a centralized data repository, such as the data repository <b>130</b>.
At <b>420</b>, the captured audio signal may be modified based on randomized biometric information in response to additional information captured and associated with the user. In some cases, the SVA node, when capturing an audio sample of the user, may capture other information, such as location information (e.g., a geographic location of the user and/or the SVA device <b>110</b> capture using the location sensor <b>260</b>), biometric information (e.g., a retinal scan and/or a facial recognition scan using the camera <b>250</b>, fingerprint information captured using the fingerprint sensor <b>240</b> and/or the like. In some cases, the SVA device <b>110</b> may analyze at least a portion of the captured information locally and/or may communicate the captured information via the network <b>115</b> to the biometric combinatory device <b>120</b> for analysis and/or modification. In some cases, the geolocation information, the biometric information and/or other information may be analyzed and used in calculations to generate information used to modify the captured audio signal (e.g., a natural voice signal). In some cases, the BCD <b>120</b> may analyze geolocation information to generate a randomized frequency or combination of frequencies, to be included in or superimposed upon the natural voice signal. In such cases, the randomized frequency may be inaudible to humans and may provide little to no distortion to the natural voice signal, but may be found based on, for example, a frequency analysis performed on the synthesized voice signal. In some cases, the SVA <b>110</b> may process the information locally to generate the “audio watermark” to be superimposed on the audio signal. In some cases, the BCD device may process the information at a central location and communicate the determined digital watermark to the SVA <b>110</b> for inclusion into the audio watermark in the synthesized voice identifier associated with that particular user. In some cases, such as for individuals with disabilities and/or difficulty with speaking, the audio sample may be machine generated audio, or in some cases, a modified text to speech format.
At <b>430</b>. the SVA <b>110</b> may use the audio watermark to modify the captured voice signal to generate a synthesized voice signal associated with the user. The SVA <b>110</b> may superimpose the audio watermark, or other such frequency based signal, onto the captured voice signal. In some cases, the audio watermark may be based on geolocation information, or other such user related information.
At <b>440</b>, the SVA <b>110</b> may generate a synthesized voice identifier, for use by the user, based on the combined audio watermark and the captured audio signal. In some cases, the SVA <b>110</b> may generate the synthesized voice identifier based, at least in part, on geolocation information captured by the SVA device, and/or other such information (e.g., biometric information and the like).
<figref idref="DRAWINGS">FIG. 5</figref> shows an illustrative method <b>500</b> for aggregating and analyzing biometric and synthesized voice authentication signals according to aspects of this disclosure. At <b>510</b>, a collection module of the BCD <b>120</b> may aggregate synthesized voice information from a plurality of SVA nodes, wherein each synthesized voice identifier is associated with a particular user. At <b>520</b>, an integration module may aggregate biometric information and/or geographic information associated with each particular user from a plurality of sources including the VCA <b>110</b>, biometric information data repositories, and/or business unit computing systems. At <b>530</b>, a markup language translation module may configure a synthesized voice signal for an SVA node based on a randomized frequency determined from geolocation information and/or biometric information and receive at an aggregation engine, one or more synthesized voice signals from a plurality of SVA nodes, in response to a user request for accessing secured information and/or to perform an action requiring proper authentication.
One or more aspects of the disclosure may be embodied in computer-usable data or computer-executable instructions, such as in one or more program modules, executed by one or more computers or other devices to perform the operations described herein. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types when executed by one or more processors in a computer or other data processing device. The computer-executable instructions may be stored as computer-readable instructions on a computer-readable medium such as a hard disk, optical disk, removable storage media, solid-state memory, RAM, and the like. The functionality of the program modules may be combined or distributed as desired in various embodiments. In addition, the functionality may be embodied in whole or in part in firmware or hardware equivalents, such as integrated circuits, application-specific integrated circuits (ASICs), field programmable gate arrays (FPGA), and the like. Particular data structures may be used to more effectively implement one or more aspects of the disclosure, and such data structures are contemplated to be within the scope of computer executable instructions and computer-usable data described herein.
Various aspects described herein may be embodied as a method, an apparatus, or as one or more computer-readable media storing computer-executable instructions. Accordingly, those aspects may take the form of an entirely hardware embodiment, an entirely software embodiment, an entirely firmware embodiment, or an embodiment combining software, hardware, and firmware aspects in any combination. In addition, various signals representing data or events as described herein may be transferred between a source and a destination in the form of light or electromagnetic waves traveling through signal-conducting media such as metal wires, optical fibers, or wireless transmission media (e.g., air or space). In general, the one or more computer-readable media may be and/or include one or more non-transitory computer-readable media.
As described herein, the various methods and acts may be operative across one or more computing servers and one or more networks. The functionality may be distributed in any manner, or may be located in a single computing device (e.g., a server, a client computer, and the like). For example, in alternative embodiments, one or more of the computing platforms discussed above may be combined into a single computing platform, and the various functions of each computing platform may be performed by the single computing platform. In such arrangements, any and/or all of the above-discussed communications between computing platforms may correspond to data being accessed, moved, modified, updated, and/or otherwise used by the single computing platform. Additionally, or alternatively, one or more of the computing platforms discussed above may be implemented in one or more virtual machines that are provided by one or more physical computing devices. In such arrangements, the various functions of each computing platform may be performed by the one or more virtual machines, and any and/or all of the above-discussed communications between computing platforms may correspond to data being accessed, moved, modified, updated, and/or otherwise used by the one or more virtual machines.
Aspects of the disclosure have been described in terms of illustrative embodiments thereof. Numerous other embodiments, modifications, and variations within the scope and spirit of the appended claims will occur to persons of ordinary skill in the art from a review of this disclosure. For example, one or more of the steps depicted in the illustrative figures may be performed in other than the recited order, and one or more depicted steps may be optional in accordance with aspects of the disclosure.
Contents5
6 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6
Every citation, both waysCites: the store holds 1 of 2
| Document | Relation | Office | Category | Cited during | Relevant claims |
|---|---|---|---|---|---|
| US10891208B2 | Cited by | United States of America | – | Search report | – |
| US10789819B1 | Cited by | United States of America | – | Applicant | – |
| US2020186962A1 | Cited by | United States of America | – | Search report | – |
| US11114091B2 | Cited by | United States of America | – | Search report | – |
| US7379872B2 | Cites | United States of America | Y | Search report | 1-20 |
4 members in 1 office
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 201615382935 | United States of America | A | |
| US201615382935 | – | – | – |
Members4
| Document | Office | Kind | |
|---|---|---|---|
| US2018174591A1 | United States of America | A1 | |
| US10446157B2 | United States of America | B2 | |
| US2019392841A1 | United States of America | A1 | |
| US10978078B2 | United States of America | B2 |
34 transactions on the USPTO file
1 non-final rejection on record.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Email NotificationEML_NTR | EML_NTR | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Email NotificationEML_NTR | EML_NTR | |
| Application Is Now CompleteCOMP | COMP | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Sent to Classification ContractorPGPC | PGPC | |
| FITF set to YES - revise initial settingFTFS | FTFS | |
| Cleared by OIPE CSRL194 | L194 | |
| Patent Term Adjustment - Ready for ExaminationPTA.RFE | PTA.RFE | |
| PTO/SB/69-Authorize EPO Access to Search ResultsSREXR141 | SREXR141 | |
| Applicants have given acceptable permission for participating foreignAPPERMS | APPERMS | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Entity status set to undiscounted (initial default setting or status change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
7 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee paymentMAFP | MAFP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| Information on status: patent application and granting procedure in generalPUBLICATIONS -- ISSUE FEE PAYMENT VERIFIEDSTPP | STPP | |
| Information on status: patent application and granting procedure in generalNOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONSSTPP | STPP | |
| Information on status: patent application and granting procedure in generalRESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINERSTPP | STPP | |
| Information on status: patent application and granting procedure in generalNON FINAL ACTION MAILEDSTPP | STPP | |
| AssignmentAS | AS |
Numbers
- Publication
- 20180174591
- Publication, DOCDB
- 2018174591
- Publication, EPODOC
- US2018174591
- Application
- 15382935
- Application, DOCDB
- 201615382935
- Application, EPODOC
- US201615382935
Titles
- English
- Synthesized Voice Authentication Engine
Classification
- CPC, 8
- G10L17/02
- G10L13/00
- G10L17/20
- G10L17/22
- G10L13/02
- G10L13/08
- G10L17/00
- H04L63/107
- IPC, 3
- G10L17 02
- G10L17 22
- G10L17 20
- USPC, 1
- 001001000