Voice activated communication system and program guide
Claim Score by NHIP
Abstract
A subscriber unit for use with a program guide selection system is described. The program guide selection system provides program guide information which is communicated over a communication network and includes operating characteristics of a communication system and selection codes which are associated with the operating characteristics of the communication system. The subscriber unit includes: a receiver for receiving the program guide information and the selection codes associated with the operating characteristics, a display for displaying the program guide information and the selection codes to a subscriber, a microphone which is employed by the subscriber, when the subscriber identifies on the display a selection code which is associated with a requested one of the operating characteristics, to orally input a voice expression which includes the selection code, and a speech recognition unit which is coupled to the microphone and is operative to enable selection of the requested one of the operating characteristics in response to the voice expression.

Term
Term ended
Projected expiry passed 17 December 2017, 8.8 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
50 claims: 13 independent, 37 dependent
- 1A subscriber unit for use with a program guide selection system in which program guide information, which includes operating characteristics of a communication system and selection codes which are associated with the operating characteristics of the communication system, is communicated over a communication network and displayed on a display viewed by a subscriber, the subscriber unit comprising:a receiver for receiving the program guide information and the selection codes associated with the operating characteristics;a microphone employed by the subscriber, when the subscriber identifies on the display at least one of the selection codes which is associated with at least a requested one of the operating characteristics, to orally input a voice expression which includes said at least one of the selection codes;and a speech recognition unit coupled to the microphone and operative to enable selection of said at least a requested one of the operating characteristics in response to said voice expression.
- 5A program guide selection system comprising:a communication network for communicating program guide information which includes operating characteristics of a communication system and selection codes associated with the operating characteristics of the communication system;and a multiplicity of subscriber units, each including: a receiver for receiving the program guide information and the selection codes associated with the operating characteristics;a display for displaying the program guide information and the selection codes to a subscriber;a microphone employed by the subscriber, when the subscriber identifies on the display at least one of the selection codes which is associated with at least a requested one of the operating characteristics, to orally input a voice expression which includes said at least one of the selection codes;and a speech recognition unit coupled to the microphone and operative to enable selection of said at least a requested one of the operating characteristics in response to said voice expression.
- 11A program guide selection system comprising:a communication network for communicating program guide information which includes operating characteristics of a communication system and selection codes associated with the operating characteristics of the communication system;and a multiplicity of subscriber units, each including: a receiver for receiving the program guide information and the selection codes associated with the operating characteristics;a microphone employed by a subscriber for oral input of a selection code, the selection code being associated with a requested one of the operating characteristics of the communication system;a camera operative to take a picture of the subscriber when located in the field of view of the camera;a processor operative to associate speech characteristics of each of a multiplicity of speakers with images of each of the multiplicity of speakers taken thereof;an image processor, coupled to the camera and to the processor, and operative to compare the picture of the subscriber to the images of each of the multiplicity of speakers and to determine whether the picture of the subscriber is substantially similar to an image of a speaker;and a speech recognition unit coupled to the microphone and to the processor and customized to respond to the selection code inputted orally by the subscriber and to enable selection of the requested one of the operating characteristics of the communication system associated with the selection code upon a determination that the picture of the subscriber is substantially similar to the image of the speaker, and that speech characteristics of the subscriber substantially match speech characteristics associated with the speaker.
- 13A subscriber unit for use with a program guide selection system in which program guide information, which includes operating characteristics of a communication system, is communicated over the communication network, the subscriber unit comprising:a receiver for receiving the program guide information and the operating characteristics of the communication system;a microphone employed by a subscriber for oral input of a selection code, the selection code being associated with a requested one of the operating characteristics of the communication system;a camera operative to take a picture of the subscriber when located in the field of view of the camera;a processor operative to associate speech characteristics of each of a multiplicity of speakers with images of each of the multiplicity of speakers taken thereof;an image processor, coupled to the camera and to the processor, and operative to compare the picture of the subscriber to the images of each of the multiplicity of speakers and to determine whether the picture of the subscriber is substantially similar to an image of a speaker;and a speech recognition unit coupled to the microphone and to the processor and customized to respond to the selection code inputted orally by the subscriber and to enable selection of the requested one of the operating characteristics of the communication system associated with the selection code upon a determination that the picture of the subscriber is substantially similar to the image of the speaker, and that speech characteristics of the subscriber substantially match speech characteristics associated with the speaker.
- 22A subscriber unit for use with a program guide selection system, wherein program guide information is communicated over a communication network, and the program guide information includes operating characteristics of a communication system, the subscriber unit comprising:a receiver for receiving the program guide information including the operating characteristics;a memory for storing selection codes which enable selections from the operating characteristics;a processor for associating the selection codes with the operating characteristics;a display for displaying the program guide information and the selection codes to a subscriber;a microphone employed by the subscriber, when the subscriber identifies on the display a selection code which is associated with a requested one of the operating characteristics, to orally input a voice expression which includes the selection code;and a speech recognition unit coupled to the microphone and operative to enable selection of said requested one of the operating characteristics in response to said voice expression.
- 27A determination system for determining, from among a plurality of viewers of a communication system, a viewer who is authorized to select a requested one of operating characteristics of the communication system, the determination system comprising:a camera operative to take a picture of the viewer when located in the field of view of the camera;and an image processor coupled to the camera and operative to compare the picture of the viewer to stored images of the plurality of viewers, to determine whether the picture of the viewer is substantially similar to one of the stored images, and to authorize the viewer to select the requested one of the operating characteristics of the communication system in response to a determination that the picture of the viewer is substantially similar to said one of the stored images.
- 28A voice selection method for enabling a user to select a requested one of operating characteristics of a communication system from among a plurality of the operating characteristics of the communication system which are displayed on a display, the method comprising:associating each one of said plurality of the operating characteristics with a selection code;displaying at least some of the plurality of the operating characteristics and selection codes associated therewith on the display;identifying, on the display, a requested selection code which corresponds to the requested one of the operating characteristics;accepting an oral input of a voice expression which includes an oral input of the requested selection code;and selecting said requested one of the operating characteristics in response to said voice expression.
- 34A voice selection method for selecting a requested one of operating characteristics of a communication system from among a plurality of the operating characteristics of the system, the method comprising:arranging said plurality of the operating characteristics of the system in a two-dimensional table having cells defined by rows and by columns, each of the rows being associated with a separate character from a first series of characters, and each of the columns being associated with a separate character from a second series of characters;displaying, on a display, said two-dimensional table, characters associated with the rows, and characters associated with the columns;identifying a cell which corresponds to the requested one of the operating characteristics;recognizing a row and a column which define the cell;accepting, at a microphone, an oral input of a voice expression, the accepting including, accepting, sequentially and in any order thereof, an oral input of a character associated with the row and an oral input of a character associated with the column;and selecting said requested one of the operating characteristics in response to said voice expression.
- 38A voice selection method for selecting a requested one of operating characteristics of a communication system from among a plurality of the operating characteristics of the system, the method comprising:arranging said plurality of the operating characteristics of the system in a one-dimensional table having cells defined by rows, each of the rows being associated with a separate character from a series of characters;displaying, on a display, said one-dimensional table and characters associated with the rows;identifying a cell which corresponds to the requested one of the operating characteristics;recognizing a row that defines the cell;accepting, at a microphone, an oral input of a voice expression which includes an oral input of a character that is associated with the row;and selecting said requested one of the operating characteristics in response to said voice expression.
- 40A voice selection method for selecting a requested one of operating characteristics of a communication system from among a plurality of the operating characteristics of the system which are displayed on a display, the method comprising:arranging said plurality of the operating characteristics of the system in a display tableau having pre-positioned selection areas each associated with a selection code from a series of codes;displaying, on the display, said tableau having pre-positioned selection areas and the series of codes associated with the selection areas;identifying an area which corresponds to the requested one of the operating characteristics;recognizing a requested selection code which is associated with the area;accepting, at a microphone, an oral input of a voice expression which includes an oral input of the requested selection code associated with the area;and selecting said requested one of the operating characteristics in response to said voice expression.
- 43A voice selection method for enabling a user to select a requested one of operating characteristics of a communication system from among a plurality of the operating characteristics of the system which are displayed on a display, the method comprising:providing a speech recognition unit which is operative to respond to speech from a multiplicity of speakers;storing speech characteristics of each of the multiplicity of speakers;associating the speech characteristics of each of the multiplicity of speakers with images of each of the multiplicity of speakers taken thereof;providing a camera which is operative to take a picture of the user when located in the field of view of the camera;comparing the picture of the user to the images of each of the multiplicity of speakers;determining that the picture of the user is substantially similar to an image of a speaker;and executing a voice command provided by the user only and associated with the requested one of the operating characteristics in response to said determining step, and in accordance with a determination that speech characteristics of the user substantially match speech characteristics associated with the speaker.
- 45A voice selection method for enabling a user to select a requested one of operating characteristics of a communication system from among a plurality of the operating characteristics of the system which are displayed on a display, the method comprising:receiving the plurality of the operating characteristics;associating the plurality of the operating characteristics with selection codes which enable selections from the plurality of the operating characteristics;displaying the plurality of the operating characteristics and the selection codes associated therewith to a subscriber;identifying, on the display, a requested selection code which corresponds to the requested one of the operating characteristics;accepting, at a microphone, an oral input of a voice expression which includes an oral input of the requested selection code;and selecting said requested one of the operating characteristics in response to said voice expression.
- 49Broadest claimClaim Score 83, broad(NHIP)From among a plurality of viewers of a communication system, a method of determining a viewer who is authorized to select a requested one of operating characteristics of the communication system, the method comprising:providing a camera operative to take a picture of the viewer when located in the field of view of the camera;comparing the picture of the viewer to stored images of the plurality of viewers;determining that the picture of the viewer is substantially similar to one of the stored images;and authorizing the viewer to select the requested one of the operating characteristics of the communication system in response to said determining step.
Independent claims13
379 paragraphs in 5 sections, as filed
FIELD OF THE INVENTION
[0001] The present invention relates to communication systems generally and more particularly to television and pay television systems and to methods and devices which are employed to operate various functions in television and pay television systems.
BACKGROUND OF THE INVENTION
[0002] There are known in the art voice activation devices which are used to activate various apparatus and systems. Typically, the voice activation devices are employed to turn on and off an appliance, such as a lighting system, a security system and a personal terminal.
[0003] U.S. Pat. Nos. 5,199,080 and 5,226,090 describe a voice-operated remote control system which transmits a remote control signal in response to a voice command. The remote control of U.S. Pat. No. 5,199,080 has a speech recognition circuit for recognizing the voice command. The remote control system of U.S. Pat. No. 5,226,090 further includes a detector for detecting whether a voice command is received or not.
[0004] U.S. Pat. No. 5,163,111 describes a customized personal terminal device which is capable of operating in response to input data peculiar to the operator and comprises a speech recognition unit for recognizing inputted speech, an image recognition unit for recognizing inputted image, and an instruction recognition unit for recognizing an inputted instruction.
[0005] U.S. Pat. No. 4,975,960 describes an electronic facial tracking and detection system and method and apparatus for automated speech recognition which includes circuitry for obtaining a video image of an individual's face, circuitry for electronically locating and tracking a first feature, such as the nostrils, of the facial image for use as reference coordinates, and circuitry responsive to the reference coordinates for locating and tracking a second facial feature, such as the mouth, of the facial image with respect to the first feature.
[0006] U.S. Pat. No. 5,086,385 describes a system and a method for providing an expandable home automation controller which supports multiple numbers and multiple different types of data communications with both appliances and subsystems within the home as well as systems external to the home. The system allows for the input of commands by a variety of means such as touchscreens, voice recognition systems, telephones, custom switches or any device capable of providing an input to a computer system.
[0007] U.S. Pat. No. 5,027,149 describes a voice-recognition camera for taking photographs by voice recognition operations. The camera comprises a microphone through which voiced command words of an operator are registered in a computer as a form of digital data.
[0008] U.S. Pat. No. 4,706,121 describes a system which controls a television receiver to allow user selection of broadcast programs from schedule information.
[0009] In an article entitled “Vision system finds faces in a crowd” on pages 52-56 in the Laser Focus Magazine of November 1996, a vision system which includes a software called Facelt published by Visionics Corporation of Metuchen, N.J. is described. The system won a competition that was part of a program named FERET which is funded by the U.S. Defense Advanced Research Projects Agency. In the competition various automated face recognition systems were tested using a single database of thousands of faces that includes a wide range of ages races and poses.
[0010] Conventional voice recognition systems are described in a book entitled “Automatic Speech Recognition, The Development of the SPHINX System”, by Kai-Fu Lee, Kluwer Academic Publishers, on pp. 1-5, and in a book entitled “Digital Speech Processing, Synthesis, and Recognition”, by Sadaoki Fururi, Marcel Dekker, Inc. Publishing, in Chapter 8.
[0011] The disclosures of all references mentioned above and throughout the specification are incorporated herein by reference.
SUMMARY OF THE INVENTION
[0012] The present invention seeks to provide voice activation devices and methods which are employed to operate various functions in entertainment and information communication systems, such as television and pay television systems.
[0013] There is thus provided in accordance with a preferred embodiment of the present invention a program guide selection system including:
[0014] a communication network for communicating program guide information and selection codes which enable selections of operating characteristics of a communication system from the program guide information, the selection codes being associated with the operating characteristics; and
[0015] a multiplicity of subscriber units, each including:
[0016] a receiver for receiving the program guide information and the selection codes associated with the operating characteristics;
[0017] a display for displaying the program guide information and the selection codes to a subscriber;
[0018] a microphone which is responsive to a voice expression spoken by the subscriber upon identification, on the display, of a selection code which is associated with a requested one of the operating characteristics, wherein the voice expression includes the selection code; and
[0019] a speech recognition unit which is coupled to the microphone and is operative to select the requested one of the operating characteristics in response to the voice expression.
[0020] Preferably, the communication network includes at least one of the following: a computer network, a television network, a cable television network, a satellite communication network, a telephone network, and a videophone network.
[0021] There is also provided in accordance with a preferred embodiment of the present invention a subscriber unit for use with a program guide selection system in which program guide information is communicated over a communication network, wherein the program guide information includes operating characteristics of a communication system and selection codes which are associated with the operating characteristics of the communication system, the subscriber unit including:
[0022] a receiver for receiving the program guide information and the selection codes associated with the operating characteristics;
[0023] a display for displaying the program guide information and the selection codes to a subscriber;
[0024] a microphone which is responsive to a voice expression spoken by the subscriber upon identification, on the display, of a selection code which is associated with a requested one of the operating characteristics, wherein the voice expression includes the selection code; and
[0025] a speech recognition unit which is coupled to the microphone and is operative to select the requested one of the operating characteristics in response to the voice expression.
[0026] Preferably, the speech recognition unit includes an external removable speech recognition module, the subscriber unit includes an interface unit, and the external removable speech recognition module is operative to select the requested one of the operating characteristics via the interface unit.
[0027] Additionally, the subscriber unit may include:
[0028] a memory which is coupled to the speech recognition unit and is operative to store speech characteristics of the subscriber, and wherein
[0029] the speech recognition unit is operative to compare characteristics of the voice expression to the speech characteristics of the subscriber, and to select the requested one of the operating characteristics only when the characteristics of the voice expression substantially matches the speech characteristics of the subscriber.
[0030] Preferably, the program guide information is compressed prior to transmission over the communication network, and the subscriber unit includes a compressor/decompressor which is operative to decompress the program guide information, to compress the speech characteristics of the subscriber prior to storage in the memory, and to decompress the speech characteristics of the subscriber upon retrieval from the memory.
[0031] In accordance with a preferred embodiment of the present invention there is also provided a program guide selection system including:
[0032] a communication network for communicating program guide information and selection codes which enable selections of operating characteristics of a communication system from the program guide information, the selection codes being associated with the operating characteristics; and
[0033] a multiplicity of subscriber units, each including:
[0034] a receiver for receiving the program guide information and the selection codes associated with the operating characteristics;
[0035] a microphone which is employed by a subscriber to provide, by speaking, a selection code;
[0036] a speech recognition unit which is coupled to the microphone and is customized to respond to the selection codes when spoken by each of multiple speakers in accordance with speech characteristics of each of the multiple speakers;
[0037] a camera which is operative to take a picture of the subscriber when located in the field of view of the camera;
[0038] a processor which is coupled to the speech recognition unit and is operative to associate the speech characteristics of each of the multiple speakers with images of each of the multiple speakers taken thereof; and
[0039] an image processor, which is coupled to the camera and to the processor, and is operative to compare the picture of the subscriber to the images of each of the multiple speakers and to determine whether the picture of the subscriber is substantially similar to an image of a speaker, wherein
[0040] the speech recognition unit is operative, in response to a determination that the picture of the subscriber is substantially similar to the image of the speaker, to select a requested one of the operating characteristics of the communication system associated with the selection code in accordance with a determination by the speech recognition unit that speech characteristics of the subscriber substantially matches speech characteristics associated with the speaker.
[0041] Preferably, each of the selection codes includes one of letter characters, number characters, and combination letter and number characters. Additionally, each of the selection codes includes an instruction code associated with an instruction for execution of an operation.
[0042] Alternatively or additionally, each of the selection codes includes at least one of words, phrases and sentences. Preferably, each of the selection codes further includes an instruction code associated with an instruction for execution of an operation.
[0043] Further, there is also provided in accordance with a preferred embodiment of the present invention a subscriber unit for use with a program guide selection system in which program guide information is communicated over a communication network, wherein the program guide information includes operating characteristics of a communication system and selection codes which are associated with the operating characteristics of the communication system, the subscriber unit including:
[0044] a receiver for receiving the program guide information and the selection codes associated with the operating characteristics;
[0045] a microphone which is employed by a subscriber to provide, by speaking, a selection code;
[0046] a speech recognition unit which is coupled to the microphone and is customized to respond to the selection codes when spoken by each of multiple speakers in accordance with speech characteristics of each of the multiple speakers;
[0047] a camera which is operative to take a picture of the subscriber when located in the field of view of the camera;
[0048] a processor which is coupled to the speech recognition unit and is operative to associate the speech characteristics of each of the multiple speakers with images of each of the multiple speakers taken thereof; and
[0049] an image processor, which is coupled to the camera and to the processor, and is operative to compare the picture of the subscriber to the images of each of the multiple speakers and to determine whether the picture of the subscriber is substantially similar to an image of a speaker, wherein
[0050] the speech recognition unit is operative, in response to a determination that the picture of the subscriber is substantially similar to the image of the speaker, to select a requested one of the operating characteristics of the communication system associated with the selection code in accordance with a determination by the speech recognition unit that speech characteristics of the subscriber substantially matches speech characteristics associated with the speaker.
[0051] Additionally, the subscriber unit includes a memory which communicates with at least one of the processor, the speech recognition unit, and the image processor, wherein the memory is operative to store at least one of the speech characteristics of each of the multiple speakers and the images of each of the multiple speakers.
[0052] Preferably, the memory includes a removable external memory module, the subscriber unit includes an external memory reader, and the removable external memory module communicates with the at least one of the processor, the speech recognition unit, and the image processor via the external memory reader.
[0053] In a preferred embodiment of the present invention the speech recognition unit includes an external removable speech recognition module, the subscriber unit includes an interface unit, and the external removable speech recognition module is operative to select the requested one of the operating characteristics via the interface unit.
[0054] Additionally, the subscriber unit includes an on-screen-display (OSD) unit which is operative to insert on-screen messages in response to instructions provided by at least one of the speech recognition unit and the processor.
[0055] Preferably, the subscriber unit includes a decrypter which is operative to decrypt encrypted incoming information in response to an authorization signal provided by at least one of the speech recognition unit and the processor.
[0056] Additionally, the subscriber unit includes a compressor/decompressor which is operative to compress the at least one of the speech characteristics of each of the multiple speakers and the images of each of the multiple speakers prior to storage in the memory, and to decompress the at least one of the speech characteristics of each of the multiple speakers and the images of each of the multiple speakers upon retrieval from the memory.
[0057] In accordance with a preferred embodiment of the present invention there is also provided a subscriber unit for use with a program guide selection system in which program guide information is communicated over a communication network, wherein the program guide information includes operating characteristics of a communication system, the subscriber unit including:
[0058] a receiver for receiving the program guide information including the operating characteristics;
[0059] a memory for storing selection codes which enable selections from the operating characteristics;
[0060] a processor for associating the selection codes with the operating characteristics;
[0061] a display for displaying the program guide information and the selection codes to a subscriber;
[0062] a microphone which is responsive to a voice expression spoken by the subscriber upon identification, on the display, of a selection code which is associated with a requested one of operating characteristics, wherein the voice expression includes the selection code; and
[0063] a speech recognition unit which is coupled to the microphone and is operative to select the requested one of the operating characteristics in response to the voice expression.
[0064] Further in accordance with a preferred embodiment of the present invention there is provided a subscriber unit for use with a program guide selection system in which program guide information is communicated over a communication network, wherein the program guide information includes operating characteristics of a communication system, the subscriber unit including:
[0065] a receiver for receiving the program guide information including the operating characteristics;
[0066] a microphone which is responsive to speech;
[0067] a memory for storing selection codes which enable selections from the operating characteristics, speech characteristics of each of multiple speakers, and images of each of the multiple speakers taken thereof;
[0068] a camera which is operative to take a picture of a subscriber when located in the field of view of the camera;
[0069] a processor which is operative to associate the selection codes with the operating characteristics, and to associate the speech characteristics of each of the multiple speakers with the images of each of the multiple speakers;
[0070] an image processor, which is coupled to the camera, to the processor and to the memory and is operative to compare the picture of the subscriber to the images of each of the multiple speakers and to determine whether the picture of the subscriber is substantially similar to an image of a speaker; and
[0071] a speech recognition unit which is coupled to the microphone, to the processor and to the memory and is operative, in response to a determination that the picture of the subscriber is substantially similar to the image of the speaker, to select a requested one of the operating characteristics of the communication system in response to a selection code spoken by the subscriber via the microphone and in accordance with a determination, by the speech recognition unit, that speech characteristics of the subscriber substantially matches speech characteristics associated with the speaker.
[0072] There is also provided in accordance with a preferred embodiment of the present invention a determination system for determining, from among a plurality of viewers of a communication system, a viewer who is exclusively authorized to select a requested one of operating characteristics of the communication system, the determination system including:
[0073] a camera which is operative to take a picture of the viewer when located in the field of view of the camera; and
[0074] an image processor which is coupled to the camera and is operative to compare the picture of the viewer to stored images of the plurality of viewers, to determine whether the picture of the viewer is substantially similar to one of the stored images, and to exclusively authorize the viewer to select the requested one of the operating characteristics of the communication system in response to a determination that the picture of the viewer is substantially similar to one of the stored images.
[0075] In accordance with a preferred embodiment of the present invention there is provided a voice selection method for enabling a user to select a requested one of operating characteristics of a communication system from a plurality of the operating characteristics of the system which are displayed on a display, the method including:
[0076] associating each one of the plurality of the operating characteristics with a selection code;
[0077] displaying at least some of the plurality of the operating characteristics and selection codes associated therewith on the display;
[0078] identifying, on the display, a requested selection code which corresponds to the requested one of the operating characteristics;
[0079] saying a voice expression which includes the requested selection code; and
[0080] selecting the requested one of the operating characteristics in response to the voice expression.
[0081] Preferably, the selecting step includes:
[0082] detecting the voice expression which includes the requested selection code;
[0083] verifying that the requested selection code is a legitimate code which is associated with a legitimate selection of one of the operating characteristics; and
[0084] executing a selection of the requested one of the operating characteristics in response to the verifying step.
[0085] Further, the verifying step also includes the step of recognizing the user as an authorized operator, and the executing step includes executing a selection of the requested one of the operating characteristics in response to verification of the requested selection code and to the recognizing step.
[0086] Preferably, the step of saying a voice expression which includes the requested selection code includes:
[0087] saying the requested selection code; and
[0088] saying an instruction code associated with an instruction for execution of an operation following the step of saying the requested selection code.
[0089] Further preferably, each selection code includes at least a letter character and a number character, and the step of saying a voice expression includes sequentially saying the letter character and the number character in any order thereof.
[0090] There is also provided in accordance with a preferred embodiment of the present invention a voice selection method for selecting a requested one of operating characteristics of a communication system from a plurality of the operating characteristics of the system, the method including:
[0091] arranging the plurality of the operating characteristics of the system in a two-dimensional table having cells defined by rows, which are each associated with a separate character from a first series of characters, and by columns, which are each associated with a separate character from a second series of characters;
[0092] displaying, on a display, the two-dimensional table, the characters associated with the rows, and the characters associated with the columns;
[0093] identifying a cell which corresponds to the requested one of the operating characteristics;
[0094] recognizing a row and a column which define the cell;
[0095] saying a voice expression which includes sequentially saying a character which is associated with the row and a character which is associated with the column in any order thereof; and
[0096] selecting the requested one of the operating characteristics in response to the voice expression.
[0097] Preferably, the first series of characters includes letter characters, the second series of characters includes number characters, and the step of saying a voice expression includes sequentially saying a letter character which is associated with the row and a number character which is associated with the column in any order thereof.
[0098] Alternatively, the first series of characters and the second series of characters include letter characters, and the step of saying a voice expression includes sequentially saying a letter character which is associated with the row and a letter character which is associated with the column in any order thereof.
[0099] Further alternatively, the first series of characters and the second series of characters include number characters, and the step of saying a voice expression includes sequentially saying a number character which is associated with the row and a number character which is associated with the column in any order thereof.
[0100] In accordance with another preferred embodiment of the present invention there is also provided a voice selection method for selecting a requested one of operating characteristics of a communication system from a plurality of the operating characteristics of the system, the method including:
[0101] arranging the plurality of the operating characteristics of the system in a one-dimensional table having cells defined by rows which are each associated with a separate character from a series of characters;
[0102] displaying, on a display, the one-dimensional table and the characters associated with the rows;
[0103] identifying a cell which corresponds to the requested one of the operating characteristics;
[0104] recognizing a row that defines the cell;
[0105] saying a voice expression which includes a character that is associated with the row; and
[0106] selecting the requested one of the operating characteristics in response to the voice expression.
[0107] Preferably, the series of characters includes one of letter characters, number characters, and combination letter and number characters.
[0108] In accordance with yet another preferred embodiment of the present invention there is provided a voice selection method for selecting a requested one of operating characteristics of a communication system from a plurality of the operating characteristics of the system which are displayed on a display, the method including:
[0109] arranging the plurality of the operating characteristics of the system in a display screen having pre-positioned selection areas which are each associated with a selection code from a series of codes;
[0110] displaying, on the display, the screen having pre-positioned selection areas and the series of codes associated with the selection areas;
[0111] identifying an area which corresponds to the requested one of the operating characteristics;
[0112] recognizing a requested selection code which is associated with the area;
[0113] saying a voice expression which includes the requested selection code which is associated with the area; and
[0114] selecting the requested one of the operating characteristics in response to the voice expression.
[0115] Preferably, the step of saying a voice expression which includes the requested selection code includes:
[0116] saying the requested selection code; and
[0117] saying an instruction code associated with an instruction for execution of an operation following the step of saying the requested selection code.
[0118] There is also provided in accordance with a preferred embodiment of the present invention a voice selection method for enabling a user to select a requested one of operating characteristics of a communication system from a plurality of the operating characteristics of the system which are displayed on a display, the method including:
[0119] providing a speech recognition unit which is operative to respond to speech from multiple speakers;
[0120] storing speech characteristics of each of the multiple speakers;
[0121] associating the speech characteristics of each of the multiple speakers with images of each of the multiple speakers taken thereof;
[0122] providing a camera which is operative to take a picture of the user when located in the field of view of the camera;
[0123] comparing the picture of the user to the images of the multiple speakers;
[0124] determining that the picture of the user is substantially similar to an image of a speaker; and
[0125] executing, in response to the determining step and in accordance with a determination, by the speech recognition unit, that speech characteristics of the user substantially matches speech characteristics associated with the speaker, a voice command which is spoken by the user only and is associated with the requested one of the operating characteristics.
[0126] Preferably, the executing step includes:
[0127] detecting the voice command spoken by the user;
[0128] verifying that the voice command is a legitimate command which is associated with a selection of the requested one of the operating characteristics; and
[0129] selecting the requested one of the operating characteristics in response to the verifying step.
[0130] In accordance with a preferred embodiment of the present invention there is further provided a voice selection method for enabling a user to select a requested one of operating characteristics of a communication system from a plurality of the operating characteristics of the system which are displayed on a display, the method including:
[0131] receiving the plurality of the operating characteristics;
[0132] storing selection codes which enable selections from the plurality of the operating characteristics;
[0133] associating the plurality of the operating characteristics with the selection codes;
[0134] displaying the plurality of the operating characteristics and the selection codes associated therewith to a subscriber;
[0135] identifying, on the display, a requested selection code which corresponds to the requested one of the operating characteristics;
[0136] saying a voice expression which includes the requested selection code; and
[0137] selecting the requested one of the operating characteristics in response to the voice expression.
[0138] There is also provided in accordance with a preferred embodiment of the present invention a voice selection method for enabling a user to select a requested one of operating characteristics of a communication system from a plurality of operating characteristics of the system which are displayed on a display, the method including:
[0139] receiving the plurality of the operating characteristics;
[0140] storing selection codes which enable selections from the plurality of the operating characteristics, speech characteristics of each of multiple speakers, and images of each of the multiple speakers taken thereof;
[0141] associating the selection codes with the plurality of the operating characteristics;
[0142] associating the speech characteristics of each of the multiple speakers with the images of each of the multiple speakers;
[0143] taking a picture of a subscriber when located in the field of view of the camera;
[0144] comparing the picture of the subscriber to the images of the multiple speakers;
[0145] determining that the picture of the subscriber is substantially similar to an image of a speaker;
[0146] providing a microphone via which the subscriber speaks a selection code;
[0147] determining that speech characteristics associated with the selection code as spoken by the subscriber substantially matches speech characteristics associated with the speaker; and
[0148] selecting a requested one of the operating characteristics of the communication system which is associated with the selection code in response to determination that the picture of the subscriber is substantially similar to the image of the speaker, and in response to determination that the speech characteristics associated with the selection code as spoken by the subscriber substantially matches the speech characteristics associated with the speaker.
[0149] In accordance with another preferred embodiment of the present invention there is provided a method of determining a viewer who is exclusively authorized to select a requested one of operating characteristics of a communication system from among a plurality of viewers of the communication system, the method including:
[0150] providing a camera which is operative to take a picture of the viewer when located in the field of view of the camera;
[0151] comparing the picture of the viewer to stored images of the plurality of viewers;
[0152] determining that the picture of the viewer is substantially similar to one of the stored images; and
[0153] exclusively authorizing the viewer to select the requested one of the operating characteristics of the communication system in response to the determining step.
BRIEF DESCRIPTION OF THE DRAWINGS
[0154] The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which:
[0155]FIG. 1 is a partial pictorial partial block diagram illustration showing the structure and functionality of a preferred implementation of a voice activated communication and entertainment system which includes a televisions the system being constructed and operative in accordance with a preferred embodiment of the present invention;
[0156]FIG. 2 is a generalized block diagram illustration of a CATV converter which forms part of the communication system of FIG. 1 and is constructed and operative in accordance with a preferred embodiment of the present invention;
[0157]FIG. 3 is a generalized block diagram illustration of an alternative preferred implementation of a CATV converter which forms part of the system of FIG. 1;
[0158]FIGS. 4A and 4B together constitute a flow chart illustrating a preferred method of operation of either one of the CATV converter of FIG. 2 and the CATV converter of FIG. 3; and
[0159] FIGS. <b>5</b>A-<b>5</b>I are generalized illustrations of selection screens in a voice activated program guide which is operative with the system of FIG. 1, and is constructed and operative in accordance with a preferred embodiment of the present invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[0160] Reference is now made to FIG. 1, which is a simplified illustration showing the structure and functionality of a voice activated entertainment system constructed and operative in accordance with a preferred embodiment of the present invention.
[0161] A user <b>10</b>, sits on an armchair <b>11</b> and watches a program which is provided via a communication network and is displayed on a television <b>12</b>. The program is preferably transmitted from a headend <b>13</b>, and is typically supplied to subscribers over-the-air -or over cables <b>14</b>. In both cases, however, transmissions are typically supplied to a wall outlet <b>15</b>, and user <b>10</b> plugs in to wall outlet <b>15</b> to receive the transmissions.
[0162] It is to be appreciated that the present invention is particularly useful with a pay television network. However, the invention is not to be limited by the nature of the network, rather any network that is configured to distribute a plurality of multimedia programs to a multiplicity of users may be suitable, such as a computer network, a television network, a satellite communication network, a telephone network, a videophone network and any combination thereof.
[0163] The terms “pay television” and “CATV” (Community Antenna Television) are interchangeably used through the specification and claims in conjunction with systems and networks. Pay television and CATV are also used in the specification and claims in a broad sense to include one-way and two-way cable television as well as satellite television, CATV, and pay television generally. Two-way cable television may include telephone links for two-way communication between subscribers and a headend.
[0164] In a preferred embodiment of the present invention the communication network is a combined radio-frequency (RF) telephone two-way pay television network, in which downlink transmissions are provided over cables <b>14</b>, which are coaxial cables, and uplink transmissions are provided over telephone.
[0165] Preferably, the program is a pay television program which may include a regular television or CATV program, a pay-per-view (PPV) television program, or program schedule information which is part of a program guide as described below. User <b>10</b>, which is also referred to herein as a pay television subscriber, may view the program or view the program schedule information and make selections thereof as described below.
[0166] Typically, the pay television program is received and decoded in a CATV converter <b>17</b>, which is coupled, via a coaxial cable <b>16</b>, to wall outlet <b>15</b>. CATV converter <b>17</b> is preferably also coupled to a video-cassette-recorder (VCR) <b>18</b> by means of a coaxial cable <b>19</b>. It is to be appreciated that VCR <b>18</b> may be any type of video signal recorder such as an analog VCR which operates with magnetic tapes, or a digital VCR, also known as DVD which operates with optical or magneto-optical disks. Preferably, VCR <b>18</b> is coupled to television <b>12</b> via a coaxial cable <b>20</b>.
[0167] The terms “encode” and “decode” in all of their forms are used throughout the specification and claims in a broad sense to cover all forms of data encoding and decoding, ranging from simple scrambling and descrambling or encoding and decoding to hard encryption and decryption respectively.
[0168] In a preferred embodiment of the present invention CATV decoder <b>17</b> is also coupled, via a built-in modem (not shown in FIG. 1) and telephone wires <b>22</b>, to a telephone wall outlet <b>23</b>. Telephone wall outlet <b>23</b> is coupled to a telephone network <b>21</b> via telephone wires <b>25</b>. The modem is employed to provide the above mentioned uplink transmissions.
[0169] Preferably, subscriber <b>10</b> holds a remote control unit <b>24</b> which is employed to control operation of at least one of television <b>12</b>, CATV converter <b>17</b> and VCR <b>18</b>. It is to be appreciated that remote control <b>24</b> may be either a universal remote control which is programmed to control the operation of all three units, i.e. television <b>12</b>, CATV converter <b>17</b> and VCR <b>18</b>, or a customized remote control which operates only one of television <b>12</b>, CATV converter <b>17</b> and VCR <b>18</b>.
[0170] In a preferred embodiment of the present invention remote control unit <b>24</b> is a voice activated remote control which is employed to control the operation of at least one of television <b>12</b>, CATV converter <b>17</b> and VCR <b>18</b>. Such a voice activated remote control unit is described in U.S. Pat. No. 5,199,080.
[0171] Preferably, a camera <b>26</b> is attached to CATV converter <b>17</b> and is mounted thereon. Camera <b>26</b> may be a video camera or a digital photo camera which takes stills or frozen pictures, and may be placed in a position to generally face subscriber <b>10</b>.
[0172] In a preferred embodiment of the present invention CATV converter <b>17</b> may be voice activated under control of camera <b>26</b>, so that when the face of the subscriber is in a frame of video camera <b>26</b>, a recognition system (not shown in FIG. 1) which is built in CATV converter <b>17</b>, recognizes the subscriber, and allows voice commands of the subscriber only to be executed. The functionality of such a recognition system and of camera <b>26</b> are described hereinafter with reference to FIG. 2.
[0173] Reference is now made to FIG. 2 which is a generalized block diagram illustration of a CATV converter <b>50</b> that is operative with the communication system of FIG. 1. CATV converter <b>50</b> is similar in functionality and structure to CATV converter <b>17</b> of FIG. 1.
[0174] Preferably, CATV converter <b>50</b> may process voice selections of a subscriber and voice commands and instructions inputted by the subscriber. The subscriber may employ a voice activated remote control (not shown in FIG. 2), such as voice activated remote control <b>24</b> of FIG. 1 which structure and functionality may be similar to those described in U.S. Pat. Nos. 5,199,080 and 5,226,090. It is to be appreciated that the subscriber may operate the remote control by speaking toward a microphone (not shown) which is built in the remote control.
[0175] In an alternative preferred embodiment of the present invention, the subscriber may speak toward a microphone <b>52</b>, which is preferably built into CATV converter <b>50</b> and is operative to detect a speech signal. Microphone <b>52</b> converts the speech signal to an electric signal as is well known in the art. The electric signal is provided to a speech recognition unit <b>54</b>, also referred to as a voice recognition unit. Hereinafter, the terms “Speech recognition” and “voice recognition” are interchangeably used.
[0176] Speech recognition unit <b>54</b> may be either a speaker dependent speech recognition unit or a speaker independent speech recognition unit. A description of such conventional voice recognition units, which are well known in the art, may be found in many publications, such as in a book entitled “Automatic Speech Recognition, The Development of the SPHINX System”, by Kai-Fu Lee, Kluwer Academic Publishers, on pp. 1-5, and in a book entitled “Digital Speech Processing, Synthesis, and Recognition”, by Sadaoki Fururi, Marcel Dekker, Inc. Publishing, in Chapter 8.
[0177] Generally, in a speaker dependent speech recognition configuration a speaker is identified, and only words or phrases which are spoken by the identified speaker are recognized. In a speaker independent speech recognition configuration specific words are recognized, regardless of the person who speaks them.
[0178] The separate applications of these two configurations of speech recognition units to the present invention are discussed in detail below, and with reference to FIGS. 4A and 4B and FIGS. <b>5</b>A-<b>5</b>I.
[0179] It is to be appreciated that speech recognition unit <b>54</b> may be embedded in a single chip, or alternatively, speech recognition unit <b>54</b> may be a separate electronic card which is inserted in a slot (not shown) in CATV converter <b>50</b>.
[0180] In a preferred embodiment of the present invention speech recognition unit <b>54</b> is coupled to the following units: a subscriber input/output (I/O) interface <b>56</b>, a processor <b>58</b>, a memory <b>60</b>, an on-screen-display (OSD) unit <b>62</b>, a decrypter <b>64</b>, a speaker <b>66</b>, a CATV receiver and tuner <b>72</b>, and a compressor/decompressor <b>74</b> which may form part of CATV receiver and tuner <b>72</b>.
[0181] Preferably, input parameters and factors for operation of speech recognition unit <b>54</b> may be provided to speech recognition unit <b>54</b> via I/O interface <b>56</b>. The input parameters and factors may include a selection of an operation mode of CATV converter <b>50</b> as described hereinafter, and various thresholds, such as a background noise threshold.
[0182] I/O interface <b>56</b> typically receives the input parameters and factors from the remote control via an infrared or an RF link, or by wire from a keyboard <b>68</b>, which may be a conventional keyboard that typically forms part of conventional CATV converters. Preferably, the input parameters and factors are received in response to requests to input parameters and factors which are presented to the subscriber on television <b>12</b> of FIG. 1.
[0183] In a preferred embodiment of the present invention speech recognition unit <b>54</b> may include conventional interface circuitry for operating speaker <b>66</b>. Preferably, speaker <b>66</b> may be employed to provide voice messages to the user. The voice messages may be accompanied by messages displayed on television <b>12</b> of FIG. 1. Preferably, speaker <b>66</b> may be a speaker of the television.
[0184] It is to be appreciated that speech recognition unit <b>54</b>, in both configurations of speaker dependent and speaker independent units, and processor <b>58</b> may each control the operation of on-screen-display (OSD) unit <b>62</b> and may generate messages and graphic information which are converted by OSD <b>62</b> to a format suitable for display on a conventional television display as is well known in the art. The messages may include error messages and control messages which are displayed on television <b>12</b> of FIG. 1.
[0185] Preferably, at least part of the messages and graphic information are stored in memory <b>60</b> and retrieved as required from memory <b>60</b> by speech recognition unit <b>54</b> and by processor <b>58</b> respectively.
[0186] Additionally, each one of speech recognition unit <b>54</b> and processor <b>58</b> may also control decryption of information in accordance with an authorization signal or code which may be entered by the subscriber via keyboard <b>68</b>. Alternatively, the authorization signal may be a voice code which is provided by the subscriber via microphone <b>52</b> and is processed by speech recognition unit <b>54</b>. Further alternatively, information may be decrypted under control of a smart card (not shown).
[0187] It is to be appreciated that speech recognition unit <b>54</b> and processor <b>58</b> may be embedded in a single unit or chip. Since, typically, processor <b>58</b> prepares information to be used by speech recognition unit <b>54</b>, embedding unit <b>54</b> and processor <b>58</b> in a single chip may save space and may be more efficient.
[0188] In accordance with a preferred embodiment of the present invention processor <b>58</b> communicates with memory <b>60</b>, with OSD <b>62</b>, with decrypter <b>64</b> and with a telephone modem <b>70</b> which is employed to provide uplink transmissions as described hereinabove. Preferably, processor <b>58</b> also communicates with CATV receiver and tuner unit <b>72</b> and is operative to provide instructions and data to CATV receiver and tuner <b>72</b>, and to control the operation of CATV receiver and tuner <b>72</b>.
[0189] In accordance with a preferred embodiment of the present invention CATV receiver and tuner <b>72</b> receives programming material and information at a plurality of channels from a pay television network (not shown). CATV receiver and tuner <b>72</b> provides the programming material and information to television <b>12</b> of FIG. 1.
[0190] Preferably, the programming material transmitted via the pay television network and received at CATV receiver and tuner <b>72</b> may include regular television programs and data related to a program guide. The data related to the program guide typically includes information about scheduled television programs at various pay television channels. In a preferred embodiment of the present invention the program guide is an electronic program guide (EPG), and the program guide data is typically transmitted in a digital form.
[0191] It is to be appreciated that the program guide may occupy a separate pay television channel. Alternatively, at least part of the program guide data may accompany regular programming channels.
[0192] Preferably, the subscriber may browse through the program guide, operate features in the program guide, refer to data presented on on-screen menus, retrieve selected program guide data, record programs, make selections and configure the program guide. All these operations may be performed either in a conventional mode of operation by pressing keys in the remote control, or in a voice activated mode of operation by entering voice commands and instructions and by making voice selections. Additionally, these operations may be done while the subscriber watches television.
[0193] The voice commands and the voice selections may be processed either at the remote control or at CATV converter <b>50</b>. When the voice commands and selections are processed at CATV converter <b>50</b>, the data related to the program guide may be processed by speech recognition unit <b>54</b> or by processor <b>58</b>, and stored in memory <b>60</b>.
[0194] Upon activation of any program guide feature by the subscriber, preferably by entering voice commands and selections as described hereinafter, program guide data is retrieved from memory <b>60</b> and processed in processor <b>58</b>. The processed program guide data is typically displayed on television <b>12</b> of FIG. 1 in accordance with the commands and the selections entered by the subscriber.
[0195] It is to be appreciated that the programming material received from the CATV network may be in a digital compressed form. In such a case CATV receiver and tuner <b>72</b> may employ compressor/decompressor unit <b>74</b> to decompress the digital material. The decompressed digital material is preferably converted to an analog form in CATV receiver and tuner <b>72</b> and is displayed on television <b>12</b> of FIG. 1.
[0196] If the portion of the programming material which includes program guide data is in a compressed form, the program guide data may be stored in a compressed form in memory <b>60</b>. Then, compressor/decompressor <b>74</b> retrieves the compressed program guide data from memory <b>60</b> and decompresses the program guide data prior to displaying on television <b>12</b>.
[0197] It is to be appreciated that compressor/decompressor <b>74</b> may be also employed to compress speech characteristics of users prior to storage in memory <b>60</b>. Upon retrieval from memory <b>60</b>, the speech characteristics are decompressed by compressor/decompressor <b>74</b>. The definition and use of the speech characteristics is described below.
[0198] Preferably, processor <b>58</b> may also communicate with an image processor <b>76</b> which processes images received from camera <b>26</b> of FIG. 1.
[0199] As mentioned before, CATV converter <b>50</b> may operate either in a voice activated mode, or in a conventional mode of operation, i.e. by pressing conventional function keys and digit keys on keyboard <b>68</b> or corresponding keys on the remote control. Selection of the voice activation mode is enabled by pressing a voice activation key <b>78</b> in keyboard <b>68</b>, or a corresponding voice activation key in the remote control. Preferably, when key <b>78</b> is pressed, the voice activated mode of operation is effective.
[0200] Upon enabling speech control of CATV converter <b>50</b> by pressing key <b>78</b>, the conventional function keys and digit keys in keyboard <b>68</b> are preferably disabled, and the subscriber may provide voice commands by speaking directly to microphone <b>52</b> of CATV converter <b>50</b>, or to an internal microphone (not shown) in the remote control.
[0201] Preferably, the voice commands received at the microphone are provided to speech recognition unit <b>54</b> in which they are processed and compared to reference messages that may be stored either in a memory (not shown) which forms part of speech recognition unit <b>54</b> or in memory <b>60</b>. Speech recognition unit <b>54</b> may provide the processed commands to processor <b>58</b>, or it may control various functions of CATV receiver and tuner <b>72</b> in accordance with the types of the commands.
[0202] Alternatively, if the remote control is employed, and the subscriber speaks to the internal microphone of the remote control, the voice commands are processed in a speech recognition unit (not shown) in the remote control. Then, the remote control transmits to I/O interface <b>56</b>, over the air, a series of infrared signals which represent the voice commands. The series of infrared signals are transmitted in response to the voice commands, and I/O interface <b>56</b> receives the infrared signals and converts them to electric signals which are provided to processor <b>58</b>.
[0203] The processed voice commands received at processor <b>58</b>, either from I/O interface <b>56</b> or from speech recognition unit <b>54</b>, are preferably processed by processor <b>58</b> and employed to control various functions of CATV receiver and tuner <b>72</b> and to allow selections of programming material on an on-screen program guide as described below with reference to FIGS. <b>5</b>A-<b>5</b>I. Alternatively, in the case that the voice commands are processed at speech recognition unit <b>54</b>, the various functions of CATV receiver and tuner <b>72</b> and the selections of the programming material on the on-screen program guide may be controlled either by speech recognition unit <b>54</b> or by processor <b>58</b>.
[0204] Typically, the subscriber watches television programs, possibly with other members of his family, and each viewer may wish to make viewing selections by entering voice commands. However, it may not be desirable to allow each viewer to enter voice selections whenever he wishes to, or to allow execution of a command or a selection whenever it is said regardless of the person who speaks it since this may cause confusion and change previous selections when there is no intention to do so. Thus, it is to be appreciated that a separation between speakers is preferred, and only commands and selections of one viewer at a time are executed, regardless of the number of viewers that speak in the vicinity of the viewer.
[0205] Additionally, it is to be appreciated that a voice command and a voice selection are preferably required to be separated from background noise which may include audio from a television program, and conversations between people in the vicinity of the subscriber. This requirement is discussed below with reference to FIGS. <b>5</b>A-<b>5</b>I.
[0206] If speech recognition unit <b>54</b> is a speaker independent unit, any legitimate command which is spoken is executed, regardless of the viewer who speaks it, or if it is mentioned in a television program.
[0207] If speech recognition unit <b>54</b> is a speaker dependent unit, unit <b>54</b> is required to recognize each speaker. This may be done by prior training of unit <b>54</b> by each speaker.
[0208] Preferably, such training of unit <b>54</b> may include repetitively speaking command and selection words and phrases by a viewer. The spoken words are received at microphone <b>52</b> and are analyzed in speech recognition unit <b>54</b>. The results of such training may form the speech characteristics of each viewer, which are then stored in the internal memory of speech recognition unit <b>54</b> or in memory <b>60</b>. Typically, the speech characteristics of a viewer may include phonemes and subphonemes, and utterance templates, such as word reference templates, as is well known in the art.
[0209] It is to be appreciated that a training mode of CATV converter <b>50</b> may be obtained by pressing a training key <b>80</b> on keyboard <b>68</b>. Preferably, viewing selections cannot be performed when CATV converter <b>50</b> is in the training mode.
[0210] The requirement for separate training for each viewer in the case of a speaker dependent configuration of speech recognition unit <b>54</b> allows substantially simple separation between various speakers as is well known in the art. Thus, in order to avoid multiple simultaneous spoken commands from various viewers and background noise, CATV converter <b>50</b> may be configured to follow instructions of one viewer at a time.
[0211] Such configuration of CATV converter <b>50</b> may be achieved by a selection of an operative viewer which may be performed by operation of a viewer selection key <b>82</b> in keyboard <b>68</b>, or of a corresponding key in the remote control, or by any other appropriate means. Preferably, successive operation of selection key <b>82</b> results in selection of subsequent operative viewers.
[0212] Alternatively, in a configuration in which camera <b>26</b> and image processor <b>76</b> are coupled to CATV converter <b>50</b>, or form part thereof, an operative viewer may be selected automatically by employing camera <b>26</b> and image processor <b>76</b> of FIG. 1. In a preferred embodiment of the present invention camera <b>26</b> is positioned to take pictures in a relatively narrow field of view which covers, for example, an armchair on which a viewer sits, such as armchair <b>11</b> of FIG. 1, and the surroundings of the armchair. Camera <b>26</b> may be either an analog camera or a digital camera, and the pictures taken thereof may be analog pictures or digital pictures respectively.
[0213] Preferably, camera <b>26</b> is manually positioned by the viewer or by a member of the viewer's family to take pictures of the viewer. Alternatively, the viewer may employ a gimbal mounted camera (not shown) with motors that move the gimbal and a control box which controls the motors (not shown) as is well known in the art. Preferably, the viewer may control the position of the camera, via keys (not shown) in the control box, which actuate the motors to rotate the gimbal to a required direction so that the face of the viewer appears in the frame of camera <b>26</b>.
[0214] Typically, only one viewer sits on the armchair, and only his face appears in the frame of camera <b>26</b>. The faces of other viewers, which may pass by the armchair, generally do not appear in the frame of camera <b>26</b>.
[0215] In a preferred embodiment of the present invention the picture of the viewer's face is captured and provided to image processor <b>76</b> which may be a conventional image processor that captures images and allows comparison of the captured images to previously captured images or to stored images. If camera <b>26</b> is a video camera, the viewer's face is constantly captured and processed in image processor <b>76</b>. If camera <b>26</b> is a still camera, a “frozen” picture of the viewer may be taken periodically, such as every 5 seconds.
[0216] Preferably, if camera <b>26</b> is a video camera, image processor <b>76</b> employs conventional processing techniques which are well known in the art to determine whether the same face of the viewer appears in the frame of camera <b>26</b> for a pre-selected time period, which may be of the order of about 30 seconds.
[0217] It is to be appreciated that even if the viewer moves his face between subsequent pictures the conventional processing techniques allow identification of the viewer. If however, a substantial portion of the viewer's face is absent from the frame of camera <b>26</b>, such as when the viewer turns to one side or gets up from his armchair, image processor <b>76</b> may refer to previous images of the viewer which are taken at the beginning of the current photographing session. Thus, image processor <b>76</b> determines a current viewer even if the viewer's face appears in the frame of camera <b>26</b> for a portion of the pre-selected time period.
[0218] Then, image processor <b>76</b> compares the image of the viewer whose face appears in the field of view of camera <b>26</b> for the pre-selected time period, or for a portion thereof, to a series of previously taken digital images of viewers which are stored in a library of digital images in memory <b>60</b>. The current operative viewer is determined as the viewer whose stored image matches, or is substantially similar to, a current captured image of a viewer whose face continuously appears in the frame of camera <b>26</b>.
[0219] Preferably, the library of digital images of the viewers and a library of speech characteristics of the viewers are created when CATV converter <b>50</b> is installed, or at any other suitable time. In a preferred embodiment of the present invention each viewer is photographed by camera <b>26</b>, and each viewer trains speech recognition unit <b>54</b> and records his speech characteristics, in the case of a speaker dependent configuration of speech recognition unit <b>54</b>. The digital images of the viewers and the corresponding speech characteristics of the viewers may be stored in an internal memory in image processor <b>76</b> (not shown) and in an internal memory (not shown) in speech recognition unit <b>54</b> respectively, or in memory <b>60</b>.
[0220] It is to be appreciated that for each viewer, an image of a viewer may be correlated to speech characteristics of the viewer. In a preferred embodiment of the present invention an identity code is associated with the image of the viewer in the library of digital images. The same identity code is also associated with the speech characteristics of the viewer. Thus, the images and the speech characteristics of the viewers may be accessed by employing the identity codes.
[0221] Thus, image processor <b>76</b> may output, as a result of the comparison of images performed thereby, a current operative viewer identity code which is associated with the current operative viewer determined thereby. The current operative viewer identity code may be provided, via processor <b>58</b>, to speech recognition unit <b>54</b>.
[0222] In accordance with a preferred embodiment of the present invention speech recognition unit <b>54</b> correlates voice commands and voice selections received thereat to the pre-recorded speech characteristics of the current operative viewer determined by the identity code received from processor <b>58</b>. If a match is found, speech recognition unit <b>54</b> determines that a current speaker is the current operative viewer, and executes commands and selects operating characteristics of the communication system in response to the voice commands and the voice selections provided by the current operative viewer.
[0223] The operating characteristics of the communication system may preferably include features such as program selection, system configurations, parental control, messages, program guide scheduling, and available channels. Selections of the operating characteristics may include, for example, a selection of a program to be viewed, a selection of a specific system configuration, a selection for implementation of parental control for specific programs, and a selection of recording of a scheduled program.
[0224] It is to be appreciated that the speech characteristics which are stored in memory <b>60</b> may be retrieved therefrom by speech recognition unit <b>54</b> or by processor <b>58</b>. The images which are stored in memory <b>60</b> may be retrieved therefrom by image processor <b>76</b> or by processor <b>58</b>.
[0225] Preferably, in a case that the current operative viewer changes places with a second viewer, and the face of the second viewer is photographed by camera <b>26</b>, the second viewer becomes a new current operative viewer. In that case, speech recognition unit <b>54</b> executes voice commands provided by the new current operative viewer in accordance with speech characteristics which are associated with the new current operative viewer.
[0226] It is to be appreciated that in the speaker independent configuration of speech recognition unit <b>54</b>, separation between multiple speakers is more difficult, and may be performed by employing special methods as described hereinafter with reference to FIGS. <b>5</b>A-<b>5</b>I. As mentioned above, such separation may be crucial in order to avoid errors in operation of CATV converter <b>50</b> due to casual spoken words which may be said in typical conversations that are normally conducted when many viewers watch a television program.
[0227] It is to be appreciated that CATV converter <b>50</b> may be operative without image processor <b>76</b> and video camera <b>26</b>. In such a case, determination of a current operative viewer may be obtained by use of viewer selection key <b>82</b> as described above, and by employing the method described below with reference to FIGS. <b>5</b>A-<b>5</b>I.
[0228] In a preferred embodiment of the present invention telephone modem <b>70</b>, which communicates with processor <b>58</b>, is a conventional telephone modem. Generally, in state-of-the-art pay television systems, modems, such as modem <b>70</b>, are coupled to a telephone network, such as telephone network <b>21</b> of FIG. 1, and are typically employed to receive messages, and instructions from headend <b>13</b> of FIG. 1 for billing purposes.
[0229] Reference is now made to FIG. 3 which is a generalized block diagram illustration of an alternative preferred implementation of a CATV converter <b>17</b> of FIG. 1. The apparatus of FIG. 3, is indicated by reference numeral <b>100</b>, and is substantially similar in functionality and structure to the apparatus of FIG. 2 except that some of the units in CATV converter <b>100</b> are external removable modules as described below.
[0230] In a preferred embodiment of the present invention CATV converter <b>100</b> includes an interface unit <b>102</b> which is operative to accept an external removable speech recognition module <b>104</b>. It is to be appreciated that external removable speech recognition module <b>104</b> may have the same functionality and may operate substantially similarly to speech recognition unit <b>54</b> of FIG. 2. Preferably, external removable speech recognition module <b>104</b> is in the form of an electronic card, and interface unit <b>102</b> includes an electronic card interface unit.
[0231] Interface unit <b>102</b> is operatively coupled to an external microphone <b>106</b> via which a subscriber may provide voice commands that may be processed in module <b>104</b>. Preferably, microphone <b>106</b> is a conventional wireless microphone.
[0232] Interface unit <b>102</b> may be also coupled to a processor <b>108</b>, a decrypter <b>110</b>, an OSD <b>112</b>, a subscriber I/O interface <b>114</b>, and a CATV receiver and tuner <b>118</b> which are similar in structure and functionality to processor <b>58</b>, decrypter <b>64</b>, OSD <b>62</b>, subscriber I/O interface <b>56</b>, and CATV receiver and tuner <b>72</b> of FIG. 2 respectively. Interface unit <b>102</b> may be also coupled to a compressor/decompressor <b>124</b> which may form part of CATV receiver and tuner <b>118</b>.
[0233] I/O interface <b>114</b> is coupled to a keyboard <b>116</b> which is substantially similar in structure and functionality to keyboard <b>68</b> of FIG. 2 and has the same functional keys as mentioned above with reference to keyboard <b>68</b>, including a voice activation key <b>117</b>, a training key <b>119</b>, and a viewer selection key <b>121</b> which are substantially similar to keys <b>78</b>, <b>80</b> and <b>82</b> of FIG. 1, respectively.
[0234] Processor <b>108</b> is preferably coupled to CATV receiver and tuner <b>118</b>, to an internal memory <b>120</b> and to a telephone modem <b>122</b> which are respectively similar in structure and functionality to CATV receiver and tuner <b>72</b>, memory <b>60</b> and modem <b>70</b> of FIG. 2. CATV receiver and tuner <b>118</b> is operative to receive programming material and information at a plurality of channels from a communication network (not shown) which may preferably be a CATV network. CATV receiver and tuner <b>118</b> provides the programming material and the information to television <b>12</b> of FIG. 1.
[0235] Preferably, the programming material includes regular television programs and the information includes program guide data. Upon activation of any program guide feature by the subscriber, preferably by entering voice commands and selections as described with reference to FIG. 2, at least a portion of the program guide data is retrieved from memory <b>120</b> and processed in processor <b>108</b>. The processed program guide data is displayed on television <b>12</b> of FIG. 1 in accordance with the commands and the selections entered by the subscriber.
[0236] In accordance with a preferred embodiment of the present invention CATV receiver and tuner <b>118</b> includes a compressor/decompressor unit <b>124</b> which is employed to decompress compressed digital signals as mentioned above with reference to FIG. 2. Compressor/decompressor unit <b>124</b> is preferably coupled to processor <b>108</b> and to internal memory <b>120</b> and is operative to compress/decompress information processed at processor <b>108</b>, information processed at external removable speech recognition module <b>104</b> and information communicated to/from memory <b>120</b>.
[0237] Interface unit <b>102</b> may also be coupled to an external memory reader <b>126</b> which is operative to accept an external removable memory module <b>128</b>. Preferably, module <b>128</b> is one of an optical memory card, a magneto-optical memory card, a magnetic memory card, a memory diskette and a CD-ROM module.
[0238] It is to be appreciated that a portion of the material to be stored in internal memory <b>120</b> may be stored in external removable memory module <b>128</b>. Preferably, such material may include the speech characteristics of each viewer as mentioned above with reference to FIG. 2, data, pre-programmed voice selections, and execution programs which are associated with speech recognition features.
[0239] Preferably, data which is related to conventional, non-voice activated operation of CATV converter <b>100</b>, and program guide data which is transmitted via the CATV network, as mentioned before with reference to FIG. 2, is preferably stored in internal memory <b>120</b>. Thus, the absence of module <b>128</b> does not affect a conventional mode of operation of CATV converter <b>100</b>.
[0240] One of the advantages of CATV converter <b>100</b> of FIG. 3 is that a non-voice activated CATV converter can be easily upgraded to include voice activation features and modules, and thus to provide a voice activation mode of operation of the CATV converter.
[0241] It is to be appreciated that the above mentioned upgrading option enables manufacturers of CATV converters to produce relatively low-cost CATV converters, which are not voice activated, and when subscribers require the voice activation features, they may upgrade the low-cost CATV converters.
[0242] In such a case, a subscriber may purchase a few removable external units, i.e. external removable speech recognition module <b>104</b>, external removable memory module <b>128</b> and microphone <b>106</b>, and then insert speech recognition module <b>104</b> and external memory <b>128</b> in interface unit <b>102</b> and in external memory reader <b>126</b> respectively, and connect microphone <b>106</b> to a suitable connector (not shown) in his CATV converter.
[0243] Additionally, the use of removable modules enables the subscriber to employ modules which include his own individual speech characteristics with any voice activated CATV converter that includes removable modules. Thus, for example, the subscriber may remove modules <b>104</b> and <b>128</b> from a CATV converter at his residence and place them in a CATV converter at a hotel.
[0244] It is to be appreciated that a video camera, such as video camera <b>26</b> of FIG. 1, and an image processor, such as image processor <b>76</b> of FIG. 2, may be added to CATV converter <b>100</b>. In such a case, the video camera and the image processor may have the same structure and functionality as video camera <b>26</b> of FIG. 1 and image processor <b>76</b> of FIG. 2 respectively, and external removable memory module <b>128</b> may include the digital images of the viewers as mentioned above with reference to FIG. 2.
[0245] In an alternative embodiment of the present invention the video camera and the image processor may be absent, as mentioned above with reference to FIG. 2.
[0246] Reference is now made to FIGS. 4A and 4B which together constitute a flow chart illustrating the operation of the apparatus of FIG. 2 or the apparatus of FIG. 3 in accordance with a preferred embodiment of the present invention.
[0247] If a subscriber owns a CATV converter which includes a voice recognition unit, such as described with reference to FIG. 2 or FIG. 3, the CATV converter may be configured either by a remote control or by speaking, from a distance, at an internal microphone of the CATV converter.
[0248] If the voice recognition unit is a speaker dependent speech recognition unit, the subscriber may press a training key on a keyboard of the CATV converter to enter a training mode. In the training mode, the subscriber may follow instructions which are displayed on a television.
[0249] Preferably, the subscriber is instructed to repeatedly speak several symbols, words and sentences. Each symbol, word and sentence is recorded and analyzed by the speech recognition unit, and is played to the subscriber for verification. Typically, the symbols, words and sentences which are used for training are similar to symbols, words and sentences which are used for making actual selections and for providing actual instructions.
[0250] If the subscriber verifies the symbol, word or sentence, the speech recognition unit converts the symbol, word or sentence to phonemes and subphonemes, and utterance templates which form the speech or voice characteristics of the subscriber, and stores the speech characteristics of the subscriber in a memory (not shown).
[0251] When the subscriber completes the training of the voice recognition unit, he may press the training key again to return to an operating mode of the CATV converter.
[0252] Typically, the training is performed only once. However, if the voice characteristics of the subscriber change with time, such as due to a surgery or due to adolescence, training has to be repeated.
[0253] If the voice recognition unit is a speaker independent voice recognition unit, no training is required, and the subscriber may enter selections either by speaking directly to the microphone in the CATV converter, or to a microphone (not shown) in remote control <b>24</b> of FIG. 1.
[0254] When a voice activation mode is not selected, the subscriber may enter commands and selections in a conventional way, i.e. via the remote control or via a keyboard, such as keyboard <b>68</b> of FIG. 2, which forms part of the CATV converter. To select the voice activation mode, the subscriber presses a voice activation key on the keyboard or a voice activation key on a keypad in the remote control (not shown).
[0255] If the voice activation mode is selected, a mark indicating that such mode is currently selected is displayed on the television screen. Preferably, the mark is symbolically indicative of the voice activation mode, such as, for example the mark includes a drawing of a microphone, or a drawing of a man speaking, and the symbols “VA” which stand for voice activation. The mark may preferably be located at a corner of the television screen.
[0256] Upon selection of the voice activation mode, the subscriber enters voice selections and voice commands which enable manipulation of a program guide system as mentioned above with reference to FIGS. <b>1</b>-<b>3</b>, and selection of operating characteristics of a communication system.
[0257] In a preferred embodiment of the present invention the voice selections include selection codes which are associated with selectable operating characteristics of the communication system which form part of a program guide, and the voice commands include instruction codes which are associated with selectable commands.
[0258] Preferably, each selection code determines one of the operating characteristics to be selected. It is appreciated that a selection code may also enable a browsing option for browsing through available operating characteristics. When an instruction code is associated with a selection code, a selection of the operating characteristics which is associated with the selection code is executed.
[0259] As mentioned before, the operating characteristics of the communication system may include features such as program selection, system configurations, parental control, messages, program guide scheduling, and available channels. In order to select a specific feature, the subscriber may preferably browse through selection screens by using each time a suitable selection code for a suitable browsing option, and an instruction code which is associated with the selection code for the suitable browsing option. When the specific feature is reached, the subscriber may use a selection code and an instruction code associated thereto to implement selection of the feature.
[0260] It is to be appreciated that at least part of the selection codes and the instruction codes may be transmitted from headend <b>13</b> of FIG. 1 with program guide information. Alternatively, at least part of the selection codes and the instruction codes may be stored in a memory in the CATV converter, such as memory <b>60</b> of FIG. 2, and retrieved therefrom for association with corresponding program guide information.
[0261] It is to be appreciated that typically, execution of a selection is performed by saying a voice expression which includes a selection code followed by an instruction code for executing the selection. The use of selection codes and instruction codes in association with operating characteristics of the communication system is described hereinafter with reference to FIGS. <b>5</b>A-<b>5</b>I.
[0262] Preferably, the voice selections and the voice commands are executed sequentially by the voice recognition unit. It is to be appreciated that the voice selections and the voice commands are preferably executed only if the subscriber is identified as the current operative viewer as described hereinabove with reference to FIG. 2.
[0263] Additionally, the voice recognition unit also verifies that a voice selection and a voice command spoken by the subscriber, i.e. the current operating viewer, are legitimate. The term “legitimate” is used throughout the specification and claims, in conjunction with selections and commands, to indicate executable selections and commands, i.e. selections and commands which are pre-designed to be executed.
[0264] Preferably, verification of the voice selections and the voice commands may be performed by comparison of symbols, words and sentences, which may form part of the above mentioned selection codes and instruction codes that are spoken by the subscriber, to reference symbols, words and sentences which may be stored in the memory. Preferably, only legitimate commands and selections are executed.
[0265] In some cases, on-screen messages may be generated as a result of the execution of voice selection and commands. Such messages may include conditional access warning messages, billing messages, announcements and control information. In a preferred embodiment of the present invention, in order to continue inputting selections and commands, the subscriber must proceed according to the displayed messages.
[0266] In a preferred embodiment of the present invention a voice selection or command, or a series of voice selections and commands may be stored to create a favorite selection subroutine. In such a case, the voice selection or command may be stored in a memory, such as memory <b>60</b> of FIG. 2, or external removable memory module <b>128</b> of FIG. 3. After the selection or command is stored, the subscriber may enter additional voice selections and commands which may be also stored in accordance with the preferences of the subscriber.
[0267] Reference is now made to FIGS. <b>5</b>A-<b>5</b>I which are generalized illustrations of selection screens in a voice activated program guide which may be used with the communication system of FIG. 1 and with a television with either of the CATV converter of FIG. 2 or the CATV converter of FIG. 3.
[0268] As mentioned above, program guide data is transmitted from a headend, such as headend <b>13</b> of FIG. 1, via a communication network to a multiplicity of subscriber units. Preferably, a subscriber unit includes a CATV converter as described above with reference to FIGS. <b>1</b>-<b>3</b>. The CATV converter is coupled to a television, and the program guide data is displayed on the television.
[0269] The program guide data preferably includes schedule information, information related to available communication network configurations, and information related to various services which are available via the communication network.
[0270] As mentioned above with reference to FIG. 2, at least part of the program guide data may be processed and stored at the CATV converter. Preferably, the program guide data is displayed on the television in the form of selectable on-screen menus.
[0271] Further as mentioned above with reference to FIG. 2, a viewer may operate the program guide, refer to data presented on the on-screen menus, retrieve selected program guide data, make selections and configure the program guide and/or the subscriber unit by entering voice commands and voice selections. These operations may be done while the subscriber watches television by employing a remote control or a keyboard on the CATV converter.
[0272] However, it is to be appreciated that a voice activation system built in accordance with methods known in the prior art would typically be associated with the following problems:
[0273] (1) the viewer that commands the voice activated program guide and CATV converter has to be distinguished from other viewers that are holding conversations in a noisy environment surrounding the user, and from background audio, and
[0274] (2) legitimate commands have to be distinguished from casual words spoken by the viewer during a conversation.
[0275] The first problem is discussed above in relation to the different configurations of the voice recognition units of FIGS. 2 and 3. It is to be appreciated that the speaker dependent configuration of the voice recognition units of FIGS. 2 and 3 address the problem of distinguishing the voice of a current operative viewer and the voices of other viewers, or background noise, as discussed above.
[0276] However, in the speaker independent configuration of the voice recognition units of FIGS. 2 and 3, training of the voice recognition units to recognize words cannot provide a simple distinction between a current operative viewer and other viewers. Rather, in the speaker independent configuration of the voice recognition units of FIGS. 2 and 3, distinction between a current operative viewer and other viewers may be provided by other means, as described below.
[0277] To understand and appreciate more fully the second problem of distinguishing legitimate commands from casual words spoken during a conversation, some common command words and selection words, such as: “GO”, “YES”, “NO”, “STOP” and “BACK” are now considered. This words, which may be used in various applications that require a command language, are considered by way of example.
[0278] One can easily note that such command language may be inadequate for the purposes of the present invention in the case of a noisy background since command and selection words as mentioned above may be frequently spoken by the viewer in a typical conversation. Thus, if, for example, the viewer responds with a “YES” or a “NO” to a question directed at him during a conversation while the CATV converter is in the voice activation mode, an erroneous selection may be generated upon viewer's response.
[0279] Furthermore, in the speaker independent configuration of the voice recognition units of FIGS. 2 and 3, if a viewer other than the current operative viewer speaks one or more of the above mentioned command words and selection words during a conversation while the CATV converter is in the voice activation mode, an erroneous selection may be generated since the voice recognition unit recognizes these words regardless of the person who speaks them.
[0280] It is to be appreciated that this problem does not typically occur in conventional voice recognition applications since generally, voice recognition applications are employed in environments in which only one person speaks without interference from other speakers. Such a conventional application may be found in a telephone purchase system in which a buyer places a call to a central office and orders an item by entering voice selections and instructions in response to selection possibilities conveyed to him over the telephone.
[0281] In a preferred embodiment of the present invention common command words and selection words as mentioned above may be implemented as an optional command language which is to be used when a viewer watches television by himself, in a quiet environment. The optional command language may be operative by activating a special purpose command language key (not shown) in the remote control or in the CATV converter.
[0282] If the environment of the viewer is a noisy environment, which it typically the case in many locations in which CATV systems are installed, such a common command language cannot be adequately employed with any configuration of the speech recognition units.
[0283] In a preferred embodiment of the present invention a method is provided which is operative to solve the above mentioned problems in speaker dependent voice recognition systems and in speaker independent voice recognition systems which operate in noisy environments. The method avoids erroneous selections, and selections made by viewers other than a current operative viewer, by employing special word combinations and phoneme combinations for voice commands and voice selections as described below with reference to the structure of each selection screen illustrated in FIGS. <b>5</b>A-<b>5</b>I.
[0284] Preferably, the special word combinations are instantaneously created special purpose combinations which may be created for each individual command or selection. The special word combinations are generated in accordance with simple logical rules which may be clearly displayed on the television. It is to be appreciated that, typically, these combinations are not employed in a conversation.
[0285] In a preferred embodiment of the present invention the logical rules are identical for all the on-screen menus which form part of the program guide and are structured to enable voice activation.
[0286] Typically, the on-screen menus have structures which include arrangements in one-dimensional table formats, arrangements in two-dimensional table formats, and arrangements in screens having pre-positioned ordered or non-ordered selection areas or area cells, such that when the current operative viewer, taken by way of example to be a subscriber, selects one of the selection areas on a screen, information associated with the selected area may be displayed. Preferably, selections are made by placing an indicator on a requested area or area cell or moving a cursor on the screen to a requested area or cell and by providing a voice instruction when the indicator or cursor is positioned on the requested area or cell.
[0287] It is to be appreciated that the indicator or the cursor may be an arrow pointing at the selected area. Alternatively, the indicator may be an indicator as employed in computer software, such as a change of color of the selected cell with respect to the other cells, or a change of color of the background of the selected cell with respect to the background of the other areas or cells.
[0288] In a preferred embodiment of the present invention the one-dimensional tables may include horizontal or vertical banners, such as program banners, which may be overlaid on regular television programs or on images taken thereof.
[0289] Preferably, the one-dimensional tables may each include either a row or a column of selection areas which may be overlaid on regular television programs or on frozen images taken thereof. It is to be appreciated that a one-dimensional table may be implemented as a table having one row and many columns, or as a table having one column and many rows.
[0290] The two-dimensional tables are preferably displayed on a portion of the television display, whereas programming material is displayed on other portions of the television display.
[0291] In a preferred embodiment of the present invention when a voice activation mode is selected, a main on-screen menu, such as illustrated in FIG. 5A, is displayed on the television. The main on-screen menu is indicated by reference numeral <b>200</b>, and is a typical representation of an arrangement of a screen in a two-dimensional table format.
[0292] Preferably, menu <b>200</b> is chained and linked to additional on-screen menus in accordance with a pre-programmed algorithm which may be resident in a memory, such as memory <b>60</b> of FIG. 2, or may be provided over the air or via cables from headend <b>13</b> of FIG. 1.
[0293] The additional on-screen menus enable conventional CATV selections of channels, programs, recording data, time schedules, various services, general information relating to programs and channels, and configuration of the program guide as described below.
[0294] In a preferred embodiment of the present invention on-screen menu <b>200</b> includes a plurality of sub-displays on which different types of data may be displayed. A conventional television program may be displayed on a video sub-display <b>202</b>. Premium schedule data may be displayed on a premium schedule sub-display <b>204</b> which is located next to video sub-display <b>202</b>. Premium schedule sub-display <b>204</b> may include a list of current featuring premium programs.
[0295] Preferably, a sub-display <b>206</b> may be located underneath sub-displays <b>202</b> and <b>204</b>. Sub-display <b>206</b> may include an indication of the voice mode operation of the program guide. Such indication may include a sub-display <b>208</b> which may flicker to draw the attention of the subscriber.
[0296] Additionally, sub-display <b>206</b> may also include a sub-display <b>210</b> which is located next to sub-display <b>208</b>. Preferably, current date information and a clock which continuously displays a current time are displayed on sub-display <b>210</b>.
[0297] In a preferred embodiment of the present invention on-screen menu <b>200</b> also includes a two-dimensional on-screen menu selection table <b>212</b>. Preferably, a cell in table <b>212</b> is defined by a row and a column, and the cell may be addressed by providing a voice command in which the subscriber speaks an identification character that indicates the row and an identification character that indicates the column. In FIG. 5A the rows are indicated by letter characters “A” and “B”, and the columns are indicated by number characters “1”, “2”, “3” and “4”. Thus, by saying combinations such as “A1” and “B4”, the appropriate cells may be addressed and selected.
[0298] It is to be appreciated that each such combination forms a selection code which is associated with a particular cell in the two-dimensional selection table <b>212</b> and thus with a particular operating characteristics of the communication system which is represented by the cell. The selection codes may be either transmitted with the program guide information which is displayed in the cells, or stored in a memory, such as memory <b>60</b> of FIG. 2, and retrieved therefrom for association with the information displayed in the cells.
[0299] This method of addressing the cells establishes a simple logical selection rule that is generally similar to selection rules employed in crossword puzzles or in a chess game which are recognized by people worldwide.
[0300] It is to be appreciated that by saying an appropriate combination of a character and a number the subscriber may select any cell in table <b>212</b>. One can easily note that such combinations are not generally used in a conversation and are therefore adequate for use with voice selections in a voice activated program guide.
[0301] In accordance with the above mentioned selection rule, the subscriber may address the on-screen menus mentioned in table <b>212</b> by saying the following combinations: <tables id="TABLE-US-00001" num="1"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="91PT" align="center" /><colspec colname="2" colwidth="126PT" align="left" /><thead><row><entry /></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row><row><entry>Say</entry><entry>Address Cell</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>A1</entry><entry>PROGRAM SCHEDULE</entry></row><row><entry>A2</entry><entry>CHANNEL LIST</entry></row><row><entry>A3</entry><entry>FAVORITES</entry></row><row><entry>A4</entry><entry>PRIME TIME</entry></row><row><entry>B1</entry><entry>RECORDING SCHEDULE</entry></row><row><entry>B2</entry><entry>SYSTEM CONFIGURATION</entry></row><row><entry>B3</entry><entry>PARENTAL CONTROL</entry></row><row><entry>B4</entry><entry>E-MAIL MESSAGES</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
[0302] A detailed description of each of the above mentioned menus in table <b>212</b> is provided below with reference to FIGS. <b>5</b>B-<b>5</b>I.
[0303] It is to be appreciated that the above mentioned selection rule may be applied to any two-dimensional selection table in which individual selection of each cell is required. Furthermore, each table may include identification letter and number characters which may be similar to characters used in another table since any selection is instantaneous and is made with reference to a current displayed table.
[0304] Additionally, the subscriber is not required to memorize programming commands and various selection rules but rather use letter and number characters which are displayed on the television and one selection rule for combining the characters to generate a selection code for selecting a particular one of the operating characteristics presented in a table.
[0305] When the subscriber selects a requested one of the operating characteristics of the communication system by saying a voice expression which includes the selection code that is associated with the requested one of the operating characteristics, the selection code is verified to be legitimate, i.e. associated with a legitimate selection of one of the available operating characteristics displayed in the current table. Preferably, a selection is made only if the selection code is legitimate.
[0306] In a preferred embodiment of the present invention saying the voice expression includes sequentially saying the components of the selection code, i.e. saying the character which is associated with the row and the character which is associated with the column in any order thereof.
[0307] Referring now to FIG. 5B, an example of the program schedule menu which may be selected from the main menu of FIG. 5A by saying the selection code “A1” followed by “SEL9” is considered. The program schedule menu, which is indicated by reference numeral <b>250</b>, is another typical representation of an arrangement of a screen in a two-dimensional table format.
[0308] Preferably, program schedule menu <b>250</b> includes a table <b>252</b> which is structured as a two-dimensional grid that includes an ordered or non-ordered crossed mesh, the ordered mesh having identical cell sizes and the non-ordered mesh having various cell sizes.
[0309] In a preferred embodiment of the present invention table <b>252</b> includes information on channels, programs to be displayed on each channel, and featuring time and date of each program. Alternatively, other information may be provided in the same grid, such as languages spoken on each program, and main actors featured on each program.
[0310] In another preferred embodiment of the present invention table <b>252</b> may include more cells than illustrated in FIG. 5B, and accordingly, additional information may be provided.
[0311] Preferably, a table of instructions <b>254</b> is located below table <b>252</b> and a table of instructions <b>256</b> is located adjacent to table <b>252</b>. In a preferred embodiment of the present invention table <b>254</b> includes instructions for navigating in table <b>252</b> by employing the following voice combinations: <tables id="TABLE-US-00002" num="2"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="49PT" align="left" /><colspec colname="2" colwidth="119PT" align="center" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row><row><entry /><entry>TO MOVE:</entry><entry>SAY:</entry></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>UP</entry><entry>A0</entry></row><row><entry /><entry>DOWN</entry><entry>Z9</entry></row><row><entry /><entry>LEFT</entry><entry>L0</entry></row><row><entry /><entry>RIGHT</entry><entry>R9</entry></row><row><entry /><entry>HOME</entry><entry>H0</entry></row><row><entry /><entry>END</entry><entry>E0</entry></row><row><entry /><entry>PAGE UP</entry><entry>U0</entry></row><row><entry /><entry>PAGE DOWN</entry><entry>D0</entry></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
[0312] Table 256 includes instructions for executing operations by employing the following voice combinations: <tables id="TABLE-US-00003" num="3"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="OFFSET" colwidth="49PT" align="left" /><colspec colname="1" colwidth="42PT" align="left" /><colspec colname="2" colwidth="126PT" align="center" /><thead><row><entry /><entry /></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row><row><entry /><entry>TO:</entry><entry>SAY:</entry></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>SELECT</entry><entry>SEL9</entry></row><row><entry /><entry>INSERT</entry><entry>INS9 </entry></row><row><entry /><entry>DELETE</entry><entry>DEL9</entry></row><row><entry /><entry>EXIT</entry><entry>EXI9 </entry></row><row><entry /><entry>RECORD</entry><entry>REC9</entry></row><row><entry /><entry>FAVORITE</entry><entry>FAV9</entry></row><row><entry /><entry>HELP</entry><entry>HEL9</entry></row><row><entry /><entry namest="OFFSET" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
[0313] Preferably, any selection of a cell in table <b>252</b> may be executed only if followed by the SELECT instruction in which the subscriber is required to say the code having the combination “SEL9”. Additionally, any voice instruction in table <b>256</b> is operative only with a selected cell. Thus, the term “selection” is also used below in conjunction with an instruction to execute the selection which may follow the selection, and such instruction may include any instruction code from table <b>256</b>.
[0314] It is to be appreciated that a navigation instruction from table <b>254</b> is not to be followed by an execution instruction from table <b>256</b>. Thus, for example, when the subscriber says “U0” a PAGE UP jump is executed immediately.
[0315] In a preferred embodiment of the present invention the instructions INS9 and DEL9 may be employed by the subscriber to reorder the grid. This is preferably done by selecting a channel, such as C0, deleting the line in the grid by using DEL9, and inserting the line in another place by using INS9.
[0316] It is to be appreciated that part of the instructions in table <b>256</b>, such as INS9 or DEL9, may be irrelevant in some cases. In such a case, these instructions are not executed when the corresponding voice combinations are used.
[0317] Preferably, the instruction REC9, when associated with a selected program, may be employed for automatic recording of the program. The instruction FAV9 is employed to pass to a favorite program or channel.
[0318] In a preferred embodiment of the present invention the instruction HEL9 may be employed to get a help screen which provides explanations on the usage of the program guide and the current menu.
[0319] Menu <b>250</b> may also lead the subscriber to other pages by saying the character “P” followed by the required page number. Preferably, the page numbers of the menus described in FIG. 5A are in units of 10, such as 10, 20, 30 etc. Derived menus (not shown), which are derived from the menus described in FIG. 5A, have intermediate page numbers which relate to the appropriate menus, such as <b>21</b>, <b>22</b> etc. which relate to the menu of FIG. 5B.
[0320] The above mentioned voice combinations for navigation and for execution are simple combinations which are not normally used in a conversation. Thus, a normal conversation would generally not interfere with such voice commands which include such combinations.
[0321] In a preferred embodiment of the present invention a program may be selected by addressing an appropriate cell in the same manner as mentioned before with reference to FIG. 5A, i.e. by saying a code which is a sequential combination of a letter character and a number character, such as A1, E3, and C2. It is to be appreciated that there is no interference between any combination which allows a cell selection and any combination which represents a navigation instruction or an execution instruction.
[0322] In order to simplify the selection of a cell, the individual selection combination which is used to address a cell may be displayed in the cell, adjacent to the program name. In such a case, the subscriber may directly see the combination which he has to say in order to select the cell. Preferably, individual selection combinations, as well as the letter and number characters which identify the rows and columns of table <b>252</b>, are transmitted together with the program guide data.
[0323] In a preferred embodiment of the present invention the order of the characters in the cell selection combination may be reversed so that the number character may precede the letter character, thus generating combinations such as <b>1</b>A, <b>3</b>E, and <b>2</b>C. Alternatively, only letter characters or only number characters may be employed to indicate the rows and columns in table <b>252</b>, and any sequential order of the letter characters and the number characters may be used.
[0324] Typically, a basic cell length corresponds to a 30 minute length featuring program. If a program is longer, its schedule is displayed in several cells, with direct relation to program length. In such a case, if, for example, a program schedule is displayed in three cells, the program selection combination may be each one of the combinations which may be used to address each of the three cells. In a preferred embodiment of the present invention, only the combination which is employed to address the last of the three cells is displayed adjacent to the program name, and may be used to select the program.
[0325] Preferably, when the subscriber says the combination which relates to the cell, an indicator is placed on the program to be selected. If the subscriber further says the combination SEL9, the CATV converter automatically tunes to the channel in which the program is displayed, menu <b>250</b> disappears from the television screen, and the selected program is displayed on the television screen.
[0326] Referring now to FIG. 5C, a channel list menu <b>280</b> which may be selected from the main menu of FIG. 5A by saying “A2” followed by “SEL9” is illustrated. Channel list menu <b>280</b> is a typical representation of an arrangement of a screen in a one-dimensional table format.
[0327] Preferably, channel list menu <b>280</b> includes a table <b>282</b> having a list of characters which are associated with channel identification names. The characters are preferably number characters which are associated with conventional channel numbers.
[0328] It is to be appreciated that table <b>282</b> is a one-dimensional table. In the voice activated program guide of the present invention a channel in table <b>282</b> may be selected by saying the channel number followed by the voice instruction SEL9 for executing the selection.
[0329] If, for example, a requested channel is channel <b>11</b>, and the number “11” is said, an indicator is placed on channel <b>11</b>. If, after saying the number “11” the voice instruction SEL9 is said, the selection of channel <b>11</b> is executed, the display of channel list menu <b>280</b> disappears, and the CATV converter automatically tunes to channel <b>11</b> and displays a current program which is featured on channel <b>11</b>.
[0330] In a preferred embodiment of the present invention menu <b>280</b> also includes a table of instructions <b>284</b> and a table of instructions <b>286</b>, which are respectively similar to tables of instructions <b>254</b> and <b>256</b> of FIG. 5B. Tables <b>284</b> and <b>286</b> are located below table <b>282</b> and adjacent to table <b>282</b> respectively. Preferably, table <b>284</b> and table <b>286</b> include instructions for navigating in table <b>282</b> and instructions for executing operations in table <b>282</b> as mentioned herein above with reference to tables <b>254</b> and <b>256</b> of FIG. 5B.
[0331] Referring now to FIG. 5D, an example of the favorites menu of FIG. 5A which may be selected from the main menu of FIG. 5A by saying “A3” followed by “SEL9” is illustrated. The favorites menu is a typical representation of an arrangement of a screen having pre-positioned non-ordered selection cells or areas, such that when the subscriber selects one of the selection areas on the screen information associated with the selected area is displayed. Preferably, such a selection may be performed by placing an indicator on the area to be selected.
[0332]FIG. 5D includes a favorites menu <b>300</b>. Favorites menu <b>300</b> includes a sub-display <b>302</b> having a plurality of cells, each corresponding to a separate feature for which a favorite menu is required. Menu <b>300</b> may also include a table of instructions <b>304</b> and a table of instructions <b>306</b>, which are similar to tables <b>254</b> and <b>256</b> of FIG. 5B respectively, and have similar functionality -and structures.
[0333] In the configuration of sub-display <b>302</b>, an individual selection combination which is used to address a cell may be displayed in the cell, adjacent to the name of the cell. When the subscriber says the combination which is displayed in the cell followed by the instruction “SEL9”, the cell is selected, and the program guide passes to the respective favorite sub-menu.
[0334] Preferably, each such favorite sub-menu includes favorite data which is selected by the subscriber. The subscriber may insert or delete favorite data, and use features, such as recording, which operate on the favorite data by employing the commands in table <b>306</b>.
[0335] In a preferred embodiment of the present invention, when the subscriber selects the channels cell, by saying “A1” followed by “SEL9”, a sub-menu of pre-programmed favorite channels is displayed, and an indicator is placed on the first channel in the sub-menu.
[0336] When the subscriber selects the programs cell, by saying “A2” followed by “SEL9”, a list of the favorite programs is displayed, together with the featuring dates and times. When the viewing hours cell is selected, by saying “B1” followed by “SEL9”, programs featuring at the hours that the subscriber considers as favorite are displayed.
[0337] A selection of the recording programs cell, by saying “C2” followed by “SEL9”, provides a display of a list of programs to be recorded, and selected hours for recording. This list may be in the form of a one-dimensional table format and selections therefrom are performed in the manner described herein above with reference to FIG. 5C.
[0338] When the subscriber selects the themes cell, by saying “D1” followed by “SEL9”, a list of the favorite themes is displayed, together with the programs which match each favorite theme.
[0339] Referring now to FIG. 5E, an example of the prime time menu of FIG. 5A that may be selected from the main menu of FIG. 5A by saying “A4” followed by “SEL9” is illustrated. The prime time menu is another typical representation of an arrangement of a screen in a two-dimensional table format. Preferably, selections in such a menu may be performed in the manner described above with reference to FIGS. 5A and 5B.
[0340] In a preferred embodiment of the present invention a prime time menu <b>350</b> in FIG. 5E includes a two-dimensional table <b>352</b> with an ordered grid having identical cell sizes.
[0341] Preferably, table <b>352</b> displays programs and shows featuring at prime time hours at various channels. In the example of FIG. 5E, table <b>352</b> displays the programs that feature every day between 19:00 hours and 23:00 hours.
[0342] Prime time menu <b>350</b> may also include a table of instructions <b>354</b> and a table of instructions <b>356</b>, which are similar to tables <b>254</b> and <b>256</b> of FIG. 5B respectively, and have similar functionality and structures thereof.
[0343] In a preferred embodiment of the present invention selections in table <b>352</b> are performed as mentioned above with reference to the two-dimensional tables in FIGS. 5A and 5B, i.e. by saying a character which indicates a row followed by a character which indicates a column, or vice versa, and by saying an instruction from table <b>356</b>. Thus, by saying “D2” an indicator is placed on the program “Bay Watch” in table <b>352</b>. If the selection of “Bay Watch” is followed by an instruction, such as “SEL9”, the instruction is executed, and the program guide instructs the CATV converter to tune to the channel at which the program “Bay Watch” is featuring.
[0344] When the subscriber browses through the channels, such as by employing the PAGE UP and PAGE DOWN instructions in table <b>354</b>, programs featuring at prime time hours in other channels are displayed. Preferably, a channel display cycle is repeated after displaying all available channels.
[0345] Referring now to FIG. 5F, the recording schedule menu of FIG. 5A that may be selected from the main menu of FIG. 5A by saying “B1” followed by “SEL9” is illustrated. The recording schedule menu, indicated as <b>400</b>, is another typical representation of an arrangement of a screen having pre-positioned non-ordered selection areas.
[0346] In FIG. 5F, menu <b>400</b> includes a sub-display <b>402</b> having a plurality of cells, each corresponding to a recording parameter. In the configuration of sub-display <b>402</b>, an individual selection combination which is used to address a cell may be displayed in the cell, adjacent to the name of the cell. When the subscriber says the combination which is displayed in the cell followed by the instruction “SEL9”, the cell is selected, and the subscriber may change the corresponding recording parameter.
[0347] Menu <b>400</b> may also include a table of instructions <b>404</b> and a table of instructions <b>406</b>, which are similar to tables <b>254</b> and <b>256</b> of FIG. 5B respectively, and have similar functionality and structures thereof.
[0348] As illustrated in FIG. 5F, the subscriber may select a channel and a program featuring at the channel for recording. When the subscriber says “A1” followed by “SEL9” a channel window <b>408</b> is opened, and a banner is placed on a first channel in a list of available channels in the system.
[0349] Preferably, the subscriber may browse through available channels by using “UP” and “DOWN” instructions from table <b>404</b> to move the banner up and down the channel window. The “UP” instruction may be executed by saying “A0”, and the “DOWN” instruction may be executed by saying “Z9”.
[0350] It is to be appreciated that a navigation instruction from table <b>404</b> is not to be followed by an execution instruction from table <b>406</b>. Thus, for example, when the subscriber says “A0” an UP jump is executed immediately.
[0351] Preferably, the subscriber may also use the PAGE UP and PAGE DOWN instructions in table <b>404</b> in order to browse more quickly through the channels by jumping, forward or backward, a constant number of channels, such as 16 channels per jump.
[0352] When the subscriber browses through the channels, an indicator is moved so as to indicate a current channel in the channel window. When the indicator is placed on a requested channel, the subscriber may select the requested channel by saying “SEL9”.
[0353] After a channel is selected, a program may be selected by saying “B1” followed by “SEL9”. Then, a program window <b>410</b> is opened, and browsing through program banners may be performed in a similar way as browsing through channels, and by employing similar instructions.
[0354] In a preferred embodiment of the present invention selection of a recording date setup and recording time setup may be also performed in a similar way as the selection of a channel and a program. When the subscriber says “C1” followed by “SEL9” a date window <b>412</b> is opened and the subscriber may browse through date banners and select a recording date.
[0355] Preferably, an indicator may be placed on a first day digit. A requested day may be selected by using the “UP” and “DOWN” instructions from table <b>404</b> to browse through available digits for each digit which forms part of a representation of the day. When a required digit is displayed, the subscriber may select the required digit by saying “SEL9”. To move to the next digits which form the date and of which setup is required, the subscriber may use the “LEFT” and “RIGHT” instructions in table <b>404</b> by saying “L0” and “R9” respectively.
[0356] A setup of a time to begin recording and a setup of a time to end recording may be selected by saying “D1” and “D2” respectively followed by “SEL9”. When the setup of the time to begin recording is selected, a setup time window <b>414</b> is opened. When the setup of the time to end recording is selected, a setup time window <b>416</b> is opened.
[0357] Preferably, when one of the time windows <b>414</b> and <b>416</b> is selected, an indicator may be placed on a first hour digit. A requested time may be selected by using the “UP” and “DOWN” instructions from table <b>404</b> to browse through available digits for each digit which forms part of a representation of the time. When a required digit is displayed, the subscriber may select the required digit by saying “SEL9”. To move to the next digits of the time for which setup is required, the subscriber may use the “LEFT” and “RIGHT” instructions in table <b>404</b> by saying “L0” and “R9” respectively.
[0358] In another preferred embodiment of the present invention a selection of a program to be recorded is sufficient to define a recording date and a recording time, since the program may be associated with the featuring date and time. Thus, selection of a date and a time may be obviated.
[0359] Referring now to FIG. 5G, an example of the system configuration menu of FIG. 5A that may be selected from the main menu of FIG. 5A by saying “B2” followed by “SEL9” is illustrated. The system configuration menu, indicated as <b>450</b>, is another typical representation of an arrangement of a screen in a one-dimensional table format.
[0360] Preferably, system configuration menu <b>450</b> includes a one-dimensional table <b>452</b> having a list of features to be configured, and each feature is preferably identified by a letter character. Menu <b>450</b> may also include a table of instructions <b>454</b> and a table of instructions <b>456</b>, which are similar to tables <b>254</b> and <b>256</b> of FIG. 5B respectively, and have similar functionality and structures thereof.
[0361] In a preferred embodiment of the present invention a feature in table <b>452</b> may be selected by saying the letter character which identifies the requested feature, followed by the voice instruction “SEL9” from table <b>456</b> for executing the selection. Preferably, when the subscriber says the letter character which identifies a feature, such as the letter character “E”, an indicator is placed on the corresponding feature, i.e. on the “diagnostic” feature. Then, if the subscriber says “SEL9”, menu <b>450</b> disappears and the program guide displays a diagnostic sub-display (not shown) in which the subscriber may view and change diagnostic parameters.
[0362] Referring now to FIG. 5H, an example of the parental control menu of FIG. 5A that may be selected from the main menu of FIG. 5A by saying “B3” followed by “SEL9” is illustrated. The parental control menu, indicated as <b>500</b>, is another typical representation of an arrangement of a screen having pre-positioned non-ordered selection areas.
[0363] Parental control menu <b>500</b> may include a sub-display <b>502</b> having a plurality of cells, each corresponding to a separate a parental control sub-menu. Menu <b>500</b> may also include a table of instructions <b>504</b> and a table of instructions <b>506</b>, which are similar to tables <b>254</b> and <b>256</b> of FIG. 5B respectively, and have similar functionality and structures thereof.
[0364] In the configuration of sub-display <b>502</b>, an individual selection combination which is used to address a cell may be displayed in the cell, adjacent to the name of the cell. When the subscriber says the combination which is displayed in the cell, followed by the instruction “SEL9” from table <b>506</b>, the cell is selected, and the program guide passes to the respective parental control sub-menu.
[0365] In a preferred embodiment of the present invention, when the subscriber selects the information cell, by saying “A1” followed by “SEL9”, a sub-menu (not shown) may be displayed in which the subscriber may view information regarding the parental control options of the program guide and the system.
[0366] When the subscriber selects the key lock cell, by saying “B1” followed by “SEL9”, a key lock sub-menu (not shown) may be displayed and the subscriber may select an access key for programs rated for adults only. Preferably, the subscriber may also enter key locks to lock programs in order to prevent children from viewing programs rated for adults only.
[0367] When the list of programs cell is selected, by saying “C1” followed by “SEL9”, a list of the programs and their ratings is displayed.
[0368] A selection of the authorized programs cell, by saying “D1” followed by “SEL9”, provides a display of a list of programs which are authorized to view by any member of the subscriber's family. This list, as well as the list of program ratings, may be in the form of a one-dimensional table format and selections therefrom are performed in the manner described herein above with reference to FIG. 5C.
[0369] When the subscriber selects the list of channels cell, by saying “E1” followed by “SEL9”, a list of channels which are rated for adults only, or for specific usage such as video-conference, is displayed. This list may also be in the form of a one-dimensional table format and selections therefrom are performed in the manner described herein above with reference to FIG. 5C.
[0370] Referring now to FIG. 5I, an example of the E-mail menu of FIG. 5A that may be selected from the main menu of FIG. 5A by saying “B4” followed by “SEL9” is illustrated. The E-mail menu, indicated as <b>550</b>, is another typical representation of an arrangement of a screen having pre-positioned non-ordered selection areas.
[0371] E-mail menu <b>500</b> may include a sub-display <b>552</b> having a plurality of pre-positioned cells. Menu <b>550</b> may also include a table of instructions <b>554</b> and a table of instructions <b>556</b>, which are similar to tables <b>254</b> and <b>256</b> of FIG. 5B respectively, and have similar functionality and structures thereof.
[0372] In the configuration of sub-display <b>552</b>, an individual selection combination which is used to address a cell may be displayed in the cell, adjacent to the name of the cell. When the subscriber says the combination which is displayed in the cell, followed by the instruction “SEL9” from table <b>556</b>, the cell is selected, and the respective command is executed.
[0373] In a preferred embodiment of the present invention an E-mail message, originated from a headend via a modem of the CATV converter or via cable, may be displayed in sub-display <b>552</b>, and the subscriber may browse through various messages by using the PAGE UP and the PAGE DOWN instructions from table <b>554</b>. Preferably, the subscriber may also cancel a message by saying “A1” followed by “SEL9”, or store a message by saying “A2” followed by “SEL9”.
[0374] It is to be appreciated that the code combinations described with reference to FIGS. <b>5</b>A-<b>5</b>I may be employed to distinguish the requested voice commands from natural speech which is spoken in a conversation or played on the television during featuring of a regular program. However, many other combinations may be employed without departing from the spirit of the invention. Such combinations may include other letter characters and other number characters, and other combinations, such “SE0” for SELECT, “A1” for UP, etc. which may also be employed to distinguish the voice commands from natural speech.
[0375] In another preferred embodiment of the invention conventional natural speech may be employed for selection, and the special instruction code combinations as mentioned herein above with reference to FIGS. <b>5</b>A-<b>5</b>I may be used for execution of the selections. Thus, even if a natural selection word is spoken in a conversation, a selection is not executed if the special execution combination does not follow the natural selection word. Preferably, the natural speech may include words, phrases and sentences such as “ORDER BAY WATCH”, or “I WANT TO WATCH CHANNEL 4”.
[0376] Alternatively, the special selection code combinations, as mentioned herein above with reference to FIGS. <b>5</b>A-<b>5</b>I, may be used for selections, and natural command words, such as “GO” and “SELECT” may be used for instructions. Such a combination assures performance of legitimate commands only.
[0377] In another preferred embodiment of the present invention the subscriber may generate his own vocabulary for selections and commands. The vocabulary may include favorite words, such as names of people, funny words, etc. Preferably, the vocabulary generated by the subscriber may be recorded and analyzed in a voice recognition unit in the CATV converter and stored in a memory in the CATV converter as mentioned above with reference to FIGS. 2 and 3.
[0378] It is appreciated that various features of the invention which are, for clarity, described in the contexts of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination.
[0379] It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. Rather the scope of the present invention is defined by the claims which follow:
Contents5
15 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US9972304B2 | Cited by | United States of America | Applicant |
| US10972205B2 | Cited by | United States of America | Search report |
| US10067934B1 | Cited by | United States of America | Applicant |
| US2008281601A1 | Cited by | United States of America | Pre-grant |
| US2014259043A1 | Cited by | United States of America | Pre-grant |
| US2006048207A1 | Cited by | United States of America | Pre-grant |
| US11086596B2 | Cited by | United States of America | Applicant |
| US9118967B2 | Cited by | United States of America | Applicant |
| US7908146B2 | Cited by | United States of America | Applicant |
| US9462340B1 | Cited by | United States of America | Search report |
| US2009132250A1 | Cited by | United States of America | Pre-grant |
| US8121846B2 | Cited by | United States of America | Search report |
| US11997357B2 | Cited by | United States of America | Search report |
| US9271039B2 | Cited by | United States of America | Applicant |
| US10249300B2 | Cited by | United States of America | Applicant |
| US9653073B2 | Cited by | United States of America | Search report |
| US8706502B2 | Cited by | United States of America | Applicant |
| US11317162B2 | Cited by | United States of America | Applicant |
| US9167186B2 | Cited by | United States of America | Applicant |
| US9414004B2 | Cited by | United States of America | Applicant |
| US10706841B2 | Cited by | United States of America | Applicant |
| US2010080221A1 | Cited by | United States of America | Pre-grant |
| US2014156281A1 | Cited by | United States of America | Search report |
| US9668024B2 | Cited by | United States of America | Applicant |
| US9055254B2 | Cited by | United States of America | Applicant |
| US9172896B2 | Cited by | United States of America | Applicant |
| US10318871B2 | Cited by | United States of America | Applicant |
| US11128714B2 | Cited by | United States of America | Applicant |
| US9934775B2 | Cited by | United States of America | Applicant |
| EP2986015A1 | Cited by | European Patent Office (EPO) | Search report |
| EP2680597A3 | Cited by | European Patent Office (EPO) | Search report |
| US2024024690A1 | Cited by | United States of America | Search report |
| US10795541B2 | Cited by | United States of America | Applicant |
| US2014156281A1 | Cited by | United States of America | Pre-grant |
| US11405466B2 | Cited by | United States of America | Applicant |
| US11544602B2 | Cited by | United States of America | Search report |
| US2019019504A1 | Cited by | United States of America | Search report |
| US10446143B2 | Cited by | United States of America | Applicant |
| US9396728B2 | Cited by | United States of America | Applicant |
| US2016323521A1 | Cited by | United States of America | Search report |
| US10049668B2 | Cited by | United States of America | Applicant |
| US10192552B2 | Cited by | United States of America | Applicant |
| US11373425B2 | Cited by | United States of America | Applicant |
| CN103187063A | Cited by | China | Search report |
| US10506294B2 | Cited by | United States of America | Applicant |
| US9021517B2 | Cited by | United States of America | Applicant |
| EP2474973A1 | Cited by | European Patent Office (EPO) | Search report |
| US9626955B2 | Cited by | United States of America | Applicant |
| US2013325480A1 | Cited by | United States of America | Pre-grant |
| US8660846B2 | Cited by | United States of America | Applicant |
| US10897637B1 | Cited by | United States of America | Applicant |
| US10747498B2 | Cited by | United States of America | Applicant |
| US10904611B2 | Cited by | United States of America | Applicant |
| US11782512B2 | Cited by | United States of America | Applicant |
| US10331312B2 | Cited by | United States of America | Applicant |
| EP3833036A1 | Cited by | European Patent Office (EPO) | Search report |
| USRE47168E | Cited by | United States of America | Applicant |
| US2018020059A1 | Cited by | United States of America | Search report |
| US7953084B2 | Cited by | United States of America | Search report |
| US10930276B2 | Cited by | United States of America | Search report |
| US2004114731A1 | Cited by | United States of America | Pre-grant |
| US10089072B2 | Cited by | United States of America | Applicant |
| US10593346B2 | Cited by | United States of America | Applicant |
| US9215510B2 | Cited by | United States of America | Applicant |
| US10366158B2 | Cited by | United States of America | Applicant |
| US11778303B2 | Cited by | United States of America | Applicant |
| US9426527B2 | Cited by | United States of America | Applicant |
| US2018176031A1 | Cited by | United States of America | Search report |
| US8433571B2 | Cited by | United States of America | Applicant |
| US9215393B2 | Cited by | United States of America | Applicant |
| US11069347B2 | Cited by | United States of America | Applicant |
| EP3413575A1 | Cited by | European Patent Office (EPO) | Search report |
| US10490187B2 | Cited by | United States of America | Applicant |
| US10553215B2 | Cited by | United States of America | Applicant |
| USRE48423E | Cited by | United States of America | Applicant |
| US7769589B2 | Cited by | United States of America | Search report |
| US11080012B2 | Cited by | United States of America | Applicant |
| US2008162145A1 | Cited by | United States of America | Pre-grant |
| US9232168B2 | Cited by | United States of America | Applicant |
| US10554432B2 | Cited by | United States of America | Search report |
| US8983299B2 | Cited by | United States of America | Applicant |
| US9865248B2 | Cited by | United States of America | Applicant |
| US10410637B2 | Cited by | United States of America | Applicant |
| US2018364977A1 | Cited by | United States of America | Search report |
| US11595723B2 | Cited by | United States of America | Search report |
| EP2860726A2 | Cited by | European Patent Office (EPO) | Search report |
| US2012158189A1 | Cited by | United States of America | Pre-grant |
| US2014244270A1 | Cited by | United States of America | Pre-grant |
| US11962851B2 | Cited by | United States of America | Applicant |
| US10671428B2 | Cited by | United States of America | Applicant |
| US9414108B2 | Cited by | United States of America | Applicant |
| US2022021943A1 | Cited by | United States of America | Search report |
| US10691473B2 | Cited by | United States of America | Applicant |
| US11778032B2 | Cited by | United States of America | Applicant |
| US10043516B2 | Cited by | United States of America | Applicant |
| US2015019974A1 | Cited by | United States of America | Pre-grant |
| US9953088B2 | Cited by | United States of America | Applicant |
| US9633660B2 | Cited by | United States of America | Applicant |
| US2009320076A1 | Cited by | United States of America | Pre-grant |
| US2009327957A1 | Cited by | United States of America | Pre-grant |
3 members in 2 offices
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 11994896 | Israel | A | |
| 11994896 | Israel | A | |
| 99197297 | United States of America | A | |
| 99197297 | United States of America | A | |
| 93309701 | United States of America | A | |
| 08991972 | – | – | – |
| 119948 | – | – | – |
| IL19960119948 | – | – | – |
| US19970991972 | – | – | – |
| US20010933097 | – | – | – |
Members3
| Document | Office | Kind | |
|---|---|---|---|
| US2002052746A1 | United States of America | A1 | |
| US6654721B2 | United States of America | B2 | |
| IL119948A | Israel | A |
35 transactions on the USPTO file
Allowed after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | |
|---|---|
| Recordation of Patent Grant Mailed | |
| Patent Issue Date Used in PTA CalculationAllowed | |
| Issue Notification MailedAllowed | |
| Receipt into Pubs | |
| Application Is Considered Ready for Issue | |
| Receipt into Pubs | |
| Workflow - File Sent to Contractor | |
| Receipt into Pubs | |
| Dispatch to Publications | |
| Dispatch to Publications | |
| Issue Fee Payment Verified | |
| Workflow - Drawings Finished | |
| Workflow - Drawings Matched with File at Contractor | |
| Issue Fee Payment Received | |
| Mail Notice of AllowanceAllowed | |
| Mail Oath of Declaration Required | |
| Oath or Declaration Required | |
| Notice of Allowance Data Verification CompletedAllowed | |
| Correction - Oath or Declaration NOT Required | |
| Request for Extension of Time - Granted | |
| Interview Summary Record | |
| Mail Non-Final RejectionNon-final rejection | |
| Non-Final RejectionNon-final rejection | |
| Case Docketed to Examiner in GAU | |
| Information Disclosure Statement (IDS) Filed | |
| Information Disclosure Statement (IDS) Filed | |
| Application Dispatched from OIPE | |
| Application Is Now Complete | |
| Notice Mailed--Application Incomplete--Filing Date Assigned | |
| Correspondence Address Change | |
| Correspondence Address Change | |
| IFW Scan & PACR Auto Security Review | |
| Incoming Letter Pertaining to the Drawings | |
| Preliminary Amendment | |
| Initial Exam Team nn |
17 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF |
Numbers
- Publication, DOCDB
- 2002052746
- Publication, EPODOC
- US2002052746
- Application
- 9933097
- Application, DOCDB
- 93309701
- Application, EPODOC
- US20010933097
Titles
- English
- Voice activated communication system and program guide
Patent term adjustment
- Net adjustment
- 0 days
Classification
- CPC, 6
- H04N21/482
- H04N7/163
- H04N21/42203
- H04N21/4223
- H04N21/4415
- G10L15/22
- IPC, 8
- G10L15 26
- G10L17 00
- H04N
- H04N7 16
- H04N21 422
- H04N21 4223
- H04N21 4415
- H04N21 482
- USPC, 3
- 704270000
- 348E07061
- 704E15045