Simulcast of interactive signals with a conventional video signal

ES 2 233 941 T3

DESCRIPTION

Simultaneous transmission of interactive signals with a conventional video signal.

The present invention relates to a method of receiving a composite interactive signal for presentation as a television program with interactivity, and to a production system for creating the composite interactive signal and to a receiver for receiving this type of signal.

Interactive television system technologies are currently being introduced to the telecommunications scene. The interactive capability has been developed using one-way systems through the provision of multiple parallel information channels, interrelated by content. For example, US-A-4,264,924 and US-A-4,264,925 each disclose interactive television systems in which you can switch between multiple television channels and cable channels based on viewers' selections in response. to messages with questionnaires.

These systems have been improved to include memory functions using computer logic and memory, in which the selections of system responses heard from the viewer are based on the processing and storage of subscriber responses, as described in US-A -4,507,680.

US-A-4,847,698, US-A-4,847,699 and US-A-4,847,700 each describe a television system that offers a common video signal accompanied by several synchronized audio channels to provide responses. user selectable related by content. Audio signals produce different audio responses. In US-A-4,847,700 these responses are syllabically synchronized for a first audio script and for the video signal (such as for a person or character on the screen) which gives the impression that the movements of the the person's or character's mouths match the spoken words.

These prior art systems allow interactive capability through the use of several related and parallel information segments, each segment requiring a separate channel.

The present invention wishes to provide a fully functional interactive program that can be normally received with non-interactive television receivers as a conventional video broadcast and in which full interactivity is transmitted with the same bandwidth as is necessary for a television signal. standard.

According to a first aspect of the invention an interactive program production system is provided to create a single composite signal for transmission within a conventional television bandwidth to multiple subscribers, the composite interactive signal comprising both a television program conventional as a fully interactive program, comprising the production system: means for storing or receiving at least one conventional video signal comprising standard audio and standard video; means for providing a plurality of audio channels to provide personalized responses to subscriber selections, the audio channels comprising segments that are of substantially equal length in time; means for generating graphical information and for creating control information to control the use of audio channels and graphical information; and means for combining the conventional video signal with the graphic information and the control information to form said composite interactive signal, wherein said control information includes codes that are integrated into the video signal and that are arranged to initiate and control the listening to selected audio channels and using graphic information.

Simultaneous Broadcasting of Simple Composite Interactive Signal is a fully interactive program that enables subscriber participation through the use of an interactive programming box, and even viewers without an interactive programming box can watch normal conventional programming uninterruptedly. Both types of programs are provided for reception of the same standard video signal or normal conventional programming. This dual functionality can be envisioned in any one of several effective broadband unidirectional techniques for sending multiple hidden interactive audio segments, graphical information, and schedule control information, the reception and processing of which provides a fully interactive experience for subscribers. Enhanced interactive flexibility is possible through the use of external information storage such as a CD ROM that can store additional graphical interactive elements locally. An important feature of embodiments of the invention is that interactivity is offered as an option, without any degradation or interruption of program content for users who choose not to interact or do not have an interactive programming box.

The present invention also extends to an interactive system for receiving a composite interactive signal comprising both conventional television programs and fully interactive programs, wherein the composite interactive signal comprises at least one conventional video signal comprising standard audio and standard video. combined with graphical information and control information, and a plurality of audio channels, said control information including codes that are integrated into the video signal, and wherein said interactive system comprises: receiving means for receiving the composite interactive signal; extraction means for extracting the graphic information and the control information from the video signal; demodulator means for demodulating standard audio and video, and demodulating means for applying the video to a screen and the audio to an audio output; processor means coupled to the extraction means and in response to the extracted control information, and a

ES 2 233 941 T3 audio switch controllable by said processor means, wherein said processing means is arranged to identify the extracted control information as instructions for listening to a selected audio channel or the use of the graphical information and is well arranged to direct a selected audio channel to the audio switch to the application to the audio output or to give rise to the use of the information in images in the beginning of the codes of said control information.

An interactive system receiver as defined may be provided with an interactive programming box connected to conventional television equipment or computer users by means of a multimedia personal computer (PC) with an RF demodulator card and hardware and software of decoding.

In some embodiments, alternative audio responses and graphical displays are provided and may be used in response to a current subscriber input signal or in response to previous stored subscriber input signals. Audio customization can be enhanced by using additional audio response segments preloaded in the interactive programming box and stacked audio response segments over time. Further improvement is possible by using external storage devices such as a CD ROM to store interactive elements of graphic information and audio information, increasing the responsiveness of the system.

Embodiments of the invention do not require personalized messages to be presented immediately after the subscriber has made an answer option selection. The use of trigger points overcomes the limitation of the response formats with interactive answering described in the prior art by allowing specialized attention to the subscriber at indeterminate times during the course of the program. Interactive graphics and audio can appear at any time during the program based on stored subscriber information.

This enhanced interactivity is contemplated through the use of trigger points distributed throughout the program and identifiable by the codes embedded in the video signal. Trigger points provide selected times during the program when program content is imperceptibly altered to present individual and specialized attention to the specific subscriber watching the television or computer screen. Trigger points are indicators in the program that effectively trigger macros that establish a certain interactive function (for example, auditioning a custom audio segment and / or overlaying a graphical display) to bring up the use of the selections in the subscriber. These subscriber selections may, for example, have been stored in response to questions presented at the beginning of the program, or withheld from a previous program, and / or in combination with a particular pattern of interactions requested and entered during the program. The controller of the interactive programming box recognizes the trigger points by decoding invisible codes embedded in the conventional video signal. The exact times of the trigger points are unknown to the subscriber in order to make the interactive elements appear unsolicited to the interactive subscriber. In this way, interactive elements are presented in a more subtle and less perceptible way than before.

Meanwhile, subscribers either without boxes of interactive programming or with boxes, but not authorized to receive the specific interactive program, continue to receive and listen to the audio and to watch the video of the conventional standard program without being offered interactive options or specialized responses. Accordingly, both an interactive program and a non-interactive program are transmitted to the subscribers simultaneously.

This high degree of individual participant interactivity is delivered to the home television or personal computer through the use of a single standard video signal. A normal television signal has an audio carrier and a video carrier. Standard audio, synchronized with the video presentation, is inserted into the normal audio carrier, thus maintaining compatibility with any conventional television equipment.

In some embodiments of the invention, unused video lines may be used to integrate additional interactive response audio and video channels of control information. Alternatively, the interactive audio segments can be provided either serially, or one after the other, on the audio subcarrier (SAP), or in cable frequency shield bands, and / or stored in memory in advance in the box. interactive programming. In addition, more audio and graphics elements can be made easier by using external storage devices or game cartridges. In any case, with the embodiments of the invention it is inconsequential that the interactive elements are transmitted in a synchronized manner, in series, on separate channels, integrated into the video, transmitted during or before the program or stored in external information stores. Any of these elements, regardless of their origin, can be displayed on the screen through the interactive box at selected activation points by using the logic sent in codes integrated into the signal. Indeed, a normal conventional television program and an interactive program are simultaneously transmitted from a centralized location to a multitude of subscriber dwellings, some of which are equipped to receive the interactive program while others are not.

The enhanced level of interactivity is transmitted to interactive subscribers in their homes through the use of interactive programming boxes connected to television sets, which receive signals either by cable, direct satellite broadcast, television broadcast, or other transmission media. . In the present invention, programming can be presented in both analog and digital embodiments.

ES 2 233 941 T3

According to another aspect of the invention there is provided a method for receiving a composite interactive signal for display on the screen as a television program with interactivity, in which the composite interactive signal comprises both a conventional television program and a fully integrated program. interactive, and includes, at least, a conventional video signal comprising standard audio and standard video combined with graphic information and control information, and a plurality of audio channels, said control information including codes integrated into the video signal, the method comprising the steps of: reception of the composite interactive signal; extraction of graphic information and control information from the video signal; demodulation of standard audio and video, and application of video to a presentation and audio to audio output; identifying the extracted control information as instructions to listen to a selected channel of the plurality of audio channels or to use the graphical information, and directing the selected audio channel to the audio output or using the graphical information at a given time by means of the codes of such control information.

Embodiments of the present invention will now be described, by way of example, with reference to the accompanying drawings, in which:

Figure 1 is an overview of the operations center, transmission subsystem, and home reception subsystem of a system for transmitting and receiving interactive programs.

Figure 2 is a timing chart showing a representation of trigger points and corresponding alternate audio segments, one of which is selected for presentation to the subscriber immediately after the execution of a trigger point function.

Figure 3 is a diagram of an embodiment of an interactive programming box for extracting interactive audio segments and information from a conventional video signal in which said interactive elements have been integrated into the composite interactive video signal at the operations center. .

Figure 4 is a more detailed schematic of the hardware elements of a VBI four-channel analog extractor in an interactive programming box as shown in Figure 3.

Figure 5 is a more detailed schematic of an alternative digital embodiment comprising a digital extractor comprising a decoder / demultiplexer configuration.

Figure 6 is a diagram of a second embodiment of an interactive programming box for extracting and storing interactive audio segments from a SAP audio channel in which the interactive audio segments are aligned in the SAP channel at the head end. .

Figure 7 is a diagram of another embodiment of an interactive programming box comprising two tuners, one of which is to tune and demodulate the standard video and audio signal and the second of which is to demodulate a secondary analog carrier comprising demodulated serial digital audio segments.

Figure 8 is a diagram of another embodiment of an interactive programming box also comprising two tuners, but with a digital demultiplexing configuration for demultiplexing the digital audio stream onto n parallel digital audio channels, where the n channels Digital audio streams are time divisions multiplexed at the head and transmitted as separate digital audio streams.

Figure 9 is a diagram showing hardware elements of an analog transmission embodiment in the operations center comprising a stuffer for integrating four audio circuits and information commands into a single video signal.

Figure 10 is a block diagram showing hardware elements in the operations center of a digital transmission embodiment comprising digital compression / encoding configurations and a digital multiplexer.

1. Introduction

The present invention is a fully interactive simultaneous program transmission system that allows subscribers to interact with the program through the use of a remote device (604) and an interactive programming box (600) connected to television equipment (186 ) conventional or by using a keyboard and a personal computer (187), with normal conventional programming, viewable by anyone with a normal television set (186) or computer monitor (187) with a screen, as shown in Figure 1.

Although this type of interactive programming may include a plurality of video signals, the interactive television programming used herein comprises a single standard audio and video television signal with a plurality of additional audio signals and / or graphic information to facilitate viewing. interactivity. The interaction with the subscribers comes mainly by the mode of selection of one or more connected audio segments from a plurality of audio segments, whereby the selected audio segment or segments are chosen based on

ES 2 233 941 T3 of previous user answers. Interactivity is enhanced through the use of graphics overlaid on the video which, like the audio responses, also vary according to the selections made by the subscriber at the remote device (604). Audio segments are used to allow personalized responses to subscriber selections. On the other hand, graphics are used both to query the subscriber, preferably at the beginning of the program, as well as to send personalized graphic messages to subscribers. The interactive television program also comprises control information that controls a controller (178) of the interactive programming box at the subscriber's home.

Interactivity is further enhanced in the preferred embodiment by applying trigger points distributed at predetermined times throughout the program. Trigger points correspond to times when interactive events are scheduled to take place. These interactive events could be the selection and audition of audio segments or the presentation of images. Although the choice of certain audio or graphic segments is still dependent on the viewer's selections in response to the displayed graphic interrogation messages, they are preferably made during a period at the beginning of the program or when a viewer first tunes in to the program. These viewer selections are then used as input signals for macros displayed on screen at later times during the program by the controller when trigger points occur, identified to the interactive programming box by unique codes embedded in the video signal. Alternatively, an immediate response can occur from local storage such as RAM, FLASH or ROM, from external information storage such as CD ROM, from the composite interactive signal, or from a series of audio segments that can be picked up from both the sign as from storage.

II. System Components

A. General

As shown in Figure 1, the system uses an interactive program transmission system (98) with any broadcast transmission medium, including satellite (150), cable (138) or television (142) to transmit programs. conventional and interactive simulcasts (hereinafter "composite interactive program") from a centralized location, or operations center (608), for distribution to subscribers at their homes. The program can be broadcast live from the operations center (608). For example, live sports events can be broadcast from operations center 608 with additional interactive elements. However, with the present invention, the program is more likely to be produced offline and stored on a program storage medium (133) at the operations center (608). Similarly, distribution of the signal to the receiving terminal can be accomplished by any suitable transmission means 166, including a cable, fiber optic, microwave, etc. distribution system. In the preferred embodiment, the system generally includes an operations center (608) from which the composite interactive program is broadcast, the composite interactive program comprising a single video signal, a plurality of audio channels, graphics, and control codes; comprising a broadcast transmission system, equipment for transmitting the interactive video signal by any suitable broadcast transmission medium, and reception equipment for distribution to remote residential locations; and to the addresses of the subscribers; an interactive programming box (600) for signal processing and providing interactivity; a remote device (604) for transmitting subscriber selections to the interactive programming box (600); and a standard television set (186). Alternatively, the interactive program signal may be received, processed, and displayed by means of a personal computer (187) comprising an RF demodulator card, an extractor card, and a keyboard.

An important aspect of this invention is the individualization of the audio response to subscribers at home. Each participant receives personalized audio responses based on one or more selections made on a remote keypad (604). Since the system can remember previous subscriber selections, the subscriber's selections can be keyed in and stored in memory at the beginning of the program for later use by the interactive programming box (600) formulating an interactive response. The audio response is typically a prepared, pre-recorded audio response comprising one or more audio segments. In the present invention, not only the audio responses allow interactivity, but the graphical presentations can also vary depending on the user's previous selections, thus generating a greater individualization of the program.

At remote locations, participants interact with the interactive program through either a subscriber interface (604) or a computer keyboard. Preferably, the subscriber interface (604) is a remote Infrared (IR) connection device with a keyboard or, if the interactive program is received by a personal computer (187), by a PC keyboard. The press of a button on the keyboard (604) inputs the processor (178) of the interactive programming box that can be used either immediately or later by the controller to activate unique algorithm codes to produce a unique and individual message from a plurality of audio segments previously transmitted or stored in the interactive programming box (600). The response may be directed to the subscriber's current response selection, to an interrogation message displayed on the screen, or it may be based on previously keyed-in subscriber selections through the provision of memory and logic in the system and trigger points, such as described later.

Preferably multiple audio segments forming the set of appropriate responses to an interrogation message are sent as part of a standard video signal. There are several different ways to ship with

ES 2 233 941 T3 effectiveness the audio segments necessary for an interactive event given to the interactive programming box (600). Different embodiments for distributing these audio segments include transmission digital and analog embodiments including serial or parallel paths, as described below. The interactive elements can be broadcast in a synchronized manner (alternative responses aligned in time), serially, on separate channels, integrated into existing video and / or transmitted before or during the program. The audio segments tagged for a given interactive event can be sent to the interactive programming boxes (600) well in advance of the scheduled event during the program, the segments being preferably stored in this case in temporary memory, or they can be broadcast the segments concurrently with the event. With the present invention, it does not matter how the audio segments arrive at the interactive programming box 600 as long as they are available for selection at the box 600 at predetermined trigger points. For example, the audio segments could also be stored in local external information storages (629) such as CD-ROM.

In the preferred embodiment, interactive events occur at predetermined trigger points (900), as shown in Figure 2. These points (900) correspond to times when programming content can be altered and customized conventional for subscribers who can receive the interactive signal. The programmer can set the trigger points (900) at any time throughout the entire program. Since the trigger points (900) are unknown to the subscriber, the subscriber does not know when he or she will receive a personalized message. In other words, an interactive response can either immediately follow a corresponding user selection made to an interrogation message or occur at a later time corresponding to a trigger point (900), or any combination of the two. Of course, the timing of interactive events must correspond to suitable moments of the program in which the branching to interactive elements is sensitive and does not collide with the content of the conventional video program still presented on television (186) or other screen monitor. .

As shown in Figure 2, at the beginning of a trigger point 900, the controller will select one or more possible audio responses (or graphical presentation) for presentation to the subscriber. As mentioned above and shown in Figure 2, some of the audio responses may comprise connecting two or more audio segments.

In combination with the use of trigger points (900), the present invention allows the viewer to select certain options at the beginning of the program as appropriate to the viewer's preferences. For example, if the broadcast of the program is a live sporting event, at an early trigger point (900), the viewer could be questioned if the viewer prefers to receive audio in English, Spanish, French, or perhaps hear the announcer. local instead of network announcer Once the selection is made by the viewer, the controller is diverted to the appropriate channel.

Each trigger point (900) is preferably identified by broadcasting codes sent as part of the composite interactive program signal. Preferably, the codes include, at a minimum, the following information: (1) header identifying the occurrence of a trigger point; (2) Function ID (eg selection of audio responses or graphical responses etc.); and (3) corresponding interrogation messages. The first sequence of bits simply identifies to the controller (178) that a trigger point is about to occur. The function ID designates the macro or other set of executable instructions for the controller 178 to read and interpret to obtain the desired result, eg, a selected audio response. Alternatively, the information codes include the current algorithmic function to be applied by the controller (178).

Once the codes are extracted by the extractor (174), the controller (178) reads and interprets the codes and removes from the memory (282, 286) either a stored message for display on the screen or a certain selection or selections of the user designated by the trigger point code. User selections correspond to subscriber responses to a series of interrogation messages preferably presented at the beginning of the program. After obtaining the appropriate selection (s) from the user, the controller 178 reads and executes the executable instructions using the user selection (s) as input signals to the macro algorithm. The result of the algorithm is either a selected audio response and / or a selected graphical response. The audio response can be retrieved from memory if it has been previously stored, retrieved from external information storage 629, or the controller 178 may direct the switch 620 to switch to the particular audio channel if the response is broadcast concurrently with the trigger point. After presenting the selected audio response to the subscriber, switch 620 returns to standard audio, displayed at time t_s in figure 2.

As mentioned above, preferably, when the subscriber begins to watch the interactive program, a series of interrogation messages are presented. These interrogation messages can be presented in one of the following three ways. First, the interrogation message can be presented as graphical displays superimposed by the interactive programming box 600 on the conventional video signal, in which the graphic information is sent in the vertical blank range of the combined interactive signal. Second, the interrogation messages are presented as graphical presentations, as discussed above, except for graphical information that comes from local storage such as RAM (282) or FLASH ROM (286), external information storage (629) (for example , CD ROM, cartridge, etc.), or a combination of information in the VBI and information extracted either from a storage (629) of external or local information (284). Third, the graphical information may be prepared in the form of a user template stored in the interactive programming box (600).

ES 2 233 941 T3

User selections corresponding to responses to the n successive interrogation messages are received by the remote interface (628) at the beginning of the program, stored in memory, and used throughout the program at appropriate trigger points to change the content of the program. imperceptibly as the program progresses. Preferably, each question has a set of possible answers. Near each possible answer will be some identifier corresponding to a label on a key in the remote subscribers (604). The subscriber presses the key corresponding to his answer selection. This selection is decoded by the remote interface (628) and the controller (178), stored in memory (282, 286), preferably RAM (282), and used later when necessary with a designated algorithm at a trigger point.

Graphics can be superimposed on video at the subscriber's site by using a character generator (624), as shown in Figures 3-8. The catactor generator (624) is essentially a display chip. onscreen. After integrating the graphic codes into the video signal of the program, the microprocessor (178) interprets the codes and represents them in the current representation of bits, representing the characters, stored in memory (282, 286). Next, the processor 178 of the interactive programming box directs the character generator 624 to superimpose a certain character designation at a certain point on the screen.

Alternatively, the graphic video can be sent from the operations center (608). Graphic video can be created and output from a personal computer (114) to a video mixer (108).

Referring to FIG. 1, additional inputs to the video mixer 108 may include conventional video, either from live cameras or from VCRs. The video mixer 108 produces a single video signal by switching between graphic video and program video at appropriate times.

A plurality of overlapping graphics may be provided, each of which preferably comprises an interrogation message and which are chosen based on previous selections by the subscriber in response to previous interrogations. The procedure by which a graphic message is chosen is substantially the same as that used to select audio responses. Graphic overlays can be selected as interactive responses at trigger points, as explained in the preceding paragraphs. As with audio responses, one or more possible overlays can be rendered at any given time interval. The selected graphic message is also based on the subscriber's selections to present interrogation messages at the beginning of the program. The subscriber selections are called by the interactive programming box processor 178 which examines these input signals in accordance with the algorithmic codes to produce the next graphical interrogation message.

The one-way interactive system also has the advantage of remembering subscriber responses and using these responses in choosing an audio response, and / or graphic interrogation message, for presentation to the subscriber. Memory branching is a technique of the present invention in which the algorithm assembles the audio responses and graphical interrogation messages according to the present and previous inputs. Memory branching is accomplished by connecting successive segments of audio messages or graphic interrogation messages to each other in a logical relationship. In this scheme, the processor (178) of the interactive programming box contains logic (preferably in the software algorithm) and memory (284) to store previous subscriber selections and to process these previous responses in the algorithm to control future selection. of audio channels, as well as the future selection of graphic messages.

B. Interactive programming box

Figure 3 shows an overview of a preferred interactive programming box (600). Figures 4 and 5 show analog and digital embodiments of the audio / information extractor 174, a component shown in Figure 3. Alternative embodiments of the interactive programming box 600 are shown in Figures 6-8. The embodiments represent different apparatus for receiving, processing and storing alternative interactive audio segments that are received in different transmission formats. With these embodiments, interactive systems are no longer limited only to selecting audio from multiple parallel audio tracks, related in time and content, and no longer just the formal answer to interactive immediate questions, as was made necessary in earlier patents. Of course, the system of the present invention can still use immediate formal response to questions or a combination of such formal response and delayed response via trigger points. The concept remains the same, that is; select audio responses that match user selections through some function. However, this invention, based on the disclosed embodiments, goes beyond enhancing interactivity by providing the interactive elements at times unknown to the viewer.

The interactive programming box (600) is a part of the system that may reside in the subscriber's home or elsewhere, such as a cable terminal, as described below. If residing in the home, the interactive programming box (600) is typically located near the subscriber's television (186), although it can be located anywhere within range of the subscriber's remote handset (604). As shown in Figure 3, the preferred interactive programming box (600) comprises an RF demodulator (616), comprising video and analog demodulators, an audio switch (620), voice / data extractor (174) , modem (312), audio memory (702) a controller (178) with associated memory (284), Gen-lock circuit (623), generator (624) of

ES 2 233 941 T3 characters, an RF modulator (622) and an infrared interface (628) for remote subscribers (604). An external storage device (629) and a printer (302) are optional.

Alternatively, the elements of the interactive programming box (600) may be incorporated and provided on a conventional multimedia personal computer (187). Preferably, this computer comprises a video demodulator card, a keyboard for keying in subscriber selections instead of a remote IR device (604), an extractor card for temporarily separating audio signals and information from the conventional video signal. , and for the permanent storage of information, a modem (optional), audio switch and a processor. Operation of the interactive program system using a personal computer (187) is substantially identical to that of the combination interactive programming box (600) and television equipment (186) described below.

Furthermore, although the interactive programming box (600) is more likely to be located in the home, there is no reason why the interactive programming box (600), or a functional substitute (comprising a processor, extractor, memory , audio switch, RF demodulator, etc.), it may not reside outside the home, such as a cable terminal. If the interactive programming box (600) is located in the cable terminal, the interactive programming box (600), or equivalent, could receive user selections from the home via a wireless RF connection, telephone line, cable, etc. Once the user selections are received at the cable terminal, the selection of audio and graphic signals takes place in an identical manner as if the interactive programming box (600) were located in the home, as described below. The path to and from the cable terminal can be viewed as simply an extension of the cable between the interactive programming box (600) and the television set (186). The only possible distinction is that an interactive programming box 600 located in the cable terminal can be programmed to serve multiple subscriber addresses effectively using a shared use box among many users.

In a preferred embodiment, the plurality of audio signals are combined with a single video signal along with interactive graphics and information codes in an operations center stuffer (130) to form a single NTSC-compatible video signal. These signals can be analog or digital, as described below.

Referring to a preferred embodiment shown in Figure 3, the composite interactive signal is received by the interactive programming box (600) either via a cable connection, if the signal is transmitted by cable, by means of a satellite antenna connected to receive broadcasts by satellite, or through a television antenna if the signal is broadcast. The composite interactive signal is input into an RF demodulator (616). In the non-interactivity standard television mode, the RF demodulator (616) simply demodulates the conventional video and audio signal and produces the standard audio that is passed through the audio switch (620) to the television equipment (186). The video is sent to an RF scrambler (622) for display on the television or computer screen. Accordingly, in the standard mode the interactive programming box (600) is simply a pass-through box. In this embodiment, the voice / data extractor (174) and the audio switch (620) are fully bridged.

In interactive mode, the video demodulator (616) produces the standard video signal which is transported to a Gen-lock circuit (623) and to a character generator (624) as well as to a voice / data extractor (174). . At the output of the Gen-Lock circuit (623) and at the character generator (624), the video is sent via the RF modulator (622) to the television (186) or the computer display monitor. The processor (178) preferably controls an nx 1 switch (620), the output of which is an audio segment suitable for sending to television equipment (186) for presentation to the subscriber. Of course, the switcher could have more than one output, in which case more than one viewer can view the video on the same monitor, each receiving individualized audio responses through the use of headphones. Processor 178 sends a command to audio switch 620 to disconnect standard audio at the beginning of an interactive segment. Extractor 174 essentially reverses the process by which the audio and data signals were fed into the video signal. As explained below, the voice / data extractor 174 extracts the additional audio segments and data that are hidden in the standard video signal. The information is sent to the microprocessor (178) and the audio segments have to be sent either to an audio switch (620) or to a temporary memory (202) depending on where the instructions indicate that the segments should be sent, all of which It occurs under the control of the microprocessor (178). The microprocessor (178) reads and interprets the instructions either broadcast in information codes or resident in the operating software in the interactive programming box (600).

The microprocessor (178) interprets the extracted information either as control information, which includes instructions to switch between voice channels, or graphic information for display on the screen. If the information is display information, the information is preferably prefixed by a command designating the information as display information, as opposed to control information. In the preferred embodiment, controller 178 also examines control information for the occurrence of a header code designating the beginning of a trigger point in the program.

If the trigger point codes designate a macro that requests the placement of a graphical presentation on the video, the microprocessor (178) reads the codes, accepts all the graphical information sent from the terminal (608), requests and examines the representations of bits stored in memory (284) or external memory (629) and

ES 2 233 941 T3 the designation of the identity of the characters, and then directs the character generator (624) to cover certain characters on the screen. Accordingly, preferably the graphics are generated locally with the bit representations stored in memory (284). The graphics are selected for presentation either in a predetermined sequence, through the use of control codes in the interactive composite program, developed when the program was created in the operations center (608), or more flexibly through the execution of algorithms by processor 178 using stored subscriber selections for previous graphical interrogation messages. Preferably, the algorithms are part of the operating system software stored in memory in the interactive programming box (600). Alternatively, the algorithms could be included in the information part of the composite interactive signal.

Graphics can be used to overlay any part of the TV screen display. The character generator (624) is locked by means of a Gen-lock circuit (623) that allows the synchronous arrangement of graphics on video. Preferably, the character generator (624) is a standard display chip that accepts the incoming video, blocks the video, and superimposes the characters on the video in accordance with instructions from the microprocessor (178). Specifically, the character generator (624) is a switching system that accepts video lines and switches them to a sending mode of the graphic characters for a predetermined time, and then returns to the video when the characters stop being written on the screen. .

Because the graphics are generated locally, subscribers without interactive programming box 600 cannot view the graphics. For those subscribers with interactive capabilities, the graphics can be used both to pose questioning questions to subscribers at the beginning of the program, consistent with the trigger point, and to raise questions during the program, or they can be used to give an insight. personalized response to individual subscriber selections.

Preferably, at the beginning of the program or when the viewer first tunes in, a series of interrogation messages is presented to the subscriber. The subscriber responds to interrogation messages by pressing a button on a remote device (604) or computer keyboard corresponding to a response selection listed on the interrogation graph screen. If the subscriber has made a selection using a remote device (604), a signal is received by the IR interface (628) which processes the signal and sends it to the processor (178). Preferably, the processor (178) creates a packet comprising the user selection and a header code that identifies the specific interrogation message associated with the user selection and sends the packet to memory (284). Each user selection for each question is stored in this way. These selections will be prompted later in the program at appropriate times when identified by trigger point codes and then used in macros or algorithms to determine interactive audio and / or graphical responses.

The display of graphical interrogation messages can also be made based on subscriber selections from previous interrogation messages. The logic used in the codes to select the next graphic message is similar to that used to select audio messages. One procedure, such as that disclosed in previous ACTV patents, is that of the logical “decision tree” methodology. The subscriber makes a selection for one for a predetermined first graphical interrogation message. After the subscriber hears a properly branched audio channel, the processor 178 will interpret the graphical algorithmic codes sent from the operations center 608 and read from memory 284 a suitable next graphical message. The processor 178 then directs the character generator 624 to superimpose the selected graphic message on subsequent video images.

The voice / data extractor (174) of the preferred embodiment shown in figure 3 is shown in more detail in figure 4. This specific extractor corresponds to the stuffer (219) for pulse width modulation (PAM) discussed later in connection with FIG. 9. Audio and information are stripped of the baseband signal in the four channel VBI extractor (174). Signal splitter 174 essentially reverses the process by which the audio and data signals were inserted into the video signal. A video digitizing system and timing controller 320 digitize the incoming video signal at the same sample rate as the PAM audio samples are inserted into the video signal. Alternatively, if a digital adaptive pulse code modulation (AOPCM) extractor, corresponding to an AOPCM stuffer described below, is used in the interactive system, the extractor does not include the digitizing of the video and buffer circuitry shown in figure 4.

Timing controller 320, shown in FIG. 4, determines which video lines contain the audio signals and separates the compressed audio signals by routing each audio channel to an associated pair 328-356 of FIFOs. As with the inserter circuit, the pairs (328-356) of FIFOs in the FIFO are used interchangeably such that while one FIFO is reading audio information, the other is recording information. The digital-to-analog (O / A) converter (360) reads sequentially from the FIFO for each channel that is in record mode and converts the digital signal for that channel into an audio signal. The analog output of each channel is filtered by filters (364-376) and directed to buffers (380-392). Preferably, the buffers (380-392) adjust and amplify the signals from the analog output to the range -IV to + IV. The four output audio signals correspond to the four audio input channels.

As shown in FIG. 4, the information on line 21 is read into 8-bit pulse registers 400 in which the 16 bits of sequential information are converted into two bytes of information. The information on line 22 is

ES 2 233 941 T3 reads in eight 8-bit pulse registers (402) and the 16 bits of sequential information are also converted into two bytes of information.

The information on lines 21 and 22 (ie the code information) is directed from the extractor (174) to the microprocessor (178). The microprocessor (178) decodes the information and stores it in RAM (282) or ROM (286).

In an alternative embodiment of the digital voice / data extractor at the receiving terminal, the composite digital signal is received where the FEC code is applied by an FEC decoder (516), as shown in Figure 5. The resulting signal is applied to a digital demultiplexer (520) where audio, data and video components are separated and stored in a set of buffers (524-532). From buffer A (524), the digital audio signal enters a digital-to-analog converter (536) where the plurality of audio signals (including standard audio channel and additional audio channels) are separated, decoded and decompress to create the individual analog audio channels. From buffer B, the digital video signal also enters a digital-to-analog converter 540 where the signal is decompressed and decoded to form an analog video signal. The information is also decompressed and decoded in the analog-to-digital decoder C (544).

Referring again to Figure 3, the processor (178) receives information from the extractor (174), stores the information and reads the instructions from a memory such as a temporary RAM (282), ROM or FLASH ROM (286) , and receives response information from the remotes (604) by means of an infrared interface (262), or alternatively a computer keyboard. Optionally, processor 178 can interface with a printer 302 via a printer port 302 to print form codes, as discussed below. Preferably, processor 178 is an 80C188-based microcontroller, although it can be any similar controller. As mentioned above, this entire system could be built on a personal computer using a commercially available multimedia personal computer (187) preferably with a processor based on 80386 or higher.

The operating system software for the processor (178) is preferably stored in a FLASH ROM (286). FLASH memory 286, as shown in Figure 4, also preferably stores new instructions for use with reprogrammable software. Works in conjunction with RAM (282). RAM 282 can also be used as an interface to a print buffer. The print buffer is used so that the transmission of information to the site can be buffered, corrected for errors, and formatted for printing. Preferably, the site controller 178 is connected to a printer via a parallel printer port. Controller 178 sends forms to printer 302.

The interactive programming box (600) connects to remote devices (604) preferably by infrared (IR) connection. Preferably, processor 178 stores configuration commands and interactive branch commands and associated algorithms in memory, as described below. In the present invention, the interpretation and switching of the codes is preferably performed by the processor / 178) of the interactive programming box (600). Processor 178 collects subscriber responses from remote devices 604 or from a computer keyboard.

The advantages discussed above in relation to presenting an interactive program using trigger points is apparent in each of the interactive programming box embodiments shown in Figures 6 8. In the embodiment shown in Figure 6, segments are preferably sent alternate audio streams sequentially from the operations center (608) on the SAPl channel. The demodulator (617) receives a composite interactive signal comprising the video signal and the standard audio signal along with an audio subcarrier. The demodulator (617) breaks the signal into its component parts, sending baseband video to the information extractor (175) and the standard audio to an audio switch (620). The information extractor 175 on line 21 receives the information codes, including the trigger points.

The SAP channel comprises a plurality of serially aligned audio segments. The audio segments are digitized in the analog-to-digital converter (175) and preferably stored in a memory (283). digital audio At certain times during the program, the information codes will designate an activation point and the microprocessor (178) key to select and listen to an audio segment corresponding to input signals from a previous user, according to the procedure described previously. The microprocessor (178) requests the appropriate audio segment or segments from internal or external information storage memory (629) and directs the audio switch to pass the selected audio segment to the FR modulator (622) for audition by the subscriber. At the end of the interactive time period, controller 178 instructs audio switch 620 to pick up the standard audio again.

In an alternative embodiment similar to that shown in Figure 6 and discussed below, the simple addition of a second tuner, which receives the composite RF signal, could be used to tune a second audio channel for pickup of the signals. streamed audio segments. The tuner would pass the audio segments to the A / D converter 175 with operation of the remainder of the interactive programming box 600 similar to that described above in connection with FIG. 6.

ES 2 233 941 T3

Figure 7 shows another embodiment of the interactive programming box (600) for providing alternate audio and graphic segments. This embodiment uses two tuners: an RF demodulator (616) and an information tuner (615). The RF demodulator (616) tunes and demodulates the conventional video and audio signal in the standard video bandwidth. The information tuner (615) receives a simple digital audio signal. The signal comprises digital serial audio segments modulated on an analog carrier. The information tuner (615) demodulates the signal into digital audio. The digital interface selector and error corrector (177) separates the audio segments and performs error correction in accordance with an error correction scheme of one of ordinary skill in the art. Controller 178 directs selector 177 to extract selected audio segments from the serial digital stream and sends them to digital audio memory 283. The selection of one or more segments to listen to personalized messages on the television set 186 occurs in accordance with the procedures described above. After the controller directs memory 283 to send a segment of digital audio, the segment is converted to analog by means of the digital-to-analog converters (176) and then passed to the RF modulator (622) for audition. on the television set (186).

Shown in FIG. 8 is another embodiment of the interactive programming box (600) for receiving, storing, and selecting alternate audio segments. At the operations center (608), the audio segments are digitized, time division multiplexed, demodulated and converted to frequencies in an unused channel frequency space of the cable television spectrum, for example, bands cable security.

The RF demodulator (616) demodulates the conventional video and audio signal again. Information extractor 175 receives the signal and extracts the information codes from VBI line 21. The information in the VBI indicates the frequency channels on which the digital audio segments are transmitted. For example, audio messages AE are located between channels 14 and 15. Controller 178 instructs information tuner 615 to tune the portion of the spectrum between channels 14 and 15. Alternatively, a self-tuning capability can be used to find the audio channels in the spectrum.

The tuner (615) demodulates the digital audio signal and sends it to the digital demultiplexer (700). The demultiplexer (700) demultiplexes the signal into n digital audio channels and sends each channel to a separate D / A converter (702-710) where each of the digital channels is converted to analog audio. As described above, one of these channels can be selected as identified at the trigger points to listen to the subscriber on the audio speaker. The other components of Figure 8 operate identically to those described above in connection with Figure 3 to facilitate interactive or conventional programming to the subscriber at home.

The embodiments described above and shown in connection with Figures 3-8 relate to different ways of receiving broadcast audio segments. Alternatively, interactive audio segments, or graphic elements could be pre-stored on cartridge, CD ROM or even floppy disk. However, the trigger points are preferably broadcast as information codes embedded in the conventional video signal and can be used with any of the embodiments described above.

In this way, each subscriber at home hears a different and personalized response on their own television equipment (186) due to their interaction with the interactive programming box (600). As discussed later, the power of this system can be increased exponentially by the precariousness of additional audio segments that expand the personalized communication and memory branching mechanism in which the system currently remembers and uses the previous selections to the present. subscriber or compose exclusive messages for the subscriber.

The range of possible audio responses can be dramatically increased by preloading audio segments. First, segments of audio responses can be transmitted rather than simply broadcast along with a trigger point by preloading the memory of the interactive programming box (600). Preloading can be done by sending additional audio segments in a time period prior to the time period in which the broadcast audio responses are sent.

For example, at the beginning of a program, several audio segments can be broadcast to interactive programming boxes (600) by any of the procedures and systems described in connection with Figures 3-8. The controller (178) recommends that these segments are stored in memory. Each audio segment has a pointer that identifies the specific interrogation message corresponding to the audio segment. For example, if the interrogation message presented at the beginning was the following, "Are you a boy or a girl", an audio segment that can correspond to this question is "Oh, I understand, you are a boy". When the interactive element is identified to the controller by the trigger point codes, preferably more audio responses associated with the interrogation message presented at the beginning are produced from the operations center (608), passed through a mixer ( 118) audio, are integrated into the video signal at stuffer (130) and transmitted to remote locations. Once received at the interactive programming box (600), the audio responses are extracted from the video signal and sent to the switch (620). The controller 178 either selects an audio response made up of audio segments previously stored in memory or one of the audio segments is broadcast with the trigger point codes. Switch 620 is forked to send either one of the segments from memory or one of the recently broadcast segments to the appropriate channel. At the end of the interactive period, switch 620 undoes the branching to go back to standard audio.

ES 2 233 941 T3

By adding external information storage 629, such as CD ROM or cartridge, even more improved and flexible operation can be achieved. For example, sports statistics or other athlete information or other information may be stored on CD ROM. During a live sporting event, either athlete-focused audio segments or graphical presentations can be ordered via processor 178 and presented to the viewer based on the user's selection of an option or at a trigger point if the user indicated during the questions at the beginning of the live event that he was interested in a specific athlete.

In the present invention, the interactive audio branching is preferably performed at the interactive programming box (600). The branching algorithm, preferably defined by a series of branching codes, can be inserted as part of the program. Processor 178 stores the algorithm in associated RAM 282. The algorithm determines the appropriate channel to switch to based on the subscriber's selection.

The branching algorithm can be expanded using previous user selections when making a decision on a present audio segment. This is the memory fork realization. In other words, the user's previous responses, stored in RAM 282 in the interactive programming box (600), are used as an input signal in a logic network, or algorithm. Successive audio output segments can be related to a "decision tree" type relationship. The logical network, or algorithm, handles input information for selection of an audio output response message. This embodiment of memory goes well with the expanded audio responsiveness described above.

The memory branching technique, described above, can work analogously to ground successive graphical interrogation messages on previous subscriber selections for previous graphical interrogation messages.

Another embodiment uses "stacking" to increase response options with audio answering. The expansion is due to the connection of separate audio segments in time to form a greater number of answers with answers. The following example illustrates the use of stacking as well as memory branching, described above. The left column of the example shows the interactions between the program and the subscriber. The right column shows the logic applied and the branching made in the interactive programming box (600).

<td>TYPE OF INTERACTION</td><td colspan="2">ACTION ..... TO ..... PERFORM-</td>

<td>1. Can you tell the time?</td><td> »</td><td>Press memory save button A</td>

<td>(4) YES</td><td></td><td>If button = 1, Go to track 1</td>

<td> (2)</td><td></td><td>IF button = 2, hint 3</td>

<td> (3)</td><td> □</td><td>YES button = 3, Go to track 2</td>

<td>(4) NO</td><td> 0</td><td>YES button = 4, Go to track 2</td>

<td></td><td> □</td><td>IF no button is pressed, go to track 3</td>

<td>BRANCH RETURN</td><td colspan="2">GO TO TRACK 1</td>

<td>2. What time is it?</td><td> □</td><td>Press memory store button B</td>

<td> (1)2:30</td><td>or</td><td>IF button = 1, go to track 1</td>

<td> (2) 3:30</td><td>or</td><td>YES button = 2, Go to track 2</td>

<td> (3) 3:50</td><td>or</td><td>YES button = 3, Go to track 3</td>

<td> (4) 4:00</td><td>or</td><td>IF button = 4, track 4</td>

<td></td><td colspan="2">If no button is pressed, go to track 4</td>

<td>Note: 03.30 (button (2) is the correct answer</td><td>or</td><td>Repeat request to memory A and branch as</td>

<td>Repeat request in memory of</td><td></td><td>go on</td>

<td>answer to question 1 HINT 1: You said you knew how to say</td><td>or</td><td>IF memory A = 1, go to track 1</td>

<td>The time</td><td> □</td><td>If memory A = 4, go to track 2</td>

<td>HINT 2: You said you didn't know how to tell the time</td><td>_or</td><td>IF memory A = 3 or 3, track 3</td>

<td>HINT 3: You did not indicate if you can tell the time</td><td>_α</td><td>Fork as follows</td>

ES 2 233 941 T3

<td>Memory fork</td><td>- If memory A = 1 and memory B = 2 (correct) go to</td>

<td>TRACK 1: “... and you were not</td><td>track 1</td>

<td>kidding me, great job!</td><td>- If memory A # 1 and memory B = 2 (correct) go to</td>

<td>HINT 2: ... but you did learn</td><td>track 2</td>

<td>Quick. It's great ”</td><td>- If memory A 1 and memory B = 1, 3 or 4</td>

<td>TRACK 3: ”... and working more yourself.</td><td>(wrong) go to track 3</td>

<td>will learn more</td><td>° If memory A # 1 and memory B = 1, 3 or 4</td>

<td>TRACK 4 “... but working more yourself.</td><td>(wrong) go to track 4</td>

<td>will learn more " BRANCH RETURN</td><td>GO TO TRACK 1</td>

In the previous example the stacking is evident by the increased number of optional audio messages formed by connecting the last two branches indicated in the example. The possible combinations of branches are considered as follows:

Branch No. 1 with Branch No. 1 Branch No. 2 with Branch No. 2 Branch No. 3 with Branch No. 2 Branch No. 1 with Branch No. 3 Branch No. 2 with Branch No. 4 Branch No. 3 with Branch No. 4

Accordingly, the present invention covers numerous methods for increasing interactive audio response capabilities.

C. Subscriber interface

Each subscriber interacts with the system via a subscriber (or "remote") interface (604) or via a computer keyboard.

The keyboard (604) preferably comprises a number of functional keys. Preferably, keyboard 604 comprises keys labeled 0-10, keys labeled "YES" and "NO," and the present invention may provide keys labeled "TRUE" and "FALSE." The invention can also provide an LCD panel to receive messages and confirm responses. Similar functions can be assigned to the keys on the computer keyboard.

Preferably, the directionality and clearance are produced using techniques well known in the cable industry. For example, program selection and authorization can occur using on-screen menus with cursor overlays. Through the menu system, a viewer can access a program by entering a unique ID code, account number, etc. The algorithms stored in memory in the interactive macro access programming box allow input.

Either at the beginning of the interactive program, when operating the preferred embodiment, or alternatively as the program progresses, subscribers are prompted to enter responses via keyboard 604 or the computer keyboard. Preferably these system messages are displayed on the television screen (186) or on the computer monitor screen through the use of graphic overlays. Preferably, the interactive programming consists of graphic interrogation messages with correct and incorrect answers superimposed on the video.

The keyboard (604) or the computer keyboard allows the subscriber to interact with the interactive programming by pressing the keys corresponding to the responses to an interrogation message. For example, in a multiple choice question mode, each participant selects a keyboard button corresponding to their choice. Preferably, these selections are stored and subsequently used by the controller (178) in selecting either an audio or graphic message and directing it to the audio switch (620) to switch from the standard audio channel to an audio channel. alternate audio to pass the respective audio segments to the television (186) or to direct the graphic character generator (624) to superimpose graphic characters on predetermined portions of the screen. User selection is represented in one or a plurality of audio responses, comprising one or a combination of connected audio segments, or one or a plurality of graphic messages after user selection is applied to some functional algorithms .

ES 2 233 941 T3

D. Preparation of programs

In the present invention it is envisaged that most interactive programs will be produced offline and therefore will be recorded and stored on some storage medium in a central location for later broadcast. Alternatively, live programs could be broadcast with interactive elements inserted in a manner similar to the techniques described in the general case.

The broadcasting or operations center (608) is where, preferably, both recording and broadcasting tasks or creation and packaging of composite interactive programs are performed. These programs are created for reception and viewing as conventional television programs and as interactive programs. Accordingly, they should be created in such a way that there are no noticeable differences for non-interactive subscribers watching the conventional program when the interactive parts begin for authorized interactive subscribers. Similarly, when the interactive parts are over and both groups of viewers are watching the same video again and listening to the standard audio, there should be no noticeable transition.

Composite interactive programs that can be created include educational programs, home shopping programs, movies, children's programs, new programs, etc. Stored programs can be in analog or digital form and stored in volatile or permanent memory resources. In addition, live programs can be enhanced with interactive elements and broadcast to paid households as part of the present invention.

The interactive program used in the present invention preferably comprises a simple video, a standard audio channel, graphics and information codes, and a plurality of audio signals integrated therein to achieve interactivity. However, as described and shown above in connection with Figures 3-8, the audio can be sent on separate channels, preloaded in the interactive programming box 600, or stored separately in external information stores.

Either of these embodiments will work with the trigger points of the present invention. The program has to be produced in a studio first. The resulting program will comprise conventional video and audio that can be received on any television set 186. Next, the desired interactive sequences must be defined. The producer must decide which parts of the program will be interactive. These parts will be defined with trigger points. These trigger points correspond to the moments with the moments when the program can be altered. Trigger points are essentially codes that will request macros that will be used to trigger the occurrence of each interactive sequence during the program.

Therefore, the producer must decide at which points in the program to include the interactive responses, that is, the trigger points. The interrogation messages necessary to ask the viewer for their interests and answers must also be recorded. Producers should also create alternative audio and graphic responses to possible viewer selections. The interrogation messages, with possible system responses, should then be rendered at predetermined trigger points. This representation is made possible by developing an algorithm on a personal computer. The algorithm represents specific system responses (audio or graphical) to be produced at trigger points based on viewers' selections. For example, if the user selects A for question no. 2, a predetermined audio or graphical response is selected for your audition at an identified trigger point.

The personal computer software then compiles the above representation into broadcast codes of the program. The personal computer then controls the loading of the audio and information throughout the program at the appropriate times and the codes are inserted into their fields. Synchronization and control between video and multiple audio elements, discussed above, is provided through the use of information codes. The information codes are stored in memory on a personal computer as part of the ACTV programming language. The codes comprise commands, or branch codes, to branch between the channels (as stated in the aforementioned ACTV patents and applications), synchronization signals to control the interactive program, the codes defining each activation point, information or text, commands for terminating and initiating interactive programming, or triggers for executing macros.

Finally, the operating system software must be developed and loaded into the interactive programming box (600). This software can be downloaded out of the box on the cable and stored in a RAM (282), loaded in a cartridge or placed in a memory (286) ROM. This software comprises macros that interpret subscriber input signals and represent these inputs in specific interactive elements at a trigger point during the program.

At this point, the audio segments can be stored on a tape storage device or on a digital device. At the time of broadcast, the standard video and audio pass to a stuffer (130) to be combined with the information codes and with the multiple audio channels at the appropriate time under the direction of a processor. As shown in Figure 1, the audio channels are preferably fed from the personal computer (114) into an audio mixer (118). In addition, this procedure can be used to align the different audio response tracks in a timely manner.

ES 2 233 941 T3

In Figure 9 the analog stuffer (214) of a preferred embodiment is shown in more detail. The four audio output channels are fed into the stuffer (214) for mixing with the video and information. Preferably the audio signals are analog signals. A buffer (222) is provided for each audio signal to electrically isolate the stuffer (214) from the audio source of the audio signals. An amplifier amplifies the signals in order to convert the analog audio signals to a format that is fully compatible with the analog-to-digital (ND) converter 234 discussed below.

The output from each buffer 222 is routed to a bank of low pass filters 226, one for each audio signal. In addition, to reduce the high frequency noise of the audio signal, the low pass filter 226 sets the audio signal at a desired frequency. The filtered audio audio signals output from the low pass filters (226) are routed as inputs to a multiplexer (230).

In a preferred embodiment, the multiplexer (230) is controlled by synchronizing the signals received from the timing circuit (254). The timing circuit (254) is synchronized with the video signal of the interactive program and controls the multiplexer (230) to sequentially receive a sample of each audio signal and direct it to an analog-to-digital (N D) converter (234 ). . The N / A converter (234) converts the samples of the four audio signals to a 6-bit digital format.

As shown in Figure 9, each of the four audio channels preferably has a pair (238, 242) of FIFOs (first in first out) associated with it. The 8-bit digital samples of each signal are routed as input to one of the pairs (238,242) of FIFOs associated with that signal. The samples from each channel are preferably directed to one of the FIFO pairs (238, 242) of that channel until there are enough samples in that FIFO to fill the desired number of lines of the video field within which to insert the sampled audio. The audio samples are then directed to the other FIFO of the FIFO pair 238, 242) (on that channel until that FIFO has the correct number of samples. Meanwhile, the content of the first FIFO is written over the video signal. It is anticipated that the FIFO pair (238, 242) will be replaced by another type of memory resource.

When the content of a particular FIFO is to be inserted into video, the digitized audio samples stored in that FIFO are routed to a digital-to-analog (D / A) converter (246), as shown in Figure 9. The D / A converter 246 converts the digitized audio sample stream into an analog PAM (Pulse Amplitude Modulated). A second buffer (250) is provided to electrically isolate the stuffer circuit from the switching circuitry (258) that multiplexes audio signals into video signals.

In a preferred embodiment, the audio signals A and B are inserted independently of each other over 5 lines of one field of the video signal, and the audio signals C and D are inserted independently of each other over 5 lines of the other field of the video signal. In order to allow continuous playback of the audio for each channel, the audio for each channel must be compressed so that 5 lines of video per image contain sufficient audio content for the playing time of one video image (about 1 (30 seconds).

The number of audio samples required for each channel depends on the desired sound quality. If you want a low quality of sound, you have to use few lines, and vice versa.

In the preferred embodiment, five (5) video lines are used for each image per audio channel, with 105 samples per line at a sample rate of 15,734 samples per second. The multiplexer (230) sequentially samples each audio signal 15,734 times per second and alternately routes 525 samples to each of the FIFOs (238, 242) associated with each audio channel. At a certain point before each channel's audio is to be inserted into the video signal, the timing circuit 254, shown in Figure 9, instructs the full FIFO for the channel to record digital audio for the D / A converter (246) that converts it to PAM signal. Next, the timing circuit (254) switches the video selector (258) to receive the PAM audio signal through the buffer (250) as an input instead of the video signal. In this way, additional audio channels are inserted into the video. Standard audio remains unaffected on the normal audio carrier. Once the audio has been inserted into the video at the desired position, the timing circuit (254) directs the selected video switch (258) to change its input back to the video signal. This procedure is repeated for each audio signal on the video lines where the audio signal is to be inserted into the video signal.

Typically, ten lines of the Vertical Blank Interval (VBI) of the video signal are available for use in each video field. In the preferred embodiment, for each video image, the audio signals A and B are each inserted into five lines of the VBI of one field, and the audio signals C and D are each inserted into five lines of the VBI of the other. countryside. The desired sound quality and the number of audio channels dictate the number of video lines that must be used to transmit the signals. Preferably, all additional audio channels can be inserted into the VBI. However, since the standards for broadcast transmissions other uses of video lines, if more lines are needed for audio services, then active picture lines will have to be used. These active lines can be grouped and placed at the top or bottom of the picture which will effectively not interfere with the video on the screen due to the overscan of most television sets. Alternatively, the lines can be randomly distributed throughout the entire program.

In the preferred embodiment, the information is preferably sent on line 21 of the blank range ver15

ES 2 233 941 T3 tical (VBI) using the predefined standard information to transmit information on line 21. The information on line 21, preferably, is sent as 16 bits of sequential information per field, and is placed in the video signal using a standard 31 line encoder. However, the information can alternatively be inserted into other lines of the video.

In an alternative embodiment, instead of inserting analog PAM samples, as shown in Figure 9, multi-level digital samples, such as AOPCM samples, can be inserted into the assigned VBl lines. In this embodiment, a bandpass filter must filter wideband analog audio in the desired frequency range. The signal is then sampled at some values ​​of the frequency in a sample. The PAM audio audio samples are then quantized to one of the n levels. An encoder then represents the amplitude levels selected by the quantizer, preferably in three-bit AOPCM samples. These samples are stored in a buffer and preferably converted from binary to a level converter

8. The AOPCM audio samples are then inserted into the video under the direction of a processor on the VBl lines. At the receiver, the corresponding extractor 174 sends the signal to a digital-to-analog converter and subsequently to a low-pass filter to receive the filtered analog output. This embodiment has the advantage of reducing end-to-end noise quantization and allowing some degree of channel noise immunity resulting from VCR recording and video / analog signal playback.

Additional audio signals can be transmitted along with the interactive video signal in other ways. An audio signal can be transmitted through each of the normal audio channels. Audio can be distributed in many ways using the available audio channels. For example, high-quality background music for the interactive program could be broadcast on the normal audio channel. Then, for unintelligible background voices, a lower quality audio could be inserted into the video signal and / or using the SAP signal. Preferably, the audio segments are serially aligned on the SAP channel. This would allow a greater number of audio signals to be transmitted with the interactive program. Furthermore, the audio channels could also simply be combined with the video and information signals by means of a frequency division multiplexer. Audio channels can be digitized using any common analog-to-digital conversion technique such as PCM, OM, AOPCM, etc. Finally, speech coders (eg, LPC channel speech coders, APCs) can be employed to reduce the necessary information rate and bandwidth requirements for voice transmission.

Therefore, there are many variations in which the present invention can be used to facilitate the transmission of multiple audio channels. In a possible alternative embodiment, instead of integrating the plurality of audio channels into the video signal, all channels are sent as one audio signal using serial sequencing. Serial sequencing is defined by reading the audio tracks from memory in sequential series (ie A1, then A2, then A3, etc.). The resulting signal is then sent as a secondary channel, or a SAP channel, with the main channel containing standard audio. In this embodiment, these specific audio tracks would have to be sent prior to the time the responses are scheduled for presentation to subscribers. Consequently, when the SAP channel is received in the interactive programming box (600), the signals are independently decoded from the SAP channel, modified and stored in memory (284) for later use when it is appropriate to reproduce the signals. responses to the subscriber. The interactive programming box 600 of this embodiment was previously described and shown in FIG. 6.

Alternatively, the interactive system of the present invention can facilitate the transmission of the interactive signal by means of digital transmission, resulting in reduced bandwidth requirements. In the digital transmission embodiment the interactive signal can be transmitted not only by satellite but also by ATM, Sonet, TI or any other digital transmission system.

The components of the digital transmission at the operations center (608) are shown in FIG. 10. As shown in FIG. 10, the plurality of audio signals are output from a personal computer (114) or a data storage device. tape into the audio mixer (118) giving conventional audio, preferably four output channels. Preferably, the audio signals are then sampled, encoded, and compressed in the digital audio encoder / compressor (500). The coding technique can be a waveform coding technique such as PCM, AOPCM or OM. Alternatively, the signals can be encoded using voice coding or synthesizer techniques such as MUSICAM, Linear Predictive Coding (LPC). Adaptive Predictive Coding (APC), and subband coding. Only a composite audio signal is produced in the digital audio encoder / compressor (500).

As shown in FIG. 10, the video signal is input to the video switch 108 which produces one of the video signals. The digital video encoder / compressor (504) receives the video signal, encodes it, and compresses it in accordance with a known standard such as MPEG-1, MPEG-2, JPEG, or other OCT-based, small wave encoding scheme. , fractals or other approaches based on transformation. Alternatively, the digital video encoder / compressor 504, shown in FIG. 10, could use a waveform-based technique, such as PCM, AOPCM, or OM, to encode and compress the digital video.

The information from the personal computer (114), Figure 10, is preferably compressed by means of a card installed in the computer (114) and sent directly to the digital multiplexer (508). The digitized information, video and audio signals are sent to the digital multiplexer (508) when the signals are modified and combined by means of time division multiplexing, applying the appropriate synchronization signals to form a

ES 2 233 941 T3 composite synchronous serial information stream. At the output of the digital multiplexer (508), advanced error correction (FEC) and code dependent on the selected transmission path are applied by means of a FEC encoder (512). The interactive digital signal is then transmitted to receivers 158 through a suitable transmission medium such as satellite, fiber optics, cable, OS, etc.

In summary, the operations center (608) creates and transmits an interactive video signal by taking the video, inserting multiple audio channels and information codes, and transmitting the resulting interactive video signal to the transmission system.

E. The transmission system

As shown in Figure 1, the system uses an interactive program presentation system (98) with any broadcast transmission medium including satellite (150), cable (138) or television (142) to broadcast interactive programs and distribute them to subscribers' homes. Similarly, the distribution of the signal to the receiving terminal can be accomplished by any suitable transmission means 166, including a cable, fiber optic, etc. distribution system. In a satellite broadcast transmission (150), the interactive video signal is transmitted to establish an uplink with equipment (146) where it can be multiplexed, upconverted, modulated, amplified and transmitted by satellite (150) to a site ( 154) receiver for distribution to users. In the analog environment, the interactive video signal enters an analog receiver 158 and then preferably a cable distribution system 166 directs the signal to subscriber locations. In the alternative digital embodiment, the composite digital interactive signal enters a receiver 158 where it is demodulated and then preferably passes to a digital cable distribution system that routes the signal to subscriber locations. Although a cable distribution system 166 is the preferred transmission medium for remote locations, the interactive video signal can also be distributed by any known conventional techniques, such as DBS, fiber optics, high or low broadcast television. power, telephone lines, cellular networks, and similar technologies, which can also be used interchangeably with this program delivery system.

F. Return route

If desired, status messages and information to participants can be returned from remote locations to the operations center (608) via return paths. For example, subscriber selections could be stored in RAM 282 and subsequently sent to operations center 608 to help create subscriber profiles to target advertising. The return paths can be dialed by telephone or via X.25 packet switched network, cable switched network, cable, wireless networks, etc. The preferred procedure for returning this information is based on subscriber initiation. The alternative procedure for returning this information is by choosing the remote locations from the operations center computer 114. Alternatively, remote sites can send performance information and messages after consolidation, at regular intervals.

If the functions of the interactive programming box (600) are performed at the cable terminal as part of a multi-user system, as described above, then the return path becomes of great importance. However, the path to and from the cable terminal can be viewed simply as an extension of the signal path between the interactive programming box (600) and the home and television set (168).

The input signal can be returned to the operations center (608) by a bidirectional cable system or by a modem telephone system (312). The modem (312) is connected to the controller as shown in Figures 3 and 6 8. The controller could send to the modem (312) a series of streams of information characterizing the specific interests of the viewer.

III. System operation

The simulcast system operates by preparing, transmitting and receiving a composite interactive program that can present an interactive program to subscribers' homes equipped with an interactive programming box (600) and a regular television program for those addresses without such equipment. As mentioned above, this dual functionality is preferably achieved by integrating mainly the non-visual intervals of a standard video signal and a plurality of audio segments, graphic information, and programming control information, the reception and treatment of which allows a fully interactive experience for subscribers. Alternatively, the audio segments can be previously stored in the interactive programming box (600), stored in external information storage (629) (629), sent serially in the SAPs, or sent serially or in parallel on a separate channel. .

Information is stored in each audio segment. Each audio segment comprises messages in response to user selections at the keyboard (604). When the program begins, a START command is sent from the broadcast center or operations center (608) to all interactive programming boxes (600). The television set (186) defaults to a predetermined channel (eg, channel 1).

ES 2 233 941 T3

Initially, authorized and unauthorized interactive subscribers watch the same standard television program, both watching standard video and listening to standard audio. For non-interactive subscribers, standard video and audio is viewed and heard throughout the entire program. Interactive subscribers, on the other hand, can interact with the program for designated periods of time.

At some point, the trigger point codes are embedded in the composite interactive program signal, with the trigger points indicating the initiation of an interactive program. The information codes of the VBIs immediately inform the interactive programming box (600). Controller 178 begins decoding the codes after detection. Graphic codes will also be sent as part of the signal. These codes allow the processor (178) of the interactive programming box to read the graphic bit representations from the memory (282, 286), corresponding to the codes, and direct the character generator (624) to superimpose the graphics on a default part of the screen. In this way, the first interrogation message can be presented on the screen.

Although in the preferred embodiment and for illustration purposes, the graphic messages are interrogatory, they can also be structural, requesting the user to select from several options to receive special services, confer status, or request subscriber profile information from the subscriber. The graphic overlay can consist of simple alphanumeric characters that form a message or more complex characters such as characters in a pictorial cartoon. Although both interactive and non-interactive subscribers listen to standard audio, interactive viewers are interrogated by using graphic overlays to access an option through their keyboards (604) or if the viewer is interactive through a computer ( 187) personal, the keyboard being connected to the personal computer (187).

In this way, at the next trigger point, the controller directs the audio switch 620 to separate from the standard audio and begin to hear an introductory message such as "Hello, welcome to the program, this is an interactive program, this is an interactive show. Would you like to interact with the show? " If the viewer wants to interact, he presses the YES button on the remote device, and the interactive show begins. If the viewer does not wish to interact with the program, the controller directs the audio switch to un-branch to standard audio and the television returns to the television program in progress.

Simultaneously, a START INPUT command is sent to all controllers 178 of interactive programming boxes 600 instructing them to accept inputs from remote infrared devices 604. The last entry before the expiration of the INPUT period is accepted by the system as subscriber selection.

After the viewer has adequately indicated his desire to interact with the program, preferably, a set of graphic interrogation messages will be presented one after another to prompt a user selection useful for obtaining the desired information from the user. For example, assume that the show you are running is a show about redecorating a kitchen. First, an audio segment will be heard stating "Hello, this is a show about redecorating your kitchen, are you interested in redecorating your kitchen, YES or NO?" If the user selects the YES button on the remote device, another audio segment can be heard "Okay, thank you very much, let me ask you a couple of quick questions on the screen." At this time, the microprocessor (178) accesses a series of graphic interrogation messages stored in memory (282, 286) and directs the chip (624) of the stack to display the graphic messages in a predetermined order. User responses to these questions are used later in the program at specified trigger points to present interactive messages to the viewer. A series of sample interrogation messages can be presented in succession as follows:

“DO YOU HAVE WINDOWS IN YOUR KITCHEN?

A, YES B. NO ”.

“HOW LARGE IS YOUR KITCHEN?

A. 10X20 B. 20X30 C. 30X40 D. 40X50 E. 50X60 ”“ WHAT IS YOUR COLOR COMBINATION?

A. WHITE B. BROWN C. BLUE D. GREEN E. YELLOW ”“ WHAT KIND OF FLOOR DO YOU HAVE?

A. WOOD B. FORMICA C. TILES ”

Graphic interrogation messages are preferably not accompanied by audio. Selections made by the user above are received by the interactive programming box (600), tagged with a code designating the specific related question and stored in memory (282, 286) for later use at the appropriate time. When a trigger point is identified by the controller (178), the embedded information codes will identify the question corresponding to that trigger point. The controller (178) will access the

ES 2 233 941 T3 memory address identified with the specific question and will request the transfer of the specific user's input response to the question. This user input is represented by some algorithm within a suitable audio segment.

For example, suppose that the narrator in the conventional program is at this moment exposing the size of the kitchen. At the next activation point the controller will access the memory location corresponding to the question about the size of the kitchen listed above. Assuming that the answer selected by the user is “A. 10 x 20 ", the controller can select and send the following audio response to the audio switch," Since you have a very small kitchen, I may suggest that you do not put a dining table in your kitchen. " At the conclusion of this segment, the controller directs controller 178 to reset the switch to standard audio. At the next trigger point, a sequence similar to that described will occur. In this way, personalized interactivity is available at unexpected times for the subscriber.

For unauthorized subscribers, the interactive programming box (600) acts similar to a cable equipment top converter box. However, the interactive programming box (600) is not necessary for the reception of the conventional program by non-interactive subscribers. If the subscriber has a box (600) but is not authorized to interact with the program for some reason, the video demodulator (616) simply demodulates the standard audio and signal and the video is transferred through the audio switch to the equipment ( 186) of TV for presentation to the subscriber.

Another application of the memory capacity of the present invention is focused on the commercial activity of the subscribers. In this application, the interactive scheduling box processor compiles and stores information including the number of associates with the interactive scheduling box subscriber, time and date of the program viewing, the list of subscriber selections made by the subscriber. during the program and the program ID (contained in the program codes broadcast with the program). This date is preferably stored in information packets. A date code can be generated from this date, which provides a general profile of subscribers' purchase wishes. This date code can be sent by modem by retailers to offer exclusive price reductions and other options to subscribers.

Although in the preferred embodiment, the system has been described as a simulcast system whereby both an interactive program and a non-interactive program are broadcast to subscribers, the system does not require the program to be non-interactive. In other words, the system is not limited to providing the dual functional programs but can simply provide interactive programming, not receivable without the interactive programming boxes (600), using the same elements described above.

The above system of the present invention can be combined with those described in earlier US patents. numbers 4,847,700,4,507,680,4,573,072,4,602,279,4,364,925, and 4,264,924 which gives rise to viewers at home equipped with a more sophisticated decoder box to receive a more sophisticated interactivity such as a Instant, ad-focused response etc. via second or third transmitted video signals, all of which can be facilitated with custom audio and graphics in the manner described above.

Using the above embodiments, procedures and treatments, the ACTV simulcast system maximizes personalized attention and interactivity with subscribers at their homes in real time using a low cost interactive system. Although the present invention has been described in detail with respect to certain embodiments and examples, there are variations and modifications that are within the scope of the present invention as defined in the following claims.