Ensuring reliable delivery of interactive content

ES 2 329 969 T3

DESCRIPTION

Ensuring reliable distribution of interactive content.

Field of the invention

The present invention relates to the field of interactive television, and, more particularly, to the synchronization and personalization of interactive content.

Background of the invention

The distribution of interactive content with broadcast programming presents several special problems. First, for interactive content to be effective, it must be synchronized with the broadcast. This involves delivering an interactive complement to an advertisement at the same time as the broadcast advertisement is broadcast, or coordinating interactivity with events in the advertisement.

Second, the delivery of interactive content must be reliable. Since the interactive content is broadcast in a data stream parallel to the video stream, the possibility exists that the interactive content could be extracted or altered at the broadcast site, or in the local subsystem, such as a local branch network. or a cable system headend. Finally, it is often desirable to direct the interactive content to the specific viewer or distribution system. For example, digital cable systems have a much higher bandwidth for delivering interactive content than the limited bandwidth provided by vertical blanking interval (VBI) data transmission methods available in analog cable systems. . It is advantageous to build a system that selectively uses this higher bandwidth when it is present in the broadcast environment. Additionally, demographic factors could motivate directing different interactive content to different distribution systems.

An important approach, as described in the pending application 09 / 333,724, entitled "Automatic Control of Broadcast and Execution of Interactive Applications to Maintain Synchronous Operation With Broadcast", filed on June 15, 1999, assigned to the assignee of this application and which is incorporated by reference into the present invention, involves the placement of an interactive broadcast server (IBS) in a broadcast facility to insert interactive content into a video stream. This server uses the network's playlist system or other program identification techniques to insert interactive content appropriate for the current broadcast program or segment. In Figure 1, broadcasting facilities using this technology are illustrated.

Broadcast facilities use various equipment along a broadcast facility transmission path to generate, enhance, modify, and transmit a continuous stream of video. In one embodiment, a video tape player 146 generates a video stream 145 from video sources 112, and places the stream 145 on the transmission path. A server module (software application) running on the IBS (interactive broadcast server) 104 receives real-time information about the current video program being broadcast from a playlist control system 108. The playlist control system 108 controls the sequencing of the video sources 112, which are typically pre-recorded video content (such as shows and advertisements). IBS 104 uses playlist information to retrieve interactive content and uses data insertion unit 116 to insert retrieved interactive content or data into video stream 148. In some systems, sequencing of previously recorded video content is done manually, or program information is pre-recorded in the video and detected by the IBS 104 (for example, through VBI encoding, of a interactive content identifier).

In an alternative embodiment of this interactive content delivery system, tapes with interactive content are pre-prepared and placed at the video source. A video tape player 146 plays the tapes ready to generate a video stream with interactive content, and then the interactive content is distributed to the local subsystem 124. In this embodiment, interactive content is pre-stored in a vertical blanking interval, for example, on VBI line 15, and an IBS 104 cannot be used. In either embodiment, the combined stream 148 of video and interactive content is then distributed to a communication system 120 (typically satellite), to a local subsystem (such as a local branch network) 124 where the interactive content is then either delivered over the air through an antenna 149, or to an interactive Customer Premises Equipment (CPE) 128, that is, a particular box of the television or a similar device, or through a cable system 149 that retransmits the local signal to a CPE 128.

Although the above system can provide both data synchronization and reliability, there are still some problems in ensuring that interactive content reaches its final destination due to the local subsystem or broadcast facility equipment used along the road. of transmission. For example, many networks have multiple signals provided to provide time-shifted content distribution for appropriate time zones. Equipment used by broadcast facilities to record and replay video content for different time zones may inadvertently delete, alter, or effectively modify, in some other way (alter) embedded interactive content. In addition, it installs them2

Broadcasts may have the ability to visually shrink a broadcast signal to allow the broadcaster to insert its own video content, eg, a stock indicator, into the broadcast signal. This insertion process can destroy interactive content that is already encoded in the broadcast signal. In addition, a broadcast facility can convert an analog broadcast signal to provide digital signals to subscribers. However, since the analog-to-digital conversion equipment is typically located downstream of the point where interactive content is added to the video stream, the conversion equipment may alter the interactive content encoded in the signal. In general, any device that modifies the video stream can alter or destroy interactive content.

Additionally, local subsystems 124 may further accidentally alter embedded interactive content.

Document WO 98/00974 discloses a digital broadcasting system that is configured to redirect and add interactive programming to a television signal originally carried over a remote network. The remote network inserts trigger commands within the vertical blanking intervals (VBIs) of the television signal to control the loading and playback of the interactive program at the broadcast station. The protocol associated with the activation orders allows the repetition of orders to guarantee in this way that the interactive program is controlled correctly, even in the event that an original order was not received or was altered in the transmission. The commands that are inserted refer to functions such as continue with, pause from, interrupt, and play a specified file at a particular time.

Local subsystems 124 may also unintentionally alter embedded interactive content, along a transmission path of a local subsystem, similar to the transmission path of broadcast facilities. Video manipulation in both ways can result in loss of interactive content. For example, a local subsystem may select to shift a video stream for half an hour in time to suit its own programming choices. In this situation, the equipment used to tape and delay the video stream may inadvertently alter embedded interactive content or simply not re-record it. Additionally, a local subsystem 124 may insert its own content into a video stream, eg, identifying call signs. The equipment used to embed this content may inadvertently alter the embedded interactive content. Thus, a system is needed that ensures the distribution of the desired interactive content to end users.

Summary of the invention

The present invention provides a system and a method according to claims 1 and 9, respectively.

The present invention provides technology to ensure reliable transmission of interactive content. This is accomplished through the insertion of interactive content codes into the video signal at certain points along the path that the video takes from the broadcast source to the equipment at the customer's premises. Servers co-located in broadcast facilities circumvent hardware that destroys interactive content, detects interactive content codes, and uses the codes as trigger signals for blocking, reinserting, or replacing interactive content on the transmission path.

Preservation of interactive content in broadcasting facilities

In a preferred embodiment, this technology is applied to solve the problem where interactive content is removed, destroyed, altered, extracted or otherwise modified ("altered") during the transmission path of broadcasting facilities. due to the processing of the video stream that carries the interactive content prior to transmission of the video stream, for example, to a satellite or other transmission media. More specifically, interactive content codes preferably comprise fields that include unique identifiers that specify individual interactive content, or a class of interactive content. Identifiers can identify interactive content or other types of content such as hyperlinks or URLs. Additionally, the interactive content codes can be the interactive content itself. In this embodiment, the interactive content carries the information required to provide identification or personalization. The interactive content codes also preferably comprise timing information indicating the length of time in which the interactive content should be inserted and conditional information to be used by the local interactive broadcast server in order to determine an appropriate action in relation to interactive content.

In this embodiment, interactive content codes are inserted into a video signal to be broadcast in order to ensure reliable distribution of the interactive content. Interactive content codes are placed in the video stream either in prepared videos or through an interactive content insertion process. An interactive content code detector then detects the interactive content codes from the video stream at the broadcasting facilities. The interactive content code detector is preferably located on the transmission path before the video stream is transmitted to the hardware of the broadcasting facilities that can extract or alter the interactive content codes; for example, in a position before the hardware of the video compression broadcasting facilities. Once the interactive content code detector detects a code, an interactive broadcast server determines what action

ES 2 329 969 T3 perform, and provide data correspondingly to a data insertion unit. In one embodiment, the interactive content code identifies interactive content that should be inserted into the video stream to accompany the broadcast program. In this embodiment, the interactive broadcast server provides the identified interactive content to the data insertion unit that inserts the interactive content into the video stream at a point in the transmission path of the post-hardware broadcast facilities. broadcasting facilities that may alter or remove interactive content. Thus, in this embodiment, the present invention ensures that interactive content will be distributed to a local subsystem even in an environment where broadcast facilities maintain equipment that can remove or alter interactive content.

An alternative embodiment solves the problem of video content alteration in the pre-transmission processing path by using interactive content codes placed in parts of the video whose preservation is guaranteed. In this embodiment, the broadcast facilities can destroy interactive content and / or interactive content codes when the video stream is being generated or at some point just after it. Thus, in this embodiment, the interactive content codes or the interactive content are placed in a part of the video the transmission of which is guaranteed by the broadcasting facilities. For example, in one embodiment, the interactive content is placed in the VBI area used for coded closed captions. This VBI zone has traditionally been required to contain encoded closed caption information for transmission to end users and therefore almost all broadcast equipment is designed to preserve this VBI zone. Thus, in one embodiment, the interactive content codes are placed in the coded closed caption area of ​​the VBI and are therefore preserved by the broadcast facilities themselves, and an interactive broadcast server is used, as described above, to insert the interactive content into the video stream at a point beyond where the broadcast facility equipment can remove or alter the signal. Thus, this embodiment preserves interactivity even if the broadcast facilities alter the video signal at the point of generation of the video stream or earlier in the transmission path.

Preservation of interactive content in the local subsystem

Local subsystems also maintain computers that can destroy interactive content. Accordingly, in another embodiment, a local interactive broadcast server is placed in a local subsystem to provide reliable transmission of interactive content. The local interactive broadcast server can also be used to provide personalized content for the local subsystem. In a preferred embodiment, interactive content codes are placed in the broadcast signal as described above. The codes are preferably placed in a part of the broadcast signal that is not typically modified by the local subsystem, such as the coded closed caption area of ​​the VBI, as also described above. Thus, if the local subsystem destroys any interactive content, the interactive content code remains in the video signal. The local interactive broadcast server then decodes the interactive content identification code to determine whether interactive content should be inserted, relocated, transferred, or removed from the broadcast signal. Alternatively, an interactive content code detector is coupled in parallel to the local subsystem transmission path prior to local subsystem equipment which can remove or alter the interactive content code. In this embodiment, the interactive broadcast server determines whether to insert, replace, transfer, or remove interactive content in response to detected interactive content codes, and inserts or replaces the interactive content on the transmission path at a later point. from where the equipment that can delete the content is attached. Since the interactive content detection technology is located upstream of possible local subsystem equipment that destroys interactive content, the content codes in this embodiment can be placed in areas of the VBI other than the coded closed caption area.

Preservation of interactive digital content in the local subsystem

In another embodiment, the present invention can be used to preserve content in systems where interactive content and video are initially provided in digital format. In this embodiment, the interactive content code is extracted by an MPEG decoder or the like at the beginning of the transmission path. The interactive broadcast server identifies new interactive content based on the code and provides this content to a data multiplexer that inserts the identified interactive content into the transmission path and, typically, at the beginning of the transmission guide (i.e., before the satellite uplink). In addition to satellite, the transmission path may include cable or terrestrial segments (ie HDTV).

Brief description of the drawings

Figure 1 is a block diagram of a prior art interactive content delivery system.

Figure 2 is a block diagram of an interactive content delivery system with interactive content preservation technology.

Figure 3 is a block diagram of various interactive content codes.

ES 2 329 969 T3

Figure 4 is an alternative embodiment of an interactive content delivery system with interactive content preservation technology.

Figure 5 is a one-line block diagram of closed captions encoded with interactive content codes.

Figure 6 is a block diagram of a local subsystem with interactive content preservation technology.

Figure 7 is a flow chart of the processing of a local interactive broadcast server.

Figure 8 is an illustration of the local subsystem data structure.

Detailed description of the preferred embodiments

I. Preservation and personalization of interactive content in broadcasting facilities

A. Preservation of interactive content in broadcasting facilities

Figure 2 is a block diagram of an interactive content delivery system with interactive content preservation technology. In a broadcast facility 224, a video source 200 is coupled to a video stream generator 212. A broadcast facility 224 may be a broadcast network site, a cable network site, or any other site that broadcasts programs and announcements to be viewed by end users with equipment at customer premises CPE 248. Broadcast facilities 224 can broadcast directly to the end user; however, they can also have their signal retransmitted through intermediaries such as a local subsystem 228 until the signal 227 reaches its ultimate destination of an end user. The video source 200 may comprise video tapes, UNIX files^TM or the like, which store programs and advertisements as is known in the art. In one embodiment, the video source 201 contains interactive content. In this embodiment, the interactive content preparer integrates the interactivity into the video source 201 (programs, advertisements, etc.) and thus provides the integrated interactivity video source 201 to broadcast facilities 224. The integration process can be achieved through conventional techniques as is known in the art. Interactive content, as used herein and as described, comprises interactive applications and / or interactive content codes, and interactive content can serve the same function as interactive content codes. Interactive content can also include parts of an existing interactive application.

In one embodiment, the interactive content is stored in a vertical blanking interval of the program or advertisement, for example, on line 15 of the vertical blanking interval ("VBI"), although any available portion of the VBI can be used. In this embodiment, a video stream generator 212 retrieves a video source 200, 201 in a predetermined time, and generates a video stream 221 from video source 200. The video stream generator 212 may retrieve the video source 200,201 in accordance with an optional playlist control system 232 that provides program and ad scheduling information. In one embodiment, the video stream generator 212 is a video tape player that plays video tape sources 200, 201 and generates a video stream 221 using a video server, such as Profile Video. Tektronix Server^(TM), or the like. Video stream 221 may comprise video, audio, and data streams, as specified, for example, in the NTSC, PAL, and MPEG specifications. The video stream 221 is then transmitted to the hardware 216 of the broadcast facility. In conventional systems, broadcast facilities 224 typically modify video stream 221 before transmitting video stream 221 to transmission facilities 220. For example, a broadcast facility 224 may select to compress a video signal occupying lines 22 to 262 in each field of an NTSC video signal so that they occupy only lines 22 to 212, and use the newly available 50 lines to displaying other information to the viewer, such as a stock indicator, a sports score indicator, or the like. In this embodiment, the equipment 216 used to compress the video signal and insert the additional information can alter the interactive content that was embedded in the video source 200. Alternatively, broadcast facilities can use time-based corrections (TBC) and frame synchronization equipment to replace a complete part of the VBI, in an attempt to clean up the synchronization pulses used to generate a stable image. These computers can also destroy interactive content.

However, according to the present invention, interactive content codes 300 are placed in a video signal to identify interactive content, and the video stream 221 with integrated interactive content is coupled in parallel to an interactive content code detector 204 to detecting the presence of the interactive content codes 300. In a preferred embodiment, an interactive content code 300 is inserted into the video source 201 and / or the video stream 221 (by the data insertion unit 208) by an interactive content preparer. As shown in Figure 3, in one embodiment, the interactive code 300 is an interactive content identifier 301, which is preferably a string of symbols (numbers, letters, binary code, a URL, UIC code, or similar) that identifies a particular interactive content. The interactive content code 300 can be located in the same location in the video source 200, 201 as the interactive content itself, for example, in the VBI of the program or advertisement in which the content is designed

ES 2 329 969 T3 interactive to be displayed. For example, if interactive content is provided on line 15 of the VBI, the interactive content code 300 is also located on line 15 of the VBI. In this embodiment, the interactive content code detector 204 is pre-programmed to examine the selected VBI line to store the interactive content code 300. An illustrative interactive content code detector 204 would be a VBI line reader as is known in the art, for example, the Norpak TTX-742 VBI Reader.^(TM) and that can be modified to read the specific line of the VBI that contains the interactive content identifier 501.

In an alternative embodiment, the interactive content identifier 301 is located in a different location than the interactive content. Since interactive content identifier 301 is typically smaller in size than interactive content, this embodiment allows interactive content code 300 to be placed in a wider variety of areas in the video source 200, 201. For example, interactive content code 300 can be placed in a field that may have less bandwidth due to its use to store other information, but is less likely to be removed than other fields in the VBI; for example, in the area of ​​hard-coded closed captions. As the hard-coded closed-caption area is not dedicated to large amounts of data, there may not be enough bandwidth to store full interactive content. However, in this embodiment, the smaller interactive content code 300 is stored in this area without interfering with the coded closed caption text and can be transmitted securely, as described in more detail. subsequently. Alternatively, the interactive content code 300 is encoded in a parallel data stream that can be broadcast on the transmission path, such as in a separate audio stream, a separate area of ​​coded closed captioning (for a broadcast signal). digital), a separate address stream, or any stream independent of the stream used to transport the interactive content. For example, some broadcasters broadcast a separate audio stream (eg SAP) along with their programming. In this embodiment, the interactive content codes 300 are integrated into the independent channel, and the interactive content code detector 204 is coupled to the separate audio stream to detect the interactive content code 300. After a code 300 has been detected, the data insertion unit 208 inserts the corresponding interactive content into the broadcast signal, typically at a point on the transmission path after which the broadcasting equipment is coupled to the broadcast path. broadcasting facilities that can destroy interactive content.

In an alternative embodiment, the interactive content code 300 is an interactive conditional code 303. An interactive conditional code 303 may provide conditional instructions for inserting interactive content into the modified video stream 225, as described later. In this embodiment, the interactive code detector 204 reads the interactive conditional code 303 present in the video stream 221. In another embodiment, the interactive content code 300 is contained in existing interactive content. In this case, the processing of the interactive content code may result in the blocking, substitution, or transfer of the original interactive content.

Once the interactive content code detector 204 has read the appropriate section of the video source 200, 201, the interactive content code 300 is transmitted to the interactive broadcast server 206. Interactive broadcast server 206 decodes interactive content code 300 and determines instructions for providing interactive content. For example, if the interactive content code 300 is an interactive content identifier 301, the interactive broadcast server 206 decodes the data to identify the interactive content identifier 301. The interactive broadcast server 206 can be a UNIX server, a Windows NT server, or any other similar server that runs a process designed to perform the functionality described herein. The interactive broadcast server 206 is coupled to an interactive content database 244, and retrieves the identified interactive content from the database 244. Next, the interactive broadcast server 206 provides the interactive binary data 222 to a data insertion unit 208 to cause the data insertion unit 208 to insert the interactive content into the altered video stream 225. The video stream 225 is the video stream 221 altered by the hardware 216 of the broadcast facilities, and therefore may or may not retain the interactive content of the video stream 221. The data insertion unit 208 is preferably a data insertion unit as is known in the art, eg, the Norpak TES-3 Multi-Standard Encoder. The data insertion unit 208 overwrites or modifies any interactive content in progress played on the video stream 225 to generate an interactive embedded video stream 226. This interactive integrated video stream 226 is sent to a transmission facility 220, which then transmits the interactive integrated video stream 226 to the local subsystem 228 or the CPE 248. Thus, in accordance with the present invention, interactive content can be reliably delivered to a CPE 248.

In one embodiment, interactive broadcast server 206 inserts interactive content immediately whenever interactive content identifier 301 is detected in the video signal. In an alternative embodiment, an enhanced interactive content identifier 302 further provides timing information 306. Timing information 306 comprises start and stop information, duration information, or start and duration information, or other information useful in determining when to insert interactive content. Thus, in this embodiment, the interactive broadcast server 206 retrieves the interactive content according to the timing information 306. For example, in an embodiment in which the timing instructions provide start and duration information, the interactive broadcast server 206 causes the interactive content to be inserted at the time indicated by the start time and causes the

ES 2 329 969 T3 insert stops after a period of time corresponding to the duration information. This embodiment ensures that the interactive content is properly synchronized with the programs and / or advertisements to which it refers.

In one embodiment, the interactive content code 300 is placed at the beginning of a program and the timing information 306 is a duration value indicating how many seconds are left in the program. Thus, the interactive content starts when the interactive content code 300 is detected and stops when the duration value expires. In an alternative embodiment, interactive content codes 300 are inserted throughout the program, and the timing information 306 includes a duration value indicating the time before the next interactive content code 300 appears. For example, an interactive content code 300 can be inserted every 4 seconds, with a duration of 5 seconds. If after 5 seconds, the interactive content code detector 204 has not detected a new interactive content code 300, the program is considered to have ended and the interactive content is stopped. This implementation is useful if the durations of the programs are unknown. In a digital environment, certain digital broadcast formats already provide time stamps, and therefore, in these formats, interactive content codes 300 can synchronize the insertion of interactive content through the use of pre-existing time codes. Alternatively, since digital broadcasts are comprised of and numbered according to frames, interactive content codes 300 may specify insertion of interactive content by frame number, eg, "insert application X into frame 596".

In another embodiment, the broadcast facilities generate digital video signals, and the interactive content code detector 204 is an MPEG decoder, and identifies the corresponding interactive content based on the decoded interactive code. The interactive content code detector 204 then provides this content to a data multiplexer or similar device that inserts the identified interactive content into the transmission path. For example, immediately before a satellite uplink, or after a point in the transmission path that contains equipment that could alter or otherwise modify interactive content. However, the transmission path can also be by cable or other terrestrial, that is, HDTV.

The interactive content code detector 204 is typically coupled to a point on the transmission path prior to the point at which the equipment 216 at the broadcast facilities can alter the interactive content code 300. The data insertion unit 208 is typically coupled at a point in the transmission path after the hardware 216 has been coupled, to ensure that the interactive content to be inserted is not deleted. Thus, the present invention enables reliable transmission of interactive content to an end user. In one embodiment, the detector 204 is coupled to the transmission path immediately after a video stream is generated, for example, after a video stream generator 212 or a video source generator is generated. coupled to the transmission path, to ensure that the content code 300 is detected before being transmitted through hardware that can remove the interactive content code 300. In another embodiment, the DIU 208 is coupled at a point on the transmission path immediately prior to transmission, for example, immediately prior to transmission facilities 220, to ensure that interactive content will be broadcast to local subsystem 228 . If the broadcast facilities do not contain equipment that destroys the data area containing the interactive content code, the interactive content code detector 204 can be coupled to the same point in the transmission path as the data insertion unit 608, which will be after the point where the hardware that will alter the interactive content is coupled to the transmission path.

B. Preservation of interactive content through selection of guaranteed fields

In one embodiment, interactive content is preserved through the placement of interactive content codes 300 in areas of the VBI that are preserved by broadcast facilities. Figure 4 is an alternative block diagram of a broadcast facility 428 in accordance with this embodiment of the present invention. In this embodiment, video having embedded interactive content 201 is input to the format conversion equipment 404 of a broadcast facility 428. The format conversion equipment 404 converts the video to a format compatible with the video stream generator 212 of broadcast facilities. Since different broadcast facilities use different format conversion equipment 404, the interactive content preparer typically prepares video in a single format and allows broadcast facilities to convert the video to the appropriate format. However, the format conversion equipment 404 often extracts or removes vertical blanking intervals from a video 400, thereby unintentionally removing interactive content. Additionally, some broadcast facilities broadcast digital signals. In this example, if the video source is analog, then broadcast facilities must convert the analog signal to a digital signal. This process can also extract or remove the VBI or certain lines of the VBI. Thus, in an embodiment where interactive content is stored on the VBI (or VBI line), interactivity can be eliminated at this point in the video transmission process. Additionally, video stream generation equipment 212 may also delete or remove interactive content or codes stored in the VBI. If interactivity is removed at any of these points, the interactive content code detector 204 will not be able to detect the interactive content code 300.

According to the present invention, an interactive content code 300 is placed on the VBI coded closed caption line, for example line 21. As mentioned above, the subtitle line 21

Coded stealth ES 2 329 969 T3 is traditionally preserved throughout transmission. Thus, broadcast facilities may use special equipment, referred to as "bridging" (not shown), that explicitly preserves data on the scrambled closed caption line. In this embodiment, the interactive content provider integrates the interactive content code 300 into the classified closed caption line of the video using a classified closed caption encoder 408 to create video with integrated interactivity 400. The encoded closed caption encoder 408 is a conventional video encoding device such as the Norpak TES-3^(TM) or the EEG Classified Closed Caption Encoder, which is designed to encode data on the coded closed caption line. Once the interactive content code 300 has been placed on the coded closed caption line, the broadcast facilities 428 themselves will ensure that the content code 300 is preserved throughout the transmission path of the broadcast facilities. In this way, the interactive content code detector 204 will be able to detect the interactive content code 300 by reading the coded closed caption line of signal 221, and then the interactive broadcast server 206 will be able to insert the corresponding interactive content. Of course, interactive content code 300 can identify an application, embedded program, or advertisement, can provide timing information 306, and can provide conditional information 308, as described later, to provide on-the-fly adjustments.

Figure 5 illustrates contents of the coded closed caption line. As illustrated, the classified closed caption line comprises two fields, field 1 and field 2. Field 1 has four subfields, coded closed captions 1, coded closed captions 2, text 1, and text 2. Field 2 has subfields Coded Closed Captions 3, Coded Closed Captions 4, Text 3, Text 4, and XDS. The scrambled closed caption field 1 stores the scrambled caption information that is displayed on a user's television when the scrambled caption feature is enabled, that is, the text of the dialogue that occurs in the program or advertisement. The other hard-coded closed-caption fields are used to display alternate languages ​​in the hard-coded closed-caption format. The Text 1, Text 2, Text 3, Text 4, and XDS fields are not specifically required to transport any data; therefore, they can be used to transport business data such as interactive content identifiers 300 or interactive content. The XDS, for example, is specifically designed to carry ancillary data, and current law requires data transmission from the anti-violence chip in that field. In this way, an interactive content provider can encode its data in any of these fields. It is preferable to store data in Field 1, since that field is the only field that is required by law to have coded closed caption information, and is therefore almost always preserved by the broadcast facilities themselves. However, any field can be used as it is difficult to accidentally delete one field and not the other. In this way, most equipment that preserves field 1 of the coded closed caption area will necessarily preserve field 2. Although the previous description refers to the insertion of interactive content in the coded closed caption line, according to the present Invention any line of the VBI or other area that is preserved throughout the transmission path of a video stream can be used. It is further envisioned that federal laws or other regulatory systems may require the preservation of other VBI lines for other purposes, and the present invention can be readily extended to those other lines.

In this embodiment, the interactive content code detector 204 and the data insertion unit 208 can be coupled to approximately the same point in the transmission path of the broadcasting facilities 224 since the preservation of the code 300 is guaranteed by the equipment of the broadcasting facilities. Thus, in this embodiment, the interactive code detector 204 reads a preserved line having an interactive content code 300, and the data insertion unit 208 inserts the interactive content into a different area that may not have been preserved at the same point where code 300 is detected. In this example, interactive content code detector 204 and DIU 208 are coupled to a point on the transmission path after which broadcast facility equipment that can destroy interactive content is coupled to the transmission path, to ensure that embedded interactive content is preserved.

In an embodiment where references to the interactive content itself (such as a URL) are encoded on VBI line 21, the interactive content code detector 204, the interactive broadcast server 206, the interactive content 208, and interactive content database 244. If a URL is used, the interactive content code detector 204 decodes the URL, connects to the database (located remotely or locally) identified by the URL through a communication facility such as a modem, and retrieves associated interactive content for insertion by IUD 608. As interactive content is guaranteed to be transmitted by its placement in the coded closed caption line, reinsertion is not necessary in this case. However, if on-the-fly replacement is desired, or if the interactive content is placed elsewhere in the video source 200, 201, then the above equipment would be used to provide the functionality described above. Thus, this embodiment of the present invention provides additional guarantees that interactive content will be preserved for an entire transmission path until it reaches CPE 248.

C. Personalization of content in broadcasting facilities

Referring to Figure 3, the system of the present invention can also provide on-the-fly content adjustment. In this embodiment, an interactive conditional code 303 is provided with interactive content. In an embodiment with video sources with integrated interactivity 201, an interactive content is integrated into the video source 201 and an interactive conditional code 303 is also integrated. The code

ES 2 329 969 T3 interactive conditional 303 preferably specifies an interactive content identifier 301 and an OPT field 308. The interactive content identifier 301, as described above, can refer either to interactive content or to a source of video with integrated interactive content 201. The OPT field 308 specifies whether interactive content can be substituted by the interactive broadcast server 206. If an OPT 308 field indicates that an interactive content cannot be substituted, then the interactive broadcast server 206 knows that no new interactive content is available for that particular video 200. Thus, the use of the OPT field 308 allows the Interactive broadcast server 206 determines immediately whether interactive content is available for replacement. If the OPT field 308 indicates that interactive content can be replaced, then the interactive broadcast server 206 determines whether or not to replace the existing interactive content with different interactive content. For example, if interactive content is embedded in a video source 201, but the interactive content provider or program source determines that a different version should be broadcast, the different version may be stored in a database 244, and the interactive broadcast server 206 may replace the existing version of the application with the newer version as identified in the interactive content code 300. For example, interactive content that refers to a news item can be replaced with a more current version of the interactive content when the news item changes, simply by substituting the interactive content at broadcast facilities 224. In this way, the interactive content provider can easily make on-the-fly adjustments to the interactive content. In this embodiment, the interactive content provider integrates into the original video source 200, 201 an OPT field that specifies that the interactive content can be substituted, along with the interactive content identifier. However, the use of an OPT field 308 further allows the interactive content preparer to ensure that the interactive content is not replaced by a third party without the control of the interactive content preparer. The on-the-fly tuning embodiment of the present invention can also be performed without any OPT fields. In this embodiment, interactive broadcast server 206 automatically inserts a latest version of interactive content upon receipt of an interactive content identifier. The OPT 308 field can also be used to specify conditions for substitution. For example, for interactive content for a contest, field 308 could specify that the interactive content be broadcast only if the local subsystem has conducted such contests, as described in more detail below. In this case, the OPT 308 field will have a numeric value that can be compared to the known values ​​on a local server. The local server determines if the application should be blocked, transferred, or replaced based on the comparison.

II. Preservation of interactive content in the local subsystem

A. Preservation of interactive content

Figure 6 is a block diagram of a local subsystem 628 with interactive content preservation technology. In this embodiment, the local subsystem 628 receives a broadcast signal 601 from a broadcast facility and relays the signal 601 to a CPE 248. Local subsystem 628 is typically a local affiliate at the broadcast facility; however, the local subsystem 628 could also be a cable headend that receives a 601 broadcast signal from a cable provider or broadcast facility, or local affiliate, or a digital satellite subsystem that receives a 601 signal from a subsidiary. local, a broadcasting facility, or a cable headend. The broadcast signal 601 contains either interactive content, or interactive content codes 300, or both. End users receive the broadcast signal 601 on their CPE 648, which may be a television, a particular television box, or a satellite reception system. The interactive content is displayed in conjunction with, or on top of, the video portion of the broadcast signal.

In accordance with the present invention, interactive content codes are placed in the broadcast signal to ensure reliable distribution of interactive content through local subsystem 628 to CPE 648. In one embodiment, interactive content codes 300 are not located. in the VBI line of hard-coded closed captions, and therefore can be modified or removed by local subsystem 628. As shown in Figure 6, a receiver 612 in local subsystem 628 receives broadcast signal 601. The local subsystem 628 then uses the local subsystem equipment 616 to perform different operations on the received signal 602. For example, the local subsystem 628 may store a received signal 602 to re-broadcast the signal 602 at a later time. Additionally, local subsystem 628 may insert graphics, such a local station ID, into signal 602 prior to retransmission. Alternatively, local subsystem 628 may insert a local commercial into video stream 602 at a location reserved by broadcast facilities for local insertion. All of these operations can inadvertently destroy interactive content or a previously inserted interactive content code by modifying or removing the component of the video signal 602 that carries the interactive content.

In accordance with the present invention, an interactive content code detector 604 is coupled in parallel to the video signal 602 to detect inserted interactive content codes 300. The interactive content code detector 604 may be coupled directly to the output of the receiver 612, or it may be coupled later along the transmission path. Interactive content code detector 604 is preferably coupled to video signal 602 before video signal 602 is transmitted to any local subsystem equipment 616 that can destroy interactive content code 300. Interactive content code detector 604 detects interactive content code 300 and provides code 300 to a local interactive broadcast server 606, which then identifies interactive content and causes data insertion unit 608 to reinsert interactive content. in video stream 607 modified at a point in the trans path

ES 2 329 969 T3 mission after which the equipment that can alter the interactive content is coupled to the transmission path. The operation of the interactive content code detector 604 in this embodiment of the present invention is substantially similar to the embodiment of the interactive content code detector 204 described above with respect to Figure 2. In one embodiment, the data insertion unit 608 is coupled at one point to the transmission path immediately before the video signal is broadcast out to the CPEs 648, to ensure that no local subsystem equipment alters the embedded interactive content.

Alternatively, in one embodiment, the interactive content provider stores multiple interactive content codes 300 in different fields of the video signal 602 before it is broadcast to the local system 628 to ensure that one of the interactive content codes 300 is successfully transmitted through local subsystem 628. Since different local subsystems 628 can independently preserve different fields, this method helps to ensure that at least one of the interactive content codes 300 present in a broadcast signal is not modified or removed by local subsystem 628 and can be detected. by interactive content code detector 604.

In an embodiment where digital applications are to be inserted into a broadcast digital video stream, the data insertion unit 608 comprises insertion capabilities of the MPEG or other digital format, as is known to those with usual knowledge on the subject. For example, for an MPEG 1 or 2 stream, the interactive broadcast server 606 transmits the interactive content to a multiplexer in the local subsystem that is generating the MPEG stream. The local subsystem multiplexer typically has a serial or TCP / IP port to receive the stream of interactive content bits. Upon receipt of the interactive content bit stream, the multiplexer adds the interactive content to the digital video stream according to its normal operation. The multiplexer can also remove and replace interactive content when appropriate. If the digital stream is Serial Component Digital Video, (a packet-based digital video stream) as specified in the SMPTE 259M-C standard, a Norpak encoder would be used to add the interactive content replacing the existing packages with new packets transmitted thereto via local interactive broadcast server 606. Alternatively, if a digital version of interactive content has been broadcast to an analog subsystem 628, the local interactive broadcast server 606 may exchange the digital application for a lower bandwidth analog application. If an analog version of interactive content has been broadcast to a 628 digital subsystem, the analog version must be converted to a digital program, or a digital program must be replaced in place of the analog version. If the analog version is to be digitized, a software analog digital converter must be used to convert the analog version into a digital program that is consistent with the local subsystem protocols. In one embodiment, local interactive broadcast server 606 supports delivery of multiple applications to subsystem 628. For example, a cable headend subsystem 628 can distribute both analog and digital streams to allow households with private boxes. digital TVs receive higher quality interactivity while homes with analogue systems can continue to receive the simplest interactivity. In this embodiment, the local interactive broadcast server 606 selects both the richest version and the simplest version of the interactive content and inserts them into the respective signals.

In an embodiment where the interactive content codes 300 are located in a field that is preserved by the local subsystem hardware, for example, on the coded closed caption line, the interactive content code detector 604 is coupled to the streaming path to detect the interactive content code 300, and then causing the data insertion unit 608 to insert the interactive content into the video signal at a point on the transmission path after which the local subsystem hardware that can alter the signal is coupled to the transmission path. In one embodiment, interactive content detector 604 and data insertion unit 608 are coupled to the same point on the transmission path.

Thus, this embodiment of the present invention ensures successful transmission of interactive content through the local subsystem 628. Obviously, the interactive content identifier 300 can identify an application, a program or embedded advertisement, it can provide information 306 of timing, and may provide conditional information 308, as described above, to provide the benefits and advantages described above.

B. Personalization of interactive content

In an alternative embodiment, local subsystem 628 also provides personalized content. In this embodiment, the interactive content is directed to a local subsystem 628, which provides a much richer interactive content experience. Additional fields are provided to allow the local subsystem to take the appropriate action for the local subsystem. For example, depending on the conditional field and the current configuration of the local subsystem, the local subsystem can disable existing interactive content, replace an existing application with a custom application, transfer an existing application, or insert interactive content.

In one embodiment, the local interactive broadcast server 606 inserts corresponding interactive content into the video signal 607 for either personalization or reinsertion purposes. However, in

In this embodiment, the corresponding interactive content may be personalized interactive content. For example, if a local subsystem 628 determines that the demographics that make up the viewer area would prefer a different version of interactive content, the interactive content provider will provide a version of the interactive content appropriate to the demographics of local subsystem 628. Alternatively, if the local subsystem 628 has a different bandwidth capacity than the bandwidth capacity with which the existing interactive content was intended to be used, the local interactive broadcast server 606 may replace the existing interactive content with a interactive content designed for the bandwidth capacity of the local 628 subsystem. For example, if the majority of all end users have low-bandwidth connections, the interactive content provider will typically provide interactive content designed to be transmitted over the low-bandwidth connection. However, if a specific local subsystem 628 is a high-bandwidth digital cable subsystem, then in accordance with the present invention, the digital local interactive broadcast server 606 replaces the low-bandwidth interactive content with a digital version. interactive content, allowing the local subsystem 628 to take advantage of its superior network infrastructure.

In an alternative embodiment, an interactive conditional code 303 is provided on the video signal 601. As described above, interactive conditional code 303 comprises an OPT field 308. OPT field 308 is set to designate whether interactive content can be substituted. Additionally, the OPT field 308 may provide information to be interpreted locally in order to decide what content to replace existing interactive content. For example, the OPT 308 field may have a flag indicating the type of content being broadcast, a ticker indicator, a contest, an advertisement, or any other type of content or whether the content should be blocked. This content type information can be used by the local subsystem to determine an action. For example, the local subsystem may ban advertisements within a program unless they earn revenue from the advertisement. Thus, if a flag indicates that an advertisement is being broadcast within a program, the local subsystem can disable the application as described later. Typically, the interactive content provider sets the OPT field 308 of the interactive conditional code 303 to indicate that the interactive code can be substituted, although the use of the OPT field 308 also allows an interactive content provider to guarantee that certain applications are not substituted or modified by a local subsystem 628. If interactive content can be substituted, the interactive content provider sets the parameter to substitute interactive content in OPT field 308.

In a preferred embodiment, the interactive content codes 300 can be inserted, as described above, in the coded closed caption area of ​​the VBI, in the form of a code in the video, or encrypted in the form of an identifier. exclusive to prevent "ad elusive" applications from being developed. As described above, if the interactive content codes 300 are originally inserted into the coded closed caption area, it is guaranteed that the interactive content codes will be transmitted to the interactive content code detector 604.

A preferred method of processing interactive content codes 300 is illustrated in Figure 7. In this embodiment, as described above, there are four main actions that a local server 606 can perform: disable 700 an existing interactive content, insert 704 an application, transfer 708 an existing application, and replace 712, 716, 720 , 724 an existing application by a custom application. First, server 606 in local subsystem 628 determines 728 whether interactive content is present on received signal 601. In one embodiment, broadcast facilities do not insert applications into video stream 601, allowing, in instead, local subsystems 628 provide the insert. In this embodiment, an interactive content identifier 300 is provided with the program or commercial material to identify the application and insert into the video stream 607. Thus, this embodiment eliminates the requirement of having an interactive broadcast server 104 at the broadcast facility. If the interactive content identifier 301 is inserted into the coded closed caption area in a video source 200, there may be no interactive equipment present in a broadcast facility at all, as broadcast facilities should not guarantee preservation of the 301 codes with the interactive content preservation technology described above.

If interactive content is not present on signal 601, either because the broadcast facilities did not insert an application as described above or because the broadcast facilities removed or removed the interactive content, then the server 606 determines 744 if there is multiple applications in the database 644 corresponding to the interactive content code 300. Figure 8 illustrates one embodiment of database 644. Database 644 maintains interactive content and database 646 maintains video sources 201 with built-in interactivity. Either or both can be used according to the present invention. The databases 644 are preferably organized by interactive content identifiers to allow the local interactive broadcast server 606 to quickly locate the information and any corresponding published applications for interactive content. In one embodiment, the database 644 maintains a count field for each interactive content that indicates the number of different versions of an interactive content that are present in the database 644. A count of 2 indicates that an additional version of interactive content is stored in database 644. Server 606 locates the count field corresponding to the interactive content code being analyzed and examines the count field to determine if there are multiple versions of interactive content. If there are no multiple applications, then the server 606 retrieves the corresponding interactive content and provides it to the data insertion unit 608,

ES 2 329 969 T3 which inserts 704 the corresponding application in the video stream 601. The resulting integrated stream 609 is transmitted to the CPE 248.

If interactive content is present in the signal, server 606 determines 732 whether subsystem 628 has blocked the application. In one embodiment, local server 606 maintains a list of those applications that are blocked by local subsystem 628 in database 644. As shown in the example of Figure 8, this interactive content is identified in database 644 as blocked for transmission. Thus, in this embodiment, local subsystem 628 has control over whether interactive content is provided to an end user by modifying the list maintained by server 606. This allows local subsystems 628 to control the content of their transmissions according to preferences. of the hearing, legal aspects, or similar. As described above, the OPT field 308 specifies the type of interactive content (eg, a contest). In this embodiment, the local interactive broadcast server 608 reads the OPT field 608 and compares the OPT field 308 with local content parameters to determine that the application broadcast is allowed. Server 606 will search its database for a corresponding contest field to determine its status. For example, if prize-rewarding contests are illegal in a subsystem, interactive contest content will be disabled. This embodiment also allows a local subsystem 628 to earn revenue by withholding a percentage of any revenue generated by interactive content. For example, if an interactive content is a link on a website that an end user can make a purchase from, the local subsystem 628 may require the website host to pay the local subsystem 628 a percentage of the income earned in exchange for allow the transmission of interactive content to the CPE 248. In this embodiment, if no contractual agreement has been reached with the website host, a flag in the database 644 will indicate that the local interactive broadcast server 606 should disable the corresponding interactive content.

If a local subsystem 628 has indicated that interactive content should be blocked as described above, server 606 disables 700 the interactive content. Alternatively, server 606 determines if interactive content can be streamed on subsystem 628 due to bandwidth considerations. For example, if an interactive content is designed to require more bandwidth than a local subsystem 628 can provide, the server 606 also disables 700 the interactive content. Thus, in this embodiment, as shown in Figure 8, the server 606 maintains the bandwidth data of the local subsystem 628 in the database 644, and / or bandwidth data is explicitly provided. of the interactive content in a code field 300 of the interactive content or the bandwidth data is available through analysis of the application itself. If the bandwidth is insufficient, the server 606 disables the 700 application. Extraction of the signal data can disable interactive content. In cases where regulations prohibit data extraction, the display of the original application can be disabled by inserting a new data field that will be used as a flag by the CPE 248 to ignore the transmitted data. If a lower bandwidth version exists, this condition is processed as described later.

If the server 606 determines that the interactive content should not be disabled, the server 606 determines 740 also at this time whether there are multiple versions of the interactive content in the database 644. If they do not exist, then server 606 transfers 708 the interactive content provided with signal 601 to CPE 248.

If at decision point either 740 or 744 the server 606 determines that there are multiple applications stored in the database 644, the server 606 determines 748 whether a local custom application is present in the database 644. As described above, a local custom application is an application that is designed for the geographic or demographic audience of a local 628 subsystem. In a preferred embodiment as shown in Figure 8, the database 644, 648 has identification fields that identify the nature of different applications in the database. For example, in Figure 8, the interactive content ID222A is a local version of ID222, and ID174A is a digital version of ID174. Both ID222 and ID174 are interactive content identifiers that would be present in the interactive content code 300 or would be part of the interactive content itself. Thus, the server 606 will examine the database entry for a specific application, and if an identification field indicates that a corresponding local custom application is present, the server will then determine 750 whether there are multiple streaming streams in the subsystem 628. For example, some cable headends provide both analog and digital video streams. In this embodiment, server 606 may maintain a field that indicates whether or not subsystem 628 provides multiple transmission streams. If there are no multiple streams, server 606 replaces 712 the existing application with the local custom application as identified in database 644, 648. Server 606 replaces an application by providing corresponding new interactive content to data unit 608 to overwrite existing interactive content with corresponding new interactive content. If there are multiple streams, the server 606 places 754 the different versions of the local custom application into the appropriate streams for broadcast. In this way, the present invention makes it possible to provide end users with targeted interactivity, making interactive content more efficient and attractive to end users than in conventional systems.

If server 606 determines that there are no local custom applications in the database, server 606 also determines 752 if local subsystem 628 had multiple streaming streams. If there are multiple streaming streams, the server 606 places 720 the corresponding high-bandwidth application

ES 2 329 969 T3 identified in the database 644 in the high bandwidth stream and places or allows the transfer of a low bandwidth application in the high bandwidth stream. This allows a local subsystem 628 to tailor its interactive content to end users based on the capabilities of the end users. If there is only one transmission stream, and in an embodiment where a low bandwidth application is the version of the application transmitted over the video signal 601 (which is the most common case to ensure the most universal of an interactive content), server 606 determines 756 whether high bandwidth interactive content is present in databases 644 that corresponds to the interactive content code being parsed. If so, the interactive broadcast server 606 replaces 712 the low-bandwidth interactive content with a high-bandwidth version of the application to take advantage of the high-bandwidth capabilities of the local subsystem 628. If a high bandwidth application is not present on the system, then the server 606 looks for other custom versions of the applications and processes those applications 724 in response to its conditions. The above order of processing is merely illustrative, as decisions can be made in different orders within the scope of the present invention.

The foregoing describes in detail the characteristics and advantages of the present invention in various embodiments. Those skilled in the art will appreciate that the present invention can be made in various other embodiments that operate in accordance with the above disclosed principles and aspects. For example, the hardware layout and organization of the broadcasting facilities and the local subsystem may be different, and the interactive preservation technology may be placed in the appropriate position according to the disclosed aspects described herein to achieve the results. and advantages described. Obviously, the names of the various entities can be changed without this having an impact on their functional operations. Accordingly, this detailed description is not intended to limit the scope of the present invention, which should be construed with reference to the following claims.