Media channel identification with multi-match detection and disambiguation based on location

References to Related Applications This application claims the priority of U.S. Provisional Patent Application No. 62 / 301,616 filed on February 29, 2016, U.S. Patent Application No. 15 / filed on June 10, 2016. Claim the priority of No. 179,143. Each of these priority applications is incorporated herein by reference in its entirety. In addition, the disclosure of US Patent Application Publication No. 2015/0181263 is incorporated herein by reference in its entirety.

A typical media presentation device receives an analog or digital media stream representing media content such as video and / or audio content and displays and presents the media content on a user interface such as a display screen and / or audio speakers. Works like this. Examples of such devices include, but are not limited to, televisions, computer monitors, projection systems, loudspeakers, headphones, and the like.

Often, such media presentation devices have access to a number of individual channels of media content and selectively deliver the media content of a given such channel to the media presentation device for playout. May be communicating with a local set-top box or other similar device or receiver such as a remote server.

As an example, a television may be communicatively linked to a cable TV set-top box that has access to a set of cable TV channels, which receives user input selecting a particular channel. It can be configured to responsively tune to the selected channel and output the media content of the selected channel to the television for presentation of the media content to the user. As another example, a loudspeaker may be communicatively linked to a radio that has access to a set of radio stations, which receives user input selecting a particular channel (station) and receives input from the user. It can be configured to responsively tune to the selected channel and output the media content of the selected channel to loudspeakers for presentation of the media content to the user. And yet yet another example, a media presentation device, such as a display or speaker, may be communicably linked to a computer that has access to a myriad of online streaming media channels, and the computer selects a particular channel. It may be configured to receive user input and responsively initiate reception and output of selected media content to provide the media content to the display and / or speaker for presentation to the user. it can.

<p> When the media presentation device receives and displays the media content, the media presentation device may have no indication of which channel carried the media content. A receiver or other device that selectively tunes to the channel to receive the media content and provides the media content to the media presentation device can have such information, but receives the media content from the other devices described above. Media presentation devices may not have such information. For example, if a television is coupled to a cable TV set-top box and the user selects a particular cable channel on the set-top box, the set-top box thereby has something to indicate the channel selected as that channel. The set-top box can then receive the media content on that channel and the media content is output to the television. However, the television itself only needs to receive and display the media content and may not have an indication of the selected channel.</p><p> However, for various reasons, which of the various channels, determining whether the channel carrying the content being displayed by the media presentation device out to be useful as possible. In addition, a channel selection device (eg, a receiver or remote control) may do so without receiving reports of the tuned channel from that device and, in some cases, without any involvement of the channel selection device. Can be useful. For example, it is useful for the media presentation device itself and / or a network server operating in collaboration with the media presentation device to determine the channel based on the rating of the media content displayed by the media presentation device. be able to. Given the knowledge of the channel on which the media content is arriving, the media presentation device, network server, and / or another entity will then, among many possibilities, play the media content for that channel. Determining and recording the extent to which media content is being used, selectively replacing certain parts of media content with alternative content (such as replacement ads), or overlaying channel-specific content on top of media content for presentation with media content. You can perform one or more actions keyed to the channel, such as.</p><p> One way to determine the channel on which the media content is arriving is for the media content displayed by the media presentation device (or possibly an auxiliary device) and / or network server. It is to generate a digital fingerprint and then compare that fingerprint with the established reference fingerprint data for media content known to be provided on a particular channel.</p><p> For example, a network server or other such entity can establish or otherwise have access to the reference data, which is available to provide media content to the media presentation device. Each reference fingerprint contains a reference fingerprint of each of the channels (eg, each of the channels in the subscription plan for a set-top box that supplies the media content to the media presentation device), and the media content is provided on it. Map to the channel. When the media presentation device receives and displays a given media content, the media presentation device then generates a fingerprint of that media content and, through a network communication interface, sends the generated fingerprint to a network server for analysis. Can report. The network server then compares the reported fingerprint to the reference fingerprint data and finds a match with the reference fingerprint so that the channel on which the media content is arriving is the reference data. It can be determined that the channel maps to that reference fingerprint. Thereby, once the media content determines the channel on which it is arriving, the network server can then communicate with the media presenting device to indicate the channel, and the media presenting device can take channel-specific actions. it can. Alternatively, the network server itself or another entity can take channel-specific actions based on the determined channel.</p><p> Unfortunately, however, the problem that can occur in this process is that the same media content can be served on multiple different channels at the same time or at different times, and therefore by media presentation devices. The fingerprint of the displayed media content may not correlate only with the channels on which the media content is arriving. For example, a sports game or political event can be broadcast simultaneously on multiple different channels, or a television or radio show delivered simultaneously on multiple different such channels at the same time or at different times. Can be broadcast. In these or other scenarios, if the media presentation device is presenting such media content and generates and provides a fingerprint of the media content, that fingerprint can be mapped to multiple reference fingerprints. Therefore, channel identification will not be definitive.</p><p> As a specific example of this, two different video content providers broadcast the same sports game, both on their own separate channels, and the advertiser presents a pop-up ad on that provider's broadcast about the game. To do this, consider a scenario where you have a contract with only one of the content providers. In this scenario, when the media presenting device receives and presents one of these broadcasts, if the media presenting device generates a broadcast fingerprint and provides it to the network server, the network server will have the fingerprint. , It may be determined to match the broadcasts of both content providers for the game, and thus it can be unclear whether the media presentation device should present pop-up ads.</p>

<p> The present specification discloses methods and systems to help disambiguate channel identification in scenarios where media content fingerprint data matches multiple different channels and corresponding multiple reference fingerprints. Will be done. According to the present disclosure, a network server or other entity performing this analysis will make multiple matches by determining that the fingerprint of the media content in question matches two or more reference fingerprints, each corresponding to a different channel. Will detect the scenario. When faced with a detected multi-match scenario, the entity then arrives on any of the channels with the media content displayed by the media presentation device to allow it to take channel-specific actions. Use contextual information about the media content displayed by the media presentation device as the basis for disambiguating the channel identification information to determine if.</p><p> An example of such contextual information is the location of the media presentation device. In particular, it is that the same media content is served or served on different channels within each location in multiple different locations, such as in different geographic market areas (eg, different metropolitan areas). It can be if it is scheduled as. To address that situation, each of the two or more reference fingerprints in a multi-match scenario can be associated with their respective location, in which case knowledge of the location of the media presentation device displaying the media content. Disambiguates between two or more matching reference fingerprints and thus is the basis for determining the channel on which the media content displayed by the media presentation device is arriving. Can be used as.</p><p> Therefore, in one regard, methods are disclosed that include taking action based on channels determined through location-based deambiguation. The method comprises determining that the computing system determines that the fingerprint of the media content displayed by the media presentation device matches a plurality of reference fingerprints corresponding to different channels. In addition, the method determines on which channel the media presenting device is receiving media content in response to determining that the fingerprint matches each of the different channels and the corresponding multiple reference fingerprints. To determine, it involves performing decontamination based at least in part on the location of the media presentation device. The method further comprises taking action based on the determined channel.</p><p> Further, in another respect, a non-transitory computer-readable medium is disclosed that stores instructions that can be executed by a processing unit to perform various operations. The operation involves determining that the fingerprint of the media content displayed by the media presentation device matches a plurality of reference fingerprints corresponding to each of the different channels. In addition, the behavior is which channel carries the media content displayed by the media presentation device in response to determining that the fingerprint matches each different channel and the corresponding multiple reference fingerprints. Includes performing decontamination based at least in part on the location of the media presentation device to determine. And actions include taking action based on a determined channel.</p><p> In addition, with respect to one other point, it is stored in (for example, on top of) the network communication interface, processing unit, non-temporary data storage, and non-temporary data storage to perform various operations. A system is disclosed that includes program instructions that can be executed by the processing unit. The operation involves receiving a fingerprint of the media content displayed by the media presenting device from the media presenting device via a network communication interface. Further, the action involves determining that the received fingerprint matches a plurality of reference fingerprints, each corresponding to a different channel. The behavior then determines which channel is being displayed by the media presentation device in response to determining that the received fingerprint matches each different channel and the corresponding plurality of reference fingerprints, respectively. Including disambiguation based on the location of the media presentation device, at least in part, to determine whether to carry. Actions also involve taking action based on a determined channel.</p><p> These and other aspects, advantages, and alternative forms will be apparent to those skilled in the art by reading the detailed description below, with reference to the accompanying drawings as appropriate. Further, it should be understood that this overview and the description provided below are merely examples of the present invention and are not intended as limitations.</p>

<figref num="1">It is a simplified block diagram of an exemplary system to which various disclosed principles can be applied.</figref><figref num="2">FIG. 6 is a simplified block diagram of an exemplary network configuration in which a media presentation device communicates with a network server to allow various disclosed principles to be implemented.</figref><figref num="3">FIG. 6 is a simplified block diagram of an exemplary system that includes distribution of media at multiple different locations.</figref><figref num="4">It is a flowchart which shows the operation which can be performed according to this disclosure.</figref><figref num="5">It is a simplified block diagram of an exemplary network server.</figref><figref num="6">It is a simplified block diagram of an exemplary media presentation device.</figref>

With reference to the drawings, FIG. 1 is a simplified block diagram of an exemplary system to which various disclosed principles can be applied. However, it will be appreciated that this and other configurations and processes described herein can take various other forms. For example, elements and behaviors can be sorted, distributed, duplicated, composited, omitted, added, or otherwise modified. In addition, the functionality described herein as being performed by one or more entities, such as by one or more processing units that execute program instructions, etc., through hardware, firmware, and / or software. It will be understood that it can be implemented by and / or for them.

As shown in Figure 1, exemplary systems include one or more media content sources 12 (eg, broadcasters, web servers, etc.) and one or more media content distributors 14 (eg, broadcasters, web servers, etc.). Multi-channel distributors such as cable providers, satellite providers, over-the-air broadcast providers, web aggregators) and one or more media content receivers 16 (for example, cable receivers, satellite receivers, over-the-air broadcast receivers) Includes a computer or other streaming media receiver, and one or more clients or media presentation devices 18, such as television or other display devices, loudspeakers or other audio output devices.

In fact, for example, the media content source 12 can be a national broadcaster such as ABC, NBC, CBS, FOX, HBO, and CNN, and the media content distributor 14 can be a specific designated market area. It can be a local affiliate and / or other local content distributor during (DMA), and the receiver 16 and media presentation device 18 can also be located on the customer's premises, such as at home or at a business facility. Using this configuration or other configuration, the content source 12 can deliver the media content to the content distributor 14 for delivery to the receiver 16 on the customer premises, and the content distributor can deliver the media content to a separate channel (eg, for example). , Specific frequency) can deliver media content to the receiver 16. Each receiver then tunes to the selected channel in response to user input or one or more other triggers and outputs the media content arriving on the selected channel to the media presentation device 18. can do. The media presentation device 18 can then receive and display the media content (eg, display or otherwise present the content).

In this configuration, when the media presenting device receives and displays this media content, the media presenting device indicates about the channel on which the media content is arriving, i.e., the channel to which the receiver is tuned. May not have. Instead, the media presentation device can only be configured to receive the media content as a media stream from the receiver and display the received media content. However, according to the present disclosure, the media presentation device may be communicating with the network server and together with the network server to allow channel identification and thus useful channel-specific actions. Can work. FIG. 2 shows an exemplary network configuration in which the media presentation device 18 communicates with the network server 20 via a network 22 such as the Internet. In reality, the media presentation device 18 can be located as a node on the local area network (LAN) on the customer premises, and the media presentation device has an Internet Protocol (IP) address assigned on the LAN. LAN has an IP address on the Internet. Further, the network server 20 can also be accessible by IP address on the Internet. With this configuration, the media presentation device and the network server over the Internet to report the fingerprint of the media content displayed by the media presentation device to enable channel identification and related actions. Can start and participate in IP communication.

As described above, the network server 20 or another entity operating in accordance with the present disclosure is or scheduled to be delivered on each of the various channels accessible to at least the media presentation device 18. Access to reference data 24 for media content has been established or can be established. Reference data, which can be stored in a relational database or other form, carries the respective reference fingerprint of each channel, and in some cases, the most recently carried by the channel (eg, covering the most recent time period). It can contain a reference fingerprint stream of media content (on a sliding window base). As an alternative or addition, the reference data is a reference to each media content program (eg, television broadcast, radio broadcast, streaming media file, etc.) available and / or scheduled to be carried on a particular channel. It can include fingerprints (eg, reference fingerprint streams). Therefore, the reference data maps each reference fingerprint to the channel on which the associated media content (ie, the content uniquely identified by the reference fingerprint) can or can be transported. Can be done.

In mapping reference fingerprints to channels, reference data can characterize channels by various attributes to help distinguish them from each other. For example, if the receiver or other such device provides a number of different channels that can be selected by channel number, the reference data can characterize the channel by their respective channel numbers. And, as another example, if each channel carries content from a particular content source, for example one content from a particular broadcaster, the reference data characterizes the channel by the identity of each of those content sources. Can be attached. Furthermore, when two or more content distributors (eg, multi-channel distributors) distribute content from a content source, the reference data can characterize the channel by the identification information of each of those content distributors. .. In practice, the reference data can correlate each reference fingerprint with one or more of these or other attributes.

A network server 20 or other entity operating in accordance with the present disclosure is a media content arriving on each of the various channels (eg, at least each of the various channels available to the receiver serving the media presentation device. By analyzing the media content arriving above), some or all of this reference data can be determined. To enable this, as shown, the server is a media content distributor on various channels in much the same way that a receiver can be configured to receive content on the customer's premises. It may include or be interconnected with one or more receivers 16 configured to receive media content from one or more of the 14. For example, a server may include or interconnect with one or more cable TV set-top boxes, radios, computers, or other media receivers, or one or more such receptions. It can be configured to emulate a machine. The server then receives and analyzes the respective media content arriving on each channel and any media fingerprinting process currently known or developed later (eg, per frame or other unit). Generate a reference fingerprint of the channel's media content for each channel using computing the hash, or otherwise identifying, extracting, and digitally representing component features that are unique to the media content. Can be configured as

In practice, can the server be configured to receive simultaneously on multiple such channels (and possibly all of them) and analyze and generate their respective fingerprints in parallel for each channel? Or, the server can be configured to cycle through the channels repeatedly, hopping from channel to channel, in order to analyze and generate its own fingerprint for each channel. In addition, the server can store a fingerprint of each of the most recent time windows of media content for each channel for reference and continue to do this in real time. The server then features each channel in the reference data in relation to channel characterization (eg, using attributes such as those mentioned above) and time stamp information indicating the time of receipt of the associated media content. Reference fingerprints can be recorded. Here, the server should have knowledge about each channel (eg, channel number), just as the receiver should normally have knowledge about the channels that the receiver has tuned to. In addition, the server may specify guide information or other such data (eg, content) that specifies each attribute of such a channel so that the server can determine and record the channel attributes for each reference fingerprint. Can have access to source identification information, content distributor identification information, etc.).

As an alternative or addition, the server receives or optionally establishes such a reference fingerprint for media content programs that are available or scheduled to be served on a particular channel. Can be done. For example, various media content program providers or distributors again use some media fingerprinting process currently known or developed later to generate reference fingerprints for media content programs. They can and their reference fingerprints can be provided to the server. Alternatively, the server can receive a pre-copy of the media content program and can itself generate such a reference fingerprint. In addition, the server receives the channels on which the Media Content program is available or scheduled to be served, and in some cases the dates and times scheduled for the Media Content to be served. Or it can be determined from the program guide information. The server is then provided with the media content program in relation to the channel on which the media content program is available or scheduled to be delivered, along with the relevant channel attributes as well, and in some cases the media content program. A reference fingerprint of each media content program can be recorded in the reference data in relation to the date and time scheduled to be.

Given this or other such reference data, when the server is presented with a fingerprint of media content received on an unknown channel, the server is currently known or will be developed later. Any fingerprint matching process can be used to match that fingerprint to one of the stored reference fingerprints so that the media content in question is the reference finger with which the reference data matches. We can conclude that we have arrived on the channel that is mapping to the print. In this way, when the server faces a fingerprint of the media content displayed by the media presentation device 18, the server can compare that fingerprint with the reference fingerprint in the reference data. Then, if the server finds a matching reference fingerprint thereby, the server can identify the channel on which the reference data is mapped to the matching reference fingerprint, which the media presentation device can do. It can be concluded above that it is the channel receiving the media content (ie, it is the channel carrying the media content displayed by the media presentation device). In turn, does the server take channel-specific actions responsively based on the identified channel, or cause one or more other entities to take channel-specific actions based on the identified channel? Or it can be made possible.

To enable this, the media presentation device 18 or another entity is configured to generate a fingerprint of the media content displayed by the media presentation device and send the fingerprint to server 20 for analysis. Can be done.

For example, as shown in FIG. 2, the media presentation device includes a fingerprint generator 26 that can be configured to generate a digital fingerprint of the media content displayed by the media presentation device. be able to. Such a fingerprint generator is the media when the media presentation device is receiving media content from receiver 16 on the channel and / or when the media presentation device is processing the media content for presentation. It can be configured to generate a fingerprint of the content. Therefore, is the fingerprint generator receiving as input a copy of the media content arriving at the media presentation device from the receiver and / or being processed for presentation by the media presentation device and is currently known? Alternatively, some media fingerprinting process developed later can be applied to generate a fingerprint of the media content.

In practice, the fingerprint generator is configured to continuously generate such fingerprints as a fingerprint stream, such as per-frame units (for example, per-keyframe units) or other units. be able to. The media presentation device can then be configured to send the fingerprints to the server 20 over the network 22 for analysis. As an example, a media presentation device is configured to periodically or occasionally send fingerprints representing the latest frames, series of frames, or other parts of the media content displayed by the media presentation device to the server. Can be done. In particular, the media presentation device can generate a message carrying the latest generated fingerprints, along with one or more time stamps and / or other such data as well as the media presentation device identifier. You can send a message to the IP address of the server. The server can then receive the fingerprint for analysis.

Alternatively, the media presentation device is similarly continuous or other unit to allow the server itself or another entity to generate a fingerprint of the media content displayed by the media presentation device. Can send various data about the media content displayed by the media presentation device to the server, and thus the server can receive it. For example, a media presentation device can send parts of the media content displayed by the media presentation device to the server, such as individual frames (for example, snapshots) of the media content or other segments. The server can then apply any media fingerprinting process currently known or developed later to generate a fingerprint of the media content for analysis.

Through the process described above, the server then references the fingerprint of the media content displayed by the media presentation device using some digital fingerprint comparison process currently known or developed later. It can be compared with the reference fingerprint in the data. And, as mentioned above, if the server thereby finds a matching reference fingerprint, the server can determine and determine which channel the reference data maps to the matching reference fingerprint. It can be concluded that the channel is the channel that carries the media content displayed by the media presentation device.

Thereby, in response to determining the channel in question, the server can then take one or more channel-specific actions based on the channel determination, or cause it to be taken. In particular, the server itself can take action based on the channel decision, or the server signals another entity, and in some cases to the media presentation device, to that other entity based on the channel decision. You can take action.

For example, the fact that a server is presenting content for a particular channel as part of a channel rating or analytics system for measuring the extent to which a particular channel is presented by the media presenting device. Can be recorded. For example, a media presentation device can periodically (eg, periodically) report a fingerprint of the media content that the media presentation device is viewing to the server, which determines which channel is being displayed. For this purpose, processes such as those described herein can be performed. Each time the server determines that a channel is displayed in this way, the server adds the displayed channel count or other statistics as data indicating the extent to which the channel is presented. Can be done.

As another example, the server may optionally provide auxiliary content, such as pop-up ads, commercial breaks, or channel identification as described above, as a replacement for one or more pieces of media content. The media presentation device can responsively trigger the presentation. For example, given knowledge of the channel in question, the server can generate or select (for example, from server data storage) specific auxiliary media content specifically associated with the determined channel, media. The auxiliary media content can be transmitted to the media presentation device for the media presentation device to present along with the media content that the presentation device is receiving from the receiver. In this way, the media presentation device can receive the auxiliary media content from the server and present the auxiliary media content together with the media content that the media presentation device is receiving from the receiver.

In practice, the process is that the server receives a fingerprint of the media content displayed by the media presentation device in real time from the media presentation device, and the received fingerprint is simultaneously on a channel known to the server. It can include the server determining that it matches the reference fingerprint of the media content it is receiving (or scheduled for the same amount of time).

However, in some cases, when the media presentation device displays the media content, time stamps the fingerprint and sends the fingerprint to the server, and in some cases the server receives the media content on a known channel. Can have a time lag from when the reference fingerprint is time stamped. The server can account for this time difference by comparing the fingerprints received across the sliding window of the reference fingerprints and vice versa. In addition, the server can take this time difference into account when taking action in response to a determined match between the received fingerprint and the reference fingerprint. For example, if the media presentation device receives the media content well (for example, more than a few seconds earlier) than the server's time stamp for the content, the server can still identify the fingerprint match. Analytical data can be recorded. However, in response to detecting that time lag, the server helps avoid situations where the media presentation device presents auxiliary content too late (for example, out of sync) from the user's point of view. You can refrain from having the media presentation device present the relevant auxiliary content. On the other hand, if the server detects a fingerprint match for a sufficient amount of time and / or determines that the matching content will continue, the server will median the auxiliary content even when faced with such a time lag. Can be presented to.

In either case, through these or other such processes, the network server or other entity can determine the channel on which the media presenting device is receiving the media content in question. Then, when the entity determines the channel, the entity can then take action based on the channel determination. Alternatively, an entity can signal another entity, and possibly the original media presentation device, to have that other entity take action based on a channel decision. Other examples are possible as well.

In line with the above discussion, the server 20 or other entity that has access to the reference data as described above may in some cases by detecting various reference fingerprints that match each other between the reference data. It can be configured to identify matching scenarios.

In one implementation, for example, a server attempts to find a reference fingerprint that matches each other, using some currently known or later developed media fingerprint matching process for the reference fingerprint in the reference data. Pairs can be compared to search for multiple match scenarios and the reference data can be analyzed on a regular basis. Upon finding each of at least two such matches in the reference fingerprint, the server can then flag the reference fingerprint as a multi-match group. Such a flag indicates that there is potential ambiguity if the fingerprint of the media content displayed by the media presentation device matches any of the reference fingerprints in the flagged multi-match group. Can be shown. The server can flag the reference fingerprint as a multi-match group in various ways. For example, the server can cross-reference the reference fingerprints of a plural match group in the reference data to indicate that the reference fingerprint is a member of the plural match group. Alternatively, the server can store a single copy of the reference fingerprint and associate that copy with the various channels on which the media content represented by the reference fingerprint is carried.

In this implementation, when the server receives a fingerprint of the media content displayed by the media presentation device from the media presentation device and the server determines that the received fingerprint matches the reference fingerprint, the server Then, whether or not a multi-match situation exists can be easily determined from the reference data. If the matching reference fingerprint is not flagged as a member of a multiple match group, the server can conclude that a single match situation exists (rather than a multiple match situation). If, as described above, the server can then easily determine the channel associated with the matching reference fingerprint from the reference data, which determines the media content displayed by the media presentation device. It can be concluded that it is a transport channel. On the other hand, if the matching reference fingerprint is flagged as a member of a multiple match group, the server can conclude that there is a multiple match situation (rather than a single match situation). Yes, in which case the server may need to perform a deambiguation process to help identify the channel in question from among those associated with the plural match group reference fingerprint.

Alternatively, in another implementation, the server can identify multiple match groups when the server receives a fingerprint from the media presentation device. For example, when the server receives a fingerprint from a media presentation device, the server can compare the received fingerprint with all of the reference fingerprints in the reference data. If the server detects that the fingerprint received thereby matches only one of the reference fingerprints, the server concludes that there is a single match situation (rather than a multiple match situation). The server can then easily determine the channel associated with the matching reference fingerprint from the reference data, which carries the media content displayed by the media presentation device. It can be concluded that it is a channel. On the other hand, if the server detects that the received fingerprint matches two or more of the reference fingerprints, then the server will assume that there is a multiple match situation (rather than a single match situation). It can be concluded, in which case the server may need to carry out an deambiguation process to help identify the channel in question from among those associated with the multi-match group reference fingerprint.

The process of detecting multiple match situations involving two or more reference fingerprints is such that the two reference fingerprints represent the same media content that is transported on two different channels with a time delay to each other. Note that presentation of media content on one of the channels can be performed even if the presentation of the same media content on another of the channels is time-shifted. .. The fingerprint matching process can take this time shift into account and still find matches if the fingerprints would normally match each other, such as by comparing one fingerprint with the other over the sliding window. can do. For example, the process of finding matching reference fingerprints in reference data is to search for reference fingerprints that match each other and are presented and / or scheduled at each time within each other's threshold time intervals. Can be included.

As mentioned above, the server or other entity performing this analysis has detected that the fingerprint of the media content displayed by the media presentation device matches multiple channel and corresponding multiple reference fingerprints. When this entity is in contextual information, it helps determine which of the channels associated with the multi-match group is the actual channel that carries the media content being displayed by the media presentation device. Based on the deambiguation process can be applied.

Further, according to the present disclosure, a useful example of such contextual information is the location of the media presentation device. In particular, it is serving or scheduled to serve the same media content on different channels within each location in multiple different locations, such as in different geographic markets, metropolitan areas, etc. Can be the case. In that case, each of the two or more reference fingerprints in the multiple match group can be associated with their respective location, in which case the knowledge of the location of the media presentation device displaying the media content is more than one. Can be used alone or in combination with one or more other elements as a basis for disambiguation between matching reference fingerprints of.

FIG. 3 shows an exemplary system in which this can actually be done, as a variant or more specific representation of the configuration shown in FIG. As shown in FIG. 3, an exemplary system includes one or more media content sources 12, plus one or more media content distributors 14 in each of multiple separate locations. Including. These locations can be geographically distinct areas, such as separate geographic markets (eg DMA), metropolitan areas, and so on. In this configuration, one or more content distributors in each location are configured to send media content to one or more receivers 16 in the location, such as receivers on the customer premises in the location. Can be done. The receiver can then be configured to deliver media content to the media presenting device 18 at the location, such as the media presenting device at the customer's premises at the location.

As an example of this, a typical content source can be a broadcaster that provides a national content feed to a separate affiliate in each of the three separate market areas, where each affiliate is in its market area. Content feeds can be delivered to their receivers on their respective local channels. Receivers in each market can then be selectively tuned to the local channel that carries the content feed in those markets, such as through user input, and the content feed can be output to the media presentation device. , The media presentation device can display the content feed for presentation. In this exemplary configuration, all three affiliate local channels should carry the same national content feeds to each other. Thus, the reference data 24 described above can have multiple matching groups of reference fingerprints for these three local channels.

In this configuration or any other configuration, the reference data is provided with the location of the associated channel for each reference fingerprint, i.e. the associated channel, to allow location-based deambiguation of the channel identification information. Location can be indicated. The server can then be configured to determine the location of the media presentation device in question and compare the determined location to the location indicated for the reference fingerprint in the multiple match group. When it discovers that the media presentation device location matches the location indicated for one of the reference fingerprints in the multiple match group, the server then (possibly one or more other). At least based on its findings (with considerations), it can be concluded that the channel associated with that reference fingerprint is the channel that carries the media content being displayed by the media presentation device.

Reference data can indicate the location of the associated channel for each reference fingerprint in various ways. For example, reference data can hold a database record for each reference fingerprint, including that reference fingerprint and the associated channel location. Alternatively, the reference data can have a separate set of reference fingerprints for each location. Other configurations are possible as well.

The server 20 can record such location information when the server generates a reference fingerprint. As an example, the server includes or is interconnected with receiver 16 configured to receive media content on various channels on a per-location basis, such as one or more receivers per location. Each receiver can be configured to receive a channel that is available to the media presentation device at its associated location. The server can thus receive and analyze the media content on each of these channels and generate a reference fingerprint as described above, and the server will generate a reference fingerprint of the media content on each channel. It can be mapped to each location and identification of the channel.

Alternatively, the server can receive a reference fingerprint from the source or distributor of the media content as described above, and for each reference fingerprint, the media content arrives or arrives on it. You can receive or determine the location of the channel scheduled to, and the server maps each reference fingerprint to the respective location and identity of the channel and media for each channel. Content reference fingerprints can be recorded as well.

The server can also identify multiple match scenarios in this reference data in the manner described above. However, here a representative multiple match group can include matching reference fingerprints for separate channels provided at different locations. For example, in the example described above, if the broadcaster provides content feeds to multiple separately located affiliates for delivery to receivers in their respective locations, the reference data will be this. It can include matching reference fingerprints for each channel of the affiliate providing the content. Each reference fingerprint can thus be mapped to different locations and different channels.

In addition, the server can determine the location of the media presentation device in a variety of ways. As an example, a media presentation device can be supplied with an indication of its location (eg, through user input), and the media presentation device is in its communication providing a fingerprint for analysis to the server. Can include that indication of its location. Or the media presentation device can locate it through some location determination system that is currently known or will be developed later (eg, using a Global Positioning System or based on a nearby WiFi network identifier). It can be determined and its location can be indicated in its communication to the server as well. In this way, the server can determine the location of the media presentation device by reading the location indication from the communication received from the media presentation device.

As another example, the server can determine the location of the media presentation device based on the IP address of the media presentation device and, in some cases, the global IP address of the LAN on which the media presentation device operates. For example, a server can query a database that maps an IP address to a location to determine the location that corresponds to the source IP address of the communication received from the media presentation device.

Furthermore, as another example, the server can determine the location of the media presentation device based on the identification of the location-distinguishing content displayed by the media presentation device. For example, channels in different locations can generally carry the same media content to each other (for example, the same media content programs to each other), but that is because channels in each location are at least some media that is unique to that location. This can be the case when transporting content. By identifying its location-specific media content as part of the media content displayed by the media presentation device, the server thereby presents the media content on which reference fingerprints in the multiple match group. You can decide if it corresponds to the channel arriving at the device.

Examples of such location-specific content, but not limited to, include local commercial breaks or local news in the media content displayed by the media presentation device. For example, in the example described above, each local affiliate could introduce a different commercial break in the national content feed, and the commercial break at each location could advertise the local business or other locals. It is unique to the affiliate's location, such as providing information. Alternatively, each local affiliate can include a news program on its channel, which is specific to the affiliate's location. If the server can identify the presence of such a local commercial break or local news program being displayed by the media presentation device, the server will determine which reference fingerprint is the correct reference fingerprint. The identified local commercial or local news program can be used as the basis for.

In order to allow disambiguation based on including local commercials or local news programs in the media content displayed by the media presentation device, the reference data 24 includes various commercials (commercial) on a per-location basis. It can further include a reference fingerprint of the media content that defines it) or the news program (the media content that defines the news program). For example, a server can provide a commercial or news program with a location indication for each commercial or news program, and the server uses some media content fingerprinting process that is currently known or developed later. The commercial or news program reference fingerprints can be generated and each such reference fingerprint can be stored in correlation with the indication of the relevant location of the commercial or news program. Alternatively, the server can receive and store each of such reference fingerprints along with the associated location of the reference fingerprints.

Given a commercial or news program reference fingerprint on a per-location basis, the server then determines that the fingerprint received from the media presentation device matches the specific commercial or news program reference fingerprint. Therefore, the location of the media presentation device can be determined that the reference data is the location associated with the reference fingerprint of the matching commercial or news program.

In practice, for example, the server may periodically receive a fingerprint of the media content displayed by the media presentation device from the media presentation device. Then, at one point in time, the server can determine that the fingerprint from the media presentation device matches the plurality of reference fingerprints and thus presents a multi-match situation. However, at another point in time (before or after), which is optimally close in time when a multi-match situation is identified, the server has a fingerprint from the media presentation device of the local commercial or news program. It can be determined that it matches the reference fingerprint, and thus the media presentation device can determine that the reference data is in a location associated with the reference fingerprint of its local commercial. The server can then determine which reference fingerprint in the multiple match group is associated with the determined location, thereby allowing the associated channel of that reference fingerprint to media content to the media presentation device. It can be concluded that it is a channel that carries.

In this or other implementation, the server can determine in various ways that the location of the media presentation device matches the location associated with a particular reference fingerprint. For example, if the location of the media presentation device is a specific geographic coordinate, such as latitude and longitude coordinates, and the location associated with the reference fingerprint is a location area defined by the geographic coordinates, the server presents the media. You can determine if the device coordinates are within the location area defined for the reference fingerprint. As another example, if the location of the media presentation device is a location area (defined by, for example, geographic coordinates, zip code, etc.) and the location associated with the reference fingerprint is a location area, the server presents the media. You can determine if the location area of the device partially or exactly matches the location area of the reference fingerprint. Other methods are possible as well.

Once the server determines the location of the media presentation device, the media presentation allows the server to further use that location information when attempting to later resolve a multiple match situation involving the media presentation device. It is possible to record something that correlates with the device's identifier to indicate its location. As mentioned above, when the media presentation device sends the fingerprint data to the server, the media presentation device can provide its identifier to the server. Alternatively, the media presentation device can provide its identifier to the server at another time, such as during the initial configuration or registration process. The server can then store its identifier in a profile record for the media presentation device, etc., and when the server determines the location of the media presentation device, the server will indicate that location. It can be stored in the profile record as well. In that way, when the server later receives a fingerprint of the media content displayed by the media presentation device from the media presentation device and the server encounters a multiple match situation, the server presents the media from the profile record. The location of the device can be determined quickly and that location can be used as the basis for disambiguation as described above.

As an alternative or addition, when the server determines the location of the media presentation device, the server can report to the media presentation device what indicates that location, and the media presentation device remembers that location and resolves multiple matches. Can be reported to the server later to enable. For example, the server may include the determined location in the response message that the server sends to the media presentation device (in some cases, the server has a message instructing the media presentation device to present certain auxiliary content, etc.). Can include what is shown. The media presentation device can then programmatically store its indications about the location for later use. The next time the media presentation device sends a fingerprint to the server, the media presentation device will indicate the location along with the transmission so that the server can easily use that location as a basis for disambiguation. Can include things.

In addition, it should be noted that the server may use the presence of location-specific content, or even other types of channel-specific content, in other ways to help resolve multiple match situations. As an example, when the server detects that two or more reference fingerprints generally match each other, the server has a fingerprint of a local news program or other such content that is specific to only one of the channels. It is possible to search for uniquely distinguishable fingerprint data and further evaluate matching fingerprints over a period of time (eg hours, days, etc.). The server can then likewise evaluate the fingerprints received from the media presentation device and identify fingerprint data matches that uniquely distinguish the fingerprint data in the reference fingerprints. Upon finding such a match, the server can then conclude that the channel displayed by the media presentation device is the channel associated with the matching reference fingerprint.

According to the figure in Figure 3, it also means that two or more media content distributors serve the same media content at a given location, but each media content distributor serves media content on different channels. Can be the case. For example, in or about a given location, a given location can have cable TV providers, satellite TV providers, over-the-air broadcast TV providers, and streaming media providers, all of which are the same. It provides national or local affiliate content feeds, each on its own channel. In such a configuration, a multiple match group can contain matching reference fingerprints for multiple such channels in the same location.

To help further disambiguate in this situation, the server (sever) can also take into account the identity of the media content distributor. For example, the server can determine that the location of the media presentation device matches two or more of the reference fingerprints in the multiple match group, and the server further (i) supplies the media presentation device. Determine the identity of the media content distributor who provides the media content to the receiver, and (ii) determine which of the two or more reference fingerprints is relevant to the channel provided by that media content distributor. can do. The server can then conclude that the channel associated with the determined reference fingerprint is the channel carrying the media content displayed by the media presentation device.

In this implementation, the reference data can indicate the media content distributor that provides the relevant channel for each reference fingerprint. For example, the server can commit or receive this information and store each reference fingerprint in the database association with the media content provider that provides the associated channel.

In addition, the server can determine in various ways which media content distributor provides a channel to carry the media content displayed by the media presentation device. For example, a media presentation device can be supplied (eg, through user input) to indicate a media content distributor that provides a channel to a receiver that feeds the media presentation device, and the media presentation device is for analysis. The indication can be included in its communication to the server that provides the fingerprint. In this way, the server can determine the media content distributor by receiving this indication from the media presentation device. Alternatively, the reference data can include distributor-specific reference fingerprints, such as commercials, on-screen guides, logos, slogans, and other fingerprints that are specific to a particular media content distributor. The media content distributor can be determined in a given case by determining that the fingerprint provided by the media presentation device matches such a distributor-specific reference fingerprint. Other methods are possible as well.

Although the above description focuses primarily on server 20 identifying plural match situations and then disambiguating based on contextual considerations, some or all of the behavior described may be: Note that it can be done on behalf of or in collaboration with the server by one or more other entities.

For example, one or more of the actions can be performed by the media presentation device itself or by an auxiliary system that is in local communication with the media presentation device. As an example, the media presentation device itself can be supplied with or have access to reference data such as the reference data described above, and the media presentation device identifies a multi-match situation and Reference data can be referenced by itself to disambiguate and identify the channel providing the media content displayed by the media presentation device. In addition, the media presentation device can then take channel-specific actions on its own, such as presenting channel-specific content, recording channel presentations, or one or more such actions. Can be taken by the entity of. Other variants are possible as well.

FIG. 4 is, in turn, a flowchart showing a method that can be performed according to the above description. One or more of the operations in the method shown in FIG. 4 may, but are not limited to, operate for or in collaboration with network servers, media presentation devices, and / or these or other entities. Can be done by one or more entities, including one or more entities. Any such entity can comprise a computing system, such as a programmed processing unit, configured to perform one or more of the method operations. In addition, non-transient computer-readable media (eg, disk storage, flash storage, etc.) may store instructions that can be executed by a processing unit to perform various illustrated operations.

As shown in FIG. 4, at block 40, the method has a different fingerprint of the media content (eg, video content and / or audio content) displayed by the media presentation device with each channel, respectively. Includes the computing system determining to match multiple corresponding reference fingerprints. At block 42, the method then receives media content on which channel the media presenting device receives media content in response to determining that the fingerprint matches each of the different channels and the corresponding plurality of reference fingerprints. To determine what you are doing (for example, to determine the channel that carries the media content displayed by the media presentation device), perform deambiguation based at least in part on the location of the media presentation device. Including that. Then, in block 44, the method comprises taking action based on the determined channel.

According to the above description, the computing system can be different from the media presentation device, and the fingerprint of the media content displayed by the media presentation device can be generated by the media presentation device. The method can then include the computing system receiving a fingerprint of the media content displayed by the media presentation device from the media presentation device.

Further, as described above, multiple reference fingerprints can be selected from multiple reference fingerprints in the reference data, in which case the fingerprint of the media content displayed by the media presentation device. Determining that matches multiple reference fingerprints is (i) comparing the fingerprint of the media content displayed by the media presentation device with the multiple reference fingerprints in the reference data, and (ii) comparing. Based on this, it can include determining that the fingerprint of the media content displayed by the media presentation device matches a plurality of reference fingerprints.

Furthermore, as described above, the method can include detecting and flagging multiple match groups containing multiple reference fingerprints, in which case the media being displayed by the media presenting device. Determining that a content fingerprint matches a plurality of reference fingerprints can include determining that the fingerprint matches a flagged multiple-match group reference fingerprint.

Further, according to the above description, the act of performing deambiguation based at least in part on the location of the media presentation device is (i) determining the location of the media presentation device and (ii) matching reference fingers. One of the prints involves using the determined location of the media presentation device as the basis for determining which channel the media presentation device corresponds to the channel receiving the media content on it. be able to.

And, as described above, the act of locating a media presentation device can take various forms. For example, it can be based on the network address of the media presenting device (eg, IP address) and / or the location information reported by the media presenting device. As an alternative or addition, it will (i) detect location-specific content based on the fingerprint evaluation of the media content displayed by the media presentation device, and (ii) media presentation based on the detected location-specific content. It can include determining the location of the device.

Furthermore, location-specific content can include local commercials or local news programs. Then, in that case, the act of deciding the location of the media presentation device based on the detected location-specific content is (i) determining the location related to the local commercial and (ii) determining the location related to the local commercial. Based on what has been determined, the location of the media presentation device can include determining that it is a location associated with a local commercial.

Further, as described above, the act of performing deambiguation at least partially based on the location of the media presenting device is displayed at least partially based on the location of the media presenting device and by the media presenting device. It can include performing deambiguation based at least in part on the distributor's identity of the media content being provided. For example, the act is to (i) determine that two or more of the matching reference fingerprints correspond to channels in the same location as each other, and (ii) deliver the media content displayed by the media presentation device. Determining the identity of a person and (iii) determining the media content displayed by the media presentation device at least partially in the selected matching reference fingerprint that corresponds to the channel provided by the distributor. Based on, it can include selecting one of two or more matching reference fingerprints.

From another perspective, as described above, each reference fingerprint of multiple reference fingerprints can have an associated channel location, in which case it is ambiguous based on the location of the media presentation device. Enforcing gender exclusion is (i) determining the location of the media presentation device and (ii) the associated channel location of the identified reference fingerprint based on the determined location of the media presentation device. Identifying one of the matching reference fingerprints, at least partially based on the matching of the determined location of the media presentation device, and (iii) identifying at least partially based on the identification. The channel to which the reference fingerprint corresponds can include determining that the media presenting device is the channel on which the media content is being received.

Moreover, as described above, actions that take action based on a determined channel can also take various forms. For example, the action is to (i) have the auxiliary channel-specific content presented along with the media content displayed by the media presentation device, and / or (ii) the presentation of the channel determined for use in the channel rating system. It can include recording.

FIG. 5 is, in turn, a simplified block diagram of an exemplary system that can operate in accordance with the present disclosure. The system can represent the network server described above and / or one or more other entities (including media presentation devices in some cases). As shown in FIG. 5, an exemplary system includes a network communication interface 50, a processing unit 52, and a non-temporary data storage 54, any or all of which are integrated together. Alternatively, as shown, they can be communicatively linked to each other by a system bus, network, or other connection mechanism 56.

Network communication interface 50 is involved in direct or networked communication with and / or with one or more other local or remote entities to enable communication over networks such as network 22 described above. Therefore, it may be provided with one or more physical network connection mechanisms. Thus, the network communication interface can include a wireless or wired Ethernet® interface or other type of network interface to participate in IP communication and / or other types of network communication.

The processing unit 52 may further include one or more general purpose processors (eg, microprocessors) and / or one or more dedicated processors (eg, application-specific integrated circuits). The non-temporary data storage 54 can then include one or more volatile and / or non-volatile storage components, such as optical, magnetic, or flash storage.

As illustrated, the data storage 54 also stores program instructions 58 that can be executed by the processing unit 52 to perform the various operations described herein. For example, a program instruction may (i) receive a fingerprint of the media content displayed by the media presentation device from the media presentation device via a network communication interface, and (ii) receive different fingerprints for each. In response to determining that a channel and each corresponding multiple reference fingerprints match, (iii) the received fingerprint matches each different channel and corresponding multiple reference fingerprints, respectively. In order to determine which channel carries the media content displayed by the media presentation device, disambiguation is performed at least partially based on the location of the media presentation device, and (iv) the determined channel. Can be actionable to take action based on.

The various features described above can be applied as well in this context. For example, the act of performing disambiguation based at least in part on the location of a media presentation device provides media content to (i) the location of the media presentation device and (ii) the receiver that feeds the media presentation device. It can include performing deambiguation at least in part based on the identification information of the media content distributor. Further, the act of taking action based on the determined channel can include causing the media presentation device to take action based on the determined channel.

Finally, FIG. 6 is a simplified block diagram of an exemplary media presentation device that can operate in accordance with the present disclosure. Following the above description, this media presentation device can take various forms. For example, it can be a television, computer monitor, or other device that operates to receive and display video content, and / or it can receive and display loudspeakers, a pair of headphones, or audio content. It can be another device that works to do so. Many other examples are possible as well.

As shown in FIG. 6, an exemplary media presentation device includes a media input interface 60, a media presentation interface 62, a network communication interface 64, a processing unit 66, and a non-temporary data storage 68. , Any or all of them can be integrated together or, as shown, can be communicatively linked to each other by a system bus, network, or other connection mechanism 70.

The media input interface 60 can include a physical communication interface for receiving media content presented by the media presenting device. Thus, the media input interface includes one or more wired and / or wireless interfaces to establish communication with the receiver or other device or system and receive media content from them in analog or digital format. be able to. For example, a media input interface can include one or more interfaces that comply with protocols such as DVI, HDMI®, VGA, USB, BLUETOOTH®, WIFI, among others.

The media presentation interface 62 may further include one or more components to enable presentation of received media content. As an example, a media presentation interface is one or one for processing received media content to enable presentation of content on user interfaces such as display screens and / or loud speakers, as well as on that user interface. It can have multiple drivers or other components.

Network communication interface 64 is involved in direct or networked communication with and / or with one or more other local or remote entities to enable communication over networks such as network 22 described above. Therefore, a physical network connection mechanism can be provided. Thus, the network communication interface can include a wireless or wired Ethernet® interface or other type of network interface to participate in IP communication and / or other types of network communication.

The processing unit 66 may further include one or more general purpose processors (eg, microprocessors) and / or one or more dedicated processors (eg, application-specific integrated circuits). The non-temporary data storage 68 can then include one or more volatile and / or non-volatile storage components, such as optical, magnetic, or flash storage. Further, as illustrated, the data storage 68 stores program instructions 72 that can be executed by the processing unit 66 to perform the various operations described herein. For example, a program instruction continually fingerprints the media content displayed by the media presentation device based on an analysis of the media content received at the media input interface 60 and / or processed at the media presentation interface. It can be feasible to generate and continuously provide the generated fingerprints to allow channel identification as described herein.

An exemplary embodiment has been described above. However, one of ordinary skill in the art will appreciate that changes and modifications can be made to these embodiments without departing from the true scope and gist of the invention.