System and method for providing optimal display of video content
Claim Score by NHIP
Abstract
Video display capabilities for use in the home continue to evolve. A method is described including receiving a video signal in a first format, determining at least one parameter associated with the signal and a display device, converting the signal to a signal in a second format based on the signal and display device parameters, and converting the second signal to a display signal based on the display device parameter. An apparatus is described including an input stream processor that decodes and separates a received signal, a controller that determines at least one characteristic of the signal and a display device, a video signal processor circuit that converts the signal to a second signal based on the characteristics and further converts the second signal to an output signal based on a characteristic of the display device, and an interface circuit that provides the output signal to the display device.

Term
4.6 yearsto projected expiry
Projected expiry 12 April 2031, counted from filing; an application has no term until it is granted.
- Priority
- Filed
- Published
- Today
- Projected expiry
24 claims: 3 independent, 21 dependent
- 1A method comprising the steps of:receiving a video signal in a first video signal format;determining at least one parameter associated with the first video signal format for the received video signal;determining at least one parameter associated with a display device;converting the received video signal to an intermediate video signal in a second video format based on the at least one parameter associated with the first video signal and the at least one parameter associated with the display device;and converting the intermediate video signal to a video display signal based on the at least one parameter associated with the display device.
- 13Broadest claimClaim Score 72, broad(NHIP)An apparatus comprising:means for receiving a video signal in a first video signal format;means for determining at least one parameter associated with the first video signal format for the received video signal;means for determining at least one parameter associated with a display device;means for converting the received video signal to an intermediate video signal in a second video format based on the at least one parameter associated with the first video signal and the at least one parameter associated with the display device;and means for converting the intermediate video signal to a video display signal based on the at least one parameter associated with the display device.
- 24A signal receiving apparatus comprising:an input stream processor, the input stream processor decoding a received signal and separating the decoded signal into a video portion and an audio portion;a controller coupled to the input stream processor, the controller determining at least one characteristic of the video portion of the decoded signal and determining at least one characteristic of a display device;a video signal processor circuit coupled to the input stream processor and controller the video signal processor circuit converting the video portion of the decoded signal from a first video format to a second video format based on the at least one characteristic of the video portion of the decoded signal and the at least one characteristic of the display device, the video signal processor circuit also converting the first converted video signal in the second video format to a display output signal in a third video format;and an interface circuit coupled to the video signal processor and controller, the interface circuit providing the display output signal to the display device.
Independent claims3
117 paragraphs in 6 sections, as filed
CROSS REFERENCE TO RELATED APPLICATIONS
0001This application claims the benefit under 35 U.S.C. §119 of provisional application 61/292,916 filed in the United States on Jan. 7, 2010.
FIELD OF THE INVENTION
0002The present disclosure relates generally to the operation of a video signal processing system and more specifically to the receiving and processing of video signals in a signal processing device for display on a video display device.
BACKGROUND OF THE INVENTION
0003This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present invention that are described below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present invention. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
0004Video display capabilities, and in particular three-dimensional (3-D) and multi-view display capabilities, continue to evolve. In recent years the technology has moved from primarily being used in mass audience presentations, such as movie theaters, to being provided to the home via delivery systems such as broadband or broadcast communications systems or using media such as Blu_ray 3-D. While there are only a limited number of standards used in movie theatres, there have been numerous attempts to get 3-D into the home, and therefore the standards for 3-D content delivery and display in the home still remain unclear. Independent of the display technology, existing 3-D content may be provided in a number of signal formats, including but not limited to anaglyph (e.g. red/blue or colorcode) for simulating 3-D on 2-dimensional (2-D) displays, checkerboard (typically used for digital light projector (DLP) displays), side by side, over/under, line interleaved, temporally interleaved, quincunx, Multiview Video Coding (MVC), and interleaved progressive frames at 48 frames per second (fps) (e.g. 2×24 fps) or 60 fps (e.g. 2×30 fps), as well as Sensio and other proprietary formats.
0005These signal formats represent only several of the current possibilities; with more expected to emerge as the technology evolves. In addition to the various signal formats introduced, several display types exist, including but not limited to cathode ray tube (CRT), DLP, Plasma, liquid crystal display (LCD), organic light emitting diode (OLED), or similar display and may include special lens systems including, for instance, a lenticular lens display. Still further, several display modes, or technologies, exist, for the user to experience a 3-D or multi-view image, including but not limited to shutter glasses, polarized lens glasses, colorized lens glasses for anaglyph 3-D content, alternating display polarization, and auto-stereoscopic display technology. As standards for 3-D in the home continue to emerge, many existing display devices will be incapable of displaying any modern 3-D content. The presence of all of the signal formats, modes, displays, and technologies, as well as the various combinations, represents a very difficult user experience for the home viewer.
0006Mechanisms to convert the input format of a video signal to match the type of display and the type of format are needed to improve the operation of 3-D in the home. Some modern video processing systems, such as the 9800 system from NVidia, address some of the conversion issues. However, conversion systems remain very limited and do not appear to address any issues related to analyzing the content, the display type, and the mode to determine the optimal display experience for the user. In many other cases, the video processor system simply acts largely as a pass-through for the 3-D formatted signal content, and relies on the processing and operations of the display.
0007In addition, some users who own one of the 3-D capable displays may wish to view content received in a more conventional 2-D format on the 3-D display. Other viewers may have only a conventional 2-D display, but may wish to view the 3-D content in a best possible 3-D display mode. Still further, as multi-view signal formats and displays emerge, no conversion paths exist for converting 2-D or 3-D content to multi-view content and vice versa. Today, no solutions exist that address the optimal operation of the display device and mode or technology to allow the user greater content display flexibility. Therefore there is a need for a system and method to provide a seamless user friendly operation to allow display devices to display advanced video content, including 2-D, 3-D, or multi-view content, in the best manner possible.
SUMMARY OF THE INVENTION
0008In accordance with an aspect of the present embodiments, a method is described including receiving a video signal in a first video signal format, determining at least one parameter associated with the first video signal format for the received video signal, determining at least one parameter associated with a display device, converting the received video signal to an intermediate video signal in a second video format based on the at least one parameter associated with the first video signal and the at least one parameter associated with the display device, and converting the intermediate video signal to a video display signal based on the at least one parameter associated with the display device.
0009In accordance with another aspect of the present embodiments, an apparatus is described including an input stream processor, the input stream processor decoding a received signal and separating the decoded signal into a video portion and an audio portion, a controller coupled to the input stream processor, the controller determining at least one characteristic of the video portion of the decoded signal and determining at least one characteristic of a display device, a video signal processor circuit coupled to the input stream processor and controller, the video signal processor circuit converting the video portion of the decoded signal from a first video format to a second video format based on the at least one characteristic of the video portion of the decoded signal and at least one characteristic of the display device, the video signal processor circuit also converting the first converted video signal in the second video format to a display output signal in a third video format, and an interface circuit coupled to the video signal processor, the interface circuit providing the display output signal to the display device.
BRIEF DESCRIPTION OF THE DRAWINGS
0010In the drawings:
0011<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of an embodiment of a content delivery system of the present disclosure;
0012<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram of another embodiment of a content delivery system of the present disclosure;
0013<figref idref="DRAWINGS">FIG. 3</figref> is a block diagram of an embodiment of a signal receiving device of the present disclosure;
0014<figref idref="DRAWINGS">FIG. 4</figref> is a block diagram of an embodiment of a display signal converter used in a signal receiving device of the present disclosure;
0015<figref idref="DRAWINGS">FIG. 5</figref> is a flow chart of an embodiment of a signal conversion process of the present disclosure;
0016<figref idref="DRAWINGS">FIG. 6</figref> is a flow chart of an embodiment of a base form or intermediate signal conversion process of the present disclosure; and
0017<figref idref="DRAWINGS">FIG. 7</figref> is a flow chart of an embodiment of a display signal conversion process of the present disclosure.
0018The characteristics and advantages of the present disclosure may become more apparent from the following description, given by way of example.
DETAILED DESCRIPTION
0019It should be understood that the elements shown in the FIGs. may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces. Herein, the phrase “coupled” is defined to mean directly connected to or indirectly connected with, or through, one or more intermediate components. Such intermediate components may include both hardware and software based components.
0020The present description illustrates the principles of the present disclosure. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the disclosure and are included within its scope.
0021All examples and conditional language recited herein are intended for educational purposes to aid the reader in understanding the principles of the disclosure and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions.
0022Moreover, all statements herein reciting principles, aspects, and embodiments of the disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
0023Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative circuitry embodying the principles of the disclosure. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
0024The functions of the various elements shown in the FIGs. may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read only memory (“ROM”) for storing software, random access memory (“RAM”), and nonvolatile storage.
0025Other hardware, conventional and/or custom, may also be included. Similarly, any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
0026In the claims hereof, any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function. The disclosure as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.
0027One or more specific embodiments of the present disclosure will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
0028The following describes a system relating to video signals, and more particularly to video signals as defined and delivered over a signal transmission system, such as a terrestrial, satellite, cable, or broadband Internet system, to a receiving device at user's premises for display. In addition, the system may include a device that delivers content from local storage, including local disks, some form of network attached storage, or video serving devices, or from other devices in the home network. The embodiments described may be used in a settop box, or similar video processing device. The embodiments may also be used in a television in which the functions attributed to the settop box may be applied to the video decoding capability of the television, or similar video signal display device. Examples of similar devices include, but are not limited to, cellular phones, intelligent phones, personal digital assistants, personal video recorders, media players, game consoles, disk players, and laptop computers. Other systems utilized to receive other types of signals may include similar structures and processes. Those of ordinary skill in the art will appreciate that the embodiments of the circuits and processes described herein are merely one set of potential embodiments. It is important to note that signals compliant with various broadcast and wireless standards in general, may be transmitted in a manner other than over a terrestrial, satellite, or cable network, including transmission over the air, through a wireless network, over telephone lines, power lines, or coax cable, or through some other local media. As such, in alternate embodiments, the components of the system may be rearranged or omitted, or additional components may be added. For example, with minor modifications, the system described may be configured for use in other terrestrial broadcast services, wi-fi video and audio services, or phone data services, including services used elsewhere in the world,
0029The embodiments described below are primarily related to reception and processing of signals. Certain aspects of the embodiments including, but not limited to, certain control signals and power supply connections have not been described or shown in the figures but may easily be ascertained by a skilled artisan. It should be noted that the embodiments may be implemented using hardware, software, or any combination of both, including the use of a microprocessor and program code or custom integrated circuits. It should also be noted that many of the embodiments involve iterative operation and connection between the various elements of the embodiments. Alternative embodiments may be possible using pipelining architectures employing repeated identical elements, connected in series, in place of, or in addition to, the iteration operation embodiments described herein.
0030The disclosed embodiments are directed at a system and method for providing optimal display of video content. More specifically, the embodiments are directed at signal processing that detects or determines the supported and preferred 2-D, 3-D, or multi-view formats of a display device, along with the modes or technology available, and uses this information to process and convert the received 2-D, 3-D, or multi-view content such that the signal processor provides the content in a format that is both appropriate or optimal for the display.
0031Turning now to the drawings and referring initially to <figref idref="DRAWINGS">FIG. 1</figref>, an exemplary embodiment of a content delivery system <b>100</b> using aspects of the present disclosure is shown. System <b>100</b> delivers content, including 3-D content, in the form of audio and video programs, over one of two possible delivery networks to users' homes. Although system <b>100</b> primarily describes delivery of 3-D content, the system may equally apply to delivery of other video content, such as enhanced 2-D content, or multi-view content.
0032In system <b>100</b>, 3-D content, along with 2-D content originates from, and is provided by, a 3-D content source <b>110</b>, such as a movie studio or production house. 3-D content source <b>110</b> provides a broadcast content signal to a broadcast affiliate manager <b>120</b>. 3-D content source <b>110</b> also provides a special content signal to content manager <b>130</b>. The broadcast affiliate manager <b>120</b> and content manager <b>130</b> each connect to a settop box <b>160</b>, typically residing at or near a user's home, through delivery network <b>140</b> and delivery network <b>150</b> respectively. The content may also be delivered to settop box <b>160</b> from local content source <b>180</b>. Settop box <b>160</b> connects to display device <b>170</b> at a user's home and is used for viewing the delivered video content.
0033As described above, 3-D content source <b>110</b> may supply content in at least one of two forms. One form may be broadcast content delivered to the broadcast affiliate manager <b>120</b>. The broadcast affiliate manager <b>120</b>, which is typically a national broadcast service, such as the American Broadcasting Company (ABC), Columbia Broadcasting System (CBS), or National Broadcasting Company (NBC), may collect and store the content. The broadcast affiliate manager <b>120</b> may also be a broadcast service associated with cable or satellite signal content delivery. The broadcast affiliate manager <b>120</b> may also schedule delivery of the content over delivery network <b>140</b>. The broadcast affiliate manager <b>120</b> ultimately provides the content for delivery, based on a schedule or otherwise, over delivery network <b>140</b>. Delivery network <b>140</b> may include a satellite transmission link from a national center to one or more regional or local centers. Delivery network <b>140</b> may also include a localized content delivery network using local delivery systems such as over the air broadcast, satellite broadcast, or cable broadcast. The delivered broadcast content is provided to the input of settop box <b>160</b> through a delivery network interface on settop box <b>160</b>.
00343-D content source <b>110</b> may also provide special content to content manager <b>130</b>. Special content may include content delivered as premium viewing, pay-per-view content, 3-D movies or videos, games, enhancement features to the broadcast content, or any other content otherwise not provided to the broadcast affiliate manager <b>120</b>. Content manager <b>130</b> manages, repackages, and schedules the delivery of content over delivery network <b>150</b>. In many cases the special content may be content requested by the user and managed and delivered over delivery network <b>150</b> by content manager <b>130</b>. Content manager <b>130</b> may be a service provider, such as an internet website. Content manager <b>130</b> may also be affiliated with a content provider such as the 3-D content source, broadcast service such as a broadcast affiliate manager <b>120</b>, or a delivery network service. Content manager <b>130</b> may also incorporate other internet content not provided by the 3-D content source through a separate internet connection.
0035Content manager <b>130</b> may deliver the content to settop box <b>160</b> over a separate delivery network, such as delivery network <b>150</b>. Delivery network <b>150</b> may include a high speed two way broadband internet type communications system. It is important to note that some or all of the content from the broadcast affiliate manager <b>120</b> may also be delivered using all or parts of delivery network <b>150</b> and some or all of the content from the content manager <b>130</b> may be delivered using all or parts of delivery network <b>140</b>. The special content is provided to the input of settop box <b>160</b> through a content delivery network interface on settop box <b>160</b>.
0036Local content source <b>180</b> may also deliver content to settop <b>160</b>. Local content source <b>180</b> may provide content that was not delivered over either delivery network <b>140</b> or delivery network <b>150</b>, but may still be based on content originating from 3-D content source <b>110</b>. Additionally, local content source <b>180</b> may provide content, such as user created or computer generated content, where the content is not transmitted, but instead is generated or reproduced locally. Local content source <b>180</b> may include a local portable storage device, such as a hard disk drive, or a removable media such as a compact disk (CD) or digital versatile disk (DVD). Local content source <b>180</b> may be included as part of an entertainment or information device, such as a game console or personal computer.
0037Settop box <b>160</b> receives content in the form of a received signal from one or both of delivery network <b>140</b> and delivery network <b>150</b> or from local content source <b>180</b>. Settop box <b>160</b> separates and processes the content, including selecting and decoding one or more channels or program streams. Settop box <b>160</b> may provide a separation of the received content based on user preferences and commands. More specifically, settop box <b>160</b> identifies and determines the format of the received signal and converts the received signal into a display signal format after determining the best available, or optimal, signal format for display. Further details of the operation of signal receiving devices such as settop box <b>160</b> will be described below. The selected and processed content, in the form of audio and video signals, is provided to display device <b>170</b>. Display device <b>170</b> may be a conventional 2-D type display. Display device <b>170</b> may alternatively be an advanced 3-D display requiring a specific 3-D signal format input in order to display 3-D content. The user may also incorporate a 3-D mode or technology that can be used with either the 2-D or 3-D characteristics of display device <b>170</b>, For instance, the user may use colorized lens glasses to view an anaglyph processed signal on a conventional 2-D display. The user may also use polarized glasses or shutter glasses synchronized to a 3-D display. Finally, the display device <b>170</b> may be an advanced multi-view display that includes an autostereoscopic or other type of multi-view display lens.
0038Settop box <b>160</b> may also include an interface for communication over delivery network <b>150</b>. For instance, settop box <b>160</b> may communicate information to content manager <b>130</b>, including display device identification information, content search requests, or direct content requests. Settop box <b>160</b> may also receive information including downloadable software applications and updates, custom content based on requests, and search request results over delivery network <b>150</b>.
0039Turning <figref idref="DRAWINGS">FIG. 2</figref>, another embodiment of a content delivery system <b>200</b> using aspects of the present disclosure is shown. System <b>200</b> delivers content, including 3-D content, in the form of audio and video programs, over one of two possible delivery networks to single or multiple dwelling units, such homes, apartments, and hotels. The content is provided to a gateway or head-end device. The gateway or head-end device distributes the content to multiple client devices and display devices within individual rooms, apartments, or living quarters with the dwelling units. Although system <b>200</b> primarily describes delivery of 3-D content, the system may equally apply to delivery of other video content, such as enhanced 2-D content, or multi-view content.
0040In system <b>200</b>, 3-D content, along with 2-D content originates from, and is provided by, a 3-D content source <b>210</b>, such as a movie studio or production house. 3-D content source <b>210</b> provides a broadcast content signal to a broadcast affiliate manager <b>220</b>. 3-D content source <b>210</b> also provides a special content signal to content manager <b>230</b>. The broadcast affiliate manager <b>220</b> and content manager <b>230</b> each connect to gateway head end device <b>255</b>, typically residing at or near a single or multiple dwelling unit, through delivery network <b>240</b> and delivery network <b>250</b> respectively. Additional content may also be delivered to gateway head end device <b>255</b> from local content source <b>280</b>. It is important to note that when gateway head end device <b>255</b> is used in a single dwelling unit setting, it is often referred to as a gateway or router device. When gateway head end device <b>255</b> is used in a multiple dwelling unit setting it is often referred to as a head end device. Gateway head end device <b>255</b> connects to each of a plurality of client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>located throughout the dwelling unit. Each of the plurality of client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>connects to display devices <b>270</b><i>a</i>-<b>270</b><i>n </i>and is used for viewing the delivered video content. The operation and function of 3-D content source <b>210</b>, broadcast affiliate manager <b>220</b>, content manager <b>230</b>, delivery network <b>240</b>, delivery network <b>250</b>, display devices <b>270</b><i>a</i>-<b>270</b><i>n, </i>and local content source <b>280</b> are similar to those similar named elements in <figref idref="DRAWINGS">FIG. 1</figref> and will not be described in further detail here.
0041The gateway head end <b>255</b> receives content in the form of a received signal from one or both of delivery network <b>240</b> and delivery network <b>250</b> or from local content source <b>280</b>. Gateway head end <b>255</b> may include circuitry tuning, demodulating, and demultiplexing multiple channels or program streams simultaneously. This circuitry may contain a plurality of tuners, demodulators, and demultiplexers to convert the received signal into a plurality of data streams, each of which carries a program or service (e.g., television channel video, television channel audio, program guides, and so forth). Gateway head end <b>255</b> also includes processing circuitry for interfacing to a local area network within the dwelling unit in order to provide the program or services to the client devices <b>265</b><i>a</i>-<b>265</b><i>n. </i>In one embodiment, gateway head end <b>255</b> includes an Internet protocol (IP) wrapper circuit to interface to client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>over Ethernet.
0042The gateway head end <b>255</b> may be coupled to client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>over the local area network. Although not shown, the local area network may include one or more routers, switches, modem, splitters, or bridges. The local area network may also include wireless interfaces in addition to wired interfaces. The client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>may be any suitable type of video, audio, and/or other data receiver capable of receiving data from gateway head end device <b>255</b>, such as IP packets. It will be appreciated the term client device, as used herein, may encompass not only devices that sit upon televisions. Rather the client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>may be any device or apparatus operating as an end user device in a dwelling, whether internal or external to a television, display, or computer, that can be configured to function as described herein including, but not limited to, video components, computers, wireless telephones, or other forms video recorders. Gateway head end device <b>255</b> may also include an interface for communication over delivery network <b>250</b>. For instance, gateway head end device <b>255</b> may communicate information to content manager <b>230</b>, including display device identification information, content search requests, or direct content requests received from one or more of the client devices <b>265</b><i>a</i>-<b>265</b><i>n</i>. Gateway head end <b>255</b> may also receive information including downloadable software applications and updates, custom content based on requests, and search request results over delivery network <b>250</b> and provide this information to one or more of the client devices <b>265</b><i>a</i>-<b>265</b><i>n. </i>
0043The client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>process the data signal containing the video program streams received from gateway head end device <b>255</b> over the local area network. In addition, client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>may receive and process individual user requests for content and provide those requests to gateway head end <b>255</b>. The IP wrapper circuit in gateway head end <b>255</b> may be configured to receive those requests from client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>and to multicast (i.e., broadcast over an IP address) the program or service content to those client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>that had requested the particular program or service. The selected and processed program or service content, in the form of audio and video signals, is provided to display devices <b>270</b><i>a</i>-<b>270</b><i>n</i>. Further details of the operation of gateway head end <b>255</b> and client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>will be described below.
0044Turning now to <figref idref="DRAWINGS">FIG. 3</figref>, a block diagram of an embodiment of a signal receiving device <b>300</b> is shown. Signal receiving device <b>300</b> may typically be used for receiving signals containing content delivered over one or more delivery networks, such as those described in <figref idref="DRAWINGS">FIG. 1</figref> or <figref idref="DRAWINGS">FIG. 2</figref> or alternately from a local source such as local content source <b>180</b> described in <figref idref="DRAWINGS">FIG. 1</figref> or local content source <b>280</b> described in <figref idref="DRAWINGS">FIG. 2</figref>. Signal receiving device <b>300</b> may be incorporated into a settop box, such as settop box <b>160</b> shown in <figref idref="DRAWINGS">FIG. 1</figref> or may alternatively be incorporated into other devices including a display device, such as display device <b>170</b> shown in <figref idref="DRAWINGS">FIG. 1</figref>. All, or a portion of, signal receiving device <b>300</b> may also be incorporated into gateway head end device <b>255</b> or client devices <b>265</b><i>a</i>-<b>265</b><i>n. </i>In either case, several components necessary for complete operation of signal receiving device <b>300</b>, such as the power supply and various control signals, are not shown in the interest of conciseness as they are well known to those skilled in the art.
0045In signal receiving device <b>300</b>, a signal containing video as well as audio content is received in input signal receiver <b>305</b>. Input receiver <b>305</b> connects to input stream processor <b>310</b>. Input stream processor <b>310</b> connects to audio processor <b>330</b>. Audio processor <b>330</b> connects to audio interface <b>335</b>. Audio interface <b>335</b> provides an audio output signal for external use in an external device, such as an audio amplifier and speaker. Input stream processor <b>310</b> also connects to base video processor <b>320</b>. Base video processor <b>320</b> connects to display processor <b>340</b>. Display processor <b>340</b> connects to display interface <b>350</b>. Display interface <b>350</b> provides an output video signal and may additionally provide a communications interface with an external display element or device. It is important to note that the audio output signal and video output signal may be combined into a composite output interface, such as HDMI. A video memory <b>355</b> connects and interfaces to input stream processor <b>310</b>, base video processor <b>320</b>, and display processor <b>340</b>. A controller <b>360</b> is connected to input signal receiver <b>305</b>, input stream processor <b>310</b>, base video processor <b>320</b>, audio processor <b>330</b>, display processor <b>340</b>, and display interface <b>350</b>. A control memory <b>365</b> connects to controller <b>360</b>. Controller <b>360</b> also connects to user interface <b>370</b>. User interface <b>370</b> includes any structures and devices necessary to allow interactive control of signal receiving device <b>300</b> by a user or viewer.
0046Input signal receiver <b>305</b> may receive a signal containing one or more audio and video programs as either a broadcast signal delivered over delivery network <b>140</b>, a broadband signal delivered over delivery network <b>150</b> or provided locally by a local content source <b>180</b> as shown in <figref idref="DRAWINGS">FIG. 1</figref> or similarly described in <figref idref="DRAWINGS">FIG. 2</figref>. Input signal receiver <b>305</b> may include one or more of several known receiver or transceiver circuits used for receiving, demodulation, and decoding signals provided over one of the several possible networks including, but not limited to, cable, satellite, over the air, Ethernet, fiber and phone line networks as well as physical media. The desired input signal may be selected, or tuned, and decoded in input signal receiver <b>305</b> based on a control signal from controller <b>360</b>. Alternately, the input signal receiver <b>305</b> may receive the signal from local content source. Controller <b>360</b> may generate the control signal based on a user input provided through user interface <b>370</b>.
0047The decoded output signal from the input receiver <b>305</b> is provided to input stream processor <b>310</b>. Input stream processor <b>310</b> performs the final signal content selection and processing and includes separation of video content from audio content within the decoded signal content stream. The audio content is provided to audio processor <b>330</b> for conversion from the received format, such as a compressed digital signal, to an analog or digital waveform signal. The analog or digital waveform signal is provided to audio interface <b>335</b> and further to a display device or audio amplifier. Alternatively, audio interface <b>335</b> may provide a digital signal to an audio output device or display device using a high definition multimedia interface (HDMI) cable or alternate digital audio interface such as via Sony/Philips Digital Interconnect Format (S/PDIF).
0048The video signal content from input stream processor <b>320</b> is provided to base video processor <b>330</b>. The video signal content may be provided in one of several formats, including traditionally compressed 2-D, 3-D checkerboard, over/under, line interleaved, quincunx, side-by-side format, or temporally interleaved, proprietary 3-D formats such as Sensio, or other formats such as MVC or SVC. In addition, the signal content may be provided at a particular frame rate, such as 24 fps or 30 fps. The signal may also be provided at a particular display resolution format, such as 720 line interlaced (720i) or 1080 line progressive (1080p). Base video processor <b>330</b> provides a first conversion of the video content into a base or intermediate form as may be necessary based on the input signal format and one or more display device characteristics. Several base forms may be possible and multiple base forms may also be generated, either simultaneously or successively. One possible base form, chosen for allowing ease of further conversion, is a left-right stereoscopic format base form. The left-right stereoscopic format includes two separate images based on an image for the left eye and another image for the right eye. It is important to note that the left-right stereoscopic format permits conversion between various 3-D formats for the input signal into other various 3-D formats for the display device. Further, the left-right stereoscopic format permits conversion of a 2-D input format to a 3-D output as well as a 3-D input format to a 2-D or 3-D output for use with a 2-D display. The left-right stereoscopic format also permits conversion of multi-view input formats into signal formats for either 2-D or 3-D display devices and vice versa.
0049The base form conversion process in base video processor <b>330</b> may be controlled based on inputs received from controller <b>360</b>. The base form conversion process will be described in further detail below. Following any necessary first, or base form, conversion in base video processor <b>320</b>, the base form signal, including either a single base form or multiple base forms, may be stored in video memory <b>355</b>. Alternatively, the base form signal may be provided directly to display processor <b>340</b>. Providing the base form signal directly to display processor <b>340</b> rather than to video memory <b>355</b> may depend on the complexity of the conversion or information from the received input signal and identified, determined, and controlled by controller <b>360</b>.
0050The base form signal from either base video processor <b>320</b> or video memory <b>355</b> is provided to display processor <b>340</b>. Display processor <b>340</b> converts, as necessary, one or more of the base forms in the base form signal into a display signal that is display device appropriate or display device optimized. Display processor <b>340</b> converts the base form signal to the display signal based on inputs received from controller <b>360</b> and may represent a separate conversion process from the conversion process performed in base video processor <b>320</b>. The display signal conversion process will be described in further detail below. The output display signal from display processor <b>340</b> is provided to display interface <b>350</b>. Display interface <b>350</b> further provides the display signal to a display device such as a type of display device described above. Display interface <b>350</b> may include an analog signal interface such as red-green-blue (RGB) interface or may include a digital interface such as HDMI.
0051Controller <b>360</b> is interconnected to, and provides control inter-operation with, several of the blocks in signal receiving device <b>300</b> including the input stream processor <b>310</b>, base video processor <b>320</b>, display processor <b>340</b>, display interface <b>350</b>, and user interface <b>370</b>. Controller <b>360</b> manages the two stage conversion process for converting the input stream signal into an appropriate or optimized display signal. Controller <b>360</b> may receive several inputs in order to determine and manage the necessary conversion processes. First, controller <b>360</b> may receive information regarding the input signal format from input stream processor <b>310</b>. The information may be provided as part of the signal, such as data in a header packet. The information may also be provided as a separate information stream associated with the content stream in the received signal. The input signal format information may be also be determined directly by signal analysis in input stream processor <b>310</b>, by a user and provided as a user input through user interface <b>370</b>, or by some other predetermined fashion.
0052Controller <b>360</b> may additionally receive information regarding the capability of the display device from display interface <b>350</b>, from the user through user interface <b>370</b>, or as part of a received input signal through input stream processor <b>310</b>. For instance, the display device may be identified using information received over the HDMI two way communications at display interface <b>350</b>. The HDMI communications may also provide display capabilities, and may also include optimal settings for the display. Additionally, after identification over HDMI or by the user, controller <b>360</b> may send a request out of the signal receiving device through input signal receiver and over a delivery network to a database service. The database may contain further information associated with the particular identified display device, including the optimal 3-D signal format, resolution, and technology capabilities. The database may also identify particular characteristics or signal and display formats that may be considered more appropriate or optimal for displaying 3-D content. Control memory <b>365</b> may be used to store display information, input signal format information, and control and user information used in the display format conversion processing.
0053It is to be appreciated that video memory <b>355</b> and control memory <b>365</b>, shown and described in <figref idref="DRAWINGS">FIG. 3</figref>, may be any conventional storage or memory device known in the art. Further, the implementation of the storage or memory may include several possible embodiments, such as a single memory device or, alternatively, more than one memory circuit connected together to form a shared or common memory. Still further, the memory may be included with other circuitry, such as portions of bus communications circuitry, in a larger circuit. Finally, the storage or memory may utilize any current storage technology suitable for storing data and/or instruction code including, but not limited to, static random access memory (SRAM), read only memory (ROM), and hard disk drive.
0054Controller <b>360</b> also provides control output signals to the input stream controller <b>310</b>, base video processor <b>320</b>, display processor <b>340</b>, and display interface <b>350</b>. Controller <b>360</b> may provide a signal to the input stream processor <b>310</b>, base video processor <b>320</b>, and display processor <b>330</b>, to bypass any further processing of the incoming signal and/or to store the received signal content in its received form in video memory <b>355</b>. This pass-through mode may be necessary or desirable based on the type of input signal, the type of display, or a user input. For instance, the pass-through mode may be necessary if the signal input and the display device utilize a proprietary, custom, or unknown 3-D signal format. Any further conversion of the incoming signal may only impair performance. Further, during pass-through mode, the controller <b>360</b> may provide additional information to the display processor <b>340</b> to add signaling to the output signal to the display interface <b>350</b> allowing automated signaling at the display device, such as display device <b>170</b> described in <figref idref="DRAWINGS">FIG. 1</figref> or similar described in <figref idref="DRAWINGS">FIG. 2</figref>.
0055Controller <b>360</b> may also provide signals to base video processor <b>320</b> and display processor <b>340</b> to identify and perform the necessary conversion steps to be performed in each block based on inputs and information received by controller <b>360</b>. For example, controller <b>360</b> may provide a control signal to base video processor <b>320</b> to convert the incoming input video stream from a 480i side-by-side 3-D signal to a 2 image left-right stereoscopic image at 1080p and 30 fps as a base form. Controller <b>360</b> may additionally provide a control signal to display processor <b>340</b> to generate a 2-D signal from the base form generated above. In one embodiment, display processor generates a 2-D signal from a 3-D base form as a 2 image left-right stereoscopic image by maintaining the left eye image and deleting or discarding the right eye image. Further detail related to the conversion processes will be described below.
0056Turning now to <figref idref="DRAWINGS">FIG. 4</figref>, a block diagram of an embodiment of a display signal converter <b>400</b> using aspects of the present disclosure is shown. Display signal converter <b>400</b> is typically included as part of a signal receiving device, such as signal receiving device <b>300</b> described in <figref idref="DRAWINGS">FIG. 3</figref>, settop box <b>160</b> described in <figref idref="DRAWINGS">FIG. 1</figref>, or gateway head end device <b>255</b> and client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>described in. <figref idref="DRAWINGS">FIG. 2</figref>. Additionally, all, or a portion, of the display signal converter <b>400</b> may be included in one or more of the blocks described in <figref idref="DRAWINGS">FIG. 3</figref>, such as input stream processor <b>310</b>, base video processor <b>320</b>, display signal processor <b>340</b>, display interface <b>350</b>, and controller <b>360</b>. Display signal converter <b>400</b> includes some of the key elements used in a video display conversion process primarily for signals received in either a 2-D or 3-D signal format, converted into a base form, and then further converted into an appropriate or optimal display signal format for either a 2-D or 3-D display device. It is important to note that display signal converter <b>400</b> may be used for the video display conversion process for other signal formats and displays, including but not limited to 2-D formats for 3-D displays, 3-D formats for 2-D displays, as well as multi-view signal formats for multi-view displays and the like.
0057An input signal, containing video content in a video format is received by input processor <b>410</b>. Input processor <b>410</b> is connected to mode detector <b>420</b>, Mode detector <b>420</b> is connected to base decoder processor <b>430</b>. Base decoder processor <b>430</b> is connected to display signal processor <b>440</b>. Display signal processor <b>440</b> is connected to output processor <b>450</b>. Output processor <b>450</b> may provide an optimal or suitable display signal using an optimal or suitable display format for a video display device, such as display device <b>170</b> described in <figref idref="DRAWINGS">FIG. 1</figref> or similarly described in <figref idref="DRAWINGS">FIG. 2</figref>. Mode detector <b>420</b> is also connected to output processor <b>450</b> in order to permit a signal pass-through operation or mode. Screen characterization block <b>460</b> is connected to mode detector <b>420</b>, base decoder processor <b>430</b>, and display signal processor <b>440</b>. Screen characterization block <b>460</b> also receives inputs from other circuits (not shown), including, but not limited to a user input through a user interface, such as user interface <b>470</b> in <figref idref="DRAWINGS">FIG. 3</figref>, and device query results processed in a controller, such as controller <b>360</b> in <figref idref="DRAWINGS">FIG. 3</figref>.
0058The input signal may be received at input processor <b>410</b> as a single or multiple program stream video signal using a number of different signal formats, including, but not limited to, 2-D, stereoscopic high definition or standard definition temporally interleaved (2× stream), side by side, over/under, checkerboard, Sensio, 2-D+depth (or disparity) map, MVC (main and offset stream), SVC (main and enhancement stream), and other forms of multi-view content including beyond stereoscopic image content. In addition, the input signal may include format information containing particular frame rate and display resolution characteristics. Following some initial processing in input processor <b>410</b>, such as packet identification and signal timing and synchronization, mode detector <b>420</b> may determine the signal format. The signal format may be determined by decoding identification information in packet headers, separate signaling, a manual configuration set-up or by analysis based on the signal timing information. Mode detector <b>420</b> may provide the signal format property information to screen characterization block <b>460</b>.
0059Screen characterization block <b>460</b> may operate to determine and manage the signal conversion process in either a static or dynamic manner in order to define the best possible 3-D or other video experience for the display to which the device is connected. In one embodiment, screen characterization block <b>460</b> receives inputs, provided as information related to querying the display device, and user preference inputs. In another embodiment, the display format and display device characteristics are predetermined or preselected based on user inputs. These display format and device inputs are used in the display screen characterization process to determine first, the most appropriate or optimal base form for the conversion, and second, the most appropriate or optimal display output format for the conversion. The information related to the base form and display format are provided to base decoder processor <b>430</b> to initially decode the incoming signal and to convert the signal into a base form signal.
0060It is important to note that the optimal display format may be characterized based on several characteristics or terms including, but not limited to, the 3-D format best suited or matched to the display, optimal resolution, progressive or interlaced scan, image depth, color gamut, and the like.
0061As mentioned above, several possible base forms may be used. For instance, an input signal in a 2-D format may be stored as a 2-D format, with no conversion necessary as part of the base form decode element. Similarly an input in a multi-view format may be stored as a similar multi-view format. It is important to note that input signal formats may be characterized as a 2-D single frame image signal, a 3-D single frame image signal (e.g. checkerboard, over/under, side-by-side, line-interleaved, temporally interleaved, quincunx, anaglyph, or 2-D plus depth (or disparity) map, a 3-D two frame stereoscopic image signal, or a multi-view multi-frame image signal. Further, all of the above formats may be accompanied by additional occlusions or other additional data. Any of these formats may also be used as a base form. In one embodiment, most 3-D input formats (e.g. over/under, side-by-side, checkerboard, line interleaved, temporally interleaved, quincunx, 2-D+depth, stereoscopic MVC, etc) may be converted to a left-right eye stereoscopic format, having 2 images in the signal.
0062In addition, display resolution up-conversion may be performed in base decoder processor <b>430</b>, in order to make the base form the highest possible resolution signal. The re-scaling, or up-sampling, may use a resolution performance optimal algorithm that may not be reversible. However, based on inputs from the screen characterization block <b>460</b>, a less than optimal but reversible re-scaling algorithm may be used in order to accommodate various display device screen resolution possibilities. If the input format is deemed to also be the optimal output format, then no conversion of any form need take place and the mode detector <b>420</b> may be switched to provide the input signal content as is to the output processor <b>450</b>.
0063Base decoder processor <b>430</b> may also produce an on-the-fly 2-D to 3-D conversion of a received 2-D image format signal to create left and right views in a left-right stereoscopic 3-D image base form signal. 2-D to 3-D conversion typically requires significant signal processing and may be added as an optional processing block in the base decoder processer <b>420</b>. Information relating to 2-D to 3-D conversion will be described in further detail below. In a similar manner, the base decoder processor <b>430</b> may include a conversion for a 2-D input signal to a 2-D base form with different display characteristics, a multi-view input signal to either 2-D or 3-D image base form signal or a 2-D or 3-D to multi-view image base form signal.
0064Once a base form video signal is created through the base decoder processor <b>430</b>, the display signal processor <b>440</b> uses a second conversion process to provide an appropriate or optimal video display output signal for a display device. The information related to the display format, such information from screen characterization block <b>460</b>, is provided to the display signal processor <b>440</b> to convert the base form signal into a display signal. Based on results from a screen characterization performed in screen characterization block <b>460</b>, conversion processing of one or more base forms in the base form signal may be identified. These conversion steps may include converting from the base form (e.g. 2 image left-right stereoscopic format) to a single frame 3-D format (e.g. over/under, side-by-side, checkerboard) and may also include any display resolution or frame rate re-scaling that may be necessary for the display device. In addition, display signal processor <b>440</b> may include the conversion of a base form 3-D image into a 2-D image format signal for display on a conventional, or legacy, 2-D display device. In one embodiment, the conversion may include a left eye only view for display on the legacy display device. Further, display signal processor <b>440</b> may produce an on-the-fly display format signal to create a 3-D effect on a legacy 2-D display device. One popular technique includes an Anaglyph video processing of the 3-D video signal which would be created or generated on-the-fly. 3-D effect type video processing will be described in further detail below.
0065Display signal processor <b>440</b> may also include display resolution and frame rate conversion. As described above, the base form signal typically includes a base form that includes the highest possible resolution format and/or frame rate. Display signal processor <b>440</b> receives inputs through screen characterization block <b>460</b> that identifies the required display resolution and frame rate for the display device. Display signal processor <b>440</b> converts the base form signal to the required resolution and frame rate, including, if necessary, conversion from progressive scan to interlaced scan. Display signal processor <b>440</b> may use an optimal or a sub-optimal resolution conversion process depending on the identified input signal format, base form, and display device characteristics. Display signal processor <b>440</b> may include mechanisms to dynamically alter 3-D depth, color gamut or other parameters as required, in addition to, or in place of, the display resolution and frame rate conversion processing. Display signal processor <b>440</b> may also include processing for 3-D to 2-D down-conversion, as well as multi-view to 2-D or 3-D down-conversion.
0066The converted display signal from display signal processor <b>440</b> is provided to output processor <b>450</b>. Output processor <b>450</b> interfaces with the external display device in order make sure the output display signal is delivered to the display device. As described earlier, the output display signal may be in a 2-D format, a 3-D format as either a single frame or multi-frame format, or multi-view format, In one embodiment, output processor <b>450</b> may provide 2-D signals over an analog RGB interface in a standard 2-D format or in an anaglyph 3-D format to a 2-D display device (e.g. CRT, LCD, DLP, OLED). The anaglyph 3-D format may then be viewed using colorized lens glasses. In another embodiment, output processor <b>450</b> may provide single frame 3-D signals to a 3-D display device (e.g. LCD, DLP, OLED) over HDMI in side by side, over/under, line interleaved, temporally interleaved, checkerboard, quincunx, or other signal format. In most cases these single frame 3-D formats are processed to produce separate left-right images on the display device and are viewed using synchronized shutter lens glasses or polarized glasses. The single frame 3-D formats may also be displayed on an auto-stereoscopic display without glasses. Output processor <b>450</b> may also provide a dual stream 3-D signal that may include stereoscopic left and right eye views or may include signals with 2-D content and a depth or disparity map. Finally, output processor <b>450</b> may provide a multi-view signal over one or more digital video interfaces for display on an auto-stereoscopic or other display requiring greater than two views.
0067In addition to the conversion steps described, mode detector <b>420</b> also permits a signal pass through mode. In some instances, the conversion process may be undesirable or unnecessary and the input signal may simply be passed to the output for the display device. One possible use for a pass-through mode is a situation where the input signal format matches the most appropriate or optimal properties of the display device. For example, the input signal may be a 1080p checkerboard 3-D signal, and the display device may be a 1080p 3-D DLP display accepting checkerboard signals and utilizing polarized glasses technology. As a result, any processing or conversion would likely only be detrimental. The pass through mode may be controlled and invoked based on signal format and/or display device detection, or may be controlled and invoked based on user input. In another embodiment, the pass through mode may be used when the input signal is in a form that is not decodable by base decoder processor <b>430</b>, and may be passed directly to the output processor <b>450</b> and to the display device for further signal decoding and display. One such example may be for future multi-view formats that don't exist today, but may be both supported by screens or display devices, as well as transmitted, in the future. The process may be similar to the introduction of digital theater systems (DTS) sound for the DVD, where players may not necessarily decode the stream, but may pass the stream through directly to a receiving device.
0068It should be understood that one aspect of the conversion circuitry described in <figref idref="DRAWINGS">FIG. 4</figref> is the flexibility of extending the process to multi-view signals and systems. For instance, a similar process may be used to receive a signal as a 3-D signal, convert to a base form (e.g. left-right eye stereoscopic format), and process the base form to generate multiple views suitable for use on multi-view auto-stereoscopic display that could, for example, require significantly more than two views. Additionally, a similar process may be used to receive a signal in a multi-view signal format with greater than two views, convert the signal to a base format suitable for stereoscopic 3-D viewing (e.g. left-right eye format) then process the base form to generate a signal (e.g. a checkerboard 1080p signal) for use on a 3-D DLP display. The same multi-view input signal may also be converted to generate a 1080p 2-D signal for use on a legacy high definition television device.
0069As described above, another aspect of the conversion circuitry described in <figref idref="DRAWINGS">FIG. 4</figref> is the capability to perform on-the-fly conversion from a 2-D source to a 3-D or multi-view source with greater than two views. In this instance, an additional step would be required in the processing to generate a 3-D or multi-view base form from the 2-D content. There are a number of known mechanisms for achieving this, and on-the-fly 2-D to 3-D conversion capability exists in some 3-D TVs in the market today.
0070Also as described above, the display signal processor <b>440</b> may support creating 3-D content for use on existing 2-D displays. One popular technique for this is the anaglyph technique. The anaglyph technique is one type of stereogram imaging technique and has remained popular for video content presentation due to its low cost and compatibility with existing equipment. The anaglyph technique involves creating two images that are made up of two different color layers that are superimposed at a slight offset. The resultant video signal is displayed on the 2-D display but viewed through a set of anaglyph filter glasses, with each eyepiece using a different colored filter. As a result, each eye sees an apparently different image resulting in the creation of depth in the image. The quality of the 3-D effect may be improved by further processing the image based on specific image parameters such as contrast in the images, presence of shadows, and varying offset distance for the objects in the image.
0071Several other techniques may be used to create a 3-D image from a 2-2-D image. For instance, a particularly useful approach, that may replace or augment the approach discussed above, involves determining the depth of an object in the image by using a series of frames of image content. Such an approach is particularly useful for video content and allows the depth of the image to be determined using cues provided by the change of position of the image or shadows around the image across several frames of video. The display processor <b>340</b> described in <figref idref="DRAWINGS">FIG. 3</figref>, as well as the base decoder processor <b>430</b>, or similar signal processing element may be capable of converting a 2-D image using either of these techniques described here, or others, including combinations of the techniques to generate 2-D to 3-D on the fly conversion.
0072The conversion process described for base decoder processor <b>430</b> may also include decompression and decoding of the image information in a frame of the video signal. The decompression and decoding steps may include the steps necessary to process a signal in the format established under the Motion Picture Entertainment Group (MPEG) standard MPEG-4, and included under MVC. The standard currently supports 3-D through a compression algorithm applied to both left eye and right eye view and sent as primary and secondary views. The standard also supports 3-D graphics menu navigation and subtitle or graphic overlay positioning within the 3-D video. The conversion process may convert an input signal in an MVC format to a base form in a two image left-right stereoscopic pair image format by decompressing and decoding the signal and, if necessary re-scaling the resolution of the signal. The conversion process may also convert a base form two image left-right stereoscopic pair image to an MVC format display signal by encoding and compressing the base form into a two image MVC format signal prior to providing the signal to the display device.
0073In addition to converting the incoming video signal to an appropriate or optimal format display output signal, the base decoder processor <b>430</b> and display signal processor <b>440</b> in <figref idref="DRAWINGS">FIG. 4</figref> or similarly, base video processor <b>320</b> and display processor <b>340</b> in <figref idref="DRAWINGS">FIG. 3</figref> may include the capability to process subtitles and graphics overlays in either 2-D or 3-D. In general, if the subtitle or graphic information is provided as part of the input stream, then the input stream processing (e.g. mode detector <b>420</b> in <figref idref="DRAWINGS">FIG. 4</figref> or input stream processor <b>310</b> in <figref idref="DRAWINGS">FIG. 3</figref>) identifies the subtitle information, and provides the information to a memory (e.g. video memory <b>355</b> in <figref idref="DRAWINGS">FIG. 3</figref>) for eventual reincorporation with the display output signal (e.g. in the display signal processor <b>440</b> of <figref idref="DRAWINGS">FIG. 4</figref>, or display processor <b>340</b> of <figref idref="DRAWINGS">FIG. 3</figref>). In this way, the subtitle or graphics information is not altered as part of the base form processing in either base decoder processor <b>430</b> in <figref idref="DRAWINGS">FIG. 4</figref> or base video processor <b>330</b> in <figref idref="DRAWINGS">FIG. 3</figref>, and is not subject to an undesired repositioning, or elimination during the conversion process. It is important to note that the same mechanisms for subtitle or graphic information apply for any graphics or user interface elements generated on the local device. These elements can be created in a normal 2-D form and provide to the output processor <b>450</b> to be formatted to match the output format to the display. In this way, even if the video is being passed through, the graphic overlays can be appropriately formatted to match the required output format.
0074Turning now to <figref idref="DRAWINGS">FIG. 5</figref>, a flow chart illustrating a process <b>500</b> for signal conversion of a received signal into an appropriate video display signal according to certain aspects of the present disclosure is shown. For purposes of example and explanation, the steps of process <b>500</b> will be described primarily with reference to signal receiving device <b>300</b> in <figref idref="DRAWINGS">FIG. 3</figref>. The steps of process <b>500</b> may similarly be carried out as part of a process associated with a signal converter circuit, such as display signal converter <b>400</b> described in <figref idref="DRAWINGS">FIG. 4</figref>. The steps of process <b>500</b> may also be included in the operation of a signal receiver, such as settop box <b>160</b> described in <figref idref="DRAWINGS">FIG. 1</figref> or gateway head end device <b>255</b> and client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>described in <figref idref="DRAWINGS">FIG. 2</figref>. The steps of process <b>500</b> are exemplary only, and are not intended to limit the present disclosure in any manner.
0075At step <b>510</b>, a signal, including video content, such as content in the form of one or more video programs or streams, is received. Step <b>510</b> may be carried out in input signal receiver <b>305</b> or further in input stream processor <b>310</b> and may include tuning, demodulating, decoding, or separating the video content or video streams in the received input signal. Next, at step <b>520</b>, one or more parameters associated with, or related to, the received video signal are determined. The determination in step <b>520</b> may be carried out in input stream processor <b>310</b> as well as in controller <b>360</b>. Step <b>520</b> may include detecting parameters associated with the received signal, such as the signal format, signal scan resolution, or any of the other parameters described earlier. The parameters may be determined in step <b>520</b> as part of the input signal reception, other external inputs, or may be part of a user determination through a user interface.
0076Next, at step <b>530</b>, one or more parameters associated with, or related to, the display device and its display modes and inputs are determined. The determination in step <b>530</b> may be carried out in display interface <b>350</b> as well as in controller <b>360</b>. Step <b>530</b> may include detecting parameters associated with the display device, such as the display input format, display output mode or technology, display scan type and resolution, screen size used for appropriate depth or disparity mapping of 3-D material, or any of the other parameters described earlier. The parameters determined in step <b>530</b> may be detected as part of the input signal reception, part of the display interface communications, part of other external means such as a database lookup, or may be part of a user determination through a user interface.
0077At step <b>540</b>, based on the one or more parameters determined in step <b>520</b> and the one or more parameters determined in step <b>530</b>, the received input signal is converted from an original received format to a first, intermediate, or base form format signal. The base form format may be a 2-D format, a 3-D format, or a multi-view format and is primarily chosen to facilitate a further conversion based on the display parameters determined in step <b>530</b>.
0078As described above, a left-right stereoscopic format base form may be chosen for allowing ease of further conversion between various formats. For instance, the left-right stereoscopic format permits conversion between various 3-D formats for the input signal into other various 3-D formats for the display device. Further, the left-right stereoscopic format permits conversion of a 2-D input format to a 3-D output as well as a 3-D input format to a 2-D or 3-D output for use with a 2-D display. The left-right stereoscopic format also permits conversion of multi-view input formats into signal formats for either 2-D or 3-D display devices and vice versa.
0079The conversion at step <b>540</b> is primarily carried out in base video processor <b>320</b>. It is important to note that in some cases no conversion in step <b>540</b> may be carried out and the base form may be the same as the received signal. Additionally, the conversion at step <b>540</b> may include the conversion to more than one base form. The conversion at step <b>540</b> may also include any additional scan or resolution conversion processing and 2-D to 3-D conversion processing as described earlier. Further details of the base form conversion process will be described below.
0080Next, at step <b>550</b>, the intermediate or base form signal, including one or a plurality of base forms from the conversion at step <b>540</b>, is stored. The storage of the signal may be carried out in video memory <b>355</b>. It is important to note that video memory <b>355</b> may include a single memory device or may include multiple memory devices coupled together to operate in unison. Video memory <b>355</b> may include a static or dynamic memory and may also include a hard disk drive or other optical or electrical storage capability.
0081At step <b>560</b>, based on the one or more parameters determined in step <b>530</b>, the intermediate or base form signal is retrieved, or otherwise received, and converted from a base form format to a display signal format. The display signal format may be a 2-D format, a 3-D format, or a multi-view format and is primarily chosen to provide an optimal output display signal for the display device. The conversion at step <b>560</b> is primarily carried out in display processor <b>340</b>.
0082It is important to note that in some cases no conversion in step <b>560</b> may be carried out and the display signal format may be the same as the received signal, resulting in a pass through operating mode. The conversion at step <b>560</b> may also include any additional scan or resolution conversion processing as described earlier. The conversion at step <b>560</b> may further include 2-D to 3-D, 3-D to 2-D, or multi-view conversion processing as described earlier. Further details of the display signal conversion process will be described below. At step <b>570</b>, the display signal resulting from a first conversion from the received signal format to an intermediate or base form signal format and from an intermediate or base form signal format to an appropriate, optimal, or desired display signal format is provided to the display device for display.
0083Turning now to <figref idref="DRAWINGS">FIG. 6</figref>, a flow chart of a base form or intermediate signal conversion process <b>600</b> for a video signal according to aspects of the present disclosure is shown. Process <b>600</b> involves taking the received video stream or program in the input form received and converting it to a neutral format available for further conversion to the required, desired, or optimal output format. The steps in process <b>600</b> are generally carried out as part of the base form conversion process described at step <b>540</b> in <figref idref="DRAWINGS">FIG. 5</figref>. The steps in process <b>600</b> may be primarily carried out in a signal conversion device such as base video processor <b>320</b> in <figref idref="DRAWINGS">FIG. 3</figref> or base form decoder processor <b>420</b> in <figref idref="DRAWINGS">FIG. 4</figref>. Additionally, some of the steps may be carried out in other blocks, such as the controller <b>360</b> in <figref idref="DRAWINGS">FIG. 3</figref> or screen characterization block <b>460</b> in <figref idref="DRAWINGS">FIG. 4</figref>.
0084Process <b>600</b> includes a series of determination steps in order to identify and provide the most appropriate base form conversion of the input signal for use in a subsequent display signal conversion based on the received input signal format type and the optimal output video signal format type for the display device. It is important to note that not all steps may necessarily be carried out and certain steps may be omitted or combined based on a particular embodiment as well as the performance parameters of the process, the signal receiving device, or the display device.
0085First, at step <b>602</b>, an incoming video signal stream or program is received. Next, at step <b>604</b>, the parameters associated with the input signal as well as the parameters associated with the display device are determined and retrieved. At step <b>606</b>, a determination is made as to whether a pass through mode is used. If, at step <b>606</b>, a pass through mode is used, then the input stream type and output stream type match and there is no need to process the stream. The process proceeds to step <b>640</b>, where the incoming video signal stream may be passed through or stored. As described above, pass-through mode bypasses the conversion process and stores, or establishes the input signal format as the base form.
0086If, at step <b>606</b>, pass through mode is not utilized, then a series of determinations follow based on the determination of the signal format and display device. Certain steps, such as steps <b>608</b>, <b>614</b>, <b>620</b>, <b>622</b>, and <b>626</b> relate to the parameters for the input signal format while other steps, such as steps <b>610</b>, <b>616</b>, <b>630</b>, and <b>634</b> relate primarily to the parameters associated with the display device output. At step <b>608</b>, a determination is made as to whether the input is a 2-D signal input. If, at step <b>608</b>, the input format of the stream is in 2-D only, then at step <b>610</b>, a further determination is made as to whether a 3-D output mode may be desired. If at step <b>610</b>, a 3-D output mode is desired, then at step <b>612</b>, the signal is converted from 2-D to 3-D prior to any further base form conversion. The conversion of 2-D to 3-D may be carried out in several possible manners including one of the processes described earlier. It is important to note that the signal format following the 2-D to 3-D conversion may be two image stereoscopic (L/R Eye) format or a multi-view format. The process proceeds, after step <b>612</b>, to step <b>630</b>, described below. If, at step <b>610</b>, a 3-D output is not desired, the process continues directly to step <b>630</b>.
0087If, at step <b>608</b>, the input signal is not a 2-D format, then, at step <b>614</b>, a determination is made as to whether the input signal is a multi-view signal format input. If, at step <b>614</b>, the input format is a multi-view (i.e. >2 views) format, then at step <b>616</b>, a further determination is made as to whether more than two views may be desired as an output. If, at step <b>614</b>, only two views are desired, for instance, as part of a desired or optimal 3-D display, then, at step <b>618</b>, an appropriate left-right view set is chosen from the multiple views present in the received signal. The process proceeds, after step <b>618</b>, to step <b>630</b>, described below. If, at step <b>616</b>, a 3-D output is not desired, the process continues directly to step <b>630</b>.
0088If, at step <b>614</b>, the input signal is not a multi-view format, then, at step <b>620</b>, a determination is made as to whether the input is a 3-D signal input provided in a single frame interlaced scan format. If, at step <b>620</b>, the received signal is in an interlaced 3-D format, then at step <b>622</b>, the signal may be scan converted or de-interlaced to create a progressive scan 3-D format signal before further processing. It is important to note that if the original input signal was provided in an anaglyph input format, additional processing is likely needed in step <b>638</b>, described below, to reverse the anaglyph process and generate the best possible quality 3-D stereoscopic image. The process proceeds, after step <b>622</b>, to step <b>630</b>, described below.
0089If, at step <b>620</b>, the input signal is not a 3-D single frame interlaced signal, then, at step <b>624</b>, a determination is made as to whether the input is a 3-D signal input provided in a progressive frame scan format. If, at step <b>624</b>, the input format is a 3-D non-interlaced, or progressive, scan single frame format (e.g. checkerboard, side by side, over/under, or anaglyph), the input signal may then pass to step <b>630</b> for further processing to create a base form format signal optimal for generating the required output format. As described above for an interlaced input signal at step <b>620</b>, if the original signal was provided in an Anaglyph input format, additional processing is likely needed in step <b>638</b> to reverse the anaglyph process and generate the best possible quality 3-D stereoscopic image.
0090As described above, during process <b>600</b>, content may be de-interlaced, converted, and/or up-sampled/re-scaled, in order to create the highest possible quality progressive scan signal as required. The resolution re-scaling may be optimal, or suboptimal and reversible. It is important to note that a scan conversion, or de-interlacing, step is shown with respect to a single frame 3-D image signal, such as checkerboard, over/under, side-by-side, or anaglyph format signal. Although not explicitly shown, this scan conversion step may also be used in conjunction with processing either 2-D or multi-view format input signals.
0091It is important to note that resolution conversion and re-scaling is necessary particularly for single frame 3-D formats, such as over/under, side-by-side, line interleaved, or checkerboard formats, and additionally for anaglyph formats if required. Each of these formats may start with a reduced resolution in either the vertical or horizontal direction or in color resolution in order to squeeze the two images into a single frame video content. The resolution conversion and re-scaling allows for the creation, storage, and use of the cleanest base form (e.g left-right eye stereoscopic 3-D image base form) possible. In these cases, information related to the capabilities of the input format for the display device is also important in determining the proper conversion steps to base form. For instance, a fully or partially reversible resolution re-scaling may be used to convert an over/under input signal format for display on a higher resolution television also requiring an over/under signal format for 3-D display.
0092If, at step <b>624</b>, the input signal is not a 3-D progressive format signal, then, at step <b>626</b>, a determination is made as to whether the input is in the form of a 2-D image signal including additional depth or disparity map information. lf, at step <b>626</b>, the format includes 2-D image data plus the depth or disparity map, then the process proceeds to step <b>630</b> in a manner similar to that described above. At step <b>630</b>, a determination is made as to the type of output format desired. If, at step <b>630</b>, any form of 3-D rendering, creation, or generation is desired, appropriate, or optimal, then the 2-D plus depth or disparity map format is decoded, at step <b>638</b>, to a 3-D stereo form. It is important to note that the depth or disparity information may also be stored as the base form, in order to allow for an alternate conversion process to a 3-D output type signal for display on a 2-D display using anaglyph or other conversion processing.
0093If, at step <b>626</b>, the input signal is not a 2-D format including a depth or disparity map, then, at step <b>628</b>, a determination is made as to whether the input is in the form of a 3-D stereoscopic image signal. If, at step <b>628</b>, the format includes a 3-D stereoscopic image, no further processing is necessary and the process proceeds to step <b>630</b> for the additional determination steps associated with the output display characteristics.
0094As described above, the display of 3-D content on a 2-D display requires additional processing to create the 3-D effect within the 2-D signal for the 2-D display. The processing may require identification of depth information, and the storage of the depth or disparity map in addition to the stereoscopic images as part of the base form may be more useful than the rendered stereoscopic images alone. If the input signal format is already a two image left-right stereoscopic format, then only a re-scaling is needed prior to storing as a base form, though for an anaglyph output, depth may need to be calculated as part of the processing. Finally, unless the input signal format is already providing a two image left-right stereoscopic format at the highest required resolution, frame rate, etc, then all other formats are first converted to a two image left-right stereoscopic format and re-scaled to the highest frame rate and resolution required by the display before storing as the base form.
0095If, at step <b>628</b> and after passing through all other determining steps, no affirmative identified determination is found, the input format is not a 3-D stereoscopic image format signal, then the input format is not identifiable or known. As with the pass-through mode described at step <b>606</b>, the received data is passed directly and/or stored in its native received format at step <b>640</b>.
0096Following the determination and processing outputs from steps <b>610</b>, <b>612</b>, <b>616</b>, <b>618</b>, <b>622</b>, <b>624</b>, <b>626</b>, and <b>628</b>, and as described above, at step <b>630</b> a further determination is made as to whether the display output mode is 2-D for display on a 2-D, 3-D or multi-view display. If, at step <b>630</b>, the display output is a 2-D type format or mode, then, at step <b>632</b>, the image is converted to a 2-D base form image as necessary. In addition, at step <b>632</b>, the image may be scaled/up converted prior to storing as a base form at step <b>640</b>.
0097If, at step <b>630</b>, the display output is not 2-D, then another determination is made, at step <b>634</b>, as to whether the display output is multi-view. If, at step <b>634</b>, the display output is a multi-view format or mode, then, as in step <b>632</b>, then at step <b>636</b>, the signal is converted, if necessary, to a multi-view base format. In addition, at step <b>636</b>, the signal may be scaled/up converted prior to storing as a base form at step <b>640</b>.
0098If at step <b>634</b>, the display is not multi-view (and it is also not 2-D from step <b>630</b>), then, at step <b>638</b>, the signal is converted, if necessary, to a 3-D base form format. As described above, an appropriate base form format is a stereoscopic left and right eye view signal format. As in step <b>632</b> and step <b>636</b>, step <b>638</b> may include scaling/up converting the signal prior to storing as a base form at step <b>640</b> or passing on for additional processing and conversion.
0099It is important to note that certain steps in process <b>600</b> may not be necessary for some combinations of input signal format and display device output format. For instance, an input signal in a stereoscopic left and right image format may pass through at step <b>628</b> and also pass through steps <b>630</b>, <b>634</b>, and <b>638</b> to the storage step without any conversion or scaling. A similar situation may also occur for some 2-D and multi-view format input signals. Process <b>600</b> may be modified to include several possible iterations that may result in the creation, storage, and provisioning of multiple base form format signals. The information regarding the stored and available base form formats may be fed back through the system to ensure that the most appropriate images are used in a later display format conversion process to create the desired, appropriate, or optimal video display output signal for the display device.
0100Turning now to <figref idref="DRAWINGS">FIG. 7</figref>, a flow chart of an embodiment of a display format conversion process <b>700</b> according to aspects of the present disclosure is shown. Process <b>700</b> describes the conversion of the base form signal, as described in <figref idref="DRAWINGS">FIG. 6</figref>, into one or more desired or required output display signal formats. The steps in process <b>700</b> may be primarily carried out in a display processor, such as display processor <b>340</b> described in <figref idref="DRAWINGS">FIG. 3</figref>. The steps in process <b>700</b> may alternatively be carried out in display signal processor <b>440</b> and screen characterization block <b>460</b> in <figref idref="DRAWINGS">FIG. 4</figref>. Additionally, some of the steps may be carried out in other blocks, such as the controller <b>360</b> in <figref idref="DRAWINGS">FIG. 3</figref> or screen characterization block <b>460</b> in <figref idref="DRAWINGS">FIG. 4</figref>.
0101Like process <b>600</b> described in <figref idref="DRAWINGS">FIG. 6</figref>, process <b>700</b> involves a series of decision steps based on a set of identified parameters or characteristics of the received signal and the display device in order to provide the most appropriate display format conversion for the signal that will be provided to the display device. Primarily, process <b>700</b> may involve identifying, determining, and retrieving the base form signal generated and, in some cases stored, as a result of process <b>600</b> before it is processed and provided to the display device. As with process <b>600</b>, an unknown or unprocessed stream may be passed directly to the display device. if further processing is needed, such as changing the base form for a certain display mode or scaling and conversion, the processing may be done to generate the appropriate 2-D, 3-D or multi-view format signal.
0102Process <b>700</b> begins at step <b>702</b> with determining, identifying, and/or retrieving information associated with the display type and optimal output format mode for the display device. As described above, the determination may include determining the capabilities of the display device. Step <b>702</b> may further determine an appropriate display format. The determination may be, possibly user input driven, externally determined or conversion device driven. A conversion device driven determination may also result in an optimal display format. In addition, information related to the display mode or viewing technology (e.g. shutter lens, polarizer) may be determined,
0103Next, at step <b>704</b>, based on the determination in step <b>702</b>, the base form created in process <b>600</b> is retrieved or accessed. The base form may be a 2-D, 3-D, or multi-view format. For example, the base form may be a 3-D stereoscopic left eye and right eye format signal. It is important to note that the base form signal may contain more than one base form format. If multiple base forms are available and used, the determination steps in process <b>700</b> may select the needed base form from the multiple base form format signal.
0104At step <b>706</b>, a determination is made as to whether pass-through mode will be used. If, at step <b>706</b>, based on the determination that the signal format is a proprietary format or an unknown format, pass through mode is used, then the process proceeds to step <b>726</b>, described further below.
0105If, at step <b>706</b>, pass through mode is not used, then at step <b>708</b>, a determination is made as to whether multi-view display type is desired. If, at step <b>708</b>, a multi-view base form is desired, then at step <b>710</b>, a further determination is made as to whether a multi-view base form was used or is available. If, at step <b>710</b>, a multi-view base form is used or available, then the process continues as step <b>726</b>. If, at step <b>710</b>, a multi-view base form is not available, then at step <b>712</b>, a multi-view display format signal is generated using a 3-D base form. It is important to note that standards for delivery of multi-view signals to displays are not yet established, and, as a result, additional processing may be required in order to adapt the available 3-D base form to support the delivery of the multi-view signal to the display. In one embodiment, additional up-sampling or processing of the signal as well identification and control signaling may be performed at step <b>712</b> before proceeding to step <b>726</b>.
0106If, at step <b>708</b>, a multi-view display type is not used, then, at step <b>714</b>, a determination is made as to whether 2-D display type is used. In general, 2-D displays are well known and standardized and do not involve any unusual display signal format identification and configuration. If, at step <b>714</b>, a 2-D display is used, then at step <b>716</b>, a further determination is made as to whether a 3-D display mode is required on the 2-D display. If at step <b>716</b>, a 3-D display mode is to be used, then at step <b>718</b>, a 3-D conversion process is performed based on the 3-D base form available. As described above, the display of a 3-D image on a 2-D display involves a 3-D conversion process, such as an anaglyph process, typically involving the generation of a red/blue
0107Anaglyph or colorcode anaglyph signal for display on a 2-D display device and viewed using colorized lens glasses.
0108If at step <b>716</b>, a 3-D display mode is not used or required on a 2-D display, then at step <b>720</b>, the 2-D base form created as a result of process <b>600</b> is passed through and the process continues at step <b>726</b>. It is important to note that based on the stored or created base form from process <b>600</b>, the appropriate 2-D base form may be generated from a 3-D base form. For example, if a left-right stereoscopic format is the base form that was stored, then the left image is selected as the 2-D image base form. Additionally, a 2-D image base form, with or without an additional depth or disparity map that is stored as a base form, may be used directly, with only the depth or disparity map information discarded.
0109If, at step <b>714</b>, the display type is not 2-D display (and is not a multi-view display type from step <b>710</b>), then a 3-D display type is used and at step <b>722</b>, a further determination as to whether a 2-D display mode will be used on the 3-D display. If, at step <b>722</b>, a 2-D display mode will be used, then at step <b>720</b>, the 2-D base form is passed to step <b>726</b>, as described above. lf, at step <b>722</b>, a 2-D display mode is not required, then, at step <b>724</b>, the 3-D base form is used to generate an optimal or appropriate 3-D display signal for the display device. At step <b>724</b>, the 3-D base form for the signal may be converted into an appropriate single frame display format (e.g. over/under, side-by-side, interleaved, or checkerboard format).
0110Next, at step <b>726</b>, the retrieved and converted base form signal from step <b>706</b>, step <b>710</b>, step <b>712</b>, step <b>718</b>, step <b>720</b>, or step <b>724</b> is scaled and converted for the proper or appropriate display device screen parameters and resolution. The scaling and conversion, such as image re-scaling for resolution or frame rate at step <b>726</b> may be necessary based on the differences between the base form and the desired display format. As was noted above, if a reversible (i.e. suboptimal) resolution scaling algorithm was used in process <b>600</b>, the conversion should include the reverse resolution scaling process. Finally, at step <b>728</b>, the scaled and converted signal, now in an appropriate display signal format, is provided to the display device,
0111It is important to note that process <b>6500</b> described in <figref idref="DRAWINGS">FIG. 6</figref> and process <b>700</b> described in <figref idref="DRAWINGS">FIG. 7</figref> may or may not be performed within the same device. For instance, process <b>600</b> may be included as part of a content generation device, such as local content source <b>180</b> described in <figref idref="DRAWINGS">FIG. 1</figref> or similarly described in <figref idref="DRAWINGS">FIG. 2</figref>. Further, process <b>700</b> may be included as part of a display device such as display device <b>170</b> described in <figref idref="DRAWINGS">FIG. 1</figref> or similarly described in <figref idref="DRAWINGS">FIG. 2</figref>. In this particular example, a separate settop box may not be necessary or included as part of the system. In another example, process <b>600</b> may also be included as part of gateway head end device <b>255</b> described in <figref idref="DRAWINGS">FIG. 2</figref>. Process <b>700</b> may be included as part of each of client devices <b>265</b><i>a</i>-<b>265</b><i>n </i>described in <figref idref="DRAWINGS">FIG. 2</figref>.
0112As described above, one of the important aspects associated with the characterization and the operation of controller <b>360</b> described in FIG, <b>3</b> or screen characterization device <b>460</b> described in <figref idref="DRAWINGS">FIG. 4</figref> relates to identifying available display modes for the display device, and also choosing the appropriate or optimal format for the signal to the display device. The operation involves first identifying what the display device is capable of. The operation may involve direct queries of the device over a communications bus such as an HDMI back channel. However, the information available or provided over HDMI may vary in degree of relevance, and may depend on the version of HDMI utilized, For instance, early HDMI standard devices may provide much less information related to the display resolution and capabilities than may be obtained from HDMI 1.4 or later. As an alternative, or as a complement, a user interface menu may be created. The user interface menu may first inquire as to the device model being used, and provide assistance in identification. The user may further be presented with a series of test patterns, utilizing various display formats and technologies as described above in order to determine the optimal settings for the display. The test patterns may be stored in a memory in the conversion device (e.g. settop box).
0113As part of the user interface menu as described here, the user may not only identify the capability of the display device, the user may also be able to select appropriate or optimal display formats. Based on these selections, the controller or screen characterization may further select the most appropriate base form for conversion of the input signal and display signal format for providing to the display device. As a result, the system can provide a seamless user friendly method to allow any type of display, including legacy type displays, to show advanced content, such as 3-D content, in the best manner possible.
0114The present embodiments describe a system and method for providing optimal display of video content. The embodiments are directed at identifying the format of an incoming video signal stream, converting the stream to a base format, and then processing the base format to generate a display signal suitable for a particular display device. In particular, the typical embodiments convert incoming 3-D content into a 2-image left-right stereoscopic image signal as a base 3-D form. The embodiments also perform additional processing necessary to handle both 2-D input signal video content and 2-D displays. The embodiments are flexible and easily extended to use in multi-view environment. The embodiments address the growing problems associated with delivering multiple formats of video content by including a conversion device between the received input signal and the display device. As a result, video content may be produced in any particular format chosen by the content provider and video content may still be effectively displayed on a broad range of display devices using various display technologies. In addition, the embodiments recognize a mechanism between the display and HDMI interface defining supported and preferred 3-D (or other) formats (if any), along with other mechanisms to automatically determine or look up optimal settings for a particular display, and a mechanism to manually define these aspects, or a combination thereof.
0115The present disclosure provides a mechanism to support a variety of display screens and display types with an optimally formatted display signal. Implementing the embodiments described above, including the signal processing and control blocks creates a flexible architecture for implementation. For instance, the embodiments may also be used to simultaneously support a range of existing and future display formats by storing either multiple base forms or multiple signal display formats that can further be combined or de-muxed to produce one or more image streams at the output. In this way, the described embodiments could generate an anaglyph on the fly from the stereo base format for one display device and/or generate a 120 Hz Interlaced 3-D format for another display device. Additionally, more efficient use of the communications bandwidth over the delivery networks described in <figref idref="DRAWINGS">FIG. 1</figref> and <figref idref="DRAWINGS">FIG. 2</figref> may be achieved by providing the 3-D content in as an efficient form as possible while ultimately delivering a full-resolution left-right stereoscopic image to the end device that supports it.
0116The disclosed embodiments are directed at a system and method for providing optimal display of video content. More specifically, the embodiments are directed at signal processing that detects or determines the supported and preferred 2-D, 3-D, or multi-view formats of a display device, along with the modes or technology available, and uses this information to process and convert the received 2-D, 3-D, or multi-view content such that the signal processor provides the content in format that is both appropriate and optimal for the display and the user's requirements.
0117While the embodiments may be susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and have been described in detail herein. However, it should be understood that the disclosure is not intended to be limited to the particular forms disclosed. Rather, the disclosure is to cover all modifications, equivalents and alternatives falling within the scope of the disclosure as defined by the following appended claims.
Contents6
8 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US9445070B2 | Cited by | United States of America | Search report |
| US8558876B2 | Cited by | United States of America | Search report |
| US2013093846A1 | Cited by | United States of America | Pre-grant |
| US2013169764A1 | Cited by | United States of America | Pre-grant |
| US2015262323A1 | Cited by | United States of America | Pre-grant |
| US2016259453A1 | Cited by | United States of America | Pre-grant |
| US9883172B2 | Cited by | United States of America | Search report |
| US2011193860A1 | Cited by | United States of America | Pre-grant |
| US2013314507A1 | Cited by | United States of America | Pre-grant |
| US2015286740A1 | Cited by | United States of America | Search report |
| US11648474B2 | Cited by | United States of America | Search report |
| US2015262323A1 | Cited by | United States of America | Search report |
| US9251764B2 | Cited by | United States of America | Search report |
| US2012229498A1 | Cited by | United States of America | Pre-grant |
| US2021006768A1 | Cited by | United States of America | Search report |
| US9509976B2 | Cited by | United States of America | Search report |
| TWI629086B | Cited by | Taiwan Province of China | Examiner |
| US9055281B2 | Cited by | United States of America | Search report |
| US2014376880A1 | Cited by | United States of America | Pre-grant |
| US2017055027A1 | Cited by | United States of America | Pre-grant |
| US11659223B2 | Cited by | United States of America | Applicant |
| US2013083164A1 | Cited by | United States of America | Pre-grant |
| US9412330B2 | Cited by | United States of America | Search report |
| US2014340494A1 | Cited by | United States of America | Pre-grant |
| US2017104975A1 | Cited by | United States of America | Pre-grant |
| US9398289B2 | Cited by | United States of America | Search report |
| US11303846B2 | Cited by | United States of America | Search report |
| US9848179B2 | Cited by | United States of America | Search report |
| US2012236949A1 | Cited by | United States of America | Pre-grant |
| US2012249872A1 | Cited by | United States of America | Pre-grant |
| US10230933B2 | Cited by | United States of America | Search report |
| US2015262323A1 | Cited by | United States of America | Search report |
| US2011285818A1 | Cited by | United States of America | Pre-grant |
| US9787937B1 | Cited by | United States of America | Search report |
| WO2016144820A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9560336B2 | Cited by | United States of America | Search report |
| US2017161941A1 | Cited by | United States of America | Pre-grant |
| US11593453B2 | Cited by | United States of America | Search report |
| US2021322874A1 | Cited by | United States of America | Search report |
| US2015054915A1 | Cited by | United States of America | Pre-grant |
| US9532026B2 | Cited by | United States of America | Search report |
| US10965974B2 | Cited by | United States of America | Search report |
| US2014300697A1 | Cited by | United States of America | Pre-grant |
| US2013002821A1 | Cited by | United States of America | Pre-grant |
| US2003128273A1 | Cites | United States of America | Pre-grant |
| US2008285863A1 | Cites | United States of America | Pre-grant |
| US2010060719A1 | Cites | United States of America | Pre-grant |
| US2010165081A1 | Cites | United States of America | Pre-grant |
| US2011052142A1 | Cites | United States of America | Pre-grant |
9 members in 7 offices
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 29291610 | United States of America | P | |
| 29291610 | United States of America | P | |
| 2010037060 | United States of America | W | |
| 2010037060 | United States of America | W | |
| 201013515385 | United States of America | A | |
| 61292916 | – | – | – |
| PCTUS2010037060 | – | – | – |
| US20100292916P | – | – | – |
| US201013515385 | – | – | – |
| WO2010US37060 | – | – | – |
Members9
| Document | Office | Kind | |
|---|---|---|---|
| WO2011084169A1 | World Intellectual Property Organization (WIPO) | A1 | |
| CN102696230A | China | A | |
| US2012249736A1 | United States of America | A1 | |
| EP2522148A1 | European Patent Office (EPO) | A1 | |
| KR20120125246A | Republic of Korea | A | |
| JP2013516892A | Japan | A | |
| US9185383B2 | United States of America | B2 | |
| JP5890318B2 | Japan | B2 | |
| BR112012016544A2 | Brazil | A2 |
69 transactions on the USPTO file
Allowed after 1 non-final rejection, 1 final rejection and 1 RCE.
- Non-final rejections
- 1
- Final rejections
- 1
- RCEs
- 1
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Payment of Maintenance Fee, 4th Year, Large EntityM1551 | M1551 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Printer Rush- No mailingTCPB | TCPB | |
| Printer Rush- No mailingTCPB | TCPB | |
| Pubs Case Remand to TCPUBTC | PUBTC | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Amendment after Notice of Allowance (Rule 312)AllowedA.NA | A.NA | |
| Amendment after Notice of Allowance (Rule 312)AllowedA.NA | A.NA | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Mail Interview Summary - Applicant Initiated - TelephonicMEXAT | MEXAT | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Interview Summary- Applicant InitiatedEXIA | EXIA | |
| Interview Summary - Applicant Initiated - TelephonicEXAT | EXAT | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Mail Interview Summary - Applicant Initiated - TelephonicMEXAT | MEXAT | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Interview Summary- Applicant InitiatedEXIA | EXIA | |
| Interview Summary - Applicant Initiated - TelephonicEXAT | EXAT | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Email NotificationEML_NTR | EML_NTR | |
| Email NotificationEML_NTR | EML_NTR | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Notice of DO/EO Acceptance MailedM903 | M903 | |
| Sent to Classification ContractorPGPC | PGPC | |
| Preliminary AmendmentA.PE | A.PE | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| 371 Completion Date371COMP | 371COMP | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Cleared by OIPE CSRL194 | L194 | |
| Initial Exam Team nnIEXX | IEXX |
4 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee paymentMAFP | MAFP | |
| Maintenance fee paymentMAFP | MAFP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS |
Numbers
- Publication
- 20120249736
- Publication, DOCDB
- 2012249736
- Publication, EPODOC
- US2012249736
- Application
- 13515385
- Application, DOCDB
- 201013515385
- Application, EPODOC
- US201013515385
Titles
- English
- SYSTEM AND METHOD FOR PROVIDING OPTIMAL DISPLAY OF VIDEO CONTENT
Classification
- CPC, 4
- H04N13/139
- H04N13/189
- H04N13/167
- H04N2013/405
- IPC, 4
- H04N7 01
- H04N13 00
- H04N21 435
- H04N21 4402
- USPC, 4
- 348043000
- 348441000
- 348E07003
- 348E13062