Apparatus, systems and methods for user controlled synchronization of presented video and audio streams

CROSS REFERENCE TO RELATED APPLICATIONS

0001This application is a Divisional of U.S. application Ser. No. 14/689,858, filed Apr. 17, 2015, published as U.S. Publication No. 2015/0222791, and entitled “APPARATUS, SYSTEMS AND METHODS FOR USER CONTROLLED SYNCHRONIZATION OF PRESENTED VIDEO AND AUDIO STREAMS,” and issued as U.S. Pat. No. 9,742,965 on Aug. 22, 2017, which claims priority to U.S. application Ser. No. 13/179,359, filed Jul. 8, 2011, published as U.S. Publication No. 2012/0008045, and entitled “APPARATUS, SYSTEMS AND METHODS FOR USER CONTROLLED SYNCHRONIZATION OF PRESENTED VIDEO AND AUDIO STREAMS,” and issued as U.S. Pat. No. 9,013,632 on Apr. 21, 2015, which claims the benefit of and priority to U.S. Application Ser. No. 61/362,498, filed Jul. 8, 2010, entitled, “APPARATUS, SYSTEMS AND METHODS FOR USER CONTROLLED SYNCHRONIZATION OF PRESENTED VIDEO AND AUDIO STREAMS,” the content of which are entirely incorporated herein by reference.

BACKGROUND

0002Media devices, such as a set top box, are configured to receive media content. The received media content may be presented on a media presentation device, such as a television, computer system, monitor, or the like. The media content, such as a television program, a broadcast sports event, a movie, or the like, is received in the form of a video stream and an associated audio stream. The video stream and the audio stream are temporally synchronized with each other. Once received and processed, the video stream is presented on a display and the audio stream is output from one or more speakers in a synchronized fashion. For example, an actor in a program or movie is viewable on the display. The actor's dialogue is heard by the viewer, where the dialogue is synchronized with the apparent speech movements of the actor.

0003However, the synchronization between the video stream and the audio stream may not be exact. In such situations, a viewer will perceive that the movement of the actor's lips when speaking does not exactly correspond to the dialogue that is being heard by the viewer. Other events in a movie may be associated with expected sounds. For example, an explosion scene from the video stream can be expected to have an attendant explosion sound in the audio stream. If the synchronization between the video stream and the audio stream is not exact, then the user will perceive the discrepancy between the presented image of the explosion and their hearing of the explosion sound, which will be heard at a time that does not correspond to the viewed image of the explosion.

0004Many different “lip-sync” or “lip-synchronism” systems have been developed to correct the lip-sync problem. However, such lip-sync correction systems and methods are based on the signal characteristics of the voice and audio streams, and/or are based on various clocking or timing signals associated with the video and audio streams.

0005Ultimately, the user of the media presentation system perceives the success, or failure, of such lip-sync correction systems and methods. If the lip-sync correction systems and methods fail to perform as intended, the user perceives the unsynchronized presentation of the video and audio streams. Such unsynchronized presentation of the video stream and the audio stream may be very distracting to the user.

0006Unfortunately, the user is not able to correct an apparent unsynchronized presentation of the video and audio streams. Accordingly, there is a need in the arts to permit the user to synchronize presentation of a presented video stream and a presented audio stream.

SUMMARY

0007Systems and methods of correcting synchronization between a video stream and an audio stream presented to a user are disclosed. An exemplary embodiment receives a synchronization correction instruction, wherein the synchronization correction is configured to be initiated by the user; and incrementally adjusts one of the video stream and the audio stream by a synchronization correction, wherein the synchronization correction advances or retards presentation of at least one of the video stream and the audio stream by a predefined duration.

BRIEF DESCRIPTION OF THE DRAWINGS

Preferred and alternative embodiments are described in detail below with reference to the following drawings:

<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of an embodiment of a video and audio synchronization system; and

<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram of an alternative embodiment of the video and audio synchronization system that is configured to support communications between the media device and the media content provider system concerning unsynchronized presentation of the video stream and the audio stream.

DETAILED DESCRIPTION

0011<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of an embodiment of a video and audio synchronization system <b>100</b> implemented in a media device <b>102</b>, such as, but not limited to, a set top box (STB). Embodiments of the video and audio synchronization system <b>100</b> may be implemented in other media devices, such as, but not limited to, stereos, surround-sound receivers, radios, televisions (TVs), digital video disc (DVD) players, digital video recorders (DVRs), game playing devices, or personal computers (PCs) that are configured to generate, provide, and/or to present a video stream <b>104</b> and/or an audio stream <b>106</b>.

0012The synchronized video stream <b>104</b> and the audio stream <b>106</b> may be presented on one or more suitable presentation devices <b>108</b>. For example, the illustrated media device <b>102</b> is communicatively coupled to a television <b>110</b> that presents the video stream <b>104</b> on its display <b>112</b> (and optionally, may also present the audio stream on its speakers). Alternatively, or additionally, the media device <b>102</b> may be communicatively coupled to a sound system <b>114</b> that emits the audio stream <b>106</b> on its speakers <b>116</b>. Examples of the sound system <b>114</b> include, but are not limited to, a surround sound system, an audio amplifier, a stereo, or the like.

0013At times, the presentation of the video stream <b>104</b> and the audio stream <b>106</b> may not be sufficiently synchronized. Such unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b> may be very distracting to the user.

0014The unsynchronization between the video stream <b>104</b> and the audio stream <b>106</b> may occur in the originally provided media content stream <b>118</b> (that includes the video stream <b>104</b> and the audio stream <b>106</b>) received over a communication network <b>120</b>. For example, there may be transmission delays between the communicated video stream <b>104</b> and audio stream <b>106</b>. Components in the media device <b>102</b> may introduce delays in one of the audio stream <b>106</b> or the video stream <b>104</b>, thereby causing the unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b>.

0015In some instances, the unsynchronization between the video stream <b>104</b> and the audio stream <b>106</b> may occur when the video stream <b>104</b> and audio stream <b>106</b> are presented by different media presentation devices <b>108</b>, such as when the video stream <b>104</b> is presented on the television <b>110</b> and the audio stream <b>106</b> is presented on the sound system <b>114</b>. The different media presentation devices <b>108</b> may use different components to process the video stream <b>104</b> and the audio stream <b>106</b>. Different time delays may be introduced by the components in the different media presentation devices <b>108</b>, thereby causing the unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b>.

0016In another instance, the unsynchronization between the video stream <b>104</b> and the audio stream <b>106</b> may occur in the originally provided media content stream <b>118</b>. For example, when the media content stream <b>118</b> is received over the communication network <b>120</b> sourced by a media content provider system <b>122</b>, the video stream <b>104</b> and the audio stream <b>106</b> may become unsynchronized during the origination of the media content stream <b>118</b> to the media device <b>102</b>.

0017Embodiments of the video and audio synchronization system <b>100</b> are configured to permit the user, who is actively viewing a presentation of the video stream <b>104</b> and who is listening to a corresponding synchronized audio stream <b>106</b>, to initiate an incremental change in the synchronization between the video stream <b>104</b> and the audio stream <b>106</b>. Accordingly, the user is able to control synchronization between the video stream <b>104</b> and the audio stream <b>106</b> to reduce, and even eliminate, an unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b>.

0018In some situations, the user may perceive that the audio stream <b>106</b> is being presented ahead of (before) the video stream <b>104</b>. In an exemplary embodiment, presentation of the video stream <b>104</b> may be advanced (speeded up) to synchronize the video stream <b>104</b> with the audio stream <b>106</b> to correct, or at least mitigate, the unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b>. Alternatively, or additionally, an exemplary embodiment may retard (slow down) the presentation of the audio stream <b>106</b> to synchronize the audio stream <b>106</b> with the video stream <b>104</b>.

0019In some situations, the user may perceive that the audio stream <b>106</b> is being presented behind (after) the video stream <b>104</b>. In an exemplary embodiment, presentation of the video stream <b>104</b> may be retarded (slowed down) to synchronize the video stream <b>104</b> with the audio stream <b>106</b> to correct, or at least mitigate, the unsynchronized presentation of the video stream and the audio stream. Alternatively, or additionally, an exemplary embodiment may advance (speed up) presentation of the audio stream <b>106</b> to synchronize the audio stream <b>106</b> with the video stream <b>104</b>.

0020To facilitate disclosure of embodiments of the video and audio synchronization system <b>100</b>, a simplified embodiment of a media device <b>102</b> is described. The media device <b>102</b> may be a set top box or the like that is configured to receive streaming media content from a communication network <b>108</b>. The media content stream <b>118</b>, comprising the presented video stream <b>104</b> and the audio stream <b>106</b>, is provided from the media content provider system <b>122</b>. For example, the media content provider system <b>122</b> may be operated by a company that provides many channels of media content, even thousands of channels of media content, to its customers over the communication network <b>120</b>. Non limiting examples of the communication network <b>120</b> include a satellite system, a cable system, and/or another network that the media device <b>102</b> is communicatively coupled to. Alternatively, or additionally, the communication network <b>120</b> may be an Internet site or web site operated by a company that provides Internet-based media content. Accordingly, exemplary communication network <b>120</b> may include, but are not limited to, satellite systems, cable systems, and the Internet.

0021Alternatively, or additionally, the media content stream <b>118</b> may be provided from another electronic device or component that is communicatively coupled to the media device <b>102</b>. For example, the media content stream <b>118</b> may be provided from an electronic device that accesses a portable media content storage medium. Non-limiting examples of such media devices include, but are not limited to, a video recording cassette (VCR), a digital video disk (DVD), a flash memory, or other media content storage medium.

0022In this context, the media device <b>102</b> is illustrated as being communicatively coupled to the television <b>110</b> that presents the video stream <b>104</b> on its display <b>112</b>. The media device <b>102</b> is also illustrated as being communicatively coupled to the sound system <b>114</b> that presents the audio stream <b>106</b> on a plurality of speakers <b>116</b>. In this exemplary configuration, an unsynchronized presentation of the video stream <b>104</b> presented on the display <b>112</b> and the audio stream <b>106</b> emitted from the speakers <b>116</b> may be discernable by the user.

0023The non-limiting simplified exemplary media device <b>102</b> comprises a media content stream interface <b>124</b>, a processor system <b>126</b>, a memory <b>128</b>, a program buffer <b>130</b>, an optional digital video recorder (DVR) <b>132</b>, a presentation device interface <b>134</b>, a remote interface <b>136</b>, and an optional user input interface <b>138</b>. The memory <b>128</b> comprises portions for storing the media content processing logic <b>140</b>, the video adjustment logic <b>142</b>, and the audio adjustment logic <b>144</b>. In some embodiments, the media content processing logic <b>140</b>, the video adjustment logic <b>142</b>, and/or the audio adjustment logic <b>144</b> may be integrated together, and/or may be integrated with other logic. Other media devices <b>102</b> may include some, or may omit some, of the above-described media processing components and/or logic. Further, additional components and/or logic not described herein may be included in alternative embodiments.

0024The functionality of the media device <b>102</b>, here a set top box, is now broadly described. The media content processing is generally implemented by the processor system <b>126</b> while executing the media content processing logic <b>140</b>. A media content provider may provide the media content stream <b>118</b> that is received by the media content stream interface <b>124</b>. One or more tuners <b>146</b> in the media content stream interface <b>124</b> selectively tune to a specified media content stream <b>118</b> in accordance with instructions received from the processor system <b>126</b>. The processor system <b>126</b>, executing the media content processing logic <b>140</b> and based upon a request for a program of interest specified by the user, parses out the video stream <b>104</b> and the audio stream <b>106</b> associated with the program of interest. The video stream <b>104</b> and the audio stream <b>106</b> may be temporarily stored by the program buffer <b>130</b> to facilitate the timing of the communication of the video stream <b>104</b> and the audio stream <b>106</b> to the media presentation devices <b>108</b>. The media content can be streamed out to the media presentation devices <b>108</b> via the presentation device interface <b>134</b>. Alternatively, or additionally, the parsed out media content may be saved into the DVR <b>132</b> for later presentation.

0025The exemplary media device <b>102</b> is configured to receive commands from the user via a remote control <b>148</b>. The remote control <b>148</b> includes one or more controllers <b>150</b>. The user, by actuating one or more of the controllers <b>150</b>, causes the remote control <b>148</b> to generate and transmit commands, via a wireless signal <b>152</b>, to the media device <b>102</b> and/or the media presentation devices <b>108</b>. The commands control the media device <b>102</b> and/or control the media presentation devices <b>108</b>. The wireless signal <b>152</b> may be an infrared signal or a radio frequency (RF) signal.

0026Typically, the video stream <b>104</b> and the audio stream <b>106</b> are closely synchronized during presentation on the media presentation devices <b>108</b>. In the event that there is some degree of unsynchronized presentation between the video stream <b>104</b> and the audio stream <b>106</b>, the amount or degree of unsynchronization will likely be relatively small. Generally, the amount or degree of unsynchronization will likely be on the order of a plurality of milliseconds. Accordingly, embodiments of the video and audio synchronization system <b>100</b> are configured to permit the user to incrementally advance or retard a selected one of the video stream <b>104</b> or the audio stream <b>106</b> by a predefined duration. In response to initiation of a synchronization correction by the user, embodiments of the video and audio synchronization system <b>100</b> advance or retard a selected one of the video stream <b>104</b> and/or the audio stream <b>106</b> by the predefined duration of the synchronization correction (interchangeably referred to herein as a synchronization correction duration).

0027To conceptually illustrate operation of an embodiment of the video and audio synchronization system <b>100</b>, assume that the predefined synchronization correction duration by which the video stream <b>104</b> or the audio stream <b>106</b> is advanced or retarded is five (5) milliseconds. Further, assume that the amount or degree of unsynchronization corresponds to mismatch of seventeen (17) milliseconds between the presentation of the video stream <b>104</b>, and assume that the video stream <b>104</b> is presented ahead of the audio stream <b>106</b>. Here, the user would hear the dialogue of the speaking actor 17 milliseconds after seeing the corresponding movement of the actor's lips.

0028In this example, the user may generate a first synchronization correction instruction or request to the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein) to retard the video stream <b>104</b>. In response, presentation of the video stream <b>104</b> is retarded by 5 milliseconds. Alternatively, presentation of the audio stream <b>106</b> may be advanced by 5 milliseconds. After the first synchronization correction, the mismatch is reduced to 12 milliseconds.

0029If the unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b> is still undesirable, the user may generate a second synchronization correction instruction or request to the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein). In response, presentation of the video stream <b>104</b> is again retarded by 5 milliseconds. Alternatively, presentation of the audio stream <b>106</b> may again be advanced by 5 milliseconds. After the second synchronization correction, the mismatch is reduced to 7 milliseconds. At this point, the presentation of the video stream <b>104</b> and the audio stream <b>106</b> may be sufficiently synchronized so as to be acceptable to the user.

0030However, if the unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b> is still undesirable, the user may generate a third synchronization correction instruction or request to the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein). In response, presentation of the video stream <b>104</b> is again retarded by 5 milliseconds. Alternatively, presentation of the audio stream <b>106</b> may again be advanced by 5 milliseconds. After the second synchronization correction, the mismatch is reduced to 2 milliseconds. A 2 millisecond difference between presentation of the video stream <b>104</b> and the audio stream <b>106</b> is not likely to be perceptible to the user.

0031However, the user might generate a fourth synchronization correction instruction or request to the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein). In response, presentation of the video stream <b>104</b> is again retarded by 5 milliseconds. Alternatively, presentation of the audio stream <b>106</b> may again be advanced by 5 milliseconds. After the fourth synchronization correction, the mismatch changes such that the user would hear the dialogue of the speaking actor 3 milliseconds before seeing the corresponding movement of the actor's lips. The user may elect to then generate a fifth synchronization correction instruction to reverse the last synchronization correction. Some embodiments may allow the user to change the predefined duration of the synchronization correction. For example, the user might choose to set the duration to 3 milliseconds, and then generate a fifth synchronization correction instruction to reverse the last synchronization correction such that the video stream <b>104</b> and the audio stream <b>106</b> are exactly synchronized.

0032The user may generate the synchronization correction instruction or request to the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein) in a variety of manners. An exemplary embodiment utilizes a designated one or more of the controllers <b>150</b> to cause the remote control <b>148</b> to generate and transmit commands, via the wireless signal <b>152</b>, to the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein). For example, one of the controllers <b>150</b> may be configured to retard the video stream <b>104</b> (or advance the audio stream <b>106</b>) by the predefined duration of the synchronization correction. Another one of the controllers <b>150</b> may be configured to advance the video stream <b>104</b> (or the retard audio stream <b>106</b>) by the predefined duration of the synchronization correction.

0033Alternatively, or additionally, the user may actuate a controller (not shown), such as a button or the like, coupled to the user input interface <b>138</b> to initiate a synchronization correction. The controller may reside on a surface of the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein).

0034Alternatively, or additionally, a user may operate the remote control <b>148</b> (or controllers on the media device <b>102</b> or other device) to cause presentation of a synchronization correction graphical user interface (GUI) <b>154</b> on a display. For example, the synchronization correction GUI <b>154</b> may be presented on the display <b>112</b> of the illustrated television <b>110</b>. In an exemplary embodiment, the synchronization correction GUI <b>154</b> has the look and feel of a table or the like presenting information describing available synchronization correction options (advance the video stream <b>104</b> or the audio stream <b>106</b>, retard the video stream <b>104</b> or the audio stream <b>106</b>, change the predefined duration of the synchronization correction, select a duration of the synchronization correction, etc.). The synchronization correction GUI <b>154</b> is interactive with the viewer. The user, via their remote control <b>148</b> or controllers on the media device <b>102</b>, is able to “scroll” or “navigate” about the synchronization correction GUI <b>154</b> to select a synchronization correction of interest. When the user highlights a portion of the synchronization correction GUI <b>154</b> corresponding to a synchronization correction of interest, the user may actuate one or more controllers <b>150</b> to cause the media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein) to perform a synchronization correction.

0035Embodiments of the video and audio synchronization system <b>100</b> may advance and/or retard a selected one of the video stream <b>104</b> or the audio stream <b>106</b> by a predefined duration using one or more techniques. To advance or retard the video stream <b>104</b>, the video adjustment logic <b>142</b> is retrieved and executed by the processor system <b>126</b> in cooperation with the media content processing logic <b>140</b>. To advance or retard the audio stream <b>106</b>, the audio adjustment logic <b>144</b> is retrieved and executed by the processor system <b>126</b> in cooperation with the media content processing logic <b>140</b>.

0036An exemplary embodiment may use time shifting and/or pitch shifting to adjust the audio stream <b>106</b> by the duration of a synchronization correction. If presentation of the audio stream <b>106</b> continues during the synchronization correction, pitch shifting and/or other audio processing may be used to present a more pleasing presented audio stream <b>106</b> with a less perceptible distortion. Any suitable technique may be used to adjust the audio stream <b>106</b> to advance or retard the audio stream <b>106</b> for synchronization with the video stream <b>104</b>. Time compression or expansion may be used. A suitable phase vocoder method may be used. A suitable Fourier transform method may be used. A suitable time domain harmonic scaling method may be used. A suitable resampling process may be used. An adaptive basis transform algorithm may be used.

0037An exemplary embodiment may use image frame processing techniques to advance presentation of the video stream <b>104</b> by the duration of a synchronization correction. Any suitable technique may be used to advance the video stream <b>104</b> for synchronization with the audio stream <b>106</b>. To advance presentation of the video stream <b>104</b>, an exemplary embodiment discards one or more selected image frames of the video stream <b>104</b>, wherein the presentation time of the selected plurality of image frames corresponds to the predefined duration of the synchronization correction. Selection of image frames for discarding may be based on the time or duration between frames so that the number of discarded image frames corresponds to the duration of the synchronization correction. When an image frame is discarded, that discarded image frame is not presented, and then presentation of the subsequent image frames of the video stream then continues. Rather, the presentation jumps ahead to a next presented image frame.

0038Image frames may be selected for discarding based on the content and/or type of the image frame. For example, in a moving picture experts group (MPEG) formatted stream of image frames, intra-coded frames (I-frames) may be retained and a number of predictive-coded frames (P-frames) and/or bidirectionally-predictive-coded frames (B-frames) may be selected for discarding. Accordingly, I-frames associated with the discarded P-frames and/or B-frames remain in the video stream

0039Alternatively, or additionally, an image frame may be selected for discarding based upon the amount of video information of that image frame. For example, one of the P-frames may have less video information than an adjacent or close-by P-frame. The P-frame having less video information may be selected for discarding. In an exemplary embodiment, a image frame for discarding is identified from a plurality of adjacent image frames in the video stream, wherein the selected image frames have the least amount of video information therein.

0040Alternatively, or additionally, the temporal relationship between image frames may be used to select image frames for discarding. For example, but not limited to, every other image frame may be selected for discarding. As another example, groups of adjacent image frames may be selected for discarding. For example, a group of three adjacent frames may be selected for discarding. Presentation may then resume. If additional synchronization correction, another group of image frames would be selected for discarding.

0041An exemplary embodiment may use image frame processing techniques to retard presentation of the video stream <b>104</b> by the duration of a synchronization correction. Any suitable technique may be used to retard the video stream <b>104</b> for synchronization with the audio stream <b>106</b>. To retard presentation of the video stream <b>104</b>, an exemplary embodiment duplicates selected image frames of the video stream <b>104</b>. Duplicated image frames may be inserted into the video stream <b>104</b> to effectively retard presentation of the remainder of the video stream <b>104</b>. The duplication and insertion process continues until a sufficient number of image frames are duplicated and inserted so that the delay in presentation of the video stream <b>104</b> corresponds to the duration of the synchronization correction.

0042In an exemplary embodiment, one image frame is selected for duplication. The selected image frame is duplicated into a plurality of duplicated image frames, wherein a presentation time of the selected plurality of duplicated image frames corresponds to the predefined duration of the synchronization correction.

0043In another embodiment, a plurality of non-adjacent image frames are selected for duplication, wherein the selected non-adjacent image frames are separated by a predefined duration or by a predefined number of image frames. For example, selected non-adjacent image frames may be separated by approximately half of a millisecond. As another example, every other image frame (or every third image frame, or every fourth image frame, etc.) may be selected for duplication. Each selected non-adjacent image frame may be duplicated one, twice or by some other predefined number of duplications. The duplicated non-adjacent image frames are inserted into the video stream adjacent to their respective image frame from which they were duplicated from. Accordingly, the presentation time of the selected plurality of duplicated image frames corresponds to the predefined duration of the synchronization correction.

0044Selection of image frames for duplicating may be based on the time or duration between frames so that the number of duplicated image frames corresponds to the duration of the synchronization correction. Image frames may be selected based on the content and/or type of the image frame. For example, in a moving picture experts group (MPEG) formatted stream of image frames, one or more of the I-frames, P-frames, and/or B-frames may be selected for duplication.

0045Alternatively, or additionally, an image frame may be selected based upon the amount of video information of that image frame. For example, one of the P-frames may have less video information than an adjacent or close-by P-frame, and thus, may be more quickly duplicated. The P-frame having less video information may be selected for duplication.

0046Alternatively, or additionally, the temporal relationship between image frames may be used to select image frames for duplicating. In an exemplary embodiment, a series of consecutive image frames may each be selected for duplicating one or more times. For example, but not limited to, a single image frame may be duplicated a predefined number of times and inserted into the video stream <b>104</b>. As another example, a selected image frame may be duplicated two times, and inserted into the video stream <b>104</b>. Then, a later image frame may be selected and duplicated two times, and inserted into the video stream <b>104</b>.

0047In some embodiments, a relatively small, predefined time delay may be added into the video stream <b>104</b> between communication and/or presentation of a plurality of image frames. A sum of the time delays corresponds to the predefined duration of the synchronization correction. The time delay may be added between a series of adjacent image frame in an exemplary embodiment. Alternatively, the time delay may be added between groups of adjacent image frames. For example, if a 5 millisecond duration of the synchronization correction is desired, five 1 millisecond time delays may be inserted into the video stream <b>104</b> at desired locations.

0048In some embodiments, the time delay may implemented by a series of generated solid blank or patterned image frames. The blank image frames may be a colored, such as black, white, grey, blue or another suitable color that may not be significantly perceptible by the user. In an exemplary embodiment, a primary color or substantial color of an selected image frame in the video stream may be identified, wherein the identified color of the selected image frame is used to define the color of the blank image frame. For example, the video scene may have been filmed during the day at a location where the sky was blue. Accordingly, a substantial color of the image frame is blue such that the selected color of the blank image frame would be blue. The sum of the presentation times of the generated image frames corresponds to the predefined duration of the synchronization correction. The generated image frames may be inserted together as a group into the image frame. Alternatively, the generated image frames may be periodically inserted so as to be spaced among the plurality of image frames of the video stream. The generated image frames are preferably inserted at locations in the video stream so as to result in an acceptable level of distraction to the user.

0049<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram of an alternative embodiment of the video and audio synchronization system <b>100</b> that is configured to support communications between the media device <b>102</b> and the media content provider system <b>122</b> concerning unsynchronized presentation of the video stream <b>104</b> and the audio stream <b>106</b>. An exemplary embodiment of the media device <b>102</b> comprises a media content system interface <b>302</b> that is configured to support communications over a communication path <b>304</b>.

0050The memory <b>128</b> comprises a portion for storing the synchronization correction information logic <b>306</b>. The synchronization correction information logic <b>306</b> is retrieved and executed by the processor system <b>126</b>, optionally in cooperation with the media content processing logic <b>140</b>, to determine the synchronization correction information and/or to facilitate communication of the synchronization correction information between the media device <b>102</b>, the media content provider system <b>122</b>, and/or another entity. In some embodiments, synchronization correction information logic <b>306</b>, the media content processing logic <b>140</b>, the video adjustment logic <b>142</b>, and/or the audio adjustment logic <b>144</b> may be integrated together, and/or may be integrated with other logic.

0051In an exemplary embodiment, the communication path <b>304</b> communicatively coupled the media device <b>102</b> to the communication network <b>120</b>. The communication path <b>304</b> may employ any suitable communication media. For example, the same coaxial cable used to deliver media content to the media device <b>102</b> may also be used to support communications between the media device <b>102</b>, the media content provider system <b>122</b>, and/or another entity <b>308</b>. As yet another example, the communication path <b>304</b> may communicatively coupled to the media device <b>102</b> to a telephone system, wire-based backchannel, or the like. As another non-limiting example, the communication path <b>304</b> may wirelessly communicatively couple the media device <b>102</b> to a suitable cellular system, the Internet, and/or a Wi-Fi system.

0052In an exemplary embodiment, when the user initiates a synchronization correction, the synchronization correction information corresponding to the synchronization correction is communicated from the media device <b>102</b> to the media content provider system <b>122</b> (or to any other suitable designated system, device, or entity <b>308</b>). The synchronization correction information may include information pertaining to the nature of the synchronization correction, such as the predefined duration and/or any user specified duration of the synchronization correction, which one of the video stream <b>104</b> and the audio stream <b>106</b> for which the synchronization correction was applied, which direction the synchronization correction was made (advance or retard), and/or the number of times that the user initiated the synchronization correction.

0053The synchronization correction information may include information that identifies the particular media device <b>102</b>. Identifying information may include, but is not limited to, a serial number, an account number, a user identity, a device location, or any other suitable identifying information.

0054The synchronization correction information may include information that may be used to determine the source of the unsynchronized presentation of the video stream <b>104</b> presented on the display <b>112</b> and the audio stream <b>106</b> emitted from the speakers <b>116</b>. For example, information may be provided to determine if the signal transmission to the media device <b>102</b> is introducing error (and thus be indicative of a media content system transmission problem that should be corrected by the media content provider). The synchronization correction information may indicate if the media device <b>102</b> is introducing the error. For example, the media device is a STB might be supplied by the media content provider, and thus indicate that the media device <b>102</b> should be serviced and/or replaced by the media content provider. As yet another example, the synchronization correction information may indicated if the error is introduced by the owner's own equipment. Thus, the media content provider might advise the user of potential corrective actions.

0055The received synchronization correction information may be saved by the media content provider for other types of analysis. For example, many users might be experiencing the same, or similar, unsynchronized presentation of the video stream <b>104</b> the audio stream <b>106</b>. If many users are experiencing the same or similar synchronization problem, the media content provider may be prompted to check performance of their equipment. Or, it may be possible that the originating provider is providing an unsynchronized video stream <b>104</b> and audio stream <b>106</b> to the media content provider. In such situations, the media content provider may prompt the media content originator to correct the synchronization problem, and/or may take actions to correct the synchronization problem at their facilities.

0056Some embodiments of the media device <b>102</b> are configured to provide other information to the media content provider or another entity. For example, the media device <b>102</b> may be provisioned with a set top box health reporting system or the like. Or, the media device may be provisioned with a program monitoring system that is used to obtain information about the user's viewing habits. The synchronization correction information logic <b>306</b> may be optionally integrated with the logic that performs these other reporting functions.

0057An exemplary embodiment may be configured to receive synchronization information from the media content provider. For example, an exemplary embodiment may receive information from the media content provider that there is a local or regional problem in the synchronization between the video stream <b>104</b> and the audio stream <b>106</b> for one or more media content streams <b>118</b>. The received synchronization information may recommend that the user initiate one or more synchronization corrections at their media device <b>102</b> (or other electronic device or media presentation device <b>108</b> having an embodiment of the video and audio synchronization system <b>100</b> therein). For example, the synchronization information may recommend a duration of a synchronization correction (where the user adjusts the duration of the synchronization correction). As another non-limiting example, the media content provider may recommend a number of synchronization corrections based on a predefined duration of a synchronization correction). The synchronization correction information may identify which one or more media content streams <b>118</b> are having synchronization problems. Alternatively, or additionally, the media content provider may recommend no action be taken by the user since the media content provider is in the process of, or planning to, implement a synchronization correction to the media content stream <b>118</b>.

0058Some embodiments are configured to generate an audio/visual (A/V) synchronization notification <b>310</b> that is presented to the user. For example, but not limited to, the AV synchronization notification <b>308</b> may be generated by the media device <b>102</b>, and then may be communicated to the television <b>110</b> for presentation on the display <b>112</b>. Alternatively, or additionally, an audible notification may be generated and presented to the user. The AV synchronization notification <b>310</b> may include the synchronization correction information, or a summary thereof, that was obtained from other media devices <b>102</b>.

0059An exemplary embodiment presents the AV synchronization notification <b>310</b> as a pop-up window or the like. Alternatively, or additionally, the AV synchronization notification <b>310</b> may be incorporated into the synchronization correction GUI <b>154</b>.

0060Alternatively, or additionally, the synchronization correction information received by the media content provider may be included with call center information, or may be made available to a call center. For example, the synchronization correction information could be incorporated into a data reporting system that is used by a call center in providing call support services to the client users. Here, the user may notice a synchronization problem between the video stream <b>104</b> and the audio stream <b>106</b>. The user may call the call center and indicate the problem to the call center operator. The call center operator may then be able to advise the user of a recommended synchronization correction.

0061An alternative embodiment of the video and audio synchronization system <b>100</b> may be implemented in any suitable media presentation device <b>108</b>. For example, an embodiment of the video and audio synchronization system <b>100</b> may be implemented in the sound system <b>114</b> to control the audio stream <b>106</b> to independently synchronize the audio stream <b>106</b> with the video stream <b>104</b> presented on a different media presentation device <b>108</b>. As another example, an embodiment of the video and audio synchronization system <b>100</b> may be implemented in the television <b>110</b> to control the audio stream <b>106</b> to independently synchronize the audio stream <b>106</b> with the presented video stream <b>104</b> presented on its display <b>112</b>. Alternatively, or additionally, the television <b>110</b> may be configured to control the video stream <b>104</b> to independently synchronize the video stream <b>104</b> with the audio stream <b>106</b> that is presented on a different media presentation device <b>108</b>, such as the sound system <b>114</b>.

0062As yet another exemplary alternative embodiment, an embodiment of the video and audio synchronization system <b>100</b> may be implemented in an external media device that is providing the media content stream <b>118</b>. For example, the media content stream <b>118</b> may be originating from a DVD, VCR tape, or other content device. The media content stream <b>118</b> may be provided to the media device <b>102</b> directly, or directly to one or more media presentation devices <b>108</b>. The user may adjust the video stream <b>104</b> and/or the audio stream <b>106</b> at the external device so as to synchronize presentation of the video stream <b>104</b> and the audio stream <b>106</b> that are presented on one or more media presentation devices <b>108</b>.

0063It should be emphasized that the above-described embodiments of the video and audio synchronization system <b>100</b> are merely possible examples of implementations of the invention. Many variations and modifications may be made to the above-described embodiments. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.