Systems, methods, and computer program products for multiple aspect ratio automated simulcast production
Summary by NHIP
Multi-Aspect Ratio Video Production
The system configures a processor to generate video content in both 4:3 and 16:9 aspect ratios. It automatically crops received 4:3 content to conform to the 16:3 format before producing the segment in the second ratio.
Claim Score by NHIP
Abstract
A system, method, and computer program product for producing a show. In an embodiment, the invention is directed to a production system having a first production path, a second production path, and a control system that causes the first production path to generate a show in a first aspect ratio (4:3), and that causes the second production path to generate the same show in a second aspect ratio (16:9). In another embodiment, the invention is directed to producing a show from live material and from archived material. This aspect of the invention operates by producing a first show comprising a plurality of stories, segmenting the first show, and storing the show segments in an archive. Then, the invention produces a second show using live portions as well as show segments retrieved from the archive. The invention is also directed to a media manager that interacts with a server. In some cases, the server is integrated with the production system. The media manager automatically assigns channels/ports of the server when accessing material stored in the server.

Term
Term ended
Expired 27 September 2023, 3 years ago.
- Priority
- Filed
- Granted
- Expired
- Today
27 claims: 7 independent, 20 dependent
- 1A production system for configuring a hardware processor to execute a video editing program for generating video content in multiple aspect ratios, the production system comprising:a control system configured to produce a content segment both in a first aspect ratio format and in a second aspect ratio format different from the first aspect ratio format;wherein the production system is configured to receive content in the first aspect ratio format, and automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment in the second aspect ratio format, and wherein the production system is configured to automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment by automatically cropping the received content in the first aspect ratio to conform to the second aspect ratio format.
- 2A production system for configuring a hardware processor to execute a video editing program for generating video content in multiple aspect ratios, the production system comprising:a control system configured to produce a content segment both in a first aspect ratio format and in a second aspect ratio format different from the first aspect ratio format;and a first production channel and a second production channel different from the first production channel, wherein the production system is configured to receive content in the first aspect ratio format, and automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment in the second aspect ratio format, and wherein the control system is configured to cause the first production channel to generate the content segment in the first aspect ratio format, and cause the second production channel to generate the content segment in the second aspect ratio format.
- 9A production system for configuring a hardware processor to execute a video editing program for generating video content in multiple aspect ratios, the production system comprising:a control system configured to produce a content segment both in a first aspect ratio format and in a second aspect ratio format different from the first aspect ratio format;wherein the production system is configured to receive content in the first aspect ratio format, and automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment in the second aspect ratio format, wherein the control system is configured to operate based on a plurality of transition macros, and wherein the plurality of transition macros comprises a first set of instructions for causing a first production path to perform a first function based on the first aspect ratio format, and a second set of instructions for causing a second production path to perform a second function based on the second aspect ratio format, the first production path being different from the second production path.
- 10A production system for configuring a hardware processor to execute a video editing program for generating video content in multiple aspect ratios, the production system comprising:a control system configured to produce a content segment both in a first aspect ratio format and in a second aspect ratio format different from the first aspect ratio format;wherein the production system is configured to receive content in the first aspect ratio format, and automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment in the second aspect ratio format, wherein the control system is configured to independently adjust an effect of the content segment based on a first desired effect associated with the first aspect ratio format and based on a second desired effect associated with the second aspect ratio format, the second desired effect being different from the first desired effect, and wherein the first desired effect comprises a first transition cut effect for a 4:3 aspect ratio format, and the second desired effect comprises a second transition cut effect for a 16:9 aspect ratio format.
- 11A production system for configuring a hardware processor to execute a video editing program for generating video content in multiple aspect ratios, the production system comprising:a control system configured to produce a content segment both in a first aspect ratio format and in a second aspect ratio format different from the first aspect ratio format;and a first production channel and a second production channel different from the first production path, wherein the production system is configured to receive content in the first aspect ratio format, and automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment in the second aspect ratio format, and wherein the control system is configured to independently adjust the production of the content segment by applying transition cuts based on the second aspect ratio format before production of the content segment through the second production channel.
- 12A production system for configuring a hardware processor to execute a video editing program for generating video content in multiple aspect ratios, the production system comprising:a control system configured to produce a content segment both in a first aspect ratio format and in a second aspect ratio format different from the first aspect ratio format;wherein the production system is configured to receive content in the first aspect ratio format, and automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment in the second aspect ratio format, and wherein the production system is configured to present a user interface configured to receive an insertion of a transition macro into a script from a user and to perform a function associated with the transition macro in generating the content segment in both the first aspect ratio and the second aspect ratio.
- 13Broadest claimClaim Score 62, broad(NHIP)A production system for configuring a hardware processor to execute a video editing program for generating video content in multiple aspect ratios, the production system comprising:a control system configured to produce a content segment both in a first aspect ratio format and in a second aspect ratio format different from the first aspect ratio format;wherein the production system is configured to receive content in the first aspect ratio format, and automatically convert the received content in the first aspect ratio format to conform to the second aspect ratio format before production of the content segment in the second aspect ratio format;and wherein the control system is configured to independently adjust production of the content segment by applying a transition based on the second aspect ratio format before production of the content segment.
Independent claims7
121 paragraphs in 7 sections, as filed
CROSS-REFERENCE TO RELATED APPLICATIONS
0001This application is a continuation of and claims the benefit of U.S. patent application Ser. No. 14/542,229 entitled “SYSTEMS, METHODS, AND COMPUTER PROGRAM PRODUCTS FOR AUTOMATED REAL-TIME EXECUTION OF LIVE INSERTS OF REPURPOSED STORED CONTENT DISTRIBUTION” and filed Nov. 14, 2014, which is a divisional of Ser. No. 10/434,461 (now U.S. Pat. No. 9,123,380) entitled “SYSTEMS, METHODS, AND COMPUTER PROGRAM PRODUCTS FOR AUTOMATED REAL-TIME EXECUTION OF LIVE INSERTS OF REPURPOSED STORED CONTENT DISTRIBUTION, AND MULTIPLE ASPECT RATIO AUTOMATED SIMULCAST PRODUCTION” filed May 9, 2003 which claims the benefit of U.S. provisional application “Automated Real-Time Execution of Live Inserts of Repurposed Stored Content Distribution,” Ser. No. 60/378,657, filed May 9, 2002, and “Multiple Aspect Ratio Automated Simulcast Production,” Ser. No. 60/378,672, filed May 9, 2002, each of which are herein incorporated by reference in their entireties.
0002The following patents and patent applications of common assignee are related to the present application, and are herein incorporated by reference in their entireties:
0003“Real Time Video Production System and Method,” Ser. No. 09/215,161, filed Dec. 18, 1998, now U.S. Pat. No. 6,452,612, issued Sep. 17, 2002.
0004“System and Method for Real Time Video Production and Multicasting,” Ser. No. 09/634,735, filed Aug. 8, 2000.
0005“Method, System and Computer Program Product for Full News Integration and Automation in a Real Time Video Production Environment,” Ser. No. 09/822,855, filed Apr. 2, 2001.
0006“Method, System and Computer Program Product for Producing and Distributing Enhanced Media Downstreams,” Ser. No. 09/836,239, filed Apr. 18, 2001.
0007“Advertisement Management Method, System, and Computer Program Product,” Ser. No. 10/247,783, filed Sep. 20, 2002.
BACKGROUND OF THE INVENTION
0008Field of the Invention
0009The present invention relates generally to production of live and as-live shows, and more particularly relates to production of live and as-live shows using live segments and re-purposed archived materials.
0010Related Art
0011The demand for 24-hour news programming is high, and growing steadily. Conventional systems and methods of producing news shows are labor extensive and, thus, expensive. What is needed are improved automated systems and methods for providing news programming that is less labor intensive and less expensive.
SUMMARY OF THE INVENTION
0012Briefly stated, the present invention is directed to a system, method, and computer program product for producing a show. In an embodiment, the invention is directed to a production system having a first production path, a second production path, and a control system that causes the first production path to generate a show in a first aspect ratio (4:3), and that causes the second production path to generate the same show in a second aspect ratio (16:9).
0013In another embodiment, the invention is directed to producing a show from live material and from archived material. This aspect of the invention operates by producing a first show comprising a plurality of stories, segmenting the first show, and storing the show segments in an archive. Then, the invention produces a second show using live portions as well as show segments retrieved from the archive.
0014The invention is also directed to a media manager that interacts with a server. In some cases, the server is integrated with the production system. The media manager automatically assigns channels/ports of the server when accessing material stored in the server.
0015Further features and advantages of the invention, as well as the structure and operation of various embodiments of the invention, are described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers generally indicate identical, functionally similar, and/or structurally similar elements. The drawing in which an element first appears is generally indicated by the left-most digit(s) in the corresponding reference number.
BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES
0016The invention shall be described with reference to the accompanying figures, wherein:
0017<figref idref="DRAWINGS">FIG. 1</figref> is an example production system useful for simultaneously generating outputs in native 4:3 format and native 16:9 format.
0018<figref idref="DRAWINGS">FIGS. 2 and 3</figref> are example flowcharts depicting the operation of the invention when producing shows using live content and re-purposed archived materials.
0019<figref idref="DRAWINGS">FIG. 4</figref> is an example production system for producing shows using live content and re-purposed archived materials.
0020<figref idref="DRAWINGS">FIG. 5</figref> is an example user interface for the production system of <figref idref="DRAWINGS">FIG. 4</figref>.
0021<figref idref="DRAWINGS">FIG. 6</figref> is a block diagram of a media manager according to an embodiment of the invention.
DETAILED DESCRIPTION OF THE INVENTION
0000Multiple Aspect Ratio Automated Simulcast Production
0022The invention is directed to a method, system, and computer program product for simulcasting digital video through outputs having differing format requirements. As described in greater detail below, in an embodiment, the present invention allows broadcasters to automate and produce a simulcast of dual 4:3 and 16:9 aspect ratio “live” or “as-live” programming. The present invention allows automatic adjustments to be made to character generators, still stores, transition effects, etc., such that the production can be synchronized and transmitted over parallel mediums with non-substantial delay.
0000Overview
0023The market for digital television continues to evolve as broadcasters transition from transmitting an analog NTSC signal to digital signals as mandated by the Federal Communications Commission (FCC). The mass majority of the installed television sets in the United States today have a 4:3 aspect ratio. New digital sets will come with the wider 16:9 aspect ratio similar to the format used in motion pictures
0024Market analysts expect the installed base of digital television sets to be at 4.2 million by the end of 2002. In addition, digital settop boxes that receive the broadcast digital signal either over-the-air or through cable for conversion onto existing analog television sets are expected to have an installed base of 39.5 million. Television households by the end of 2002 are forecasted to be at 104.5 million. This shows a market penetration of 4% for digital television sets (16:9) and 38% for digital settop boxes (4:3). By the year 2005, the market penetration numbers will change for digital television sets from 4% to 17% while digital settop boxes change from 38% to 77%. This means that consumers will go through a period whereby many will be looking for a 16:9 format signal from broadcasters versus the standard 4:3 format currently used with analog television sets.
0025The broadcaster will be challenged to deliver several different types of programming solutions as follows:
00264:3 original (“native”) output “letter boxed” to fit a 16:9 digital television set. The letter box could be “black” or contain text, data or graphic content.
002716:9 original (“native”) output sent out “as is” for display on 16:9 digital television sets.
002816:9 original (“native”) output “cropped” to fit into a 4:3 analog television set with digital settop box converter.
0029In several of the cases above, compromises exist in order to serve the consumer during the market transition from a 4:3 to a 16:9 aspect ratio format. For example, some televisions include circuitry to convert from one format to another. However, such conversions introduce artifacts and negative impact resolution and/or the viewing experience. It is preferable that televisions receive and use signals in their original, or native, formats.
0030Therefore, a need exists to automate the process of producing simultaneous 4:3 and 16:9 formats from a single user interface to avoid duplicating both equipment and personnel resources. The simultaneous native output of both formats allow the broadcaster to design a “look and feel” that better enables them to take advantage of both 4:3 and 16:9 aspect ratios without negatively impacting one over the other.
0031The invention is applicable to formats other than 4:3 and 16:9, and is also applicable to the processing of greater than two formats, as will be appreciated by persons skilled in the relevant arts based on the teachings contained herein.
DETAILED DESCRIPTION
0032The invention allows broadcasters to automate and produce the simulcast of dual 4:3 and 16:9 aspect ratio “live” and “as-live” programming. <figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of a production system <b>102</b> according to an embodiment of the invention. The production system <b>102</b> includes a user interface <b>106</b>, to enable interaction with users <b>104</b>. Through the user interface <b>106</b>, users <b>104</b> can design and produce shows, such as but not limited to live and as-live shows.
0033The production system <b>102</b> includes a control system <b>108</b>, which controls the production system <b>102</b> (and components thereof) in the manner described herein. The control system <b>108</b> is implemented using a computer operating according to software. Such software, when stored on a computer readable medium (such as a CD, tape, hard drive, signals traveling over a wired or wireless medium, etc.), is referred to as computer program product. The invention is directed to such computer program products, as well as methods embodied in such computer program products, and systems incorporating such computer program products. Alternatively, the control system <b>108</b> is implemented using predominately hardware (such as hardware state machines or application specific processors).
0034The production system <b>102</b> includes a number of production paths <b>110</b>. In the example shown in <figref idref="DRAWINGS">FIG. 1</figref>, such production paths <b>110</b> include a 4:3 production path <b>110</b>A and a 16:9 production path <b>110</b>B. These examples are provided for illustrative purposes only, and are not limiting. The invention is applicable to other formats. Also, the invention can accommodate more than two production paths.
0035The production system <b>102</b> also includes a number of sources <b>114</b>, which may be cameras, tape machines, still stores, etc. The sources <b>114</b> provide material for the show to the production paths <b>110</b>, either directly or via the control system <b>108</b>.
0036In operation, the control system <b>108</b> controls the 4:3 production path <b>110</b>A to generate a show in a native 4:3 format, to thereby generate a native 4:3 output <b>112</b>A. Also, the control system <b>108</b> controls the 16:9 production path <b>110</b>B to generate a show in a native 16:9 format, to thereby generate a native 16:9 output <b>112</b>B. In an embodiment, the control system <b>108</b> simultaneously controls the 4:3 production path <b>110</b>A and the 16:9 production path <b>110</b>B such that the native 4:3 output <b>112</b>A and the native 16:9 output <b>112</b>B are synchronized with each other. In practice, the outputs <b>112</b>A, <b>112</b>B may not be precisely synchronized with each other, but are sufficiently synchronized so that any offset from each other is not easily discernable by viewers (or are at least are not sufficiently distracting to viewers).
0037In an embodiment, the production system <b>102</b> is similar to that described in “Real Time Video Production System and Method,” Ser. No. 09/215,161, filed Dec. 18, 1998, now U.S. Pat. No. 6,452,612, issued Sep. 17, 2002, referenced above (although the invention can be implemented using any production system having the functionality described herein). However, the production system <b>102</b> is modified to include multiple production paths <b>110</b>, and the control system <b>108</b> is modified to control the multiple production paths <b>110</b>. Further information regarding the production system <b>102</b> is provided below.
0000Transition Macros for Controlling Multiple Production Paths
0038The invention uses a Transition Macro to achieve the functionality described herein. A transition macro is a set of video production commands, where each video production command is transmitted from a processing unit to a video production device. A user designs a production by combining one or more transition macros in a script. Execution of the transition macros cause the production system <b>102</b> to produce the show in accordance with the script.
0039Transition macros are described in great detail in U.S. Pat. No. 6,452,612, “Real Time Video Production System and Method,” referenced above.
0040The '612 patent describes transition macros as controlling elements in a single production path. In the present invention, transition macros control elements in multiple production paths <b>110</b>. For example, in the example of <figref idref="DRAWINGS">FIG. 1</figref>, a given transition macro controls elements in both the 4:3 production path <b>110</b>A and the 16:9 production path <b>110</b>B (although some transition macros may still be limited to a subset of the production paths <b>110</b>). This feature of the invention is further described below.
0000Material for Multiple Formats
0041In an embodiment, the production system <b>102</b> includes material in the native formats for each of the system <b>102</b>'s production paths <b>110</b>. For example, for a given still, the production system <b>102</b> includes a 4:3 version of the still, and a 16:9 version of the still. The production paths <b>110</b>A, <b>110</b>B may each include a dedicated still store, or may share a still store. Another example relates to cameras. In an embodiment, the 4:3 production path <b>110</b>A includes 4:3 format cameras, and the 16:9 production path <b>110</b>B includes 16:9 format cameras. Such duplicity is generally (but not always) the case for the production paths <b>110</b>, to enable generation of the outputs <b>112</b> in the multiple native formats.
0042For example, consider the case of mixed effect (ME) banks. In embodiments of the invention, the production system <b>102</b> includes ME banks dedicated for the 4:3 production path <b>110</b>A, and other ME banks dedicated for the 16:9 production path <b>110</b>B.
0043A number of methods for acquiring materials for the production (in the different formats) are used, depending on a number of factors such as cost, availability, material types, as well as other implementation dependent factors. For example, in an embodiment, field acquisitions will originally be in 16:9 format, since that format will capture more data (when compared to 4:3). The 16:9 raw footage will then be used to create 4:3 format material (via appropriate cropping, for example). The result will be two separate files, one in 16:9 format, and one in 4:3 format. Since both files were created prior to production, it is possible to optimize both for their respective uses (i.e., one for producing a 4:3 output, and one for producing a 16:9 output). In another embodiment, field acquisitions are obtained in multiple original formats.
0044Such operation of the invention is in contrast to many conventional post-production conversion techniques, which try to convert a 16:9 signal to a 4:3 signal (or vice versa). Since such cropping is performed post-production, the cropping is not specifically tailored to the characteristics and parameters of the target format.
0000Processing Applicable Format
0045As noted above, the production paths <b>110</b> include components that are dedicated to their operation. In practice, each production path <b>110</b> may include a dedicated component, or they may share a single component. For example, in some embodiments, the production paths <b>110</b> may each include character generator (CG) and still store components, or they may share the same character generator (CG) and still store components.
0046In an embodiment, all files are identified as being in either 4:3 format or 16:9 format (for example, each file may include meta data that denotes the applicable format). When the 4:3 production path <b>110</b>A accesses material, it ensures that it accesses files tagged as being in the 4:3 format. Similarly, when the 16:9 production path <b>110</b>B accesses material, it ensures that it accesses files tagged as being in the 16:9 format. In embodiments, such control is achieved through operation of the control system <b>108</b>, and/or through appropriate coding of transition macros.
0000Keyer Functionality
0047In an embodiment, the control system <b>108</b> includes a keyer for the 4:3 production path <b>110</b>A, and a second keyer for the 16:9 production path <b>110</b>B.
0048As will be appreciated, the output signals <b>112</b> comprise a composite of signals from multiple sources. For example, the output signals <b>112</b> may comprise a first video signal having a hole, or “key,” cut therein. A second video signal is then inserted inside the key. The output signals <b>112</b> are thus a composite of the first video signal and the second video signal.
0049In the invention, the production system <b>102</b> includes video switchers to implement keying. The video switchers switch between multiple video sources (i.e., the first and second video signals from the above example). The switching operation of the video switchers is controlled by the control system <b>108</b>, which is operating according to commands/instructions contained in transition macros.
0050A given transition macro includes commands for both the 4:3 format and the 16:9 format. For example, assume the user <b>104</b> inserts into a script the icon for a particular transition macro relating to keying. In an embodiment, the user <b>104</b> need pay no concern to whether the icon relates to the 4:3 format or the 16:9 format. Instead, the icon is associated with a transition macro that includes video commands to perform the keying function for both the 4:3 format and the 16:9 format, such that the outputs <b>112</b> are synchronized. In other words, the invention provides a user interface <b>106</b> that shields the user <b>104</b> from the complexities of the generation of dual outputs <b>112</b>A, <b>112</b>B in dual formats.
0000Adjustment of Effects
0051The control system <b>108</b> independently adjusts effects (such as DVE transitions like cuts, fades, wipes, etc.) for the desired look in a particular format (i.e., 4:3 or 16:9). This is achieved through transition macros. Specifically, a particular “cut” transition macro includes commands to effect the cut effect for the 4:3 format, and includes other commands to effect the cut effect for the 16:9 format. Such commands access either 4:3 format source materials, or 16:9 source materials, depending on whether the commands are for the 4:3 format or the 16:9 format. Such commands also have appropriate duration settings so the native 4:3 output <b>112</b>A is synchronized with the native 16:9 output <b>112</b>B.
0000Source Management
0052The invention achieves source management for to simultaneously generate the 4:3 output <b>112</b>A and the 16:9 output <b>112</b>B. The invention synchronizes and manages dual output control of video server ports for proper ingestion and processing in the system. The invention performs automated format detection to properly address source material that does not meet one or the other format. Therefore, the invention utilizes a number of processes to “letterbox” a 4:3 format or “crop” a 16:9 format for proper display.
0053In other words, the control system <b>108</b> must ensure that source materials are served to the 4:3 production path <b>110</b>A and the 16:9 production path <b>110</b>B such that the 4:3 output <b>112</b>A is synchronized with the 16:9 output <b>112</b>B. In one embodiment, the control system <b>108</b> issues control signals to simultaneously activate servers in the two production paths <b>110</b>A, <b>110</b>B. In this embodiment, the production paths <b>110</b>A, <b>110</b>B each have dedicated servers. In another embodiment, the production paths <b>110</b>A, <b>110</b>B share servers. In this embodiment, the control system <b>108</b> communicates with a shared server(s) to server materials to the production paths <b>110</b>A, <b>110</b>B in a synchronous manner.
0054Exact synchronization between the outputs <b>112</b> is not necessary. The goal of the invention is to align the outputs <b>112</b> with one another so differences are not easily discernable to the human eye.
0055The invention also performs automated format detection to properly address source material that does not meet one or the other format. For example, suppose in a show a particular source was available only in 4:3 format. In order to use this source in both the 4:3 production path <b>110</b>A and the 16:9 production path <b>110</b>B, the source would have to be converted to the 16:9 format. Accordingly, the invention automatically determines whether a given source is only available in certain formats (or, equivalently, whether a given source is not available in any formats of interest). The invention then automatically converts the source to the other formats, using any well known technique. Such conversion can be performed either pre-production, or during production.
0000Addressing Camera Sources
0056The invention addresses camera sources properly according to the respective formats (4:3 or 16:9).
0057In some embodiments, both 4:3 cameras and 16:9 cameras are utilized to produce the native 4:3 output <b>112</b>A and the native 16:9 output <b>112</b>B.
0058In other embodiments, only cameras of a single format are used, such as 16:9 cameras. The video output of such cameras are then adjusted (cropped) to form the 4:3 source material. As a result, source materials in both the 16:9 format and the 4:3 format are made available to the production paths <b>110</b>A, <b>110</b>B.
0059Cropping of the 16:9 video material into the 4:3 format takes into consideration the parameters of the 4:3 format, as well as the parameters of the show being produced. Accordingly, compositing the video materials to form the 4:3 output <b>112</b>A and the 16:9 output <b>112</b>B is enhanced, thereby increasing the quality of these output signals <b>112</b>.
0060For example, consider the case where the script calls for a video signal to appear above and to the right of the anchor's shoulders. By knowing this ahead of time (during pre-production), the 16:9 original video signal can be cropped into the 4:3 format so that all the pertinent information will be conveyed in both the 16:9 output <b>112</b>B, as well as the 4:3 output <b>112</b>A.
0000User Interface
0061As clear from the description above, the user interface <b>106</b> enables users <b>104</b> to create scripts that, when executed by the control system <b>108</b>, simultaneously generates the 4:3 output <b>112</b>A and the 16:9 output <b>112</b>B. Such dual format operation of the invention is transparent to the user <b>104</b>. In other words, the user <b>104</b> does not need to explicitly design the script to achieve such dual format broadcasts. Instead, the invention utilizes transition macros that are coded for both formats, as described above.
0062The invention also supports “hot keys” that are coded for both formats. For example, the invention supports Late Breaking News keys, which when activated by the user <b>104</b> inserts into the script commands to accommodate a late breaking news segment. Hot keys are described in greater detail in U.S. Pat. No. 6,452,612, referenced above. According to the invention, such hot keys are associated with transition macros having instructions for both the 4:3 format and the 16:9 format.
0000Automated Real-Time Execution of Live Inserts of Repurposed Stored Content Distribution
0063A method, system, and computer program product are provided for segmenting and marking digital video productions, such that all or segments of the production can be retrieved for a repurposed distribution over traditional mediums or computer networks, such as the Internet. As described in greater detail below, the present invention includes methodologies for removing or editing keyers, character generators, etc. The present invention enables one to change the order of the repurposed distribution or add segments from another production. The present invention also enables the insertion of advertisements and other information into the repurposed video stream.
0000Overview
0064Cable 24 hour news channels have found a niche for consumers looking for real time news information at the local/regional level. The 24-hour news channel model serves the community looking for updated news around the clock without having to wait for specific times as is typical of traditional broadcast local news. Traditional local broadcasters deliver live newscasts daily in the morning (5:00 AM-7:00 AM), afternoon (11:00 AM-1:00 PM), evenings (4:00 PM 6:00 PM) and late evening hours (10:00 PM-12:00 PM). The demand for local 24-hour news channels can be attributed to the different working hours and shifts associated with today's work environments along with the sense of immediacy that has been cultivated by the Internet.
0065In addition, in the not so distant future, local broadcasters will be able to participate in this market trend through the appropriate use of allocated digital bandwidth. The local broadcaster will be able to divide their digital bandwidth into multiple standard definition television (SDTV) channels that allows them to develop new applications. Local broadcasters in mid to large markets will take advantage of these channel opportunities to provide for new revenue applications such as 24-hour local news, local sports, local shopping and local education programming.
0066Two methods of deployment exist. One is to provide 24-hour “live” programming around the clock. Second, provide “live” programming when the“facts” change. In other words, a cable or local broadcaster can produce live content in the first ½ hour followed by a “repurposed” ½ hour on the back with live inserts for stories or events that require real time updates such as traffic and weather reports along with breaking news stories of events occurring in real time. Today, this is managed manually since the intelligence does not exist to automate this process. The manual process does not allow for true automated live inserts without many resources to manage the process.
0067Therefore a need exists to automate this process so that digital SDTV 24-hour programming channels can cost effectively produce content while the market develops. This will require a design that integrates the automated production environment with storage equipment intelligently including the ability to edit stories in real time during the production process while automatically maintaining a database and daily schedule at both the micro (story level) and macro (show level) resolution.
0000Detailed Description
0068<figref idref="DRAWINGS">FIG. 4</figref> is a production system <b>402</b> according to an embodiment of the invention. The production system <b>402</b> includes a user interface <b>406</b> for enabling interaction with users <b>404</b>. The production system <b>402</b> also includes a control system <b>408</b> which is similar to the control system <b>108</b> described above. The control system <b>408</b> controls the production system <b>402</b> to achieve the functionality described herein.
0069The production system <b>402</b> includes a number of sources <b>410</b>, including a story archive <b>412</b> and other production devices <b>414</b>. The story archive <b>412</b> is a database having stored therein previously produced stories (although a “story” stored in this database may be any portion of a show). The production devices <b>414</b> are any known device for producing a show, such as a video switcher, camera, audio control, still store, tape machine, etc.
0070The production system <b>402</b> further includes one or more switchers <b>416</b>, which receives sources <b>410</b> and is controlled by the control system <b>408</b>. The switchers <b>416</b> generate an output <b>418</b>, which in an embodiment represents a live or as-live show.
0071The production system <b>402</b> may be implemented using a production system as described in U.S. Pat. No. 6,452,612, referenced above.
0072<figref idref="DRAWINGS">FIG. 2</figref> is a flowchart <b>202</b> representing the operation of the production system <b>402</b> according to an embodiment of the invention.
0073In step <b>204</b>, the user <b>404</b> interacts with the user interface <b>406</b> to generate a script for the show that is to be produced. Such operation is described in detail in U.S. Pat. No. 6,452,612, referenced above.
0074In step <b>206</b>, the production system <b>402</b> produces the show according to the script generated in step <b>204</b>. Such operation is described in detail in U.S. Pat. No. 6,452,612, referenced above.
0075In step <b>208</b>, the production system <b>402</b> segments the show (produced in step <b>206</b>) according to some criteria. In an embodiment, the show is segmented according to content. Specifically, in an embodiment, the show is segmented according to story. Accordingly, in step <b>208</b>, the production system <b>402</b> divides the show into its component stories.
0076In step <b>210</b>, these stories are stored in the story archive <b>412</b>, and indexed (or otherwise marked or tagged) for later retrieval.
0077In an embodiment, the production system <b>402</b> performs step <b>208</b> by recording the beginning and end of each story in the show, and/or the duration of each story. This information is stored, for example in the story archive <b>412</b>, along with the show. Also stored is the story type or category of each story. Subsequently, the production system <b>402</b> can uniquely access any story in the show using this information (meta data).
0078It is noted that a “story” can be any portion of the show.
0079Further description regarding the segmentation of a show is provided in “Method, System and Computer Program Product for Producing and Distributing Enhanced Media Downstreams,” Ser. No. 09/836,239, filed Apr. 18, 2001, referenced above.
0080In step <b>212</b>, the production system <b>402</b> generates additional programming, such as a new live or as-live show, using a combination of live inserts and archived material from the story archive <b>412</b>. The live inserts are generated using the production devices <b>414</b>. The material from the story archive <b>412</b> may be modified, if necessary, using the production devices <b>414</b>. In some cases, the additional programming is comprised of only material from the story archive <b>412</b>, although such materials may be modified to some extent. The operation of step <b>212</b> is shown in greater detail in <figref idref="DRAWINGS">FIG. 3</figref>, which shall now be considered.
0081In step <b>302</b>, the user <b>404</b> interacts with the production system <b>402</b> via the user interface <b>406</b> to create or modify a listing for a Current Show. The Current Show is a new show being designed for production using live inserts and material from the story archive <b>412</b>. The listing lists the components of the Current Show. For example, <figref idref="DRAWINGS">FIG. 5</figref> shows a Current Show Listing <b>506</b> having 6 components/segments/stories: a traffic report <b>520</b>A, a weather report <b>520</b>B, sports spotlight <b>520</b>C, a live 10:15 AM insert <b>518</b>B, a bridge collapse story <b>520</b>E, and an entertainment segment <b>520</b>F. Note that the sports spotlight <b>520</b>C and the bridge collapse story <b>520</b>E are from the story archive <b>412</b> (shown in the archived video window <b>508</b> of <figref idref="DRAWINGS">FIG. 5</figref>). The 10:15 AM insert <b>518</b>B is a live insert (see the live segments window <b>504</b>).
0082<figref idref="DRAWINGS">FIG. 5</figref> illustrates an example user interface <b>502</b> (provided by the user interface <b>406</b> shown in <figref idref="DRAWINGS">FIG. 4</figref>) for enabling the user <b>404</b> to create and modify the Current Show Listing <b>506</b>. The user <b>404</b> can drag and drop live segments from the live segment window <b>504</b>, and/or archived stories from the archived video window <b>508</b>. Within the current show window <b>506</b>, the user <b>404</b> can use well known computer pointing techniques to arrange and order the components of the Current Show. Other user interfaces could alternatively be used, such as those described in U.S. Pat. No. 6,452,612 and/or pending U.S. application Ser. No. 09/836,239, referenced above.
0083In step <b>304</b>, the production system <b>404</b> maps the Current Show Listing <b>506</b> to a production system script that comprises transition macros. Scripts and transition macros are described in detail in U.S. Pat. No. 6,452,612, as well as other patents and patent applications referenced above.
0084In step <b>306</b>, the production system <b>404</b> produces the Current Show according to the Current Show Listing <b>506</b> and/or the script (from step <b>304</b>). Step <b>306</b> includes steps <b>308</b>, <b>310</b>, and <b>312</b>, which shall now be described.
0085In step <b>308</b>, the production system <b>404</b> retrieves and modifies, as necessary, archived materials from the story archive <b>412</b>, in accordance with the Current Show Listing <b>506</b>. Such retrieved materials are inserted into the output <b>418</b> via the switcher <b>416</b>.
0086Step <b>308</b> involves automatic “downstream” keyer changes for “as live” replay of the retrieved materials (as necessary). For example, supposed the retrieved materials include a “bug” (for example, a time and temperature overlay on top of the video). In this example, the production system <b>404</b> would cause the keyer (one of the production devices <b>414</b>) to either eliminate the bug, or update the bug with the current time and temperature.
0087In an embodiment, step <b>308</b> is achieved by modifying the retrieved materials, in the manner just described. In an alternative embodiment, this is achieved by not recording the bug in the materials when the materials were originally produced (in step <b>206</b>). In this embodiment, the bug is inserted into the output <b>418</b> in real-time.
0088In step <b>310</b>, the production system <b>404</b> generates live segments in accordance with the Current Show Listing <b>506</b>. Such live segments are inserted into the output <b>418</b> via the switcher <b>416</b>.
0089Note that the user interface <b>502</b> includes a Time Over/Under for Current ½ Hour timer <b>514</b>, which indicates the amount of time that the show is over/under given the stories already aired and the stories that are yet to be aired, and a Time Left for Current ½ Hour timer <b>516</b>, which indicates the time remaining in the 30 minute show (these counters <b>514</b>, <b>516</b> are based on a 30 minute show). These counters <b>514</b>, <b>516</b> are used by the director <b>404</b> to ensure that the show fits into the allotted time (i.e., 30 minutes in the example of <figref idref="DRAWINGS">FIG. 5</figref>). The director <b>404</b> can control the length of any live segments to ensure that the show fits within the 30 minute slot. Alternatively, the director <b>404</b> can select other archived materials from the story archive <b>412</b> based on duration of such materials to ensure the show fits within the allotted slot. Manipulation of the Current Show Listing <b>506</b> in this manner is described in greater detail in “Method, System and Computer Program Product for Producing and Distributing Enhanced Media Downstreams,” Ser. No. 09/836,239, filed Apr. 18, 2001, referenced above (in the context of an approval application, system, method, and computer program product).
0090In step <b>312</b>, the production system <b>402</b> inserts advertisements into the output stream <b>418</b>. In an embodiment, the ads are “searched” to import the light ad with the correct duration, and possibly content. In other words, based on the scheduled “break” length, and/or the content of stories around the break, commercials of corresponding duration will be accessed and inserted into the output stream <b>418</b>.
0091As the Current Show is produced, some segments may run longer or shorter than originally expected. The production system <b>402</b> keeps track of the overage or underage, and may adjust the duration of commercial breaks to compensate for such overage/underage. If the duration(s) of the commercial breaks change, then the production system <b>402</b> selects and inserts into the output stream <b>418</b> combination(s) of commercials that fit the duration of the breaks. Other aspects involving the selection of commercials are described in “Advertisement Management Method, System, and Computer Program Product,” Ser. No. 10/247,783, filed Sep. 20, 2002, referenced above.
0000Media Manager
0092<figref idref="DRAWINGS">FIG. 6</figref> is a block diagram showing a media manager <b>602</b> and a server <b>604</b> according to an embodiment of the invention. The media manager <b>602</b> and server <b>604</b> are optionally part of the production systems <b>102</b>, <b>402</b> shown in <figref idref="DRAWINGS">FIGS. 1 and 4</figref>, for example.
0093The media manager <b>602</b> manages the selection, play out status, play out channel assignment of both video clips and graphic files from the server <b>604</b>.
0094The media manager <b>602</b>/server <b>604</b> combination has a number of features:
0095Media Types: The combination combines the management of a video server, still store, and character generator under one software interface. The media may consist of video and key. The key can be linked with the video for play out.
0096Integrated server: In an embodiment, the server <b>604</b> is an integrated server that is capable of internally keying media, with key signals, and outputting the composite media out a single channel.
0097Clip & Graphic Selection: The Media Manager <b>602</b> interfaces with user interfaces <b>106</b>, <b>406</b> to allow the user <b>104</b>, <b>404</b> to brow a low-resolution image of video clips and graphic files available in the server <b>604</b>. These clip or graphic Id's can then be assigned to a particular story within the rundown. Non-integrated servers may only be able to export a list of clip or graphic id's available for selection.
0098Play out Status: The Media Manager <b>602</b> updates the status of a clip assigned to a particular story. When a clip is assigned to a particular story within the rundown, the Media Manager <b>602</b> tracks the air readiness of that particular clip. If a predefined graphic Id were entered into the rundown that does not exist, Media Manager <b>602</b> would notify the rundown that the graphic requested is not air ready.
0099When the production system <b>102</b>, <b>402</b> monitors a rundown, a list of clips and graphics is generated under each story slug. If a clip or graphic is not air ready, the text is colored red. The status of the clip or graphic is automatically updated, until the rundown is unmonitored. When a list item that is colored red, becomes air ready, the text is changed to black.
0100Auto Assign Play out Channels: When a particular story is previewed for air, Media Manager <b>602</b> automatically assigns the clips and graphics on an available play out channel (video & key) from a pool of channels. There are two parts to the channel assignment. Part one loads the media to the auto-assigned channel. Part two routes the auto-assigned channel to the proper background or key channel. (Channels on-air and requested channels for preview cannot exceed the total number of channels for the system.)
0101The media manager <b>602</b> and server <b>604</b> shall now be described in greater detail.
0102As noted above, in an embodiment, the server <b>604</b> is an integrated server. The media manager <b>602</b> communicates and interacts with the server <b>604</b> in the server <b>604</b>'s native language, such that the media manager <b>602</b> is capable of accessing additional functionality of the server <b>604</b>.
0103The media manager <b>602</b> manages the play-out of server clips and still devices. The media manager <b>602</b> controls what channels (ports) <b>606</b> of the server <b>604</b> these play out, and will ascertain if the clip exists or docs not exist. When a particular clip on the script comes up to be output, the media manager <b>606</b> automatically assigns the channel that it will be played out on, from the pool of channels that exist. This process is called auto-channeling.
0104For example, suppose the production system <b>102</b>, <b>402</b> is processing a “load media” command from a transition macro. According to the invention, the media manager <b>602</b> automatically finds the next unused port <b>606</b> of the server <b>604</b>, and uses that port <b>606</b> to output the media from the server <b>604</b>. In other words, the port <b>606</b> of the server <b>604</b> need not be hard-coded into the “load media” command.
0105There are various benefits of auto-channeling. First, if the server port must be hard-coded into transition macros, then the library of transition macros becomes very large (for example, there must be a transition macro for each function/port combination). With auto-channeling, only a single transition macro for a given function is needed, since the channel <b>606</b> of the server <b>604</b> that is going to be used is automatically determined by the media manager <b>602</b> when the command is executed. Second, auto-channeling greatly simplifies user operation, since the user need not be concerned with specifying the server port to use. Instead, the user can focus on selecting and ordering the transition macros in order to produce the desired show.
0106It is noted that the media manager <b>602</b> can operate with non-integrated, commercially available servers. In this case, it is necessary to produce a configuration file or otherwise inform the media manager <b>602</b> of the number and configuration of the server's ports/channels.
CONCLUSION
0107While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be apparent to persons skilled in the relevant art that various changes in form and detail can be made therein without departing from the spirit and scope of the invention. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
Contents7
7 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| WO0072574A2 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO0111627A1 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO0152526A2 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| WO02087244A1 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| EP0239884A1 | Cites | European Patent Office (EPO) | Applicant |
| EP0559478A1 | Cites | European Patent Office (EPO) | Applicant |
| EP0774756A2 | Cites | European Patent Office (EPO) | Applicant |
| EP0817474A1 | Cites | European Patent Office (EPO) | Applicant |
| EP0929197A2 | Cites | European Patent Office (EPO) | Applicant |
| EP0933893A1 | Cites | European Patent Office (EPO) | Applicant |
| EP1126712A2 | Cites | European Patent Office (EPO) | Applicant |
| EP1262063A2 | Cites | European Patent Office (EPO) | Applicant |
| US2001003846A1 | Cites | United States of America | Applicant |
| US2001032333A1 | Cites | United States of America | Applicant |
| US2001038392A1 | Cites | United States of America | Applicant |
| US2002026642A1 | Cites | United States of America | Applicant |
| US2002053078A1 | Cites | United States of America | Applicant |
| US2002054244A1 | Cites | United States of America | Applicant |
| US2002067730A1 | Cites | United States of America | Applicant |
| US2002083472A1 | Cites | United States of America | Applicant |
| US2002109710A1 | Cites | United States of America | Applicant |
| US2002113803A1 | Cites | United States of America | Applicant |
| US2002120925A1 | Cites | United States of America | Applicant |
| US2002170068A1 | Cites | United States of America | Applicant |
| US2002171649A1 | Cites | United States of America | Applicant |
| US2003066070A1 | Cites | United States of America | Applicant |
| US2003070167A1 | Cites | United States of America | Applicant |
| US2003131359A1 | Cites | United States of America | Applicant |
| US2003141665A1 | Cites | United States of America | Applicant |
| US2003206662A1 | Cites | United States of America | Applicant |
| US2003206720A1 | Cites | United States of America | Applicant |
| US2003217362A1 | Cites | United States of America | Applicant |
| US2004005004A1 | Cites | United States of America | Applicant |
| US2004073953A1 | Cites | United States of America | Applicant |
| US2004095829A1 | Cites | United States of America | Applicant |
| WO2004095829A1 | Cites | World Intellectual Property Organization (WIPO) | Applicant |
| US2004103439A1 | Cites | United States of America | Applicant |
| US2004210945A1 | Cites | United States of America | Applicant |
| US2004228605A1 | Cites | United States of America | Applicant |
| US2004237122A1 | Cites | United States of America | Applicant |
| US2005028217A1 | Cites | United States of America | Applicant |
| US2005084232A1 | Cites | United States of America | Applicant |
| US2008016532A1 | Cites | United States of America | Applicant |
| US2008028340A1 | Cites | United States of America | Applicant |
| GB2323699A | Cites | United Kingdom | Applicant |
| US4232311A | Cites | United States of America | Applicant |
| US4242707A | Cites | United States of America | Applicant |
| US4272790A | Cites | United States of America | Applicant |
| US4283766A | Cites | United States of America | Applicant |
| US4400697A | Cites | United States of America | Applicant |
| US4488180A | Cites | United States of America | Applicant |
| US4559531A | Cites | United States of America | Applicant |
| US4631590A | Cites | United States of America | Applicant |
| US4689683A | Cites | United States of America | Applicant |
| US4746994A | Cites | United States of America | Applicant |
| US4768102A | Cites | United States of America | Applicant |
| US4972274A | Cites | United States of America | Applicant |
| US4982346A | Cites | United States of America | Applicant |
| US5001473A | Cites | United States of America | Applicant |
| US5036395A | Cites | United States of America | Applicant |
| US5115310A | Cites | United States of America | Applicant |
| US5122885A | Cites | United States of America | Search report |
| US5148154A | Cites | United States of America | Applicant |
| US5166797A | Cites | United States of America | Applicant |
| US5189516A | Cites | United States of America | Applicant |
| US5231499A | Cites | United States of America | Applicant |
| US5237648A | Cites | United States of America | Applicant |
| US5253065A | Cites | United States of America | Applicant |
| US5262865A | Cites | United States of America | Applicant |
| US5274758A | Cites | United States of America | Applicant |
| US5307456A | Cites | United States of America | Applicant |
| US5347622A | Cites | United States of America | Applicant |
| US5369443A | Cites | United States of America | Applicant |
| US5384912A | Cites | United States of America | Applicant |
| US5388197A | Cites | United States of America | Applicant |
| US5420724A | Cites | United States of America | Applicant |
| US5434678A | Cites | United States of America | Applicant |
| US5442749A | Cites | United States of America | Applicant |
| US5450140A | Cites | United States of America | Applicant |
| US5487167A | Cites | United States of America | Applicant |
| US5519828A | Cites | United States of America | Applicant |
| US5537157A | Cites | United States of America | Search report |
| US5557724A | Cites | United States of America | Applicant |
| US5559641A | Cites | United States of America | Applicant |
| US5565929A | Cites | United States of America | Applicant |
| US5577190A | Cites | United States of America | Applicant |
| US5602684A | Cites | United States of America | Applicant |
| US5608464A | Cites | United States of America | Applicant |
| US5625570A | Cites | United States of America | Applicant |
| US5638133A | Cites | United States of America | Applicant |
| US5641596A | Cites | United States of America | Applicant |
| US5659792A | Cites | United States of America | Applicant |
| US5659793A | Cites | United States of America | Applicant |
| US5664087A | Cites | United States of America | Applicant |
| US5680639A | Cites | United States of America | Applicant |
| US5682326A | Cites | United States of America | Applicant |
| US5684543A | Cites | United States of America | Applicant |
| US5724521A | Cites | United States of America | Applicant |
| US5737011A | Cites | United States of America | Applicant |
| US5740549A | Cites | United States of America | Applicant |
77 members in 9 offices
Priority claims9
| Document | Office | Kind | Date |
|---|---|---|---|
| 21516198 | United States of America | A | |
| 63473500 | United States of America | A | |
| 82285501 | United States of America | A | |
| 83623901 | United States of America | A | |
| 37867202 | United States of America | P | |
| 37865702 | United States of America | P | |
| 24778302 | United States of America | A | |
| 43446103 | United States of America | A | |
| 201414542229 | United States of America | A |
Members77
| Document | Office | Kind | |
|---|---|---|---|
| WO0152526A2 | World Intellectual Property Organization (WIPO) | A2 | |
| AU2771801A | Australia | A | |
| WO0175887A2 | World Intellectual Property Organization (WIPO) | A2 | |
| AU4966901A | Australia | A | |
| WO0152526A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2002031756A1 | United States of America | A1 | |
| WO0175887A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2002053078A1 | United States of America | A1 | |
| US2002054244A1 | United States of America | A1 | |
| WO0152526A9 | World Intellectual Property Organization (WIPO) | A9 | |
| US2002109710A1 | United States of America | A1 | |
| US6452612B1 | United States of America | B1 | |
| WO02087244A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2002175931A1 | United States of America | A1 | |
| EP1262063A2 | European Patent Office (EPO) | A2 | |
| US2002186233A1 | United States of America | A1 | |
| US2003001880A1 | United States of America | A1 | |
| EP1273008A2 | European Patent Office (EPO) | A2 | |
| WO03014949A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2003070167A1 | United States of America | A1 | |
| WO03030011A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO03014949A9 | World Intellectual Property Organization (WIPO) | A9 | |
| AU2003230350A1 | Australia | A1 | |
| US2003214605A1 | United States of America | A1 | |
| WO03096682A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2004008220A1 | United States of America | A1 | |
| US2004027368A1 | United States of America | A1 | |
| EP1391118A1 | European Patent Office (EPO) | A1 | |
| WO03096682A9 | World Intellectual Property Organization (WIPO) | A9 | |
| US2004070690A1 | United States of America | A1 | |
| EP1423794A1 | European Patent Office (EPO) | A1 | |
| US6760916B2 | United States of America | B2 | |
| US2004210945A1 | United States of America | A1 | |
| CA2523947A1 | Canada | A1 | |
| WO2004102343A2 | World Intellectual Property Organization (WIPO) | A2 | |
| US6909874B2 | United States of America | B2 | |
| EP1552685A1 | European Patent Office (EPO) | A1 | |
| US6952221B1 | United States of America | B1 | |
| EP1391118A4 | European Patent Office (EPO) | A4 | |
| EP1629349A2 | European Patent Office (EPO) | A2 | |
| US7024677B1 | United States of America | B1 | |
| EP1423794A4 | European Patent Office (EPO) | A4 | |
| EP1552685A4 | European Patent Office (EPO) | A4 | |
| JP2007518288A | Japan | A | |
| EP1262063B1 | European Patent Office (EPO) | B1 | |
| AT377906T | Austria | T | |
| ATE377906T1 | Austria | T1 | |
| US7302644B2 | United States of America | B2 | |
| DE60131251D1 | Germany | D1 | |
| DE60131251T2 | Germany | T2 | |
| WO2004102343A3 | World Intellectual Property Organization (WIPO) | A3 | |
| CN101410796A | China | A | |
| EP2061032A1 | European Patent Office (EPO) | A1 | |
| US7549128B2 | United States of America | B2 | |
| US2009288008A1 | United States of America | A1 | |
| US2009292991A1 | United States of America | A1 | |
| EP1629349A4 | European Patent Office (EPO) | A4 | |
| JP4503609B2 | Japan | B2 | |
| US7835920B2 | United States of America | B2 | |
| US8006184B2 | United States of America | B2 | |
| CN101410796B | China | B | |
| US8560951B1 | United States of America | B1 | |
| US8661366B2 | United States of America | B2 | |
| US8726187B2 | United States of America | B2 | |
| US2015063787A1 | United States of America | A1 | |
| CA2523947C | Canada | C | |
| US9123380B2 | United States of America | B2 | |
| US2016118081A1 | United States of America | A1 | |
| US2016118082A1 | United States of America | A1 | |
| US9558786B2 | United States of America | B2 | |
| US9711180B2 | United States of America | B2 | |
| US10056111B2This record | United States of America | B2 | |
| US2018358051A1 | United States of America | A1 | |
| US10360944B2 | United States of America | B2 | |
| US2019348077A1 | United States of America | A1 | |
| US10546612B2 | United States of America | B2 | |
| US11109114B2 | United States of America | B2 |
68 transactions on the USPTO file
Allowed after 1 non-final rejection and 1 RCE.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 1
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Maintenance Fee Reminder MailedREM. | REM. | |
| Payment of Maintenance Fee, 4th Year, Large EntityM1551 | M1551 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Response to 312 Amendment (PTO-271)MN271 | MN271 | |
| Dispatch to FDCD1935 | D1935 | |
| Response to Amendment under Rule 312N271 | N271 | |
| Pubs Case Remand to TCPUBTC | PUBTC | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Amendment after Notice of Allowance (Rule 312)AllowedA.NA | A.NA | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Supplemental Papers - Oath or DeclarationC600 | C600 | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Paralegal or electronic terminal disclaimer approvedP574 | P574 | |
| Terminal Disclaimer FiledDIST | DIST | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Correspondence Address ChangeC.ADB | C.ADB | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| Application Is Now CompleteCOMP | COMP | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Application Is Now CompleteCOMP | COMP | |
| Application Dispatched from OIPEOIPE | OIPE | |
| FITF set to NO - revise initial settingFTFI | FTFI | |
| Cleared by OIPE CSRL194 | L194 | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Preliminary AmendmentA.PE | A.PE | |
| Patent Term Adjustment - Ready for ExaminationPTA.RFE | PTA.RFE | |
| PTO/SB/69-Authorize EPO Access to Search ResultsSREXR141 | SREXR141 | |
| Applicants have given acceptable permission for participating foreignAPPERMS | APPERMS | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Entity Status Set To Undiscounted (Initial Default Setting or Status Change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
7 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Maintenance fee paymentMAFP | MAFP | |
| AssignmentAS | AS | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| AssignmentAS | AS |
Numbers
- Publication
- 10056111
- Application
- 14986435
Titles
- English
- Systems, methods, and computer program products for multiple aspect ratio automated simulcast production
Patent term adjustment
- A delay
- +189 daysthe office missed an examination deadline
- Applicant delay
- −48 days
- Net adjustment
- 141 days
Classification
- CPC, 9
- G11B27/031
- H04N5/262
- H04N5/268
- H04N5/2628
- H04N21/2187
- H04N21/2358
- H04N21/234372
- H04N21/2665
- H04N21/440272
- IPC, 8
- G11B27 031
- H04N5 262
- H04N5 268
- H04N21 2187
- H04N21 2665
- H04N21 2343
- H04N21 235
- H04N21 4402
- USPC, 1
- 386269000