Switching camera angles during interactive events
Summary by NHIP
Multi-Stream Interactive Event System
The system transmits multiple synchronized event streams from a performance studio to interactive clients equipped with stream selectors. Selecting a specific stream directs user feedback messages exclusively to objects within that stream while excluding non-selected streams.
Claim Score by NHIP
Abstract
Multiple camera angles of an interactive event are simultaneously transmitted as part of a broadcast. The simultaneous distribution of multiple synchronized streams of audio and/or visual information enables switching between cameras to be made by the audience members without interruption of the presentation of the event. In one embodiment, a performance studio might send out multiple synchronized concurrent streams. For example, a performance studio might transmit four distinct camera angles or streams, each at varying quality levels, such as the illustrated high-bandwidth and low-bandwidth encodings. Selection of the stream may also direct interactive feedback portions generated by the selecting audience member towards the selected object/individual. Alternatively, interactive feedback generated by the audience member may be directed globally to the producers of the event and selectively to the performers and other audience members of the event.

Term
Projected expiry 14 February 2032.
- Priority and filed
- Granted
- Today
- Projected expiry
5 claims: 2 independent, 3 dependent
- 1Broadest claimClaim Score 75, broad(NHIP)A method for participation in interactive online events, comprising:at an interactive client of the interactive online event, receiving multiple streams of an event from an event performance studio;selecting a stream from the multiple streams;displaying the selected stream of the event for user observation;and transmitting user initiated feedback messages to an object of the selected stream and not to objects of non-selected streams.
- 4A interactive event system comprising:a performance studio having at least two interactive displays and configured to produce two or more streams of an interactive event;a production center for producing the interactive event based on event material received from the performance studio;and at least two interactive clients, at least one of the interactive clients having i) a stream selector, and ii) at least one interactive display, wherein selection of a stream using the stream selector causes event feedback generated at a respective one of the interactive clients to be transmitted to an object of the selected stream and not to objects of non-selected streams.
Independent claims2
57 paragraphs in 6 sections, as filed
CROSS REFERENCE TO RELATED APPLICATIONS
0001The present application is a non-provisional application that claims priority and incorporates by reference in its entirety provisional U.S. Patent Application No. 61/100,701, entitled “Interactive Live Events” and provisional U.S. Patent Application No. 61/100,703 entitled “Interactive Events” and provisional U.S. Patent Application No. 61/100,704 entitled “Ticket Scarcity Management for Interactive Events” and provisional U.S. Patent Application No. 61/100,706 entitled “Switching Camera Angles during Interactive Events” all filed on Sep. 26, 2008.
TECHNICAL FIELD
0002Embodiments of the present disclosure generally relate to data evaluation, categorization, and presentation. More particularly, the embodiments of the present disclosure relate to systems which manage ticket scarcity for interactive events.
BACKGROUND
0003Attempts to display media on computers date back to the earliest days of computing. However, little progress was made for several decades, primarily due to the high cost, limited capabilities and to a lesser extent compatibilities of available computer hardware. Recently consumer-grade personal computers have become powerful enough to display various types of media, including high quality audio and/or video streams.
0004Streaming multimedia represents one method of media distribution. In essence streaming multimedia is multimedia that is broadcast by a streaming provider to an end-user. Generally, the term streaming specifically refers to the delivery method of the data rather than to the content. Unfortunately, streaming typically requires tremendous bandwidth and/or latency to cache the data locally. Recent advances in computer networks combined with powerful home computers and modern operating systems have made possible, i.e. practical and affordable, the near universal distribution of streaming media for ordinary consumers. Universal distribution represents multimedia that is constantly received by, and normally presented to, an end-user while it is being delivered by a streaming provider.
0005A stream of media can be on demand or live. On demand streams are stored on a server for a long period of time, and are available to be transmitted at a user's request. Live streams may still use a server to broadcast the event, but are typically only available at one particular time, such as a video stream of a live sporting event, a political debate, educational lecture, or a concert. Live streams may be edited and converted into on demand streams for later content consumption. Current on demand or live streams lose any possibility for constructive feedback from the streaming targets. Essentially, live online presentations to large streaming audiences generally only provide unidirectional information in a manner that is difficult to facilitate observer participation. On demand performances are presented after the fact, preventing the presenter and/or observer(s) from directly altering the previously recorded presentation. Moreover, customized presentation of the event for each end-user is also limited due to bandwidth constraints.
SUMMARY
0006In view of the problems in the state of the art, embodiments of the invention are based on overcoming the technical problem of only providing a single perspective, or vantage point, of an interactive live event. In one embodiment, the disclosure provides for categorization and presentation of selectable and switchable camera angles during an online environment. While the internet already allows many services for one way communication and event broadcast, there have been no options for providing multiple real-time perspectives of the event, including providing two-way interactivity between audience members and the people associated with the event, such as the producers and performers. Systems and methods presented in this disclosure provide this very type of interactivity to create truly compelling live events on the internet.
0007More specifically, multiple camera angles of an interactive event are simultaneously transmitted as part of a broadcast. The simultaneous distribution of multiple synchronized streams of audio and/or visual information enables switching between cameras to be made by the online audience members of the broadcast without interruption of the presentation of the event. In one embodiment, a performance studio might send out multiple synchronized concurrent streams as part of the broadcast to a content distribution network. For example, a performance studio might transmit four distinct camera angles or streams, each at varying quality levels, such as the illustrated high-bandwidth and low-bandwidth encodings. Audience members of the broadcast may select which stream(s) they want to watch of the broadcast. Selection of one of the streams may also direct interactive feedback portions generated by the selecting audience member towards the selected object/individual. Alternatively, interactive feedback generated by the audience member may be directed globally to the producers of the event and selectively to the performers and other audience members of the event.
BRIEF DESCRIPTION OF THE DRAWINGS
0008Non-limiting and non-exhaustive exemplary embodiments of the present disclosure are described with reference to the following drawings in which:
0009<figref idref="DRAWINGS">FIG. 1</figref> illustrates a block diagram view of a portion of an interactive client interface of an online interactive event environment during presentation of the event in accordance with various embodiments of the present disclosure;
0010<figref idref="DRAWINGS">FIGS. 2A-2D</figref> illustrate block diagram views of portions of user interfaces, each generated in an interactive feedback system configured for relative interactivity during event presentation in accordance with various embodiments;
0011<figref idref="DRAWINGS">FIG. 3</figref> illustrates a block/flow diagram view of a portion of computer systems in an exemplary online interactive event environment in accordance with at least one embodiment;
0012<figref idref="DRAWINGS">FIG. 4</figref> illustrates a flow diagram view of a method of a portion of operation for interactive event data evaluation, categorization, and presentation in accordance with at least one embodiment;
0013<figref idref="DRAWINGS">FIG. 5</figref> illustrates a block/flow diagram view of a portion of computer systems to distribute content across multiple channels in an exemplary online interactive event environment in accordance with at least one embodiment; and
0014<figref idref="DRAWINGS">FIG. 6</figref> illustrates a block diagram view of components contained in an interactive client system configured in accordance with at least one embodiment.
DETAILED DESCRIPTION
0015In the following detailed description, reference is made to the accompanying drawings which form a part hereof wherein like numerals designate like parts throughout, and in which are shown, by way of illustration, specific embodiments in which the disclosure may be practiced. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of a portion of the present disclosure is defined by the appended claims and their equivalents.
0016Throughout the specification and claims, the following terms take at least the meanings explicitly associated herein, unless the context clearly dictates otherwise. The meanings identified below are not intended to limit the terms, but merely provide illustrative examples for use of the terms. The meaning of “a,” “an,” and “the” may include reference to both the singular and the plural. Reference in the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. The meaning of “in” may include “in” and “on.” The appearances of the phrases “in one embodiment” or “in an embodiment” in various places in the specification do not necessarily all refer to the same embodiment, but it may. The term “connected” may mean a direct electrical, electro-magnetic, mechanical, logical, or other connection between the items connected, without any electrical, mechanical, logical or other intermediary there between. The term “coupled” can mean a direct connection between items, an indirect connection through one or more intermediaries, or communication between items in a manner that may not constitute a connection. The term “circuit” or “circuitry” as used in any embodiment described herein, can mean a single component or a plurality of components, active and/or passive, discrete or integrated, that are coupled together to provide a desired function and may include, for example, singly or in any combination, hardwired circuitry, programmable circuitry, state machine circuitry, and/or firmware that stores instructions executed by programmable circuitry. The term “signal” can mean at least one current, voltage, charge, data, or other such identifiable quantity.
0017In an effort to clarify comparative phrases used in the specification and the claims of this disclosure, please note that the following phrases take at least the meanings indicated and associated herein, unless the context clearly dictates otherwise. The phrase “A/B” means “A or B”. The phrase “A and/or B” means “(A), (B), or (A and B)”. The phrase “at least one of A, B and C” means “(A), (B), (C), (A and B), (A and C), (B and C) or (A, B and C)”. The phrase “(A) B” means “(A B) or (B)”, that is “A” is optional.
0018Referring now to <figref idref="DRAWINGS">FIG. 1</figref>, a block diagram view of a portion of an interactive client interface <b>100</b> of an online interactive event environment is illustrated showing portions of the presentation during an interactive event in accordance with various embodiments of the present disclosure. The interactive client interface <b>100</b>, in one embodiment, may include a video presentation of the event, and audio presentation of the event, or some combination thereof. In one embodiment, the video presentation may be individually selected by audience members. The selection of the video presentation may include choice of camera angle, perspective, and/or relative distance (e.g., zoom in/out). Video presentation selection allows the event attendee to choose the position of their virtual seat in the performance hall. For example, in the illustrated embodiment an audience may have a specialized interest in watching the lead singer, David, or in watching the entire live mix of the band, Disturbed.
0019The illustrated interactive client interface <b>100</b> incorporates into the event presentation the user interfaces <b>210</b>, <b>270</b>, <b>280</b>, and <b>290</b> illustrated in <figref idref="DRAWINGS">FIGS. 2A-2D</figref> and are described in greater detailed below. In addition, the illustrated embodiment also shows event sponsorship of the event. Accordingly, this sponsorship may be sold in accordance with a variety of advertising mechanisms, including but not limited to per event, per song, per minute, per impression, or some combination thereof. In one embodiment, an event sponsor may present customized logos and marketing material targeted for the audience of the event. On embodiment provides promotional links on the presentation page of event. When clicked, another window may open without interrupting the stream. Alternatively, a sponsorship link may change the look of the event interface. Other more subtle methods of promotion also considered within the scope of the disclosure include use of a watermark and/or background images and/or desktop/window wallpaper of promotional material.
0020Referring now to <figref idref="DRAWINGS">FIGS. 2A-2D</figref>, block diagram views of portions of user interfaces (<b>210</b>, <b>270</b>, <b>280</b>, and <b>290</b>) are illustrated. Each user interface generated in an interactive feedback system configured for compelling live event quality via relative interactivity in accordance with various embodiments.
0021In <figref idref="DRAWINGS">FIG. 2A</figref>, portions of user interface <b>210</b> are shown illustrating the solicitation on an interactive client of an event attendee to select and transmit a desired event presentation view to the producer. The selection of the video presentation may include choice of camera angle, perspective, and/or relative distance (e.g., zoom in/out). In the illustrated user interface <b>210</b> each of the white buttons represent a unique camera and/or microphone pickup of the live event. As illustrated, user interface <b>210</b> includes multiple perspectives and/or camera angles including whole band perspective view <b>220</b>, guitar camera <b>230</b>, drum camera <b>240</b>, and keyboards camera <b>250</b>. By clicking on one of the buttons, the video and audio perspective on the performance of the event, which is being streamed over the Internet or broadcast, is switched to reflect the requested view.
0022The user interface <b>210</b> also includes a bandwidth selector <b>260</b>. Video presentation selection allows the event attendee to choose the position of their virtual seat in the performance hall. Audience members may have a specialized interest in the performing band and camera angle selection allows the event attendee to choose the position of their virtual seat in the performance hall.
0023Selectable and switchable camera angles during an online or broadcast event give an Internet- or broadcast-based audience member direct involvement in dictating what part or parts of the event they see at any given moment during the event. The viewing and/or listening to an event, either via the traditional television medium or via streamed webcasts, was previously limited to a single perspective, or vantage point of the event. This would normally be either a fixed position viewpoint, or a director's cut version of the event where a professional production director would dictate which views, which were being relayed to the audience based upon the director's estimation of the most desirable view at a given time. This provided a very limiting experience for fans who wanted more involvement in how the event is consumed.
0024In contrast, one embodiment calls for multiple camera angles of the interactive event to be simultaneously transmitted as part of the broadcast. The simultaneous distribution of multiple synchronized streams of audio and/or visual information enables switching between cameras to occur without interruption of the presentation of the event. In one embodiment, a performance studio might send out multiple synchronized concurrent streams. For example, a performance studio might transmit four distinct camera angles, each at varying quality levels, such as the illustrated high-bandwidth and low-bandwidth encodings.
0025In one embodiment, the selection of the camera angle of the event may also direct interactive portions generated by the selecting audience member towards the selected object/individual. For example, if an audience member selected the drummer then the video presentation would switch to a camera angle for the drummer and emotapplause and/or shout outs generated by the audience member would also be directed towards the drummer. Alternatively, in one embodiment, the interactive content generated by an audience member is transmitted globally to the producers of the event and selectively to the performers and other audience members of the event.
0026In <figref idref="DRAWINGS">FIG. 2B</figref>, portions of user interface <b>270</b> are shown illustrating the solicitation on an interactive client of an event attendee to select and transmit a prioritized interactive playlist. One of the best ways to keep an audience engaged in an event is to give them some control of how the event unfolds. Providing a voting mechanism allows them to decide what song is played next, what topic is covered next or the audience decision on the outcome of some sporting event or any number of other mechanisms for impacting the flow of the event based on popular vote. Voting can be presented as a list of choices below some header describing what is currently being voted on. Each choice has an option for the audience member to make or change their choice. When they make a choice, it is sent to the service which tallies the votes and provides summary information in the client data requests. It will be appreciated by those of ordinary skill in the art and others, that a wide variety of alternate and/or equivalent implementations of voting mechanisms may be substituted for the specific embodiment of voting on a presented playlist as shown. For example, the questions to be voted on can be sent in real time by an administrator, based on input by the performers. In one embodiment, the voting results can be presented in real-time to performers and/or audience members. One embodiment allows past ballot results or voting history to be saved for later use and review.
0027In <figref idref="DRAWINGS">FIG. 2C</figref>, portions of user interface <b>280</b> are shown illustrating the solicitation on an interactive client of an event attendee to select and transmit emotapplause via an emoticon indicative of a current emotional state of the event attendee. Emotapplause is a mechanism of sending non-verbal communication from the audience members to the performers. By clicking graphical representations of the emotapplause (such as clapping hands, a heart, etc) a message is sent to a centralized service that aggregates all of the feedback from the audience. The performers then see a graphical representation of the aggregated feedback. The actual experience by the performer changes based on how many audience members are using that emotapplause image at that moment, so if 70% of the audience was ‘clapping’ and 10% of the audience was sending kisses, the visualization might include very large clapping hands, or perhaps many clapping hands and a smaller representation of kissing lips. Other sample emoticons include a lighter, a unity or rock-on fist, a hang-loose or horned devil hand sign, a virtual bra, and clapping. It will be appreciated by those of ordinary skill in the art and others, that a wide variety of alternate and/or equivalent implementations of emotapplause may be substituted for the specific embodiment of emotapplause shown. For example, emotapplause messages may be displayed to the performers based on statistical aggregation of the number of times each emotapplause item is clicked by audience members in accordance with one embodiment. It may be appreciated by those of ordinary skill in the art and others that a variety of algorithms may be used to determine the quantity, size and intensity of the animation that is presented to the performers. For example, if a statistically larger percentage of the audience is clicking one icon in the most recent set of data received from the interactive clients, the associated animation may be larger than the other animations for the less used emotapplause at that moment. Alternatively, in one embodiment, if one form of emotapplause is trending up in total number of clicks over a number of recent requests for data from the service that could result in the corresponding animations also growing in size, quantity and/or intensity. Similarly, if a trend is downward, the corresponding animations could shrink in size, quantity, and/or intensity. In one embodiment, different animations may be displayed to indicate some such large milestone has been hit when detected emotapplause images from the audience hit a designated milestone in number or a threshold gauging relative intensity of user actions is reached. In one embodiment, multiple animations may be shown simultaneously, and/or different display surfaces may show different sets of animations where the placement of the display surfaces could indicate a higher or lower priority to the performer or audience. In one embodiment, animations on the audience member's interface could also show similar animations based on the activity of the overall audience, so they will be able to see how active different emotapplause items are. Various embodiments enable animations to be overlaid on the video stream to allow audience members to see exactly what the performers are seeing.
0028In <figref idref="DRAWINGS">FIG. 2D</figref>, portions of user interface <b>290</b> are shown illustrating the solicitation on an interactive client of an event attendee to provide and transmit a virtual shout out to the performer. Shout outs are a text messages sent from the audience members to the performers and audience members. The intent of the shout out is for the audience members to be able to send a directed message or question to the performers. In addition to the performer seeing the message at the performance venue, the audience members also see a subset of the messages, thus providing a sense of community among all of the audience members. Because the number of audience members could be very large for a worldwide internet event, there is no guarantee that all messages will be presented to the performers but due to the mechanism of transferring shout out messages, a good random sampling of messages from all audience members will be presented to both the performers and other audience members. It will be appreciated by those of ordinary skill in the art and others, that a wide variety of alternate and/or equivalent implementations of selective instant messaging mechanisms may be substituted for the specific shout out embodiment shown. For example, in one embodiment, messages from audience members may be filtered if the same message is sent multiple times in a row to prevent “spamming” of messages to the participants. Moreover, messages from audience members may also be filtered based on content and length. In one embodiment, the audience and/or performers may be shielded from inappropriate content or specific topics. In one embodiment, a message can be filtered if too long to prevent situations where information download would be slowed by extra long messages. One variation allows long messages to be parsed and resent separately, while another throws out long messages. Determining which action should be taken may be based in part on the content of the message.
0029In one embodiment, specific audience members can be blocked from sending messages if they are found to be consistently sending inappropriate messages and/or “spamming” messages. When messages are blocked, various embodiments allow the audience member to still see their message as if they were sent, so that they are unaware that messages they send have been blocked.
0030In one embodiment, messages that are displayed to audience member and/or performers are displayed for a relative period of time related to the length of the message, so that longer messages are displayed longer while short messages go by faster. This helps audience and/or artist to both read and comprehend messages before they disappear. For example, messages like “yay!” take less time to comprehend than more complex messages like “That was amazing, what were you thinking when you wrote that song?” In one embodiment, the message animations at event location may be overlaid on the video stream to allow audience members to see exactly what the performers are seeing.
0031In one embodiment, when the incoming content is slow, for example from a low attendance event, the client may show messages from farther back in time. However, one embodiment monitors and limits the length of time that an old message may be used to prevent displayed messages from seeming out of context due to latency since the message was originally sent.
0032Referring now to <figref idref="DRAWINGS">FIG. 3</figref>, a block diagram of various computer systems in an online interactive event environment <b>300</b> is shown. Computer systems useful for data evaluation, categorization, and presentation of interactive events are shown in accordance with various embodiments of the present disclosure. The online interactive event environment <b>300</b> includes both a variety of operating environments and a variety of network devices. Operating environments within the online interactive event environment <b>300</b> may include, but are not limited to, multiple interactive client endpoints that may attach via a communication network, such as the internet, to a production center and/or one or more performance studios. The online interactive event environment <b>300</b> may also include a content distribution network for receiving camera angle requests and transmitting requested audio/visual streams. The online interactive event may also transmit other interactive data, such as the camera angle requests to the production center and/or the content distribution network.
0033In one embodiment, the production center includes network operations and a datacenter including a logging process for monitoring the event. The production center is configured to transceive audio/visual streams and to receive a logging channel of the event. In one embodiment, the performance studio includes an event studio, an event database, an event interface, and at least one interactive display. In one configuration, each channel at a designated bandwidth level may be associated with a camera and/or an interactive display. In one embodiment, a lower bandwidth stream of the event is sampled from the high bandwidth stream of the event to reduce the number of cameras necessary. As illustrated, the production center and performance studio may be separately connected via a private communication network or via a virtual private network across a public communication network, such as the internet.
0034An interactive client endpoint may represent a variety of consumer devices including, but not limited to, general purpose computer systems, personal digital assistants, digital media players, mobile telephones, video equipment, application specific devices, and other digital communication devices.
0035Performance centers provide executable code and operational data to the interactive client endpoints, directly and indirectly via the production center. Interactive client endpoints, in accordance with various embodiments, can be visitors of the event website, people who own or purchase a ticket, employees of the production company running the web site, or any other types of people or device that may participate in the interactive event. Various multimedia devices may be used to upload a rich variety of media information for or about an event to the event profile. For example, multiple cameras or webcams may be used to collect video images of an event, conduct a separate web interviews, and/or provide a video preview of an event. Likewise, multiple microphones may be used to collect sound from the event and/or associated interviews or advertisements.
0036In one embodiment, the audience member at the interactive client endpoint joins an ongoing event and initiates interactivity with the event by typing a message, clicking or otherwise choosing an emotapplause image, voting for event presentation lists, selecting a camera angle, or some other method of indicating the message they would like to send. The messages are then sent to a centralized internet web service that adds user information about that audience member such as their name, image, location, source, etc. That information is then stored in a central database or data store such that the web service may index, search, log and recall each request, or aggregated totals of requests.
0037Interactive client applications can then periodically issue requests for the current summary state of the interactivity information via a logging channel. That information includes a set of recent shout out messages and their related metadata, the current aggregate information for emotapplause items, current voting topics and voting choices, and any other status information that is helpful for the client to be able to process this data. Because of the potential quantity of requests coming from audience members, various caching mechanisms can be used to reduce the overhead spent gathering this information on every request. To maintain relevancy it is important that the information sent out to clients be very current, so as to maintain the feeling of interactivity at the event. In one embodiment, shout out messages are not allowed to be more than about 30 seconds old (time they were sent from audience member) and preferably represent the most recent messages received by the system. The response to the interactive client may be encoded in at least one of a variety of different formats, including but not limited to, XML, JSON, CSV, and the like.
0038In one embodiment, when the interactive audience client or performance studio client initially receives the data, they present the information to the performers or audience members in an appropriate way. For the performers, that may be showing the name of the audience member, their image, location and the shout out message itself in an interesting animation. Some additional options for emotapplause and shout outs were described previously with reference to <figref idref="DRAWINGS">FIG. 2C</figref> and <figref idref="DRAWINGS">FIG. 2D</figref>.
0039Referring now to <figref idref="DRAWINGS">FIG. 4</figref>, a flow diagram view of a portion of a method of operation <b>400</b> for interactive event data evaluation, categorization, and presentation is illustrated in accordance with at least one embodiment. Initially the event is established in block <b>410</b>. The established event may include information about the performers at the event, size (number of available tickets), ticket sales thresholds, anticipated playlists, online location of the event, and other particulars about the event. In block <b>420</b> tickets or admission codes for the event are issued based on event information.
0040Once the event opens in block <b>430</b>, such as the beginning of a performance, the method <b>400</b> begins to determine which interactive clients may have access to the data being transmitted. Query block <b>440</b> handles this by determining whether the soliciting client has ticket or admission code. If not then the soliciting client is encouraged to purchase a ticket in block <b>420</b>. If the client has a ticket, then they are allowed into the event in block <b>450</b>. Upon registering with the event coordinators, the interactive client will be allowed to receive the event stream in block <b>460</b>, including at least one integrated multimedia audio and video stream from the performance studio. In one embodiment, the integrated multimedia audio and video stream includes multiple synchronized streams, one for each camera angle.
0041Monitoring block <b>470</b> determines whether the event has concluded. If not concluded, the method <b>400</b> continues to accept and process interactive inputs from the interactive client, such as requests to change camera angles <b>482</b>, voting information <b>484</b> including votes regarding upcoming playlists, emotapplause <b>486</b>, and shout outs <b>488</b>. If the event has concluded, the method <b>400</b> directs interactive clients towards after party presentations <b>490</b> associated with the event, which may include post videos <b>494</b>, post photos <b>496</b>, post notes <b>498</b>, and other post event offerings. In one embodiment, the post videos <b>494</b> may include the entire event stream for review of the interactive client. In one embodiment, the post photos <b>496</b> may include a collection of images from the event and/or publicity shots of the performers at the event. In one embodiment, the post notes <b>498</b> may include links to additional information about the performers at the event, including future concerts that may be available.
0042Referring now to <figref idref="DRAWINGS">FIG. 5</figref>, a block/flow diagram view of a portion of computer systems <b>500</b> configured to distribute content across multiple channels in an exemplary online interactive event environment in accordance with at least one embodiment. The computer systems <b>500</b> include a database of event origination material <b>510</b> (live and/or recorded on demand), encoding and transmission stations <b>520</b>, content distribution network <b>530</b>, and multiple event clients <b>540</b> installed on user media devices. At least one user media device having a camera/microphone selector <b>550</b>.
0043The event origination material is transmitted as raw audio/visual data to multiple encoders and transmitters. Encoded and Compressed audio/visual streams are delivered from the encoders and transmitters to a content distribution network <b>530</b>. The content distribution network <b>530</b> distributes multiple streams including a variety of camera angles of the interactive event to multiple event clients <b>540</b> installed on user media devices. In one embodiment, event clients <b>540</b> are able to select a desired stream from the multiple streams received from the content distribution network and play the selected audio/visual stream. The event client <b>540</b> may be deployed on a user personal computer, television, personal music player, and/or other multimedia electronic device.
0044In various embodiments, the event client <b>540</b> may receive all of the potential streams from the content distribution network and may be configured to operate in at least one of three different modes. The first operational mode including rendering only the selected stream. In this first mode, only one stream is being buffered by the client and the other streams are either not buffered or ignored/discarded altogether. When a stream-switch request is signaled by the event client, the target (new) stream is buffered from scratch and the former stream is discarded.
0045The second operational mode including receiving partial or thumbnail non-selected streams, while receiving and rendering the full selected stream. In this second mode, one video and/or audio angle is selected and is considered primary, and is fully received and displayed. The other switchable streams are buffered slightly, received and reviewed in part or at lower bandwidth, and are displayed as animated thumbnails. When a stream switch signal is detected from a user camera button, the current primary stream becomes secondary and is relegated to a thumbnail and the target (new) stream is inflated to a fuller size and full bit rate reception.
0046The third operational mode including receiving full streams of all potential camera/microphone angles. In this third mode, all of the potential angles are received in full, regardless of how they are rendered. Even if secondary (non-selected) angles are rendered as thumbnails, the fact that the full-bit rate streams are receive and fully buffered results in a sense of “instant switching” from a client perspective. This scenario is generally only used in the most optimistic of network conditions with sufficient bandwidth availability.
0047Referring now to <figref idref="DRAWINGS">FIG. 6</figref>, a computer system is shown for implementing at least one embodiment of the invention, the system including a computing device <b>600</b> in which executable and operational data may be hosted and transmitted to one or more interactive stations via a communication network of the previously described online interactive event environment <b>300</b>. Computing device <b>600</b> may be configured as a client, a server, a mobile device, or any other computing device that interacts with data in a network based collaboration system.
0048In a very basic configuration, computing device <b>600</b> typically includes at least one processing unit <b>620</b>. In one embodiment, the processing unit <b>620</b> includes at least one processor. As such, the term “processor”, as used herein, should be interpreted to mean an individual processor, firmware logic, reconfigurable logic, a hardware description language logic configuration, a state machine, an application-specific integrated circuit, a processing core co-disposed in an integrated circuit package with at least one other processing core and/or component, or combinations thereof.
0049The processing unit <b>620</b> may be operably connected to system memory <b>610</b>. Depending on the exact configuration and type of computing device, system memory <b>610</b> may be non-volatile memory <b>611</b> (such as ROM, flash memory, etc.), volatile memory <b>614</b> (such as RAM), or some combination of the two. System memory <b>610</b> typically includes Basic Input/Output System (BIOS) firmware code <b>612</b>, an operating system <b>615</b>, one or more applications <b>616</b>, and may include program modules and data <b>617</b>. A configuration library <b>618</b> (e.g., registries), which contain code and data to be shared and changed in a modular or database fashion to provide services to applications <b>616</b> and programs <b>617</b> is also often included in system memory <b>610</b>.
0050Computing device <b>600</b> may have additional features or functionality. For example, computing device <b>600</b> may also have a dedicated graphics rendering device, such as video adapter <b>630</b> coupled with at least one display monitor <b>635</b>. Computing device <b>600</b> may also have a variety of human input device(s) (HID) <b>659</b> such as keyboard, mouse, pen, voice input device, touch input device, and the like. In a broader sense, human input device (HID) <b>659</b> may also include various output devices such as a display monitor <b>635</b>, speakers, printer, and the like. Computing device <b>600</b> may utilize a variety of ports via port interface <b>650</b> to share data including wireless ports <b>653</b>, parallel ports <b>655</b>, and serial ports <b>657</b>. Each of these port types may include further varieties, for example serial ports may include a Universal Serial Bus (USB) port and/or a FireWire/IEEE 1394 port.
0051In various embodiments, computing device <b>600</b> may also include a storage drive interface <b>640</b> for communication with additional data storage devices (removable and/or non-removable) such as, for example, magnetic disk drives <b>642</b>, optical disk drives <b>643</b>, hard disk drives <b>644</b>, tape drives, and other storage devices. Such additional storage is illustrated in <figref idref="DRAWINGS">FIG. 6</figref> by removable magnetic storage <b>641</b> and removable optical storage <b>649</b> and non-removable storage (hard disk drive <b>644</b>).
0052Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. System memory <b>610</b>, removable storage and non-removable storage are all examples of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM. EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computing device <b>600</b>. Any such computer storage media may be used to store desired information, such as operating system <b>645</b>, one or more applications <b>646</b>, programs <b>647</b>, and/or registries and configuration libraries <b>648</b> accessible to computing device <b>600</b>.
0053Computing device <b>600</b> may also contain a communication connection via port interface <b>650</b> and/or network interface card <b>660</b> that allows the device <b>600</b> to communicate with other remote computing devices <b>680</b>, such as over a communication network. The communication network may comprise a local area network (LAN) and/or a wide area network (WAN). Each network may be wired or wireless or combination thereof. The communication network may also comprise other large scale networks including, but not limited to, intranets and extranets, or combinations thereof. In one embodiment the communication network is an interconnected system of networks, one particular example of which is the Internet and the World Wide Web supported on the Internet.
0054A variety of configurations may be used to connect the computing device <b>600</b> to the remote computing devices <b>680</b>. For example, although modem <b>665</b> is illustrated as connecting to the remote computing device <b>680</b>, a remote server, via a WAN and network interface <b>660</b> is illustrated as connecting via a LAN, both the network interface <b>660</b> and/or the modem <b>665</b> may just as well be coupled to other large scale networks including, but not limited to, a global system of interconnected computer networks (internet), various intranets and extranets, or combinations thereof.
0055The information transmitted as data across the previously discussed communication connections are examples of communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. The term computer readable media as used herein includes both storage media and communication media.
0056Although many of the examples refer to computing devices with a single operating system, file system and configuration library, the concepts, principles, and examples disclosed below may be extended to provide interactive event functionality across several or many operating systems, file systems, and/or configurations libraries (e.g., registries). Accordingly, it is contemplated that the principles described herein may be applied to these and other computing systems and devices, both existing and yet to be developed, using the methods and principles disclosed herein.
0057The above specification, examples and data provide a complete description of the manufacture and use of the composition of the invention. Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art and others, that a wide variety of alternate and/or equivalent implementations may be substituted for the specific embodiment shown in the described without departing from the spirit and scope of the present disclosure. This application is intended to cover any adaptations or variations of the embodiments discussed herein. Therefore, it is manifested and intended that the disclosure be limited only by the claims and the equivalence thereof.
Contents6
8 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2003208613A1 | Cites | United States of America | Search report |
| US2004064838A1 | Cites | United States of America | Search report |
| US2004261127A1 | Cites | United States of America | Search report |
| US2004263636A1 | Cites | United States of America | Search report |
| US2005024488A1 | Cites | United States of America | Search report |
| US2005060751A1 | Cites | United States of America | Search report |
| US2005210505A1 | Cites | United States of America | Search report |
| US2006104600A1 | Cites | United States of America | Search report |
| US2007028272A1 | Cites | United States of America | Search report |
| US2007233785A1 | Cites | United States of America | Search report |
| US2008046910A1 | Cites | United States of America | Search report |
| US2008270541A1 | Cites | United States of America | Search report |
| US2008271082A1 | Cites | United States of America | Search report |
| US2008282286A1 | Cites | United States of America | Search report |
| US2009089683A1 | Cites | United States of America | Search report |
| US2009164876A1 | Cites | United States of America | Search report |
| US2009309975A1 | Cites | United States of America | Search report |
| US6317881B1 | Cites | United States of America | Search report |
| US7149549B1 | Cites | United States of America | Search report |
| US7196722B2 | Cites | United States of America | Search report |
| US7376388B2 | Cites | United States of America | Search report |
| US7478334B2 | Cites | United States of America | Search report |
| US7782363B2 | Cites | United States of America | Search report |
| US7796162B2 | Cites | United States of America | Search report |
| US7884855B2 | Cites | United States of America | Search report |
| US20030208613A1 | Cites | United States of America | Search report |
| US20040064838A1 | Cites | United States of America | Search report |
| US20040261127A1 | Cites | United States of America | Search report |
| US20040263636A1 | Cites | United States of America | Search report |
| US20050024488A1 | Cites | United States of America | Search report |
| US20050060751A1 | Cites | United States of America | Search report |
| US20050210505A1 | Cites | United States of America | Search report |
| US20060104600A1 | Cites | United States of America | Search report |
| US20070028272A1 | Cites | United States of America | Search report |
| US20070233785A1 | Cites | United States of America | Search report |
| US20080046910A1 | Cites | United States of America | Search report |
| US20080270541A1 | Cites | United States of America | Search report |
| US20080271082A1 | Cites | United States of America | Search report |
| US20080282286A1 | Cites | United States of America | Search report |
| US20090089683A1 | Cites | United States of America | Search report |
| US20090164876A1 | Cites | United States of America | Search report |
| US20090309975A1 | Cites | United States of America | Search report |
9 members in 1 office
Members9
| Document | Office | Kind | |
|---|---|---|---|
| US2010088128A1 | United States of America | A1 | |
| US2010088159A1 | United States of America | A1 | |
| US2010094686A1 | United States of America | A1 | |
| US2010153861A1 | United States of America | A1 | |
| US2012123811A1 | United States of America | A1 | |
| US8442424B2 | United States of America | B2 | |
| US2014237381A1 | United States of America | A1 | |
| US9160692B2 | United States of America | B2 | |
| US9548950B2This record | United States of America | B2 |
100 transactions on the USPTO file
Allowed after 2 non-final rejections, 2 final rejections, 1 RCE and 1 appeal.
- Non-final rejections
- 2
- Final rejections
- 2
- RCEs
- 1
- Appeals
- 1
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Expire PatentEXP. | EXP. | |
| Maintenance Fee Reminder MailedREM. | REM. | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail BPAI Decision on Appeal - ReversedMAPDR | MAPDR | |
| BPAI Decision - Examiner ReversedAPDR | APDR | |
| Email NotificationEML_NTR | EML_NTR | |
| Docketing Notice Mailed to AppellantAP_DK_M | AP_DK_M | |
| Assignment of Appeal NumberAPAS | APAS | |
| Appeal Awaiting BPAI DocketingAPWD | APWD | |
| Appeal ready for BPAI reviewARBP | ARBP | |
| Fee Payment Recorded (fees filed separately e.g. not with original papers, etc).FEE. | FEE. | |
| Reply Brief FiledAPRB | APRB | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Exam. Ans. Review CompletePACC | PACC | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Examiner's AnswerMAPEA | MAPEA | |
| Examiner's Answer to Appeal BriefAPEA | APEA | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Appeal Brief Review CompleteAPBR | APBR | |
| track 1 OFFT1OFF | T1OFF | |
| Appeal Brief FiledAP.B | AP.B | |
| Mail Appeals conf. Proceed to BPAIMAPCP | MAPCP | |
| Pre-Appeals Conference Decision - Proceed to BPAIAPCP | APCP | |
| Email NotificationEML_NTR | EML_NTR | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Correspondence Address ChangeC.AD | C.AD | |
| Request for Pre-Appeal Conference FiledAP.C | AP.C | |
| Notice of Appeal FiledN/AP | N/AP | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Advisory Action (PTOL - 303)MCTAV | MCTAV | |
| Interview Summary - Examiner Initiated - TelephonicEXET | EXET | |
| Interview Summary - Examiner InitiatedEXIE | EXIE | |
| Advisory Action (PTOL-303)CTAV | CTAV | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Mail Interview Summary - Applicant Initiated - TelephonicMEXAT | MEXAT | |
| Response after Final ActionA.NE | A.NE | |
| PILOT- Request for After Final Consideration ProgramRAFC | RAFC | |
| Interview Summary- Applicant InitiatedEXIA | EXIA | |
| Interview Summary - Applicant Initiated - TelephonicEXAT | EXAT | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Email NotificationEML_NTR | EML_NTR | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Correspondence Address ChangeC.AD | C.AD | |
| Correspondence Address ChangeC.AD | C.AD | |
| Correspondence Address ChangeC.AD | C.AD | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Transfer Inquiry to GAUTI1050 | TI1050 | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Sent to Classification ContractorPGPC | PGPC | |
| Filing Receipt - UpdatedFLRCPT.U | FLRCPT.U | |
| Applicant has submitted new drawings to correct Corrected Papers problemsCORRDRW | CORRDRW | |
| Payment of additional filing fee/PreexamFLFEE | FLFEE | |
| A statement by one or more inventors satisfying the requirement under 35 USC 115, Oath of the ApplicOATHDECL | OATHDECL | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Notice Mailed--Application Incomplete--Filing Date AssignedINCD | INCD | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Initial Exam Team nnIEXX | IEXX |
5 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Lapse for failure to pay maintenance feesLapsedPATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITYLAPS | LAPS | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITYFEPP | FEPP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF |
Numbers
- Publication
- 9548950
- Application
- 12586923
Titles
- English
- Switching camera angles during interactive events
Patent term adjustment
- A delay
- +854 daysthe office missed an examination deadline
- B delay
- +251 dayspendency past three years
- C delay
- +617 daysinterference, secrecy order or appeal
- Overlap
- −495 daysdelays counted once
- Applicant delay
- −358 days
- Net adjustment
- 869 days
Classification
- CPC, 11
- H04L51/046
- G06Q10/0637
- G06Q10/02
- G06F3/0484
- G06Q10/1093
- G06Q30/02
- G06Q30/0246
- G06Q30/0252
- G06Q30/0282
- G06Q30/0601
- H04N7/155
- IPC, 8
- H04L12 58
- H04N7 15
- G06F3 0484
- G06Q10 02
- G06Q10 06
- G06Q10 10
- G06Q30 02
- G06Q30 06
- USPC, 1
- 001001000