Non-persistent user interface for real-time communication
Claim Score by NHIP
Term
Term ended
Projected expiry passed 26 June 2023, 3.2 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
46 claims: 4 independent, 42 dependent
- 1In a computer system that supports real-time communication between a user of the computer system and one or more contacts, a method of making one or more user interfaces for real time communication less intrusive by automatically adjusting the one or more user interfaces based on the user's level of interaction, the method comprising acts of:displaying an intermediate representation of a user interface for real-time communication, the intermediate representation including a text input box and at least a portion of a received real-time message;upon receiving an increased level of interaction with the intermediate representation of the user interface, automatically enlarging the intermediate representation of the user interface to an enlarged representation appropriate for the increased level of interaction, wherein the enlarged representation includes the text input box;and upon receiving a decreased level of interaction with the intermediate representation of the user interface, automatically reducing the intermediate representation of the user interface to a reduced representation appropriate for the decreased level of interaction.
- 17Broadest claimClaim Score 50, average(NHIP)In a computer system that supports real-time communication between a user of the computer system and one or more contacts, a method of simplifying user interaction with one or more real time communication user interfaces by adapting the one or more user interfaces to the user's activity level, the method comprising steps for:monitoring user input directed to an initial representation of a user interface for real-time communication;and automatically adapting the initial representation of the user interface to the user's activity level based on the monitored user input, wherein adapting the initial representation produces at least one of an intermediate representation of the user interface that includes a text input box, a larger representation of the user interface that also includes the text input box, or a smaller representation of the user interface.
- 29For a computer system that supports real-time communication between a user of the computer system and one or more contacts, a computer program product comprising one or more computer readable media carrying computer executable instruction that implement a method of making one or more user interfaces for real time communication less intrusive by automatically adjusting the one or more user interfaces based on the user's level of interaction, the method comprising acts of:displaying an intermediate representation of a user interface for real-time communication, the intermediate representation including a text input box and at least a portion of a received real-time message;upon receiving an increased level of interaction with the intermediate representation of the user interface, automatically enlarging the intermediate representation of the user interface to an enlarged representation appropriate for the increased level of interaction, wherein the enlarged representation includes the text input box;and upon receiving a decreased level of interaction with the intermediate representation of the user interface, automatically reducing the intermediate representation of the user interface to a reduced representation appropriate for the decreased level of interaction.
- 38For a computer system that supports real-time communication between a user of the computer system and one or more contacts, a computer program product comprising one or more computer readable media carrying computer executable instructions that implement a method of simplifying user interaction with one or more real time communication user interfaces by adapting the one or more user interfaces to the user's activity level, the method comprising steps for:monitoring user input directed to an initial representation of a user interface for real-time communication;and automatically adapting the initial representation of the user interface to the user's activity level based on the monitored user input, wherein adapting the initial representation produces at least one of an intermediate representation of the user interface that includes a text input box, a larger representation of the user interface that also includes the text input box, or a smaller representation of the user interface.
Independent claims4
64 paragraphs in 4 sections, as filed
BACKGROUND OF THE INVENTION
P-0001[0001] 1. The Field of the Invention
P-0002[0002] The present invention relates to methods, systems and computer program products for real-time communication interfaces.
P-0003[0003] 2. The Relevant Technology
P-0004[0004] The popularity of the Internet and satellite-based technologies has enhanced the way people communicate with each other by allowing users quick and easy access to a virtually endless sea of communication methods. Any given person may now contact another person with greater or lesser immediacy using various media that include accessing the World Wide Web, electronic mail (email), satellite-based or Internet-based telephony, video conferencing, and instant text messaging. These methods allow people to stay in touch with each other, and to access information on a variety of subjects, in some cases instantly.
P-0005[0005] Currently, instant text messaging (IM) is one of the more popular forms of relatively immediate or real-time communication. Such real-time communication allows a user to communicate with another user within a matter of seconds. In operation, real-time communication interfaces typically display a selectable contact list. When a user desires to communicate with a contact in real-time, the user may select a contact from the contact list and send real-time text communications to the user. In so doing, the user's message usually is received by the contact within a second or two of being sent. This ability to communicate with other contacts in such a short time highlights a number of advantages instant text messaging has over other types of electronic messaging, such as email.
P-0006[0006] Real-time communication users converse with other contacts typically using a separate conversation interface for each contact (i.e., one-on-one session), or one conversation interface for multiple contacts (i.e., chat session). Messages appear in each conversation interface in time-dependant alternating segments. Thus, users can monitor continuous text conversations through one conversation interface, even after multiple iterations of sending and receiving responses. This ability allows for a fluid real-time conversation between users. Thus, real-time communication provide many conveniences compared with other messaging protocols such as electronic mail.
P-0007[0007] Despite such conveniences, FIG. 1 illustrates some significant impediments that remain with present real-time communication interfaces. As shown, a prior art monitor <b>100</b> with a desktop screen <b>102</b> may display application icons <b>104</b>, and several other open application interfaces. Such applications may include several different real-time communication applications <b>110</b>, <b>120</b>, and <b>130</b>, an email application <b>140</b>, and a word processing application <b>150</b>. The monitor <b>100</b> may also display one or more incoming message notifications, e.g., notifications <b>160</b> and <b>170</b>. These applications and notifications illustrate a significant problem in the prior art: intrusive notices and interfaces.
P-0008[0008] For example, incoming message notification <b>170</b> obstructs email interface <b>140</b>, which itself obstructs word processing application <b>150</b>. Email interface <b>140</b> and real-time communication interface <b>120</b> both obstruct real-time communication interface <b>130</b>. Instant messenger interface <b>110</b> and incoming message notification <b>160</b> simply occupy currently unused desktop screen real estate. As a result, for a user to monitor the real-time communication conversations <b>110</b>, <b>120</b>, and <b>130</b>, as well as to reference the word processing document <b>150</b> or email <b>140</b>, the user must toggle between each of the different interfaces. In addition to obstructing other interfaces, notification <b>170</b> requires explicit user interaction in order to dismiss the notification so that the user can proceed with other, potentially more pressing tasks. Notification <b>160</b> automatically fades from view after a predetermined amount of time, giving the user a limited amount of time to take any desired action.
P-0009[0009] Although notifications <b>160</b> and <b>170</b> may display part of a received real-time message, neither notification represents a user interface for real-time communication. Note, for example, that notifications <b>160</b> and <b>170</b> do not include a text input box or other input field for composing real-time messages. If a user decides to participate in a real-time conversation by interacting with notifications <b>160</b> and <b>170</b>, a separate user interface, such as user interfaces <b>110</b>, <b>120</b>, or <b>130</b>, is launched. Once launched, user interfaces <b>110</b>, <b>120</b>, and <b>130</b> remain a fixed (maximized) size, regardless of the amount of user interaction with each user interface. For example, user interface <b>120</b> displays as shown until explicitly resized, moved, closed, or minimized by a user.
P-0010[0010] A user may attempt to remedy the screen space and multiple interface issues by arranging or resizing the various application interfaces. In addition, the user may simply turn off incoming message notifications <b>160</b> and <b>170</b> in order to avoid distractions. While most present GUI-based operating systems provide this ability to arrange various interfaces selectively, having to explicitly interact with multiple user interfaces can be burdensome. Accordingly, methods, systems, and computer program products that make real-time communication user interfaces less intrusive by automatically adjusting the user interfaces based on a user's level of interaction are desired.
BRIEF SUMMARY OF THE INVENTION
P-0011[0011] The present invention relates to making user interfaces for real-time communication less intrusive by automatically adjusting the user interfaces based on the user's level of interaction. In accordance with example embodiments, an initial representation of a user interface for real-time communication is display and user input directed to the initial representation is monitored. The initial representation of the user interface is automatically adapted to the user's activity level based on the monitored user input. For example, the initial representation may be automatically adapted to an intermediate representation that includes a text input box, a larger representation that also includes the text input box, or a smaller representation. Because each contains a text input box, both the intermediate representation and the enlarged or larger representation can receive user input. Automatically adapting occurs without explicit user input to reduce or enlarge the initial representation, such as an explicit minimize, maximize, or resize input.
P-0012[0012] In an example embodiment, the initial representation is enlarged in response to hovering over or clicking on the initial representation. The initial representation may be reduced in response to a user sending a real-time message. For example, the user may compose a real-time message in the text input box of a larger representation of the user interface. Then, after the user sends the real-time message, the larger representation may be reduced automatically to the intermediate representation.
P-0013[0013] When the intermediate representation is reduced to the smaller representation, a message may be displayed to indicate the location of the smaller representation, which after reduction may be simply an icon. Subsequent real-time messages may be displayed next to the smaller representation, at least for a predetermined time, as they are received. Interacting with the displayed real-time messages for the smaller representation may cause the smaller representation to be enlarged to either an intermediate representation or the larger representation.
P-0014[0014] The initial representation of the user interface for real-time communication may be displayed in a desktop bar that also displays representations of other user interfaces, such as for a calendar, streaming audio or video, a contact list which allows custom identification information to be associated with individual contacts, etc. A user may initiate a real-time message to a contact by selecting the contact's representation, or dragging a computerized object, such as a file icon, and dropping the computerized object on the contact. As the initial representation is adapted, these other representations may be adapted as well. For example, as the initial representation enlarges, representations of one or more other user interfaces may be reduced. Similarly, as the initial representation reduces, the representations of the other user interfaces may be enlarged.
P-0015[0015] These and other objects and features of the present invention will become more fully apparent from the following description and appended claims, or may be learned by the practice of the invention as set forth hereinafter.
BRIEF DESCRIPTION OF THE DRAWINGS
P-0016[0016] To further clarify the above and other advantages and features of the present invention, a more particular description of the invention will be rendered by references to specific embodiments thereof, which are illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
P-0017[0017]FIG. 1 illustrates a prior art depiction of a computer screen having several applications open, including a plurality of real-time communication applications.
P-0018[0018]FIG. 2A illustrates an example embodiment of the present invention in connection with a word processing application.
P-0019[0019]FIG. 2B illustrates the example embodiment shown in FIG. 2A as a before and after sequence.
P-0020[0020]FIG. 3A illustrates a before and after sequence for an example real-time communication user interface in accordance with the present invention.
P-0021[0021]FIGS. 3B-3C illustrate example embodiments of a user interface for real-time communication in accordance with the present invention.
P-0022[0022]FIG. 4 illustrates an example of how a user may manipulate the user's representation within the present invention.
P-0023[0023]FIG. 5 illustrates a drag-and-drop operation using an example real-time communication interface in accordance with the present invention.
P-0024[0024]FIG. 6 shows one or more example embodiments of the present invention for a multi-media environment.
P-0025[0025]FIG. 7 illustrates example non-functional acts and functional steps for methods of making user interfaces for real-time communication less intrusive in accordance with the present invention.
P-0026[0026]FIG. 8 illustrates an example system that provides a suitable operating environment for the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
P-0027[0027] The present invention relates to simplifying user interaction with real time communication user interfaces by adapting the user interfaces to the user's activity level. Example embodiments of the present invention may comprise a special purpose or general-purpose computer including various computer hardware, as discussed in greater detail below. Embodiments within the scope of the present invention also include computer-readable media for carrying or having computer-executable instructions or data structures stored thereon. Such computer-readable media can be any available media that can be accessed by a general purpose or special purpose computer.
P-0028[0028] By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer. When information is transferred or provided over a network or another communication connection (either hardwired, wireless, or a combination of hardwired or wireless) to a computer, the computer properly views the connection as a computer-readable medium. Thus, any such connection is properly termed a computer-readable medium. Combinations of the above should also be included within the scope of computer-readable media. Computer-executable instructions comprise, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions.
P-0029[0029]FIG. 2A illustrates an example embodiment of the present invention in connection with a word processing application. Here the figure depicts a computer screen or desktop <b>202</b> with a user typing a letter <b>210</b> into word processing document <b>200</b>, which appears next to a desktop bar <b>220</b>. Although FIG. 2A shows desktop bar <b>220</b> at the right side of screen <b>202</b>, it should be appreciated that desktop bar <b>220</b> may be displayed in any portion of the screen <b>202</b> (side, top or bottom, etc.).
P-0030[0030] Desktop bar <b>220</b> (for FIGS. 2A and 2B) displays a user interface for a contact list that includes representations of the user, Bryan <b>230</b>, and of contacts Jena <b>240</b>, Mike <b>250</b>, and Kurt <b>260</b>. Each contact is represented by a name and a bullet point, such as with contact Jena <b>240</b>. FIG. 2A shows the user's (Bryan <b>230</b>) representation prominently above the other contacts, though such a placement is not required. An online count <b>222</b> indicates how many of the contacts are online. Other status information, including status information for individual contacts, also may be shown. For example, the contact representation for Mike <b>250</b> indicates that he is online, but has not interacted with a real-time communication interface (or some other type of measurement such as typing on his keyboard) for a predetermined period of time or has otherwise indicated that he is unavailable for real-time communication. Consequently, the contact representation for Mike <b>250</b> shows an altered bullet point and text <b>255</b> indicating he is “away” from his messaging device (i.e., computer, PDA, etc.).
P-0031[0031] Desktop bar <b>220</b> (in FIGS. 2A and 2B) also displays representations of a user interface for real-time communication (e.g., chat, instant messaging, etc.) that includes message text <b>242</b>, a text input box <b>270</b>, and a send option <b>272</b>. For this example embodiment, the user interface representation shown in FIG. 2A illustrates an intermediate representation of a user interface for real-time communication in a minimized state. As described in greater detail below, minimized does not necessarily mean the smallest possible state, but rather, an intermediate state that allows for user interaction with the intermediate representation with a minimal level of intrusion by the user interface. Compare this intermediate user interface representation, for example, with the smaller user interface representation <b>327</b> shown in FIG. 3A and the larger user interface representations <b>270</b> and <b>311</b> shown in FIGS. 2B (After), <b>3</b>B and <b>3</b>C.
P-0032[0032] Note, however, that intermediate, larger or enlarged, and smaller or reduced, are relative terms. Each qualifier should be evaluated relative to other representations of user interfaces for real-time communication. Also note that while minimized ordinarily refers to an icon and/or text representation of a currently running application or process, in the context of this application, minimized and minimized state also can be used to reference an intermediate representation of a user interface displayed in a desktop bar. In other words, minimizing a real-time communication user interface may be used to display the user interface in desktop bar <b>220</b>, rather than displaying the user interface as merely an icon and/or text.
P-0033[0033]FIG. 2A illustrates that user Bryan <b>230</b> is involved in a conversation with at least one other contact, Jena <b>240</b>. As shown, user Bryan <b>230</b> receives a real-time message <b>242</b> which appears below the list of contact representations, and within the desktop bar <b>220</b>. Thus, unlike FIG. 1, the example real-time communication interface for real-time communication that is illustrated in FIG. 2A does not obstruct the word processing document <b>200</b>. User Bryan <b>230</b> can monitor incoming real-time messages, such as message <b>242</b>, as they are received, and as described below, may respond via a text input box <b>270</b> and send option <b>272</b> without opening a new real-time communication user interface.
P-0034[0034]FIG. 2B illustrates before and after sequences of user Bryan <b>230</b> entering a real-time message in text input box <b>270</b>. In the “Before” sequence, user Bryan <b>230</b> begins entering text in text input box <b>270</b>. User Bryan's text, however, needs more space than is allotted in the “Before” depiction. Accordingly, the text input box <b>270</b> automatically enlarges or grows in the “After” depiction to allow user Bryan <b>230</b> more space for entering his response text. In other words, user Bryan does not need to explicitly resize the real-time communication user interface. Since the text input box <b>270</b> begins at a more minimal size (“Before”), and automatically enlarges or grows to fit the entire typed text (“After”), user Bryan <b>230</b> does not need scroll bars to see his entire real-time message.
P-0035[0035] The “After” representation of text input box <b>270</b> is an example of an enlarged or larger representation of a user interface for real-time communication. After user Bryan <b>230</b> sends his message, at least a portion of the text will appear under Jena's <b>240</b> message as part of a conversation history; and text input box <b>270</b> reduces or shrink back to its initial size. Among other things, automatically adjusting or adapting the text input box <b>270</b> of the real-time communication interface based on user interaction allows for a compact user interface layout that initially favors other applications, but gives way to an enlarged or larger user interface when the user's interaction with the real-time communication interface make an enlarged or larger user interface appropriate. This ability to automatically adjust a user interface based on a user's interaction with the user interface, as opposed to explicit resize, maximize or minimize input, represents a significant advancement, particularly in the context of real-time communication, where real-time messages may interrupt other activities.
P-0036[0036]FIG. 3A depicts additional example embodiments of the present invention in “Before” and “After” sequences of desktop bar <b>300</b>. Desktop bar <b>300</b> displays a representation of a user Bryan <b>310</b> and a contact list that includes contacts Jena <b>320</b>, Mike <b>330</b>, and Kurt <b>340</b>. Each contact has an associated user-definable icon or graphic <b>315</b>, <b>325</b>, <b>335</b>, and <b>345</b>. In FIG. 3A, user Bryan <b>310</b> is monitoring a real-time conversation between contacts Jena <b>320</b> and Mike <b>330</b>.
P-0037[0037] Because user Bryan <b>310</b> is monitoring (that is not actively participating and therefore having little or no interaction with) the real-time conversation between Jena <b>320</b> and Mike <b>330</b>, the user interface for the real-time communication is a reduced or smaller representation <b>327</b>. The reduced or small representation <b>327</b> allows other user interfaces, such as video newscast <b>360</b>, list of incoming emails <b>375</b>, the word processing application of FIG. 2A, etc., more space. The reduced or smaller representation <b>327</b> comprises an icon in the form of a balloon or conversation balloon, below newscast <b>360</b> and email list <b>375</b>.
P-0038[0038] Smaller or reduced user interface representations for real-time communication may take a variety of forms. Furthermore, the user may be offered one or more dynamic options based on whether a user hovers (e.g., places a cursor over the balloon) or selects the balloon (e.g., “clicks” on the balloon). Such dynamic options could include displaying a portion of the message, displaying an option to explicitly maximize the conversation window, an option to view the conversation history, an option to cancel the conversation session, etc. Of course, the invention is not limited to any of these examples.
P-0039[0039] Continuing with the “Before” sequence, Jena <b>320</b> sends Mike <b>330</b> a text message <b>322</b>. This message notification <b>322</b> for user Bryan may remain only for a predetermined time period. For example, if user Bryan <b>310</b> fails to interact with the message notification <b>322</b>, the message fades, and therefore is not shown in the “After” representation of desktop bar <b>300</b>. Interaction may comprise, e.g., “hovering” over the message, or selecting the message, as described with the conversation balloons above. After the message notification <b>322</b> fades, the sending contact's representation <b>325</b> in the “After” sequence may be highlighted, alerting user Bryan <b>310</b> to a received message. Here, for example icon <b>325</b> (“After”) is shown outlined, representing that Jena <b>320</b> has sent a real-time message that has not been viewed, selected, etc. by user Bryan <b>310</b>. One will appreciate that this sort highlighting may comprise a wide variety of methods such as bolding or outlining a representation, blinking a representation, inserting smaller textual notices near the representation, enlarging the representation, etc. Contact Mike <b>330</b> responds to contact Jena's message <b>322</b>, as shown in the FIG. 3A “After” sequence. Here too, the real-time communication interface places message <b>332</b> beside or adjacent to conversation representation <b>327</b>.
P-0040[0040]FIGS. 3B and 3C illustrate additional embodiments of a larger or enlarged real-time communication user interface <b>311</b>, which is maximized. In FIGS. 3B and 3C, the desktop bar <b>300</b> does not show the client's user name (e.g., Bryan <b>310</b>, FIG. 3A). FIGS. 3B and 3C do, however, show an online count <b>302</b>, as described above in FIGS. 2A-2B. As well, FIG. 3B shows a different user interface <b>380</b> for a calendar, rather than the email inbox <b>375</b> shown in FIG. 3A.
P-0041[0041] In FIG. 3B, the user interface or conversation window <b>311</b> is shown prominently on the desktop bar <b>300</b>. Note that the user interface <b>311</b> in this case is slightly larger than the overall desktop bar <b>300</b>, and includes conversation text <b>316</b>, as well as additional window options <b>312</b> and <b>314</b>. An enlarged conversation window <b>311</b> is appropriate here because the user is actively interacting with the real-time conversation, rather than simply monitoring. That is, since the user is directing his attention to the real-time <b>311</b> in this manner does not obstruct other interfaces with which the user might be otherwise interacting. The user also may explicitly direct that the message window <b>310</b> remain in an enhanced size, even though the user directs his attention elsewhere.
P-0042[0042] Continuing with FIG. 3B, the user interface <b>311</b> may present the typed text <b>316</b> such that the conversation lines appear in different horizontal offsets. Different horizontal offsets provide a visual cue regarding the identity of the participants. After a time, the user interface <b>311</b> may drop the contact names preceding the text after a time, and simply show the conversation in contact-specific horizontal offsets to identify the source of each real-time message. However, it should be recognized that there are a variety of ways the conversation window <b>311</b> may present the message text <b>316</b> to the user.
P-0043[0043] The user interface <b>311</b> may include the two window options <b>312</b> and <b>314</b> as shown, as well as additional options (not shown), and may provide the user with a variety of menu options. For example, option <b>312</b> may provide an option to display a conversation history, or may provide an option to move the conversation window upon selection (e.g., “clicking”) to make the conversation window appear as a separated interface (e.g., FIG. 3C). Upon a user's selection of option <b>314</b>, time and date properties may be displayed, etc. Window option <b>314</b> may provide similar options as window option <b>312</b>, or may provide a minimize function such that selection of the option <b>314</b> drops the conversation window into an iconic form (e.g., message balloon icon <b>327</b>, FIG. 3A) of docks the conversation window within desktop bar <b>300</b>.
P-0044[0044]FIG. 3C shows the case when the user selects the conversation window <b>311</b> to be separated from the desktop bar <b>300</b>. FIG. 3C, also shows that, as a result, another user interface, e.g., newscast <b>360</b>, may appear where the real-time communication user interface <b>311</b> resided previously. Newscast user interface <b>360</b> may automatically replace user interface <b>311</b> when the conversation window <b>311</b> is separated from the overall interface. Alternatively, desktop bar <b>300</b> may show a blank spot where the user can optionally insert the newscast user interface <b>360</b> some other user interface.
P-0045[0045] In addition, these various, optional user interfaces may enlarge or reduce based on adjustments made existing conversation window <b>311</b>. For example, in FIG. 3B, calendar object <b>380</b> is shown below real-time communication user interface <b>311</b> with three two-hour blocks. When the user interface <b>311</b> is removed or reduced in some way (e.g., FIG. 3C), the calendar <b>380</b> may automatically enlarge as shown in FIG. 3C, to show a five two-hour blocks or to display more information. Accordingly, the various user interfaces, such as newscast <b>360</b> (streaming video), streaming audio (not shown), calendar <b>380</b>, and email object <b>375</b> may automatically adjust or adapt based on the real-time communication user interface, or may be adjusted manually by the user as is common in graphical user interfaces.
P-0046[0046]FIG. 4 shows one embodiment of how a user may alter or customize his representation of others in a contacts interface for real-time communication. The figure depicts a contact interface <b>400</b> with user Bryan <b>410</b>, contacts <b>420</b>, <b>430</b>, and <b>440</b> and respective iconic representations <b>415</b>, <b>425</b>, <b>435</b>, and <b>445</b>. FIG. 4 also depicts a modification user interface <b>450</b> with a textual appearance option <b>452</b> and an image or graphic appearance option <b>455</b>, including a custom image selection option <b>457</b>.
P-0047[0047] In practice, a user, e.g. user Bryan <b>410</b>, may change the user's appearance to other contacts, e.g. <b>420</b>, <b>430</b>, <b>440</b>, by typing a user name in the text input option <b>452</b>. To do so, the application software, may present a user, e.g. user Bryan <b>410</b>, with several options <b>455</b> including using (or altering) a default icon, or selecting a custom image. It should be appreciated, however, that customized text, icons, and graphics are merely examples of manipulating a user's representation of others.
P-0048[0048]FIG. 5 illustrates at least one method by which a user, e.g. user Bryan <b>510</b> may initiate a real-time communication with another user, using a typical “drag and drop” method. “Drag and drop” is a phrase referring to selecting and moving objects (and, in some cases executing files or commands) with a cursor in a graphical user interface. FIG. 5 depicts a desktop bar <b>500</b> for user Bryan <b>510</b>, with a contact list comprising contacts Jena <b>520</b>, Mike <b>530</b>, and Kurt <b>540</b>. Each user or contact has a respective graphical or iconic representation <b>515</b>, <b>525</b>, <b>535</b>, and <b>545</b>. The figure depicts user Bryan <b>510</b> sending a real-time communication to Kurt <b>540</b> by “dragging and dropping” a file <b>550</b> onto Kurt's <b>540</b> representation <b>545</b>. Of course, Bryan <b>510</b> may initiate the message by dropping the file onto Kurt's name. Either way, this action initiates a new real-time message window <b>568</b> that comprises the document <b>550</b> and an option to send accompanying text, or alternatively may add a file icon in the send portion of an existing real-time communication user interface such that a new message window <b>568</b> is not opened.
P-0049[0049]FIG. 6 illustrates a variety of embodiments of the present invention in the context of multi-media such as audio and/or video messaging. As described in more detail below, desktop <b>602</b> includes three enlarged user interface representations <b>615</b> (text only), <b>645</b> (audio), and <b>685</b> (video), along with reduced user interface representations <b>610</b>, <b>640</b> or <b>650</b>, and <b>680</b> or <b>690</b> that each appear below their corresponding enlarged user interface representation. In accordance with the present invention, the example real-time communication interfaces illustrated in FIG. 6 are capable of automatically adapting to the user's activity level based on monitored user input to help make the user interface less intrusive. Of course, a user also may switch between the enlarged and reduced representations with explicit input, such as a maximize input, a minimize input, etc. Note that each of the enlarged and reduced representations alternatively may be displayed within desktop bar <b>600</b>. Similar FIGS. 2A-2B, desktop bar <b>600</b> shows an online count indicator <b>622</b>, user Bryan <b>630</b>, and a list of contacts including Jena <b>640</b>, Mike <b>650</b>, and Kurt <b>660</b>. Since the real-time message user interface is separated from the desktop bar <b>600</b>, newscast user interface <b>665</b> and email user interface <b>675</b> fill the remaining space.
P-0050[0050] Each of the enlarged user interface representations <b>615</b>, <b>645</b>, and <b>685</b> show examples of some options and capabilities that a real-time communication user interfaces may provide. For clarity, however, most common options are numbered, and will be described, only with respect to user interface representation <b>615</b>. User interface representation <b>615</b> includes a window minimize button <b>608</b>, a window maximize button <b>604</b>, a window close button <b>606</b>, and an interface minimize button <b>618</b>. For enlarged user interface representation <b>615</b>, <b>645</b>, and <b>685</b>, the window minimize button <b>608</b> may serve to reduce the conversation window to corresponding conversation windows <b>610</b>, <b>640</b> or <b>650</b>, and <b>680</b> or <b>690</b>; the window maximize button <b>604</b> may serve to enlarge the conversation windows to a larger size if they have been previously reduced or resized or may display the conversation history; and the window exit button <b>606</b> may serve to close the conversation entirely. The interface minimize button <b>618</b> may be designed to perform the same function as window minimize button <b>608</b>, or may dock conversation windows <b>615</b>, <b>645</b>, and <b>685</b> to the desktop bar <b>600</b>.
P-0051[0051] Conversation window <b>615</b> also includes a menu button <b>622</b> that may provide a list of additional interface options, a webcam button <b>624</b> that may provide an option for audio messaging (e.g., conversation window <b>645</b>) or video messaging (e.g., conversation window <b>685</b>), and a send file button <b>626</b> for adding a file to a real-time message. A format and emoticon toolbar <b>612</b>, a text entry box <b>614</b>, and at least a portion of the ongoing text conversation <b>620</b> show toward the bottom of conversation window <b>615</b>.
P-0052[0052] For an audio conversation, e.g. audio conversation window <b>645</b>, the real-time communication user interface may provide additional audio controls <b>632</b> to adjust the volume, speakers, or quit the audio conversation. The audio conversation window <b>645</b> shows that audio and text chat may be combined into a single interface, and may be reduced into alternative audio user interfaces, e.g., window <b>640</b> or window <b>650</b>, which may represent minimized representations of conversation window <b>645</b>. Conversation windows <b>640</b> and <b>650</b> merely illustrate one example of the extent to which optional controls may be included in a reduced audio conversation window <b>645</b>. Note that audio conversation window <b>650</b> also includes a window minimize button <b>604</b> and a window maximize button <b>606</b>.
P-0053[0053] Similar to audio conversation window <b>645</b>, video conversation window <b>685</b> provides audio controls <b>632</b> to adjust the volume, speakers, or quit the audio portion of the real-time video messaging communication. Video conversation window <b>685</b> includes video stream <b>672</b>, shows a text entry box <b>614</b> and an ongoing text conversation history <b>620</b> for combined real-time text and video messages. As in the case of the other conversation windows <b>615</b> and <b>645</b>, a user may reduce the video conversation window <b>685</b> into smaller user interfaces, e.g. video conversations windows <b>680</b> and <b>690</b>. Like smaller audio conversation windows <b>640</b> and <b>650</b>, smaller video conversation windows <b>680</b> and <b>690</b> illustrate merely one example of the extent to which optional controls may be included in a reduced video conversation window <b>685</b>. Note that video conversation window <b>690</b> also includes window minimize and maximize buttons <b>604</b> and <b>606</b>.
P-0054[0054] The present invention also may be described in terms of methods comprising functional steps and/or non-functional acts. The following is a description of acts and steps that may be performed in practicing the present invention. Usually, functional steps describe the invention in terms of results that are accomplished, whereas non-functional acts describe more specific actions for achieving a particular result. Although the functional steps and non functional acts may be described or claimed in a particular order, the present invention is not necessarily limited to any particular ordering or combination of acts and/or steps.
P-0055[0055]FIG. 7 shows example acts and steps for methods of making one or more user interfaces for real time communication less intrusive by automatically adjusting the one or more user interfaces based on the user's level of interaction in accordance with the present invention. A step for monitoring (<b>710</b>) user input directed to an initial representation of a user interface for real-time communication may include an act of displaying (<b>712</b>) an intermediate representation of the user interface that includes a text input box and a least a portion of a received real-time message. A step for automatically adapting (<b>730</b>) the initial representation of the user interface to the user's activity level based on the monitored input may include an act of automatically enlarging (<b>724</b>) an intermediate representation of the user interface upon receiving an increased level of interaction with the intermediate representation and an act of automatically reducing (<b>722</b>) the intermediate representation of the user interface upon receiving a decreased level of interaction with the intermediate representation.
P-0056[0056] A step for automatically adapting (<b>730</b>) one or more other user interfaces to account for size changes in the initial representation of the user interface may include an act of automatically reducing or enlarging (<b>732</b>) the one or more other user interfaces when the initial representation is enlarged or reduced. When a user interface representation is reduced, a step for indicating (<b>740</b>) the location of the reduced representation may include an act of displaying (<b>742</b>) a message that indicates where the reduced representation is located. For reduced user interface representations, such as a user interface that has been reduced to an icon, received real-time messages may be displayed (<b>752</b>) adjacent to the reduced representation.
P-0057[0057]FIG. 8 and the following discussion are intended to provide a brief, general description of a suitable computing environment in which the invention may be implemented. Although not required, the invention will be described in the general context of computer-executable instructions, such as program modules, being executed by computers in network environments. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of the program code means for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps.
P-0058[0058] Those skilled in the art will appreciate that the invention may be practiced in network computing environments with many types of computer system configurations, including personal computers, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where local and remote processing devices perform tasks and are linked (either by hardwired links, wireless links, or by a combination of hardwired or wireless links) through a communication network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
P-0059[0059] With reference to FIG. 8, an exemplary system for implementing the invention includes a general-purpose computing device in the form of a conventional computer <b>820</b>, including a processing unit <b>821</b>, a system memory <b>822</b>, and a system bus <b>823</b> that couples various system components including the system memory <b>822</b> to the processing unit <b>821</b>. The system bus <b>823</b> may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. The system memory includes read only memory (ROM) <b>824</b> and random access memory (RAM) <b>825</b>. A basic input/output system (BIOS) <b>826</b>, containing the basic routines that help transfer information between elements within the computer <b>820</b>, such as during start-up, may be stored in ROM <b>824</b>.
P-0060[0060] The computer <b>820</b> may also include a magnetic hard disk drive <b>827</b> for reading from and writing to a magnetic hard disk <b>839</b>, a magnetic disk drive <b>828</b> for reading from or writing to a removable magnetic disk <b>829</b>, and an optical disc drive <b>830</b> for reading from or writing to removable optical disc <b>831</b> such as a CD ROM or other optical media. The magnetic hard disk drive <b>827</b>, magnetic disk drive <b>828</b>, and optical disc drive <b>830</b> are connected to the system bus <b>823</b> by a hard disk drive interface <b>832</b>, a magnetic disk drive-interface <b>833</b>, and an optical drive interface <b>834</b>, respectively. The drives and their associated computer-readable media provide nonvolatile storage of computer-executable instructions, data structures, program modules and other data for the computer <b>820</b>. Although the exemplary environment described herein employs a magnetic hard disk <b>839</b>, a removable magnetic disk <b>829</b> and a removable optical disc <b>831</b>, other types of computer readable media for storing data can be used, including magnetic cassettes, flash memory cards, digital versatile disks, Bernoulli cartridges, RAMs, ROMs, and the like.
P-0061[0061] Program code means comprising one or more program modules may be stored on the hard disk <b>839</b>, magnetic disk <b>829</b>, optical disc <b>831</b>, ROM <b>824</b> or RAM <b>825</b>, including an operating system <b>835</b>, one or more application programs <b>836</b>, other program modules <b>837</b>, and program data <b>838</b>. A user may enter commands and information into the computer <b>820</b> through keyboard <b>840</b>, pointing device <b>842</b>, or other input devices (not shown), such as a microphone, joy stick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit <b>821</b> through a serial port interface <b>846</b> coupled to system bus <b>823</b>. Alternatively, the input devices may be connected by other interfaces, such as a parallel port, a game port or a universal serial bus (USB). A monitor <b>847</b> or another display device is also connected to system bus <b>823</b> via an interface, such as video adapter <b>848</b>. In addition to the monitor, personal computers typically include other peripheral output devices (not shown), such as speakers and printers.
P-0062[0062] The computer <b>820</b> may operate in a networked environment using logical connections to one or more remote computers, such as remote computers <b>849</b><i>a </i>and <b>849</b><i>b</i>. Remote computers <b>849</b><i>a </i>and <b>849</b><i>b </i>may each be another personal computer, a server, a router, a network PC, a peer device or other common network node, and typically include many or all of the elements described above relative to the computer <b>820</b>, although only memory storage devices <b>850</b><i>a </i>and <b>850</b><i>b </i>and their associated application programs <b>836</b><i>a </i>and <b>836</b><i>b </i>have been illustrated in FIG. 8. The logical connections depicted in FIG. 8 include a local area network (LAN) <b>851</b> and a wide area network (WAN) <b>852</b> that are presented here by way of example and not limitation. Such networking environments are commonplace in office-wide or enterprise-wide computer networks, intranets and the Internet.
P-0063[0063] When used in a LAN networking environment, the computer <b>820</b> is connected to the local network <b>851</b> through a network interface or adapter <b>853</b>. When used in a WAN networking environment, the computer <b>820</b> may include a modem <b>854</b>, a wireless link, or other means for establishing communication over the wide area network <b>852</b>, such as the Internet. The modem <b>854</b>, which may be internal or external, is connected to the system bus <b>823</b> via the serial port interface <b>846</b>. In a networked environment, program modules depicted relative to the computer <b>820</b>, or portions thereof, may be stored in the remote memory storage device. It will be appreciated that the network connections shown are exemplary and other means of establishing communication over wide area network <b>852</b> may be used.
P-0064[0064] The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.
Contents4
11 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US8726190B2 | Cited by | United States of America | Applicant |
| US11036368B1 | Cited by | United States of America | Search report |
| US11588914B2 | Cited by | United States of America | Search report |
| US9967399B2 | Cited by | United States of America | Applicant |
| US10067639B2 | Cited by | United States of America | Applicant |
| US7159192B2 | Cited by | United States of America | Search report |
| US10665017B2 | Cited by | United States of America | Applicant |
| US9071464B2 | Cited by | United States of America | Search report |
| US8583086B2 | Cited by | United States of America | Search report |
| US9800817B2 | Cited by | United States of America | Applicant |
| US2002057299A1 | Cited by | United States of America | Pre-grant |
| US9449349B2 | Cited by | United States of America | Search report |
| US10366153B2 | Cited by | United States of America | Applicant |
| US8959330B2 | Cited by | United States of America | Applicant |
| US9373143B2 | Cited by | United States of America | Search report |
| US9874990B2 | Cited by | United States of America | Search report |
| US8285982B2 | Cited by | United States of America | Applicant |
| US2010082539A1 | Cited by | United States of America | Pre-grant |
| US2005261011A1 | Cited by | United States of America | Pre-grant |
| US8601391B2 | Cited by | United States of America | Search report |
| US10152190B2 | Cited by | United States of America | Search report |
| US2012254777A1 | Cited by | United States of America | Pre-grant |
| EP3567838A1 | Cited by | European Patent Office (EPO) | Search report |
| US11435882B2 | Cited by | United States of America | Applicant |
| US8661349B2 | Cited by | United States of America | Applicant |
| US10791191B2 | Cited by | United States of America | Search report |
| US11921967B2 | Cited by | United States of America | Search report |
| US11507244B2 | Cited by | United States of America | Applicant |
| EP2712165A1 | Cited by | European Patent Office (EPO) | Search report |
| US2017083168A1 | Cited by | United States of America | Search report |
| US10628969B2 | Cited by | United States of America | Applicant |
| US12034686B2 | Cited by | United States of America | Applicant |
| US7802206B1 | Cited by | United States of America | Search report |
| US8640035B2 | Cited by | United States of America | Applicant |
| US7222303B2 | Cited by | United States of America | Applicant |
| US2011012930A1 | Cited by | United States of America | Pre-grant |
| US2012246246A1 | Cited by | United States of America | Pre-grant |
| US10785440B2 | Cited by | United States of America | Applicant |
| US2015012881A1 | Cited by | United States of America | Pre-grant |
| US11726642B2 | Cited by | United States of America | Applicant |
| US2007162867A1 | Cited by | United States of America | Pre-grant |
| US11314372B2 | Cited by | United States of America | Search report |
| US7627828B1 | Cited by | United States of America | Search report |
| US2015012881A1 | Cited by | United States of America | Search report |
| US2004150673A1 | Cited by | United States of America | Pre-grant |
| US11019011B1 | Cited by | United States of America | Applicant |
| EP3846015A4 | Cited by | European Patent Office (EPO) | Search report |
| US9272210B2 | Cited by | United States of America | Applicant |
| US2014372911A1 | Cited by | United States of America | Pre-grant |
| US9766903B2 | Cited by | United States of America | Search report |
| EP2063609A3 | Cited by | European Patent Office (EPO) | Search report |
| US7747265B1 | Cited by | United States of America | Applicant |
| US8341533B2 | Cited by | United States of America | Search report |
| US2008307322A1 | Cited by | United States of America | Pre-grant |
| US8677250B2 | Cited by | United States of America | Search report |
| US2005289180A1 | Cited by | United States of America | Pre-grant |
| US2010077302A1 | Cited by | United States of America | Pre-grant |
| US10901611B2 | Cited by | United States of America | Applicant |
| US7712049B2 | Cited by | United States of America | Search report |
| US2011196812A1 | Cited by | United States of America | Pre-grant |
| US2013212466A1 | Cited by | United States of America | Pre-grant |
| US10033855B2 | Cited by | United States of America | Search report |
| US10416878B2 | Cited by | United States of America | Search report |
| US2013167012A1 | Cited by | United States of America | Pre-grant |
| US2018041730A1 | Cited by | United States of America | Applicant |
| US2013135235A1 | Cited by | United States of America | Pre-grant |
| FR3050891A1 | Cited by | France | Search report |
| US2010083192A1 | Cited by | United States of America | Pre-grant |
| US2011077084A1 | Cited by | United States of America | Pre-grant |
| US8677286B2 | Cited by | United States of America | Search report |
| US10606438B2 | Cited by | United States of America | Applicant |
| US2017123650A1 | Cited by | United States of America | Search report |
| CN102752234A | Cited by | China | Search report |
| US2022214774A1 | Cited by | United States of America | Search report |
| US2014058921A1 | Cited by | United States of America | Pre-grant |
| US2009276700A1 | Cited by | United States of America | Pre-grant |
| US9414003B2 | Cited by | United States of America | Applicant |
| US2010058203A1 | Cited by | United States of America | Pre-grant |
| US7317919B1 | Cited by | United States of America | Search report |
| US2007040891A1 | Cited by | United States of America | Pre-grant |
| US11546280B2 | Cited by | United States of America | Applicant |
| US2013097535A1 | Cited by | United States of America | Pre-grant |
| EP3242188A1 | Cited by | European Patent Office (EPO) | Search report |
| US10254830B2 | Cited by | United States of America | Search report |
| US2010267369A1 | Cited by | United States of America | Pre-grant |
| US8838713B2 | Cited by | United States of America | Search report |
| US8099395B2 | Cited by | United States of America | Applicant |
| US10713846B2 | Cited by | United States of America | Applicant |
| US2013073990A1 | Cited by | United States of America | Pre-grant |
| US8856663B2 | Cited by | United States of America | Search report |
| US10269179B2 | Cited by | United States of America | Applicant |
| US10298872B2 | Cited by | United States of America | Applicant |
| US11054968B2 | Cited by | United States of America | Applicant |
| US9542019B2 | Cited by | United States of America | Search report |
| US8185593B2 | Cited by | United States of America | Search report |
| US10795530B2 | Cited by | United States of America | Applicant |
| US2009307606A1 | Cited by | United States of America | Pre-grant |
| US2021203737A1 | Cited by | United States of America | Search report |
| US2014351713A1 | Cited by | United States of America | Pre-grant |
| CN104471598A | Cited by | China | Search report |
2 members in 1 office; this record represents the family
Members2
| Document | Office | Kind | |
|---|---|---|---|
| US2004268263A1 | United States of America | A1 | |
| US7568167B2 | United States of America | B2 |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| AssignmentAS | AS | |
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Lapse for failure to pay maintenance feesLapsedLAPS | LAPS | |
| Maintenance fee reminder mailedREMI | REMI | |
| Fee payment procedurePAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| AssignmentAS | AS |
Numbers
- Application
- 60649403
Titles
- English
- Non-persistent user interface for real-time communication
Classification
- CPC, 2
- G09G5/14
- G09G2340/0407
- IPC, 3
- G09G5 00
- G09G5 14
- H04M3 42
