Multimedia output and display device selection
Claim Score by NHIP
Abstract
Systems and methods for configuring, identifying, and selecting a desired display device of one or more display devices for multimedia output are provided. In one embodiment, a spatial orientation, display device identifier, and one or more connectivity identifiers are associated with each of one or more display devices. The associated data for each of the one or more display devices is stored in as configuration data in a configuration database for subsequent use in selecting a desired display device.

Term
Projected expiry 9 April 2034.
- Priority
- Filed
- Published
- Today
- Projected expiry
20 claims: 3 independent, 17 dependent
- 1Broadest claimClaim Score 56, average(NHIP)A method for configuring a multimedia environment, comprising:receiving from a first display device and a second display device display device information, the display device information comprising a display device identifier and a network connectivity, at a configuration device coupled to the first display device and the second display device over a network connection;identifying a spatial orientation associated with each of the first display device and the second display device;associating the identified spatial orientations with the received display device information for the first display device and the second display device;and storing the associated spatial orientations and display device information for the first display device and the second display device as configuration data in a configuration database.
- 9A system for configuring a multimedia environment, comprising:a first display device and a second display device within the multimedia environment wherein the first display device and second display device includes display device information, comprising a display device identifier and a network connectivity;a configuration device within the multimedia environment, the configuration device coupled to the first display device and the second display device over a network, the configuration device programmed to: receive from each of the first display device and the second display device the display device information;identify a room spacing alignment corresponding to each of the first display device and the second display device;associate the identified room spacing alignment with the received display device information for each of the first display device and the second display device;and store the associated identified room spacing alignment and received display device information for the first display device and the second display device as configuration data in a configuration database.
- 17A configuration device, comprising:an orientation determining component configured to determine a room spacing alignment for a first display device and a second display device in an environment;an audio emission component configure to emit audio signals;a logic subsystem;a memory subsystem holding instructions executable by the logic subsystem to: receive from a first display device and a second display device display device information;identify a room spacing alignment for the first display device and the second display device;associate the identified room spacing alignment with the received display device information for the first display device and the second display device;and store the associated identified room spacing alignment and received display device information for the first display device and the second display device as configuration data in a configuration database.
Independent claims3
160 paragraphs in 4 sections, as filed
CROSS REFERENCE TO RELATED APPLICATIONS
0001The present application is a continuation-in-part of U.S. patent application Ser. No. 13/838,707, entitled “MULTIMEDIA OUTPUT AND DISPLAY DEVICE SELECTION,” filed on Mar. 15, 2013, the entire contents of which are hereby incorporated by reference for all purposes.
BACKGROUND AND SUMMARY
0002The creation and consumption of multimedia content (e.g., photographs, music, video, etc.) is increasingly expanding and diversifying, as are the devices used to carry out such actions. In multimedia environments, for example in the home, professional, and other environments, users can expect to encounter a plurality of electronic devices used to develop and process multimedia content. As such, both the configuration and use of such devices in an environment may be time-consuming, cumbersome, and unintuitive. Device-specific means (e.g., a device-specific remote) may be required to address each device, for example. Additionally, users often must spend a considerable amount of time configuring display devices in a conference room for a multimedia presentation so that a source device supplying multimedia content can correctly address a desired display device among a plurality of display devices. This connectivity difficulty becomes even more difficult in settings where there is more than one display device. A user may be forced to manually enter the information to link to a specific display device and such manual entry may be time consuming and cumbersome due to differences in the device-specific configurations.
0003To address at least some of the above issues, the inventors herein provide systems and methods for environment configuration, and identifying and selecting a desired display device out of one or more display devices for multimedia output. In one embodiment, a respective identifying spatial orientation and one or more connectivity identifiers are associated with each of one or more display devices. A respective selecting spatial orientation is then received. The respective selecting spatial orientation is matched to the respective identifying spatial orientation to thereby determine the desired display device from the one or more display devices. Multimedia content is then routed from a source device to the desired display device via one of the one or more associated connectivity identifiers.
0004This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
BRIEF DESCRIPTION OF THE FIGURES
0005<figref idref="DRAWINGS">FIG. 1A</figref> shows an embodiment of a multimedia environment in accordance with an embodiment of the present disclosure.
0006<figref idref="DRAWINGS">FIG. 1B</figref> shows an example schematic diagram of network connections between devices during configuration.
0007<figref idref="DRAWINGS">FIG. 2</figref> shows a schematic diagram of a selection device in accordance with an embodiment of the present disclosure.
0008<figref idref="DRAWINGS">FIG. 3A</figref> shows a plan view of another multimedia environment in accordance with an embodiment of the present disclosure.
0009<figref idref="DRAWINGS">FIG. 3B</figref> shows a partial view of yet another multimedia environment in accordance with an embodiment of the present disclosure.
0010<figref idref="DRAWINGS">FIGS. 3C and 3D</figref> show a plan view and a partial view of yet another multimedia environment in accordance with an embodiment of the present disclosure.
0011<figref idref="DRAWINGS">FIG. 3E</figref> show a schematic for mapping display devices by measuring reference sources in a multimedia environment in accordance with an embodiment of the present disclosure.
0012<figref idref="DRAWINGS">FIGS. 3F and 3G</figref> show a schematic map for display devices in a multimedia environment.
0013<figref idref="DRAWINGS">FIG. 4A</figref> shows an example method for environment configuration of a multimedia environment.
0014<figref idref="DRAWINGS">FIG. 4B</figref> shows an example method for selection in a multimedia environment.
0015<figref idref="DRAWINGS">FIG. 4C</figref> shows an example method for displaying in a multimedia environment.
0016<figref idref="DRAWINGS">FIG. 4D</figref> shows an example method for configuring a device to identify and select one or more display devices for multimedia content output in accordance with an embodiment of the present disclosure.
0017<figref idref="DRAWINGS">FIG. 4E</figref> shows an example method for selecting display devices for multimedia content output in accordance with an embodiment of the present disclosure.
0018<figref idref="DRAWINGS">FIG. 5A</figref> shows an exemplary configuration application having a graphical user interface in accordance with an embodiment of the present disclosure.
0019<figref idref="DRAWINGS">FIG. 5B</figref> shows an exemplary control application having a graphical user interface in accordance with an embodiment of the present disclosure.
0020<figref idref="DRAWINGS">FIG. 6</figref> shows an exemplary display identifier in accordance with an embodiment of the present disclosure.
0021<figref idref="DRAWINGS">FIG. 7</figref> shows an exemplary pointing device in accordance with an embodiment of the present disclosure.
0022<figref idref="DRAWINGS">FIG. 8</figref> shows an example method for configuring the pointing device of <figref idref="DRAWINGS">FIG. 7</figref> to identify one or more display devices in accordance with an embodiment of the present disclosure.
0023<figref idref="DRAWINGS">FIG. 9</figref> shows an example method for selecting display devices for multimedia content output with the pointing device of <figref idref="DRAWINGS">FIG. 7</figref> in accordance with an embodiment of the present disclosure.
0024<figref idref="DRAWINGS">FIGS. 10A and 10B</figref> shows an example method for routing multimedia content to a desired display device which may be implemented in the environment of <figref idref="DRAWINGS">FIG. 1A</figref> according to an embodiment of the present disclosure.
0025<figref idref="DRAWINGS">FIG. 11</figref> shows an example method for configuring a source device to identify and select one or more display devices for multimedia content output in accordance with an embodiment of the present disclosure.
DETAILED DESCRIPTION
0026The present disclosure will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. The particular embodiment(s) is merely exemplary in nature and is in no way intended to limit the scope of the invention, its application, or uses, which may, of course, vary. The invention is described with relation to the non-limiting definitions and terminology included herein. These definitions and terminology are not designed to function as a limitation on the scope or practice of the invention but are presented for illustrative and descriptive purposes only. While the systems or methods are described as an order of individual steps or using specific devices, it is appreciated that steps or devices may be interchangeable such that the description of the invention may include multiple steps or devices arranged in many ways.
0027The present disclosure provides systems and methods for configuring, identifying and selecting a desired display device of one or more display devices for multimedia output. In one embodiment, a respective identifying spatial orientation and one or more connectivity identifiers are associated with each of one or more display devices. A respective selecting spatial orientation is then received. The respective selecting spatial orientation is matched to the respective identifying spatial orientation to thereby determine the desired display device from the one or more display devices. Multimedia content is then routed from a source device to the desired display device via one of the one or more associated connectivity identifiers.
0028<figref idref="DRAWINGS">FIG. 1A</figref> shows an embodiment of a multimedia environment in accordance with an embodiment of the present disclosure. <figref idref="DRAWINGS">FIG. 1B</figref> shows an example schematic diagram of possible network connections between devices in a multimedia environment. <figref idref="DRAWINGS">FIG. 2</figref> shows a schematic diagram of a selection device which may be used to identify and/or select display devices in the environment of <figref idref="DRAWINGS">FIG. 1A</figref>. <figref idref="DRAWINGS">FIG. 3A</figref> shows a plan view of another multimedia environment, while <figref idref="DRAWINGS">FIG. 3B</figref> shows a partial view of yet another multimedia environment. <figref idref="DRAWINGS">FIGS. 3C and 3D</figref> show a plan view and partial view of yet another multimedia environment. <figref idref="DRAWINGS">FIG. 3E</figref> shows a schematic for mapping display devices by measuring reference points in a multimedia environment in accordance with an embodiment of the present disclosure. <figref idref="DRAWINGS">FIGS. 3F and 3G</figref> show schematic maps for display devices relative to a selection device in a multimedia environment. <figref idref="DRAWINGS">FIGS. 4A</figref>, <b>4</b>B and <b>4</b>C show example methods for environment configuration, selection, and displaying in a multimedia environment. <figref idref="DRAWINGS">FIG. 4D</figref> shows a method for configuring device to identify and select one or more display devices for multimedia content, while <figref idref="DRAWINGS">FIG. 4E</figref> shows a method for selecting display devices for multimedia content output. <figref idref="DRAWINGS">FIG. 5A</figref> shows an exemplary configuration application having a graphical user interface, and <figref idref="DRAWINGS">FIG. 5B</figref> shows an exemplary control application also having a graphical user interface. <figref idref="DRAWINGS">FIG. 6</figref> shows an exemplary display identifier which may be used to identify a display device undergoing identification. <figref idref="DRAWINGS">FIG. 7</figref> shows an exemplary pointing device also referred to as a selection device which may implement the elements shown in <figref idref="DRAWINGS">FIG. 2</figref>. <figref idref="DRAWINGS">FIG. 8</figref> shows a method for configuring the pointing device of <figref idref="DRAWINGS">FIG. 7</figref> to identify one or more display devices. <figref idref="DRAWINGS">FIG. 9</figref> shows a method for selecting display devices for multimedia content output with the pointing device of <figref idref="DRAWINGS">FIG. 7</figref>. <figref idref="DRAWINGS">FIGS. 10A and 10B</figref> show a method for routing multimedia content to a desired display device which may be implemented in the environment of <figref idref="DRAWINGS">FIG. 3C</figref>. <figref idref="DRAWINGS">FIG. 11</figref> shows a method for configuring a source device to identify and select one or more display devices for multimedia content output which may be implemented in the environment of <figref idref="DRAWINGS">FIG. 3C</figref>.
0029<figref idref="DRAWINGS">FIG. 1A</figref> schematically shows an embodiment of a multimedia environment, environment <b>100</b> in accordance with the present disclosure. Environment <b>100</b> includes a plurality of display devices, also referred to herein as displays, which may receive and output multimedia content. Examples of displays, include but are not limited to, display device <b>102</b>, which may be a cathode-ray tube (CRT) television, display device <b>104</b>, which may be a wall-mounted liquid crystal display (LCD) monitor, display device <b>106</b>, which may be an organic light-emitting diode (OLED) display, display device <b>108</b>, which may be a video projector mounted to a leftward portion of a ceiling of environment <b>100</b>, display device <b>109</b>, which may be a video projector mounted to a rightward portion of the ceiling of environment <b>100</b>, and display array <b>110</b>, which in this example comprises three individual plasma display devices mounted side-by-side in a horizontally-packed configuration. It will be appreciated that the number and types of display devices described above are provided as non-limiting examples and other examples are considered, including, but not limited to digital white boards, large format displays, front projection devices, rear projection devices, etc. Such number and type may be varied without departing from the scope of this disclosure, and the display devices in environment <b>100</b> may be of any suitable type of display configured to output multimedia content.
0030“Multimedia content” as used herein primarily refers to content including visual elements—e.g., images, video, animation, etc. In some embodiments, however, multimedia content may include other forms of content, such as audio. It will be assumed that the display devices in environment <b>100</b> include display screens or other output elements by which they may output visual multimedia content, though such display devices may include other components configured to output other forms of multimedia content, such as speakers configured to output audio.
0031Environment <b>100</b> may represent a number of environments in accordance with the present disclosure. In one scenario, environment <b>100</b> may represent a home multimedia environment in which a user <b>112</b> selectively directs multimedia content output to one or more desired display devices, for example by directing multimedia content output to display device <b>102</b> to watch a movie or television show. Environment <b>100</b> may also represent a conference room environment in which individual control of each display device and their respective output is desired. In this example, user <b>112</b>, who may be among a plurality of users in environment <b>100</b>, has entered the environment with a selection device <b>114</b>. Selection device <b>114</b> may be controlled by user <b>112</b> to select a desired display device for multimedia content output. Selection device <b>114</b> may be, for example, a smartphone, tablet computer, personal data assistant, handheld gaming console, etc. In some examples, the selection device may be brought into the environment or room by the user or, alternatively, the selection device may be available for use by the user in the environment.
0032Multimedia content to be shared may reside on what is referred to herein as a “source device” (e.g., source device <b>118</b>). A source device may be the device from which multimedia content to be shared originates. Shown in this example, as a laptop computer, source device <b>118</b> may be any suitable device configured to store and output multimedia content, including a cellular phone, smartphone, desktop computer, laptop computer, home-theater personal computer, gaming console, tablet computer, etc. In this example, source device <b>118</b> may be referred to as an “external” source device, and may be operatively connected to selection device <b>114</b>. Selection device <b>114</b> may then be used to select a desired display device for multimedia content output and communicate information regarding the selection to source device <b>118</b> to cause the multimedia content to be routed to the selected display device. Such information may be conveyed, for example, via emission of audio signals from selection device <b>114</b> to source device <b>118</b>. It will be appreciated, however, that a selection device and a source device may be integrated into a single device without departing from the scope of this disclosure. In such embodiments, a single device may be used to select display devices while storing multimedia content. Should the selection and source device be integrated into a single device, the source device may be referred to as an “integral” source device.
0033As noted above, source device may be any suitable computing device configured to store and/or output multimedia content. In some examples, the source device may be brought into the environment or room by the user or, alternatively, the source device may be available for use by the user in the environment. As a non-limiting example, the source device <b>118</b> may be brought into the room with user <b>112</b>. The individual may set the source device on a conference table or other surface and access their source device in the usual manner. In other examples, a locally-residing networked computer or other device in the environment may function as the source device. It will be appreciated that in some examples, desired output data may be retained on a memory device and used in a source device.
0034Selection device <b>114</b> and/or source device <b>118</b> may interface with one or more networks to which the display and other devices in environment <b>100</b> may be commonly or individually connected, for example via an Ethernet port and/or wireless transceiver. In one embodiment, environment <b>100</b> includes a network device <b>116</b>, which may be a router, hub, switch, or other device configured to link a plurality of devices together over a telecommunications network.
0035Network device <b>116</b> may or may not be located in environment <b>100</b> but nevertheless operatively coupled to the other devices in the environment. Network device <b>116</b> may be connected to the Internet via an internet service provider, and supply such Internet connection to the devices to which it is connected. In such a case, network device <b>116</b> may thus provide a cloud network to source device <b>118</b> and display devices <b>102</b>, <b>104</b>, <b>106</b>, <b>108</b>, <b>109</b>, and <b>110</b>. Alternatively or additionally, network device <b>116</b> may connect such devices over a local area network (LAN) or a wireless local area network (WLAN). Moreover, one or more of display devices <b>102</b>, <b>104</b>, <b>106</b>, <b>108</b>, <b>109</b>, and <b>110</b>, and source device <b>118</b> may include components configured to establish a two-way communication link among themselves, for example a Wi-Fi or Bluetooth-compliant transceiver. Still further, one or more of display devices <b>102</b>, <b>104</b>, <b>106</b>, <b>108</b>, <b>109</b>, and <b>110</b>, and source device <b>118</b> may include a transceiver enabling Digital European Cordless Telecommunications (DECT) communication. As display devices <b>102</b>, <b>104</b>, <b>106</b>, <b>108</b>, <b>109</b>, and <b>110</b> may be connected to one or more of the networks described above, they each may be assigned a connectivity identifier to thereby identify each device on the network(s). If, for example, the display devices are commonly connected to a LAN provided by network device <b>116</b>, each display may be assigned a specific internet protocol (IP) address. In this way, content originating on source device <b>118</b> may be easily and selectively routed, shared, and outputted to one or more display devices in environment <b>100</b> via the connectivity identifiers described above.
0036Multimedia content, originating in this example on source device <b>118</b>, may be shared in some embodiments to a desired display device by controlling the spatial orientation and activation of selection device <b>114</b>. “Activation” or “activating,” as used herein, refers to a change in state of selection device <b>114</b>. In the embodiment in which selection device <b>114</b> is a smartphone, for example, user <b>112</b> may press a button on a touch screen, thereby activating selection device <b>114</b> and driving multimedia content output from source device <b>118</b> to a desired display device selected based on the spatial orientation of the source device. As described in further detail below with reference to <figref idref="DRAWINGS">FIG. 2</figref>, a user may use the selection device to choose a display. In some examples, the spatial orientation of selection device <b>114</b> may be determined by an orientation component including a compass and gyroscope. For example, the compass may determine the direction of north, at which point the orientation of the gyroscope may be recorded. As selection device <b>114</b> is subsequently manipulated, the gyroscope orientation may be compared to its previously-recorded orientation corresponding to north to thereby determine the orientation and/or pointing direction of selection device <b>114</b>, for example in a 360° angular range.
0037In the example shown in <figref idref="DRAWINGS">FIG. 1A</figref>, user <b>112</b> desires to share and output multimedia content originating on source device <b>118</b> to display device <b>102</b>. Accordingly, user <b>112</b> has gripped and pointed selection device <b>114</b> toward display device <b>102</b>, the pointing represented in the figure by the dotted axis extending from the selection device. Upon user activation, selection device <b>114</b> may record and match its current spatial orientation (e.g., spatial orientation at the moment of activation) to a previously-recorded spatial orientation associated with display device <b>102</b>. In this way, a current spatial orientation recorded at the time of activation may be matched to a previously-recorded orientation associated with a display device such that selection device <b>114</b> may correctly determine the display device for content output desired by user <b>112</b>. In one example, the previously-recorded orientation may be accessed from a database created during environment configuration of a multimedia environment.
0038In this example, display device <b>102</b>, which user <b>112</b> desired to receive and output multimedia content, is correctly identified after activation of selection device <b>114</b>. Content from source device may then be routed to display device <b>102</b>. In some embodiments, selection device <b>114</b> may emit audio signals encoding selecting of display device <b>102</b> which may be received by source device <b>118</b>, causing the source device to route multimedia content directly to the selected display device <b>102</b>. Display device <b>102</b> accordingly outputs the multimedia content, represented in the figure by shading.
0039Although a first example is shown and discussed above, other embodiments are also considered. For example, the selection device may be configured to easily access all the display devices connected to a network. However, there may be many displays on the network that are not of interest to a user in the room. For example, a display may be in an adjacent room using the same wireless access point (AP.) In some embodiments, the selection device may broadcast a signal to all the displays and give each display an identifying number, such as an ID number, to show on the screen. Thus, in this example, all the displays in the room of interest may show their assigned identifying number. Displays outside the room (but on the network) may also show other numbers, or if being used, may not show anything. The selection device may point to each of the displays and the corresponding number of the display may be entered or optically read. This method may enable easy association of the network path with each display.
0040As described in more detail below, a user interface or application may be provided on the source device such that a user may enter the information for the network path to each display. In some embodiments, the selection device may obtain the information regarding the display in an automatic or semi-automatic process. In a semi-automatic process, the user may manually complete the process to enable association of the source device with a chosen or selected display.
0041As discussed above, multiple methods may be used to positively identify a display. Thus, as described above, spatial identification (such as use of a compass and gyroscope) may be used as part of the selection device. As another example, in embodiments where an identifying number has been assigned, the identifying number may be used to perform initial identification. Afterwards, the selection device may send a unique pattern to the display and optically read it back to ensure a positive identification when the round trip of information is completed.
0042The programmed information (display identification information) for a selection device for the displays in a room (whether through spatial orientation or identification numbers or other method), may be uploaded and stored. In some embodiments, this display identification information may be stored on the network and tagged to a room. As the display identification information may be specific to a room, when the selection device is moved to another room, a room identification mode may be used such that the selection device may identify the room. The identification mode may include a manual entry of room information, or an automatic or semi-automatic identification through spatial or image identification or other suitable method. Once the room is identified, the programmed information for that room may be downloaded to the selection device to enable selection of any one of the displays in the room.
0043It will be appreciated that in some embodiments, display device selection may be carried out by pointing selection device <b>114</b> in a direction substantially perpendicular to a display device or its surface and activating the selection device. For example, user <b>112</b> may select one of display devices <b>108</b> and <b>109</b> by pointing in a direction substantially upward in environment <b>100</b>. Multiple display devices arranged in a single region of environment <b>100</b> (e.g., multiple display devices on a single wall or ceiling) may be distinguished from one another by separating the individual display devices into separate selection regions (e.g., angular regions), described in further detail below with reference to <figref idref="DRAWINGS">FIGS. 3A</figref>, <b>3</b>B, <b>3</b>C, <b>3</b>D, <b>3</b>E, <b>3</b>F, and <b>3</b>G. Thus, for example, display device <b>108</b> may be selected and distinguished from display device <b>109</b> by pointing selection device <b>114</b> in a direction substantially upward and leftward, and activating the selection device.
0044It will be further appreciated that in some embodiments, the position of selection device <b>114</b> may be in a different position and spatial orientation relative to a display device during identification of the display device and the spatial orientation of the display device within environment <b>100</b> and during selection of the display device for use. As described herein, a position of the selection device or display device refers to a location of the device in the environment. For instance, a position of a selection device may be indicated via coordinates (e.g., 3-dimensional coordinates). In one use-case example, environment <b>100</b> may include a projector located on a ceiling. The projector and the spatial orientation of the projector may be identified using selection device <b>114</b> from a fixed position relative to the projector. To enable selection of the projector from any other point within environment <b>100</b>, the location of selection device <b>114</b> may be determined within environment <b>100</b> during identification and during selection of the projector. However, in other examples the location of the selection device <b>114</b> may not be determined at the time of display device configuration. A location of selection device <b>114</b> within environment <b>100</b> may be determined by triangulation of the position of selection device <b>114</b> using two or more fixed reference points within the room, device location components such as GPS location or other network based location systems, manually input by the user, or any other suitable method. As a non-limiting example, during identification of the projector, selection device <b>114</b> may be pointed at two or more reference points within environment <b>100</b>. Selection device <b>114</b> may determine its location within environment <b>100</b> relative to each reference point. Selection device <b>114</b> may also be pointed at the projector (or any other display device within environment <b>100</b>). The location and/or spatial orientation of the projector relative to each reference point within environment <b>100</b> may also be determined and recorded by selection device <b>114</b>. As the location and spatial orientation of the projector relative to each reference point within environment <b>100</b> is recorded, the projector may be selected by selection device <b>114</b> from any position within environment <b>100</b> by first determining the position of selection device <b>114</b> relative to each reference point and then selecting the projector.
0045Such previously-recorded spatial orientations, for example during an environment configuration as outlined in method <b>400</b> at <figref idref="DRAWINGS">FIG. 4A</figref>, may be determined during a configuration phase in which selection device <b>114</b>, for example with an integrated source device, is trained to identify and select the display devices in environment <b>100</b>. Alternatively, the configuration phase may be carried out during execution of a configuration application executed on source device <b>118</b>, described in further detail below with reference to <figref idref="DRAWINGS">FIG. 5A</figref>, and may implement a method <b>423</b>, described in further detail below with reference to <figref idref="DRAWINGS">FIG. 4D</figref>. In some embodiments, the configuration phase may precede a use phase in which configuration has been completed, allowing a user to engage in display device selection and output control. As used herein, “identification” and “identifying spatial orientations” may correspond to the configuration phase in which display devices are identified, while “selection” and “selecting spatial orientations” may correspond to the use phase.
0046It will be appreciated, however, that the configuration phase may be implemented on another device other than source device <b>118</b>, for example a configuration device <b>120</b> dedicated to configuring display device identification and selection. In one example, the configuration device may be a computer. In another example, the configuration device may be a device capable of network communication.
0047As described above, a system for configuring a multimedia environment, comprising a first display device and a second display device within the multimedia environment wherein the first display device and second display device includes display device information, comprising a display device identifier and a network connectivity; a configuration device within the multimedia environment, the configuration device coupled to the first display device and the second display device over a network is provided. The configuration device is programmed to receive from each of the first display device and the second display device the display device information, identify a spatial orientation for the first display device and the second display device, associate the identified spatial orientation with the received display device information for each of the first display device and the second display device, and store the associated identified spatial orientation and received display device information for the first display device and the second display device as configuration data in a configuration database. In one example, a spatial orientation of a display device may include directional and/or elevation angles or angle ranges corresponding to the display device. The directional and elevation angles may be associated with a references point, such as a central point in the room, for instance. Thus, the spatial orientation may be angulation information from a central point, a point on a floor, a point on a desk, a point on a podium, etc., or from the position of one or more moveable objects such as a remote control or projector. In this way, display device angulation can be tied to a reference point. Tying the reference point to the angulation information enables greater accuracy when determining which display device a user intends to select. Moreover, the reference point may be a point within the room in which the display devices are located or may be a point external to the room. For instance, the reference point may be a point on a desk contained in the room or a point on a floor in a hallway adjacent to the room. In this way, a user may be able to select display devices when they are located in an adjacent room or in the room where the display devices are located.
0048The system further comprises a server coupled to the configuration device. In one example, the configuration data in a configuration database is stored on the server. For example, the configuration data may be store on a server in the cloud or a server which is located in the room of the multimedia environment.
0049The configuration device is further programmed to: identify a room spacing alignment for the first display device and the second display device; associate the room spacing alignment with the first display device and the second display device; and store the associated identified room spacing alignment for the first display device and the second display device as configuration data in a configuration database. The room spacing alignment may include orientation data associated with the display devices corresponding to reference points contained within a specified room. As previously discussed, the reference point may be a point at the center of the room, a point on a desk, a point on a chair, a point on a projector, etc. The orientation data may include directional and/or elevation angles or angle ranges associated with the displays. For instance, a room spacing alignment corresponding to a first display device in a conference room may include a direction and elevation angle associated with a central point in the conference room. However, a room spacing alignment does not include angulation angles from orientation data associated with reference points external to a specified room.
0050The system further comprises a selection device coupled to the network, the selection device programmed to access the configuration database and select a desired display device. The selection device selects the desired display device by providing the orientation information of the desired display device and matching the information stored in the configuration database. As described herein, orientation information can include directional angle and/or elevation angle relative to and measured by the selection device. Moreover, the orientation information can be associated with a reference point, as described above.
0051The system further comprises a source device coupled to the selection device, the selection device further programmed to drive source multimedia from the source device to the desired display device.
0052The configuration device is further programmed to receive from a reference source reference data, the reference data comprising a room position, and store the reference data in the configuration database.
0053Turning to <figref idref="DRAWINGS">FIG. 1B</figref>, <figref idref="DRAWINGS">FIG. 1B</figref> shows an example schematic diagram of connections between devices during configuration. The selection device <b>114</b>, configuration device <b>120</b>, server <b>140</b> and cloud <b>142</b> may all be connected via a network <b>152</b>, illustrated as dash dot lines, provided by the network device connections <b>116</b>. In one example, the selection device <b>114</b> and configuration device <b>120</b> may be separate devices. In another example, the selection device <b>114</b> and the configuration device <b>120</b> may be integrated as a single device <b>150</b>. The selection device <b>114</b> and configuration device <b>120</b> may be connected via the network to a server <b>140</b>. The server <b>140</b> may be present in the multimedia room, outside the room, at various other locations, or be in the cloud. The configuration device <b>120</b> may communicate with the server <b>140</b> during configuration of a display device in the multimedia environment. The selection device <b>114</b> may communicate with the server <b>140</b> during selection of a display device in the multimedia room. The server <b>140</b> may include a database <b>142</b> which includes information about the display devices in the multimedia room. For example, the position and angulation of the display devices. In one example, the database <b>142</b> may be stored on the server <b>140</b>. In another example, the database <b>142</b> may be stored in the cloud. In yet another example, the database <b>142</b> may be stored on an off-site storage server.
0054Configuring environment <b>100</b> for display device identification and selection on configuration device <b>120</b>, for example, may allow configuration to be completed in a single session by an information technology professional before users arrive to the environment. Such an approach may advantageously allow information garnered during configuration (e.g., spatial orientations and connectivity identifiers associated with each display device) to be downloaded to the electronic devices of the respective users in environment <b>100</b> such that they may bypass configuration themselves and immediately point to drive display output selection. It will also be noted that a “use” phase during which display device output may be controlled via the spatial orientation and activation of selection device <b>114</b>, and following the configuration phase described above in which selection device <b>114</b> and the display devices in environment <b>100</b> have been configured, may be controlled via a control application, which may also be executed on source device <b>118</b>. For example, the control application may implement a method <b>451</b> described in further detail below with reference to <figref idref="DRAWINGS">FIG. 4E</figref>, and in some embodiments, may be combined with the configuration application to form a single configuration and control application.
0055Alternatively, the configuration phase may include recording geo-spatial location coordinates of environment <b>100</b>, such as Radio Frequency Pattern Matching, wireless network location methods, GPS coordinates, or any other suitable geospatial location method, for example. These location coordinates may be associated with the spatial orientation and identification of display devices within environment <b>100</b>. In some examples, geospatial location coordinates may be recorded for each of the display devices within the environment. The identification and spatial orientation of each display device within environment <b>100</b> and the geospatial location coordinates of environment <b>100</b> may be stored locally at configuration device <b>120</b> and/or remotely at a remote server or cloud server. Therefore, a source device <b>118</b> with geospatial locating functionality may provide geospatial location coordinates to an executed control application. The control application may match the geospatial location coordinates of source device <b>118</b> to the geospatial location coordinates of environment <b>100</b>. The control application may then request a download from configuration device <b>120</b> or the remote server/cloud server of the identification of the available display devices within environment <b>100</b>, the spatial orientation of the display devices, and the geospatial location coordinates of each available display device (if available). As discussed above this approach may advantageously allow information garnered during configuration to be downloaded to the electronic devices of the respective users in environment <b>100</b> such that they may bypass configuration themselves and immediately point to drive display output selection.
0056Thus, a configuration device, comprising: an orientation determining component configured to determine a room spacing alignment for a first display device and a second display device in an environment; an audio emission component configure to emit audio signals; a logic subsystem; and a memory subsystem holding instructions executable by the logic subsystem. The instructions are configured to: receive from a first display device and a second display device display device information; identify a room spacing alignment for the first display device and the second display device; associate the identified room spacing alignment with the received display device information for the first display device and the second display device; and store the associated identified room spacing alignment and received display device information for the first display device and the second display device as configuration data in a configuration database.
0057In one embodiment, a selection device is an integral selection device integrated with the configuration device. The selection device configured to: access the configuration database from the selection device; determine a selecting spatial orientation at the selection device; associate the selecting spatial orientation with the configuration database to determine a desired display device and the associated data; and wherein the orientation determining component includes one or both of a compass and a gyroscope. As previously discussed, the spatial orientation may include directional and/or elevation angles or angle ranges.
0058In one example, the orientation determining component includes one or both of a compass and a gyroscope.
0059In other embodiments, the configuration device is further programmed to: receive from a reference source a room position; and store the reference source room position as configuration data in the configuration database.
0060Turning now to <figref idref="DRAWINGS">FIG. 2</figref>, a schematic diagram <b>200</b> is shown, illustrating in schematic form elements of a selection device <b>202</b> which may be used to identify and select display devices in environment <b>100</b> for multimedia content output. Diagram <b>200</b> may represent one or more elements of selection device <b>114</b> or another separate device suitable for display device identification and selection (e.g., a smartphone, tablet computer, handheld gaming console, personal data assistant, a dedicated device whose primary function is to perform the selection process, etc.).
0061Selection device <b>202</b> may include a power source <b>204</b> configured to supply electrical power to various active components in selection device <b>202</b>. Power supply lines to such components are represented in the figure by dot-dash lines. Power source <b>204</b> may be any suitable power source, for example a replaceable and/or rechargeable lithium-ion, alkaline, or nickel-cadmium battery, or a power supply unit configured to receive electrical current from a wall outlet (not shown). Power source <b>204</b> may provide electrical power to a communication (comm.) subsystem <b>206</b>, an input subsystem <b>208</b>, a speaker <b>210</b>, a camera <b>212</b>, a logic subsystem <b>214</b>, and a memory subsystem <b>216</b>.
0062Communication subsystem <b>206</b> may facilitate communication between selection device <b>202</b> and various devices in environment <b>100</b> to drive display device selection and multimedia content output, for example display devices <b>102</b>, <b>104</b>, <b>106</b>, <b>108</b>, and <b>110</b>, and network device <b>116</b>. Communication subsystem <b>206</b> may correspond to and/or interface with various physical devices to implement such communication, for example an Ethernet port, wireless transceiver, universal serial bus port, etc. The configuration and/or use applications described above may be downloaded to selection device <b>202</b> via communication subsystem <b>206</b>.
0063Input subsystem <b>208</b> may facilitate the reception of user input at selection device <b>202</b>. Input subsystem <b>208</b> may correspond to, for example, a touch screen, microphone, physical button, etc., and may be used to receive user activation indicating identification and/or selection of a display device.
0064Speaker <b>210</b> may be any suitable device configured to emit audio signals in one or more frequencies (e.g., audible, subaudible, ultrasonic, etc.). In some embodiments, speaker <b>210</b> may emit audio signals having encoded therein information representing display device identification and/or selection. Audio signals may be emitted to display devices themselves in environment <b>100</b>, for example. Alternatively or additionally, in some embodiments audio signals may be emitted to a separate source device (e.g., source device <b>118</b>) such that selection device <b>202</b> may be used as a pointing device to drive multimedia content output by emitting information upon activation to the separate source device. An exemplary pointing device <b>700</b> is described below with reference to <figref idref="DRAWINGS">FIG. 7</figref>. In some embodiments, the audio signals may be encoded via any suitable technique (e.g., frequency-shift keying (FSK), phase-shift keying (PSK), Trellis modulation, quadrature amplitude modulation (QAM) coding) and may include spatial orientations and/or connectivity identifiers.
0065Camera <b>212</b> may be any suitable image capture device configured to capture light in one or more wavelengths (e.g., visible, infrared, etc.), and may include a lens and a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) sensor, for example. In some embodiments, camera <b>212</b> may capture images containing information relevant to display device selection, described in further detail below.
0066Logic subsystem <b>214</b> may be configured to execute instructions, routines, and other code stored in memory subsystem <b>216</b> to drive display device selection, and may include a memory controller (not shown) configured to facilitate an interface between the logic and memory subsystem. Logic subsystem <b>214</b> may carry out a method, for example methods <b>423</b> and/or <b>451</b> described below with reference to <figref idref="DRAWINGS">FIGS. 4A and 4B</figref> respectively, as part of a configuration and/or control application used to drive display device selection and output. Logic subsystem <b>214</b> may be any suitable logic device configured to execute instructions stored in memory subsystem <b>216</b>, such as a processor or microcontroller. Likewise, memory subsystem <b>216</b> may be any suitable storage device configured to store instructions executable by logic subsystem <b>214</b>, such as electronically erasable programmable read-only memory (EEPROM), a hard drive, flash memory, etc. In some embodiments, memory subsystem <b>216</b> may further store information received during a configuration phase in which selection device <b>202</b> is trained to select display devices in environment <b>100</b>, described in further detail below with reference to <figref idref="DRAWINGS">FIG. 4E</figref>.
0067Data connections—e.g., pathways which facilitate the transmission of electronic data—are illustrated in the figure by solid lines, which may be, for example, data busses. As shown, data connections connect logic subsystem <b>214</b> to communication subsystem <b>206</b>, input subsystem <b>208</b>, speaker <b>210</b>, camera <b>212</b>, memory subsystem <b>216</b>, a microphone <b>217</b>, a compass <b>218</b>, and a gyroscope <b>220</b>. Such data connections may be a combination of one-way and two-way connections; for example, a two-way data connection may be provided between memory subsystem <b>216</b> and logic subsystem <b>214</b>, while a one-way data connection may be provided between speaker <b>210</b> and logic subsystem <b>214</b>. It will be appreciated that two or more of the above-described components (e.g., memory subsystem <b>216</b> and logic subsystem <b>214</b>) may be integrated onto a single die or provided as separate components in selection device <b>202</b>.
0068Microphone <b>217</b> may be any suitable device configured to receive audio signals emitted in environment <b>100</b>. In some embodiments, one or more of display devices <b>102</b>, <b>104</b>, <b>106</b>, <b>108</b>, and <b>110</b> may include speakers configured to emit information relevant to display device identification and/or selection (e.g., information indicative of spatial location and/or connectivity identifiers) which may be received by selection device <b>202</b> via microphone <b>217</b>. In other embodiments, environment <b>100</b> may include a reference source configured to emit audio signals to thereby improve determination of the spatial orientation of selection device <b>202</b> and one or more displays in the environment.
0069In yet other embodiments, selection device <b>202</b> may include an orientation-determining device or component configured to determine the orientation of selection device <b>202</b>. As a non-limiting example, the orientation-determining device may include one or more of a compass <b>218</b>, a gyroscope <b>220</b>, a global positioning system (GPS) device, an accelerometer, x-y-z Cartesian coordinate sensor, etc. The orientation-determining device may be used to determine the spatial orientation of selection device <b>202</b> upon its activation by a user. Such orientation may then be recorded and stored in memory subsystem <b>216</b> and subsequently associated with one or more connectivity identifiers. In this way, a display device in environment <b>100</b> may be identified by associating a spatial orientation and one or more connectivity identifiers with the display device, such that the display device may be subsequently selected by comparing a spatial orientation during selection with the orientation previously-recorded during configuration. It will be appreciated that the orientation-determining device may be integrated in, connected to, linked to, or otherwise operable with selection device <b>202</b>.
0070In one example, the inclusion of compass <b>218</b> and/or gyroscope <b>220</b> may operate synergistically to provide orientation data regarding selection device <b>202</b>. In some examples, compass <b>218</b> may be used to determine a reference point, for example, the point at which selection device <b>202</b> points due north. At this point, the orientation of gyroscope <b>220</b> (e.g., its output) may be recorded and associated with due north. It will be appreciated that other reference points may be used. As selection device <b>202</b> is manipulated, subsequent gyroscope orientations may be compared to the gyroscope orientation associated with due north to thereby determine the spatial orientation and/or pointing direction of the selection device. Such an approach may allow selection device <b>202</b> to determine its spatial orientation and/or pointing direction in a 360° angular range, for example.
0071Further, in some examples, compass may be used to determine a horizontal pointing direction (horizontal directional signal) which indicates the horizontal direction pointing direction when the selection device is held more or less horizontal. The gyroscope can then be used to determine an up or down directional signal. By the combination of the compass and gyroscope to determine the horizontal directional signal, it is possible to determine a 3-dimensional spatial orientation or pointing direction which assists in selecting vertically separated displays and displays mounted on the ceiling.
0072Compass <b>218</b> and/or gyroscope <b>220</b> may include respective transducers configured to translate their physical states into electrical signals interpretable by logic subsystem <b>256</b>, such as analog-to-digital converters. Such electrical signals may encode spatial orientations in any suitable form, for example, three-dimensional Cartesian coordinates associated with selection device <b>202</b>, and may include other orientation data such as the yaw, pitch, and roll associated with the selection device.
0073It will be appreciated, however, that the inclusion of various components in selection device <b>202</b> may be varied. For example, one or more of camera <b>212</b>, microphone <b>217</b>, compass <b>218</b>, and gyroscope <b>220</b> may be included or omitted. The inclusion of compass <b>218</b> and/or gyroscope <b>220</b> while omitting camera <b>212</b> and microphone <b>217</b> may reduce costs at the expense of decreased accuracy. Turning back to <figref idref="DRAWINGS">FIG. 1A</figref>, an example illustrating the relative accuracy of selection device <b>202</b> as a function of the inclusion of various orientation-determining devices is illustrated. In embodiments in which selection device <b>202</b> includes compass <b>218</b> and/or gyroscope <b>220</b> while omitting camera <b>212</b> and microphone <b>217</b>, the selection device may be capable of selecting displays which are substantially separated (e.g., by an angle that allows sufficient tolerance to easily distinguish one display device from another). In the example shown in <figref idref="DRAWINGS">FIG. 1A</figref>, user <b>112</b> may thus select among display devices <b>102</b>, <b>104</b>, <b>106</b>, and <b>110</b>.
0074In some examples, an external reference may be detected by the addition of a camera <b>212</b> or microphone <b>217</b> to enable precise orientation and selection capabilities. In other embodiments, selection device <b>202</b> may be capable of gross determination of spatial orientations, with fine determination achieved by the inclusion of a capture device. For example, in some embodiments the orientation of selection device <b>202</b> may be determined in relation to an external reference not limited to environment <b>100</b> (a compass direction and gyroscope data may only facilitate determination of pointing orientation relative to the earth).
0075In the example of gross determination, display device selection may be able to differentiate between a number of display devices, four, five, or six display devices (e.g., a display surface on each perpendicular surface of environment <b>100</b>). The display selection may be limited to the selection of perpendicular display devices, for example by comparing the spatial orientation of a display device undergoing selection to a previously-recorded spatial orientation for a separate display device. If an angle between the display devices is less than 90 degrees, for example, selection of the new display device may be suppressed and a notification or request for verification sent to user <b>112</b>. Selection device <b>202</b> may be in different positions within environment <b>100</b>, and with the inclusion of an external reference, the accuracy by which the selection device may determine the display device to which it is being pointed may be increased.
0076Other approaches may be utilized to aid in display device identification and/or selection for embodiments in which selection device <b>202</b> lacks a camera or microphone. <figref idref="DRAWINGS">FIG. 3A</figref> shows a plan view of a multimedia environment <b>300</b> in which four display devices (numbered sequentially in the figure) are mounted side-by-side on a single wall, similarly to display array <b>110</b> in environment <b>100</b>. During configuration of selection device <b>202</b>, the wall may be divided into several separate angular regions (e.g., angular regions <b>302</b> and <b>303</b>). Angular regions associated with each display device (e.g., angular region <b>302</b>) may subtend 22.5°, for example. Each display device may then be associated with its own specific angular region. Spatial orientations recorded during activation of selection device <b>202</b> after completion of the configuration phase may then be matched to an angular range. In this way, a pointing tolerance may be provided and close-packed display devices mounted on a common wall may be distinguished from one another. In some embodiments, selection device <b>202</b> may be located in various positions within the room. In this case, selection device <b>202</b> may determine the orientation angles relative to a position of selection device <b>202</b> within multimedia environment <b>300</b>. Thus, a directional and/or elevation angle or angle range of the selection device may be associated with a room location of the selection device. Selection device <b>202</b> may select at least two fixed reference points within the room to determine the position of selection device <b>202</b> within multimedia environment <b>300</b>. Additionally, the location of the display devices and/or angular regions may be determined relative to the at least two fixed points.
0077Other variations are possible. In some approaches, it may be desirable to expand some angular regions while restricting others. For example, some angular regions may correspond to regions in which users may intuitively direct pointing. <figref idref="DRAWINGS">FIG. 3A</figref> shows how a horizontal line <b>304</b> may be used to adapt angular regions to user tendencies. An expanded angular region <b>306</b> is shown, extending from horizontal line <b>304</b> to the middle of a surface of display device <b>1</b>. Expanded angular region <b>306</b> may subtend, for example, 57.7°. When a user desires to select display device <b>1</b>, the user may direct pointing in directions not only intersecting the surface of display device <b>1</b>, but also directions intersecting portions of a left wall of multimedia environment <b>300</b>. Directions intersecting portions of this left wall, extending to horizontal line <b>304</b>, may result in successful selection of display device <b>1</b>. In this way, ease of display selection, and associated pointing tolerance, may be increased. A similar angular region may be provided for display device <b>4</b> as the user may have a tendency to select display devices disposed in corners with pointing directions intersecting proximate sidewalls.
0078Although the angular regions associated with display devices <b>2</b> and <b>3</b> may be reduced in this example (e.g., subtending 20.4°), pointing directions resulting in selection of an unintended display (e.g., selection of display device <b>3</b> when selection of display device <b>2</b> was intended) may be mitigated by also leveraging user intuition. For example, a user accidentally selecting display device <b>3</b> may observe multimedia content being routed to this display device and promptly provide a new pointing direction toward a left side of multimedia environment <b>300</b> in response.
0079In addition, in some examples, the angular region for the central based displays may be increased. For example, the angular region for display device <b>2</b> may extend from the center line to a shifted position indicated by the dash-double dot line. This expanded region may be based on the likelihood or tendency that a user will position the selection device by pointing toward the corner for display device <b>1</b> and in a more general but not specific region off the center line for display device <b>2</b>. Although shown as positioned at the mid line of the angular region of display device <b>1</b>, it will be appreciated that the shift position may be of any suitable size, expanding or reducing the selection zone for a display.
0080It is noted, in some examples, during a configuration phase in which display device selection is configured, the location of a user and selection device <b>202</b> may be provided to increase pointing ease and accuracy. Further, data regarding position of a user (based on size, obstructions in the room, such as conference tables, etc.) may be determined such that the selection zones are customized to the room. Tolerances, such as the selection zone, may be adjusted based on the likelihood of a user's position when using the selection device.
0081Some devices may require manual verification due to overlap in a selection zone or movement of a display. For example, a wheeled display may change the compass heading and adjustments may be necessary or user verification or confirmation of a selected device. Likewise, a default may be set for a display where overlap occurs based on position of the user in pointing at a display. The user may be able to verify or request reselection of a display.
0082Turning to <figref idref="DRAWINGS">FIG. 3B</figref>, <figref idref="DRAWINGS">FIG. 3B</figref> shows a partial view of another multimedia environment <b>350</b>, illustrating how four display devices (numbered sequentially) mounted on a common wall in a two-by-two configuration may be distinguished from another, similarly to the approach described above with reference to <figref idref="DRAWINGS">FIG. 3A</figref>. In this example, two display devices at the top of the two-by-two arrangement devices may be separated from two display devices at the bottom of the arrangement by a horizontal line <b>352</b>, while two display devices at the left side of the arrangement may be separated from their rightward counterparts by a vertical line <b>354</b>. Thus, a spatial orientation of selection device <b>202</b> may be compared to horizontal lines <b>352</b> and vertical lines <b>354</b>, respectively, to determine which quadrant (e.g., quadrant <b>356</b>) is being pointed at. Pointing tolerance and ease of use of selection device <b>202</b> may be increased in such an approach. It will be appreciated that the above-described methods in which a wall is divided into regions may be extended to environments having other numbers of display devices, and such display devices may be divided into regions using any suitable geometrical configurations. For example, display devices may instead be divided into circular or elliptical regions. Further, the separation of display devices into regions and the selection of such displays based on regions may be encoded in instructions stored on memory subsystem <b>216</b> and executed by logic subsystem <b>214</b> of selection device <b>202</b>, for example.
0083Turning now to <figref idref="DRAWINGS">FIG. 3C</figref>, multimedia environment <b>300</b> may include a plurality of display devices <b>318</b>, <b>320</b>, <b>322</b>, <b>324</b>, <b>326</b>, <b>328</b>, <b>330</b>, <b>332</b>, and <b>334</b>. Each of the display devices may include a single display device or two or more display devices forming a composite display device as illustrated in display devices <b>322</b> and <b>324</b> of <figref idref="DRAWINGS">FIG. 3D</figref>. As illustrated, selection device <b>202</b> may be used to receive the spatial orientation of any of the display devices in multimedia environment <b>300</b> as shown by the dash double dot lines. Further, selection device <b>202</b> may receive the spatial orientation of one or more reference sources within the multimedia environment <b>300</b>. For example, multimedia environment <b>300</b> may include four reference sources <b>310</b>, <b>312</b>, <b>314</b>, and <b>316</b>. These reference sources may be used during both configuration and device selection. Although each reference source is shown in a respective corner of the room, it will be appreciated that a reference sources may located at any suitable location within multimedia environment <b>300</b>, such located on a wall, an intersection of two walls, on the floor, on the ceiling (e.g., ceiling corners), or on any static feature of multimedia environment <b>300</b>. It will also be appreciated that in some embodiments, the reference sources may be located on other fixtures which may be placed within multimedia environment <b>300</b> during the configuration phase. In these embodiments, the fixtures may remain in place until use of multimedia environment <b>300</b> is complete. Reference sources <b>310</b>, <b>312</b>, <b>314</b>, and <b>316</b> may comprise a visual marker, sound emitter, wireless signal transmitter, radio transmitter, or any other suitable marker or transmitter that may be detected by selection device <b>202</b>.
0084In some embodiments, the corners of the room may be employed as reference sources.
0085During the configuration phase, selection device <b>202</b> may receive the spatial orientation of each reference source <b>310</b>, <b>312</b>, <b>314</b>, and <b>316</b>. The spatial orientation of each reference source may then serve as a fixed point or “landmark” within multimedia environment <b>300</b> from which the spatial orientation of each display device and the location of selection device <b>202</b> may be determined. A location of selection device <b>202</b> within multimedia environment <b>300</b> may be determined through any suitable location algorithm such as triangulation, trilateration, multilateration, stereopsis, or any other method of calculation of position relative to one or more reference points. Selection device <b>202</b> may also receive the spatial orientation of each of the display devices <b>318</b>, <b>320</b>, <b>322</b>, <b>324</b>, <b>326</b>, <b>328</b>, <b>330</b>, <b>332</b>, and <b>334</b> and associate the spatial orientation relative to the reference sources. A change in position of selection device <b>202</b> between the configuration phase and selection of a display device may change the spatial orientation of each display device relative to selection device <b>202</b>. By determining the spatial orientation of each display device and selection device <b>202</b> within multimedia environment <b>300</b> relative to reference source <b>310</b>, <b>312</b>, <b>314</b>, and/or <b>316</b>, any difference in spatial orientation of a display device due to a change in the position of selection device <b>202</b> may be corrected for and the proper display device may be selected.
0086In other embodiments, the spatial orientation of the reference sources as determined by selection device <b>202</b> may be corrected to a specific reference point within multimedia environment, such as a reference point in the center of multimedia environment <b>300</b>. Shifting the reference point to the center of the multimedia environment increases the accuracy of device selection. Consequently, the likelihood of selection of a desired display device is increased. The reference point may be the position of selection device <b>202</b> within multimedia environment <b>300</b> during the configuration phase and during receiving of a respective identifying spatial orientation of each of the one or more display devices. In this embodiment, the spatial orientations of the display devices determined during configuration may be similarly corrected. For instance, during configuration the spatial orientation assigned to each display device may correspond to a reference point that is shifted to a central point in the room. As a result, a common reference point can be established during device configuration and device selection. Consequently, the accuracy of display device selection is increased.
0087As a non-limiting example, a change in relative position between selection device <b>202</b> and display device <b>332</b> will be discussed. Display devices <b>332</b> and <b>334</b> may be projectors mounted to the ceiling of multimedia environment <b>300</b>. During the configuration phase, the spatial orientation of the reference sources, location P<b>1</b> of selection device <b>202</b>, and the spatial orientation of each display device within multimedia environment <b>300</b> may be received as illustrated. During the selection of display device <b>332</b>, selection device <b>202</b> may be located adjacent display device <b>318</b> at location P<b>2</b>. To account for this change in position, selection device <b>202</b> may receive the spatial orientation of one or more of reference sources <b>312</b>, <b>314</b>, <b>316</b>, and/or <b>318</b> from the location P<b>2</b>. The location of selection device <b>202</b> at P<b>2</b> within multimedia environment <b>300</b> may be determined relative to the spatial orientation of the one or more reference sources. The change in location of selection device <b>202</b> may change the spatial orientation of each display device relative to selection device <b>202</b> when a display device is selected from P<b>2</b>. Therefore, an expected spatial orientation of each display device may be determined based on the difference in spatial orientation of each reference source at P<b>2</b> and the spatial orientation of each reference source at P<b>1</b>. Selection device <b>202</b> may then select display device <b>332</b> from the current location despite the change in relative location between selection device <b>202</b> and display device <b>332</b>. It will be appreciated that the spatial orientations of the reference sources prior to selection of display device <b>332</b> may be received automatically or manually.
0088In some embodiments, the spatial orientation of a reference source within multimedia environment <b>300</b> may be used to determine elevation of a display device or other multimedia device. As illustrated in <figref idref="DRAWINGS">FIG. 3D</figref>, display device <b>322</b> may include two devices <b>322</b>A and <b>322</b>C and display device <b>324</b> may include two devices <b>322</b>B and <b>322</b>D. Dashed line <b>340</b> may indicate 0 degrees elevation. Also illustrated are a 10 degree elevation line and a 350 degree elevation line (10 degrees below dashed line <b>340</b>). It will be appreciated that alternative forms of expressing relative elevation such as positive/negative degrees, radians, azimuth angles, etc. Further, it will be appreciated that the elevation of a display device may be determined from the center of the display device as illustrated, from the bottom of the display device, from the top of the display device, from a corner of the display device, or any other point on the display device. In these embodiments, the spatial orientation of a display device may include both position and elevation data associated with the display device. For example, the display devices <b>322</b>A and <b>322</b>C may have similar spatial orientations if elevation is not determined and included with or within the spatial orientation associated with each display device. The inclusion of elevation may allow the selection of either display device <b>322</b>A or <b>322</b>C individually, as display device <b>322</b>A has an elevation of 10 degrees and display device <b>322</b>C has an elevation of 350 degrees. In other applications, the elevation of a display within a multimedia environment may allow for increased precision of the selection of a display device.
0089Further, in another embodiment, the accuracy of the room layout and therefore the position of the display devices may be improved by utilizing the selection device to record the directions of the four corner of the room. Illustrated in <figref idref="DRAWINGS">FIG. 3E</figref>, an example schematic for mapping display devices by recording the direction of the four corners of the room in a multimedia environment in accordance with an embodiment of the present disclosure is shown. This would allow for the measured angles to be translated to the reference point at the center of the room. For example, as illustrated in <figref idref="DRAWINGS">FIG. 3E</figref>, the selection device <b>202</b> is positioned at <b>370</b> and is not positioned at the center of the room at <b>380</b>. By recording the direction of the four corners of the room, the center of the room may become known. The display devices spatial orientation relative to the selection device position, at <b>370</b> may be translated to as though measured at the center of the room, <b>380</b>. This allows better accuracy of selection even if the configuration was performed at more fringe positions within the room. For example, illustrated in <figref idref="DRAWINGS">FIG. 3G</figref> is the orientation information mapped subsequent to recording the direction of the four corners of the room with the direction or position of the display devices shown. <figref idref="DRAWINGS">FIG. 3F</figref> shows the partitioning of the room into different angular ranges for each display device. Position <b>370</b>, shown in <figref idref="DRAWINGS">FIG. 3E</figref> is used as the reference point, for partitioning the room into angular ranges in <figref idref="DRAWINGS">FIG. 3F</figref>. On the other hand, <figref idref="DRAWINGS">FIG. 3G</figref> shows the angular ranges corrected to have position <b>380</b>, shown in <figref idref="DRAWINGS">FIG. 3E</figref>, used as the reference point for determining angular range partitions. Translating the reference point for angular partitioning to the center of the room increases device selection accuracy.
0090In <figref idref="DRAWINGS">FIG. 3F</figref>, an example schematic for mapping display devices in a multimedia environment in accordance with an embodiment of the present disclosure is shown. The configuration information indicates the location of the display devices within a multimedia environment. In the illustrated example, in reference to the positioning of display devices shown in <figref idref="DRAWINGS">FIG. 3C</figref>, the display devices may be mapped based on their direction and elevation. For example, from the position of the selection device as illustrated in <figref idref="DRAWINGS">FIG. 3C</figref>, display <b>318</b> is in front of the selection device and therefore at a direction or position of 0°. In the same manner, the direction/position of display devices within the multimedia environment may be obtained. Continuing with the example multimedia room of <figref idref="DRAWINGS">FIG. 3C</figref>, the positions illustrated in <figref idref="DRAWINGS">FIG. 3E</figref> shows displays <b>320</b> and <b>324</b> between 45° and 135°, with display <b>324</b> further being recognized as having an elevation of 45° relative to the selection device, display <b>322</b>, between 135° and 180°, display <b>324</b> between 180° and 225°, display <b>326</b>, <b>328</b> and <b>330</b>, which may be a three by one array (all at the same elevation), being detected as having <b>326</b> between 225° and 255°, <b>328</b> between 255° and 285°, <b>330</b> between 285° and 315°. Thus, based on the relative angle of the display device and the elevation, the orientation information may be mapped as illustrated.
0091In <figref idref="DRAWINGS">FIG. 3G</figref>, an example schematic for mapping display devices in a multimedia environment in accordance with an embodiment of the present disclosure is shown. <figref idref="DRAWINGS">FIG. 3G</figref> shows the assigned ranges of angles associated with different displays if the selection device were positioned in the center of the room. In the example shown in <figref idref="DRAWINGS">FIG. 3G</figref>, the display device <b>318</b> is still in front of the selection device and at a direction or position of 0°. However, the other display devices are at different angles to the selection device, as the selection device is positioned at the center of the room. Thus, the direction and position, i.e. the spatial orientation, of the display devices may change. For example, the display devices <b>326</b>, <b>328</b> and <b>330</b>, which may be a three by one display, would have a different relative angle from the selection device as compared to the mapping illustrated in <figref idref="DRAWINGS">FIG. 3F</figref>. The display device <b>326</b> is between 215° and 252°, <b>328</b> is between 252° and 288°, and <b>330</b> is between 288° and 325°. Thus, by determining the room layout during a configuration step, for example by determining the directions of the four corners of the room, the display device position and angulation may be translated from a reference point not at the center of the room to a position near the center of the room. While this example illustrated a room with four corners, a room having more or fewer corners may also be measured in a similar manner. Further, a room having no corners, for example a circular room may include reference points to be measured. In one example, the reference points may be an object affixed to the wall.
0092It will be appreciated that any suitable pointing direction may be assigned to selection device <b>202</b>. In one example, a reference point used to quantify the pointing direction may be determined by a compass in the configuration device and/or selection device. In such an example, a predetermined angle/cardinal direction (i.e., 0 degrees (north), 90 degrees (west), 180 degrees (south), 270 degrees (east), etc.,) may be used as the reference point. In some examples, a default reference may be to use north (0 degrees) as the reference point. However, other techniques for determining a common reference point have been contemplated. As shown in <figref idref="DRAWINGS">FIG. 1A</figref>, for example, a pointing direction extending outwardly from selection device <b>114</b> and substantially parallel with its longest dimension is assigned to the selection device. Thus in this example, user <b>112</b> is pointing in a direction substantially perpendicular to display device <b>102</b>, the direction represented by the dotted axis. Any other suitable pointing directions may be assigned, however, including those determined by user <b>112</b>. As another example, the pointing direction may extend in a direction substantially perpendicular to a display screen of a selection device. Further in one example, after the orientation of each display device in the system is recorded during configuration, 360 degrees may be partitioned to assign as the ranges within which each display device is considered located. For example, in the simple case of a square room with one display on each of the four walls and the configuration can be done with the selection device at the center of the room, each display device will be assigned a range of 90 degrees, for instance. During the selection process, pointing the selection device anywhere within that assigned 90 degrees range will select the device, in such an example. It will be appreciated that in certain scenarios the display devices in the room may be large and the number of displays in the room may be low. Therefore, very rough pointing will be able to select a desired display device. Additionally, if there are many tightly packed small display devices in the room a feedback mechanism can also be used to pinpoint the devices. If, as in some scenarios, the pointing direction coincides with an upper or lower limit of a threshold (e.g., 85°), or within an otherwise ambiguous region, a confirmation may be requested of a user performing pointing. The confirmation may be implemented in any suitable fashion, such as via a prompt in a graphical user interface of a software application (e.g., control application <b>550</b> of <figref idref="DRAWINGS">FIG. 5B</figref>), or an easily identifiable sequence of audible beeps from selection device <b>114</b>. As another example in which an ambiguous pointing direction corresponds to two display devices, a message may be outputted to and displayed by each display device requesting the user to confirm selection, for example by providing a new pointing direction.
0093Returning to <figref idref="DRAWINGS">FIG. 2</figref>, the accuracy and number of display devices selectable by selection device <b>202</b> may be increased via the inclusion of camera <b>212</b> and/or microphone <b>217</b>. As shown in <figref idref="DRAWINGS">FIG. 1A</figref>, environment <b>100</b> may include a reference source <b>122</b> configured to emit a signal detectable by selection device <b>202</b> to thereby improve the determination of its spatial orientation. In some embodiments, reference source <b>122</b> may be a light source configured to emit light (e.g., infrared light), an identifiable symbol, a reflective sticker (e.g., a sticker configured to reflect infrared light), or multiple light sources detectable by camera <b>212</b>. The position of reference source <b>122</b> in an image captured by camera <b>212</b> may be compared to a spatial orientation recorded for a display device undergoing selection. In embodiments where reference source <b>122</b> may have multiple light sources separated by a pre-determined, known, and fixed distance, detection of the reference source by camera <b>212</b> may enable selection device <b>202</b> to determine distances to display devices. Additional reference sources may be included in environment <b>100</b>, for example at each wall. Reference source <b>122</b> may further aid in the determination of the orientation of a selection device which lacks a compass and gyroscope. Such a selection device, for example, may receive data from a fixed transmission source (e.g., a proximate antenna emitting electromagnetic signals) and compare the received data to that of the reference source.
0094Camera <b>212</b> may alternatively or additionally detect other light sources or other optically reflective signs or stickers to improve orientation and distance determination. For example, camera <b>212</b> may evaluate the position of light in a captured image and emitted by a secondary display device <b>123</b>, located proximate to display device <b>104</b> to improve location of the display device. Logic subsystem <b>214</b> of selection device <b>202</b> may further evaluate information encoded in light emitted by secondary display device <b>123</b>, which in this example includes a hash or number sign. The number sign is a symbol specifically associated with display device <b>104</b> to identify the display device. It will be appreciated, however, that any suitable identifier may be displayed by secondary display device <b>123</b>.
0095Similarly, display devices themselves may display information relevant to display device identification and/or selection which may be detectable by camera <b>212</b> of selection device <b>202</b>. For example, <figref idref="DRAWINGS">FIG. 1A</figref> shows how display device <b>104</b> may itself display identifying information in the form of a quick response (QR) code, an image of which may be captured by camera <b>212</b> and interpreted by logic subsystem <b>214</b> of selection device <b>202</b>.
0096Continuing with <figref idref="DRAWINGS">FIG. 1A</figref>, camera <b>212</b> may further capture an image or a sequence of images of a set of lights <b>124</b> (e.g., set of LEDs) included on a bezel of display device <b>104</b>. Set of lights <b>124</b> may collectivity emit a pattern encoding orientation information or one or more connectivity identifiers associated with display device <b>104</b> in a unique on/off pattern. Still further, camera <b>212</b> may capture an image of an identifying mark <b>126</b>, which may also encode identifying information specific to display device <b>104</b>. Identifying mark <b>126</b> may encode such information, for example, in a unique geometric and/or color pattern.
0097Alternatively or additionally, selection device <b>202</b> may utilize microphone <b>217</b> to improve display selection. In some embodiments, reference source <b>122</b> may be a sound source emitting an audio signal (e.g., an ultrasonic signal) detectable by microphone <b>217</b> to improve display device location. It will be appreciated that although described as an ultrasonic signal, the audio signal may be an audible signal, a subaudible signal, etc., and may span any suitable frequency spectrum. Microphone <b>217</b> may also be utilized to detect audio signals emitted from speakers included in one or more display devices, such as display speaker <b>128</b> included in display device <b>104</b>. It will be appreciated that any of the audio sources, light sources, and identifying marks described above, including reference source <b>122</b>, secondary display device <b>123</b>, set of lights <b>124</b>, identifying mark <b>126</b>, display speaker <b>128</b>, and QR code <b>130</b> may encode one or more connectivity identifiers or other additional information, such as a secondary reference point, specific to the display device to which they are associated. Thus, additional information, including information to establish a secondary reference point in an environment, may be encoded via one or more of a secondary display device, a set of lights, an identifying mark or other signals emitted or presented by the one or more display devices.
0098For example, set of lights <b>124</b> may emit a light pattern encoding the IP address of display device <b>104</b>. Such a pattern may then be captured by camera <b>212</b> and interpreted by logic subsystem <b>214</b> to drive display device selection. In embodiments in which a network linking one or more display devices in environment <b>100</b> has been properly configured, connectivity identifiers have been associated with such display devices, and selection device <b>202</b> includes camera <b>212</b>, the configuration phase training display device identification may be bypassed, as selection device <b>202</b> may be used to capture information identifying a desired display device and subsequently drive multimedia content output according to the identifying information.
0099Turning now to <figref idref="DRAWINGS">FIG. 4A</figref>, an example method <b>400</b> is shown for configuring a multimedia environment, also referred to as environment configuration, of one or more display devices for a multimedia environment using a configuration device. In one example, the environment configuration of the one or more display devices for a multimedia environment may be done using a configuration device, for example as shown in <figref idref="DRAWINGS">FIG. 1A</figref>. In another example, the environment configuration of the one or more display devices for a multimedia environment may be done using a selection device which has an integrated configuration device. Environment configuration may be done to determine the room position and room angulation of the display devices. Environment configuration may be done as an initial set-up of a multimedia environment. Environment configuration may further be done when display devices are added or removed from a multimedia environment. Environment configuration may include reference sources in the multimedia environment. Additionally, environment configuration may be done by a technician or a user.
0100At <b>402</b> of method <b>400</b>, the configuration device may receive a connection. For example, the configuration device may receive a connection to the network over wifi. In other examples, other protocols may be used to connect the configuration device to a network. The configuration device may receive the connection by selecting the network address for the multimedia room.
0101At <b>404</b> of method <b>400</b>, the configuration device may receive display device information. The configuration device may receive information about the display device by scanning a QR code, manually inputting information, or through other methods of electronically communicating.
0102At <b>406</b> of method <b>400</b>, the configuration device may receive configuration data. Configuration data may include room position of the display device, room angulation of the display device, network connectivity of the display device, display device identifier, etc.
0103At <b>408</b> of method <b>400</b>, the configuration device may create a configuration database. In one example, the configuration database may be created on a local server. In another example, the configuration database may be created on an external server. In yet another example, the configuration database may be created on a server in the cloud.
0104At <b>410</b> of method <b>400</b>, the configuration device may store the configuration data. The configuration data received at <b>406</b> may be stored in the configuration database created at <b>408</b>. Thus, the display device information may be stored for retrieval at a later point.
0105The method <b>400</b> may then end. Thus, a method for configuring a multimedia environment is provided which may be used to configure one or more display devices present in a multimedia environment. In one example, the method for configuring a multimedia environment may be run by a technician setting up the multimedia environment. In another example, the method for configuring a multimedia environment may be run by a user in the multimedia environment. In yet another example, the method for configuring a multimedia environment results in a database with stored configuration data for the one or more display devices located in the multimedia environment. The method for configuring a multimedia environment may be used to update display device information, for example if a display device is moved to a new position within the multimedia environment.
0106Turning to <figref idref="DRAWINGS">FIG. 4B</figref>, an example selection method <b>411</b> is shown to select a display device using a selection device in a multimedia environment. For example, a selection device may be used to select a desired display device present in a multimedia environment, for example a display device previously configured during example configuration method <b>400</b>.
0107At <b>412</b> of method <b>411</b>, the selection device may connect to the multimedia environment. The selection device may connect to the multimedia environment on a network connection. The selection device may connect via wifi, LAN, etc. In one example, the selection device may connect to the network by manually inputting an IP address. In another example, the selection device may connect by scanning nearby wireless signals and selecting the wireless with the correct multimedia environment identifier, for example as posted near a door in the environment.
0108At <b>414</b> of method <b>411</b>, the selection device may receive the desired display device. The desired display device may be received by pointing the selection device.
0109At <b>416</b> of method <b>411</b>, the selection device may receive display device identifiers for the desired display device. For example, the display identifiers may be received from the database created during configuration of the display devices.
0110At <b>418</b> of method <b>411</b>, the selection device may confirm the display device. For example, the display device may output an image or auditory signal and the selection device may confirm that display device for use. The method <b>411</b> may then end.
0111Turning to <figref idref="DRAWINGS">FIG. 4C</figref>, an example display method <b>419</b> is shown. The display method may drive multimedia content from a source device to a display device, for example a display device selected during example selection method <b>411</b>.
0112At <b>420</b> of method <b>419</b>, the source device may be associated with the selected display device.
0113At <b>422</b> of method <b>419</b>, the source device may drive content to the selected display device. In this manner, a presentation or video, for example, on a source device may be transferred from the source device to the selected display device. The method may then end.
0114Thus, a method for configuring a multimedia environment is outlined above. The method includes configuring the room position of a display device, for example one display device, two display devices, or a plurality of display devices. The display devices may be, for example, a monitor, a TV, a projector, or a display device as previously described.
0115In one example, the method for configuring a multimedia environment comprises receiving from a first display device and a second display device display device information. The display device information comprises a display device identifier and a network connectivity. The display device information is received at a configuration device coupled to the first display device and the second display device over a network connection. The method includes identifying a room position for the first display device and the second display device, associating the identified room position with the received display device information for the first display device and the second display device, and storing the associated room position and display device information for the first display device and the second display device as configuration data in a configuration database.
0116The method further comprises accessing the configuration database from a selection device; receiving a room position at the selection device from at least one of the first display device and second display device; and associating the received room position with the configuration database to determine a desired display device.
0117The method further comprises connecting the selection device to a source device, the source device comprising multimedia content, and driving multimedia content from the source device via the selection device to the desired display device. In one example, the source device is an external source device and operatively coupled to the selection device. In another example, the source device may be integrated with the selection device, the configuration device, or both. Additionally, in one example, the source device and the at least one of the first display device and the second display device are connected to one or more telecommunications networks for use in sending multimedia content from the source device to the desired display device.
0118The method further comprising, prior to driving the multimedia content from the source device, encoding the display device identifier associated with the desired display device into an encoded signal and sending the encoded signal to the source device. In one example, the encoded signal is an audio signal.
0119The method further comprising receiving a reference data from a reference source, the reference data comprising a room position; associating the reference data with the reference source; and storing the associated reference data in the configuration database. For example, the reference source may be the corners of the room as previously described with respect to <figref idref="DRAWINGS">FIG. 3C</figref>.
0120Turning now to <figref idref="DRAWINGS">FIG. 4D</figref>, a method <b>423</b> is shown for configuring a device to identify and select one or more display devices for multimedia content output. Although method <b>423</b> will be described with reference to selection device <b>202</b> of <figref idref="DRAWINGS">FIG. 2</figref> and environment <b>100</b> of <figref idref="DRAWINGS">FIG. 1A</figref>, it will be appreciated that the method may be carried out by other devices capable of determining their spatial orientation and communicating information to a network device or display devices. With respect to selection device <b>202</b>, method <b>423</b> may be implemented in instructions stored on memory subsystem <b>216</b> and executed on logic subsystem <b>214</b>.
0121At <b>424</b> of method <b>423</b>, a configuration application is executed on selection device <b>202</b> or another device such as configuration device <b>120</b> of <figref idref="DRAWINGS">FIG. 1A</figref>. The configuration application may be downloaded and installed by a user prior to entering the environment in which output selection is to take place, or may be stored on a device in the environment and downloaded therefrom. For example, configuration device <b>120</b> in environment <b>100</b> may store the configuration application which may then be downloaded via communication subsystem <b>206</b> of selection device <b>202</b>. The configuration application may train the selection device to identify and select display devices in the environment.
0122At <b>426</b>, display devices in the environment may be identified on one or more networks. For example, selection device <b>202</b> may establish a connection via communication subsystem <b>206</b> with network device <b>116</b> to obtain a list of display devices connected to the network device and their associated connectivity identifiers specific to that network (e.g., IP addresses). Turning now to <figref idref="DRAWINGS">FIG. 5A</figref>, an exemplary configuration application <b>500</b> having a graphical user interface (GUI) <b>502</b> is shown, which may be executed on selection device <b>202</b> in embodiments in which the selection device includes a display screen (e.g., a touch screen on a smartphone). A window <b>504</b> reports that the selection device is connected to a LAN and that four display devices have been identified on that LAN. Window <b>504</b> further reports that a configuration phase has been initiated in which selection device <b>202</b> is trained to drive display device output selection. A region <b>506</b> toward the right side of GUI <b>502</b> lists each identified display device, their associated names, and their associated connectivity identifiers, which in this example are IP addresses specific to the LAN.
0123Returning to <figref idref="DRAWINGS">FIG. 4D</figref>, at <b>428</b> of method <b>423</b>, a display device identification selection is received via configuration application <b>500</b>. An “identification selection” as used herein may refer to a user selecting a display device to be identified as opposed to used, as the display device has not yet been configured for use. The selection may be physically received via input subsystem <b>208</b> of selection device <b>202</b>. <figref idref="DRAWINGS">FIG. 5A</figref> represents such a selection. As shown in GUI <b>502</b>, and particularly in region <b>506</b>, “Interactive Whiteboard 2” has been selected, the selection represented in the figure by the bolded border and shading. Window <b>504</b> accordingly reports the selection, indicating that Interactive Whiteboard 2 is currently undergoing identification.
0124At <b>430</b> of method <b>423</b>, a display identifier may optionally be routed to the selected display device, which in this case corresponds to Interactive Whiteboard 2. <figref idref="DRAWINGS">FIG. 6</figref> shows an exemplary display identifier which may be routed to a display device undergoing identification. In this example, an exemplary display device <b>600</b> is shown displaying a display identifier <b>602</b>. Display identifier <b>602</b> indicates that display device <b>600</b> is undergoing identification and that the device used to identify the display device (e.g., selection device <b>202</b>) must be activated for the display device to be configured for use. Display identifier <b>602</b> also reports the name of the display and its associated connectivity identifier (e.g., IP address).
0125At <b>432</b> of method <b>423</b>, selection device <b>202</b> orientation data is determined upon activation of the selection device. In one example, activation may be carried out by pressing, clicking, or otherwise engaging a button <b>508</b> in GUI <b>502</b>, labeled “IDENTIFY”. Upon activation, the spatial orientation of selection <b>202</b> may be determined by evaluating measurements produced by elements described above—e.g., compass <b>218</b> and/or gyroscope <b>220</b>. Orientation data determined here at <b>432</b> may correspond to an identifying spatial orientation as described above, and may be respective to the display device undergoing identification—in other words, associated with the display device. Determination of the spatial orientation of selection device <b>202</b> may further include at <b>434</b> receiving and comparing orientation data garnered from a reference source (e.g., reference source <b>122</b> in environment <b>100</b>) with the selection device orientation data (e.g., identifying spatial orientation) determined at <b>432</b> to thereby increase the accuracy of spatial orientation determination accuracy. Any suitable technique may be used to compare reference source and selection device orientation data, such as matching source and selection device orientation data via a lookup table, which may be determined by logic subsystem <b>214</b> and stored in memory subsystem <b>216</b>, for example. It will be further appreciated that at this or another step of method <b>423</b>, a spatial location of a user and/or selection device <b>202</b> may be received to thereby improve display device identification and/or selection, for example in embodiments in which display devices are associated with quadrants, angular regions, or other unique regions. Reception of such data may improve display device selection for scenarios in which users position themselves in areas away from the center of an environment.
0126At <b>436</b> of method <b>423</b>, one or more connectivity identifiers are associated with the selection device orientation determined at <b>432</b> for the selected display device. In some embodiments, one or more connectivity identifiers are determined at <b>426</b>. In such a case, the determined connectivity identifier(s) may be easily associated with the selection device orientation for the selected display device. Other scenarios are possible, for example, such as that described in further detail below with reference to <figref idref="DRAWINGS">FIG. 4E</figref>.
0127At <b>438</b> of method <b>423</b>, it is evaluated whether or not orientation data for all display devices identified at <b>426</b> has been determined. Such evaluation may be carried out by configuration application <b>500</b>, for example, which may notify a user if orientation for all identified displays has not been determined. If orientation data for all display devices identified at <b>426</b> has not been determined, method <b>423</b> may return to <b>428</b> to obtain orientation data for all identified display devices. As shown in <figref idref="DRAWINGS">FIG. 5A</figref>, window <b>504</b> also includes a termination button <b>510</b> which may be engaged by a user to terminate configuration before orientation data is determined for all identified displays, though such termination may limit the number of display devices which may be controlled in their environment.
0128It will be appreciated that the steps heretofore described may correspond to the configuration phase described above in which selection device <b>202</b> is trained to identify and select display devices in its environment, while those following and illustrated in <figref idref="DRAWINGS">FIG. 4E</figref> may correspond to a use phase in which display device selection may be carried out by controlling the orientation and activation of the selection device. In some embodiments, the configuration phase may be performed on selection device <b>202</b> or a separate device (e.g., configuration device <b>120</b> in <figref idref="DRAWINGS">FIG. 1A</figref>) prior to use of an environment and its display devices by one or more users. Here, data recorded during the configuration phase (e.g., spatial orientations and connectivity identifiers) may be saved for later use if the same device is used to select display devices, or the data may be saved for subsequent downloading by another device. The latter example may correspond to a scenario in which an information technology professional has configured an environment for use. Following such configuration, users may arrive with their own selection devices and use such devices to download the configuration information, for example configuration data stored in a configuration database, such that they may immediately control the spatial orientation and activation of their selection devices to drive display device selection and output, bypassing the configuration phase. In <figref idref="DRAWINGS">FIG. 1A</figref>, for example, configuration device <b>120</b> may be used to carry out the configuration phase and store associated configuration data for later download by one or more selection devices.
0129Turning now to <figref idref="DRAWINGS">FIG. 4E</figref>, a method <b>451</b> is shown for selecting display devices for multimedia content output. Method <b>451</b> may be stored on memory subsystem <b>216</b> and executed by logic subsystem <b>214</b> of selection device <b>202</b>. It will be appreciated, however, that method <b>451</b> may be carried out by other suitable devices.
0130At <b>452</b>, an image of a display device may optionally be captured upon activation, for example by camera <b>212</b>. As described above with reference to <figref idref="DRAWINGS">FIG. 1A</figref>, an image may be captured of a display device itself (e.g., display device <b>104</b>), a secondary display device (e.g., secondary display device <b>123</b>) adjacent the first display device, a set of lights (e.g., set of lights <b>124</b>) on a bezel of the display device, or an identifying mark (e.g., identifying mark <b>126</b>) which may also be on the bezel of the display device. At <b>454</b>, an audio signal emitted by the display device may optionally be received in embodiments in which one or more display devices are capable of outputting audio—e.g., display device <b>104</b> which includes integrated speaker <b>128</b>.
0131At <b>455</b>, following completion of the configuration phase, a display device output selection may be received via a control application or via activation of selection device <b>202</b>. Turning now to <figref idref="DRAWINGS">FIG. 5B</figref>, an exemplary control application <b>550</b> having a GUI <b>552</b> is shown. Control application <b>550</b> may be executed on selection device <b>202</b> in embodiments in which the selection device includes a display screen, or the application may be executed on source device <b>118</b> in embodiments in which the source device stores multimedia content to be shared, for example. As in configuration application <b>500</b>, GUI <b>552</b> displays region <b>506</b> which lists the identified display devices, their associated names, and their associated connectivity identifiers. A window <b>554</b> indicates the multimedia content being outputted and to which display device it is being outputted. In this example, the desktop of an operating system executing control application <b>550</b> is being shared to Interactive Whiteboard 2. Window <b>554</b> further lists one or more running applications in an application region <b>556</b> whose output may be shared to the identified display devices. A preview region <b>558</b> provides a representation of the output being sent to Interactive Whiteboard 2. Finally, control application <b>550</b> includes an output termination button which may be engaged to terminate output to Interactive Whiteboard 2. It will be appreciated that control application <b>550</b> is shown for illustrative purposes, and that in some embodiments, the control application may be combined with configuration application <b>500</b> described above. The state and appearance of the combined application may change depending on a transition from the configuration phase to the use phase.
0132Control application <b>550</b> also illustrates one of a plurality of methods which may be used to select display devices for multimedia content output. In some embodiments, selection of a desired display device and output of multimedia content thereto may be carried out by engaging a button corresponding to the desired display device (e.g., pressing the button on a touch screen). Additionally or alternatively, the orientation of a selection device executing control application <b>550</b> (e.g., selection device <b>202</b>) may be controlled to point toward a desired display device and the selection device may be activated to route multimedia content to the desired display device, as described above. In this example, a selecting spatial orientation may be recorded, also as described above. It will be appreciated that reference source orientation data received at <b>434</b> of method <b>423</b> may be compared to a recorded selecting spatial orientation alternatively or in addition to a recorded identifying spatial orientation. In this way, an accuracy of the selecting spatial orientation and/or identifying spatial orientation, respective to the desired display, may be increased.
0133At <b>456</b>, the spatial orientation of selection device <b>202</b> is determined with compass <b>218</b> and gyroscope <b>220</b>. It will be appreciated, however, that other methods and components may be used to determine the spatial orientation of the selection device, as described above. At <b>458</b>, a display device desired to receive multimedia content output is determined based on the spatial orientation determined at <b>456</b>. As described above, determination of the desired display device may include matching the selection device spatial orientation at the time of activation (e.g., selecting spatial orientation) to a previously-recorded spatial orientation (e.g., identifying spatial orientation), and may include consideration of tolerance, angular or other regions, and reference source(s).
0134At <b>460</b>, one or more connectivity identifiers associated with the display device may be determined. Such connectivity identifier(s) may be determined at <b>426</b> of method <b>423</b>, for example. Alternatively or additionally, the connectivity identifier(s) may be determined based on information optionally gathered at <b>452</b> and/or <b>454</b>. In the latter example, the secondary display, set of lights, identifying mark, and emitted audio signal may each encode therein one or more connectivity identifiers associated with the display device, as described above. Determining such connectivity identifiers at <b>460</b> may thus include decoding such sources of light and audio. As shown in <figref idref="DRAWINGS">FIG. 1A</figref>, display device <b>104</b> may output a QR code <b>130</b> encoding therein an associated IP address. At <b>462</b>, multimedia content output to the display device may then be driven according to the associated connectivity identifiers. In this way, a method may be provided in which connectivity identifiers for display devices are encoded in an environment and which may be detected by a camera and/or microphone, for example. Such an approach may obviate the need for a configuration phase, allowing rapid and intuitive control of display device output.
0135Method <b>451</b> shows two possibilities by which multimedia content may be routed to the display device. At <b>464</b>, multimedia content may be routed to the display device via the one or more connectivity identifiers determined at <b>460</b>. Such an approach may refer to embodiments in which the selection device executing method <b>451</b> (e.g., selection device <b>202</b>) is connected to the network to which the display device is also connected, and to embodiments in which the selection and source device are integrated into a single device. Thus multimedia content originating on the selection device may be directly routed to the display device after determination of the associated one or more connectivity identifiers. In other embodiments, method <b>451</b> may proceed to <b>466</b> where the selection device emits an audio signal (e.g., via speaker <b>210</b>) including therein spatial orientation data of the selection device and/or one or more connectivity identifiers associated with the display device. In this example, the selection device may be used to select display devices and obtain their associated connectivity identifiers. Selection of a display device upon activation may then be communicated to a separate device which may store multimedia content to be shared (e.g., source device <b>118</b> in <figref idref="DRAWINGS">FIG. 1A</figref>). Window <b>554</b> of <figref idref="DRAWINGS">FIG. 5B</figref> illustrates a message reading “transmitting selecting audio signal” in embodiments in which a selection is conveyed via audio transmission.
0136Turning now to <figref idref="DRAWINGS">FIG. 7</figref>, an exemplary pointing device or pointer <b>700</b> is shown for use as a selection device. Pointer <b>700</b> may facilitate and communicate display device identification and/or selection and communicate to a separate device storing multimedia content to be shared. Pointer <b>700</b> may have a substantially cylindrical body suited to a typical user's grip and a conical head having a truncated, flat tip. Further, pointer <b>700</b> may house one or more of the elements of selection device <b>202</b> in some embodiments.
0137Proceeding left-to-right in the figure, pointer <b>700</b> may include a camera <b>702</b>, a microphone <b>704</b>, a speaker <b>706</b>, a button <b>708</b>, a communication port <b>710</b>, and a hatch <b>712</b>. The camera, microphone, and speaker may be configured to carry out the functionality described above with respect to their counterparts in selection device <b>202</b>. Button <b>708</b> may be a physical button which may be pressed by a user to activate pointer <b>700</b>, causing emission of information regarding display device identification and/or selection from speaker <b>706</b>. Communication port <b>710</b> may be a physical interface configured to send and receive information during a configuration phase. In some embodiments, communication port <b>710</b> is a USB port by which pointer <b>700</b> may be connected to another device to receive configuration information, as described in further detail below with reference to <figref idref="DRAWINGS">FIG. 8</figref>. Hatch <b>712</b> may be a detachable, releasable, or include other accessible mechanisms by which an internal power source (not shown) may be accessed. The power source may correspond to power source <b>204</b> of selection device <b>202</b>, and may be a replaceable and/or rechargeable nickel-cadmium or lithium-ion battery, for example. Pointer <b>700</b> may further internally include a logic subsystem <b>714</b> and a memory subsystem <b>716</b>, which may correspond to logic subsystem <b>214</b> and memory subsystem <b>716</b> of selection device <b>202</b>, respectively. Logic subsystem <b>714</b> may be configured to execute instructions stored on memory subsystem <b>716</b> to thereby facilitate display device identification and/or selection. Still further, pointer <b>700</b> may include a compass <b>718</b> and a gyroscope <b>720</b> configured to determine the spatial orientation and/or pointing direction of the pointer. Compass <b>718</b> and gyroscope <b>720</b> may correspond to compass <b>218</b> and gyroscope <b>220</b> of selection device <b>202</b>, respectively.
0138Turning now to <figref idref="DRAWINGS">FIG. 8</figref>, a method <b>800</b> is shown illustrating a method by which a pointer (e.g., pointer <b>700</b>) may be configured using a configuration device, which may be, for example, source device <b>118</b> or configuration device <b>120</b>. At <b>802</b>, a configuration application (e.g., configuration application <b>500</b>) may be executed on the configuration device. At <b>804</b>, one or more display devices on a network to which the configuration device is connected may be identified. At <b>806</b>, a connection may be established between the configuration device and pointer <b>700</b>, for example by connecting pointer <b>700</b> via communication port <b>710</b> to a suitable communication port in the configuration device. At <b>808</b>, a display device identification selection may be received via the configuration application. Such selection may be user input indicating a display device which the user desires to identify. Accordingly, at <b>810</b>, a display identifier may optionally be routed to the identified display device. The display identifier may provide a visual indication of the display device undergoing identification, as described above with reference to <figref idref="DRAWINGS">FIG. 6</figref>. At <b>812</b>, orientation data corresponding to the identified display device may be received from pointer <b>700</b>. The orientation data may be recorded upon activation of pointer <b>700</b> (e.g., via pressing button <b>708</b>) via one or more orientation-determining devices (e.g., a gyroscope, compass, etc.). At <b>814</b>, the recorded orientation data may be compared to reference source orientation data in embodiments in which reference source orientation data is recorded from a reference source (e.g., reference source <b>122</b> in <figref idref="DRAWINGS">FIG. 1A</figref>). The comparison may improve the accuracy of orientation data (e.g., identifying and/or selecting spatial orientation) associated with the display device. At <b>816</b>, the resulting orientation data, along with one or more connectivity identifiers associated with the display device, may be encoded by the configuration device. The connectivity identifier(s) may be collected, for example, by the configuration device at <b>804</b>. The orientation data and one or more connectivity identifiers may be encoded in any suitable format using any suitable technique. In some embodiments, such information may be encoded in an alphanumeric text string storing spatial orientations and/or connectivity identifiers in an array data structure. In some environments in which a plurality of display devices are identified with each having an associated spatial orientation and one or more connectivity identifiers, the resulting text string may not exceed 100 bytes, which may reduce computational overhead, increase the speed of display device identification and selection, and decrease the silicon footprint of pointer <b>700</b>.
0139At <b>818</b>, the encoded orientation data and one or more connectivity identifiers may be transferred to pointer <b>700</b> via communication port <b>710</b> for storage on memory subsystem <b>716</b>. If, as in some embodiments, such data is encoded in one or more alphanumeric text strings, a transfer rate on the order of 9600 bauds may be sufficient, for example, which may reduce computational overhead and power consumption. Further, the transfer performed at <b>818</b> may be on the order of several seconds, for example. Finally, at <b>820</b>, it is determined whether or not orientation data for all display devices identified at <b>804</b> have been transferred to pointer <b>700</b>. If it is determined that orientation data for all display devices identified at <b>804</b> have not been transferred to pointer <b>700</b> (NO), method <b>800</b> may return to <b>808</b> to complete identification of all display devices in the corresponding environment.
0140The steps heretofore described may correspond to a configuration phase in which pointer <b>700</b> is trained to identify and select one or more display devices in an environment using a separate configuration device. <figref idref="DRAWINGS">FIG. 9</figref> shows a method <b>900</b> which may be implemented on a device (e.g., source device <b>118</b> or configuration device <b>120</b>) to drive display device selection. Method <b>900</b> may correspond to a use phase, for example the selection phase, following the configuration phase.
0141At <b>902</b>, an audio signal emitted by speaker <b>706</b> of pointer <b>700</b> may be received by the source device and an associated microphone. The audio signal may be encoded by default, as the audio signal may directly represent encoded information (e.g., an encoded alphanumeric text string) stored on memory subsystem <b>716</b>. Alternatively, logic subsystem <b>714</b> may encode display device selection information prior to its emission via speaker <b>706</b>. The audio signal may include a spatial orientation and one or more connectivity identifiers associated with a display device. At <b>904</b>, the received audio signal may be decoded at the source device to thereby identify the display device selected by pointer <b>700</b>. At <b>906</b>, a connection may be established with the display device identified in the decoded audio signal. Finally, at <b>908</b>, multimedia content may be routed to the display device identified in the decoded audio signal via one or more decoded connectivity identifiers. Multimedia content may reside on source device <b>118</b>, for example, such that the multimedia content may be directly routed to the display device, or in other embodiments, the multimedia content may reside on a separate device connected to the network device <b>116</b>. As a non-limiting example, an IP address associated with a display device may be determined from the audio signal and used to route multimedia content to the display device. It will be appreciated, however, that the above described steps may apply to scenarios in which a selection device is separate but operatively coupled to a source device holding multimedia content thereon—for example, as shown in <figref idref="DRAWINGS">FIG. 1A</figref>, selection device <b>114</b> may be separate but communicative with source device <b>118</b>. In other embodiments in which the source and selection device are integral (e.g., provided in the same device housing), steps <b>902</b> and <b>904</b> may be omitted.
0142As an illustrative example, a method may be executed by a selection device having a camera (e.g., pointer <b>700</b> having camera <b>702</b>) to select display devices. In this approach, a configuration phase may be omitted as describe above. An image of a display device may be captured by the camera (e.g., camera <b>702</b>) upon activation of the selection device. As described above, an image of a secondary display, set of lights, or identifying mark may be captured which each may encode one or more connectivity identifiers associated with the display device. An identifying audio signal emitted by the display device may then be received (e.g., from display speaker <b>128</b> of display device <b>104</b>), which may also encode therein one or more connectivity identifiers associated with the display device. Finally, the selection device may emit an encoded audio signal including one or more connectivity identifiers determined from the above sources. The encoded audio signal may then be received by a separate device having multimedia content stored thereon (e.g., source device <b>118</b> in <figref idref="DRAWINGS">FIG. 1A</figref>) or by another device configuration device (e.g., configuration device <b>120</b>) which may then route multimedia content to the selected display. Pointer <b>700</b> may emit an encoded audio signal from speaker <b>706</b>, for example. In this way, pointer <b>700</b> may be used to immediately select display devices for multimedia content while bypassing a configuration phase. Such an approach may allow users to bring source devices having multimedia content stored thereon to an environment and control the spatial orientation and activation of pointer <b>700</b> to thereby route the multimedia content to a desired display device.
0143Turning now to <figref idref="DRAWINGS">FIGS. 10A and 10B</figref>, a method <b>1000</b> for routing multimedia content to a desired display device according to an embodiment of the present disclosure is shown. Method <b>1000</b> may be implemented in multimedia environment <b>300</b> of <figref idref="DRAWINGS">FIG. 3C</figref>, for example. At <b>1002</b>, method <b>1000</b> may optionally include receiving a reference source spatial orientation with a selection device. As discussed above, the reference source spatial orientation may be a spatial orientation of a fixed point within the multimedia environment. At <b>1004</b>, method <b>1000</b> may optionally include receiving a selecting reference source spatial orientation with the selection device. As discussed above, the reference source spatial orientation may be compared to the selecting reference source spatial orientation at <b>1006</b> and a position and spatial orientation of the selecting device may be determined at <b>1008</b>. The optional steps <b>1002</b>, <b>1004</b>, <b>1006</b>, and <b>1008</b> of method <b>1000</b> may provide increased accuracy of identifying spatial orientations and selecting spatial orientations received at step <b>1010</b> and step <b>1022</b>, respectively.
0144At <b>1010</b>, method <b>1000</b> may include receiving a respective identifying spatial orientation of each of the one or more display devices with the selection device. At <b>1012</b>, method <b>1000</b> may include associating the spatial orientation and one or more connectivity identifiers with each of one or more display devices in an environment (e.g., multimedia environment <b>300</b>). Put another way, a spatial orientation which is used to identify a display device (e.g., during the configuration phase in conjunction with execution of configuration application <b>500</b>), and which is respective to one of one or more display devices, is associated with that one display device. In this way, an identifying spatial orientation and one or more connectivity identifiers are respectively associated with each of the one or more display devices in the environment. As described above, the identifying spatial orientations may be determined by one or more orientation-determining components (e.g., compass <b>218</b> and/or gyroscope <b>220</b> of selection device <b>202</b>) and/or the position and spatial orientation of the selecting device within multimedia environment <b>300</b>, while the one or more connectivity identifiers may be determined by a device (e.g., selection device <b>114</b>, source device <b>118</b>, or selection device <b>202</b>) connected to a network to which the one or more display devices are connected. Such information may be respectively associated with each of the one or more display devices by a device executing configuration application <b>500</b>—for example selection device <b>114</b>, configuration device <b>120</b>, or selection device <b>202</b>. At <b>1014</b>, the respective identifying spatial orientation and one or more connectivity identifiers for each of the one or more display devices may be stored locally within memory of the selecting device, configuration device, or device executing the configuration application. In other embodiments, the respective spatial orientation and one or more connectivity identifiers for each of the one or more display devices may be stored remotely, such as at a network connected server and/or cloud based storage, for example.
0145At steps <b>1016</b>, <b>1018</b>, and <b>1020</b>, method <b>1000</b> may optionally include receiving a selecting reference source spatial orientation, comparing the reference source spatial orientation to the selecting source spatial orientation, and determining the position and spatial orientation of the selection device. Repeating these steps prior to receiving a respective selecting spatial orientation of a desired display device provides the advantage of selection of a desired display device from multiple positions within the multimedia environment. As discussed above for <figref idref="DRAWINGS">FIG. 3C</figref>, a change in position of the selection device within multimedia environment <b>300</b> may change the spatial orientation of the one or more display devices relative to the selection device. As the stored spatial orientations of each of the one or more display devices are determined relative to the position and spatial orientation of the selection device during the configuration phase, repeating the determination of the position and spatial orientation of the display device may be used to correct the respective spatial orientations of each of the one or more display devices relative to the change in position of the selection device within the multimedia environment.
0146At <b>1022</b>, a respective selecting spatial orientation is received. The selecting spatial orientation may be a spatial orientation recorded upon activation of selection device <b>114</b> or selection device <b>202</b>, for example, and may be recorded for the purpose of selecting a display device for multimedia content output. In some embodiments, the respective selecting spatial orientation may be received by the same device used to record the selecting spatial orientation (e.g., selection device <b>202</b>). In other embodiments, the selecting spatial orientation may be recorded by pointer <b>700</b>, encoded in an audio signal emitted by the pointer, and received by a separate device (e.g., source device <b>118</b>). At <b>1024</b>, the respective selecting spatial orientation is matched to the respective identifying spatial orientation to determine the display device desired for multimedia content output. Such matching may again be performed by the same device or by separate devices used to record one or both of the identifying and selecting spatial orientations. As described above, in some embodiments, matching may include utilizing reference source orientation data and may include spatial orientations to angular regions or quadrants separating individual display devices. At <b>1026</b>, method <b>1000</b> may optionally include retrieving the one or more connectivity identifiers of the desired display device from local or remote storage.
0147Finally, at <b>1028</b>, multimedia content is routed to the desired display device via one of the one or more connectivity identifiers associated with the desired display device. The multimedia content may be routed, for example, by the device storing the multimedia content (e.g., source device <b>118</b> of <figref idref="DRAWINGS">FIG. 1A</figref>).
0148Thus, as described above, in one embodiment, a method for routing multimedia content to a desired display device is provided. In one example method, the method includes receiving a respective identifying spatial orientation, associating the respective identifying spatial orientation and one or more connectivity identifiers with each of one or more display devices, receiving a respective selecting spatial orientation, matching the respective selecting spatial orientation to the respective identifying spatial orientation to thereby determine the desired display device from the one or more display devices, and routing multimedia content from a source device to the desired display device via one of the one or more associated connectivity identifiers. The method may further include prior to routing the multi-media content from the source device, encoding the connectivity identifier associated with the desired display device into an encoded signal and sending the encoded signal to the source device. In some examples, the encoded signal may be an audio signal. The source device and one or more display devices may be connected to one or more telecommunications networks for use in sending multi-media content from the source device to the display device. For example, the source device and the display device may both include wireless telecommunications functionality. As a non-limiting example, the source device and display device may both connect to a wireless data network, such as a 3G, 4G, LTE, or any other suitable cellular data network. A second non-limiting example may include the source device and the display device including wireless telephone network connectivity where each of the source device and display device may have a specific identifier or phone number and may communicate via Short Message Service (SMS) messaging or any other suitable messaging protocol. In some embodiments, the respective identifying spatial orientation and one or more connectivity identifiers associated with each of the one or more display devices may be stored in local or remote storage. The stored identifying spatial orientation and one or more connectivity identifiers may be retrieved from storage for a display device with a respective identifying spatial orientation matching the respective selecting spatial orientation.
0149As another non-limiting example, the method may further include receiving a reference source spatial orientation and comparing the reference source spatial orientation to the respective selecting spatial orientation to determine a position and spatial orientation of the selection device during configuration and prior to receiving the respective selecting spatial orientation thereby increase an accuracy of the respective selecting spatial orientation. The respective selecting spatial orientation may be received from a selection device and the multimedia content may be routed from a source device where the selection device has one or more orientation-determining components. The one or more orientation-determining components may include one or both of a compass and a gyroscope. The selection device may be integrated into the source device.
0150As described above, a system for routing multimedia content to a desired display device is disclosed. In an example system, an orientation-determining component configured to determine a respective identifying spatial orientation and a respective selecting spatial orientation for each of one or more display devices in an environment is provided. The system may include a logic subsystem and a memory subsystem holding instructions executable by the logic subsystem to associate the respective identifying spatial orientation and one or more connectivity identifiers with each of the one or more display devices, match the respective selecting spatial orientation to the respective identifying spatial orientation to thereby determine the desired display device from the one or more display devices, and encode the connectivity identifier associated with the desired display device into an encoded signal and send the encoded signal to a source device.
0151The system may further include instructions executable to receive a reference source spatial orientation; and compare the reference source spatial orientation to the respective selecting spatial orientation to thereby increase an accuracy of the respective selecting spatial orientation. The reference source spatial orientation may include a room position of the reference source and a room angulation of the reference source. The orientation-determining components may include one or both of a compass and a gyroscope.
0152In one example system, the source device may be configured to send multi-media content to the desired display device based on the connectivity identifier received in the encoded signal. The system may further include a camera configured to capture images of one or more of a secondary display device, a set of lights, and an identifying mark. A power source may be configured to supply electrical power to the logic subsystem, memory subsystem, and camera.
0153Turning now to <figref idref="DRAWINGS">FIG. 11</figref>, a method <b>1100</b> for configuring a source device to identify and select one or more display devices for multimedia content output according to an embodiment of the present disclosure is disclosed. Method <b>1100</b> may be implemented in environment <b>100</b> of <figref idref="DRAWINGS">FIG. 1A</figref>. At <b>1102</b>, method <b>1100</b> includes executing a configuration application on a source device, such as source device <b>118</b> of <figref idref="DRAWINGS">FIG. 1A</figref>, for example. Upon execution of the configuration application, source device <b>118</b> may enable an integrated microphone to listen for an audio signal emitted by one of display devices <b>102</b>, <b>104</b>, <b>106</b>, <b>108</b>, <b>109</b>, and <b>110</b> present in environment <b>100</b>. For example, User <b>112</b> may cause display device <b>104</b> to emit an audio signal. The audio signal may encode a display device identifier, a connectivity identifier, spatial orientation information, one or more connection protocols, etc.
0154At <b>1104</b>, method <b>1100</b> includes receiving the audio signal emitted from the display device. The source device may receive a display device and connectivity identifier at <b>1106</b>. The source device may receive the display device and connectivity identifier through processing the audio signal.
0155At <b>1108</b>, method <b>1100</b> includes determining one or more connectivity identifiers associated with the display device. The one or more connectivity identifiers may include any of a network identifier such as an IP address, an identifier for direct connection such as a Bluetooth, Miracast, or any other direct connection protocol, or any identifier employed by a suitable connectivity method.
0156At <b>1110</b>, method <b>1100</b> includes driving multimedia content output to the display device, such as a test pattern, audio signal, or other multimedia content, through one of the one or more connectivity identifiers. Optionally and additionally, at <b>1112</b>, method <b>1100</b> may include the source device routing multimedia content to the display device via one or more determined connectivity identifiers. The method may then end.
0157Thus, a system and method for configuring a multimedia environment is provided as discussed above. The system and method may be used for a single display device or multiple display devices. The display devices may be in a room and have a spatial orientation associated with the display device. The display devices may be configured with a configuration device and then selected for use with a selection device. The configuration device may be used to populate a configuration database with configuration data. The selection device may be used to access the configuration database and relate a selection spatial orientation of a desired display device to the stored configuration data in the configuration database to select the desired display device. The selection device may then confirm the desired display device and drive multimedia source content from a source device, which may be integrated or a standalone system, to the desired display device. Additionally, multiple display devices, if present, may be selected.
0158It will be appreciated that the configurations disclosed herein are exemplary in nature, and that these specific embodiments are not to be considered in a limiting sense, because numerous variations are possible. The subject matter of the present disclosure includes all novel and nonobvious combinations and subcombinations of the various configurations, and other features, functions, and/or properties disclosed herein.
0159The following claims particularly point out certain combinations and subcombinations regarded as novel and nonobvious. These claims may refer to “an” element or “a first” element or the equivalent thereof. Such claims will be understood to include incorporation of one or more such elements, neither requiring nor excluding two or more such elements. Other combinations and subcombinations of the disclosed features, functions, elements, and/or properties may be claimed through amendment of the present claims or through presentation of new claims in this or a related application.
0160Such claims, whether broader, narrower, equal or different in scope to the original claims, also are regarded as included within the subject matter of the present disclosure.
Contents4
23 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23
Every citation, both ways
| Document | Relation | Office | Category | Cited during | Relevant claims |
|---|---|---|---|---|---|
| US12045545B2 | Cited by | United States of America | – | Applicant | – |
| US12314638B2 | Cited by | United States of America | – | Applicant | – |
| US2015248119A1 | Cited by | United States of America | – | Pre-grant | – |
| US12400048B2 | Cited by | United States of America | – | Applicant | – |
| US11750672B2 | Cited by | United States of America | – | Applicant | – |
| US11003013B2 | Cited by | United States of America | – | Search report | – |
| US11212127B2 | Cited by | United States of America | – | Search report | – |
| US12086943B2 | Cited by | United States of America | – | Applicant | – |
| US10341478B2 | Cited by | United States of America | – | Search report | – |
| US2025047809A1 | Cited by | United States of America | – | Search report | – |
| US12589862B2 | Cited by | United States of America | – | Search report | – |
| US9986437B2 | Cited by | United States of America | – | Search report | – |
| US10548003B2 | Cited by | United States of America | – | Search report | – |
| US2017147272A1 | Cited by | United States of America | – | Pre-grant | – |
| US2023315271A1 | Cited by | United States of America | – | Pre-grant | – |
| US2025361004A1 | Cited by | United States of America | – | Pre-grant | – |
| US2019266887A1 | Cited by | United States of America | – | Search report | – |
| US10989952B2 | Cited by | United States of America | – | Search report | – |
| US10462345B2 | Cited by | United States of America | – | Applicant | – |
| US2023359779A1 | Cited by | United States of America | – | Search report | – |
| US12248737B2 | Cited by | United States of America | – | Applicant | – |
| EP3573016A4 | Cited by | European Patent Office (EPO) | – | Search report | – |
| US2015207794A1 | Cited by | United States of America | – | Search report | – |
| US12086509B2 | Cited by | United States of America | – | Applicant | – |
| US9958843B2 | Cited by | United States of America | – | Search report | – |
| US10061552B2 | Cited by | United States of America | – | Applicant | – |
| US10409102B2 | Cited by | United States of America | – | Search report | – |
| US11956289B2 | Cited by | United States of America | – | Applicant | – |
| US12475273B2 | Cited by | United States of America | – | Applicant | – |
| US12032875B2 | Cited by | United States of America | – | Applicant | – |
| US10409103B2 | Cited by | United States of America | – | Search report | – |
| US12086507B2 | Cited by | United States of America | – | Applicant | – |
| US11900022B2 | Cited by | United States of America | – | Search report | – |
| US10831364B2 | Cited by | United States of America | – | Applicant | – |
| US12301642B2 | Cited by | United States of America | – | Applicant | – |
| US10810867B2 | Cited by | United States of America | – | Search report | – |
| US2021351946A1 | Cited by | United States of America | – | Pre-grant | – |
| US9727300B2 | Cited by | United States of America | – | Search report | – |
| US12223234B2 | Cited by | United States of America | – | Applicant | – |
| US2012169482A1 | Cites | United States of America | X | Search report | 1-3, 6-20 , 4-5 |
| US2014156281A1 | Cites | United States of America | Y | Search report | 4-5 |
5 members in 2 offices; this record represents the family
Priority claims1
| Document | Office | Kind | Date |
|---|---|---|---|
| 201313838707 | United States of America | A |
Members5
| Document | Office | Kind | |
|---|---|---|---|
| US2014267554A1 | United States of America | A1 | |
| WO2014151023A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US9210376B2 | United States of America | B2 | |
| US2016054971A1 | United States of America | A1 | |
| US10372397B2 | United States of America | B2 |
58 transactions on the USPTO file
Allowed after 1 non-final rejection, 1 final rejection and 1 RCE.
- Non-final rejections
- 1
- Final rejections
- 1
- RCEs
- 1
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Expire PatentEXP. | EXP. | |
| Maintenance Fee Reminder MailedREM. | REM. | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Response to Reasons for AllowanceREAS | REAS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Mail Advisory Action (PTOL - 303)MCTAV | MCTAV | |
| Interview Summary - Examiner Initiated - TelephonicEXET | EXET | |
| After Final Consideration Program Amendment too ExtensiveAFNE | AFNE | |
| Advisory Action (PTOL-303)CTAV | CTAV | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Final ActionA.NE | A.NE | |
| Mail Applicant Initiated Interview SummaryMEXIA | MEXIA | |
| Interview Summary - Applicant Initiated - TelephonicEXAT | EXAT | |
| Interview Summary- Applicant InitiatedEXIA | EXIA | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Correspondence Address ChangeC.AD | C.AD | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Filing Receipt - CorrectedFLRCPT.C | FLRCPT.C | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Sent to Classification ContractorPGPC | PGPC | |
| FITF set to NO - revise initial settingFTFI | FTFI | |
| Application Is Now CompleteCOMP | COMP | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Oath or Declaration Filed (Including Supplemental)C602 | C602 | |
| Patent Term Adjustment - Ready for ExaminationPTA.RFE | PTA.RFE | |
| Applicants have given acceptable permission for participating foreignAPPERMS | APPERMS | |
| Entity Status Set To Undiscounted (Initial Default Setting or Status Change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Lapse for failure to pay maintenance feesLapsedPATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYLAPS | LAPS | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| Information on status: patent application and granting procedure in generalPUBLICATIONS -- ISSUE FEE PAYMENT VERIFIEDSTPP | STPP | |
| Information on status: patent application and granting procedure in generalNOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONSSTPP | STPP | |
| AssignmentAS | AS |
Numbers
- Publication
- 20160054971
- Application
- 14928887
Titles
- English
- MULTIMEDIA OUTPUT AND DISPLAY DEVICE SELECTION
Patent term adjustment
- A delay
- +340 daysthe office missed an examination deadline
- B delay
- +109 dayspendency past three years
- Applicant delay
- −59 days
- Net adjustment
- 390 days
Classification
- CPC, 4
- H04N7/15
- G06F3/1423
- G08C17/02
- G06F3/0346
- IPC, 2
- G06F3 0346
- G06F3 14