Peripheral vision head-mounted display for imparting information to a user without distraction and associated methods
Summary by NHIP
Flexible boom peripheral vision display
The system directs non-reflected illumination into peripheral vision using a flexible boom with position memory to avoid eye repositioning. A subject light display element within a linear one-dimensional array emits light at a fixed wavelength based on its position, while a microcontroller processes sensor data to control the resulting illumination pattern.
Claim Score by NHIP
Abstract
A head-mounted peripheral vision display and associated methods display information to a user without distraction. A plurality of light display elements are positioned within an area of peripheral vision of at least one eye of the user such that the information is imparted to the user without a need for repositioning or refocusing of the eye. The information may be determined from data received from one or more sensors and an illumination pattern is determined based upon the performance information. The light display elements are controlled to display the illumination pattern to the user.

Term
Projected expiry 21 September 2031.
- Priority
- Filed
- Granted
- Today
- Projected expiry
18 claims: 2 independent, 16 dependent
- 1A peripheral vision head-mounted display system for imparting information to a user without distraction, comprising:a flexible boom;at least one light display element located proximate a distal end of the flexible boom, wherein the flexible boom is configured to position the at least one light display element to direct non-reflected illumination into peripheral vision of the user's eye such that a non-textual illumination pattern is visually imparted to the user without repositioning or refocusing, the at least one light display element comprising a plurality of light display elements formed as a linear one-dimensional array, a subject light display element of the plurality of light display elements configured to emit light at a fixed wavelength based upon a position of the subject light display element;anda microcontroller coupled with the light display element for processing information from one or more sensors to determine the illumination pattern based upon the information and for controlling the light display element to display the illumination pattern.
- 11Broadest claimClaim Score 45, average(NHIP)A method for imparting information to a user without distraction, comprising the steps of:receiving the information within a microcontroller of a peripheral vision head-mounted display system having at least one light display element located proximate a distal end of a flexible boom;determining, within the microcontroller, a non-textual illumination pattern for the light display element based upon the information;andcontrolling the light display element to illuminate peripheral vision of an eye of the user with the illumination pattern without reflection;wherein the flexible boom positions the at least one light display element to illuminate the non-textual illumination pattern onto the peripheral vision of the eye, the at least one light display element comprising a plurality of light display elements formed as a linear one-dimensional array, a subject light display element of the plurality of light display elements configured to emit light at a fixed wavelength based upon a position of the subject light display element.
Independent claims2
184 paragraphs in 6 sections, as filed
RELATED APPLICATIONS
This application is a continuation of International Application No. PCT/US2011/052641 filed Sep. 21, 2011, which claims priority to U.S. Provisional Patent Application Ser. No. 61/385,057, filed Sep. 21, 2010. Both of the aforementioned applications are incorporated herein by reference.
FIELD OF THE INVENTION
The present disclosure is directed to a headset that presents information through visual and audible means with minimal impact on user focus and attention toward user activity.
BACKGROUND
Fitness and activity monitors typically take the form of a small display device that is worn as a wristwatch or, in the case of a bicycle computer, motorbike, or snowmobile speedometer, mounted to the handlebars of the vehicle. Performance metrics such as heart rate, speed, distance, location, cadence, power, among others, are measured by one or more sensors connected to the display device either electrically or through a wireless communication link. The display device typically receives, processes, and displays the performance information to the user.
Such activity monitors and feedback mechanisms may present several issues to the user. First, since the display device must be lightweight and portable, the display size is typically small and difficult to read while in motion, a situation that is worsened in low light conditions. In certain sports, such as swimming, it is not feasible for the user to read a display without significantly interfering with the activity. Second, the user must frequently take focus off of his activity to read displayed information, which can be distracting or dangerous to the activity at hand. Competitive athletes can find such a lack of focus detrimental to optimal performance and safety. Certain activities such as cycling, motorcycling, and snowmobiling require constant attention to the road, trail, and surrounding environment; looking elsewhere can lead to injury. Third, the reading and operation of a wrist-worn or handlebar-mounted display can interfere with efficient body motions required for optimal performance. Frequent viewing of a wristwatch, or operation of the wristwatch by the opposite hand, for example, can interfere with the efficient arm and corresponding stride motion during running activity. As another example, the viewing or operation of a bicycle computer can cause the cyclist to exit from a streamlined aerodynamic position, which is detrimental to his resultant performance.
Heads-Up displays, as well known in the art, present a focused image (e.g., alphanumeric characters and/or graphics) to a wearer of the display. The focused image is projected into at least part of the wearer's normal operational field of view, such that the user typically sees the focused image overlaid onto that normal field of view. While allowing the user to assimilate the information from the focused display, this information is also distracting since this focused image partially covers the wearer's operational field of view, that part of the wearer's normal field of view is obscured.
SUMMARY
In one embodiment, a head-mounted display displays information to a user without distraction. At least one light display element is positioned within a peripheral vision area of at least one eye of the user such that the information is imparted to the user without the need of repositioning or refocusing the eye. A receiver receives the information and a microcontroller, coupled with the receiver and the at least one light display element, processes the information to determine an illumination pattern based upon the information and controls the at least one light display element to display the illumination pattern.
In another embodiment, a method displays information to a user without distraction. The information is received within a microcontroller of a peripheral vision display system. An illumination pattern for at least one light display element is determined, based upon the information, within the microcontroller and the at least one light display element is controlled to display the illumination pattern. The at least one light display element is positioned within an area of peripheral vision of at least one eye of the user such that the information may be imparted to the user without the need to reposition or refocus the eye.
In another embodiment, a headset displays information within a peripheral vision area of a user. The headset includes a receiver for receiving a signal from a signaling device, at least one light display element positioned within a peripheral vision area of at least one eye of the user such that the information is imparted to the user without the need of repositioning or refocusing the eye, and a microcontroller coupled with the receiver and the light display element for determining an illumination pattern based upon the signal and for controlling the light display elements to display the illumination pattern.
In another embodiment, a system displays audio information within a peripheral vision area of a user. The system includes at least one microphone for detecting sound, at least one light display element positioned within a peripheral vision area of at least one eye of the user such that the information is imparted to the user without the need of repositioning or refocusing the eye, and a microcontroller coupled with the at least one microphone and the at least one light display element. The system includes machine readable instructions that, when executed by the microcontroller, perform the steps of: processing the detected sound to generate the audio information, generating an illumination pattern based upon the detected sound, and controlling the at least one light display element to display the illumination pattern.
In another embodiment, headwear displays information within a peripheral vision area of a user. A receiver is integrated with the headwear and receives the information. At least one light display element is integrated with the headwear and positioned within a peripheral vision area of at least one eye of the user. A microcontroller is integrated with the headwear and coupled with the receiver and the light display element. The microcontroller determines an illumination pattern based upon the signal and controls the light display elements to display the illumination pattern. The information is imparted to the user without the need of repositioning or refocusing the eye.
BRIEF DESCRIPTION OF THE FIGURES
<figref idref="DRAWINGS">FIG. 1</figref> shows a schematic view of one exemplary head-mounted system for displaying performance information, in an embodiment.
<figref idref="DRAWINGS">FIG. 2</figref> is a perspective view of one exemplary embodiment of the system of <figref idref="DRAWINGS">FIG. 1</figref>, showing a boom for positioning a peripheral vision device within a peripheral vision area of the user's eye.
<figref idref="DRAWINGS">FIG. 3</figref> shows part of the peripheral vision device of <figref idref="DRAWINGS">FIG. 1</figref> in further detail.
<figref idref="DRAWINGS">FIG. 4</figref> shows exemplary use of the peripheral vision device of <figref idref="DRAWINGS">FIG. 3</figref> formed with seven light display elements, in an embodiment.
<figref idref="DRAWINGS">FIG. 5</figref> shows exemplary use of a peripheral vision device formed with two linear rows each of seven light display elements, in an embodiment.
<figref idref="DRAWINGS">FIG. 6</figref> shows the system of <figref idref="DRAWINGS">FIG. 2</figref> attached to one arm of a pair of sunglasses, in an embodiment.
<figref idref="DRAWINGS">FIG. 7</figref> schematically shows one exemplary head-mounted peripheral vision display system for displaying performance information generated by a remote intermediary processor, in an embodiment.
<figref idref="DRAWINGS">FIG. 8</figref> schematically shows one exemplary head mounted system for displaying signal information within a peripheral vision area of a user, in an embodiment.
<figref idref="DRAWINGS">FIG. 9</figref> is an exemplary perspective view showing the system of <figref idref="DRAWINGS">FIG. 8</figref> configured as a frame of a pair of glasses, in an embodiment.
<figref idref="DRAWINGS">FIG. 10</figref> is a schematic diagram illustrating one embodiment of the systems of <figref idref="DRAWINGS">FIGS. 1, 7 and 12</figref>, configured as a headset body that has an ear clip, an ear piece, and a microphone.
<figref idref="DRAWINGS">FIG. 11</figref> is a schematic diagram illustrating one embodiment of the systems of <figref idref="DRAWINGS">FIGS. 1, 7 and 12</figref>, configured as a headset body that has a clip, an ear piece, and a microphone.
<figref idref="DRAWINGS">FIG. 12</figref> shows one exemplary head-mounted cellular phone that includes a microcontroller, a peripheral vision device, and a cellular transceiver, in an embodiment.
<figref idref="DRAWINGS">FIG. 13</figref> shows one exemplary head mounted system for displaying sound indications within a peripheral vision area of a user of system, in an embodiment.
<figref idref="DRAWINGS">FIG. 14</figref> is a perspective view showing the system of <figref idref="DRAWINGS">FIG. 13</figref> configured as a frame of a pair of glasses, in an embodiment.
<figref idref="DRAWINGS">FIGS. 15A-C</figref> show perspective views of exemplary embodiments of the systems of <figref idref="DRAWINGS">FIGS. 1, 7, 8 and 12</figref> configured as a clip-on addition to an ear piece of a user's existing glasses and sunglasses.
<figref idref="DRAWINGS">FIGS. 16A</figref> and B show one exemplary head-mounted peripheral vision display system configured as a baseball cap, in an embodiment.
<figref idref="DRAWINGS">FIG. 17</figref> is a flowchart illustrating one exemplary method for displaying information to a user without distraction, in an embodiment.
<figref idref="DRAWINGS">FIG. 18</figref> is a flowchart illustrating one exemplary method for determining an illumination pattern for one metric, in an embodiment.
<figref idref="DRAWINGS">FIG. 19</figref> is a flowchart illustrating one exemplary method for determining an illumination pattern for an activity metric where activity in a target zone is indicated by no illuminated elements of the peripheral display.
<figref idref="DRAWINGS">FIG. 20</figref> shows exemplary communication between two head-mounted performance display systems, and between a coach station <b>2002</b> and each of the two head-mounted performance display systems, in an embodiment.
DETAILED DESCRIPTION
<figref idref="DRAWINGS">FIG. 1</figref> schematically shows one exemplary head-mounted performance display system <b>100</b> for displaying performance information within a peripheral vision area of a user. System <b>100</b> includes a microcontroller <b>102</b>, a peripheral vision device <b>104</b>, and a wireless receiver/transceiver <b>106</b>. Microcontroller <b>102</b> may include memory (non-volatile and volatile), one or more analog to digital converters, one or more digital to analog converters, and other functionality, as typically found in microcontroller devices. Microcontroller <b>102</b> is shown with software <b>103</b>, for example stored within a memory of microcontroller <b>102</b>, which contains machine readable instructions that, when executed by microcontroller <b>102</b>, performs functionality of system <b>100</b> as describe below. Software <b>103</b> may be permanently stored within memory of microcontroller <b>102</b>, or may be read into registers or temporary memory, that is, software <b>103</b> may be field programmable. In embodiments where software <b>103</b> is field programmable, it may be loaded into the registers or temporary memory in situations such as start up of system <b>100</b>, to stream instant notifications, to provide updated content such as messages, comments, audible or display cues, or to change individual or group settings of software <b>103</b>.
Peripheral vision device <b>104</b> is controlled by microcontroller <b>102</b> and positioned within a peripheral vision area of a user of system <b>100</b> such that the user may absorb displayed information without repositioning and/or refocusing his or her vision. System <b>100</b> receives information from one or more sensors <b>170</b><i>a</i>-<i>c </i>(external to system <b>100</b>) via wireless receiver/transceiver <b>106</b>. When configured as a transceiver, wireless receiver/transceiver <b>106</b> provides bi-directional communication. In one embodiment, wireless receiver/transceiver <b>106</b> is part of an ANT communication system, as provided by Nordic Semiconductor. In another embodiment, wireless receiver/transceiver <b>106</b> supports Bluetooth communication.
System <b>100</b> has a user interface <b>150</b> for receiving input from the user. User interface <b>150</b> may include one or more of: an actuator <b>152</b>, motion sensors <b>154</b>, proximity sensors <b>156</b>, capacitive sensors <b>157</b> and microphones <b>158</b>. Actuator <b>152</b> represents an input device (e.g., one or more of a push button switch, a slider switch, and a slider potentiometer) that allows the user to interact with microcontroller <b>102</b>. In one embodiment, actuator <b>152</b> is used to activate and deactivate system <b>100</b>. Motion sensors <b>154</b> may include one or more accelerometers and/or gyroscopes for detecting movement of system <b>100</b>. Proximity sensor <b>156</b> detects proximity changes of system <b>100</b> relative to other objects (e.g., the user's hand). Capacitive sensor <b>157</b> detects changes in capacitance, such as touch of the user's finger and motion of that finger along a surface proximate to capacitive sensor <b>157</b>. Other types of sensor may be used in place of capacitive sensor <b>157</b> for detecting touch gestures of the user without departing from the scope hereof. User interface <b>150</b> allows system <b>100</b> to recognize user gestures, such as: button pushes (long and/or short duration); taps—single, double, or triple taps by the user on system <b>100</b>; and movements such as head tilts, and head nods and/or head shakes, and touch gestures such as finger motion along a surface of system <b>100</b>. Microcontroller <b>102</b> may interpret input from single and multiple sensors (e.g., button pushes, taps, and touches) from the user as sensed by user interface <b>150</b>. Other methods of receiving user input may be used without departing from the scope hereof. For example, system <b>100</b> may include a sensor for tracking eye movement and/or detecting blinking of an eye, thereby allowing the user to create inputs through blinking and eye movements.
System <b>100</b> may also include one or more internal sensors <b>110</b> that couple with microcontroller <b>102</b> to sense user performance. Internal sensors <b>110</b> may include one or more of an accelerometer, a gyroscope, a pressure sensor, a power sensor, a temperature sensor, a light sensor, and a proximity sensor. Optionally, sensors of user interface <b>150</b> (e.g., sensors <b>154</b>, <b>156</b>) and sensors <b>110</b> may provide both user input information and performance information. For example, information received from an accelerometer within sensors <b>110</b> may also be interpreted by microcontroller <b>102</b> as user input information.
In one embodiment, system <b>100</b> also includes an audio output device <b>120</b> coupled with microcontroller <b>102</b> for generating audio information (e.g., tones and voice information readout) to a user of system <b>100</b>. Optionally, system <b>100</b> has an external audio output device <b>120</b>′ in addition to, or to replace, audio output device <b>120</b>. System <b>100</b> may also optionally include a vibration device <b>122</b> that, when activated by microcontroller <b>102</b>, provides tactile feedback to the user of system <b>100</b>. In one embodiment, audio output device <b>120</b> and vibration device <b>122</b> are combined into a single component of system <b>100</b>.
In one embodiment, system <b>100</b> also includes an interface <b>130</b> coupled with microcontroller <b>102</b> that enables communication between system <b>100</b> and an external device such as a personal computer (PC) <b>172</b>. In this document, “PC” may refer to any one or more of a desktop computer, a laptop or netbook computer, a tablet computer, a smart phone, a personal digital assistant (PDA), a navigation system (e.g., a GPS enabled route mapping system) and/or other similar electronic devices having capability for communicating (wired and/or wirelessly) with system <b>100</b>. In one example of operation, a PC <b>172</b> connects to interface <b>130</b> and is used to set configuration <b>160</b> of system <b>100</b> via a USB interface of interface <b>130</b>. Configuration <b>160</b> may for example define performance zones and thresholds of one or more metrics displayed by system <b>100</b>, load celebrity voices, custom display patterns, other audio and visual cues and/or combinations thereof, for output by system <b>100</b>. Interface <b>130</b> may also be combined with wireless receiver/transceiver <b>106</b> such that system <b>100</b> may communicate with the PC wirelessly. For example, in a field programmable embodiment of system <b>100</b>, interface <b>130</b> enables the PC to provide software <b>103</b> upon startup of system <b>100</b>, to provide updates to software <b>103</b>, or to provide updated content such as notifications, messages, comments, or audible or display cues. In another embodiment, interface <b>130</b> represents a transceiver for wirelessly communicating with the PC.
In one embodiment, system <b>100</b> includes a removable storage device <b>132</b> (e.g., a microSD card) that is coupled to microcontroller <b>102</b> such that sensed data and/or configuration <b>160</b> of system <b>100</b> may be stored thereon. Removable storage device <b>132</b> is for example mounted within a socket such that it may be removed and access in other computer systems (e.g., a PC). In one example, information recorded from sensors <b>110</b>, <b>154</b>, <b>156</b>, <b>170</b><i>a</i>-<i>c </i>and/or microphone <b>158</b> may be further processed and/or viewed on the other computer. In another example, configuration <b>160</b> if system <b>100</b> is prepared within the other computer and stored onto storage device <b>132</b> and then installed within system <b>100</b>, wherein storage device <b>132</b> provides configuration <b>160</b> that defines zones and other parameters of metrics and displayed data of system <b>100</b>.
Microcontroller <b>102</b> may receive sensed information from one or more external sensors <b>170</b><i>a</i>-<i>c </i>via wireless receiver/transceiver <b>106</b>. <figref idref="DRAWINGS">FIG. 1</figref> illustratively shows three external sensors <b>170</b><i>a</i>-<i>c </i>wirelessly coupled with system <b>100</b>. However, more or fewer external sensors <b>170</b><i>a</i>-<i>c </i>may be used without departing from the scope hereof. For example, no external sensors <b>170</b><i>a</i>-<i>c </i>may be used when internal sensors <b>110</b> provide sufficient information for display of performance data. External sensors <b>170</b><i>a</i>-<i>c </i>may represent one or more of: a heart rate monitor; a running speed/distance/cadence sensor; a bike speed/distance/cadence/power sensor; a bike computer; an exercise equipment computer (e.g. treadmill); a (Digital) pressure sensor (for height information); a GNSS receiver (e.g., GPS); a temperature sensor; a light sensor; and a proximity sensor.
System <b>100</b> provides the user with performance feedback and/or audible information such as, for example: current, average, max or min speed/pace; current, average, max or min heart rate; distance traveled; total energy expended; % through workout; duration; clock time; workout zone transition (or zone number cue); workout zone information (such as “hill climb,” “steps,” “hot terrain,” “windy” and the like); heart rate zone; timer; lap time; current, average, min or max power; and current, average, min or max cadence. System <b>100</b> may, in embodiments, store performance information of a user and determine and feed back to the user when personal milestones are reached or a personal best performance is achieved.
In one example of operation, microcontroller <b>102</b> receives sensor data from sensors <b>170</b><i>a</i>-<i>c </i>(if included) via wireless receiver/transceiver <b>106</b>, from sensors <b>110</b> (if included), and from sensors <b>154</b> and <b>156</b> (if included) of user interface <b>150</b>. Software <b>103</b> is executed within microcontroller <b>102</b> to process this sensor data and to control peripheral vision device <b>104</b> to display performance data to the user. Where included, audio output device <b>120</b> is controlled by microcontroller <b>102</b> (e.g., by executing software <b>103</b> to control a digital to analog converter) to provide audible information and feedback to the user.
<figref idref="DRAWINGS">FIG. 2</figref> is a perspective view of one exemplary embodiment of system <b>100</b>, <figref idref="DRAWINGS">FIG. 1</figref>, configured with a boom <b>202</b> for positioning peripheral vision device <b>104</b> within a peripheral vision area of the user's eye and a housing <b>204</b> that contains electronics <b>101</b> (e.g., microcontroller <b>102</b>, wireless receiver/transceiver <b>106</b>, internal sensors <b>110</b>, audio output device <b>120</b>, user interface <b>150</b>, and interface <b>130</b>, if included). <figref idref="DRAWINGS">FIG. 3</figref> shows peripheral vision device <b>104</b> of <figref idref="DRAWINGS">FIG. 2</figref> in further detail. <figref idref="DRAWINGS">FIGS. 2 and 3</figref> are best viewed together with the following description.
Boom <b>202</b> is a thin flexible substrate attached to, or integral with, housing <b>204</b>, such that peripheral vision device <b>104</b> may be positioned within a peripheral vision area of the user (as indicated by viewing direction <b>208</b>). The substrate may be encased within a housing material for environmental protection or stiffening purposes. Boom <b>202</b> may include a position memory material (e.g., a wire, engineering polymer, shape memory alloy, or other material that maintains its shape after bending) such that once positioned by the user, boom <b>202</b> remains substantially in that position during activity by the user, unless moved again by the user. The memory material may also provide torsion memory to boom <b>202</b>, and may be selectively utilized to provide shape memory in one or more directions (e.g., one-, two- or three-dimensional shape memory). In another embodiment, boom <b>202</b> is substantially rigid and shaped to fit a particular application and/or supporting apparatus (e.g., a user's eyewear).
In one embodiment, housing <b>204</b> is integral with the supporting headgear or eyewear (see <figref idref="DRAWINGS">FIGS. 9 and 14</figref> for example). System <b>100</b> is also shown with an attachment mechanism <b>206</b>, coupled with housing <b>204</b>, for attaching system <b>100</b> to a supporting frame, such as a user's eyewear or headwear. In one embodiment, attachment mechanism <b>206</b> of system <b>100</b> is shaped and configured to mount to a user's ear. In another embodiment, attachment mechanism <b>206</b> is shaped and configured to mount to a user's nose. In yet another embodiment, attachment mechanism <b>206</b> is shaped and configured to mount to a user's head. System <b>100</b> may be configured to attach to objects worn by the user, and may be configured to attach directly to the user. Boom <b>202</b> has seven light display elements <b>304</b> (<b>1</b>)-(<b>7</b>) formed into a linear array or matrix array at a distal end <b>302</b> thereof. Light emitted by light display elements <b>304</b> is directed towards the user's eye (or eyes) to maximize visibility and reduce required intensity (and thereby reduce power consumption). Light display element <b>304</b> may represent a light emitting diode (LED) or other light sources. Although seven light display elements <b>304</b> are shown within peripheral vision device <b>104</b>, more or fewer light display elements <b>304</b> may be included without departing from the scope hereof.
When attached to existing eyewear, boom <b>202</b> may be configured such that peripheral vision device <b>104</b> is positioned outside the lens, within the lens, inside the frames of the eyewear, outside the frames, and at any peripheral position around the eye. In one embodiment, boom <b>202</b> contains optical fibers, and light display elements <b>304</b> are located within housing <b>204</b> and coupled to the optical fibers such that light is emitted from the distal end <b>302</b> of boom <b>202</b>, for example in a linear array similar to <figref idref="DRAWINGS">FIG. 3</figref> or in a two dimensional matrix array. Light display elements <b>304</b> may be mounted flush with, or just behind a window in, a surface <b>306</b> of boom <b>202</b>.
Boom <b>202</b> and housing <b>204</b> may attach to existing eyewear for example using adhesive to couple housing <b>204</b> to an arm of the eyewear, or attach using adhesive along boom <b>202</b>. Boom <b>202</b> and/or housing <b>204</b> may include one or more suction cups for attaching system <b>100</b> to existing eyewear and headwear. In one embodiment, boom <b>202</b> and/or housing <b>204</b> has an attachment feature fabricated from, or overmolded or sprayed with, a “grippy” (that is, slightly sticky or tacky) material that increases the coefficient of friction between boom <b>202</b> and a user's glasses for example to prevent undesired movement of boom <b>202</b> relative to the glasses. In another embodiment, boom <b>202</b> and housing <b>204</b> include an ear clip for attaching system <b>100</b> to a user's ear such that peripheral vision device <b>104</b> may be positioned in a peripheral vision areas of the user's eye without any need for eyewear or headwear.
A plurality of capacitive sensors <b>157</b> are illustratively shown configured with boom <b>202</b> such that motion of a user's finger along path <b>212</b> is detected and interpreted by microcontroller <b>102</b>. More or fewer capacitive sensors <b>157</b> may be integrated with one or both of boom <b>202</b> and housing <b>204</b> without departing from the scope hereof.
In one embodiment, light display elements <b>304</b> mount to, or are integral with, a user's eyewear, such as sunglasses, ski or snowboard goggles, swim goggles, and eyeglasses. In another embodiment, light display elements <b>304</b> mount to, or are integral with, a user's headgear, such as a bicycle helmet, a motorbike helmet, a visor, a hat, a cap, a hearing aid, and a headband.
In one embodiment, system <b>100</b> has two booms (each similar to boom <b>202</b>) such that light display elements <b>304</b> of peripheral vision device <b>104</b> may be positioned in peripheral vision areas both above and below the user's eye. In yet another embodiment, light display elements <b>304</b> are formed into a partial or full circle such that light display elements are radially positioned around the user's eye. This may be especially convenient where the light display elements are integrated with the frame of one or both eyewear lenses (see <figref idref="DRAWINGS">FIGS. 9 and 14</figref>), which naturally surrounds the eye. In another embodiment, light display elements <b>304</b> are integrated with eyewear such that they have a vertical orientation either side of the user's eye when the eyewear is worn by the user.
In another embodiment, light display elements <b>304</b> are mounted in close proximity and visible to both eyes of the user. This may be accomplished with a single piece of display substrate (e.g., clear engineering plastic in the form of a lens), either integrated with (e.g., etched into glass), or externally attached to, the user's existing eyewear or headgear. Alternatively, if appropriate, two separate substrates may be used. In one embodiment, light display elements <b>304</b> project light onto at least part of the substrate to make it become visible to the user, for example utilizing polarized light from the one or more light display elements <b>304</b>.
In <figref idref="DRAWINGS">FIG. 3</figref>, light display elements <b>304</b> are formed into a linear array. However, the light display elements <b>304</b> may also be formed into two dimensional arrays. For example, light display elements <b>304</b> may be formed as two or more rows, wherein each row displays information of a different activity metric. See <figref idref="DRAWINGS">FIG. 5</figref> for example. Alternatively, the information of a single activity metric may be displayed using the two or more rows. Light display elements <b>304</b> may also be configured to provide a 3D (three dimensional) display of information. For example, peripheral vision device <b>104</b> may project light that is received differently by each of the user's eyes to form a 3D image (e.g., an image with perceived depth to the user). In one embodiment, light display elements <b>304</b> are structured as a 3D array having various heights in regions around the peripheral vision area of the user (e.g., on boom <b>202</b>).
Light display elements <b>304</b> may each emit light at a fixed wavelength (e.g., a fixed color). For example, color of light emitted by each light display element <b>304</b> may be selected based upon position of the light display element within the one or two dimensional array. Alternatively, light display elements <b>304</b> may each emit a different color under control of microcontroller <b>102</b>.
<figref idref="DRAWINGS">FIG. 2</figref> shows exemplary positioning of light sensors <b>110</b>(<b>1</b>) for detecting ambient light conditions experienced by the user, such that microcontroller <b>102</b> may control intensity of light display elements <b>304</b> automatically based upon determined ambient light conditions. Light sensors <b>110</b>(<b>1</b>) represent at least part of sensors <b>110</b> of <figref idref="DRAWINGS">FIG. 1</figref>. Light sensors <b>110</b>(<b>1</b>) are shown in exemplary positions at a tip of boom <b>202</b> and at a base of boom <b>202</b> of <figref idref="DRAWINGS">FIG. 2</figref>. System <b>100</b> may include zero, one or more light sensors <b>110</b>(<b>1</b>) at the same or other positions without departing from the scope hereof.
In one embodiment, microcontroller <b>102</b> interprets the user pressing actuator <b>152</b> as an instruction to reduce intensity of light display elements <b>304</b>. In an embodiment, light display elements <b>304</b> do not include lenses, or other optical components; however, one or more lenses may be included to enhance the viewing angle of each light display element. Where light display elements <b>304</b> are included in existing eyewear, optical components may be included to correct the effects of lenses within the existing eyewear.
In one embodiment, light display elements <b>304</b> are each monocolor LEDs arranged in a linear fashion and embedded within boom <b>202</b>. In another embodiment, light display elements <b>304</b> are each bicolor or tricolor LEDs arranged in a linear fashion and embedded within a soft resin of boom <b>202</b>. <figref idref="DRAWINGS">FIGS. 2 and 3</figref> may also represent embodiments of systems <b>700</b>, <b>800</b> and <b>1200</b>, described herein.
<figref idref="DRAWINGS">FIG. 4</figref> shows exemplary use of peripheral vision device <b>104</b> formed with seven light display elements <b>304</b>(<b>1</b>)-(<b>7</b>) of <figref idref="DRAWINGS">FIG. 3</figref> as configured within system <b>100</b> of <figref idref="DRAWINGS">FIG. 1</figref> to display performance of one or more activities by the user. Microcontroller <b>102</b> may utilize one or more of modulation of display element position, intensity, color, flashing rate, flashing duty cycle, fading, multiple element combinations and patterns to generate an illumination pattern <b>408</b> for light display elements <b>304</b> based upon determined performance information. In one example of operation, system <b>100</b> displays each measured metric of a particular activity within a pre-defined performance range. For example, for that particular activity, a heart rate metric may range between 80 beats per minute and 190 beats per minute, wherein an optimal (goal) rate may be 160 beats per minute. In another example, the user may define a target pace of a seven minute mile while running, with a minimum pace of a 9 minute mile and a maximum pace of a 4 minute mile. System <b>100</b> may provide feedback to the user for both heart rate and pace. When system <b>100</b> provides such goal oriented guidance, once the goal is established, the feedback from system <b>100</b> allows the user to be aware of progress towards the goal without requiring the user to lose focus by concentrating on specific metrics or values.
Using user interface <b>150</b>, the user may select a particular metric for display, wherein microcontroller <b>102</b> subdivides minima and maxima of the metric into one or more sequential zones <b>402</b>, illustrated as arrows within <figref idref="DRAWINGS">FIG. 4</figref>. For example, where the metric is speed, the desired range is between a minimum and a maximum speed; for a heart rate metric, the desired range is between low and high heart rate thresholds. One or more light display elements <b>304</b> are assigned to each zone <b>402</b>, as shown. Specifically, light display element <b>304</b>(<b>1</b>) is assigned to zone <b>402</b>(<b>1</b>), light display element <b>304</b>(<b>2</b>) is assigned to zone <b>402</b>(<b>2</b>), light display element <b>304</b>(<b>3</b>) is assigned to zone <b>402</b>(<b>3</b>), light display element <b>304</b>(<b>4</b>) is assigned to zone <b>402</b>(<b>4</b>), light display element <b>304</b>(<b>5</b>) is assigned to zone <b>402</b>(<b>5</b>), light display element <b>304</b>(<b>6</b>) is assigned to zone <b>402</b>(<b>6</b>), and light display element <b>304</b>(<b>7</b>) is assigned to zone <b>402</b>(<b>7</b>). When the user's determined activity level falls within one of these zones, microcontroller <b>102</b> generates illumination pattern <b>408</b> such that corresponding display element(s) is differentiated from the remaining display elements by modulating one or more visual characteristics, such as intensity, duty cycle, flashing rate, and color.
In the example of <figref idref="DRAWINGS">FIG. 4</figref>, all light display elements <b>304</b> are utilized for displaying one activity metric <b>406</b>. However, light display elements <b>304</b> may be divided into smaller virtual arrays for displaying more than one activity metric simultaneously. For example, light display elements <b>304</b>(<b>1</b>)-(<b>3</b>) may display a first activity metric, light display element <b>304</b>(<b>4</b>) may display a second activity metric, and light display elements <b>304</b>(<b>5</b>)-(<b>7</b>) may display a third activity metric. In another embodiment, peripheral vision device <b>104</b> automatically cycles between displayed metrics. In another embodiment, peripheral vision device <b>104</b> displays the metric indicating greatest variance from a preconfigured goal for that metric.
<figref idref="DRAWINGS">FIG. 5</figref> shows exemplary use of a peripheral vision device <b>104</b>′ having two linear rows of seven light display elements <b>504</b> each. In this example, the top row of elements <b>504</b>(<b>1</b>)-(<b>7</b>) displays a first activity metric <b>506</b>(<b>1</b>) and the second row of elements <b>504</b>(<b>8</b>)-(<b>14</b>) displays a second activity metric <b>506</b>(<b>2</b>). The first activity metric <b>506</b>(<b>1</b>) is divided into seven zones <b>502</b>(<b>1</b>)-(<b>7</b>), and the second activity metric <b>506</b>(<b>2</b>) is divided into seven zones <b>502</b>(<b>8</b>)-(<b>14</b>). In this example of peripheral vision device <b>104</b>′, light display element <b>504</b>(<b>5</b>) indicated that a user is performing within zone <b>502</b>(<b>5</b>) for first activity metric <b>506</b>(<b>1</b>) and light display element <b>504</b>(<b>10</b>) indicated that the user is performing in zone <b>502</b>(<b>10</b>) for second activity metric <b>506</b>(<b>2</b>). If, in this example, first activity metric <b>506</b>(<b>1</b>) displays heart rate performance, and second activity metric <b>506</b>(<b>2</b>) displays pace, and both zones <b>502</b>(<b>4</b>) and <b>502</b>(<b>11</b>) represent target zones for each activity, respectively, microcontroller <b>102</b> generates an illumination pattern <b>508</b> for display on peripheral vision device <b>104</b>′ such that the user may simultaneously see that his or her heart rate is higher, and his or her pace is lower, than their respective target zones. Peripheral vision device <b>104</b>′ may concurrently display more than two metrics. For example, the linear array formed of display elements <b>504</b>(<b>1</b>)-(<b>7</b>) may be sub-divided to show two different metrics. Alternatively, different colors may be used within the linear array formed of display elements <b>504</b>(<b>1</b>)-(<b>7</b>), where each color displays a different metric.
<figref idref="DRAWINGS">FIG. 6</figref> shows system <b>100</b> attached to one arm <b>604</b> of a pair of sunglasses <b>602</b> using attachment mechanism <b>206</b> (e.g., a clip) such that boom <b>202</b> positions peripheral vision device <b>104</b> within a peripheral field of vision of a user wearing sunglasses <b>602</b>. Although shown positioned outside of the lens of sunglasses <b>602</b>, the flexibility and position memory of boom <b>202</b> allows it to be positioned within the lens of sunglasses <b>602</b>, as preferred by the user. For example, where boom <b>202</b> has an outer gripper material, as described above, boom <b>202</b> may be attached to the lower inside surface of the lens. <figref idref="DRAWINGS">FIG. 6</figref> may also illustrate physical embodiments of systems <b>700</b>, <b>800</b> and <b>1200</b>.
In an embodiment, system <b>100</b> determines the user's performance periodically, and, as the determined performance changes from one zone to another, microcontroller <b>102</b> generates illumination patterns (e.g., illumination pattern <b>408</b>, <b>508</b>) and controls light display elements <b>304</b> to provide feedback to the user. The user may use this feedback to guide his activity towards a desired (preferred or optimal) activity level. Where sensors <b>170</b><i>a</i>-<i>c </i>of system <b>100</b> monitor activity of other devices (e.g., vehicles, equipments, and so on.), the feedback may guide the user's operation of those devices.
To prevent fatigue of the user's eyes, system <b>100</b> may dim or extinguish display elements of peripheral vision device <b>104</b> (and optionally other components of system <b>100</b>). For example, system <b>100</b> may display metrics when that metric changes, and later may dim the corresponding display elements to prevent the user's eyes from becoming fatigued. Optional audio output device <b>120</b> and optional vibration device <b>122</b>, if included, may continue to provide performance feedback when display elements of peripheral vision device <b>104</b> are dimmed or extinguished, or devices <b>120</b> and <b>122</b> may be silenced and/or stilled also.
In one embodiment, the range of the currently specified activity metric may be applied across multiple pages of display elements. A single page of information is mapped with some or all display elements and presented at any given time, with pages incrementing or decrementing automatically as the user activity crosses the page thresholds. Alternatively, input from the user (e.g., a nod of the head or a tap on the frame of system <b>100</b> detected by accelerometers within system <b>100</b>) may transition from one page to another. In one example of operation, system <b>100</b> may be configured to turn off the display (or fade the display) when the user is operating within defined target zones, and to activate the display when the user varies from those target zones. See flowchart <b>1900</b> of <figref idref="DRAWINGS">FIG. 19</figref> for example. In another example of operation, where a metric display indicates that the user is within a target zone and the user is not within a target zone of a different metric, system <b>100</b> may automatically change to display the different metric. Optionally, system <b>100</b> may also provide audible and/or vibration feedback when changing the displayed metric.
In one example of operation, system <b>100</b> periodically monitors performance of a user and provides feedback using peripheral vision device <b>104</b>. A central light display element <b>304</b>(<b>4</b>) indicates that the user has reached a target performance level based upon information received from sensors <b>110</b> and/or sensors <b>170</b><i>a</i>-<i>c</i>. If the user's performance level changes, microcontroller <b>102</b> may alter the displayed illumination pattern to indicate the changes in performance to the user. For example, if the user's performance level drops, light display element <b>304</b>(<b>3</b>) may illuminate, and light display element <b>304</b>(<b>4</b>) may extinguish. When the user's performance drops further, the light display element <b>304</b>(<b>3</b>) is extinguished and light display element <b>304</b>(<b>2</b>) illuminates. On the other hand, if the uses performance level exceeds the target performance level, light display element <b>304</b>(<b>5</b>) eliminates and light display element <b>304</b>(<b>4</b>) is extinguished. In another example of operation, a single light display element <b>304</b> indicates a target zone is achieved by the user for at least one metric, and additionally illuminated light display elements <b>304</b> indicate variance from that target zone, the greater the number of illuminated light display elements <b>304</b>, the greater the user's variance from the target zone. In yet another example of operation, variance from a metric target zone is indicated by the number of illuminated light display elements <b>304</b>, where the greater the user's variance from the target zone, the greater the number of elements illuminated. In another operational example, one or more light display elements <b>304</b> are illuminated when the user reaches a target zone, and are extinguished or dimmed when the user varies from that target zone.
The span of the activity metric range, as well as the number of zones, and width of each zone within this range, may be specified or adjusted by the user prior to, or during activity. Optionally, the user may select the light display elements <b>304</b> and preferred visual modulation characteristics for one or more zones <b>402</b>.
Fixed vs. Dynamic Zones
In one embodiment, the span and zone characteristics of each available activity metric are fixed (e.g., within configuration <b>160</b>) for the duration of the activity session in accordance with predefined settings. In another embodiment, the span and zone characteristics may vary in accordance with a preselected activity profile. For example, the activity profile may be preconfigured (e.g., within configuration <b>160</b>) by the user using one of a smart phone, a PC, and a tablet computer. In one example of operation, the user defines the activity profile to include an initial warm-up phase at a lower activity level, followed by a higher intensity phase such as during interval training, and finally a lower intensity cool-down phase. The user may select from an available selection of predefined activity profiles, or may define new profiles. For example, the user may define the duration of each activity profile. In one embodiment, zones are automatically adjusted by system <b>100</b> when one or more milestones are reached by the user. In another embodiment, zones may be adjusted by a device external to system <b>100</b>, such as a remote control, PC, smart phone, and tablet PC. For example, a coach may use a remote control device to change a user's zones during a training session. In another embodiment, zones may be automatically changed based upon a wellness environment, where metrics such as a calorie threshold are reached. In yet another embodiment, zones are defined during an activity by the user indicating (e.g., tapping system <b>100</b>) via user interface <b>150</b> that a current intensity of an activity is within a target zone. Similarly, the user may define a lowest range of a zone and a highest range of a zone by indicating using user interface <b>150</b>.
Activity Metric Display & Selection
In one exemplary configuration, system <b>100</b> is connected to a plurality of sensors <b>110</b>, <b>170</b><i>a</i>-<i>c</i>, and displays one activity metric at a time. That is, system <b>100</b> allocates light display elements <b>304</b> to display the single activity metric, as opposed to displaying multiple activity metrics simultaneously.
User interface <b>150</b> allows the user to cycle through the available activity metrics to select one or more activity metrics for display. In one embodiment, sensors <b>110</b> include an accelerometer utilized by system <b>100</b> to determine activity metrics that also may be used to sense taps on system <b>100</b> by the user. In another embodiment, user interface <b>150</b> includes a microphone <b>158</b> that receives voice commands from the user, wherein microcontroller <b>102</b> includes voice recognition capability to interpret the commands to control system <b>100</b>. In another embodiment, a remote control device is operated by the user to change metrics displayed by system <b>100</b>. For example, the user may have a remote control device attached to a handlebar of a vehicle being ridden that allows the metric displayed on system <b>100</b> to be changed without removing his or her hands from the handlebars. In another example, a coach, teammate, or official has the remote control to select the metric displayed by system <b>100</b> to the user. In one embodiment, the remote control is an application (app) running on a smart phone, tablet, or other similar device. The application has the ability to receive metrics (e.g., metrics from a machine being used by the user of system <b>100</b>, environmental metrics, or other metrics not processed by system <b>100</b>), perform complex algorithms, and act like a coach to change target zone settings or other performance metrics of system <b>100</b> on the fly. The application may be configured to focus on goal oriented performance and may be for example written by (and/or audio cues may be provided using the voice of) a coach or fitness celebrity.
In response to user input, system <b>100</b> may provide visual or audio prompts to the user. For example, peripheral vision device <b>104</b> may display a specific sequence indicating selection of a desired activity metric for display. Alternatively, each activity metric may have a unique visual characteristic, such as color, to identify the activity metric being displayed.
In one embodiment, light display elements <b>304</b> are divided between two or more activity metrics such that these metrics are displayed simultaneously. This allocation of light display elements <b>304</b> to one or more activity metrics may be pre-defined and may be defined by the user before or during activity. Thus, the user may receive feedback for multiple activity metrics simultaneously without additional interaction.
In an alternative mode of operation, light display elements <b>304</b> may be simultaneously shared among one or more activity metrics by utilizing unique visual characteristics for each activity metric. For example, the determined heart rate of the user may be displayed in the form of a slow-flashing red light display element in a position relative to a heart rate target zone. At the same time, the speed of the user may be displayed as a fast-flashing green light display element within the peripheral vision device at a position relative to a target speed zone. In one embodiment, a single light display element <b>304</b> capable of outputting light at any one of a plurality of colors is used to provide multiple metrics, where a particular color indicates a particular metric and where an intensity and/or modulation frequency of light output at that color indicates a value for the metric. In another embodiment, multiple light display elements <b>304</b> each capable of outputting light at any one of a plurality of colors allows transition effects to be implemented by system <b>100</b> to indicate a change in displayed metric. Exemplary transition effects include a wave effect from one side of peripheral vision device <b>104</b> to the other, a curtain effect where transition from one metric to the next starts in the middle of peripheral vision device <b>104</b> and progresses towards each side, and a reverse curtain effect where transition from one metric to the next starts at both sides of peripheral vision device <b>104</b> and progresses towards the middle.
In one embodiment, light display elements <b>304</b> are implemented as seven tricolor LEDs that are each assigned to predefined training zones obtained by subdividing a user-defined minimum-maximum span for each activity metric. As the determined performance of the user transitions into each zone, the corresponding LED will flash for several seconds before fading away to reduce annoyance to the user. The user will most often attempt to center his activity in the ‘central’ training zone, which is the 3rd LED from either side. The user can cycle between available activity metrics by tapping system <b>100</b> (or using other input method of user interface <b>150</b>) to change modes. In addition, system <b>100</b> allows the user to specify custom activity profiles for each activity metric such that the zone mapping is modified dynamically during the training session. The objective for the user is to maintain his performance within the centrally displayed zone through the duration of the training session, which will require that he adjusts his effort to match the current zone profile.
Audio Output
If audio output device <b>120</b> is included within system <b>100</b>, audible voice or sound cues may also be provided to the user based upon determined activity performance metrics, and to provide operational feedback prompts to the user. For example, system <b>100</b> may be configured to provide, via audio output device <b>120</b>, motivational support based upon detected activity performance of the user. Optionally, audio output device <b>120</b> may be configured to play custom audio clips from music tracks and provide other tones to indicate measured performance. In one embodiment, one or more audio clips and music files may be stored within storage device <b>132</b> and retrieved by microcontroller <b>102</b> and played using audio output device <b>120</b>. In another embodiment, audio data is downloaded via one or both of wireless receiver/transceiver <b>106</b> and interface <b>130</b>. Audio output device <b>120</b> may include a voice synthesis module <b>121</b> for generating voice output. In one example of operation, the user of system <b>100</b> downloads and installs audio clips of a celebrity that provide prompts and cues for playback during a workout.
Activity performance audio feedback may include audible cues, or a verbal description of the user's speed, distance, workout time, or other current, average, and/or historical activity metric. This audio feedback may be provided on demand as a result of a user input, or may be provided at predefined activity points (e.g., when the user reaches an activity objective or crosses a threshold related to one or more activity metrics) or based upon one or more predetermined time intervals. In one example of operation, system <b>100</b> provides a verbal readout of a user's heart rate determined at predefined 5 minute or 1 mile intervals. In another example of operation, system <b>100</b> provides a verbal notification that a user's average speed for the current session has dropped below a predefined threshold; the user is thereby made aware that a performance adjustment is required to achieve a desired level. In another example of operation, system <b>100</b> provides a verbal notification to a user of remaining time and/or distance in the current session. In another example of operation, system <b>100</b> provides an audible indication using audio output device <b>120</b> when the user's performance transitions between zones (e.g., transitions from zone <b>402</b>(<b>4</b>) to zone <b>402</b>(<b>3</b>)). Feedback is not limited to the user's performance, but may also include vehicular performance metrics, safety metrics, gaming metrics, warnings, and other useful information.
System <b>100</b> may provide operational feedback prompts that include audible cues during mode transitions, on or off transitions, active sensor changes, configuration setting adjustment, and low battery status. Audio output device <b>120</b> may include (wired or wireless) one or more of speakers, ear inserts, and headphones, each of which may be mechanically integrated, attached, or detached from peripheral vision device <b>104</b>. In one embodiment, audio output device <b>120</b> includes a speaker that is positioned in close proximity to, and directed towards, the user's ear to maximize the available volume to the user. Audio output device <b>120</b> may provide audible cues to the user such as for downloading, charging, uploading, update available, connected, and disconnected.
System Configuration
Configuration <b>160</b> of system <b>100</b> may be defined using PC <b>172</b> (e.g., a MAC or Windows based personal computer, laptop, tablet PC, and smart phone) connected to interface <b>130</b> via communication path <b>174</b>. In one embodiment, interface <b>130</b> represents a Bluetooth interface that is incorporated within wireless receiver/transceiver <b>106</b>, and communication path <b>174</b> is wireless, thereby allowing system <b>100</b> to be configured wirelessly and without a physical connection. In another embodiment, interface <b>130</b> and wireless receiver/transceiver <b>106</b> are packaged together with microcontroller <b>102</b>. In yet another embodiment, interface <b>130</b> represents a wired connection with PC <b>172</b> and communication path <b>174</b> is a wired connection such as a USB cable. System <b>100</b> may use other wired and/or wireless communication devices and modules without departing from the scope hereof. For example, system <b>100</b> may utilize one or more of WiFi, ANT FS, Bluetooth, Bluetooth Low Energy (BTLE), Zigbee, EM, and other such protocols and interfaces.
In one embodiment, a user connects system <b>100</b> to PC <b>172</b> for configuration and customization. While connected to PC <b>172</b>, configuration <b>160</b> of system <b>100</b> may be defined for future use, performance metric data may be downloaded and saved to the device, and firmware (e.g., software <b>103</b> within microcontroller <b>102</b>) within system <b>100</b> may be updated. In one example, a graphical user interface (GUI) based application may run on the PC to support configuration and control of system <b>100</b>. In one embodiment, system <b>100</b> utilizes a GUI running on the external device for displaying data and interacting with the user.
A user may utilize the PC GUI application to select or design activity profiles (e.g., workout profiles). For example, the user may generate a time series graph of a desired activity metric profile as a function of time, and select the associated target zone thresholds for one or more activity metrics. The PC GUI application may process the graph to generate a configuration file that is uploaded to system <b>100</b>. In one embodiment, system <b>100</b> stores a plurality of predefined profiles (e.g., within configuration <b>160</b>) that may be selected by the user (e.g., by interacting with user interface <b>150</b>) without need of a PC.
The PC GUI application may also allow sharing, via the Internet for example, of generated workout profiles. For example, a coach could prepare a week's worth of workout profiles and send them to each team member. At the end of the week each team member may upload their recorded performance data to a server (e.g., via a web site) such that team members performance may be graphically compared (e.g., by the team coach). Optionally, generated workout profiles may be shared directly between multiple systems <b>100</b>, for example to allow collaborative workouts.
In one embodiment, the PC GUI application provides a map interface on which the user draws a desired route, or allows the user to select from historical routes, or to select from routes published by other users. In one embodiment, the PC GUI displays a map and allows the user to select a desired path, the coordinates of which form a route profile that the user wishes to follow during training. The PC GUI may then allow the user to specify desired performance metrics at various points along the route. During operation, in addition to providing performance feedback to the user as described above, system <b>100</b> may provide turn-by-turn guidance to the user indicates, either by using peripheral vision device <b>104</b> or by using an audible prompt. For example, system <b>100</b> may prompt the users that a turn in the predefined route is approaching. System <b>100</b> may also provide other information to the user, such as safety information including approaching hazards, and may also provide information such as approaching sustenance points, such as water, food, fuel, and so on. Alternatively, system <b>100</b> may provide directional information to allow the user to find these points, and/or avoid hazards.
In another embodiment, system <b>100</b> allows the user to record information during an activity. For example, on a cycle ride, a user instructs system <b>100</b> to record a hazard at the current location, whereupon system <b>100</b> determines (e.g., using a GPS sensor, time on journey, or other metrics) a current location of the user and transmits that information to the PC GUI application, where it is annotated to a map in the form of a symbol and/or transcribed text from the users recorded speech.
Automatic Mode Detection
System <b>100</b> may automatically detect a mode of use. Detected modes may include stopped, walking, running, and cycling. System <b>100</b> may utilize one or more of sensors <b>110</b> and <b>170</b><i>a</i>-<i>c </i>to determine the current mode. For example, microcontroller <b>102</b> may process a signal from an accelerometer to detect a walking gait within the signal, and may process a signal from a GNSS receiver to determine that the user is moving at a speed of 2 miles per hour. Based upon these two signals, system <b>100</b> may therefore determine that the user is walking. In another example, system <b>100</b> may determine that the user is cycling if a measured speed of the user is between 6 and 30 miles per hour and a cadence is within a cycling range. System <b>100</b> may utilize input from more than one sensor to determine a current activity of the user. If the determined mode transitions, system <b>100</b> may generate an audio prompt to request confirmation of the mode change (e.g., by tapping or other input to user interface <b>150</b>) by the user.
Other Features
In one embodiment, system <b>100</b> utilizes wireless receiver/transceiver <b>106</b> (or an additional wireless receiver) to receive voice communication data for playing through audio output device <b>120</b>. In another embodiment, system <b>100</b> includes a transceiver (e.g., in place of or together with wireless receiver/transceiver <b>106</b>) that receives voice communication data from other systems, and transmits voice communication data received via microphone <b>158</b> from the user to other systems, thereby providing two way wireless voice communication between users of system <b>100</b>. See for example <figref idref="DRAWINGS">FIG. 20</figref> and its associated description. In one example of operation of this embodiment, voice input is received via microphone <b>158</b> and transmitted via wireless receiver/transceiver <b>106</b> to an external device where it is interpreted and acted upon, such as to control gear selection in a vehicle and/or operation of lights. In one embodiment, voice commands received via microphone <b>158</b> are interpreted by microcontroller <b>102</b> as input to system <b>100</b>.
In another similar embodiment, wireless receiver/transceiver <b>106</b> of system <b>100</b> receives voice communications from a coach station <b>2002</b> such that a coach may communicate in real time with the user (e.g., to provide additional feedback and/or tips).
In another embodiment, system <b>100</b> includes a transmitter for broadcasting performance information (or raw sensor data) as a wireless signal <b>2004</b> to coach station <b>2002</b>. Coach station <b>2002</b> may represent a mobile device such as one or more of a smart phone, a laptop computer, and a tablet computer). Coach station <b>2002</b> may then display instantaneous graphing and provide near-field feedback to allow the coach to view performance data substantially in real-time.
<figref idref="DRAWINGS">FIG. 7</figref> shows one exemplary head-mounted system <b>700</b> for displaying performance information generated by a remote intermediary processor <b>770</b>. System <b>700</b> is similar to system <b>100</b>, <figref idref="DRAWINGS">FIG. 1</figref>, and includes a microcontroller <b>702</b>, a peripheral vision device <b>704</b>, and a wireless transceiver <b>706</b>. Microcontroller <b>702</b> may include memory (non-volatile and volatile), one or more analog to digital converters, and other functionality, as typically found in microcontroller devices. Microcontroller <b>702</b> is shown with software <b>703</b>, stored within a memory of microcontroller <b>702</b> for example, which contains machine readable instructions that when executed by microcontroller <b>702</b> perform functionality of system <b>700</b>. Peripheral vision device <b>704</b> is controlled by microcontroller <b>702</b> and positioned within a peripheral vision area of a user of system <b>700</b>.
System <b>700</b> receives performance information wirelessly from remote intermediary processor <b>770</b>, which is external to system <b>700</b>. Optionally, microcontroller <b>702</b> also determines performance information from one or more of sensors <b>710</b>, <b>754</b>, and <b>756</b>, if included. Intermediary processor <b>770</b> receives sensor data from external sensors <b>740</b> (either wirelessly as shown in <figref idref="DRAWINGS">FIG. 7</figref>, or wired) and determines performance of the user based upon that data. Intermediary processor <b>770</b> may also include one or more internal sensors <b>776</b> for sensing activity of a user and/or a device. Intermediary processor <b>770</b> then transmits the determined performance to microcontroller <b>702</b> via wireless transceiver <b>706</b> for display on peripheral vision device <b>704</b>.
System <b>700</b> has a user interface <b>750</b> for receiving input from the user that may include one or more of: an actuator <b>752</b>, a motion sensor <b>754</b>, a proximity sensor <b>756</b>, a capacitive sensor <b>757</b>, and a microphone <b>758</b>. Operation of user interface <b>750</b> is similar to operation of user interface <b>150</b> of system <b>100</b>, <figref idref="DRAWINGS">FIG. 1</figref>. Actuator <b>752</b> represents an input device (e.g., a push button switch) and/or a slider that allows the user to interact with microcontroller <b>702</b>. In one embodiment, actuator <b>752</b> is used to activate and deactivate system <b>700</b>. Motion sensors <b>754</b> may include one or more accelerometers and/or gyroscopes for detecting movement of system <b>700</b>. Proximity sensor <b>756</b> detects proximity changes of system <b>700</b> relative to other objects (e.g., the user's hand). Capacitive sensor <b>757</b> detects changes in capacitance, such as touch of the user's finger and motion of that finger along a surface proximate to capacitive sensor <b>757</b>. Microphone <b>758</b> may be used to receive voice commands from the user. User interface <b>750</b> allows system <b>700</b> to recognize user gestures, such as: button pushes (long and/or short duration); taps—single, double, and triple taps and finger presence/touch/motion by the user on system <b>700</b>; and user movements such as head tilts, and head nods and/or shakes. Microcontroller <b>702</b> may also interpret combinations of inputs (e.g., button pushes and taps) from the user as sensed by user interface <b>750</b>.
System <b>700</b> may also include one or more internal sensors <b>710</b> that couple with microcontroller <b>702</b> to sense performance of the user. The internal sensors <b>710</b> may include one or more of an accelerometer, a gyroscope, a pressure sensor, a GNSS receiver (e.g., GPS), a power sensor, a temperature sensor, a light sensor, and a proximity sensor. Optionally, sensors of user interface <b>750</b> and sensors <b>710</b> may provide both user input information and performance information. For example, information received from an accelerometer within sensors <b>710</b> may also be interpreted provide user input information.
System <b>700</b> may also include an audio output device <b>720</b> coupled with microcontroller <b>702</b> for generating audio information (e.g., tones and voice information readout) to a user of system <b>700</b>. System <b>700</b> may also include a vibration device <b>721</b> for providing tactile feedback to the user.
System <b>700</b> may also include a interface <b>730</b> coupled with microcontroller <b>702</b> that enables communication between system <b>700</b> and one or more of a PC, a smart phone, a tablet, and other intelligent devices having wireless capability. In one example of operation, a PC is used to configure performance zones and thresholds of system <b>700</b> via a USB interface of interface <b>730</b>. Interface <b>730</b> may represent any known communication means for communicating with an external device. In one embodiment, interface <b>730</b> may be incorporated within wireless transceiver <b>706</b>. In one example of operation, system <b>700</b> utilizes one or more of user interface <b>750</b> and sensor <b>710</b> to allow a user to configure system <b>700</b>.
External sensors <b>740</b> and intermediary processor <b>770</b> may represent, alone or on combination, one or more of: a smart phone, a heart rate monitor; a running speed/distance/cadence sensor; a vehicle engine management unit; a bike speed/distance/cadence/power sensor; a bike computer; an exercise equipment computer (e.g., treadmill); a (digital) pressure sensor (for height information); a GNSS receiver (e.g., GPS); a temperature sensor; a light sensor; a proximity sensor, and other such devices. Optionally, intermediary processor <b>770</b> may utilize an interface <b>772</b> for configuration of a desired performance. For example, interface <b>772</b> may attach to intermediary processor <b>770</b> or may be incorporated within intermediary processor <b>770</b>. Interface <b>772</b> may provide WiFi, Bluetooth, USB, and other wired and wireless communication capability for communicating with a PC, a tablet computer, a smart phone. Optionally, intermediary processor <b>770</b> may include a user interface <b>774</b> for interaction with a user. External sensors <b>740</b> may represent other sensors for sensing other activities without departing from the scope hereof. Intermediary processor <b>770</b> includes software such that a microcontroller of intermediary processor, executing the software, processes signals from the internal sensors <b>776</b> and/or external sensors <b>740</b> to determine performance of the user or vehicle being ridden or driven by the user. One or more external sensors <b>740</b> may also be directly wired thereto (i.e., without requiring a wireless interface).
In one embodiment, where intermediary processor <b>770</b> is a smart phone, microcontroller <b>702</b> utilizes wireless transceiver <b>706</b> for bi-directional communication with intermediary processor <b>770</b>, and may send raw data, collected from one or more of sensors <b>710</b>, <b>754</b>, <b>756</b>, and/or microphone <b>758</b> of system <b>700</b> to intermediary processor <b>770</b> for processing. Microcontroller <b>702</b> may then receive processing results from intermediary processor <b>770</b> for optional further processing and display on peripheral vision device <b>704</b>.
System <b>700</b> may provide the user with performance feedback such as: current, average, max or min speed/pace; current, average, max or min heart rate; distance traveled; total energy expended; % through workout; duration; clock time; workout zone transition (or zone number cue); heart rate zone; timer; lap time; current, average, min or max power; and current, average, min or max cadence. In one example, system <b>700</b> provides an indication of when the user should replenish energy and/or rehydrate based upon total energy expended by the user and/or other sensed conditions of the user.
In one example of operation, microcontroller <b>702</b> receives performance information from intermediary processor <b>770</b> via wireless transceiver <b>706</b>, sensor data from sensors <b>710</b> if included, and from sensors <b>754</b> and <b>756</b> of user interface <b>750</b>. Software <b>703</b> is executed within microcontroller <b>702</b> to process this performance information and sensor data, to generate an illumination pattern (e.g., illumination pattern <b>408</b>, <b>508</b>), and to control peripheral vision device <b>704</b> to display the illumination pattern using peripheral vision device <b>704</b> such that the user is informed of the determined performance. Where included, audio output device <b>720</b> is also controlled by microcontroller <b>702</b> (e.g., when executing software <b>703</b>) to provide audible information to the user.
In one embodiment, intermediary processor <b>770</b> and external sensors <b>740</b> are integrated with a waterproof housing that couples to a swimmer's body (e.g., at the neck). Similarly, electronics <b>701</b> are enclosed within a waterproof housing and integrated with swimming goggles, such that the user when wearing system <b>700</b> and intermediary processor <b>770</b> may receive feedback on swimming metrics, such as length time, stroke rate, and so on. For example, sensors <b>710</b> and <b>740</b> may represent one or more of accelerometers, gyroscopes and light detectors for sensing swimming activity of the user.
In one embodiment, intermediary processor <b>770</b> is a smart phone (e.g., an iPhone® or other similar device), a tablet computer (e.g., an iPad® or other similar device), or a media player (e.g., an iPod® or iPod Touch® or other similar device), a bicycle computer, a netbook, or other such device. User interface <b>750</b> of system <b>700</b> may be used to control intermediary processor <b>770</b>, for example to adjust playback of audio from intermediary processor <b>770</b> via audio output device <b>720</b>.
<figref idref="DRAWINGS">FIG. 8</figref> shows one exemplary head mounted system <b>800</b> for displaying signal information within a peripheral vision area of a user. System <b>800</b> includes a microcontroller <b>802</b>, a peripheral vision device <b>804</b>, and a wireless transceiver <b>806</b>. Microcontroller <b>802</b> may include memory (non-volatile and volatile), one or more analog to digital converters, and other functionality, as typically found in microcontroller devices. Microcontroller <b>802</b> is shown with software <b>803</b>, stored within a memory of microcontroller <b>802</b> for example, which includes machine readable instructions that when executed by microcontroller <b>802</b> performs functionality of system <b>800</b>.
Peripheral vision device <b>804</b> is controlled by microcontroller <b>802</b> and positioned within a peripheral vision area of a user of system <b>800</b>. System <b>800</b> receives performance information from signaling device <b>870</b> via wireless transceiver <b>806</b>. Wireless transceiver <b>806</b> may have the capability of one or more of WiFi, Bluetooth, and other wireless protocols. Signaling device <b>870</b> may represent one or more of a mobile phone, an alarm system, a tablet computer, a PC, a vehicle engine management unit, a control system, and other such similar systems. Signaling device <b>870</b> transmits a signal to microcontroller <b>802</b> via wireless transceiver <b>806</b> to indicate a status (e.g., of a device or system being monitored by signaling device <b>870</b>). Microcontroller <b>802</b> then generates an illumination pattern based upon the signal and controls peripheral vision device <b>804</b> to display the illumination pattern to indicate the status to the user.
System <b>800</b> has a user interface <b>850</b> for receiving input from the user. User interface <b>850</b> may include one or more of: an actuator <b>852</b>, motion sensors <b>854</b>, a proximity sensor <b>856</b>, and a capacitive sensor <b>857</b>. Actuator <b>852</b> represents an input device (e.g., a push button switch and/or a slider) that allows the user to interact with microcontroller <b>802</b>. In one embodiment, actuator <b>852</b> is used to activate and deactivate system <b>800</b>. Motion sensor <b>854</b> may include one or more accelerometers and/or gyroscopes for detecting movement of system <b>800</b>. Proximity sensor <b>856</b> detects proximity changes of system <b>800</b> relative to other objects (e.g., the user's hand). Capacitive sensor <b>857</b> detects touch and/or motion of a user's fingertips on a surface proximate sensor <b>857</b> as an input to system <b>800</b>. Microcontroller <b>802</b> may detect gestures by the user using one or more of motion sensor <b>854</b> and capacitive sensor <b>857</b>. User interface <b>850</b> allows system <b>800</b> to recognize user gestures, such as: button pushes (long and/or short duration); taps—single, double, or triple taps by the user on system <b>800</b>; finger touches and sliding motion; and user movements such as head tilts, and head nods and/or shakes. Microcontroller <b>802</b> may also interpret combinations of inputs (e.g., gestures, button pushes and taps) from the user as sensed by user interface <b>850</b>.
System <b>800</b> may also include one or more internal sensors <b>810</b> that couple with microcontroller <b>802</b> to sense performance of the user or other environmental conditions. The internal sensors <b>810</b> may represent one or more of an accelerometer, a GNSS receiver, a gyroscope, a pressure sensor, a power sensor, a temperature sensor, a light sensor, and a proximity sensor. In one example, internal sensor <b>810</b> senses temperature of the user. In another example, sensor <b>810</b> senses environmental light levels. Optionally, sensors of user interface <b>850</b> and internal sensors <b>810</b> may provide both user input information and performance information. For example, information received from an accelerometer of sensors <b>810</b> may also be used to detect user input information.
System <b>800</b> may also include an audio output device <b>820</b> coupled with microcontroller <b>802</b> for generating audio information (e.g., tones and voice information readout) to a user of system <b>800</b>. In one embodiment, audio output device <b>820</b> also includes a vibration device for signaling to the user where audio signals may not be heard (e.g., in noisy environments).
System <b>800</b> may also include an interface <b>830</b> coupled with microcontroller <b>802</b> that enables communication between system <b>800</b> and a PC. In one example of operation, a personal computer may be used to configure performance zones and thresholds of system <b>800</b> via a USB interface of interface <b>830</b>. In one embodiment, interface <b>830</b> may be incorporated within wireless transceiver <b>806</b>, wherein system <b>800</b> communicates wirelessly with one or more of a PC, a tablet computer, a smart phone, and other devices having wireless capability. In another example, system <b>800</b> utilizes one or more of user interface <b>850</b> and internal sensor <b>810</b> to allow a user to configure system <b>800</b>.
<figref idref="DRAWINGS">FIG. 9</figref> is an exemplary perspective view showing system <b>800</b> of <figref idref="DRAWINGS">FIG. 8</figref> configured as a frame <b>902</b> for a pair of glasses. A plurality of light display elements <b>910</b> are positioned within frames <b>902</b> around one or both lenses to form peripheral vision device <b>804</b> such that light display elements <b>910</b> are within a peripheral vision area of one or both eyes of the user when the glasses are worn. Although shown with thirteen light display elements <b>910</b> on each half of frame <b>902</b>, system <b>800</b> may have more of fewer light display elements without departing from the scope hereof.
Light display elements <b>910</b> may be positioned to form a linear array <b>912</b> such that level signals may be displayed (e.g., the number of light display elements illuminated within array <b>912</b> may indicate a level). Each of light display elements <b>910</b> may be a single color, bicolor or tricolor, to convey information to the user. The linear array may be positioned at any point around the user's peripheral vision area, such as at the bottom or side of frame <b>902</b>. One or more of light display elements <b>910</b> may operate to project light onto other objects for viewing by the user. For example, light display elements <b>910</b> may project light onto a lens (polarized or non-polarized) that is within the peripheral field of vision of the user when wearing the glasses integrated with system <b>800</b>. In another example, light display elements <b>910</b> project light onto an intermediate lens or screen which is within the peripheral field of vision of the user when wearing the glasses integrated with system <b>800</b>.
A housing <b>906</b> formed on ear piece <b>904</b> of frames <b>902</b> contains electronics <b>801</b> that includes microcontroller <b>802</b>, wireless transceiver <b>806</b>, and user interface <b>850</b>, and optionally includes interface <b>830</b> and internal sensors <b>810</b>. Housing <b>906</b> may also be positioned at other convenient and/or ergonomic locations on frames <b>902</b> without departing from the scope hereof. Housing <b>906</b> may also include a battery (not shown) for powering electronics <b>801</b> and peripheral vision device <b>804</b>. The battery may also be positioned elsewhere (e.g., within a separate housing on the other ear piece of the glasses) without departing from the scope hereof. In one embodiment, a housing (e.g., housing <b>906</b>) may be positioned on each earpiece of frames <b>902</b> and electronics <b>101</b>, <b>701</b>, <b>801</b>, and <b>1201</b>, distributed therebetween.
System <b>800</b> may include other sources of energy, such as energy harvesting systems, solar energy collectors, and so on, without departing from the scope hereof.
In one example of use, signaling device <b>870</b> represents a heart rate monitoring device that is measuring the heart rate of a patient within a hospital, and where system <b>800</b>, in the form of frames <b>902</b>, is worn by a doctor performing a procedure on the patient. While maintaining his view on the procedure being performed, the doctor receives an indication (e.g., periodically, or when one or more predefined thresholds are reached) of the patients heart rate from peripheral vision device <b>804</b>. The indication may take the form of one or more light display elements <b>910</b> flashing to indicate that the patient heart rate has exceeded the predefined threshold, and may utilize array <b>912</b> to indicate a rate of change in the measured heart rate (e.g., by a running light effect).
In another example of use, signaling device <b>870</b> represents a timer associated with a setting time of cement used by a dentist on a patient's tooth. The dentist has the cement mixed and applies it to the tooth, applying pressure to the tooth (e.g., holding the crown or veneer in place) while the cement sets. Signaling device <b>870</b> sends a timing signal to microcontroller <b>802</b> via wireless transceiver <b>806</b>, and microcontroller <b>802</b> utilizes peripheral vision device <b>804</b> to show a countdown of remaining time (e.g., using array <b>912</b>). When the timer expires, signaling device <b>870</b> sends a signal to microcontroller <b>802</b> via wireless transceiver <b>806</b>, wherein microcontroller flashes a different one of light display elements <b>910</b> in a green color to indicate that the cement is set.
In another example of use, sensor <b>810</b> includes an infrared temperature sensor (or radiation sensor) that is attached to (or built into) frames <b>902</b> and directionally aligned with the view of a user wearing frames <b>902</b>. Microcontroller <b>802</b> receives and processes a signal from this sensor to determine a temperature of an object being viewed. Microcontroller <b>802</b> then compares this temperature to at least one threshold (e.g., a maximum temperature) and controls peripheral vision device <b>804</b> to indicate a sensed temperature that exceeds the defined threshold. For example, this could provide a warning to the user approaching a hot object. In another example, the array <b>912</b> displays an indication of measured temperature, thereby operating as a limited infrared vision aid. It will be appreciated that although <figref idref="DRAWINGS">FIG. 9</figref> shows system <b>800</b> configured as frames <b>902</b>, systems <b>100</b>, <b>700</b> or <b>1200</b> (described below) may likewise be integrated with frames <b>902</b>.
Frames <b>902</b> may also contain other sensors <b>810</b> that couple with electronics <b>801</b> to enhance safety of a wearer of system <b>800</b>. For example, sensors <b>810</b> may include gas sensors such that system <b>800</b> provides a warning to the wearer when a certain gas (or lack thereof) is detected by sensors <b>810</b>.
<figref idref="DRAWINGS">FIG. 10</figref> is a schematic diagram illustrating one embodiment of systems <b>100</b>, <b>700</b>, and <b>1200</b> in the form of a headset body <b>1002</b> that has an ear clip <b>1004</b>, an ear piece <b>1006</b>, and a microphone <b>1008</b>. Ear clip <b>1004</b> may optionally include an inner-ear clip (not shown) for securing headset body <b>1002</b> in position. Ear piece <b>1006</b> is formed to fit the human ear and includes audio output device <b>120</b>, <b>720</b>, <b>820</b>, <b>1220</b>. Microphone <b>1008</b> may represent microphone <b>158</b>, <b>758</b>, <b>1208</b> of user interface <b>150</b>, <b>750</b>, <b>1250</b>, and/or may represent a microphone of sensors <b>110</b>, <b>710</b> and <b>1210</b>. Electronics <b>101</b>, <b>701</b>, and <b>1201</b> within headset body <b>1002</b> represent components of microcontroller <b>102</b>, <b>702</b>, <b>1202</b>, user interface <b>150</b>, <b>750</b>, <b>1250</b>, wireless receiver/transceiver <b>106</b>, wireless transceiver <b>706</b>, and cellular transceiver <b>1206</b>. A boom <b>1012</b> connected to headset body <b>1002</b> positions peripheral vision device <b>104</b>, <b>704</b>, and <b>1204</b> within a peripheral vision area of the user wearing system <b>100</b>, <b>700</b>, and <b>1200</b>.
<figref idref="DRAWINGS">FIG. 11</figref> is a schematic diagram illustrating one embodiment of systems <b>100</b>, <b>700</b>, and <b>1200</b> in the form of a headset body <b>1102</b> that has a clip <b>1104</b>, an ear piece <b>1106</b>, and a microphone <b>1108</b>. Clip <b>1104</b> attaches headset body <b>1102</b> to an ear piece <b>1105</b> of a pair of glasses, for example. Ear piece <b>1106</b> is formed to fit the human ear and includes audio output device <b>120</b>, <b>720</b>, <b>820</b>, <b>1220</b>. Microphone <b>1108</b> may represent microphone <b>158</b>, <b>758</b>, <b>1208</b> of user interface <b>150</b>, <b>750</b>, <b>1250</b>, and/or may represent a microphone of sensors <b>110</b>, <b>710</b> and <b>1210</b>. Electronics <b>101</b>, <b>701</b>, and <b>1201</b> within headset body <b>1102</b> represents components of microcontroller <b>102</b>, <b>702</b>, <b>1202</b>, user interface <b>150</b>, <b>750</b>, <b>1250</b>, wireless receiver/transceiver <b>106</b>, wireless transceiver <b>706</b>, and cellular transceiver <b>1206</b>. A boom <b>1112</b> connected to headset body <b>1102</b> positions peripheral vision device <b>104</b>, <b>704</b>, and <b>1204</b> within a peripheral vision area of the user wearing system <b>100</b>, <b>700</b>, and <b>1200</b>. Clip <b>1104</b> may also attach headset body <b>1102</b> to other articles word by the user, such as a helmet, a ball-cap, goggles, and a visor.
<figref idref="DRAWINGS">FIG. 12</figref> shows one exemplary head-mounted cellular phone system <b>1200</b> that includes a microcontroller <b>1202</b>, a peripheral vision device <b>1204</b>, and a cellular transceiver <b>1206</b>. Microcontroller <b>1202</b> may include memory (non-volatile and volatile), one or more analog to digital converters, and other functionality, as typically found in microcontroller devices. Microcontroller <b>1202</b> is shown with software <b>1203</b>, stored within a memory of microcontroller <b>1202</b> for example, which contains machine readable instructions that when executed by microcontroller <b>1202</b> performs functionality of system <b>1200</b>.
Peripheral vision device <b>1204</b> is controlled by microcontroller <b>1202</b> and positioned within a peripheral vision area of a user of system <b>1200</b> for displaying information associated with operation of system <b>1200</b>. For example, microcontroller <b>1202</b> may utilize peripheral vision device <b>1204</b> to display an illumination pattern (e.g., illumination pattern <b>408</b>, <b>508</b>) that indicates one or more of incoming calls, incoming text messages, incoming emails, calendar events, signal strength, and battery status.
System <b>1200</b> has a user interface <b>1250</b> for receiving input from the user. User interface <b>1250</b> may include one or more of: an actuator <b>1252</b>, motion sensors <b>1254</b>, a proximity sensor <b>1256</b>, and a capacitive sensor <b>1257</b>. Actuator <b>1252</b> represents an input device (e.g., a push button switch) that allows the user to interact with microcontroller <b>1202</b>. In one embodiment, actuator <b>1252</b> is used to activate and deactivate system <b>1200</b>. Motion sensors <b>1254</b> may include one or more accelerometers and/or gyroscopes for detecting movement of system <b>1200</b>. Proximity sensor <b>1256</b> detects proximity changes of system <b>1200</b> relative to other objects (e.g., the user's hand). Capacitive sensor <b>1257</b> detects touch and/or motion of a user's fingertips on a surface proximate sensor <b>1257</b> as an input to system <b>1200</b>. User interface <b>1250</b> allows system <b>1200</b> to recognize user gestures, such as: button pushes (long and/or short duration); taps—single, double, or triple taps by the user on system <b>1200</b>; touches and/or finger movements along a surface of system <b>1200</b>; and movements such as head tilts, and head nods and/or shakes. Microcontroller <b>1202</b> may also interpret combinations of inputs (e.g., button pushes and taps) from the user as sensed by user interface <b>1250</b>.
In one example of operation, microcontroller <b>1202</b> display indication of an incoming call to cellular transceiver <b>1206</b> using peripheral vision device <b>1204</b>. Upon noticing the displayed indication, the user nods to indicate that system <b>1200</b> should answer the call, whereupon microcontroller <b>1202</b> instructs cellular transceiver <b>1206</b> to answer the incoming call and allows the user to hear the caller via audio output device <b>1220</b> and speak to the caller via a microphone <b>1258</b>.
System <b>1200</b> may also include one or more internal sensors <b>1210</b> that couple with microcontroller <b>1202</b> to sense performance of the user. The internal sensors <b>1210</b> may include one or more of an accelerometer, a gyroscope, a pressure sensor, a power sensor, a temperature sensor, a light sensor, GNSS (GPS), and a proximity sensor. Optionally, sensors of user interface <b>1250</b> and sensors <b>1210</b> may provide one or more of user input information, environmental information, and performance information. For example, information received from an accelerometer within sensors <b>1210</b> may also be interpreted provide user input information.
System <b>1200</b> may also include a interface <b>1230</b> coupled with microcontroller <b>1202</b> that enables communication between system <b>1200</b> and a PC or other device such as a tablet, a smart phone, a media player, and other similar devices. In one example of operation, a PC connected to interface <b>1230</b> is used to configure contact information and other operation parameters of system <b>1200</b> via a USB interface. Interface <b>1230</b> may also represent a wireless transceiver (e.g., Bluetooth or Bluetooth Low Energy) for communicating with the PC without departing from the scope hereof.
<figref idref="DRAWINGS">FIG. 13</figref> shows one exemplary head mounted system <b>1300</b> for displaying sound indications within a peripheral vision area of a user of system <b>1300</b>. System <b>1300</b> includes a microcontroller <b>1302</b>, a peripheral vision device <b>1304</b>, and may include a wireless transceiver (not shown) similar to transceiver <b>806</b>. Microcontroller <b>1302</b> may include memory (non-volatile and volatile), one or more analog to digital converters, and other functionality, as typically found in microcontroller devices. Microcontroller <b>1302</b> is shown with software <b>1303</b>, stored within a memory of microcontroller <b>1302</b> for example, which has machine readable instructions that when executed by microcontroller <b>1302</b> performs functionality of system <b>1300</b>, as describe below.
Peripheral vision device <b>1304</b> is positioned within a peripheral vision area of a user of system <b>1300</b> and controlled by microcontroller <b>1302</b> to display an illumination pattern that indicates sounds detected by microphones <b>1358</b>. Software <b>1303</b> includes one or more algorithms for processing data collected by microcontroller <b>1302</b> from microphones <b>1358</b> to identify one or more of: intensity, frequency, spectral content, and direction of the sound source.
System <b>1300</b> has a user interface <b>1350</b> for receiving input from the user. User interface <b>1350</b> may include one or more of: an actuator <b>1352</b>, motion sensors <b>1354</b>, a proximity sensor <b>1356</b>, and a capacitive sensor <b>1357</b>. Actuator <b>1352</b> represents an input device (e.g., a push button switch) that allows the user to interact with microcontroller <b>1302</b>. In one embodiment, actuator <b>1352</b> is used to activate and deactivate system <b>1300</b>. Motion sensor <b>1354</b> may include one or more accelerometers and/or gyroscopes for detecting movement of system <b>1300</b>. Proximity sensor <b>1356</b> detects proximity changes of system <b>1300</b> relative to other objects (e.g., the user's hand). Capacitive sensor <b>1357</b> detects touch and/or motion of a user's fingertips on a surface proximate sensor <b>1357</b> as an input to system <b>1300</b>. User interface <b>1350</b> allows system <b>1300</b> to recognize user gestures, such as: button pushes (long and/or short duration); taps—single, double, or triple taps by the user on system <b>1300</b>; touches and/or finger movements along a surface of system <b>1300</b>; and movements such as head tilts, and head nods and/or shakes. Microcontroller <b>1302</b> may also interpret combinations of inputs (e.g., button pushes and taps) from the user as sensed by user interface <b>1350</b>. In one embodiment, one or more capacitive sensors <b>1357</b> are positioned proximate to light display elements of peripheral vision device <b>1304</b> such that gestures made by the user (e.g., sliding a finger) along the frame above a lit portion of peripheral vision device <b>1304</b> are input as commands to change one or more settings associated with the displayed metric.
System <b>1300</b> may include one or more sensors <b>1310</b> for sensing the environmental conditions, such as ambient light, body temperature, air temperature, and so on. Sensors <b>1310</b> are similar to sensors <b>110</b> of system <b>100</b>, <figref idref="DRAWINGS">FIG. 1</figref>, for example.
System <b>1300</b> may also include an interface <b>1330</b> coupled with microcontroller <b>1302</b> that enables communication between system <b>1300</b> and one or more of a PC, a tablet, a smart phone, and other similar devices. In one example of operation, the PC is used to configure software <b>1303</b> and thresholds of system <b>1300</b> via a USB interface of interface <b>1330</b>. Interface <b>1330</b> may also represent a wireless transceiver (e.g., Bluetooth or Bluetooth Low Energy) for communicating with the PC.
<figref idref="DRAWINGS">FIG. 14</figref> is a perspective view showing system <b>1300</b> of <figref idref="DRAWINGS">FIG. 13</figref> configured with frames <b>1402</b> of a pair of glasses. A plurality of light display elements <b>1410</b> are positioned within frames <b>1402</b> around both lenses to form peripheral vision device <b>1304</b> such that light display elements <b>1410</b> are within a peripheral vision area of the user when the glasses are worn. Although shown with thirteen light display elements <b>1410</b> on each half of frames <b>1402</b>, system <b>1300</b> may have more of fewer light display elements without departing from the scope hereof. Light display elements <b>1410</b> may be positioned to form linear arrays <b>1412</b>(L), <b>1412</b>(R) such that level signals may be displayed (e.g., the number of light display elements illuminated within array <b>1412</b> indicates a level). Each light display element <b>1410</b> may be mono-color, bicolor, tricolor, or multi-color, such that additional information of a signal may be conveyed to the user. A housing <b>1406</b> formed on ear piece <b>1404</b> of frames <b>1402</b> contains electronics <b>1301</b> that include microcontroller <b>1302</b>, user interface <b>1350</b>, and optionally interface <b>1330</b>. Housing <b>1406</b> may also include a battery (not shown) for powering electronics <b>1301</b> and peripheral vision device <b>1304</b>. The battery may also be positioned elsewhere (e.g., within a separate housing on the other ear piece of the glasses) without departing from the scope hereof.
In one example of operation, microcontroller <b>1302</b> receives signals from microphones <b>1358</b>(L) and <b>1358</b>(R) and converts them into digital data streams using at least one analog to digital converter. These data streams are then processed by executing software <b>1303</b> to identify and qualify sounds within each data stream. In one example, software <b>1303</b> implements one or more of digital filters, fast Fourier transforms, and other digital signal processing algorithm in conjunction with correlation algorithms. Microcontroller <b>1302</b> correlates the digital data stream from each microphone <b>1358</b> to determine a direction of the sound relative to the position of the microphone and frames <b>1402</b>, thereby deriving a direction relative to the user wearing the frames. Microcontroller <b>1302</b> then illuminates, flashes, and/or otherwise controls one or more light display elements <b>1410</b> of peripheral vision device <b>1304</b> to indicate a type of the sound, the intensity, and the direction. For example, arrays <b>1412</b>(L) and <b>1412</b>(R) may be used to indicate both intensity and direction of the sound, and other light display elements <b>1410</b> may indicate the type of the sound. For example, microcontroller <b>1302</b> executing software <b>1303</b> may identify one or more sounds from a phone ringing, a knock at the door, a doorbell, a fire alarm, a smoke alarm, a car horn, a baby monitor, a baby crying, a male voice, a female voice, and a child's voice.
System <b>1300</b> may also be configured with a wireless transceiver and an intermediary processor, similar to system <b>700</b> of <figref idref="DRAWINGS">FIG. 7</figref>, such that processing may be performed remotely and results transferred back to system <b>1300</b> for display using peripheral vision device <b>1304</b>.
<figref idref="DRAWINGS">FIGS. 15A-C</figref> show perspective views of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and/or <b>1300</b> configured as a clip-on addition to an ear piece <b>1508</b> of a user's existing glasses <b>1502</b> and sunglasses <b>1552</b>. An attachment device <b>1504</b> allows a housing <b>1506</b> to couple with ear piece <b>1508</b> of glasses <b>1502</b>. Attachment device <b>1504</b> is for example similar to attachment mechanism <b>206</b> of <figref idref="DRAWINGS">FIG. 2</figref>. A peripheral vision device <b>1512</b> couples with housing <b>1506</b> containing electronics <b>101</b>, <b>701</b>, <b>801</b>, <b>1201</b>, <b>1302</b> of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b>, respectively. In one embodiment, peripheral vision device <b>1512</b> includes at least one lens that couples with electronics <b>101</b>, <b>701</b>, <b>801</b>, <b>1201</b>, and <b>1301</b> via at least one fiber optic connection <b>1510</b>. For example, peripheral vision device <b>1512</b> may bond to glass or use an attachment feature such as suction cups for removable positioning. System <b>1500</b> may include more than one peripheral vision device <b>1512</b> without departing from the scope hereof. For example, peripheral vision devices <b>1512</b> may be positioned one or more of the top, the bottom, and the sides of a lens of the user's glasses.
Two systems may be worn together and/or integrated into one piece of headgear. For example, a first system <b>100</b> may be configured on a left side of a user's glasses, and a second system <b>100</b> may be configured on a right side of the user's glasses. The first and second systems then communicate and operate as a single, more capable unit. Displayed metrics and indications may be distributed between light display elements of both systems. For example, the first system <b>100</b> may display a low heart rate indication on a left-most light display element and the second system <b>100</b> may display a high heart rate indication on a right-most light display element. The first and second systems may also display different metrics and when information is uploaded to a PC (e.g., via interface <b>130</b>), information is not duplicated from both units.
As described above, systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> may implement a communication protocol that allows two or more units to communicate with one another as well as to communicate with external sensors <b>170</b><i>a</i>-<i>c</i>/<b>740</b>, intermediary processor <b>770</b>, and signaling device <b>870</b>. In one example, systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b> and <b>1300</b> include transceivers that allow communication based upon ANT communication protocols. Other examples of communication devices and protocols that may be implemented and/or used with systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> include BTLE and other Bluetooth (BT) communication devices and protocols. Systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> may be configures to use any appropriate type of communication device and protocol without departing from the scope hereof.
Positioning of peripheral vision devices <b>104</b>, <b>704</b>, <b>804</b>, <b>1204</b>, and <b>1304</b>, as described above, may also use other means to enhance reliability and convenience. For example, boom <b>202</b> may include one or more of a suction cup and an adhesive pad, for attaching boom <b>202</b> to a user's goggles or glasses. In another example, boom <b>202</b> includes an attachment clip that allows boom <b>202</b> to attach to items (e.g., glasses, goggles, face protectors, headgear, and so on.) worn by the user.
Additional Examples of Use
In a retail environment, serving staff each wear systems <b>800</b> to receive instructions to better service customers. For example, one or more light display elements of system <b>800</b> may be assigned to indicate a location where more servers are required to help customers. In another example, a server in a restaurant wears system <b>800</b> and one or more light display elements are assigned to indicate that food is ready. In another example, system <b>800</b> is worn by a kitchen worker and one or more indicators are assigned to indicate that more food of a particular type (e.g., hamburger) should be prepared. System <b>800</b> may be used to convey information where speaking directly to people is not convenient.
In another example of use, system <b>100</b> includes a GPS receiver and mapping information of a golf course, such that system <b>100</b> may provide distance information of a current position to a next green when worn by a golfer. In another example, system <b>700</b> is linked to a GPS unit in a golf cart to provide distance information as received wirelessly. One or more user inputs may instruct system <b>100</b>, <b>700</b> as to when to switch to the next hole and to keep track of strokes taken.
In another example of use, system <b>800</b> may be configured to provide timing prompts, such as a time-per-question reminder for a student in an exam. In another example, system <b>800</b> provides prompts to a teacher (or other officiator) from members of the class without disturbing other members of the class.
In another example, system <b>800</b> is worn by sound engineers at a concert, and linear arrays <b>912</b> are used to visually display the DB's (since the engineers typically wear noise cancelling headphones). Similarly, for worker of heavy equipment where audible warnings are less effective, system <b>800</b> may be worn to provide one or more alarm and/or status indications.
In a gaming environment, a player wears system <b>800</b> in the embodiment of frames <b>902</b> to display one or more of kill and hit rates in laser tag. For example, linear array <b>912</b> may indicate one or more of: a “health” of the player in the game, an amount of ammunition left, and time left in the game.
In another example, a cyclist wears system <b>100</b> to view their current performance and to communicate with other cyclists in a peloton. For example, when the front rider needs to switch out, he may utilize the user interface of system <b>100</b> to indicate to other riders in the peloton one or more of: he is about to change out of the lead position, he has equipment problems, and he is going into attack mode. Through use of system <b>100</b>, each member of the team is aware of the required actions at the same time.
In another example, system <b>800</b> couples to a cell phone and displays indication of incoming calls, incoming text messages, and incoming emails. System <b>800</b> may thus operate similar to system <b>1200</b>, but with an external cell phone.
In another example of use, system <b>800</b> is coupled with a GPS receiver and provides an indication of a required direction change based upon the user's location and movement. For example, system <b>800</b> may indicate a left turn, a right turn, straight ahead, and may display compass information to the user. In another example, system <b>800</b> provides clues within a treasure hunt, such as getting closer to and farther from the goal.
In another example of use, system <b>800</b> provides status indications from a laptop, tablet computer (e.g., Apple iPad™) and desktop computer, such as instant messaging and email notifications, without requiring the user to switch to different displays on the computer.
In another example of use, a driver wears system <b>800</b> while driving a car to provide a warning indication (e.g., car malfunction). For example, system <b>800</b> may also indicate backup warnings and/or distances, and may include a range finder to display measured distances to the user, for example to warn if travelling too close to the vehicle in front.
In another example of use, each of a plurality of cyclists wear system <b>100</b> to display their performance information, and to also receive indication of acceleration/deceleration of the other riders (i.e., system <b>100</b> acts as a bicycle brake light). That is, within an ecosystem of cycle riders each wearing at least one system <b>100</b>, certain information may be shared between the riders to enhance safety and promote awareness of intended activities.
In another example of use, system <b>700</b> communicates with an iPhone® to receive performance data from at least one sensor (internal and/or external) and display high level data using peripheral vision device <b>804</b>, while sending the data to the iPhone to allow the data to be stored and/or displayed graphically.
In another example of use, within a manufacturing environment, equipment operators wear system <b>800</b> in the form of a pair of safety glasses, as shown in <figref idref="DRAWINGS">FIG. 9</figref>, to display status information of operated equipment. For example, one or more light display elements may be assigned to indicate that the operator should increase or decrease speed, or that an item has passed inspection or failed inspection. A plant manager may walk through a division wearing system <b>800</b>, and based upon connectivity (e.g., automatically connecting to systems within proximity) may receive an instant display of operation status.
In another example of use, system <b>100</b> is included within a helmet of a football player to indicate selected plays and his performance during training. System <b>100</b> may include a GPS receiver and thus indicate when the player should turn and cut for a selected or predefined play.
In another example of use, system <b>100</b> is built into goggles and/or a helmet worn by a parachutist and used to indicate when the rip-cord should be pulled, or may be used to provide an indication of danger.
In another example of use, system <b>800</b> is worn by a pilot and is in communication with aircraft equipment to provide a status display (e.g., warning lights) and/or other information. In another example, system <b>800</b> couples with one or more gyroscopes mounted within the aircraft to generate an artificial horizon, wherein system <b>800</b> displays attitude information of the aircraft to the pilot.
In another example of use, external sensors (e.g., one or more accelerometers) are attached to a head of a golf club swung by a wearer of system <b>100</b>. As the user swings the club, microcontroller <b>102</b> determines a club head speed, which is reported to the user, either visually using peripheral vision device <b>104</b> and/or audibly via audio output device <b>120</b>. Additional sensors (e.g., sensors <b>110</b>) may be integrated into the grips of the club, such that system <b>100</b> may optionally display the user's grip pressure.
In another example of use, system <b>100</b> is configured within swim goggles to maintain a lap counter and other performance measurements. System <b>100</b> may include a heart rate monitor sensor (e.g., an ear clip) and one or more accelerometers and/or gyroscopes that allow microcontroller to determine a swim direction, and thereby count laps.
In another example, system <b>700</b> includes two-way voice communication to other similarly enables systems. For example, cyclists in a peloton each using system <b>700</b> may communicate verbally over short distances, and may use verbal commands to control system <b>700</b>.
In another example of use, system <b>100</b>, <b>700</b> has one or more sensors positioned on an arm or a leg of the user, wherein system <b>100</b>, <b>700</b> displays an indication of body position relative to a set position as used for working out with weights and other equipment. System <b>100</b>, <b>700</b> may then count repetitions of a set of exercises, and even count the number of sets. Where system <b>100</b>, <b>700</b> is preprogrammed with the exercises and total number of sets, system <b>100</b>, <b>700</b> may prompt (either visually and/or audibly) the user as to which exercise/set is next, and how many repetitions/sets/exercises are remaining. System <b>100</b>, <b>700</b> may also interact with another device (e.g., a cell phone, iPod etc.) to display exercises and/or statistics, and receive configuration information as to the number of repetitions, target heart rate, training intervals, etc. After exercising, system <b>100</b>, <b>700</b> may download data to the device for display to the user and/or uploading to a web site for storage and/or comparison with other competitors.
In another embodiment, an automatic wireless cycle brake light system utilizes accelerometers to detect acceleration and/or other methods of detecting changes in motion to control a tail light that varies in intensity and/or color to indicate changes in speed of the cycle. For example, when the user coasts, the light may be yellow, whereas when the user brakes, a high intensity red light is displayed.
In another example of use, a stock broker may configure system <b>800</b> to provide an alert when a stock value (or commodity or market index) drops below, or exceeds, a lower or upper threshold.
In another example of use, an external level sensing device includes at least one accelerometer sensor (e.g., one of sensors <b>170</b><i>a</i>-<i>c</i>), and sends wireless level information to system <b>100</b>. A user wears system <b>100</b>, which displays the level information from the external device, thereby allowing the user to level equipment for example without constantly referring to the level sensing device itself.
<figref idref="DRAWINGS">FIGS. 16A</figref> and B show one exemplary head-mounted peripheral vision display system <b>1600</b> integrated with a baseball cap <b>1602</b>. System <b>1600</b> may represent one of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> of <figref idref="DRAWINGS">FIGS. 1, 7, 8, 12 and 30</figref>, respectively. A peripheral vision device <b>1604</b> is positioned to be able to emit light from an underside of a peak <b>1606</b> of baseball cap <b>1602</b> and a housing <b>1608</b> is positioned on a top surface of peak <b>1606</b> and contains electronics of system <b>1600</b>. Housing <b>1608</b> may be positioned or integrated elsewhere on or within cap <b>1602</b> without departing from the scope hereof. Each light display element <b>1610</b> of peripheral vision device <b>1604</b> is electrically coupled with electronics within housing <b>1608</b>. Optionally, one or more audio output devices <b>1620</b> are integrated with baseball cap <b>1602</b> to provide audio output from system <b>1600</b>. Audio output devices <b>1620</b> may represent audio output devices <b>120</b>, <b>720</b>, <b>820</b>, <b>1220</b>, and <b>1320</b>, for example. Systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> may similarly be configured to attach to existing headwear or may be integrated with headwear. For example, systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> may be integrated with a helmet, a hat, glasses, headphones, earphones, and other items worn or used on the head. Systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> may for example be formed with an attachment mechanism for coupling within or upon one or more of a helmet, a hat, glasses, headphones, earphones, and other items worn or used on the head.
<figref idref="DRAWINGS">FIG. 17</figref> is a flowchart illustrating one exemplary method <b>1700</b> for displaying information to a user without distraction. Method <b>1700</b> is for example implemented within one or more of software <b>103</b>, software <b>703</b>, software <b>803</b>, software <b>1203</b>, and software <b>1303</b>, of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b>, respectively.
In step <b>1702</b>, method <b>1700</b> receives the information. In one example of step <b>1702</b>, wireless receiver/transceiver <b>106</b> receives information from one or more external sensors or devices and passes the information to microcontroller <b>102</b>. In step <b>1704</b>, method <b>1700</b> determines an illumination pattern for at least one light display element based upon the information. In one example of step <b>1704</b>, microcontroller <b>102</b> determines illumination pattern <b>408</b> for light display elements <b>304</b> based upon information received from sensors <b>170</b><i>a</i>-<i>c. </i>
Steps <b>1706</b> through <b>1710</b> are optional. If included, step <b>1706</b> is a decision. If, in step <b>1706</b>, method <b>1700</b> determines that the determined illumination pattern has changed, method <b>1700</b> continues with step <b>1712</b>; otherwise method <b>1700</b> continues with step <b>1708</b>. If included, step <b>1708</b> is a decision. If, in step <b>1708</b><i>m </i>method <b>1700</b> determines that a timeout has occurred, method <b>1700</b> continues with step <b>1710</b>; otherwise method <b>1700</b> terminates. In one example of step <b>1708</b>, a timer within microcontroller <b>102</b>, <b>702</b>, <b>802</b>, <b>1202</b>, and <b>1302</b>, is configured to mature a predefined period after a pattern change in peripheral vision device <b>104</b>, <b>704</b>, <b>804</b>, <b>1204</b>, and <b>1304</b>, where the timer is restarted whenever the pattern in the peripheral vision device changes. If included, in step <b>1710</b>, method <b>1700</b> dims (or extinguishes) the peripheral vision device. In one example of step <b>1710</b>, peripheral vision device <b>104</b>, <b>704</b>, <b>804</b>, <b>1204</b>, and <b>1304</b> is gradually dimmed and then extinguished by microcontroller <b>102</b>, <b>702</b>, <b>802</b>, <b>1202</b>, and <b>1302</b>.
In step <b>1712</b>, method <b>1700</b> controls the at least one light display element to display the illumination pattern. In one example of step <b>1712</b>, microcontroller <b>102</b> controls light display elements <b>304</b> to display illumination pattern <b>408</b> determined from information received from wireless receiver/transceiver <b>106</b>. Where steps <b>1706</b> through <b>1710</b> are included, step <b>1712</b> may also restart the timer within microcontroller <b>102</b>, <b>702</b>, <b>802</b>, <b>1202</b>, and <b>1302</b>.
<figref idref="DRAWINGS">FIG. 18</figref> is a flowchart illustrating one exemplary method <b>1800</b> for determining an illumination pattern for one metric. Method <b>1800</b> may represent at least part of step <b>1704</b> of <figref idref="DRAWINGS">FIG. 17</figref> and is for example implemented within one or more of software <b>103</b>, software <b>703</b>, software <b>803</b>, software <b>1203</b>, and software <b>1303</b>, of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b>, respectively.
In step <b>1802</b>, method <b>1800</b> reads a metric display area from a configuration. In one example of step <b>1802</b>, microcontroller <b>102</b> reads a display area containing display elements <b>304</b>(<b>1</b>) through <b>304</b>(<b>7</b>) from configuration <b>160</b> for activity metric <b>406</b>. In step <b>1804</b>, method <b>1800</b> reads a display mode from the configuration for the metric. In one example of step <b>1804</b>, microcontroller <b>102</b> reads a display mode indicating that activity metric <b>406</b> is displayed as a linear array. In step <b>1806</b>, method <b>1800</b> reads metric minimum and maximum values from the configuration. In one example of step <b>1806</b>, microcontroller <b>102</b> reads, for a running metric, a minimum value of 2 miles per hour (mph) and a maximum value of 8 mph. In step <b>1808</b>, method <b>1800</b> reads a metric target zone from the configuration. In one example of step <b>1808</b>, microcontroller <b>102</b> reads, for the running metric, a target zone of 4-6 mph.
In step <b>1810</b>, method <b>1800</b> determines a position of indicator based on the minimum and maximum values and the current metric value. In one example of step <b>1810</b>, continuing with the above running example where the current metric value is 5 mph, microcontroller <b>102</b> determines that light display element <b>304</b>(<b>4</b>) is the position for indicating the current metric value for activity metric <b>406</b> based upon the display area of light display elements <b>304</b>(<b>1</b>)-(<b>7</b>), the minimum and maximum values of 2 mph and 8 mph, and the current metric value of 5 mph.
In step <b>1812</b>, method <b>1800</b> determines an intensity of the illumination pattern based upon the target zone and the current metric value. In one example of step <b>1812</b>, microcontroller <b>102</b> determines that the current metric value is within the target zone of step <b>1808</b> and therefore sets illumination pattern <b>408</b> to have a bright flashing intensity. In step <b>1814</b>, method <b>1800</b> generates an illumination pattern based upon the display area, the display mode, the position, and the intensity. In one example of step <b>1814</b>, microcontroller <b>102</b> generates illumination pattern <b>408</b> to display active metric <b>406</b> on peripheral vision device <b>104</b>.
Ordering of steps within method <b>1800</b> may change without departing from the scope hereof.
<figref idref="DRAWINGS">FIG. 19</figref> is a flowchart illustrating one exemplary method <b>1900</b> for determining an illumination pattern for an activity metric where activity in a target zone is indicated by no illuminated elements of the peripheral display. Method <b>1900</b> may represent at least part of step <b>1704</b> of <figref idref="DRAWINGS">FIG. 17</figref> and is for example implemented within one or more of software <b>103</b>, software <b>703</b>, software <b>803</b>, software <b>1203</b>, and software <b>1303</b>, of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b>, respectively.
Step <b>1902</b> is optional. Step <b>1902</b> is included where the peripheral display has multiple light display elements <b>304</b>. In step <b>1902</b>, method <b>1900</b> reads metric display position from the configuration. In one example of step <b>1902</b>, microcontroller <b>102</b> reads a display area containing display elements <b>304</b>(<b>1</b>) through <b>304</b>(<b>7</b>) from configuration <b>160</b> for activity metric <b>406</b>. In step <b>1904</b>, method <b>1900</b> reads a metric target zone from the configuration. In one example of step <b>1904</b>, microcontroller <b>102</b> reads a 4-6 mph target zone from configuration <b>160</b>. In step <b>1906</b>, method <b>1900</b> determines a current metric value. In one example of step <b>1906</b>, microcontroller <b>102</b> processes information received from one or more sensors <b>110</b> and/or <b>154</b> to determine a current running speed of the user as the current metric value.
Step <b>1908</b> is a decision. If, in step <b>1908</b>, method <b>1900</b> determines that the current metric value is within the target zone, method <b>1900</b> continues with step <b>1910</b>; otherwise method <b>1900</b> continues with step <b>1912</b>. In step <b>1910</b>, method <b>1900</b> extinguishes the display elements of the metric display position. In one example of step <b>1910</b>, microcontroller <b>102</b> controls peripheral vision device <b>104</b> to extinguish light display elements <b>304</b>(<b>1</b>)-(<b>7</b>) of activity metric <b>406</b>. Method <b>1900</b> then terminates.
In step <b>1912</b>, method <b>1900</b> determines intensity, a mode, and/or a position of indicators for illumination based upon the current metric value, the display position, and the target zone. In one example of step <b>1912</b>, microcontroller <b>102</b> determines intensity based upon the size of the difference between the current metric value and the target zone. In step <b>1914</b>, method <b>1900</b> generates an illumination pattern based upon the position and the intensity. In one example of step <b>1914</b>, microcontroller <b>102</b> generates illumination pattern <b>408</b> to display active metric <b>406</b> on peripheral vision device <b>104</b>.
Ordering of steps within method <b>1900</b> may change without departing from the scope hereof.
<figref idref="DRAWINGS">FIG. 20</figref> shows exemplary communication between head-mounted performance display systems <b>100</b>(<b>1</b>) and <b>100</b>(<b>2</b>), and between a coach station <b>2002</b> and each of systems <b>100</b>(<b>1</b>) and <b>100</b>(<b>2</b>). Although the example uses system <b>100</b>, any of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> may be used without departing from the scope hereof. System <b>100</b>(<b>1</b>) and system <b>100</b>(<b>2</b>) communicate with each other and communicate with coach station <b>2002</b> wirelessly using wireless receiver/transceiver <b>106</b>. Coach station <b>2002</b> has a transceiver similar to (or compatible with) wireless receiver/transceiver <b>106</b> and includes a microphone (e.g., similar to microphone <b>158</b> of system <b>100</b>) and an audio output device (e.g., similar to audio output device <b>120</b>).
In one example of operation, an analog signal <b>2003</b> generated by microphone <b>158</b> is captured by microcontroller <b>102</b> (e.g., using an analog to digital converter controlled by software <b>103</b>) and transferred to wireless receiver/transceiver <b>106</b> for transmission as wireless signal <b>2004</b> to system <b>100</b>(<b>2</b>). Within system <b>100</b>(<b>2</b>), information received within wireless signal <b>2004</b> is output to the user of system <b>100</b>(<b>2</b>) using audio output device <b>120</b> of system <b>100</b>(<b>2</b>). Similarly, system <b>100</b>(<b>2</b>) may capture audio from the user and send that audio within wireless signal <b>2006</b> to system <b>100</b>(<b>1</b>), where it is received by wireless receiver/transceiver <b>106</b> and transferred by microcontroller <b>102</b> to audio output device <b>120</b> for output to the user of system <b>100</b>(<b>1</b>). Thus, users of systems <b>100</b>(<b>1</b>) and <b>100</b>(<b>2</b>) may communicate using voice.
In one embodiment, systems <b>100</b>(<b>1</b>) and <b>100</b>(<b>2</b>) communicate with one another via wireless receiver/transceiver <b>106</b> to share route profiles and/or synchronize route profiles. For example, where users meet at to start a run together, system <b>100</b>(<b>1</b>) of a first user and system <b>100</b>(<b>2</b>) of a second user may synchronize to share a preconfigured route programmed into system <b>100</b>(<b>1</b>). In another example, the first and second users may synchronize target zones (e.g., running speed) where they intend to run together.
Similarly, coach station <b>2002</b> may send a wireless signal <b>2008</b> containing audio information (e.g., voice) from a user (e.g., coach) of coach station <b>2002</b> which is transferred by microcontroller <b>102</b> as data <b>2009</b> for output by audio output device <b>120</b> of system <b>100</b>(<b>1</b>) to the user of system <b>100</b>(<b>1</b>).
Coach station <b>2002</b> may also receive wireless performance information <b>2010</b> from system <b>100</b>(<b>1</b>) as determined by microcontroller <b>102</b> from one or more sensors <b>110</b>. Thus, coach station <b>2002</b> may display real-time performance data of the user of system <b>100</b>(<b>1</b>) and also provide audio feedback to that user.
In one example of operation, coach station <b>2002</b> operates within a group/social setting (e.g., a training class such as spinning, aerobics, Pilates or other) to instantly change the profiles of each of a plurality of head-mounted peripheral display systems (e.g., systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b>). For example, coach station <b>2002</b> may transition a plurality of systems <b>100</b>, <b>700</b>, <b>800</b>, <b>1200</b>, and <b>1300</b> that are assigned to a group, between stages in a workout wherein the desired metric is automatically changed for all systems in the group.
Combinations of Features
It should be clear to one skilled in the art that the above-mentioned features, and others, may be combined in embodiments of head-mounted displays. The following combinations of features are contemplated: <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0176">A. A head-mounted display for displaying information to a user without distraction, including at least one light display element positioned within a peripheral vision area of at least one eye of the user. The information is imparted to the user without the need of repositioning or refocusing the eye. The display also includes a receiver for receiving the information, and a microcontroller coupled with the receiver and the at least one light display element. The microcontroller processes the information to determine an illumination pattern based upon the information and for controlling the at least one light display element to display the illumination pattern.</li><li id="ul0002-0002" num="0177">B. The display denoted above as A, further including a boom for positioning the at least one light display element within the peripheral vision area.</li><li id="ul0002-0003" num="0178">C. The display denoted above as A or B, with a boom that includes a flexible substrate having position memory to allow the user to position the at least one light display element relative to the eye.</li><li id="ul0002-0004" num="0179">D. The display denoted above as A, B or C, further including an attachment feature integrated with the boom for securing the boom to one of eyewear and headwear of the user.</li><li id="ul0002-0005" num="0180">E. The display denoted above as A, B, C or D, further including a mounting clip for physically coupling the boom onto an item worn on a head of the user.</li><li id="ul0002-0006" num="0181">F. The display denoted above as any of A through E, with a mounting clip that is configured to physically couple with one or more of: regular glasses, sun glasses, goggles, a face mask, a hat, a strap fastened around the head of the user, a visor, a cap, a helmet, and a carrier formed to support the head-mounted performance display and worn by the user.</li><li id="ul0002-0007" num="0182">G. The display denoted above as any of A through F, with a boom and a housing coupled with the boom for containing the receiver and the microcontroller.</li><li id="ul0002-0008" num="0183">H. The display denoted above as any of A through G, further including a user interface for interacting with the user and including an actuator for allowing the user to activate and deactivate the head-mounted display.</li><li id="ul0002-0009" num="0184">I. The display denoted above as any of A through H, including a user interface that includes one or more of an accelerometer for detecting movement of the head-mounted display, a proximity sensor for detecting proximity of a hand of the user, a capacitive sensor for detecting a touch of a finger of the user, and a microphone for detecting sounds from the user.</li><li id="ul0002-0010" num="0185">J. The display denoted above as any of A through I, further including at least one sensor electrically coupled to the microcontroller for sensing activity of the user, wherein the microcontroller determines the information based at least in part upon the activity.</li><li id="ul0002-0011" num="0186">K. The display denoted above as any of A through J, including at least one sensor that is one or more of a heart rate monitor, a speed sensor, an accelerometer, a gyroscope, a pressure sensor, and a power sensor.</li><li id="ul0002-0012" num="0187">L. The display denoted above as any of A through J, including at least one sensor that is a temperature sensor for sensing ambient temperature.</li><li id="ul0002-0013" num="0188">M. The display denoted above as any of A through L, including at least one light sensor for detecting an ambient light level, wherein the microcontroller automatically adjust an intensity of the at least one light display element based upon the ambient light level.</li><li id="ul0002-0014" num="0189">N. The display denoted above as any of A through M, the microcontroller processing a signal from an accelerometer to detect user input in the form of taps to the display or a head shake of the user.</li><li id="ul0002-0015" num="0190">O. The display denoted above as any of A through N, the receiver configured to receive the information from one or more of a bike computer, an exercise equipment computer, and a motor vehicle computer.</li><li id="ul0002-0016" num="0191">P. The display denoted above as any of A through O, the receiver configured to receive the information from an exercise equipment computer, wherein exercise equipment that includes the exercise equipment computer includes one of a stationary bike, a treadmill, and an elliptical machine.</li><li id="ul0002-0017" num="0192">Q. The display denoted above as any of A through P, further including a GNSS receiver coupled with the microcontroller, the microcontroller determining one or more of speed and distance from the GNSS receiver.</li><li id="ul0002-0018" num="0193">R. The display denoted above as any of A through Q, the receiver including a wireless receiver for receiving the information wirelessly.</li><li id="ul0002-0019" num="0194">S. The display denoted above as any of A through R, the at least one light display element including a plurality of light display element formed as a linear array of light display elements that are independently controlled.</li><li id="ul0002-0020" num="0195">T. A method for displaying information to a user without distraction, including the steps of receiving the information within a microcontroller of a peripheral vision display system, and determining, within the microcontroller, an illumination pattern for at least one light display element based upon the information. The method further includes controlling the at least one light display element to display the illumination pattern wherein the at least one light display element is positioned within an area of peripheral vision of at least one eye of the user such that the information may be imparted to the user without the need to reposition or refocus the eye.</li><li id="ul0002-0021" num="0196">U. The method denoted above as T, the step of receiving including receiving data from one or more sensors within the microcontroller, and processing the data to generate the information.</li><li id="ul0002-0022" num="0197">V. The method denoted above as T or U, the step of receiving including receiving the information from a signaling device.</li><li id="ul0002-0023" num="0198">W. The method denoted above as T, U or V, further including sensing an ambient light level and adjusting an intensity of illuminated light display elements based upon the ambient light level.</li><li id="ul0002-0024" num="0199">X. A headset for displaying information within a peripheral vision area of a user, including a receiver for receiving a signal from a signaling device, and at least one light display element positioned within a peripheral vision area of at least one eye of the user such that the information is imparted to the user without the need of repositioning or refocusing the eye. The headset further includes a microcontroller coupled with the receiver and the at least one light display element for determining an illumination pattern based upon the signal and for controlling the at least one light display element to display the illumination pattern.</li><li id="ul0002-0025" num="0200">Y. The headset denoted above as X, further including a boom for positioning the at least one light display element within the peripheral vision area.</li><li id="ul0002-0026" num="0201">Z. The headset denoted above as X or Y, further including a mounting clip for attaching the headset onto headgear worn by the user.</li><li id="ul0002-0027" num="0202">AA. The headset denoted above as X, Y or Z, further including a motion sensor for detecting motion of the headset, wherein the microcontroller determines user input based upon the motion.</li><li id="ul0002-0028" num="0203">AB. The headset denoted above as X, Y, Z or AA, the microcontroller selecting one of a plurality of display modes based upon the user input</li><li id="ul0002-0029" num="0204">AC. The headset denoted above as any of X through AB, the receiver comprising a transceiver, wherein the microcontroller sends the user input to the signaling device via the transceiver.</li><li id="ul0002-0030" num="0205">AD. The headset denoted above as any of X through AC, the microcontroller interpreting detected motion resulting from the user nodding as an affirmative signal, and interpreting motion resulting from a head shake of the user as a negative signal.</li><li id="ul0002-0031" num="0206">AE. The headset denoted above as any of X through AD, including a motion sensor that is one or more of an accelerometer and a gyroscope, for detecting motion of the headset,</li><li id="ul0002-0032" num="0207">AF. A system for displaying audio information within a peripheral vision area of a user, including at least one microphone for detecting sound, at least one light display element positioned within a peripheral vision area of at least one eye of the user such that the audio information is imparted to the user without the need of repositioning or refocusing the eye, and a microcontroller. The microcontroller is coupled with the at least one microphone and the at least one light display element, and includes machine readable instructions that when executed by the microcontroller perform the steps of processing the sound to generate the audio information, generating an illumination pattern based upon the sound, and controlling the at least one light display element to display the illumination pattern.</li><li id="ul0002-0033" num="0208">AG. The system denoted above as AF, the at least one microphone comprising at least two microphones for detecting stereo sounds, wherein the microcontroller processes the stereo sounds to generate at least two illumination patterns, one for each of the stereo sounds, and controls at least two light display elements to each display a different one of the illumination patterns.</li><li id="ul0002-0034" num="0209">AH. The system denoted above as AF or AG, the at least one microphone comprising at least two directional microphones, wherein the microcontroller determines directionality of the sound and generates the illumination pattern to indicate the directionality.</li><li id="ul0002-0035" num="0210">AI. Headwear for displaying information within a peripheral vision area of a user, including a receiver integrated with the headwear for receiving a signal that represents the information, at least one light display element integrated with the headwear and positioned within a peripheral vision area of at least one eye of the user; and a microcontroller. The microcontroller determines an illumination pattern based upon the signal and for controlling the at least one light display element to display the illumination pattern wherein the information is imparted to the user without the need of repositioning or refocusing the eye.</li><li id="ul0002-0036" num="0211">AJ. Headwear denoted above as AI, further including a boom for positioning the at least one light display element within the peripheral vision area.</li><li id="ul0002-0037" num="0212">AK. Headwear denoted above as AI or AJ wherein the headwear is selected from the group consisting of a helmet, a baseball cap, headphones, sunglasses, reading glasses, prescription glasses, ski goggles, swimming goggles, and a face mask.</li></ul></li></ul>
Changes may be made in the above methods and systems without departing from the scope hereof. It should thus be noted that the matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a limiting sense. The following claims are intended to cover all generic and specific features described herein, as well as all statements of the scope of the present method and system, which, as a matter of language, might be said to fall therebetween.
Contents6
19 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19
Every citation, both waysCites: the store holds 45 of 46
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2016155000A1 | Cited by | United States of America | Search report |
| US11210772B2 | Cited by | United States of America | Applicant |
| US11200655B2 | Cited by | United States of America | Applicant |
| US2016155000A1 | Cited by | United States of America | Search report |
| US10387719B2 | Cited by | United States of America | Search report |
| US10317942B1 | Cited by | United States of America | Search report |
| US2017285685A1 | Cited by | United States of America | Pre-grant |
| US10948729B2 | Cited by | United States of America | Applicant |
| US10088867B2 | Cited by | United States of America | Search report |
| US2018004248A1 | Cited by | United States of America | Pre-grant |
| US10627862B1 | Cited by | United States of America | Search report |
| US10627862B1 | Cited by | United States of America | Search report |
| US11200656B2 | Cited by | United States of America | Applicant |
| US2016155000A1 | Cited by | United States of America | Pre-grant |
| US10877268B2 | Cited by | United States of America | Search report |
| US2005219152A1 | Cites | United States of America | Search report |
| US2006119539A1 | Cites | United States of America | Search report |
| US2006158329A1 | Cites | United States of America | Search report |
| US2006221266A1 | Cites | United States of America | Search report |
| US2007195012A1 | Cites | United States of America | Search report |
| US2009189974A1 | Cites | United States of America | Applicant |
| US2010035726A1 | Cites | United States of America | Applicant |
| US2010149073A1 | Cites | United States of America | Applicant |
| US2012021806A1 | Cites | United States of America | Search report |
| US2012068913A1 | Cites | United States of America | Search report |
| US2013249776A1 | Cites | United States of America | Search report |
| US2014123015A1 | Cites | United States of America | Search report |
| US2014146394A1 | Cites | United States of America | Search report |
| US2014313585A1 | Cites | United States of America | Search report |
| US2015015461A1 | Cites | United States of America | Search report |
| US4028725A | Cites | United States of America | Search report |
| US5162828A | Cites | United States of America | Search report |
| US6539336B1 | Cites | United States of America | Applicant |
| US6825777B2 | Cites | United States of America | Applicant |
| US7245216B2 | Cites | United States of America | Search report |
| US7542012B2 | Cites | United States of America | Search report |
| US7719769B2 | Cites | United States of America | Search report |
| US7856339B2 | Cites | United States of America | Applicant |
| US8396687B2 | Cites | United States of America | Applicant |
| US8531355B2 | Cites | United States of America | Search report |
| US8620600B2 | Cites | United States of America | Search report |
| US8705177B1 | Cites | United States of America | Search report |
| US8786675B2 | Cites | United States of America | Search report |
| US8878749B1 | Cites | United States of America | Search report |
| US8941559B2 | Cites | United States of America | Search report |
| US20050219152A1 | Cites | United States of America | Search report |
| US20060119539A1 | Cites | United States of America | Search report |
| US20060158329A1 | Cites | United States of America | Search report |
| US20060221266A1 | Cites | United States of America | Search report |
| US20070195012A1 | Cites | United States of America | Search report |
| US20090189974A1 | Cites | United States of America | Applicant |
| US20100035726A1 | Cites | United States of America | Applicant |
| US20100149073A1 | Cites | United States of America | Applicant |
| US20120021806A1 | Cites | United States of America | Search report |
| US20120068913A1 | Cites | United States of America | Search report |
| US20130249776A1 | Cites | United States of America | Search report |
| US20140123015A1 | Cites | United States of America | Search report |
| US20140146394A1 | Cites | United States of America | Search report |
| US20140313585A1 | Cites | United States of America | Search report |
| US20150015461A1 | Cites | United States of America | Search report |
10 priority claims, no other members on record
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 38505710 | United States of America | P | |
| 38505710 | United States of America | P | |
| 2011052641 | United States of America | W | |
| 2011052641 | United States of America | W | |
| 201313848650 | United States of America | A | |
| 61385057 | – | – | – |
| PCTUS2011052641 | – | – | – |
| US20100385057P | – | – | – |
| US201313848650 | – | – | – |
| WO2011US52641 | – | – | – |
82 transactions on the USPTO file
Allowed after 3 non-final rejections, 2 final rejections and 2 RCEs.
- Non-final rejections
- 3
- Final rejections
- 2
- RCEs
- 2
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Post Issue Communication - Certificate of CorrectionN423 | N423 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Response to Reasons for AllowanceREAS | REAS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Email NotificationEML_NTR | EML_NTR | |
| Filing Receipt - CorrectedFLRCPT.C | FLRCPT.C | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Advisory Action (PTOL - 303)MCTAV | MCTAV | |
| Advisory Action (PTOL-303)CTAV | CTAV | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Final ActionA.NE | A.NE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Email NotificationEML_NTR | EML_NTR | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Email NotificationEML_NTR | EML_NTR | |
| Application Is Now CompleteCOMP | COMP | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| FITF set to NO - revise initial settingFTFI | FTFI | |
| Sent to Classification ContractorPGPC | PGPC | |
| Applicant Has Filed a Verified Statement of Small Entity Status in Compliance with 37 CFR 1.27SMAL | SMAL | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Entity status set to undiscounted (initial default setting or status change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Lapse for failure to pay maintenance feesLapsedPATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITYLAPS | LAPS | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITYFEPP | FEPP | |
| Maintenance fee paymentMAFP | MAFP | |
| Certificate of correctionCC | CC | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS |
Numbers
- Publication
- 09645396
- Publication, DOCDB
- 9645396
- Publication, EPODOC
- US9645396
- Application
- 13848650
- Application, DOCDB
- 201313848650
- Application, EPODOC
- US201313848650
Titles
- English
- Peripheral vision head-mounted display for imparting information to a user without distraction and associated methods
Classification
- CPC, 12
- G02B27/0172
- G02B27/017
- G06F3/044
- G02B2027/0178
- G02C11/10
- G02B2027/014
- G02B2027/0141
- G06F3/013
- G06F3/0346
- G06F2203/04101
- G09G5/10
- G09G2360/144
- IPC, 2
- G09G5 00
- G02B27 01
- USPC, 1
- 001001000