Imaging devices including spacing members and imaging devices including tactile feedback devices
Claim Score by NHIP
Abstract
Imaging devices including spacing members and imaging devices including tactile feedback devices are disclosed. An imaging device includes a body portion, a spacing member, and a camera. The body portion extends in a lengthwise direction from a distal end of the body portion to an imaging end of the body portion. The spacing member extends from the imaging end of the body portion in the lengthwise direction. The camera is coupled to the imaging end of the body portion. When the spacing member of the imaging device is positioned in contact with a surface to be imaged by the camera and the imaging device is moved across the surface, the spacing member maintains a fixed distance between the camera and the surface as the imaging device moves across the surface to be imaged. Imaging devices including tactile feedback devices that are activated when text is recognized are also disclosed.

Term
Projected expiry 27 April 2036.
- Priority and filed
- Published
- Today
- Projected expiry
20 claims: 3 independent, 17 dependent
- 1An imaging device comprising:a body portion extending in a lengthwise direction from a distal end of the body portion to an imaging end of the body portion;a spacing member extending from the imaging end of the body portion in the lengthwise direction;and a camera coupled to the imaging end of the body portion, wherein when the spacing member of the imaging device is positioned in contact with a surface to be imaged by the camera and the imaging device is moved across the surface, the spacing member maintains a fixed distance between the camera and the surface as the imaging device moves across the surface to be imaged.
- 15An imaging device comprising:a body portion extending in a lengthwise direction from a distal end of the body portion to an imaging end of the body portion;a spacing member extending from the imaging end of the body portion in the lengthwise direction, wherein the spacing member includes a body portion engagement end and a surface contact end, the body portion engagement end engages the imaging end of the body portion, and the surface contact end is open;and a camera coupled to the imaging end of the body portion, wherein when the spacing member is positioned in contact with a surface to be imaged by the camera and the imaging device is moved across the surface, the surface contact end contacts the surface and maintains a fixed distance between the camera and the surface as the imaging device moves across the surface to be imaged.
- 18Broadest claimClaim Score 78, broad(NHIP)An imaging device comprising:a body portion;a camera coupled to the body portion, a processor communicatively coupled to the camera;a tactile feedback device coupled to the body portion and communicatively coupled to the processor;a memory module communicatively coupled to the processor;and machine readable instructions stored in the memory module that cause the imaging device to perform at least the following when executed by the processor: receive image data from the camera;and activate the tactile feedback device when text is recognized in the image data.
Independent claims3
58 paragraphs in 5 sections, as filed
TECHNICAL FIELD
0001The present specification generally relates to imaging devices and, more specifically, to imaging devices including spacing members and imaging devices including tactile feedback devices.
BACKGROUND
0002Visually impaired individuals may find it difficult to ascertain the content of printed text. Visually impaired individuals may utilize imaging devices to capture images of text. However, it may be difficult for such individuals to move such imaging devices to capture larger areas of text because the individuals may be unable to reliably and accurately image the areas due to unsteady movement of the imaging device relative to the areas to be imaged. It may also be difficult for such individuals to place such imaging devices over text fields to be imaged.
0003Accordingly, a need exists for imaging devices including spacer members and imaging devices including tactile feedback devices.
SUMMARY
0004In one embodiment, an imaging device includes a body portion, a spacing member, and a camera. The body portion extends in a lengthwise direction from a distal end of the body portion to an imaging end of the body portion. The spacing member extends from the imaging end of the body portion in the lengthwise direction. The camera is coupled to the imaging end of the body portion. When the spacing member of the imaging device is positioned in contact with a surface to be imaged by the camera and the imaging device is moved across the surface, the spacing member maintains a fixed distance between the camera and the surface as the imaging device moves across the surface to be imaged.
0005In another embodiment, an imaging device includes a body portion, a spacing member, and a camera. The body portion extends in a lengthwise direction from a distal end of the body portion to an imaging end of the body portion. The spacing member extends from the imaging end of the body portion in the lengthwise direction. The spacing member includes a body portion engagement end and a surface contact end. The body portion engagement end of the spacing member engages the imaging end of the body portion. The surface contact end of the spacing member is open. The camera is coupled to the imaging end of the body portion. When the spacing member is positioned in contact with a surface to be imaged by the camera and the imaging device is moved across the surface, the surface contact end contacts the surface and maintains a fixed distance between the camera and the surface as the imaging device moves across the surface to be imaged.
0006In yet another embodiment, an imaging device includes a body portion, a camera, a processor, a tactile feedback device, a memory module, and machine readable instructions. The camera is coupled to the body portion. The processor is communicatively coupled to the camera. The tactile feedback device is coupled to the body portion and communicatively coupled to the processor. The memory module is communicatively coupled to the processor. The machine readable instructions are stored in the memory module. When executed by the processor, the machine readable instructions cause the imaging device to receive image data from the camera, and activate the tactile feedback device when text is recognized in the image data.
0007These and additional features provided by the embodiments of the present disclosure will be more fully understood in view of the following detailed description, in conjunction with the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
The embodiments set forth in the drawings are illustrative and exemplary in nature and not intended to limit the disclosure. The following detailed description of the illustrative embodiments can be understood when read in conjunction with the following drawings, where like structure is indicated with like reference numerals and in which:
<figref idref="DRAWINGS">FIG. 1</figref> schematically depicts an imaging device including a variety of sensors and electronic components, according to one or more embodiments shown and described herein;
<figref idref="DRAWINGS">FIG. 2</figref> schematically depicts a perspective view of an imaging device including a body portion, a camera, and a spacing member, according to one or more embodiments shown and described herein;
<figref idref="DRAWINGS">FIG. 3</figref> schematically depicts an imaging device imaging a portion of a surface of an envelope that does not contain text, according to one or more embodiments shown and described herein;
<figref idref="DRAWINGS">FIG. 4</figref>, schematically depicts an imaging device imaging a portion of a surface of an envelope that contains text, according to one or more embodiments shown and described herein;
<figref idref="DRAWINGS">FIG. 5</figref> schematically depicts an imaging device providing audible output to a user, according to one or more embodiments shown and described herein; and
<figref idref="DRAWINGS">FIG. 6</figref> schematically depicts an imaging device transmitting information to a portable electronic device, according to one or more embodiments shown and described herein.
DETAILED DESCRIPTION
0015The embodiments disclosed herein include imaging devices including spacing members and imaging devices including tactile feedback devices. Referring generally to <figref idref="DRAWINGS">FIG. 2</figref>, an imaging device includes a body portion, a spacing member extending from the body portion, and a camera coupled to the imaging end of the body portion. When the spacing member of the imaging device is positioned in contact with a surface to be imaged by the camera and the imaging device is moved across the surface, the spacing member maintains a fixed distance between the camera and the surface as the imaging device moves across the surface to be imaged. Furthermore, referring generally to <figref idref="DRAWINGS">FIG. 4</figref>, an imaging device including a body portion, a camera, and a tactile feedback device coupled to the body portion activates the tactile feedback device when text is recognized in the received image data. The various imaging devices including spacing members and imaging devices including tactile feedback devices will be described in more detail herein with specific reference to the corresponding drawings.
0016Referring now to <figref idref="DRAWINGS">FIG. 1</figref>, one embodiment of an imaging device <b>100</b> is schematically depicted. The imaging device <b>100</b> includes a communication path <b>120</b>, one or more processors <b>130</b>, one or more memory modules <b>132</b>, one or more displays <b>134</b>, one or more inertial measurement units <b>136</b>, tactile input hardware <b>138</b>, one or more speakers <b>140</b>, one or more microphones <b>142</b>, one or more cameras <b>144</b>, network interface hardware <b>146</b>, one or more tactile feedback devices <b>148</b>, one or more location sensors <b>150</b>, one or more lights <b>152</b>, one or more proximity sensors <b>154</b>, one or more temperature sensors <b>156</b>, one or more batteries <b>160</b>, and one or more charging ports <b>162</b>. The various components of the imaging device <b>100</b> and the interaction thereof will be described in detail below.
0017Still referring to <figref idref="DRAWINGS">FIG. 1</figref>, the communication path <b>120</b> may be formed from any medium that is capable of transmitting a signal such as, for example, conductive wires, conductive traces, optical waveguides, or the like. Moreover, the communication path <b>120</b> may be formed from a combination of mediums capable of transmitting signals. In one embodiment, the communication path <b>120</b> comprises a combination of conductive traces, conductive wires, connectors, and buses that cooperate to permit the transmission of electrical data signals to components such as processors, memories, sensors, input devices, output devices, and communication devices. Accordingly, the communication path <b>120</b> may comprise a bus. Additionally, it is noted that the term “signal” means a waveform (e.g., electrical, optical, magnetic, mechanical or electromagnetic), such as DC, AC, sinusoidal-wave, triangular-wave, square-wave, vibration, and the like, capable of traveling through a medium. The communication path <b>120</b> communicatively couples the various components of the imaging device <b>100</b>. As used herein, the term “communicatively coupled” means that coupled components are capable of exchanging data signals with one another such as, for example, electrical signals via conductive medium, electromagnetic signals via air, optical signals via optical waveguides, and the like.
0018Each of the one or more processors <b>130</b> of the imaging device <b>100</b> may be any device capable of executing machine readable instructions. Accordingly, each of the one or more processors <b>130</b> may be a controller, an integrated circuit, a microchip, a computer, or any other computing device. Each of the one or more processors <b>130</b> is communicatively coupled to the other components of the imaging device <b>100</b> by the communication path <b>120</b>. Accordingly, the communication path <b>120</b> may communicatively couple any number of processors with one another, and allow the components coupled to the communication path <b>120</b> to operate in a distributed computing environment. Specifically, each of the components may operate as anode that may send and/or receive data.
0019Each of the one or more memory modules <b>132</b> of the imaging device <b>100</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more memory modules <b>132</b> may comprise RAM, ROM, flash memories, hard drives, or any device capable of storing machine readable instructions such that the machine readable instructions can be accessed and executed by the one or more processors <b>130</b>. The machine readable instructions may comprise logic or algorithm(s) written in any programming language of any generation (e.g., 1GL, 2GL, 3GL, 4GL, or 5GL) such as, for example, machine language that may be directly executed by the one or more processors <b>130</b>, or assembly language, object-oriented programming (OOP), scripting languages, microcode, etc., that may be compiled or assembled into machine readable instructions and stored in the one or more memory modules <b>132</b>. Alternatively, the machine readable instructions may be written in a hardware description language (HDL), such as logic implemented via either a field-programmable gate array (FPGA) configuration or an application-specific integrated circuit (ASIC), or their equivalents. Accordingly, the functionality described herein may be implemented in any conventional computer programming language, as pre-programmed hardware elements, or as a combination of hardware and software components.
0020Each of the one or more displays <b>134</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more displays <b>134</b> may be any device capable of providing visual output. Each of the one or more displays <b>134</b> may include any medium capable of transmitting an optical output such as, for example, a cathode ray tube, light emitting diodes, a liquid crystal display, a plasma display, or the like. In some embodiments, the one or more displays <b>134</b> may include a touchscreen that, in addition to providing optical information, detects the presence and location of a tactile input upon a surface of or adjacent to the display. In such embodiments, the touchscreen may receive mechanical input directly upon the optical output provided by the display. In some embodiments, the one or more displays <b>134</b> includes a three dimensional tactile display including a surface, portions of which may raise to communicate information. Additionally, it is noted that each of the one or more displays <b>134</b> can include at least one processor or memory module. Some embodiments of the imaging device <b>100</b> may not include the one or more displays <b>134</b>.
0021Each of the one or more inertial measurement units <b>136</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more inertial measurement units <b>136</b> may include one or more accelerometers and one or more gyroscopes. Each of the one or more inertial measurement units <b>136</b> transforms sensed physical movement of the imaging device <b>100</b> into a signal indicative of an orientation, a rotation, a velocity, or an acceleration of the imaging device <b>100</b>. Some embodiments of the imaging device <b>100</b> may not include the one or more inertial measurement units <b>136</b>, such as embodiments that include an accelerometer but not a gyroscope, embodiments that include a gyroscope but not an accelerometer, or embodiments that include neither an accelerometer nor a gyroscope.
0022Still referring to <figref idref="DRAWINGS">FIG. 1</figref>, the tactile input hardware <b>138</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. The tactile input hardware <b>138</b> may be any device capable of transforming mechanical pressure (e.g., the pressure from a user contacting the tactile input hardware <b>138</b>) into a data signal that can be transmitted over the communication path <b>120</b> such as, for example, a button, a switch, a knob, a microphone or the like. In some embodiments, the tactile input hardware <b>138</b> includes a power button, a volume button, an activation button, a scroll button, or the like. In some embodiments, the tactile input hardware <b>138</b> includes a pressure sensor, a touch strip, a pressure strip, or the like. Some embodiments may not include the tactile input hardware <b>138</b>.
0023Each of the one or more speakers <b>140</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more speakers <b>140</b> transforms data signals from the imaging device <b>100</b> into audible mechanical vibrations. However, it should be understood that in other embodiments the imaging device <b>100</b> may not include the one or more speakers <b>140</b>.
0024Each of the one or more microphones <b>142</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more microphones <b>142</b> may be any device capable of transforming a mechanical vibration associated with sound into an electrical signal indicative of the sound. Some embodiments may not include the one or more microphones <b>142</b>.
0025Each of the one or more cameras <b>144</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more cameras <b>144</b> may be any device having an array of sensing devices (e.g., pixels) capable of detecting radiation in an ultraviolet wavelength band, a visible light wavelength band, or an infrared wavelength band. Each of the one or more cameras <b>144</b> may have any resolution. The one or more cameras <b>144</b> may include an omni-directional camera, or a panoramic camera. In some embodiments, one or more optical components, such as a minor, fish-eye lens, or any other type of lens may be optically coupled to at least one of the one or more cameras <b>144</b>.
0026The network interface hardware <b>146</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. The network interface hardware <b>146</b> may be any device capable of transmitting and/or receiving data via a network <b>170</b>. Accordingly, the network interface hardware <b>146</b> can include a communication transceiver for sending and/or receiving any wired or wireless communication. For example, the network interface hardware <b>146</b> may include an antenna, a modem, LAN port, Wi-Fi card, WiMax card, mobile communications hardware, near-field communication hardware, satellite communication hardware and/or any wired or wireless hardware for communicating with other networks and/or devices. In some embodiments, the network interface hardware <b>146</b> includes hardware configured to operate in accordance with the Bluetooth wireless communication protocol. In some embodiments, the network interface hardware <b>146</b> may include a Bluetooth send/receive module for sending and receiving Bluetooth communications to/from a portable electronic device <b>180</b>.
0027Still referring to <figref idref="DRAWINGS">FIG. 1</figref>, in some embodiments, the imaging device <b>100</b> may be communicatively coupled to a portable electronic device <b>180</b> via the network <b>170</b>. In some embodiments, the network <b>170</b> is a personal area network that utilizes Bluetooth technology to communicatively couple the imaging device <b>100</b> and the portable electronic device <b>180</b>. In other embodiments, the network <b>170</b> may include one or more computer networks (e.g., a personal area network, a local area network, or a wide area network), cellular networks, satellite networks and/or a global positioning system and combinations thereof. Accordingly, the imaging device <b>100</b> can be communicatively coupled to the network <b>170</b> via wires, via a wide area network, via a local area network, via a personal area network, via a cellular network, via a satellite network, or the like. Suitable local area networks may include wired Ethernet and/or wireless technologies such as, for example, wireless fidelity (Wi-Fi). Suitable personal area networks may include wireless technologies such as, for example, IrDA, Bluetooth, Wireless USB, Z-Wave, ZigBee, and/or other near field communication protocols. Suitable personal area networks may similarly include wired computer buses such as, for example, USB and FireWire. Suitable cellular networks include, but are not limited to, technologies such as LTE, WiMAX, UMTS, CDMA, and GSM.
0028As stated above, the network <b>170</b> may be utilized to communicatively couple the imaging device <b>100</b> with the portable electronic device <b>180</b>. The portable electronic device <b>180</b> may include a mobile phone, a smartphone, a personal digital assistant, a camera, a dedicated mobile media player, a mobile personal computer, a laptop computer, and/or any other portable electronic device capable of being communicatively coupled with the imaging device <b>100</b>. The portable electronic device <b>180</b> may include one or more processors and one or more memories. The one or more processors can execute logic to communicate with the imaging device <b>100</b>. The portable electronic device <b>180</b> may be configured with wired and/or wireless communication functionality for communicating with the imaging device <b>100</b>. In some embodiments, the portable electronic device <b>180</b> may perform one or more elements of the functionality described herein, such as in embodiments in which the functionality described herein is distributed between the imaging device <b>100</b> and the portable electronic device <b>180</b>.
0029Still referring to <figref idref="DRAWINGS">FIG. 1</figref>, each of the one or more tactile feedback devices <b>148</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more tactile feedback devices <b>148</b> may be any device capable of providing tactile feedback to a user. The one or more tactile feedback devices <b>148</b> may include a vibration device (such as in embodiments in which tactile feedback is delivered through vibration), an air blowing device (such as in embodiments in which tactile feedback is delivered through a puff of air), or a pressure generating device (such as in embodiments in which the tactile feedback is delivered through generated pressure). Some embodiments may not include the one or more tactile feedback devices <b>148</b>.
0030Each of the one or more location sensors <b>150</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more location sensors <b>150</b> may be any device capable of generating an output indicative of a location. In some embodiments, the one or more location sensors <b>150</b> include a global positioning system (GPS) sensor, though embodiments are not limited thereto. Some embodiments may not include the one or more location sensors <b>150</b>, such as embodiments in which the imaging device <b>100</b> does not determine a location of the imaging device <b>100</b> or embodiments in which the location is determined in other ways (e.g., based on information received from the one or more cameras <b>144</b>, the one or more microphones <b>142</b>, the network interface hardware <b>146</b>, the one or more proximity sensors <b>154</b>, the one or more inertial measurement units <b>136</b> or the like).
0031Each of the one or more lights <b>152</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more lights <b>152</b> may be any device capable of outputting light, such as but not limited to a light emitting diode, an incandescent light, a fluorescent light, or the like. In some embodiments, the one or more lights <b>152</b> include a power indicator light that is illuminated when the imaging device <b>100</b> is powered on. In some embodiments, the one or more lights <b>152</b> includes an activity indicator light that is illuminated when the imaging device <b>100</b> is active or processing data. In some embodiments, the one or more lights <b>152</b> includes an illumination light for illuminating a field proximate the imaging device <b>100</b>. Some embodiments may not include the one or more lights <b>152</b>, such as embodiments in which visual output is provided via the one or more displays <b>134</b>, or embodiments in which no light output is provided.
0032Each of the one or more proximity sensors <b>154</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more proximity sensors <b>154</b> may be any device capable of outputting a proximity signal indicative of a proximity of the imaging device <b>100</b> to another object. In some embodiments, the one or more proximity sensors <b>154</b> may include a laser scanner, a capacitive displacement sensor, a Doppler effect sensor, an eddy-current sensor, an ultrasonic sensor, a magnetic sensor, an optical sensor, a radar sensor, a sonar sensor, or the like. Some embodiments may not include the one or more proximity sensors <b>154</b>, such as embodiments in which the proximity of the imaging device <b>100</b> to an object is determine from inputs provided by other sensors (e.g., the one or more cameras <b>144</b>, the one or more speakers <b>140</b>, etc.) or embodiments that do not determine a proximity of the imaging device <b>100</b> to an object.
0033Each of the one or more temperature sensors <b>156</b> is coupled to the communication path <b>120</b> and communicatively coupled to the one or more processors <b>130</b>. Each of the one or more temperature sensors <b>156</b> may be any device capable of outputting a temperature signal indicative of a temperature sensed by the one or more temperature sensors <b>156</b>. In some embodiments, the one or more temperature sensors <b>156</b> may include a thermocouple, a resistive temperature device, an infrared sensor, a bimetallic device, a change of state sensor, a thermometer, a silicon diode sensor, or the like. Some embodiments of the imaging device <b>100</b> may not include the one or more temperature sensors <b>156</b>.
0034The imaging device <b>100</b> is powered by the one or more batteries <b>160</b>, each of which is electrically coupled to the various electrical components of the imaging device <b>100</b>. Each of the one or more batteries <b>160</b> may be any device capable of storing electric energy for later use by the imaging device <b>100</b>. In some embodiments, the one or more batteries <b>160</b> may include a rechargeable battery, such as a lithium-ion battery or a nickel-cadmium battery. In embodiments in which the one or more batteries <b>160</b> include a rechargeable battery, the imaging device <b>100</b> may include the one or more charging ports <b>162</b>, each of which may be used to charge the one or more batteries <b>160</b>. Some embodiments may not include the one or more batteries <b>160</b>, such as embodiments in which the imaging device <b>100</b> is powered by solar energy or energy harvested from the environment. Some embodiments may not include the one or more charging ports <b>162</b>, such as embodiments in which the imaging device utilizes disposable batteries for power.
0035Referring now to <figref idref="DRAWINGS">FIG. 2</figref>, a perspective view of the imaging device <b>100</b> is schematically depicted. The imaging device <b>100</b> includes a body portion <b>110</b>, a spacing member <b>105</b>, a camera <b>144</b><i>a, </i>an illumination light <b>152</b><i>a, </i>a power indicator light <b>152</b><i>b, </i>a touch strip <b>138</b><i>a, </i>a power button <b>138</b><i>b, </i>a volume button <b>138</b><i>c, </i>a microphone <b>142</b><i>a, </i>and a speaker <b>140</b><i>a. </i>The body portion <b>110</b> extends in a lengthwise direction <b>190</b> from a distal end <b>110</b><i>b </i>to an imaging end <b>110</b><i>a. </i>In some embodiments, the body portion <b>110</b> is a cylindrical body portion having a maximum diameter of less than three inches. As used herein, the term “cylindrical body portion” means a body portion having a generally cylindrical shape such that each cross section of the body portion along the lengthwise direction is elliptical. In some embodiments, the body portion <b>110</b> is not cylindrically shaped, such as embodiments in which the body portion <b>110</b> has a prism shape, a cuboid shape, or the like. In some embodiments, the body portion <b>110</b> is pen-shaped such that a length L of the body portion is at least three times greater than a maximum cross-sectional width W of the body portion <b>110</b>. A pen-shaped body portion <b>110</b> may have a familiar form that avoids drawing attention to the user of the imaging device <b>100</b> from the public.
0036Still referring to <figref idref="DRAWINGS">FIG. 2</figref>, the camera <b>144</b><i>a </i>is disposed within an interior of the spacing member <b>105</b>. However, in other embodiments, the camera <b>144</b><i>a </i>may not be disposed within an interior of the spacing member <b>105</b>, such as embodiments in which the camera <b>144</b><i>a </i>is recessed within the body portion <b>110</b>. The camera <b>144</b><i>a </i>depicted in <figref idref="DRAWINGS">FIG. 2</figref> has an optical axis <b>145</b> that extends in the lengthwise direction <b>190</b>, though embodiments are not limited thereto. The camera <b>144</b><i>a </i>is included in the one or more cameras <b>144</b> described above with respect to <figref idref="DRAWINGS">FIG. 1</figref>. While the embodiment depicted in <figref idref="DRAWINGS">FIG. 2</figref> includes only one camera <b>144</b><i>a, </i>other embodiments may include more than one camera, such as embodiments that include two cameras that provide a stereoscopic viewing system.
0037Still referring to <figref idref="DRAWINGS">FIG. 2</figref>, the spacing member <b>105</b> extends from the imaging end <b>110</b><i>a. </i>In some embodiments, the spacing member <b>105</b> is a component separate from the body portion <b>110</b>. In other embodiments, the spacing member <b>105</b> and the body portion <b>110</b> are integrally formed. In the embodiment depicted in <figref idref="DRAWINGS">FIG. 2</figref>, the spacing member <b>105</b> extends from the imaging end <b>110</b><i>a </i>in the lengthwise direction <b>190</b>. In other embodiments the spacing member <b>105</b> may extend from the imaging end <b>110</b><i>a </i>at an angle relative to the lengthwise direction <b>190</b>, such as when the spacing member <b>105</b> extends from the body portion <b>110</b> at an angle relative to the body portion <b>110</b>. In some embodiments, the angle of the spacing member <b>105</b> relative to the body portion <b>110</b> may be adjustable. In some embodiments the spacing member <b>105</b> is transparent or translucent, though the spacing member <b>105</b> may be opaque in other embodiments. The spacing member <b>105</b> depicted in <figref idref="DRAWINGS">FIG. 2</figref> is a hollow truncated cone. In some embodiments, the spacing member <b>105</b> may have a shape other than a hollow truncated cone, such as embodiments in which the spacing member <b>105</b> has a cylindrical shape, a prism shape, a cuboid shape, or the like.
0038Still referring to <figref idref="DRAWINGS">FIG. 2</figref>, the spacing member <b>105</b> includes a body portion engagement end <b>105</b><i>a </i>and a surface contact end <b>105</b><i>b. </i>The body portion engagement end <b>105</b><i>a </i>engages the imaging end <b>110</b><i>a </i>of the body portion <b>110</b>. When the spacing member <b>105</b> is positioned in contact with a surface to be imaged, as will be described below with reference to <figref idref="DRAWINGS">FIGS. 3-4</figref>, the surface contact end <b>105</b><i>b </i>contacts the surface. In the embodiment depicted in <figref idref="DRAWINGS">FIG. 2</figref>, the surface contact end <b>105</b><i>b </i>is open such that the spacing member <b>105</b> does not obstruct the camera <b>144</b><i>a </i>when the camera <b>144</b><i>a </i>images a surface. However, in some embodiments the surface contact end <b>105</b><i>b </i>may not be open, such as in embodiments in which the surface contact end <b>105</b><i>b </i>is a transparent or translucent planar surface, such as plastic, glass, or the like.
0039As will be described in detail below, when the spacing member <b>105</b> of the imaging device <b>100</b> is positioned in contact with a surface to be imaged by the camera <b>144</b><i>a </i>and the imaging device <b>100</b> is moved across the surface, the spacing member <b>105</b> maintains a fixed distance between the camera <b>144</b><i>a </i>and the surface as the imaging device <b>100</b> moves across the surface. By maintaining a fixed distance between the camera <b>144</b><i>a </i>and the imaged surface, text and images may be reliably and accurately captured. Some embodiments may not include the spacing member <b>105</b>, such as embodiments in which it is not desired for the imaging device <b>100</b> to be placed in contact with a surface to be imaged by the imaging device <b>100</b>. In some embodiments, spacing members of varying lengths are provided for use with the imaging device <b>100</b>, such as in embodiments in which a longer spacing member is provided for imaging larger areas (e.g., entire documents) and a shorter spacing member is provided for imaging smaller areas (e.g., lines, paragraphs, or portions of documents).
0040Still referring to <figref idref="DRAWINGS">FIG. 2</figref>, the illumination light <b>152</b><i>a </i>is coupled to the body portion <b>110</b>. The illumination light <b>152</b><i>a </i>may output light for illuminating a surface or environment to be imaged by the one or more cameras <b>144</b>. Accordingly, in some embodiments, the illumination light <b>152</b><i>a </i>may output light in the direction of the optical axis <b>145</b> of the camera <b>144</b><i>a. </i>The power indicator light <b>152</b><i>b </i>may be illuminated when the imaging device <b>100</b> is powered on to provide a visual indication that the imaging device <b>100</b> is powered on. The illumination light <b>152</b><i>a </i>and the power indicator light <b>152</b><i>b </i>are included in the one or more lights <b>152</b> described above with respect to <figref idref="DRAWINGS">FIG. 1</figref>. Some embodiments may not include one or both of the illumination light <b>152</b><i>a </i>and the power indicator light <b>152</b><i>b. </i>
0041Still referring to <figref idref="DRAWINGS">FIG. 2</figref>, the touch strip <b>138</b><i>a, </i>the power button <b>138</b><i>b, </i>and the volume button <b>138</b><i>c </i>are coupled to and disposed on the body portion <b>110</b>. The touch strip <b>138</b><i>a </i>transforms mechanical pressure from a user contacting the touch strip <b>138</b><i>a </i>into a data signal indicative of a user applying pressure to the touch strip <b>138</b><i>a. </i>The touch strip <b>138</b><i>a </i>may be manipulated by a user for a variety of purposes, such as to activate or deactivate the imaging device <b>100</b>. When the touch strip <b>138</b><i>a </i>is used to activate the imaging device <b>100</b>, the imaging device <b>100</b> may receive a signal from the touch strip <b>138</b><i>a </i>indicative of a user applying pressure to the touch strip, and provide output indicative of text or an object recognized by the imaging device <b>100</b> in response to the received signal. Similarly, the touch strip <b>138</b><i>a </i>may be used to deactivate the imaging device <b>100</b> by ceasing to provide output indicative of text or object recognition in response to receiving a signal from the touch strip <b>138</b><i>a. </i>Further details regarding text or object recognition will be provided below. Some embodiments include opposing touch strips on opposite sides of the body portion <b>110</b>, such that a user may apply pressure to the opposing touch strips when gripping the body portion <b>110</b> at the location of the touch strips. The power button <b>138</b><i>b </i>may transform mechanical pressure from a user pressing the button into a signal indicative of the pressing of the power button <b>138</b><i>b. </i>The imaging device <b>100</b> may power on or power off in response to receiving the signal indicative of the pressing of the power button <b>138</b><i>b. </i>The volume button <b>138</b><i>c </i>may transform mechanical pressure from a user pressing the button into a signal indicative of the pressing of the volume button <b>138</b><i>c. </i>The imaging device <b>100</b> may adjust the volume of audible output provided by the speaker <b>140</b><i>a </i>in response to receiving the signal indicative of the pressing of the volume button <b>138</b><i>c. </i>The touch strip <b>138</b><i>a, </i>the power button <b>138</b><i>b, </i>and the volume button <b>138</b><i>c </i>are included in the tactile input hardware <b>138</b> described above with respect to <figref idref="DRAWINGS">FIG. 1</figref>. Some embodiments may not include one or more of the touch strip <b>138</b><i>a, </i>the power button <b>138</b><i>b, </i>and the volume button <b>138</b><i>c. </i>
0042Still referring to <figref idref="DRAWINGS">FIG. 2</figref>, the microphone <b>142</b><i>a </i>is coupled to the body portion <b>110</b>. The microphone <b>142</b><i>a </i>transforms mechanical vibration associated with sound into an electrical signal indicative of the sound. In some embodiments, the microphone <b>142</b><i>a </i>may be used by a user to interact with the imaging device <b>100</b>, such as in embodiments in which a user may issue verbal commands to the imaging device <b>100</b> to control the device. The microphone <b>142</b><i>a </i>is included in the one or more microphones <b>142</b> described above with respect to <figref idref="DRAWINGS">FIG. 1</figref>.
0043Still referring to <figref idref="DRAWINGS">FIG. 2</figref>, the speaker <b>140</b><i>a </i>is coupled to the body portion <b>110</b>. The speaker <b>140</b><i>a </i>transforms data signals from the imaging device <b>100</b> into audible output, such as audible output indicative of text or objects recognized by the imaging device <b>100</b>. The speaker <b>140</b><i>a </i>is included in the one or more speakers <b>140</b> described above with respect to <figref idref="DRAWINGS">FIG. 1</figref>.
0044It should be understood that in other embodiments, the imaging device <b>100</b> depicted in <figref idref="DRAWINGS">FIG. 2</figref> may have a different configuration or layout of components. In some embodiments, the imaging device <b>100</b> may not include at least one of the depicted components. In some embodiments, the imaging device <b>100</b> may include other components than depicted in <figref idref="DRAWINGS">FIG. 2</figref>, such as embodiments that include other components described above with respect to <figref idref="DRAWINGS">FIG. 1</figref>, such as the one or more displays <b>134</b>, the one or more temperature sensors <b>156</b>, the one or more proximity sensors <b>154</b>, or the like that are disposed on the body portion <b>110</b>. Additionally, it should be understood that in other embodiments the depicted imaging device <b>100</b> may include one or more components coupled to and housed within the body portion <b>110</b>, such as embodiments in which the one or more processors <b>130</b>, the one or more memory modules <b>132</b>, the one or more inertial measurement units <b>136</b>, the network interface hardware <b>146</b>, the one or more location sensors <b>150</b>, the one or more tactile feedback devices <b>148</b>, the one or more temperature sensors <b>156</b>, or the like are housed within the body portion <b>110</b>.
0045By way of non-limiting examples, the imaging device <b>100</b> may be used to recognize text or objects in a user's environment and provide output (e.g., audible output provided by the speaker <b>140</b><i>a, </i>output transmitted to a paired portable electronic device, etc.) in response to recognizing the text or objects. A user may utilize the imaging device <b>100</b> to take a picture of a field of view of the camera <b>144</b><i>a, </i>which may include text or an environment including one or more objects. With respect to objects in the user's environment, the user may utilize the imaging device <b>100</b> to recognize a variety of classes of objects including, but not limited to, people, tables, empty seats, doorways, walls, restrooms, and water fountains.
0046For example, the user may activate the imaging device <b>100</b> to take a picture of the field of view imaged by the camera <b>144</b><i>a </i>by applying pressure to the touch strip <b>138</b><i>a, </i>by pressing the power button <b>138</b><i>b, </i>or by moving the imaging device <b>100</b> in a manner that causes the one or more inertial measurement units <b>136</b> to generate a signal that causes the imaging device <b>100</b> to receive image data from the camera <b>144</b><i>a. </i>The image data may be received by the one or more processors <b>130</b>, which may process the image data using one or more algorithms. Any known or yet-to-be developed optical character recognition algorithms may be applied to the image data in order to recognize text included in the image data. One or more object recognition algorithms may be applied to the image data to extract objects having the particular class selected by the user. Any known or yet-to-be-developed object recognition algorithms may be used to extract the objects from the image data. Example object recognition algorithms include, but are not limited to, scale-invariant feature transform (“SIFT”), speeded up robust features (“SURF”), and edge-detection algorithms. Any known or yet-to-be developed facial recognition algorithms may also be applied to the image data to detect particular people within the environment. The optical character recognition algorithms, object recognition algorithms, or facial recognition algorithms may be stored in the one or more memory modules <b>132</b> and executed by the one or more processors <b>130</b>.
0047By way of non-limiting example, a visually impaired user may utilize the imaging device <b>100</b> to read aloud text imaged from a surface. A visually impaired user may also utilize the imaging device <b>100</b> to provide output pertaining to objects recognized by the imaging device <b>100</b> or an environment imaged by the imaging device <b>100</b>. However, uses of the imaging device <b>100</b> are not limited to applications for visually impaired individuals. For example, the imaging device <b>100</b> may be used by a user having normal vision to translate imaged text that is in a language other than the user can comprehend by: imaging the text, and providing an audible translation of the text in a language that the user can comprehend. A non-limiting example use case of a visually impaired user using the imaging device <b>100</b> to identify the sender of a piece of mail will now be described with reference to <figref idref="DRAWINGS">FIGS. 3-6</figref>.
0048Referring now to <figref idref="DRAWINGS">FIG. 3</figref>, when a user receives an envelope <b>300</b> in the mail, the user may wish to identify the sender of an envelope <b>300</b>. The user may position the imaging device <b>100</b> on a surface of the envelope <b>300</b> such that the spacing member <b>105</b> is in contact with the surface. As noted above, when the spacing member <b>105</b> is positioned in contact with the surface of the envelope <b>300</b> and the imaging device <b>100</b> is moved across the surface, the spacing member <b>105</b> maintains a fixed distance between the camera <b>144</b><i>a </i>and the surface as the imaging device <b>100</b> moves across the surface to be imaged. Maintaining a fixed distance between the camera <b>144</b><i>a </i>and the surface to be imaged may facilitate accurate and efficient imaging of the surface. This feature of the spacing member <b>105</b> may be particularly beneficial to visually impaired users who may have a difficult time maintaining a fixed distance between the camera <b>144</b><i>a </i>and the surface as the imaging device <b>100</b> is moved relative to the surface to be imaged.
0049From the initial configuration depicted in <figref idref="DRAWINGS">FIG. 3</figref>, the user may then move the imaging device <b>100</b> across the surface of the envelope <b>300</b> to identify text, images, or other information printed on the surface. For example, the user may wish to image the surface of the envelope <b>300</b> in order to determine the sender of the envelope <b>300</b>. Not being able to see what is printed on the surface of the envelope <b>300</b>, the user may start by imaging a portion <b>302</b> of the envelope <b>300</b> that does not include text, as depicted in <figref idref="DRAWINGS">FIG. 3</figref>. The imaging device <b>100</b> may receive image data from the camera <b>144</b><i>a </i>and determine that text is not present (e.g., by processing received image data with one or more optical character recognition programs executed by the one or more processors <b>130</b>). The imaging device <b>100</b> may provide output to the user indicating that text is not present in the imaged field, such as by providing an audible indication through the speaker <b>140</b><i>a </i>or activating the one or more tactile feedback devices <b>148</b> (<figref idref="DRAWINGS">FIG. 1</figref>).
0050In some embodiments, the imaging device <b>100</b> may receive image data from the camera <b>144</b><i>a </i>and activate a tactile feedback device in response to the received image data, such as to aid in the positioning of the imaging device <b>100</b> over a text field. In some embodiments, in order to facilitate the positioning of the imaging device <b>100</b> over a portion of the surface that includes text, the imaging device <b>100</b> may receive image data, determine that text is included in the image data, and activate the one or more tactile feedback devices <b>148</b> (<figref idref="DRAWINGS">FIG. 1</figref>) in response to determining that text is included in the image data. For example, when the user moves the imaging device <b>100</b> over the return address portion <b>304</b>, as shown in <figref idref="DRAWINGS">FIG. 4</figref>, the imaging device <b>100</b> may determine that text is included in image data received from the camera <b>144</b><i>a </i>and activate the one or more tactile feedback devices <b>148</b> to signal to the user that the user has now positioned the imaging device <b>100</b> over the text. In some embodiments, the one or more tactile feedback devices <b>148</b> are activated in other circumstances, such as by activating the one or more tactile feedback devices <b>148</b> when the user fails to follow a line or portion of text, or activating the one or more tactile feedback devices <b>148</b> with greater intensity as a deviation from a desired path for reading a line or portion of text increases as the user moves the imaging device <b>100</b> across a surface.
0051Once the imaging device <b>100</b> is placed over a portion of the surface that includes text, such as when the imaging device <b>100</b> is placed over and images the return address portion <b>304</b> of the envelope <b>300</b> (<figref idref="DRAWINGS">FIG. 4</figref>), the imaging device <b>100</b> may process the image data received from the camera <b>144</b><i>a </i>to recognized text included in the received image data with one or more of optical character recognition algorithms executed by the one or more processors <b>130</b>.
0052After receiving image data and recognizing text in the received image data, as described above with reference to <figref idref="DRAWINGS">FIGS. 3 and 4</figref>, the imaging device <b>100</b> may provide output indicative of the recognized text. In some embodiments, the imaging device <b>100</b> may provide audible output indicative of the recognized text, such as by outputting “the mail is from ABC Company,” (<figref idref="DRAWINGS">FIG. 5</figref>) via the speaker <b>140</b><i>a </i>of the imaging device <b>100</b> to indicate to the visually impaired user that the mail in his or her hand is from ABC Company. In some embodiments, the imaging device <b>100</b> may transmit the output indicative of the recognized text to a portable electronic device. For example, in the embodiment depicted in <figref idref="DRAWINGS">FIG. 6</figref>, the imaging device <b>100</b> may transmit the text recognized from the imaged surface of the envelope <b>300</b> to the portable electronic device <b>180</b> via the network <b>170</b>. The portable electronic device <b>180</b> may utilize the transmitted text for a variety of purposes, such as for updating a database of incoming mail, performing an automated action in response to receiving such information, or storing such information for later retrieval or use by the user. In some embodiments, the imaging device <b>100</b> may transmit a message to a headset paired to the imaging device <b>100</b> via the network interface hardware <b>146</b> that causes the headset to generate audible output, such as the “the mail is from ABC Company” message described above. In some embodiments, the functionality described herein, such as the text recognition and image processing features may distributed among the imaging device <b>100</b> and the portable electronic device <b>180</b>.
0053While the imaging device <b>100</b> was described in the context of text recognition in <figref idref="DRAWINGS">FIGS. 3-6</figref>, embodiments are not limited thereto. For example, the imaging device <b>100</b> may be used to recognize objects in a user's environment or to provide output pertaining to the environment. In such embodiments, the imaging device <b>100</b> may receive image data from the camera <b>144</b><i>a, </i>recognize an object included in the received image data, and provide output indicative of the recognized object. The output may include spatial information regarding objects that are in the user's environment as extracted from the image data. The output may indicate the presence and position of particular objects, such as empty seats, doorways, tables, people, and the like. By way of non-limiting example, the output may include the number of empty seats in the room, the presence of a particular person in a room, or the like. In some embodiments, the optical character recognition algorithms may be used to detect text on signs or other objects in a user's environment. By way of non-limiting example, image data of a user's environment captured by the camera may include an “EXIT” sign. The one or more processors <b>130</b> may detect and extract the word and location of the “EXIT” sign in the environment and provide audible output that the exit sign was detected.
0054Referring once again to <figref idref="DRAWINGS">FIG. 1</figref>, some embodiments that include the one or more inertial measurement units <b>136</b> may detect an orientation of the imaging device <b>100</b> with the one or more inertial measurement units <b>136</b>, and determine an operating mode for the imaging device <b>100</b> based on the detected orientation. For example, when an orientation in which the imaging device <b>100</b> is generally upright or the camera <b>144</b><i>a </i>is directed generally downward is detected, the operational mode may be determined as a text recognition mode, such as described above with respect to <figref idref="DRAWINGS">FIGS. 3-6</figref>. When an orientation in which the imaging device <b>100</b> is generally horizontal or the camera <b>144</b><i>a </i>is directed horizontally or upward is detected, the operational mode may be determined to be an objection recognition mode or an environmental awareness mode in which the imaging device <b>100</b> recognizes objects imaged by the camera <b>144</b><i>a, </i>recognizes features of an environment imaged by the camera <b>144</b><i>a, </i>and/or provides output based on the recognized objects or recognized environmental features. The one or more inertial measurement units <b>136</b> may also be used for gesture-based control of the imaging device <b>100</b>, such as by activating or deactivating the imaging device <b>100</b> in response to input received from the one or more inertial measurement units <b>136</b>, or changing the functionality of the imaging device <b>100</b> in response to input received from the one or more inertial measurement units <b>136</b>.
0055Still referring to <figref idref="DRAWINGS">FIG. 1</figref>, in some embodiments, the imaging device <b>100</b> may also provide navigational assistance to a user. For example, the imaging device <b>100</b> may determine a location of the user in an environment (e.g., based on information received from the one or more location sensors <b>150</b>, image data received from the one or more cameras <b>144</b>, or the like), and generate a path for a user to traverse. In some embodiments, the imaging device <b>100</b> may access map data (e.g., data relating to external maps, such as roads, footpaths, buildings, or the like) stored in the one or more memory modules <b>132</b> in order to generate the path. The imaging device <b>100</b> may then provide audible output via the one or more speakers <b>140</b> and/or the one or more tactile feedback devices <b>148</b> to guide the user along the determined path. For example, the imaging device <b>100</b> may provide audible output with respect to upcoming turns, distance to travel in a forward direction before the next turn, obstacles, hazards, landmarks, or the like.
0056It should be understood that embodiments described herein are directed to imaging devices including spacing members and imaging devices including tactile feedback devices. When the spacing member of the imaging device is positioned in contact with a surface to be imaged by the camera and the imaging device is moved across the surface, the spacing member maintains a fixed distance between the camera and the surface as the imaging device moves across the surface. By maintaining a fixed distance between the camera and the imaged surface, text and images may be reliably and accurately captured. Furthermore, imaging devices including tactile feedback devices that are activated when text is recognized in an imaged field of view may allow a user to position the imaging device over a text field. Such imaging devices may be useful to visually impaired individuals who may have difficulty maintaining a fixed distance between a camera and a surface to be imaged, or who may have difficulty placing the imaging device over a text field. Moreover, the imaging devices described herein may also be portable and lightweight, allowing for frequent and non-taxing use by a visually impaired individual.
0057It is noted that the terms “substantially” and “about” may be utilized herein to represent the inherent degree of uncertainty that may be attributed to any quantitative comparison, value, measurement, or other representation. These terms are also utilized herein to represent the degree by which a quantitative representation may vary from a stated reference without resulting in a change in the basic function of the subject matter at issue.
0058While particular embodiments have been illustrated and described herein, it should be understood that various other changes and modifications may be made without departing from the spirit and scope of the claimed subject matter. Moreover, although various aspects of the claimed subject matter have been described herein, such aspects need not be utilized in combination. It is therefore intended that the appended claims cover all such changes and modifications that are within the scope of the claimed subject matter.
Contents5
7 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US10583359B2 | Cited by | United States of America | Applicant |
| US10261582B2 | Cited by | United States of America | Applicant |
| US10556175B2 | Cited by | United States of America | Applicant |
| US10416770B2 | Cited by | United States of America | Applicant |
| US10162416B2 | Cited by | United States of America | Applicant |
| US10359851B2 | Cited by | United States of America | Applicant |
| US10147460B2 | Cited by | United States of America | Applicant |
| US10564725B2 | Cited by | United States of America | Applicant |
| US10401962B2 | Cited by | United States of America | Applicant |
| US10514761B2 | Cited by | United States of America | Applicant |
| US11579697B2 | Cited by | United States of America | Applicant |
| US10254836B2 | Cited by | United States of America | Applicant |
| US10248212B2 | Cited by | United States of America | Applicant |
| US10366584B2 | Cited by | United States of America | Applicant |
| US10216277B2 | Cited by | United States of America | Applicant |
| US10248850B2 | Cited by | United States of America | Applicant |
| US10209776B2 | Cited by | United States of America | Applicant |
| US11272283B2 | Cited by | United States of America | Applicant |
| US10620706B2 | Cited by | United States of America | Applicant |
| US10353471B2 | Cited by | United States of America | Applicant |
| US10254838B2 | Cited by | United States of America | Applicant |
| US10234944B2 | Cited by | United States of America | Applicant |
| US10269222B2 | Cited by | United States of America | Applicant |
| US10210724B2 | Cited by | United States of America | Applicant |
| US10269392B2 | Cited by | United States of America | Applicant |
| US10665067B2 | Cited by | United States of America | Applicant |
| US10692337B2 | Cited by | United States of America | Applicant |
| US10228764B2 | Cited by | United States of America | Applicant |
| US10185396B2 | Cited by | United States of America | Applicant |
| US10613636B2 | Cited by | United States of America | Applicant |
| US10194078B2 | Cited by | United States of America | Applicant |
| US10409380B2 | Cited by | United States of America | Applicant |
| US10720189B2 | Cited by | United States of America | Applicant |
| US10725548B2 | Cited by | United States of America | Applicant |
| US10613628B2 | Cited by | United States of America | Applicant |
| US10477298B2 | Cited by | United States of America | Applicant |
| US10109161B2 | Cited by | United States of America | Applicant |
| US10296092B2 | Cited by | United States of America | Applicant |
| US2008210474A1 | Cites | United States of America | Pre-grant |
| US2008248673A1 | Cites | United States of America | Pre-grant |
| US2008316178A1 | Cites | United States of America | Pre-grant |
| US2014270528A1 | Cites | United States of America | Pre-grant |
| US2015062024A1 | Cites | United States of America | Pre-grant |
| US5543972A | Cites | United States of America | Pre-grant |
2 members in 1 office
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 201414567036 | United States of America | A | |
| US201414567036 | – | – | – |
Members2
| Document | Office | Kind | |
|---|---|---|---|
| US2016171908A1 | United States of America | A1 | |
| US9870718B2 | United States of America | B2 |
39 transactions on the USPTO file
Allowed after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Maintenance Fee Reminder MailedREM. | REM. | |
| Payment of Maintenance Fee, 4th Year, Large EntityM1551 | M1551 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Miscellaneous Incoming LetterLET. | LET. | |
| Response after Non-Final ActionA... | A... | |
| Mail Interview Summary - Applicant Initiated - TelephonicMEXAT | MEXAT | |
| Interview Summary - Applicant Initiated - TelephonicEXAT | EXAT | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Sent to Classification ContractorPGPC | PGPC | |
| FITF set to YES - revise initial settingFTFS | FTFS | |
| Application Is Now CompleteCOMP | COMP | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Cleared by OIPE CSRL194 | L194 | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Patent Term Adjustment - Ready for ExaminationPTA.RFE | PTA.RFE | |
| Applicants have given acceptable permission for participating foreignAPPERMS | APPERMS | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| PTO/SB/69-Authorize EPO Access to Search ResultsSREXR141 | SREXR141 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Entity status set to undiscounted (initial default setting or status change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Lapse for failure to pay maintenance feesLapsedPATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYLAPS | LAPS | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Maintenance fee paymentMAFP | MAFP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS | |
| AssignmentAS | AS |
Numbers
- Publication
- 20160171908
- Publication, DOCDB
- 2016171908
- Publication, EPODOC
- US2016171908
- Application
- 14567036
- Application, DOCDB
- 201414567036
- Application, EPODOC
- US201414567036
Titles
- English
- IMAGING DEVICES INCLUDING SPACING MEMBERS AND IMAGING DEVICES INCLUDING TACTILE FEEDBACK DEVICES
Patent term adjustment
- A delay
- +467 daysthe office missed an examination deadline
- B delay
- +36 dayspendency past three years
- Net adjustment
- 503 days
Classification
- CPC, 4
- G09B21/008
- G09B21/007
- H04N7/183
- G09B21/003
- IPC, 2
- G09B21 00
- H04N7 18
- USPC, 1
- 348062000