Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
Claim Score by NHIP
Abstract
Provided are an augmented reality, virtual reality and mixed reality eyeglass communication device and a method for facilitating shopping, payments and multimedia capture using an eyeglass communication device. The eyeglass communication device may comprise a frame, and a right earpiece and a left earpiece connected to the frame. The eyeglass communication device may comprise a processor configured to receive one or more commands of a user, perform operations associated with the commands of the user, receive product information, and process the product information. The eyeglass communication device may comprise a display connected to the frame and configured to display data received from the processor. The eyeglass communication device may comprise a transceiver electrically connected to the processor and configured to receive and transmit data over a wireless network. The eyeglass communication device may comprise a Subscriber Identification Module card slot, a camera, an earphone, a microphone, and a charging unit.

Term
Projected expiry 1 August 2035.
- Priority
- Filed
- Published
- Today
- Projected expiry
20 claims: 3 independent, 17 dependent
- 1An augmented reality, virtual reality and mixed reality eyeglass communication device comprising:a frame having a first end and a second end;a right earpiece and a left earpiece, wherein the right earpiece is connected to the first end of the frame and the left earpiece is connected to the second end of the frame;a camera disposed on the frame, the right earpiece or the left earpiece, the camera being configured to track a hand gesture command of a user;a processor disposed in the frame, the right earpiece or the left earpiece and configured to receive one or more commands of the user, perform operations associated with the commands of the user, process the hand gesture command tracked by the camera, receive product information, and process the product information;at least one display connected to the frame and configured to display data received from the processor, the display comprising: an optical prism element embedded in the display, and a projector embedded in the display, the projector being configured to project the data received from the processor to the optical prism element and to project the data received from the processor to a surface in environment of the user, the data including a virtual touch screen environment;a transceiver electrically coupled to the processor and configured to receive and transmit data over a wireless network;a Subscriber Identification Module (SIM) card slot disposed in the frame, the right earpiece or the left earpiece and configured to receive a SIM card;at least one earphone disposed on the right earpiece or the left earpiece;a microphone configured to sense a voice command of the user;and a charging unit connected to the frame, the right earpiece or the left earpiece;at least one electroencephalograph sensor configured to sense brain activity of the user;a gesture recognition unit including at least three dimensional gesture recognition sensors, a range finder, a depth camera, and a rear projection system, the gesture recognition unit being configured to track the hand gesture command of the user, the hand gesture command being processed by the processor, wherein the hand gesture command is associated with vertices and lines of a hand of the user, the vertices and lines being in a specific relation;and wherein the augmented reality eyeglass communication device is configured to perform phone communication functions;wherein further comprising sensors, wherein the sensors includes a motion sensing unit configured to sense head movement of the user, and an eye-tracking unit configured to track eye movement of the user;wherein the voice command includes a voice memo, and a voice message;wherein the microphone is configured to sense voice data and to transmit the voice data to the processor;wherein the charging unit includes one or more solar cells configured to charge the device, a wireless charger accessory, and a vibration charger configured to charge the devices using natural movement vibrations;wherein the user interacts with the data projected to the surface in environment, the interaction being performed through the hand gesture command;wherein the gesture recognition unit is configured to identify multiple hand gesture commands of the user or gestures of a human, hand gesture commands of the user or gestures of a human including depth data, finger data, and hand data;wherein the processing of the hand gesture command includes correlating of the hand gesture command with a template from a template database;wherein the rear projector system is configured to project the virtual touch screen environment in front of the user, the hand gesture command being captured combined with the virtual touch screen environment;wherein the display is configured as a prescription lens, a non-prescription lens, a safety lens, a lens without diopters, or a bionic contact lens, the bionic contact lens including integrated circuitry for wireless communication;wherein the display includes a see-through material to display simultaneously a picture of real world and data requested by the user;wherein the camera is configured to capture front-, rear-, top-, left- or right-side area around the device;wherein the camera is configured to simultaneously perform video recording and image capturing.
- 17A method for facilitating shopping using an augmented reality eyeglass communication device, the augmented reality, virtual reality and mixed reality eyeglass communication device comprising the augmented reality eyeglass communication device, and the method comprising:receiving, by a processor of the augmented reality eyeglass communication device, product information associated with products comprised in a list of products of a user;receiving, by the processor, location information associated with location of the user;searching, based on the product information, by the processor, a database associated with a store for availability, location and pricing information associated with the products;receiving, by the processor, the availability, location and pricing information associated with the product;and displaying, by a display of the augmented reality eyeglass communication device, the availability, location and pricing information associated with the product;further comprising: plotting a route for the user on a map of the store based on the availability, location and pricing information associated with the product and the location information associated with the location of the user;and displaying, by the display, the route for the user;further comprising: receiving, by the processor, a command of the user to provide description of a product present in the store;receiving, by the processor, information associated with the product present in the store, wherein receiving information associated with the product present in the store includes taking a picture of the product, scanning a barcode of the product and reading a RFID tag of the product;processing, by the processor, the received information associated with the product present in the store;searching, based on the received information associated with the product, by the processor, the description of the product in a database available in a network;receiving, by the processor, the description of the product;and displaying, by the display, the description of the product present in the store;further comprising: tracking, by a camera, a hand gesture command of the user;processing, by the processor, the hand gesture command of the user;and projecting, by a projector, the description of the product to a surface in environment of the user according to the hand gesture command, wherein the surface in environment of the user includes a vertical surface in environment of the user, a horizontal surface in environment of the user, an inclined surface in environment of the user, a surface of a physical object in environment of the user, and a part of a body of the user.
- 20Broadest claimClaim Score 66, broad(NHIP)A non-transitory computer-readable medium comprising instructions, which when executed by one or more processors, perform the following operations:receive product information associated with products comprised in a list of products of a user;receive location information associated with location of the user;search a database associated with a store for availability, location and pricing information associated with the products;receive the availability, location and pricing information associated with the product;and display the availability, location and pricing information associated with the product.
Independent claims3
150 paragraphs in 6 sections, as filed
CROSS-REFERENCES TO RELATED APPLICATIONS
0001This application is a continuation-in-part of U.S. patent application Ser. No. 29/587,752, entitled “WEARABLE ARTIFICIAL INTELLIGENCE (AI) DATA PROCESSING, AUGMENTED REALITY, VIRTUAL REALITY, AND MIXED REALITY COMMUNICATION EYEGLASS INCLUDING MOBILE PHONE AND MOBILE COMPUTING VIA VIRTUAL TOUCH SCREEN GESTURE CONTROL AND NEURON COMMAND ALL IN ONE DEVICE”, filed Dec. 15, 2016, U.S. patent application Ser. No. 29/587,581, entitled “ARTIFICIAL INTELLIGENCE (AI) DATA PROCESSING, MESSAGING, CALLING, DIGITAL MULTIMEDIA CAPTURE AND PAYMENT TRANSACTIONS DEVICE”, filed Dec. 14, 2016, U.S. patent application Ser. No. 29/587,388, entitled “AMPHIBIOUS VERTICAL TAKEOFF AND LANDING (VTOL) UNMANNED DEVICE WITH AT (ARTIFICIAL INTELLIGENCE) DATA PROCESSING MOBILE AND WEARABLE APPLICATIONS APPARATUS, SAME AS SUPERSONIC JET DRONE, SUPERSONIC JET PLANE, PRIVATE SUPERSONIC VTOL JET, PERSONAL JET AIRCRAFT WITH GSP VTOL JET ENGINES AND SELF-JET CHARGED AND SOLAR CELLS POWERED HYBRID SUPER FIVE LAYERS EMERGENCY SYSTEMS JET VEHICLE ALL IN ONE (ELECTRICITY/FUEL)”, filed Dec. 13, 2016, U.S. patent application Ser. No. 15/350,458, entitled “AMPHIBIOUS VERTICAL TAKEOFF AND LANDING (VTOL) UNMANNED DEVICE WITH AI (ARTIFICIAL INTELLIGENCE) DATA PROCESSING MOBILE AND WEARABLE APPLICATIONS APPARATUS, SAME AS JET DRONE, JET FLYING CAR, PRIVATE VTOL JET, PERSONAL JET AIRCRAFT WITH GSP VTOL JET ENGINES AND SELF-JET CHARGED AND SOLAR CELLS POWERED HYBRID SUPER JET ELECTRICAL CAR ALL IN ONE (ELECTRICITY/FUEL)”, filed Nov. 14, 2016, U.S. patent application Ser. No. 29/572,722, entitled “AMPHIBIOUS VTOL, HOVER, BACKWARD, LEFTWARD, RIGHTWARD, TURBOJET, TURBOFAN, ROCKET ENGINE, RAMJET, PULSE JET, AFTERBURNER, AND SCRAMJET SINGLE/DUAL ALL IN ONE JET ENGINE (FUEL/ELECTRICITY) WITH ONBOARD SELF COMPUTER BASED AUTONOMOUS MODULE GIMBALED SWIVEL PROPULSION (GSP) SYSTEM DEVICE, SAME AS DUCTED FAN (FUEL/ELECTRICITY)”, filed on Jul. 29, 2016, U.S. patent application Ser. No. 29/567,712, entitled “AMPHIBIOUS VTOL, HOVER, BACKWARD, LEFTWARD, RIGHTWARD, TURBOJET, TURBOFAN, ROCKET ENGINE, RAMJET, PULSE JET, AFTERBURNER, AND SCRAMJET ALL IN ONE JET ENGINE (FUEL/ELECTRICITY) WITH ONBOARD SELF COMPUTER BASED AUTONOMOUS GIMBALED SWIVEL PROPULSION SYSTEM DEVICE”, filed on Jun. 10, 2016, U.S. patent application Ser. No. 14/940,379, entitled “AMPHIBIOUS VERTICAL TAKEOFF AND LANDING UNMANNED SYSTEM AND FLYING CAR WITH MULTIPLE AERIAL AND AQUATIC FLIGHT MODES FOR CAPTURING PANORAMIC VIRTUAL REALITY VIEWS, INTERACTIVE VIDEO AND TRANSPORTATION WITH MOBILE AND WEARABLE APPLICATION”, filed on Nov. 13, 2015, U.S. patent application Ser. No. 15/345,349, entitled “SYSTEMS AND METHODS FOR MESSAGING, CALLING, DIGITAL MULTIMEDIA CAPTURE AND PAYMENT TRANSACTIONS”, filed on Nov. 7, 2016, which is a continuation-in-part of U.S. patent application Ser. No. 14/957,644, entitled “SYSTEMS AND METHODS FOR MOBILE APPLICATION, WEARABLE APPLICATION, TRANSACTIONAL MESSAGING, CALLING, DIGITAL MULTIMEDIA CAPTURE AND PAYMENT TRANSACTIONS”, filed on Dec. 3, 2015, which is a continuation-in-part of U.S. patent application Ser. No. 14/815,988, entitled “SYSTEMS AND METHODS FOR MOBILE APPLICATION, WEARABLE APPLICATION, TRANSACTIONAL MESSAGING, CALLING, DIGITAL MULTIMEDIA CAPTURE AND PAYMENT TRANSACTIONS”, filed on Aug. 1, 2015, which claims priority to U.S. patent application Ser. No. 13/760,214, entitled “WEARABLE PERSONAL DIGITAL DEVICE FOR FACILITATING MOBILE DEVICE PAYMENTS AND PERSONAL USE”, filed on Feb. 6, 2013, which is a continuation-in-part of U.S. patent application Ser. No. 10/677,098, entitled “EFFICIENT TRANSACTIONAL MESSAGING BETWEEN LOOSELY COUPLED CLIENT AND SERVER OVER MULTIPLE INTERMITTENT NETWORKS WITH POLICY BASED ROUTING”, filed on Sep. 30, 2003, which claims priority to Provisional Application No. 60/415,546, entitled “DATA PROCESSING SYSTEM”, filed on Oct. 1, 2002, which are incorporated herein by reference in their entirety.
FIELD
0002This application relates generally to wearable personal digital interfaces and, more specifically, to an augmented reality eyeglass communication device.
BACKGROUND
0003Typically, a person who goes shopping attends several stores to compare assortment of goods, prices and availability of desired products. Handheld digital devices, e.g. smartphones, have become efficient assistants for performing shopping. The person may, for example, create a list of products to buy and may save this list on a smartphone. When being at the store, the smartphone may be used to scan product barcodes to retrieve product information or perform payment based on payment information encoded in the product barcodes. However, long-term constant holding of the smartphone in a hand may cause inconvenience to the person who performs shopping at the store. For example, when the person wants to take a big size product, the person firstly needs to empty his hands and, therefore, to put the smartphone into his pocket. After inspecting the desired product, the person will need to get the smartphone out of the pocket in order to scan a barcode of the desired product or to see what products left in the list of products to buy. In addition to that, when using a smartphone in a store, a person needs to repeatedly look at a display of the smartphone, for example, to check a list of products stored on the smartphone or to read product information retrieved from a product barcode. Therefore, time spent on shopping may increase.
SUMMARY
0004This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
0005Provided are an augmented reality eyeglass communication device for facilitating shopping and a method for facilitating shopping using the augmented reality eyeglass communication device.
0006In certain embodiments, the augmented reality eyeglass communication device may comprise a frame having a first end and a second end, and a right earpiece connected to the first end of the frame and a left earpiece connected to the second end of the frame. Furthermore, the eyeglass communication device may comprise a processor disposed in the frame, the right earpiece or the left earpiece and configured to receive one or more commands of a user, perform operations associated with the commands of the user, receive product information, and process the product information. The eyeglass communication device may comprise a display connected to the frame and configured to display data received from the processor. The display may include an optical prism element and a projector embedded in the display. The projector may be configured to project the data received from the processor to the optical prism element. In addition to that, the eyeglass communication device may comprise a transceiver electrically connected to the processor and configured to receive and transmit data over a wireless network. In the frame, the right earpiece or the left earpiece of the eyeglass communication device a Subscriber Identification Module (SIM) card slot may be disposed. The eyeglass communication device may comprise a camera disposed on the frame, the right earpiece or the left earpiece, at least one earphone disposed on the right earpiece or the left earpiece, a microphone configured to sense a voice command of the user, and a charging unit connected to the frame, the right earpiece or the left earpiece. The eyeglass communication device may be configured to perform phone communication functions.
0007In certain embodiments, a method for facilitating shopping using an augmented reality eyeglass communication device may include receiving, by a processor of the eyeglass communication device, product information associated with products comprised in a list of products of a user. Furthermore, the method may involve receiving, by the processor, location information associated with location of the user. In further embodiments, the method may include searching, based on the product information, by the processor, a database associated with a store for availability, location and pricing information associated with the products. The method may involve receiving, by the processor, the availability, location and pricing information associated with the product, and displaying, by a display of the eyeglass communication device, the availability, location and pricing information associated with the product.
0008In further exemplary embodiments, modules, subsystems, or devices can be adapted to perform the recited steps. Other features and exemplary embodiments are described below.
BRIEF DESCRIPTION OF DRAWINGS
0009Embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
0010<figref idref="DRAWINGS">FIG. 1</figref> illustrates an environment within which an augmented reality eyeglass communication device for facilitating shopping and a method for facilitating shopping using an augmented reality eyeglass communication device may be implemented, in accordance with an example embodiment.
0011<figref idref="DRAWINGS">FIG. 2</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0012<figref idref="DRAWINGS">FIG. 3A</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0013<figref idref="DRAWINGS">FIG. 3B</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0014<figref idref="DRAWINGS">FIG. 4A</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0015<figref idref="DRAWINGS">FIG. 4B</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0016<figref idref="DRAWINGS">FIG. 5</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0017<figref idref="DRAWINGS">FIG. 6A</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0018<figref idref="DRAWINGS">FIG. 6B</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0019<figref idref="DRAWINGS">FIG. 7</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0020<figref idref="DRAWINGS">FIG. 8</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0021<figref idref="DRAWINGS">FIG. 9</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0022<figref idref="DRAWINGS">FIG. 10</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0023<figref idref="DRAWINGS">FIG. 11</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0024<figref idref="DRAWINGS">FIG. 12</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0025<figref idref="DRAWINGS">FIG. 13</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0026<figref idref="DRAWINGS">FIG. 14</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0027<figref idref="DRAWINGS">FIG. 15</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0028<figref idref="DRAWINGS">FIG. 16</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0029<figref idref="DRAWINGS">FIG. 17</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0030<figref idref="DRAWINGS">FIG. 18</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0031<figref idref="DRAWINGS">FIG. 19</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0032<figref idref="DRAWINGS">FIG. 20</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0033<figref idref="DRAWINGS">FIG. 21</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0034<figref idref="DRAWINGS">FIG. 22</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0035<figref idref="DRAWINGS">FIG. 23</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0036<figref idref="DRAWINGS">FIG. 24</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0037<figref idref="DRAWINGS">FIG. 25</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0038<figref idref="DRAWINGS">FIG. 26</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0039<figref idref="DRAWINGS">FIG. 27</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0040<figref idref="DRAWINGS">FIG. 28</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0041<figref idref="DRAWINGS">FIG. 29</figref> is a schematic representation of an augmented reality eyeglass communication device for facilitating shopping, in accordance with an example embodiment.
0042<figref idref="DRAWINGS">FIG. 30</figref> shows a schematic representation of tracking a hand gesture command performed by an augmented reality eyeglass communication device.
0043<figref idref="DRAWINGS">FIG. 31</figref> is a flow chart illustrating a method for facilitating shopping using an augmented reality eyeglass communication device, in accordance with an example embodiment.
0044<figref idref="DRAWINGS">FIG. 32</figref> shows a payment performed by an augmented reality eyeglass communication device, in accordance with an example embodiment.
0045<figref idref="DRAWINGS">FIG. 33</figref> is a schematic diagram illustrating an example of a computer system for performing any one or more of the methods discussed herein.
DETAILED DESCRIPTION
0046In the following description, numerous specific details are set forth in order to provide a thorough understanding of the presented concepts. The presented concepts may be practiced without some or all of these specific details. In other instances, well known process operations have not been described in detail so as to not unnecessarily obscure the described concepts. While some concepts will be described in conjunction with the specific embodiments, it will be understood that these embodiments are not intended to be limiting.
0047An augmented reality eyeglass communication device for facilitating shopping and a method for facilitating shopping using the augmented reality eyeglass communication device are described herein. The eyeglass communication device allows a user to visually access information by simply looking trough eyeglass lenses configured as a display. Being worn by the user, the eyeglass communication device may provide for convenient carrying in many situations and environments, such as physical activity, sports, travels, shopping, telephone conversations, leisure time, and so forth.
0048Disposing a processor, a transmitter, and SIM card slot in a structure of the eyeglass communication device, as well as insertion of a SIM card into the SIM card slot may allow the eyeglass communication device to perform communication functions of a mobile phone, e.g. a smartphone, and display data on a display of the eyeglass communication device. In this case, a user may review the data simply looking through lenses of the eyeglass communication device. The user may store information in a memory unit of the eyeglass communication device and review the information on the display of the eyeglass communication device. Furthermore, with the help of the eyeglass communication device, the user may perform a number of functions of the smartphone, such as accept or decline phone calls, make phone calls, listen to the music stored in the memory unit of the eyeglass communication device, a remote device or accessed via the Internet, view maps, check for weather forecasts, control remote devices to which the eyeglass communication device is currently connected, such as a computer, a TV, an audio or video system, and so forth. Additionally, the eyeglass communication device may allow the user to make a photo or video and upload it to a remote device or to the Internet.
0049An augmented reality eyeglass communication device may be a useful tool for facilitating shopping. In particular, the user may use the eyeglass communication device to scan an image, a barcode of a product or to read a RFID tag of the product. The information retrieved from the image, barcode or RFID tag may be displayed to the user. Therefore, the user may look at the product in a store and may see real-world environment, i.e. the product itself, augmented by information about the product displayed on a display of the eyeglass communication device. The display of the eyeglass communication device may be configured as an eyeglass lens, such as a prescription lens or a lens without diopters, and may include an optical prism element and a projector embedded into the display. Additionally, the display may be configured as a bionic contact lens, which may include integrated circuitry for wireless communications. In some embodiments, the camera lens may be configured to track eye movements. The tracked eye movements may be transmitted to the processor and interpreted as a command.
0050The projector may project an image received from a processor of the eyeglass communication device to the optical prism element. The optical prism element may be configured so as to focus the image to a retina of the user.
0051The eyeglass communication device may be configured to sense and process voice commands of the user. Therefore, the user may give voice commands to the eyeglass communication device and immediately see data associated with the commands on the display of the eyeglass communication device. The commands of the user may be processed by a processor of the eyeglass communication device or may be sent to a remote device, such as a search server, and information received from the remote device may be displayed on the display of the eyeglass communication device.
0052Additionally, the device may be used as a hands-free mobile computing device, to synchronize with one or more external devices in real time, track a geographical location of the one or more external devices in real time, and provide communication capabilities using an embedded emergency button configured to provide a medical alert signal, a request for help signal, or another informational signal.
0053Referring now to the drawings, <figref idref="DRAWINGS">FIG. 1</figref> illustrates an environment <b>100</b> within which a user <b>105</b> wearing an augmented reality eyeglass communication device <b>200</b> for facilitating shopping and methods for facilitating shopping using an augmented reality eyeglass communication device <b>200</b> can be implemented. The environment <b>100</b> may include a user <b>105</b>, an eyeglass communication device <b>200</b>, a communication network <b>110</b>, a store server <b>115</b>, a financial organization server <b>120</b>, and a communication server <b>125</b>.
0054The device <b>200</b> may communicate with the store server <b>115</b>, the financial organization server <b>120</b>, and the communication server <b>125</b> via the network <b>110</b>. Furthermore, the device <b>200</b> may retrieve information associated with a product <b>130</b> by, for example, scanning an image or a barcode of the product <b>130</b> or reading an RFID tag of the product <b>130</b>.
0055In various embodiments, the barcode may include a one-dimensional barcode, a two-dimensional barcode, a three-dimensional barcode, a quick response code, a snap tag code, and other machine readable codes. The barcode may encode payment data, personal data, credit card data, debit card data, gift card data, prepaid card data, bank checking account data, digital cash data, and so forth. Additionally, the barcode may include a link to a web-resource, a payment request, advertising information, and other information. The barcode may encode electronic key data and be scannable by a web-camera of an access control system. The scanned data may be processed by the access control system and access to an item related to the access control system may be granted based on the processing.
0056The network <b>110</b> may include the Internet or any other network capable of communicating data between devices. Suitable networks may include or interface with any one or more of, for instance, a local intranet, a PAN (Personal Area Network), a LAN (Local Area Network), a WAN (Wide Area Network), a MAN (Metropolitan Area Network), a virtual private network (VPN), a storage area network (SAN), a frame relay connection, an Advanced Intelligent Network (AIN) connection, a synchronous optical network (SONET) connection, a digital T1, T3, E1 or E3 line, Digital Data Service (DDS) connection, DSL (Digital Subscriber Line) connection, an Ethernet connection, an ISDN (Integrated Services Digital Network) line, a dial-up port such as a V.90, V.34 or V.34bis analog modem connection, a cable modem, an ATM (Asynchronous Transfer Mode) connection, or an FDDI (Fiber Distributed Data Interface) or CDDI (Copper Distributed Data Interface) connection. Furthermore, communications may also include links to any of a variety of wireless networks, including WAP (Wireless Application Protocol), GPRS (General Packet Radio Service), GSM (Global System for Mobile Communication), CDMA (Code Division Multiple Access) or TDMA (Time Division Multiple Access), cellular phone networks, GPS (Global Positioning System), CDPD (cellular digital packet data), RIM (Research in Motion, Limited) duplex paging network, Bluetooth radio, or an IEEE 802.11-based radio frequency network. The network <b>110</b> can further include or interface with any one or more of an RS-232 serial connection, an IEEE-1394 (Firewire) connection, a Fiber Channel connection, an IrDA (infrared) port, a SCSI (Small Computer Systems Interface) connection, a Universal Serial Bus (USB) connection or other wired or wireless, digital or analog interface or connection, mesh or Digi® networking. The network <b>110</b> may include any suitable number and type of devices (e.g., routers and switches) for forwarding commands, content, and/or web object requests from each client to the online community application and responses back to the clients. The device <b>200</b> may be compatible with one or more of the following network standards: GSM, CDMA, LTE, IMS, Universal Mobile Telecommunication System (UMTS), RFID, 4G, 5G, 6G and higher. The device <b>200</b> may communicate with the GPS satellite via the network <b>110</b> to exchange data on a geographical location of the device <b>200</b>. Additionally, the device <b>200</b> may communicate with mobile network operators using a mobile base station. In some embodiments, the device <b>200</b> may be used as a standalone system operating via a WiFi module or a Subscriber Identity Module (SIM) card.
0057The methods described herein may also be practiced in a wide variety of network environments (represented by network <b>110</b>) including, for example, TCP/IP-based networks, telecommunications networks, wireless networks, etc. In addition, the computer program instructions may be stored in any type of computer-readable media. The program may be executed according to a variety of computing models including a client/server model, a peer-to-peer model, on a stand-alone computing device, or according to a distributed computing model in which various functionalities described herein may be effected or employed at different locations.
0058Additionally, the user <b>105</b> wearing the device <b>200</b> may interact via the bidirectional communication network <b>110</b> with the one or more remote devices (not shown). The one or more remote devices may include a television set, a set-top box, a personal computer (e.g., a tablet or a laptop), a house signaling system, and the like. The device <b>200</b> may connect to the one or more remote devices wirelessly or by wires using various connections such as a USB port, a parallel port, an infrared transceiver port, a radiofrequency transceiver port, and so forth.
0059For the purposes of communication, the device <b>200</b> may be compatible with one or more of the following network standards: GSM, CDMA, LTE, IMS, Universal Mobile Telecommunication System (UMTS), 4G, 5G, 6G and upper, RFID, and so forth. <figref idref="DRAWINGS">FIG. 2</figref> shows a schematic representation of an exemplary eyeglass communication device <b>200</b> for facilitating shopping. The device <b>200</b> may comprise a frame <b>205</b> having a first end <b>210</b> and a second end <b>215</b>. The first end <b>210</b> of the frame <b>205</b> may be connected to a right earpiece <b>220</b>. The second end <b>215</b> of the frame <b>205</b> may be connected to a left earpiece <b>225</b>. The frame <b>205</b> may be configured as a single unit or may consist of several pieces. In an example embodiment, the frame <b>205</b> may consist of two pieces connected to each other by a connector (not shown). The connector may include two magnets, one on each piece of the frame <b>205</b>. When two parts of the connector are connected, the connector may look like a nose bridge of ordinary eyeglasses.
0060The device <b>200</b> may comprise a processor <b>230</b> disposed in the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b>. The processor <b>230</b> may be configured to receive one or more commands of a user, perform operations associated with the commands of the user, receive product information, and process the product information. The processor <b>230</b> may operate on an operational system, such as iOS, Android, Windows Mobile, Blackberry, Symbian, Asha, Linux, Nemo Mobile, and so forth. The processor <b>230</b> may be configured to establish connection with a network to view text, photo or video data, maps, listen to audio data, watch multimedia data, receive and send e-mails, perform payments, etc. Additionally, the processor <b>230</b> may download applications, receive and send text, video, and multimedia data. In a certain embodiment, the processor <b>230</b> may be configured to process a hand gesture command of the user.
0061The device <b>200</b> may also comprise at least one display <b>235</b>. The display <b>235</b> may be embedded into the frame <b>105</b>. The frame <b>105</b> may comprise openings for disposing the display <b>235</b>. In a certain embodiment, the frame <b>205</b> may be implemented without openings and may partially enclose two displays <b>235</b>. The display <b>235</b> may be configured as an eyeglass lens, such as prescription lenses, non-prescription lenses, e.g., darkened lenses, safety lenses, lenses without diopters, and the like. The eyeglass lens may be changeable. The display <b>235</b> may be configured to display data received from the processor <b>230</b>. The data received from the processor <b>230</b> may include video data, text data, payment data, personal data, barcode information, time data, notifications, and so forth. The display <b>235</b> may include an optical prism element <b>240</b> and a projector <b>245</b> embedded in the display <b>235</b>. The display <b>235</b> may include a see-through material to display simultaneously a picture of real world and data requested by the user. In some embodiments, the display <b>235</b> may be configured so that the optical prism element <b>240</b> and the projector <b>245</b> cannot be seen when looking from any side on the device <b>200</b>. Therefore, the user <b>105</b> wearing the device <b>200</b> and looking through displays <b>235</b> may not see the optical prism element <b>240</b> and the projector <b>245</b>. The projector <b>245</b> may receive an image <b>247</b> from the processor <b>230</b> and may project the image <b>247</b> to the optical prism element <b>240</b>. The optical prism element <b>240</b> may be configured so as to focus the image <b>247</b> to a retina of the user. In certain embodiments, the projector <b>245</b> may be configured to project the data received from the processor <b>230</b> to a surface in environment of the user. The surface in environment of the user may be any surface in environment of the user, such as a vertical surface, a horizontal surface, an inclined surface in environment of the user, a surface of a physical object in environment of the user, and a part of a body of the user. In some embodiments, the surface may be a wall, a table, a hand of the user, a sheet of paper. The data may include a virtual touch screen environment. The virtual touch screen environment may be see-through to enable the user to see the surroundings. Virtual objects in the virtual touch screen environment may be moveable and deformable. The user may interact with virtual objects visualized in the virtual touch screen environment. Thus, the device <b>200</b> may provide gesture tracking, surface tracking, code example tracking, and so forth.
0062In some embodiments, the device <b>200</b> may comprise a gesture sensor capable of measuring electrical activity associated with a muscle movement. Thus, the muscle movement may be detected and interpreted as a command.
0063The user may interact with the data and/or objects projected by the projector <b>245</b> (e.g. a rear projector system), such as the virtual touch screen. The camera <b>260</b> may capture images or video of user body parts in relation to the projected objects and recognize user commands provided via virtual control components. Alternatively, motions of user fingers or hands may be detected by one or more sensors and interpreted by the processor.
0064In some embodiments, the device <b>200</b> may comprise two cameras, one for each eye of the user. Each of the two cameras may have a 23 degree field of view.
0065In some embodiments, the projector <b>245</b> may be configured rotatable to enable the processor <b>245</b> to project an image to the optical prism element <b>240</b>, as well as to a surface in environment of the user. In further embodiments, the image projected by the projector <b>245</b> may be refracted by an optical prism element embedded into a display <b>235</b> and directed to the surface in environment of the user. In some embodiments, the data projected by the projector to the optical prism element may be perceived by a human eye as located at a distance of 3 to 8 meters.
0066The device <b>200</b> may comprise a transceiver <b>250</b> electrically coupled to the processor <b>230</b>. The transceiver <b>250</b> may be configured to receive and transmit data from a remote device over a wireless network, receive one or more commands of the user, and transmit the data and the one or more commands to the remote device. The remote device may include a store server, a communication server, a financial organization server, and so forth. The transceiver <b>250</b> may be disposed in the frame <b>205</b>, the right earpiece <b>220</b>, or the left earpiece <b>225</b>.
0067In some embodiments, the device <b>200</b> may comprise a receiver configured to sense a change in frequency of a WiFi signal. The change may be caused by a move of a user hand. The change may be processed by the processor and a hand gesture associated with the change may be recognized and the corresponding command may be performed. For example, the command may include controlling temperature settings, adjusting a volume on a stereo, flipping a channel on a television set, or shutting off lights, causing a fireplace to blaze to life, and so forth. The change in frequency may be sensed in a line of sight of the user, outside the line of sight of the user, through a wall, and so forth. In some embodiments, the receiver sensing WiFi signal may be activated by a specific combination of gestures serving as an activating sequence or a password. In some embodiments, WiFi signal change may be sensed by a microphone.
0068In certain embodiments, the device <b>200</b> may comprise a SIM card slot <b>255</b> disposed in the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b> and configured to receive a SIM card (not shown). The SIM card may store a phone number of the SIM card, an operator of the SIM card, an available balance of the SIM card, and so forth. Therefore, when the SIM card in received in the SIM card slot <b>255</b>, the device <b>200</b> may perform phone communication functions, i.e. may function as a mobile phone, in particular, a smartphone.
0069In certain embodiments, the device <b>200</b> may comprise a camera <b>260</b> disposed on the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b>. The camera <b>260</b> may include one or more of the following: a digital camera, a mini-camera, a motion picture camera, a video camera, a still photography camera, and so forth. The camera <b>260</b> may be configured to take a photo or record a video, capture a sequence of images, such as the images containing a hand of the user. The camera <b>260</b> may communicate the captured photo or video to the transceiver <b>250</b>. Alternatively, the camera <b>260</b> may transmit the images to the processor to recognize the hand gesture command. The camera <b>260</b> may be configured to perform simultaneously video recording and image capturing.
0070<figref idref="DRAWINGS">FIG. 3</figref> shows a schematic representation <b>3000</b> of an embodiment of the device <b>200</b>, in which the camera <b>260</b> may be configured to track a hand gesture command of the user <b>105</b>. The tracked hand gesture command of the user may be communicated to a processor of the device <b>200</b>. In this embodiment, the user <b>105</b> may give a command to perform a command call, e.g. by moving a user hand up. The camera <b>260</b> may track the hand gesture command of the user <b>105</b> and communicate data associated with the tracked data to the processor of the device <b>200</b>. The processor may process the received data and may give a command to a projector <b>245</b> to project an image of a keyboard, i.e. a virtual keyboard <b>3005</b>, to a surface <b>3010</b> in an environment of the user <b>105</b>, e.g. to a wall or a user palm. The user <b>105</b> may point figures of a telephone number on the virtual keyboard <b>3005</b>. The camera <b>260</b> may detect the figured pointed by the user <b>105</b> and communicate the numbers to the processor. The processor may process the received figures and give a command to perform a command call.
0071Referring again to <figref idref="DRAWINGS">FIG. 2</figref>, the device <b>200</b> may comprise several cameras mounted on any side of the device <b>200</b> and directed in a way allowing capture of all areas around the device <b>200</b>. For example, the cameras may be mounted on front, rear, top, left and right sides of the device <b>200</b>. The areas captured by the front-, rear-, top-, left- and right-side cameras may be displayed on the display <b>235</b> simultaneously or one by one. Furthermore, the user may select, for example, by voice command, one of the cameras, and the data captured by the selected camera may be shown on the display <b>235</b>. In further embodiments, the camera <b>260</b> may be configured to allow focusing on an object selected by the user, for example, by voice command.
0072The camera <b>260</b> may be configured to scan a barcode. Scanning a barcode may involve capturing an image of the barcode using the camera <b>260</b>. The scanned barcode may be processed by the processor <b>230</b> to retrieve the barcode information. Using the camera <b>260</b> of device <b>200</b>, the user may capture pictures of various cards, tickets, or coupons. Such pictures, stored in the device <b>200</b>, may comprise data related to captured cards, tickets, or coupons.
0073One having ordinary skills in the art would understand that the term “scanning” is not limited to printed barcodes having particular formats, but can be used for barcodes displayed on a screen of a PC, smartphone, laptop, another wearable personal digital device (WPD), and so forth. Additionally, barcodes may be transmitted to and from the eyeglass communication device electronically. In some embodiments, barcodes may be in the form of an Electronic Product Code (EPC) designed as a universal identifier that provides a unique identity for every physical object (not just a trade item category) anywhere in the world. It should be noted that EPCs are not exclusively used with RFID data carriers. They can be constructed based on reading of optical data carriers, such as linear barcodes and two-dimensional barcodes, such as Data Matrix symbols. For purposes of this document, all optical data carriers are referred to herein as “barcodes”.
0074In certain embodiments, the camera <b>260</b> may be configured to capture an image of a product. The captured image may be processed by the processor to retrieve image information. The image information may include a name of the product or a trademark of the product. Information associated with the product may be retrieved from the image information and displayed on the display <b>235</b>.
0075In certain embodiments, the device <b>200</b> may comprise at least one earphone <b>270</b> disposed on the right earpiece <b>220</b> or the left earpiece <b>225</b>. The earphone <b>270</b> may play sounds received by the transceiver <b>250</b> from the control device.
0076In certain embodiments, the device <b>200</b> may comprise a microphone <b>275</b>. The microphone <b>275</b> may sense the voice command of the user and communicate it to the transceiver <b>250</b>. The voice command may also include a voice memo, a voice message, and so forth. Additionally, the microphone <b>275</b> may sense other voice data and transmit the voice data to the processor.
0077In certain embodiments, the device <b>200</b> may comprise a charging unit <b>280</b> connected to the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b>. The charging unit <b>280</b> may be configured to provide power to elements of the device <b>200</b>. In various embodiments, the charging unit may include one or more solar cells, a wireless charger accessory, a vibration charger configured to charge the devices using natural movement vibrations, and so forth.
0078Additionally, the device <b>200</b> may include at least one electroencephalograph (EEC) sensor configured to sense brain activity of the user. Neurons of the human brain can interact through a chemical reaction and emit a measurable electrical impulse. EEG sensors may sense the electrical impulses and translate the pulses into one or more commands. By sensing the electrical impulses, the device may optimize brain fitness and performance of the user, measure and monitor cognitive health and wellbeing of the user, and so forth.
0079In certain embodiments, the device <b>200</b> may comprise a memory slot <b>285</b> disposed on the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b>. The memory slot <b>285</b> may be configured to capture a memory unit (not shown). On a request of the user, the device <b>200</b> may display data stored in the memory unit of the device <b>200</b>. In various examples, such data may include a photo or a video recorded by the camera <b>260</b>, the information received from a remote device, payment information of the user in the form of a scannable barcode, discount or membership cards of the user, tickets, coupons, boarding passes, any personal information of the user, and so forth. The memory unit may include a smart media card, a secure digital card, a compact flash card, a multimedia card, a memory stick, an extreme digital card, a trans flash card, and so forth.
0080In certain embodiments, the device <b>200</b> may comprise at least one sensor (not shown) mounted to the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b> and configured to sense the one or more commands of the user. The sensor may include at least one eye-tracking unit, at least one motion sensing unit, and an accelerometer determining an activity of the user. The eye-tracking unit may track an eye movement of the user, generate a command based on the eye movement, and communicate the command to the transceiver <b>250</b>. The motion sensing unit may sense head movement of the user, i.e. motion of the device <b>200</b> about a horizontal or vertical axis. In particular, the motion sensing unit may sense motion of the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b>. The user may give commands by moving the device <b>200</b>, for example, by moving the head of the user. The user may choose one or more ways to give commands: by voice using the microphone <b>275</b>, by eye movement using the eye-tracking unit, by head movement using the motion sensing unit, for example, by nodding or shaking the head, or use all these ways simultaneously.
0081Additionally, the device <b>200</b> may comprise one or more biometric sensors to sense biometric parameters of the user. The biometric parameters may be stored to the memory and processed by the processor to receive historical biometric data. For example, the biometric sensors may include sensors for measuring a blood pressure, a pulse, a heart rate, a glucose level, a body temperature, an environment temperature, arterial properties, and so forth. The sensed data may be processed by the processor and/or shown on the display <b>235</b>. Additionally, one or more automatic alerts may be provided based on the measuring, such as visual alerts, audio alerts, voice alerts, and so forth.
0082Moreover, to track user activity, the device <b>200</b> may comprise one or more accelerometers. Using the accelerometers, the various physical data related to the user may be received, such as calories burned, sleep quality, breaths per minute, snoring breaks, steps walked, distance walked, and the like. In some embodiments, using the accelerometers, the device <b>200</b> may control snoring by sensing the position of the user while he is asleep.
0083In certain embodiments, the device <b>200</b> may comprise a light indicator <b>290</b>, and buttons <b>295</b>, such as an on/off button and a reset button. In certain embodiments, the device <b>200</b> may comprise a USB slot <b>297</b> to connect to other devices, for example, to a computer.
0084Additionally, a gesture recognition unit including at least three dimensional (3D) gesture recognition sensors, a range finder, a depth camera, and a rear projection system may be included in the device <b>200</b>. The gesture recognition unit may be configured to track hand gesture commands of the user. Moreover, non-verbal communication of a human (gestures, hand gestures, emotion signs, directional indications, and facial expressions) may be recognized by the gesture recognition unit, a camera, and/or other sensors. Multiple hand gesture commands or gestures of other humans may be identified simultaneously. In various embodiments, hand gesture commands or gestures of other humans may be identified based on depth data, finger data, hand data, and other data, which may be received from sensors of the device <b>200</b>. The 3D gesture recognition sensor may capture three dimensional data in real time with high precision.
0085To identify a hand gesture, a human hand may be interpreted as a collection of vertices and lines in a 3D mesh. Based on relative position and interaction of the vertices and lines, the gesture may be inferred. To capture gestures in real time, a skeletal representation of a user body may be generated. To this end, a virtual skeleton of the user may be computed by the device <b>200</b> and parts of the body may be mapped to certain segments of the virtual skeleton. Thus, user gestures may be determined faster, since only key parameters are analyzed.
0086Additionally, deformable 2D templates of hands may be used. Deformable templates may be sets of points on the outline of human hands as linear simplest interpolation which performs an average shape from point sets, point variability parameters, and external deformators. Parameters of the hands may be derived directly from the images or videos using a template database from previously captured hand gestures.
0087Additionally, facial expressions of the user, including a blink, a wink, a surprise expression, a frown, a clench, a smile, and so forth, may be tracked by the camera <b>260</b> and interpreted as user commands. For example, user blinking may be interpreted by the device <b>200</b> as a command to capture a photo or a video.
0088Through recognition of gestures and other indication or expressions, the device <b>200</b> may enable the user to control, remotely or non-remotely, various machines, mechanisms, robots, and so forth. Information associated with key components of the body parts may be used to recognize gestures. Thus, important parameters, like palm position or joint angles, may be received. Based on the parameters, relative position and interaction of user body parts may be determined in order to infer gestures. Meaningful gestures may be associated with templates stored in a template database.
0089In other embodiments, images or videos of the user body parts may be used for gesture interpretation. Images or videos may be taken by the camera <b>260</b>.
0090In certain embodiments, the device <b>200</b> may comprise a RFID reader (not shown) to read a RFID tag of a product. The read RFID tag may be processed by the processor <b>230</b> to retrieve the product information.
0091In certain embodiments, the device <b>200</b> may be configured to allow the user to view data in 3D format. In this embodiment, the device <b>200</b> may comprise two displays <b>235</b> enabling the user to view data in 3D format. Viewing the data in 3D format may be used, for example, when working with such applications as games, simulators, and the like. The device <b>200</b> may be configured to enable head tracking. The user may control, for example, video games by simply moving his head. Video game application with head tracking may use 3D effects to coordinate actual movements of the user in the real world with his virtual movements in a displayed virtual world.
0092In certain embodiments, the device <b>200</b> may comprise a vibration unit (not shown). The vibration unit may be mounted to the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b>. The vibration unit may generate vibrations. The user may feel the vibrations generated by the vibration unit. The vibration may notify the user about receipt of the data from the remote device, alert notification, and the like.
0093Additionally, the device <b>200</b> may comprise a communication circuit. The communication circuit may include one or more of the following: a Bluetooth module, a WiFi module, a communication port, including a universal serial bus (USB) port, a parallel port, an infrared transceiver port, a radiofrequency transceiver port, an embedded transmitter, and so forth. The device <b>200</b> may communicate with external devices using the communication circuit.
0094Thus, in certain embodiments, the device <b>200</b> may comprise a GPS unit (not shown). The GPS unit may be disposed on the frame <b>205</b>, the right earpiece <b>220</b> or the left earpiece <b>225</b>. The GPS unit may detect coordinates indicating a position of the user <b>105</b>. The coordinates may be shown on the display <b>235</b>, for example, on request of the user, stored in the memory unit <b>285</b>, or sent to a remote device.
0095In certain embodiments, the device <b>200</b> may comprise a Wi-Fi module (not shown) and a Wi-Fi signal detecting sensor (not shown). The Wi-Fi signal detecting sensor may be configured to detect change of a Wi-Fi signal caused by the hand gesture command of the user and communicate data associated with the detected change to the processor <b>230</b>. In this embodiment, the processor <b>230</b> may be further configured to process the data associated with the detected change of the Wi-Fi signal and perform the detected hand gesture command in accordance with the processed data. For example, a user may give a command to turn off the light in the room, e.g., by moving a user hand up and down. The Wi-Fi signal changes due to movement of the user hand. The Wi-Fi signal detecting sensor may detect change of the Wi-Fi signal and communicate data associated with the detected change to the processor <b>230</b>. The processor <b>230</b> may process the received data to determine the command given by the user and send a command to a light controlling unit of the room to turn off the light.
0096Using the embedded transmitter, the device <b>200</b> may produce signals used to control a device remotely (e.g. TV set, audio system, and so forth), to enable a two way radio alert, a medical care alert, a radar, activate a door opener, control an operation transporting vehicle, a navigational beacon, a toy, and the like.
0097In some embodiments, device <b>200</b> may include control elements to control operation or functions of the device.
0098Access to the device <b>200</b> may be controlled by a password, a Personal Identification Number (PIN) code, and/or biometric authorization. The biometric authorization may include fingerprint scanning, palm scanning, face scanning, retina scanning, and so forth. The scanning may be performed using one or more biometric sensors. Additionally, the device <b>200</b> may include a fingerprint reader configured to scan a fingerprint. The scanned fingerprint may be matched to one or more approved fingerprints and if the scanned fingerprint corresponds to one of the approved fingerprints, the access to the device <b>200</b> may be granted.
0099Additionally, a Software Development Kit (SDK) and/or an Application Programming Interface (API) may be associated with the device <b>200</b>. The SDK and/or API may be used for third party integration purposes.
0100In various embodiments, the device <b>200</b> may comprise a GPS module to track geographical location of the device, an alert unit to alert the user about some events by vibration and/or sound, one or more subscriber identification module (SIM) cards, one or more additional memory units, a physical interface (e.g. a microSecureDigital (microSD) slot) to receive memory devices external to the device, a two-way radio transceiver for communication purposes, and an emergency button configured to send an alarm signal. In some embodiments, the vibration and sound of the alert unit may be used by a guide tool and an exercise learning service.
0101In certain example embodiments, device may be configured to analyze one or more music records stored in a memory unit. The device may communicate, over a network, with one or more music providers and receive data on music records suggested by the music providers for sale which are similar to the music records stored in the memory unit of the device. The received data may be displayed by the device.
0102Additionally, the processor may be configured to communicate with a gambling cloud service or a gaming cloud service, exchange gambling or gaming data with the gambling cloud service or the gaming cloud service, and, based on a user request, transfer payments related to gambling or gaming using payment data of the user associated with an account of the user in the cloud service, using payment data of the user stored in a memory unit or using a swipe card reader to read payment card data.
0103<figref idref="DRAWINGS">FIG. 4</figref> is a flow chart illustrating a method <b>3100</b> for facilitating shopping using an augmented reality eyeglass communication device <b>200</b>. The method <b>3100</b> may start with receiving product information associated with products comprised in a list of products of a user at operation <b>3102</b>. The product information, e.g., names or types of the products, may be received by a processor <b>230</b> of the device <b>200</b> by sensing a command of the user. In a certain embodiment, the user may pronounce names of products the user wishes to buy and may give a voice command to include these products into the list of products. The device <b>200</b> may sense the voice command of the user via a microphone <b>275</b> and communicate the command to the processor <b>230</b>. The processor <b>230</b> may receive location information associated with location of the user at operation <b>3104</b>. At operation <b>3106</b>, the processor <b>230</b> may search a database associated with a store for availability, location and pricing information associated with the products included into the list of products of the user. The search may be based on the product information. The store may include any store in proximity to location of the user or any store selected by the user. At operation <b>3108</b>, the processor <b>230</b> may receive the availability, location and pricing information associated with the product from the database of the store. The availability, location and pricing information associated with the product may be displayed to the user on a display <b>235</b> of the device <b>200</b> at operation <b>3110</b>.
0104Optionally, the method <b>3100</b> may comprise plotting, by the processor <b>230</b>, a route for the user on a map of the store based on the availability, location and pricing information associated with the product and the location information associated with the location of the user. The route may be displayed on the display <b>235</b>.
0105In a certain embodiment, the user may give a command to provide description of a product present in the store. The device <b>200</b> may sense the command of the user via the microphone and communicate the command to the processor <b>230</b> of the device <b>200</b>. The processor <b>230</b> may receive information associated with the product which description is requested by the user. The information associated with the product may be received by means of taking a picture of the product, scanning a barcode of the product, and reading a RFID tag of the product. The received information associated with the product may be processed by the processor <b>230</b>. Then, the processor may search, based on the received information associated with the product, the description of the product in a database available in a network, e.g., in the Internet. After receiving, by the processor, the description of the product from the network, the description of the product present in the store may be displayed to the user on the display <b>235</b>.
0106In a certain embodiment, the user may give a command to provide description of a product by means of a hand gesture, for example, by moving a hand of the user from left to right. In this embodiment, the method <b>3100</b> may comprise tracking, by a camera of the device <b>200</b>, a hand gesture command of the user. The hand gesture command of the user may be processed by a processor of the device <b>200</b>. The processor may give a command to a projector of the device <b>200</b> to project the description of the product to a surface in environment of the user, e.g. a wall or the product itself, according to the hand gesture command.
0107In a certain embodiment, the processor <b>230</b> may optionally receive information about the products put by the user into a shopping cart. The information about the products may be received by means of taking a picture of the product, scanning a barcode of the product, and reading a RFID tag of the product. The processor <b>230</b> may remove, based on the received information, the products put by the user into the shopping cart from the list of products.
0108In case a product comprised in the list of products of the user is not available in the store, the device <b>200</b> may notify the user about such an absence, for example, by means of a sound or vibration notification or by means of showing the notification on the display <b>235</b>. Furthermore, the processor <b>230</b> may search availability information associated with the not available product in a database of a store located proximate to the location of the user, based on location information of the user.
0109In a certain embodiment, the processor <b>230</b> may search the database associated with the store for information about a product having the same characteristics as the not available product. After the processor <b>230</b> receives the information about the product having the same characteristics as the not available product, the information may be displayed to the user on the display <b>235</b>.
0110In a certain embodiment, when all products the user needs are put into the shopping chart, the user may give a command to perform a payment. The processor <b>230</b> may receive information about the products put by the user into the shopping cart and, based on the received information, may generate a payment request. The generated payment request may be sent, by means of the transceiver <b>250</b>, to a financial organization to perform a payment. The financial organization may include a bank. The financial organization may confirm the payment, for example, based on SIM information of the user received together with the payment request or any other information associated with the device <b>200</b> and stored in a database of the financial organization. One example embodiment of the method <b>3000</b> in respect of facilitating shopping will now be illustrated by <figref idref="DRAWINGS">FIG. 5</figref>.
0111<figref idref="DRAWINGS">FIG. 5</figref> shows payment <b>3200</b> using a payment card, in accordance with some embodiments. The user <b>105</b> may give a command, for example, by voice or by eye movement, to scan a barcode of a product <b>130</b>. The device <b>200</b> may scan the barcode of the product <b>130</b> by means of a camera. After scanning the barcode of the product <b>130</b>, the user <b>105</b> may receive payment data associated with the product <b>130</b>. The payment data may encode payment request information, such as receiving account, amount to be paid, and so forth. However, in some embodiments, the amount to be paid may be provided by the user <b>105</b>.
0112To pay for the product <b>130</b>, the user may choose to pay electronically using the payment data stored on the device <b>200</b> or by a payment card. To pay using the payment card, the user <b>105</b> may dispose the payment card in front of the camera of the device <b>200</b>. In a certain embodiment, information about the payment card may be stored in a memory unit of the device <b>200</b> or may be reached via the Internet. After capturing the image of the payment card by the camera, the device <b>200</b> may receive payment data associated with the payment card. The device <b>200</b> may generate a payment request <b>3202</b> based on the payment data of the payment card and the payment data of the product <b>130</b>.
0113The payment request <b>3202</b> may be then sent via the network <b>110</b> to the financial organization <b>3204</b> associated with the payment data of the payment card. The financial organization <b>3204</b> may process the payment request <b>3202</b> and may either perform the payment or deny the payment. Then, a report <b>3206</b> may be generated and sent to the device <b>200</b> via the network <b>110</b>. The report <b>3206</b> may inform user <b>105</b> whether the payment succeeded or was denied. The user <b>105</b> may be notified about the report <b>3206</b> by showing the report <b>3206</b> on the display of the device <b>200</b>, playing a sound in earphones of the device <b>200</b>, or by generating a vibration by a vibration unit of the device <b>200</b>.
0114Additionally, the user <b>105</b> may receive payments from other users via the device <b>200</b>. Payment data associated with another user may be received by the device <b>200</b>. The payment data may include payment account information associated with another user, payment transfer data, and so forth. Based on the payment data, an amount may be transferred from the payment account of another user to a payment account of the user. The information on the payment account of the user may be stored in the memory of the device <b>200</b> or on a server.
0115In some embodiments, the device <b>200</b> may be used for different purposes. For example, the device may enable hands free check-in and/or check-out, hands free video calls, and so forth. Additionally, the device may perform hands free video calls, take pictures, record video, get directions to a location, and so forth. In some embodiments, the augmented reality eyeglass communication device may make and receive calls over a radio link while moving around a wide geographic area via a cellular network, access a public phone network, send and receive text, photo, and video messages, access internet, capture videos and photos, play games, and so forth.
0116The augmented reality eyeglass communication device may be used to purchase products in a retail environment. To this end, the augmented reality eyeglass communication device, on receiving a user request to read one or more product codes, may read the product codes corresponding to products. The reading may include scanning the product code by the augmented reality eyeglass communication device and decoding the product code to receive product information. The product information may include a product price, a manufacture date, a manufacturing country, or a quantity of products. Prior to the reading, an aisle location of products may be determined. Each reading may be stored in a list of read products on the augmented reality eyeglass communication device. Additionally, the user may create one or more product lists.
0117In some embodiments, a request to check a total amount and price of the reading may be received from the user. Additionally, the user may give a command to remove some items from the reading, so some items may be selectively removed.
0118Data associated with the product information may be transmitted to a payment processing system. On a user request, the augmented reality eyeglass communication device may calculate the total price of the reading, and payment may be authorized and the authorization may be transmitted to the payment processing system. The payment processing system may perform the payment and funds may be transferred to a merchant account. Alternatively, the total price may be encoded in a barcode and the barcode may be displayed on a display of the augmented reality eyeglass communication device. The displayed barcode may be scanned by a sales person to accelerate check out.
0119Additionally, compensation may be selectively received based on predetermined criteria. For example, the compensation may include a cashback, a discount, a gift card, and so forth. In certain embodiments, the user may pay with a restored payment card by sending a request to make payment via an interface of the augmented reality eyeglass communication device. The payment card may include any credit or debit card.
0120In some cases, the augmented reality eyeglass communication device may connect to a wireless network of a merchant to receive information, receive digital coupons and offers to make a purchase, receive promotional offers and advertising, or for other purposes. In various embodiments, promotional offers and advertising may be received from a merchant, a mobile payment service provider, a third party, and so forth.
0121After a purchase is made, a digital receipt may be received by email. The digital receipt may contain detailed information on cashback, discount, and so forth. Furthermore, a remote order for home delivery of one or more unavailable products may be placed with a merchant.
0122Another possible use of the augmented reality eyeglass communication device is accessing game and multimedia data. A user request to display the game and multimedia data or perform communication may be received and the augmented reality eyeglass communication device communicate, over a network, with a game and multimedia server to transfer game and multimedia data or a communication server to transfer communication data. The transferred data may be displayed on a display of the augmented reality eyeglass communication device. Furthermore, a user command may be received and transferred to the game and multimedia server, the server may process the command and transfer data related to the processing to the augmented reality eyeglass communication device.
0123Additionally, the augmented reality eyeglass communication device may receive incoming communication data and notify the user about the incoming communication data. To notify the user, an audible sound may be generated. The sound may correspond to the incoming communication data. A user command may be received in response to the incoming communication data, and the incoming communication data may be displayed.
0124In some embodiments, the game and multimedia data or the incoming communication data may be transferred to a television set, a set-top box, a computer, a laptop, a smartphone, a wearable personal digital device, and so forth.
0125The augmented reality eyeglass communication device may be used to alert a driver and prevent the driver for falling asleep. The augmented reality eyeglass communication device may include a neuron sensor and camera to detect the state of an eye of the driver (open or not) by processing frontal or side views of the face images taken by the camera to analyze slackening facial muscles, blinking pattern and a period of time the eyes stay closed between blinks. Once it is determined that the driver is asleep, an audible, voice, light, and/or vibration alarm may be generated.
0126Furthermore, the augmented reality eyeglass communication device may be used for personal navigation. The augmented reality eyeglass communication device may comprise a GPS unit to determine a geographical location of a user and a magnetic direction sensor to determine an orientation of a head of the user. The processor of the augmented reality eyeglass communication device may receive a destination or an itinerary, one or more geographical maps, the geographical location of the user, and the orientation of the head of the user, and generate navigation hints. The navigation hints may be provided to the user via a plurality of Light Emitting Diodes (LEDs). The LEDs may be disposed in a peripheral field of vision of the user and provide navigation hints by changing their color. For example, the LEDS located on in the direction where the user need to move to reach the destination or to follow the itinerary, may have a green color, while the LEDs located in a wrong direction may have a red color. Additionally, data including the itinerary, the one or more geographical maps, the geographical location of the user, one or more messages, one or more alternative routes, one or more travel alerts, and so forth may be displayed on the display of the augmented reality eyeglass communication device.
0127In some embodiments, the augmented reality eyeglass communication device may receive user commands via a microphone.
0128In some embodiments, the augmented reality eyeglass communication device may comprise at least one electroencephalograph (EEG) sensor sensing one or more electrical impulses associated with the brain activity of the user. The electrical impulses may be translated in one or more commands. Additionally, the electrical impulses may be used to detect and optimize brain fitness and performance of the user, measure and monitor cognitive health and well being of the user. Based on the electrical impulses undesired condition of the user may be detected and an alert associated with the undesired condition may be provided. The undesired condition may include chronic stress, anxiety, depression, aging, decreasing estrogen level, excess oxytocin level, prolonged cortisol secretion, and so forth.
0129Moreover, healthy lifestyle tips may be provided to the user via the augmented reality eyeglass communication device. The healthy lifestyle tips may be associated with mental stimulation, physical exercise, healthy nutrition, stress management, sleep, and so forth.
0130An optical head-mounted display, designed in the shape of a pair of eyeglasses with the mission of producing a multimedia computer. The Glass displays information in a smartphone-like hands-free format. Wearers communicate with the Internet via natural language voice commands. A touchpad located on the side of the Glass, allowing users to control the device by swiping through a timeline-like interface displayed on the screen. Sliding backward shows current events, such as weather, and sliding forward shows past events, such as phone calls, photos, circle updates, etc.
0131A display, the Glass display uses a liquid crystal on silicon, the LED illumination is first P-polarized and then shines through the in-coupling panel, the panel reflects the light and alters it to S-polarization at active pixel sensor sites. the in-coupling LED then reflects the S-polarized areas of light at 45°-85 degree through the out-coupling beam splitter to a collimating reflector at the other end. Finally, the out-coupling beam splitter (which is a partially reflecting mirror, not a polarizing beam splitter) reflects the collimated light another 45°-85 degree and into the wearer's eye.
0132A head-mounted virtual retinal display, which superimposes 3D computer generated imagery over real world objects, by projecting a digital light field into the user's eye, Involving technologies potentially suited to applications in augmented reality and computer vision with a light-field chip using silicon photonics.
0133A live direct or indirect view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data, in which a view of reality is modified by a computer. As a result, the technology functions by enhancing one's current perception of reality.
0134Virtual reality, which replaces the real world with a simulated one. Augmentation is conventionally in real time and in semantic context with environmental elements, such as sports scores on TV during a match, wherein adding computer vision and object recognition the information about the surrounding real world of the user becomes interactive and digitally manipulable. Information about the environment and its objects is overlaid on the real world, wherein information can be virtual or real, e.g. seeing other real sensed or measured information such as electromagnetic radio waves overlaid in exact alignment with where they actually are in space. Augmented reality brings out the components of the digital world into user's perceived real world.
0135Augmented reality can aid in visualizing building projects. Computer-generated images of a structure can be superimposed into a real life local view of a property before the physical building is constructed there; wherein augmented reality can also be employed within an architect's work space, rendering into their view animated 3D visualizations of their 2D drawings. Architecture sight-seeing can be enhanced with augmented reality applications allowing users viewing a building's exterior to virtually see through its walls, viewing its interior objects and layout, wherein with the continual improvements to GPS accuracy, mixed reality is able to use augmented reality to visualize geo-referenced models of construction sites, underground structures, cables and pipes using mobile devices. Augmented reality is applied to present new projects, to solve on-site construction challenges, and to enhance promotional materials, wherein Smart Helmet, an Android-powered hard hat used to create augmented reality for the industrial worker, including visual instructions, real time alerts, and 3D mapping.
0136Augmented reality applied in the visual arts allowed objects or places to trigger artistic multidimensional experiences and interpretations of reality. Augmented reality is used to integrate print and video marketing. Printed marketing material can be designed with certain “trigger” images that, when scanned by an augmented reality enabled device using image recognition, activate a video version of the promotional material, wherein augmented reality and straight forward image recognition is overlaying multiple media at the same time in the view screen, such as social media share buttons, in-page video even audio and 3D objects. Augmented reality connects many different types of media. Augmented reality can enhance product previews such as allowing a customer to view what's inside a product's packaging without opening it. Augmented reality can also be used as an aid in selecting products from a catalog or through a kiosk. Scanned images of products can activate views of additional content such as customization options and additional images of the product in its use.
0137Augmented reality allowed video game players to experience digital game play in a real world environment, as a location-based game.
0138Augmented reality provide surgeons with patient monitoring data in the style of a fighter pilot's heads up display or allowed patient imaging records, including functional videos, to be accessed and overlaid, including a virtual x-ray view based on prior tomography or on real time images from ultrasound and confocal microscopy probes, visualizing the position of a tumor in the video of an endoscope, or radiation exposure risks from X-ray imaging devices. Augmented reality can enhance viewing a fetus inside a mother's womb. Augmented reality may be used for cockroach phobia treatment. Patients wearing augmented reality glasses can be reminded to take medications.
0139Augmented reality can augment the effectiveness of navigation devices. Information can be displayed on an automobile's windshield indicating destination directions and meter, weather, terrain, road conditions and traffic information as well as alerts to potential hazards in their path. Aboard maritime vessels, augmented reality allows bridge watch-standers to continuously monitor important information such as a ship's heading and speed while moving throughout the bridge or performing other tasks. Augmented reality was used to facilitate collaboration among distributed team members via conferences with local and virtual participants. Augmented reality tasks included brainstorming and discussion meetings utilizing common visualization via touch screen tables, interactive digital whiteboards, shared design spaces, and distributed control rooms.
0140Complex tasks such as assembly, maintenance, and surgery were simplified by inserting additional information into the field of view. Labels may be displayed on parts of a system to clarify operating instructions for a mechanic performing maintenance on a system. Assembly lines benefited from the usage of augmented reality for incorporating augmented reality into assembly lines for monitoring process improvements. Big machines are difficult to maintain because of the multiple layers or structures they have. Augmented reality permitted them to look through the machine as if it was with x-ray, pointing them to the problem right away.
0141Augmented reality in sports telecasting, sports and entertainment venues are provided with see-through and overlay augmentation through tracked camera feeds for enhanced viewing by the audience. Integrated augmented reality in association with football and other sporting events may show commercial advertisements overlaid onto the view of the playing area. Sections of rugby fields and cricket pitches also display sponsored images. Swimming telecasts often add a line across the lanes to indicate the position of the current record holder as a race proceeds to allow viewers to compare the current race to the best performance. And also hockey puck tracking and annotations of racing car performance and snooker ball trajectories. Integrated augmented reality TV allowed viewers to interact with the programs they were watching. Users may place objects into an existing program and interact with them, such as moving them around. Objects included avatars of real persons in real time who were also watching the same program. Integrated augmented reality may be used to enhance concert and theater performances. Artists allowed listeners to augment their listening experience by adding their performance to that of other bands/groups of users.
0142Integrated augmented reality applications, running on handheld devices utilized as virtual reality headsets, can also digitalize human presence in space and provide a computer generated model of them, in a virtual space where users can interact and perform various actions.
0143Integrated augmented reality In combat serves as a networked communication system that renders useful battlefield data onto a soldier's goggles in real time. From the soldier's viewpoint, people and various objects can be marked with special indicators to warn of potential dangers. Virtual maps and 360° view camera imaging can also be rendered to aid a soldier's navigation and battlefield perspective, and this can be transmitted to military leaders at a remote command center.
0144<figref idref="DRAWINGS">FIG. 6</figref> shows a diagrammatic representation of a machine in the example electronic form of a computer system <b>3300</b>, within which a set of instructions for causing the machine to perform any one or more of the methodologies discussed herein may be executed. In various example embodiments, the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a portable music player (e.g., a portable hard drive audio device such as an Moving Picture Experts Group Audio Layer 3 (MP3) player), a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
0145The example computer system <b>3300</b> includes a processor or multiple processors <b>3302</b> (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both), a main memory <b>3304</b> and a static memory <b>3206</b>, which communicate with each other via a bus <b>3308</b>. The computer system <b>3300</b> may further include a video display unit <b>3310</b> (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). The computer system <b>3300</b> may also include an alphanumeric input device <b>3312</b> (e.g., a keyboard), a cursor control device <b>3314</b> (e.g., a mouse), a disk drive unit <b>3316</b>, a signal generation device <b>3318</b> (e.g., a speaker) and a network interface device <b>3320</b>.
0146The disk drive unit <b>3316</b> includes a computer-readable medium <b>3322</b>, on which is stored one or more sets of instructions and data structures (e.g., instructions <b>3324</b>) embodying or utilized by any one or more of the methodologies or functions described herein. The instructions <b>3324</b> may also reside, completely or at least partially, within the main memory <b>3304</b> and/or within the processors <b>3302</b> during execution thereof by the computer system <b>3300</b>. The main memory <b>3304</b> and the processors <b>3302</b> may also constitute machine-readable media.
0147The instructions <b>3324</b> may further be transmitted or received over a network <b>3326</b> via the network interface device <b>3320</b> utilizing any one of a number of well-known transfer protocols (e.g., Hyper Text Transfer Protocol (HTTP)).
0148While the computer-readable medium <b>3322</b> is shown in an example embodiment to be a single medium, the term “computer-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database and/or associated caches and servers) that store the one or more sets of instructions. The term “computer-readable medium” shall also be taken to include any medium that is capable of storing, encoding, or carrying a set of instructions for execution by the machine and that causes the machine to perform any one or more of the methodologies of the present application, or that is capable of storing, encoding, or carrying data structures utilized by or associated with such a set of instructions. The term “computer-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical and magnetic media, and carrier wave signals. Such media may also include, without limitation, hard disks, floppy disks, flash memory cards, digital video disks, random access memory (RAMs), read only memory (ROMs), and the like.
0149The example embodiments described herein may be implemented in an operating environment comprising software installed on a computer, in hardware, or in a combination of software and hardware.
0150Thus, various augmented reality eyeglass communication devices for facilitating shopping and methods for facilitating shopping using an augmented reality eyeglass communication device have been described. Although embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the system and method described herein. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
Contents6
35 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2024046239A1 | Cited by | United States of America | Search report |
| US11902477B1 | Cited by | United States of America | Search report |
| US11556912B2 | Cited by | United States of America | Search report |
| US11364361B2 | Cited by | United States of America | Applicant |
| US2018204196A1 | Cited by | United States of America | Search report |
| US10970935B2 | Cited by | United States of America | Applicant |
| US12242587B2 | Cited by | United States of America | Search report |
| US11361364B2 | Cited by | United States of America | Search report |
| US10802142B2 | Cited by | United States of America | Applicant |
| US12058135B2 | Cited by | United States of America | Search report |
| US11429957B1 | Cited by | United States of America | Applicant |
| US11282248B2 | Cited by | United States of America | Applicant |
| US11379806B2 | Cited by | United States of America | Search report |
| US11875896B2 | Cited by | United States of America | Applicant |
| US2020004016A1 | Cited by | United States of America | Search report |
| US12014829B2 | Cited by | United States of America | Applicant |
| US12215534B1 | Cited by | United States of America | Applicant |
| CN112053505A | Cited by | China | Search report |
| TWI851764B | Cited by | Taiwan Province of China | Examiner |
| US2024111854A1 | Cited by | United States of America | Search report |
| US11191609B2 | Cited by | United States of America | Applicant |
| US11916885B1 | Cited by | United States of America | Applicant |
| US11568987B2 | Cited by | United States of America | Applicant |
| US11804299B2 | Cited by | United States of America | Applicant |
| US10448762B2 | Cited by | United States of America | Applicant |
| US11676697B2 | Cited by | United States of America | Applicant |
| US12603921B1 | Cited by | United States of America | Applicant |
| US11784999B1 | Cited by | United States of America | Search report |
| US11461991B2 | Cited by | United States of America | Applicant |
| US11631119B2 | Cited by | United States of America | Applicant |
| US11568988B2 | Cited by | United States of America | Applicant |
| USD900206S | Cited by | United States of America | Applicant |
| US11816266B2 | Cited by | United States of America | Applicant |
| US12386641B2 | Cited by | United States of America | Applicant |
| US11916968B1 | Cited by | United States of America | Applicant |
| US11457106B2 | Cited by | United States of America | Applicant |
| US11903657B2 | Cited by | United States of America | Applicant |
| US2021295025A1 | Cited by | United States of America | Search report |
| US10497161B1 | Cited by | United States of America | Applicant |
| US11500463B2 | Cited by | United States of America | Search report |
| US11397956B1 | Cited by | United States of America | Applicant |
| US12033131B2 | Cited by | United States of America | Search report |
| US11393586B1 | Cited by | United States of America | Applicant |
| US12284224B1 | Cited by | United States of America | Applicant |
| US2023117748A1 | Cited by | United States of America | Search report |
| US12277363B2 | Cited by | United States of America | Applicant |
| US11894137B2 | Cited by | United States of America | Applicant |
| WO2019120553A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US11949533B2 | Cited by | United States of America | Applicant |
| USD954136S | Cited by | United States of America | Applicant |
| US10136275B2 | Cited by | United States of America | Search report |
| US2023196329A1 | Cited by | United States of America | Search report |
| US10636197B2 | Cited by | United States of America | Applicant |
| TWI907910B | Cited by | Taiwan Province of China | Examiner |
| US2018190031A1 | Cited by | United States of America | Pre-grant |
| US11314215B2 | Cited by | United States of America | Applicant |
| US12334629B2 | Cited by | United States of America | Applicant |
| US10818088B2 | Cited by | United States of America | Applicant |
| US11869659B2 | Cited by | United States of America | Applicant |
| US11282523B2 | Cited by | United States of America | Search report |
| USD900920S | Cited by | United States of America | Applicant |
| US11614621B2 | Cited by | United States of America | Applicant |
| US12135535B2 | Cited by | United States of America | Applicant |
| US12322396B2 | Cited by | United States of America | Search report |
| USD899497S | Cited by | United States of America | Applicant |
| US11995772B2 | Cited by | United States of America | Applicant |
| US11886767B2 | Cited by | United States of America | Applicant |
| US12449793B2 | Cited by | United States of America | Applicant |
| US11348147B2 | Cited by | United States of America | Applicant |
| EP3438782A1 | Cited by | European Patent Office (EPO) | Search report |
| US11758389B2 | Cited by | United States of America | Applicant |
| US11055913B2 | Cited by | United States of America | Applicant |
| US10901218B2 | Cited by | United States of America | Applicant |
| US10908419B2 | Cited by | United States of America | Search report |
| EP4331664A1 | Cited by | European Patent Office (EPO) | Search report |
| US11942218B2 | Cited by | United States of America | Applicant |
| US11515037B2 | Cited by | United States of America | Applicant |
| US12399553B2 | Cited by | United States of America | Search report |
| US2023136553A1 | Cited by | United States of America | Search report |
| US11973752B2 | Cited by | United States of America | Applicant |
| US11399258B2 | Cited by | United States of America | Search report |
| US10115239B2 | Cited by | United States of America | Search report |
| US12053301B2 | Cited by | United States of America | Search report |
| US12280219B2 | Cited by | United States of America | Applicant |
| USD900204S | Cited by | United States of America | Applicant |
| US2018204196A1 | Cited by | United States of America | Search report |
| US11785071B2 | Cited by | United States of America | Search report |
| USD900205S | Cited by | United States of America | Applicant |
| US10762382B2 | Cited by | United States of America | Search report |
| US12273960B2 | Cited by | United States of America | Search report |
| US12397128B2 | Cited by | United States of America | Applicant |
| US2021152555A1 | Cited by | United States of America | Search report |
| US11676696B2 | Cited by | United States of America | Applicant |
| US11682479B2 | Cited by | United States of America | Applicant |
| USD899496S | Cited by | United States of America | Applicant |
| US2025076966A1 | Cited by | United States of America | Search report |
| US11283937B1 | Cited by | United States of America | Search report |
| US2022253823A1 | Cited by | United States of America | Search report |
| US11717686B2 | Cited by | United States of America | Applicant |
| US12217372B2 | Cited by | United States of America | Applicant |
220 members in 5 offices; this record represents the family
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 201514815988 | United States of America | A | |
| 201514940379 | United States of America | A | |
| 201514957644 | United States of America | A | |
| 201629567712 | United States of America | F | |
| 201629572722 | United States of America | F | |
| 201615345349 | United States of America | A | |
| 201615350458 | United States of America | A | |
| 201629587388 | United States of America | F | |
| 201629587581 | United States of America | F | |
| 201629587752 | United States of America | F |
Members220
| Document | Office | Kind | |
|---|---|---|---|
| US7702739B1 | United States of America | B1 | |
| US2011276636A1 | United States of America | A1 | |
| US2012006891A1 | United States of America | A1 | |
| US2012059699A1 | United States of America | A1 | |
| US2013006788A1 | United States of America | A1 | |
| US2013018715A1 | United States of America | A1 | |
| US2013018782A1 | United States of America | A1 | |
| US2013026232A1 | United States of America | A1 | |
| US2013043305A1 | United States of America | A1 | |
| WO2013064986A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2013141313A1 | United States of America | A1 | |
| US2013146659A1 | United States of America | A1 | |
| US2013172068A1 | United States of America | A1 | |
| US2013173362A1 | United States of America | A1 | |
| US2013191174A1 | United States of America | A1 | |
| US2013225290A1 | United States of America | A1 | |
| US2013236877A1 | United States of America | A1 | |
| US2013238401A1 | United States of America | A1 | |
| US2013240622A1 | United States of America | A1 | |
| US2013311484A1 | United States of America | A1 | |
| US2013346168A1 | United States of America | A1 | |
| US2014058804A1 | United States of America | A1 | |
| WO2014041456A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2014041458A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2014045145A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2014098758A1 | United States of America | A1 | |
| WO2014053924A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2014064549A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2014129422A1 | United States of America | A1 | |
| US2014143037A1 | United States of America | A1 | |
| US2014189354A1 | United States of America | A1 | |
| WO2014118703A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2014122558A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2014236750A1 | United States of America | A1 | |
| US2014239065A1 | United States of America | A1 | |
| WO2014132192A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2014254896A1 | United States of America | A1 | |
| WO2014141076A2 | World Intellectual Property Organization (WIPO) | A2 | |
| US8851372B2 | United States of America | B2 | |
| WO2014162257A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2014174398A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2014174399A2 | World Intellectual Property Organization (WIPO) | A2 | |
| US2014330656A1 | United States of America | A1 | |
| US2014349692A1 | United States of America | A1 | |
| WO2014174398A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2015026072A1 | United States of America | A1 | |
| WO2014141076A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO2014162257A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO2014174399A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO2015025251A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US8968103B2 | United States of America | B2 | |
| US2015066613A1 | United States of America | A1 | |
| US8985442B1 | United States of America | B1 | |
| US2015088757A1 | United States of America | A1 | |
| US9009166B2 | United States of America | B2 | |
| US9016565B2 | United States of America | B2 | |
| WO2015063627A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US9047600B2 | United States of America | B2 | |
| US2015161721A1 | United States of America | A1 | |
| CN104781841A | China | A | |
| EP2896001A1 | European Patent Office (EPO) | A1 | |
| EP2896011A1 | European Patent Office (EPO) | A1 | |
| WO2015107442A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP2898464A1 | European Patent Office (EPO) | A1 | |
| US9098190B2 | United States of America | B2 | |
| US9100493B1 | United States of America | B1 | |
| WO2015114475A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP2904557A1 | European Patent Office (EPO) | A1 | |
| US2015229750A1 | United States of America | A1 | |
| EP2912620A1 | European Patent Office (EPO) | A1 | |
| WO2015132767A1 | World Intellectual Property Organization (WIPO) | A1 | |
| IN3115DEN2015A | India | A | |
| IN3127DEN2015A | India | A | |
| IN3128DEN2015A | India | A | |
| US9153074B2 | United States of America | B2 | |
| CN104995545A | China | A | |
| WO2015162565A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2015170253A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2015339696A1 | United States of America | A1 | |
| WO2015177760A2 | World Intellectual Property Organization (WIPO) | A2 | |
| US9208505B1 | United States of America | B1 | |
| CN105164707A | China | A | |
| US2015371215A1 | United States of America | A1 | |
| WO2015177760A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO2016009287A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2016024183A2 | World Intellectual Property Organization (WIPO) | A2 | |
| US2016086161A1 | United States of America | A1 | |
| WO2016055877A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US9317883B2 | United States of America | B2 | |
| US2016110695A1 | United States of America | A1 | |
| WO2016024183A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2016114887A1 | United States of America | A1 | |
| US9342829B2 | United States of America | B2 | |
| WO2016075598A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2016083906A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US9361616B2 | United States of America | B2 | |
| US2016162873A1 | United States of America | A1 | |
| US9367841B2 | United States of America | B2 | |
| US2016189137A1 | United States of America | A1 | |
| WO2016075598A3 | World Intellectual Property Organization (WIPO) | A3 |
36 transactions on the USPTO file
Abandoned without a rejection on record.
- Non-final rejections
- 0
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Correspondence Address ChangeC.AD | C.AD | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Abandonment for Failure to Pay Issue FeeAbandonedMABN6 | MABN6 | |
| Abandonment for Failure to Pay Issue FeeAbandonedABN6 | ABN6 | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Examiner's Amendment CommunicationEX.A | EX.A | |
| Reasons for AllowanceEX.R | EX.R | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Pre-Exam NoticeMPEN | MPEN | |
| Application Is Now CompleteCOMP | COMP | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Application Dispatched from OIPEOIPE | OIPE | |
| FITF set to YES - revise initial settingFTFS | FTFS | |
| Applicant Has Filed a Verified Statement of Small Entity Status in Compliance with 37 CFR 1.27SMAL | SMAL | |
| Cleared by L&R (LARS)L128 | L128 | |
| Patent Term Adjustment - Ready for ExaminationPTA.RFE | PTA.RFE | |
| PTO/SB/69-Authorize EPO Access to Search ResultsSREXR141 | SREXR141 | |
| Applicants have given acceptable permission for participating foreignAPPERMS | APPERMS | |
| Referred to Level 2 (LARS) by OIPE CSRL198 | L198 | |
| Entity Status Set To Undiscounted (Initial Default Setting or Status Change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
3 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: application discontinuationABANDONED -- FAILURE TO PAY ISSUE FEESTCB | STCB | |
| Information on status: application discontinuationABANDONED -- FAILURE TO PAY ISSUE FEESTCB | STCB | |
| Information on status: patent application and granting procedure in generalDOCKETED NEW CASE - READY FOR EXAMINATIONSTPP | STPP |
Numbers
- Publication
- 20170103440
- Application
- 15390638
Titles
- English
- WEARABLE AUGMENTED REALITY EYEGLASS COMMUNICATION DEVICE INCLUDING MOBILE PHONE AND MOBILE COMPUTING VIA VIRTUAL TOUCH SCREEN GESTURE CONTROL AND NEURON COMMAND
Classification
- CPC, 55
- G06Q30/0625
- A61B5/1114
- G06F3/017
- A61B5/1121
- A61B5/1128
- G06F3/015
- G06T19/006
- A61B5/1172
- A61B5/1176
- G06F3/167
- G06F3/04883
- A61B5/6803
- G06F3/012
- H04W12/06
- G06F3/013
- H04W84/12
- G02B27/0172
- G08B21/06
- G06K7/10009
- G02B2027/0156
- H04W4/02
- G02B2027/0187
- H04B1/385
- G02B27/0176
- H04W4/22
- G06F1/163
- G06K7/10712
- G06F3/04815
- H04L67/22
- G06F2203/011
- H04L67/10
- G06Q30/0277
- G06Q30/0633
- G06Q20/102
- H04L63/083
- H04L63/0861
- G08B21/0453
- A61B5/0476
- G07F17/3209
- G07F17/3227
- G02B2027/0178
- G02B2027/0138
- G02B2027/014
- G02B2027/0141
- G02B2027/0145
- H04B2001/3866
- H04W4/90
- G06Q20/321
- G07F9/001
- G07F9/0235
- G07F7/1033
- G06Q20/3229
- A61B5/369
- H04W12/33
- H04L67/535
- IPC, 18
- G06Q30 06
- G06T19 00
- G06F3 16
- G06F3 0488
- G02B27 01
- G06K7 10
- H04W4 02
- H04B1 3827
- H04W4 22
- H04L29 08
- G06Q30 02
- G06Q20 10
- H04L29 06
- G08B21 04
- A61B5 0476
- G07F17 32
- G06F3 01
- H04W4 90