US20170103440A1

Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command

Claim Score by NHIP

Read claim 20, the broadest

Abstract

Provided are an augmented reality, virtual reality and mixed reality eyeglass communication device and a method for facilitating shopping, payments and multimedia capture using an eyeglass communication device. The eyeglass communication device may comprise a frame, and a right earpiece and a left earpiece connected to the frame. The eyeglass communication device may comprise a processor configured to receive one or more commands of a user, perform operations associated with the commands of the user, receive product information, and process the product information. The eyeglass communication device may comprise a display connected to the frame and configured to display data received from the processor. The eyeglass communication device may comprise a transceiver electrically connected to the processor and configured to receive and transmit data over a wireless network. The eyeglass communication device may comprise a Subscriber Identification Module card slot, a camera, an earphone, a microphone, and a charging unit.

US20170103440A1, drawing sheet 1
Sheet 1 of 35

Term

Projected expiry 1 August 2035.

  1. Priority
  2. Filed
  3. Published
  4. Today
  5. Projected expiry

20 claims: 3 independent, 17 dependent

  1. 1
    An augmented reality, virtual reality and mixed reality eyeglass communication device comprising:a frame having a first end and a second end;a right earpiece and a left earpiece, wherein the right earpiece is connected to the first end of the frame and the left earpiece is connected to the second end of the frame;a camera disposed on the frame, the right earpiece or the left earpiece, the camera being configured to track a hand gesture command of a user;a processor disposed in the frame, the right earpiece or the left earpiece and configured to receive one or more commands of the user, perform operations associated with the commands of the user, process the hand gesture command tracked by the camera, receive product information, and process the product information;at least one display connected to the frame and configured to display data received from the processor, the display comprising: an optical prism element embedded in the display, and a projector embedded in the display, the projector being configured to project the data received from the processor to the optical prism element and to project the data received from the processor to a surface in environment of the user, the data including a virtual touch screen environment;a transceiver electrically coupled to the processor and configured to receive and transmit data over a wireless network;a Subscriber Identification Module (SIM) card slot disposed in the frame, the right earpiece or the left earpiece and configured to receive a SIM card;at least one earphone disposed on the right earpiece or the left earpiece;a microphone configured to sense a voice command of the user;and a charging unit connected to the frame, the right earpiece or the left earpiece;at least one electroencephalograph sensor configured to sense brain activity of the user;a gesture recognition unit including at least three dimensional gesture recognition sensors, a range finder, a depth camera, and a rear projection system, the gesture recognition unit being configured to track the hand gesture command of the user, the hand gesture command being processed by the processor, wherein the hand gesture command is associated with vertices and lines of a hand of the user, the vertices and lines being in a specific relation;and wherein the augmented reality eyeglass communication device is configured to perform phone communication functions;wherein further comprising sensors, wherein the sensors includes a motion sensing unit configured to sense head movement of the user, and an eye-tracking unit configured to track eye movement of the user;wherein the voice command includes a voice memo, and a voice message;wherein the microphone is configured to sense voice data and to transmit the voice data to the processor;wherein the charging unit includes one or more solar cells configured to charge the device, a wireless charger accessory, and a vibration charger configured to charge the devices using natural movement vibrations;wherein the user interacts with the data projected to the surface in environment, the interaction being performed through the hand gesture command;wherein the gesture recognition unit is configured to identify multiple hand gesture commands of the user or gestures of a human, hand gesture commands of the user or gestures of a human including depth data, finger data, and hand data;wherein the processing of the hand gesture command includes correlating of the hand gesture command with a template from a template database;wherein the rear projector system is configured to project the virtual touch screen environment in front of the user, the hand gesture command being captured combined with the virtual touch screen environment;wherein the display is configured as a prescription lens, a non-prescription lens, a safety lens, a lens without diopters, or a bionic contact lens, the bionic contact lens including integrated circuitry for wireless communication;wherein the display includes a see-through material to display simultaneously a picture of real world and data requested by the user;wherein the camera is configured to capture front-, rear-, top-, left- or right-side area around the device;wherein the camera is configured to simultaneously perform video recording and image capturing.
  2. 17
    A method for facilitating shopping using an augmented reality eyeglass communication device, the augmented reality, virtual reality and mixed reality eyeglass communication device comprising the augmented reality eyeglass communication device, and the method comprising:receiving, by a processor of the augmented reality eyeglass communication device, product information associated with products comprised in a list of products of a user;receiving, by the processor, location information associated with location of the user;searching, based on the product information, by the processor, a database associated with a store for availability, location and pricing information associated with the products;receiving, by the processor, the availability, location and pricing information associated with the product;and displaying, by a display of the augmented reality eyeglass communication device, the availability, location and pricing information associated with the product;further comprising: plotting a route for the user on a map of the store based on the availability, location and pricing information associated with the product and the location information associated with the location of the user;and displaying, by the display, the route for the user;further comprising: receiving, by the processor, a command of the user to provide description of a product present in the store;receiving, by the processor, information associated with the product present in the store, wherein receiving information associated with the product present in the store includes taking a picture of the product, scanning a barcode of the product and reading a RFID tag of the product;processing, by the processor, the received information associated with the product present in the store;searching, based on the received information associated with the product, by the processor, the description of the product in a database available in a network;receiving, by the processor, the description of the product;and displaying, by the display, the description of the product present in the store;further comprising: tracking, by a camera, a hand gesture command of the user;processing, by the processor, the hand gesture command of the user;and projecting, by a projector, the description of the product to a surface in environment of the user according to the hand gesture command, wherein the surface in environment of the user includes a vertical surface in environment of the user, a horizontal surface in environment of the user, an inclined surface in environment of the user, a surface of a physical object in environment of the user, and a part of a body of the user.
  3. 20
    Broadest claimClaim Score 66, broad(NHIP)A non-transitory computer-readable medium comprising instructions, which when executed by one or more processors, perform the following operations:receive product information associated with products comprised in a list of products of a user;receive location information associated with location of the user;search a database associated with a store for availability, location and pricing information associated with the products;receive the availability, location and pricing information associated with the product;and display the availability, location and pricing information associated with the product.