Augmented Reality Data Center Visualization
Claim Score by NHIP
Abstract
Datacenter datasets and other information are visually displayed in an augmented reality view using a portable device. The visual display of this information is presented along with a visual display of the actual datacenter environment. The combination of these two displays allows installers and technicians to view instructions or other data that are visually correlated to the environment in which they are working.

Term
Projected expiry 21 March 2032.
- Priority
- Filed
- Published
- Today
- Projected expiry
15 claims: 2 independent, 13 dependent
- 1A system for reporting data about a network datacenter to a user, said system comprising:an appliance adapted to provide said data about equipment in said network datacenter to said user in a data view, said appliance providing said data in combination with a real-time visual depiction of datacenter hardware, such that said data view is visually overlaid with said visual depiction of datacenter hardware in an augmented reality overlay.
- 8Broadest claimClaim Score 89, very broad(NHIP)A system for reporting data about at least a portion of a premises having telecommunication equipment therein, said system comprising:at least one trackable indicator having tracking information embedded therein;and an appliance adapted to display said data in response to acquiring said tracking information.
Independent claims2
38 paragraphs in 5 sections, as filed
CROSS-REFERENCE TO RELATED APPLICATIONS
0001This application claims priority from U.S. Provisional Application Ser. No. 61/466,355, filed Mar. 22, 2011, the entire disclosure of which is hereby incorporated by reference.
BACKGROUND OF THE INVENTION
0002The data center is a highly dynamic environment which requires multiple disciplines and technology owners to manage. Typically, different departments within a company are responsible for managing different functions, deployments, and operations; such as: space allocation, storage, network asset availability, server provisioning, and facilities management.
0003The sharing of information between these groups is often accomplished through manual data entry in spreadsheets and other static-view software tools such as AutoCad, MS Visio, and Aperture. This combination of manual entry and static-view tools can result in the presentation of outdated information to people who need updated information for a variety of tasks. Such tasks may include the installation or relocation of hardware, or the installation or movement of connections between existing network components.
0004There is a need for a system that combines up-to-date system information with the ability to present this information to key technical personnel in a highly useful format.
SUMMARY OF THE INVENTION
0005Accordingly, in one embodiment, the present invention is a system for reporting data about a network datacenter to a user, said system comprising an appliance adapted to provide said data about equipment in said network datacenter to said user in a data view, said appliance providing said data in combination with a real-time visual depiction of datacenter hardware, such that said data view is visually overlaid with said visual depiction of datacenter hardware in an augmented reality overlay.
0006In another embodiment, the present invention is a system for reporting data about at least a portion of a premises having telecommunication equipment therein, said system comprising: at least one trackable indicator having tracking information embedded therein; and an appliance adapted to display said data in response to acquiring said tracking information.
BRIEF DESCRIPTION OF THE DRAWINGS
0007The above-mentioned and other features and advantages of this invention, and the manner of attaining them, will become more apparent and the invention will be better understood by reference to the following description of an embodiment of the invention taken in conjunction with the accompanying drawings, wherein:
0008<figref idref="DRAWINGS">FIG. 1</figref> is a depiction of information that can be shown to a user using an augmented reality system according to some embodiments of the present invention;
0009<figref idref="DRAWINGS">FIG. 2</figref> shows an augmented reality display according to one embodiment of the present invention;
0010<figref idref="DRAWINGS">FIG. 3</figref> illustrates items relevant to work orders according to one embodiment of the present invention;
0011<figref idref="DRAWINGS">FIG. 4</figref> shows an augmented reality view according to one embodiment of the present invention;
0012<figref idref="DRAWINGS">FIG. 5</figref> is a combination illustration showing the use of trackable indicators according to one embodiment of the present invention;
0013<figref idref="DRAWINGS">FIG. 6</figref> illustrates a portable device showing a plan view according to one embodiment of the present invention; and
0014<figref idref="DRAWINGS">FIGS. 7A-7H</figref> are illustrations of a portable device guiding a technician according to one embodiment of the present invention.
0015Corresponding reference characters indicate corresponding parts throughout the several views. The exemplification set out herein illustrates preferred embodiments of the invention, in one form, and such exemplification is not to be construed as limiting the scope of the invention in any manner.
DETAILED DESCRIPTION OF EMBODIMENTS
0016Systems and methods according to some embodiments of the present invention combine augmented reality tools with network design and operational tools to provide a seamless and holistic view of data center operations, network uptime or bandwidth capability, environmental, and infrastructure status. In one embodiment of the present invention, a handheld visualization tool, such as a handheld device combining a camera with a video display, is used to combine a real-world view as seen by the camera with a computer-provided overlay of data or images relevant to the real-world view. Such a combination of features gives rise to a number of advantages.
0017One advantage of the present system is that data center planning before groundbreaking or procurement of assets can be done more efficiently. This arises because, for example, a real-world view of a data center space can be combined with a virtual view of data center assets. This enables a space-efficient correspondence between the data center space and the assets to be installed in the data center.
0018Another advantage of the present system is increased operational efficiency during moves, adds, and changes (MAC's) in connectivity in the data center. Further, both macro and micro views of data center information can provide the user with large data perspective viewing, while also enabling the user to drill down into micro-level information. This may be accomplished through a “fly” feature which allows the user to have a 3D view from above the Augmented Reality (AR) visuals (see <figref idref="DRAWINGS">FIG. 1</figref>), allowing a user to quickly travel between virtual locations using a display without needing to walk between the locations. Such a view allows the user to walk around through the datacenter and have the ability to pull up a series of views (application view, temperature view, powerview, planned view) dynamically as the user is moving through a potentially large environment.
0019Very precise locational guidance can be employed in the data center for use in multiple scenarios, including: work order deployment, hardware implementation mapping, port connectivity, virtual machine mapping, virtual machine transforms to multiple servers, technician deployment to a problem area in the datacenter, security violations, emergency response, and user asset deployment.
0020In different embodiments, multiple appliances may be used for viewing the visual data, including augmented reality (AR) glasses, virtual reality goggles, or a handheld device such as a PDA, which may be pointed at particular device, cabinet, or area in the data center in order to acquire information about the particular item.
0021<figref idref="DRAWINGS">FIG. 1</figref> is a depiction of information that may be provided to a user via AR. Using the AR glasses the user would approach the rack or cabinet and, upon focusing on a particular device, pull up environmental or power data. As is seen in <figref idref="DRAWINGS">FIG. 1</figref>, the user can choose different devices from the rack view <b>10</b>, and by using the AR software, extract different data relevant to the specific hardware selected by the user.
0022The user may choose connectivity data, and see end-to-end connectivity mapping of devices visually through the AR glasses. <figref idref="DRAWINGS">FIG. 1</figref> also shows a “lift” view feature <b>12</b> (showing the top down look at the data center). This allows the user to pull up information, for example in an information view <b>13</b>, by visually picking a certain rack or cabinet from the top-down view: from there the user could obtain rollup data for the particular cabinet, or pull up a 2D elevation view to pick certain devices for monitoring. This may be useful for very large data centers, and for efficient navigation through a data center. Also shown in <figref idref="DRAWINGS">FIG. 1</figref> is an infrastructure management view <b>14</b> that enables the user to see a physical location tree topology view for items selected from the AR view. A virtual machine logical view <b>16</b> allows for the visualization of virtual machines as they are executed on hardware within the view of the AR device.
0023In the rack view <b>10</b> of <figref idref="DRAWINGS">FIG. 1</figref>, a server <b>18</b> to be added to the rack <b>20</b> is inserted by the AR system into the rack view <b>10</b>, providing the technician with a view of the rack <b>20</b> as it will look following installation of the server <b>18</b>. Also visible in <figref idref="DRAWINGS">FIG. 1</figref> is an AR view of reserved space <b>21</b> in the rack <b>20</b>. As shown in <figref idref="DRAWINGS">FIG. 1</figref> the user has the ability with Augmented Reality (AR) to view information live in their immersive environment for asset tracking within a specific location in the data center. Further, an AR view may be used to overlay step-by-step instructions for installing hardware such as screws, cable managers, data cables, power cables, and labels.
0024The AR data center software may display both passive and active (real-time) data. For example, power data may be displayed over each specific device hovered over (either with AR goggles, or with a user interface on a handheld device). In addition, port-level connectivity information may be provided by a connectivity management device (such as a Panduit PViQ device) and displayed as a HUD (heads up display). An example of such a view is shown in <figref idref="DRAWINGS">FIG. 2</figref>, where traces <b>22</b> on an AR display give a visual indication of connections between different prices of hardware.
0025Application layer infatuation may be displayed on a per-device basis. Such information may include information on the operating system (OS) in use, information on the virtual machines installed on specific blade servers, and information on end-to-end port connectivity, software applications installed, and SLA (Software Licensing Agreement, Service Level Agreement) auditing.
0026Cabinet-level, rack-level, and room-level data/environmental/power data aggregations, or “rollups” may also be displayed in the AR software environment. For example, an AR view may be used to illustrate to a user the power dissipation by a room in a data center, a row of cabinets, or a particular rack. The temperature distribution in a room may be displayed visually. AR data center software may be used for move, add, change (MAC) deployment and continuation of cabling and connectivity change with work order software such as Panduit's work order software or through integration with other third party vendors. <figref idref="DRAWINGS">FIG. 2</figref> shows AR data displays <b>24</b> and <b>26</b>. The information data display <b>24</b> shows information about a server, and the work order data display <b>26</b> shows the ports that are involved in a MAC operation.
0027AR data center software coupled with a physical layer information system such as the Panduit PIM Physical Infrastructure Management system could visually guide technicians in many activities such as server provisioning and server decommissioning, with visual confirmation from the physical layer information system that connectivity is accomplished and being tracked. For example, <figref idref="DRAWINGS">FIG. 3</figref> shows instructions and views involved in a work order according to one embodiment of the present invention.
0028Item <b>1</b> in <figref idref="DRAWINGS">FIG. 3</figref> is a work order bar code, containing identification information about the work order itself. The work order illustrated in <figref idref="DRAWINGS">FIG. 3</figref> is instructing a technician to install three pieces of equipment, listed at item <b>3</b>, and make a connection between two of those pieces. Item <b>2</b> shows where the pieces can be found, and items <b>4</b> and <b>5</b> respectively show the room and cabinet where the pieces are to be installed. Item <b>6</b> in <figref idref="DRAWINGS">FIG. 3</figref> is a bar code listing of the rack unit (RU) locations where each piece is to be installed. Item <b>7</b> shows the technician a connection that is to be made between two of the pieces. A map <b>30</b> can be provided to guide the technician to the correct cabinet location, B, for the installation. An elevation view <b>32</b>, overlayed in an AR view, is provided to show the existing work order.
0029AR data center software coupled with a physical layer information system visually provides technicians with “what if,” scenarios that would result from deploying certain devices into a cabinet. Factors such as the impact of the installation on the health of cabinet and power usage can be displayed. Further, reserved space for future build outs can be shown on an AR display, as can the end state scenario of an installation.
0030AR data center software coupled with a physical layer information system may also visually provide technicians with port availability in certain pods to allow for quick decision-making for network connectivity at the patch field level.
0031In one embodiment of the present invention, AR technology is combined with data center information to enable more efficient data center construction. In this embodiment, contractors wear AR glasses that contain construction details. Step by step construction information is fed from multiple sources (such as AutoCad drawings, HVAC drawings, Work Order systems, and the like) such that the installers can visually see directionally where and how components should be deployed and in what order. Connection points and other details can be provided to the installer via the AR glasses.
0032In some embodiments of the present invention, technicians are guided visually through an AR data center environment to execute work orders. This allows the technician to view the work order details, as shown in <figref idref="DRAWINGS">FIG. 3</figref>, in the AR environment. The technician is then visually guided through the data center to the correct area, cabinet, or piece of equipment to complete the work. This visual guidance is shown in <figref idref="DRAWINGS">FIG. 4</figref>, with arrow <b>40</b> in an AR view showing a technician the proper cabinet <b>42</b> where a work order is to be performed.
0033<figref idref="DRAWINGS">FIG. 5</figref> shows an example implementation of an AR system according to one embodiment of the present invention. In the embodiment of <figref idref="DRAWINGS">FIG. 5</figref>, a portable device <b>50</b> is used to display an AR view <b>52</b> of hardware installed within a zone box <b>54</b> without needing to physically open the zone box <b>54</b>. In this illustration, the zone box <b>54</b> contains hardware enabling the connectivity of network equipment within nearby cubicles <b>55</b>. A trackable indicator <b>56</b>, such as a QR code, is within the view of a camera provided on the portable device <b>50</b>. This, in turn, allows the AR software to display an image along with other information regarding the hardware stored within the zone box <b>54</b>.
0034AR data, such as the image display in <figref idref="DRAWINGS">FIG. 5</figref> or connectivity information to be displayed in an AR view, can be acquired by the portable device or other AR viewer via communication with a database. Data for presentation on the AR-enabled device <b>50</b> can be acquired from a main database. Asset tracking features within a physical infrastructure management system (such as RFID, barcode, or switch uplink methods) may be used to keep the database up-to-date. Once the AR-enabled device recognizes a particular identifier (such as the indicator <b>56</b>), the device pulls relevant data from a database (either internal or wirelessly) and displays the AR overlay in the AR view <b>52</b>. The data to be viewed may be selected by the user via a menu.
0035<figref idref="DRAWINGS">FIG. 6</figref> shows the portable device <b>50</b> with a connectivity plan view <b>58</b> illustrating the connections between zone boxes and network equipment in cubicles. The zone box image <b>60</b> may be a snapshot illustrating the last known view of the zone box that the portable device <b>50</b> is pointed at. The connectivity plan view illustrates the floor plan of the area selected by the user. A switch display <b>59</b> may be provided simultaneously to show the switch ports that service the location shown in the connectivity plan view <b>58</b>. Alerts may also be provided in these views, for example to illustrate connectivity problems.
0036<figref idref="DRAWINGS">FIG. 7</figref> shows a series of views on a portable device <b>50</b> guiding a technician through a work order that requires the installation of network equipment. In a first view <b>70</b>, the technician receives a notification of a work order. Next, as shown in view <b>72</b>, the technician's location is determined and a map illustration <b>73</b> is shown on the device, illustrating the path for the technician to take to the location of the needed equipment to complete the work order. Next, as shown in view <b>74</b>, the AR view is used to place an indicator <b>75</b> on the screen showing the correct endpoint when more than one comparable end point is in view of the camera on the device <b>50</b>. When the correct store room is entered, as shown in view <b>76</b>, the camera on the device uses indicia provided on inventory to place an indicator <b>77</b> on the equipment needed to fulfill the work order.
0037Once the technician has confirmed pickup of the correct equipment, the map illustration <b>73</b> is used to indicate the path to the destination where the equipment is to be installed, as shown in view <b>78</b>. Next, an indicator <b>77</b> is shown on the display <b>80</b> to indicate the correct row where the equipment is to be installed. As the technician approaches the rack, the indicator <b>77</b> indicates the correct rack as shown in vie <b>82</b>. Finally, a connection display <b>83</b> guides the technician through the correct installation of the equipment as shown in view <b>84</b>. Once the MAC has been verified (via switch uplink or other means), the whole system is updated to reflect the change and maintain an accurate representation of the environment in the database.
0038While particular embodiments of the present invention have been shown and described, it will be obvious to those skilled in the art that changes may be made to these embodiments without departing from the teachings of our invention. The matter shown and described is offered by way of illustration only and not as a limitation.
Contents5
11 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2014281758A1 | Cited by | United States of America | Pre-grant |
| US10535202B2 | Cited by | United States of America | Search report |
| US2016212224A1 | Cited by | United States of America | Pre-grant |
| US9492900B2 | Cited by | United States of America | Applicant |
| US2019057181A1 | Cited by | United States of America | Search report |
| US10866631B2 | Cited by | United States of America | Applicant |
| US2014218398A1 | Cited by | United States of America | Pre-grant |
| US10099382B2 | Cited by | United States of America | Applicant |
| US9881425B1 | Cited by | United States of America | Search report |
| US10635423B2 | Cited by | United States of America | Applicant |
| US2017076504A1 | Cited by | United States of America | Search report |
| US9182892B2 | Cited by | United States of America | Applicant |
| US10649413B2 | Cited by | United States of America | Applicant |
| US8773467B2 | Cited by | United States of America | Search report |
| CN104007889A | Cited by | China | Search report |
| US2014340423A1 | Cited by | United States of America | Pre-grant |
| US10332314B2 | Cited by | United States of America | Search report |
| US9836888B2 | Cited by | United States of America | Search report |
| US10866952B2 | Cited by | United States of America | Applicant |
| US10649412B2 | Cited by | United States of America | Applicant |
| US10051041B2 | Cited by | United States of America | Applicant |
| US9391860B2 | Cited by | United States of America | Applicant |
| US10997832B1 | Cited by | United States of America | Applicant |
| US2020011696A1 | Cited by | United States of America | Search report |
| US2016380850A1 | Cited by | United States of America | Search report |
| US2012265876A1 | Cited by | United States of America | Pre-grant |
| US2014098137A1 | Cited by | United States of America | Pre-grant |
| US9880694B2 | Cited by | United States of America | Applicant |
| EP2994266A4 | Cited by | European Patent Office (EPO) | Search report |
| EP2865993B1 | Cited by | European Patent Office (EPO) | Examiner |
| US10109075B2 | Cited by | United States of America | Applicant |
| US10572362B2 | Cited by | United States of America | Applicant |
| US10740970B1 | Cited by | United States of America | Applicant |
| WO2021051007A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US10416857B2 | Cited by | United States of America | Applicant |
| US2014095244A1 | Cited by | United States of America | Search report |
| US10649424B2 | Cited by | United States of America | Applicant |
| WO2014144035A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9105126B2 | Cited by | United States of America | Applicant |
| US9292180B2 | Cited by | United States of America | Applicant |
| US10025486B2 | Cited by | United States of America | Applicant |
| US9858482B2 | Cited by | United States of America | Applicant |
| WO2020130267A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9712413B2 | Cited by | United States of America | Applicant |
| US10573084B2 | Cited by | United States of America | Applicant |
| US2018089870A1 | Cited by | United States of America | Pre-grant |
| JP2016520925A | Cited by | Japan | Search report |
| US2019057181A1 | Cited by | United States of America | Search report |
| US2016380850A1 | Cited by | United States of America | Search report |
| US10656627B2 | Cited by | United States of America | Applicant |
| US2012313963A1 | Cited by | United States of America | Pre-grant |
| US2012257794A1 | Cited by | United States of America | Pre-grant |
| US10007413B2 | Cited by | United States of America | Applicant |
| US9954907B2 | Cited by | United States of America | Applicant |
| CN105189038A | Cited by | China | Search report |
| US10649449B2 | Cited by | United States of America | Applicant |
| WO2014170040A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2015221134A1 | Cited by | United States of America | Pre-grant |
| US9092865B2 | Cited by | United States of America | Search report |
| US10691281B2 | Cited by | United States of America | Applicant |
| US10735691B2 | Cited by | United States of America | Applicant |
| US2016299481A1 | Cited by | United States of America | Search report |
| US9870444B2 | Cited by | United States of America | Applicant |
| US9959190B2 | Cited by | United States of America | Search report |
| US10997415B2 | Cited by | United States of America | Applicant |
| US10386827B2 | Cited by | United States of America | Applicant |
| US9141188B2 | Cited by | United States of America | Applicant |
| US10318570B2 | Cited by | United States of America | Applicant |
| US2012256953A1 | Cited by | United States of America | Pre-grant |
| US10740081B2 | Cited by | United States of America | Applicant |
| US2014281754A1 | Cited by | United States of America | Pre-grant |
| US10922907B2 | Cited by | United States of America | Applicant |
| US2014277596A1 | Cited by | United States of America | Search report |
| US8913086B2 | Cited by | United States of America | Search report |
| EP2942717A1 | Cited by | European Patent Office (EPO) | Search report |
| US9448623B2 | Cited by | United States of America | Applicant |
| US10671028B2 | Cited by | United States of America | Search report |
| US2019057181A1 | Cited by | United States of America | Search report |
| US2021096781A1 | Cited by | United States of America | Pre-grant |
| US10778730B2 | Cited by | United States of America | Applicant |
| US10445944B2 | Cited by | United States of America | Applicant |
| US2020250863A1 | Cited by | United States of America | Search report |
| US2019097896A1 | Cited by | United States of America | Search report |
| US10551799B2 | Cited by | United States of America | Applicant |
| US9110560B1 | Cited by | United States of America | Applicant |
| US10319128B2 | Cited by | United States of America | Search report |
| US10168691B2 | Cited by | United States of America | Applicant |
| US10269179B2 | Cited by | United States of America | Applicant |
| US2016380850A1 | Cited by | United States of America | Search report |
| US10663302B1 | Cited by | United States of America | Search report |
| US10051018B2 | Cited by | United States of America | Applicant |
| US2014095244A1 | Cited by | United States of America | Search report |
| US10628969B2 | Cited by | United States of America | Applicant |
| US10372096B2 | Cited by | United States of America | Search report |
| US2015109334A1 | Cited by | United States of America | Pre-grant |
| US2015049905A1 | Cited by | United States of America | Pre-grant |
| US10762470B2 | Cited by | United States of America | Search report |
| US10061481B2 | Cited by | United States of America | Applicant |
| US10771343B2 | Cited by | United States of America | Search report |
| US10771350B2 | Cited by | United States of America | Search report |
6 priority claims, no other members on record
Priority claims6
| Document | Office | Kind | Date |
|---|---|---|---|
| 201161466355 | United States of America | P | |
| 201161466355 | United States of America | P | |
| 201213426065 | United States of America | A | |
| 61466355 | – | – | – |
| US201161466355P | – | – | – |
| US201213426065 | – | – | – |
44 transactions on the USPTO file
Abandoned after 1 non-final rejection and 1 final rejection.
- Non-final rejections
- 1
- Final rejections
- 1
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Email NotificationEML_NTR | EML_NTR | |
| Mail Abandonment for Failure to Respond to Office ActionAbandonedMABN2 | MABN2 | |
| Aband. for Failure to Respond to O. A.AbandonedABN2 | ABN2 | |
| Email NotificationEML_NTR | EML_NTR | |
| Mail Advisory Action (PTOL - 303)MCTAV | MCTAV | |
| Advisory Action (PTOL-303)CTAV | CTAV | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Final ActionA.NE | A.NE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Electronic Information Disclosure StatementEIDS. | EIDS. | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Email NotificationEML_NTR | EML_NTR | |
| Email NotificationEML_NTR | EML_NTR | |
| Filing Receipt - UpdatedFLRCPT.U | FLRCPT.U | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Sent to Classification ContractorPGPC | PGPC | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| Applicants have given acceptable permission for participating foreignAPPERMS | APPERMS | |
| A statement by one or more inventors satisfying the requirement under 35 USC 115, Oath of the ApplicOATHDECL | OATHDECL | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTR | EML_NTR | |
| Email NotificationEML_NTF | EML_NTF | |
| Notice Mailed--Application Incomplete--Filing Date AssignedINCD | INCD | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Initial Exam Team nnIEXX | IEXX |
2 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: application discontinuationABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTIONSTCB | STCB | |
| AssignmentAS | AS |
Numbers
- Publication
- 20120249588
- Publication, DOCDB
- 2012249588
- Publication, EPODOC
- US2012249588
- Application
- 13426065
- Application, DOCDB
- 201213426065
- Application, EPODOC
- US201213426065
Titles
- English
- Augmented Reality Data Center Visualization
Classification
- CPC, 8
- G06F1/1696
- G01C21/206
- G06T11/00
- G06F16/9537
- G06F16/9554
- G06V20/20
- G06F17/00
- G06T19/006
- IPC, 2
- G09G5 00
- G06K9 62
- USPC, 2
- 345633000
- 382103000