Virtual reality force emulation
Claim Score by NHIP
Abstract
Multi-dimensional, non-linked method and apparatus for producing a simulated feeling of force on a preselected location on a human operator in a synthesized environment accomplished by generating a first, constant, stationary electromagnetic field and a second, varying electromagnetic field local to the human operator. The variance of the second electromagnetic field is controlled by electrical currents which are responsive to parameters describing the position and orientation of said preselected location on the human operator and such variance results in attraction and repulsion of the first and second electromagnetic fields emulating a feeling of force on the human subject.
Term
Term ended
Projected expiry passed 2 April 2018, 8.5 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
17 claims: 3 independent, 14 dependent
- 1A non-linked method for providing a feeling of force to a human operator comprising the steps of:generating a first, constant, stationary electromagnetic field;sensing three-dimensional position and orientation of said human operator relative to said first, constant, stationary electromagnetic field;communicating data from said sensing step to a microprocessing computing device;generating an electric signal responsive to data from said communicating step;producing a second, varying electromagnetic field local to said human operator responsive to said electrical signal from said generating step;and coupling a force generated by interaction of said first and second electromagnetic fields to said human operator.
- 7Broadest claimClaim Score 65, broad(NHIP)An non-linked system for providing a feeling of force to a human operator comprising:a first, constant, stationary electromagnetic field generating apparatus;sensing apparatus appended to said human operator for locating three-dimensional orientation of said human operator relative to said first, constant, stationary electromagnetic field;a second electromagnetic field local to said human operator and responsive to three-dimensional position and orientation data of said human operator;a computer apparatus capable of varying said second electromagnetic field to generate attractive and repulsive forces acting on said human operator in response to signals received from said sensing apparatus.
- 17An untethered system for providing force virtual reality to a human operator comprising:a first, constant, stationary electromagnetic field;externally powered sensing apparatus appended to a glove-type device on a hand of said human operator for determining three-dimensional angular and linear orientation of said hand of said human operator relative to said first, constant, stationary electromagnetic field;a second electromagnetic field local to said human operator and responsive to three-dimensional angular and linear orientation data of said hand of said human operator;a microprocessing computing device operative to receive and generate data to vary said second electromagnetic field to generate attractive and repulsive forces between said first and second electromagnetic fields which direct a force on said human operator.
Independent claims3
63 paragraphs in 5 sections, as filed
RIGHTS OF THE GOVERNMENT
The invention described herein may be manufactured and used by or for the Government of the United States for all governmental purposes without the payment of any royalty.
BACKGROUND OF THE INVENTION
This invention relates to the field of generating forces in a virtual reality setting and more specifically to the field of generating forces in a virtual reality setting without physical attachment to a reference source.
Virtual reality simulators are widely used for training in space, aviation and large vehicle driving operations where a specific environment is simulated so the trainee can learn and practice appropriate responses. The more realistic the simulated environment, the more realistic the responses learned by the trainee so the trainee's performance during a real-time operation is superior. Training in virtual reality simulators is more practical and less costly than using real-time operational equipment. Virtual reality simulators simulating a variety of environments are also widely used for recreational purposes.
To make the simulated environment as realistic as possible, there is interest in producing a feeling of force or proprioceptive feedback to the human operator as he tries to interact in the virtual environment. In most operational environments, where an operator receives a feeling of force on one or more parts of the body, there is no connection or attachment from the part of the body receiving the feeling of force to any other objects. Most virtual reality systems simulating force, however, must attach or link the part of the body receiving the force to a reference frame and the feeling of attachment minimizes the realism of the simulation.
Known systems operate under an action-reaction scenario based on the traditional Newton's third law concept of bodies in contact in which the equipment attached to the human subject is also attached to either a spring or other force reflecting coupling system or possibly to a track where its motion can be carefully controlled. Attaching a human subject to a spring or other force reflecting coupling system minimizes the effectiveness of the simulator when such attachment or coupling does not occur in an operational environment. When an attached or tethered force reflecting device is used in today's modem virtual reality simulation systems, there is a loss of realism as the human becomes aware of his tethering to a local stationary frame.
It is known to have force reflection in virtual reality systems in multiple, as opposed to single dimensions, thus, producing a more realistic force feeling. However, all known systems in the art are arranged so that a tether, ground source or reference frame is attached to the human subject.
One goal of the invention is to capitalize on the concept of an “action at a distance” method of reflecting forces as opposed to the traditional Newton's third law concept of “action-reaction” with bodies in contact as is used in devices known in the art. The “action at a distance” concept is successfully employed in the virtual reality environment by using electromagnetic fields and forces in three dimensions. The electromagnetic fields generate the force feeling on the human operator without the human operator being attached or connected to a reference source, thereby increasing the realism of the simulation.
SUMMARY OF THE INVENTION
Multi-dimensional, non-linked method and apparatus for producing a simulated feeling of force by generating a first, constant, stationary electromagnetic field and a second, interacting electromagnetic field local to the human operator. The second electromagnetic field is varying and is controlled by electrical currents which are responsive to parameters describing the location of the human operator and such variance results in attraction and repulsion between the first and second electromagnetic fields producing a non-linked magnetic field force on the human subject.
An object of the present invention is, therefore, to provide a magnetic field force to a human subject.
Another object of the invention is to provide a magnetic field force to a human subject with the human subject free from any attachments or links to a reference frame.
Another object of the invention is to provide a feeling of force to a human subject for complete immersion in a virtual reality environment.
Another object of the invention is to provide a non-linked magnetic field force to a preselected location or perception point on a human subject.
Another object of the invention is to provide a multi-dimensional magnetic field force to a human subject free from any attachments to a reference frame.
Another object of the invention is to provide a multi-dimensional non-linked magnetic field force to a preselected location on a human subject for complete immersion in a virtual reality environment.
Additional objects and features of the invention will be understood from the following description and the accompanying drawings.
These and other objects of the invention are achieved by a non-linked method for providing a feeling of force to a human operator comprising the steps of:
generating a first, constant, stationary electromagnetic field;
sensing position and three-dimensional orientation of said human operator relative to said first, constant, stationary electromagnetic field;
producing a second, varying electromagnetic field local to said human operator responsive to position and three-dimensional orientation of said human operator;
directing a force on said human operator resulting from attracting and repulsing forces between said first and second electromagnetic fields.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic diagram of a stator and rotor arrangement used in a DC motor in the prior art.
FIG. 2 is a frontal view of a glove type untethered virtual reality force emulator apparatus in accordance with the invention.
FIG. 3 is a schematic diagram showing force developed on a conductor in an electromagnetic field.
FIG. 4 is a schematic of an actuator element.
FIG. 5 is a glove type apparatus immersed in an electromagnetic field in accordance with the invention.
FIG. 6 is a schematic of a layered actuator element.
FIG. 7 is a diagram showing the geometry of force vectors.
FIG. 8 is a shoulder-to-arm force emulator system in accordance with the invention.
FIG. 8<i>a </i>is a diagram showing references for angular displacement in accordance with the invention.
FIG. 9 is a diagram showing a solenoid with an associated electromagnetic field.
FIG. 10 shows a Helmholz coil generated magnetic field in accordance with the invention.
FIG. 11 shows Helmholz coil generated magnetic fields in two planes.
DETAILED DESCRIPTION
The invention may be better understood by first considering the basic concepts of electromagnetic interaction and force generation, as is employed in a DC motor, for example, and then extrapolating such concepts to the present invention. FIG. 1 shows a prior art DC motor that is known in the art. In FIG. 1, the stationary part of the motor, or the stator, is shown to include the magnetic poles at <b>100</b>, <b>101</b>, <b>102</b> and <b>103</b>. The rotating part of the motor, or the rotor, is shown at <b>104</b>. The mechanical load rotated by the motor is shown at <b>108</b>. The stator poles, <b>100</b>, <b>101</b>, <b>102</b> and <b>103</b> remain stationary and have constant magnetic polarities associated with each of them, polarities controlled via external power excitation as indicated at <b>109</b>. The magnetic field at poles 100 and 102 have a North magnetic polarity and the magnetic field at poles <b>101</b> and <b>103</b> have a South magnetic polarity. The lines of flux that become generated by these opposite magnetic polarities are indicated at <b>110</b>.
The rotor, indicated in FIG. 1 at the center of the motor diagram by the barbell type device at <b>104</b>, has a North magnetic pole shown at <b>105</b> and a South magnetic pole shown at <b>106</b>. It is generally known in the area of electromagnetics that the South pole <b>106</b> is attracted to the North pole <b>102</b> and conversely. Also, if a North pole encounters another North pole, the two poles repel. This repulsion also occurs if a South pole encounters a South pole. In the instant shown in FIG. 1, the rotor <b>104</b> at the pole <b>105</b> is therefore being repelled by the stator at pole <b>100</b> and simultaneously being attracted to stator pole <b>101</b>. This tends to produce rotation in a counter-clockwise direction. When the rotor pole <b>105</b> arrives at the stator pole <b>101</b>, the currents in the rotor winding, shown at <b>111</b> are changed such that the polarity of pole <b>105</b> is changed from North to South. Since the rotor <b>104</b> was already moving, the additional repulsion between poles <b>101</b> and <b>105</b> will now move the rotor further in a counterclockwise motion towards stator pole <b>102</b>. Recall stator pole <b>102</b> has a North polarity and pole <b>105</b> of the rotor (now with a South polarity) will then be attracted to stator pole <b>102</b>. This motion continues with the polarity of the rotor poles changing every quarter cycle as the rotor moves in the counter clockwise manner shown at <b>107</b>.
The rotor <b>104</b> is often attached to a load, a load generally depicted at <b>108</b> in FIG. 1, thereby the initial electrical energy input to the motor device is transformed into mechanical energy of load rotation. The device thus described is one-dimensional and functions in a planar type of movement. The DC motor of FIG. 1, therefore, may be considered to demonstrate the concept of “action at a distance”, a method of force generation in which mechanical energy is transferred to the environment without any objects or surfaces coming into direct contact with one another. This is different from the traditional Newton's Third Law “action-reaction” scenario in which an object reacts to a given force through direct contact.
To better understand what other variables may influence the force generated via electromagnetic interaction, and hence better understand the invention, it is worthwhile to examine how a force can be produced on a single electrical particle by its movement in an electromagnetic field. From the basic principles of physics, the force acting on a charge q, when moving with a velocity v in an external field, can be described by the relationship:
<maths><formula-text>F=q v×B (Eq. 1) </formula-text></maths>
Where the vector v is a velocity vector indicating the direction of the charge q relative to the external (constant) B field. The variable B is the magnetic induction vector that has units of Webers/meter<sup>2</sup>. The cross product term x indicates that the force acting on the charge q is at right angles to both the v and B vectors. Thus, the force generated is proportional to the quantity of charge, its velocity, the intensity of the external B field, and the orientation between v the vector and the B field. To illustrate this basic principle of physics, consider FIG. 3, which illustrates the relationship of Eq. 1 for the flow of many charges q. FIG. 3 shows a magnetic field B at <b>303</b>, current at <b>301</b> and conductor length at <b>302</b>. In FIG. 3, the flux lines of the B field are shown at <b>300</b>, a current is shown at <b>301</b> moving from right to left in a conductor whose length is illustrated at <b>302</b>. The current i(t), shown at <b>301</b>, is a summation of charges and the force, F, on the conductor can be expressed by the relationship
<maths><formula-text>F=i(t) L×B (Eq. 2) </formula-text></maths>
Where L is a vector indicating the direction of the current i(t). Eq. 2 is similar to Eq. 1 but applies for multiple charges and demonstrates the dependency of the force developed on the quantity and orientation of the current as well as the length of the conductor L affected in the external B field. The principle of the operation of a force generated on a conductor as depicted in FIG. 3 provides a basis for all types of force generation in electromagnetic devices including electric motors as shown in FIG. <b>1</b>. The effect could also be illustrated through the interaction of two electromagnetic fields, that is, the external field having flux lines at <b>300</b> in FIG. 3 and a field generated by the current shown at <b>301</b> in FIG. 3 opposing the external field at <b>300</b>. This is the basis of force generation for the non-linked magnetic field force system of the invention.
This effect may be extrapolated to an arrangement of the invention involving a glove device in a virtual reality simulation as shown in FIG. 2 where the external magnetic field shown at <b>200</b>, and the glove device generally shown at <b>202</b> operates in a magnetic field. Force actuators are shown at <b>204</b>. An attached microprocessor, such as is shown connected at <b>203</b> in FIG. 2, is responsible for computing the actual position and orientation of the body part, a hand in the arrangement of FIG. 2, to institute necessary currents in the force actuators. Referring to the description of the DC motor, the external field <b>200</b> remains constant as do the stator poles at <b>100</b>, <b>101</b>, <b>102</b> and <b>103</b> in FIG. <b>1</b>. The rotor, at <b>104</b> in FIG. 1, has a current coil therein whose current valued is changed, this in turn changes the polarity of the rotor poles. A similar action occurs in the force actuators <b>204</b> on the glove device in the arrangement of FIG. <b>2</b>. The current within the force actuator changes value, which in turn changes the magnetic field local to the glove device. Assume for example, that a feeling of force is desired on the glove-type device, the actual orientation of the glove-type device is determined by the microprocessor, which obtains position and orientation information in the form of electrical signals from the goiniometers at 205. After data indicating the three-dimensional position and orientation of the glove-type device with respect to the magnetic field <b>200</b> are communicated to the microprocessor, the microprocessor then computes the value and vector direction of the magnetic field local to the glove-type device needed to cause the static electromagnetic field to repulse the local magnetic field and emulate a feeling of force in the intended direction on the glove-type device. A sample software algorithm is provided as Appendix A, which provides means for the microprocessor to coordinate and keep track of position and orientation of the sensors and actuators. The software algorithm is written in MS BASIC language.
The FIG. 10 arrangement of the invention uses a Helmholz type coil to generate a first, constant, stationary magnetic field. The Helmholz coils are shown at <b>1010</b> in FIG. <b>10</b> and the glove-type device is shown at <b>1020</b>. The Helmholz coil is known in the art and has the unique ability to produce an electromagnetic field which is very uniform and homogeneous. The flux lines of the magnetic field generated by the Helmholz coil are shown at <b>1040</b>. After the electromagnetic field <b>1040</b> is maintained constant, the glove-type device <b>1020</b> is then inserted into the field, the glove-type device appended with a three-dimensional force actuator shown at <b>1030</b>. In relation to the DC motor example, the Hehmholz coil acts as a stator and the three dimensional force actuator <b>1030</b> equates to the rotor device.
Another possible arrangement for generating a more than one constant, stationary electromagnetic field is by using two Helmhotz coil generated magnetic fields at right angles to each other as shown in FIG. <b>11</b>. Such an arrangement allows for non-linked magnetic field force generation in more than one plane. In FIG. 11, a first constant electromagnetic field is generated between Helmhotz coils shown at <b>1111</b> and <b>1112</b> with the associated magnetic flux lines flowing in the “X” direction on the world coordinate system. A second electromagnetic field, perpendicular to the first electromagnetic field is generated between Helmhotz coils shown at <b>1113</b> and <b>1114</b> with the associated magnetic flux lines flowing in the “Y” direction on the world coordinate system. If the magnetic fields of FIG. 11 are pulsed on and off sequentially every millisecond, it is possible to generate non-linked magnetic field forces in more than one plane on, for example, a glove-type device inserted within the magnetic fields, in a similar manner as force generation accomplished in a single plane.
There are various ways to determine the actual orientation of the human subject's body part, the hand in the arrangement of FIG. 2 that will receive a virtual reality force. The determination is not entirely different from having a global positioning system at each key joint of the human operator to determine the position and orientation of each respective coordinate frame in space. One method of determining position and orientation, commonly accomplished in the field of robotics is by measuring the changes of the joint angles and the lengths of the respective links making up the system. In FIG. 8, a shoulder-to-arm arrangement of the invention is depicted. The flux lines of the first, stationary, constant magnetic field are shown at <b>800</b>, the force actuators are shown at <b>801</b> and goiniometers or position and orientation sensors are shown at <b>802</b> and <b>803</b>. Simple trigonometric measurements of the arm system using goiniometeres <b>802</b> and <b>803</b> as shown in FIG. 8 are used to determine the joint angles.
FIG. 8<i>a </i>is a diagram of the angle relationships of the position sensors <b>802</b> and <b>803</b> in FIG. <b>8</b>. The goiniometer has a fixed reference base as indicated at <b>805</b> in FIG. 8<i>a </i>and is the origin of the world coordinate system. The angles shown at <b>806</b> and <b>807</b> are each sensed via either a rotational potentiometer or an encoder, which counts the number of passing slots as the angle <b>806</b> changes. For example, a 10-bit encoder has 2<sup>10</sup>=1024 slots and for a full rotation of 360 degrees, the degree change per slot is 360 degrees divided by 1024 which equals 0.352 degrees per slot. Thus, the angle: <b>806</b> and <b>807</b> in FIG. 8<i>a </i>can be sensed as they change. Similarly, the lengths shown, at <b>810</b> and <b>811</b> are also known as shown in the algorithm of the microprocessor, attached as Appendix A. Thus in FIG. 8<i>a, </i>the point shown at <b>809</b> can be y-axis located with respect to the origin at point <b>805</b> by the length represented at <b>810</b> multiplied by the sine of angle <b>806</b> and adding the product of the length represented at <b>811</b> multiplied by the sine of angle <b>807</b>. Similarly, the x-axis position change of point <b>809</b> relative to the origin at point <b>805</b> can be determined by multiplying the length represented at <b>810</b> by the cosine of the angle at <b>806</b> and adding the product of the length represented at <b>811</b> by the cosine of the angle at <b>807</b>. Therefore, the microprocessor contains an algorithm to locate the point at <b>809</b> representing the human subject's body part, relative to the origin at point <b>805</b>, utilizing only the lengths represented at <b>810</b> and <b>811</b> and the measurement of angles <b>806</b> and <b>807</b>. The joint angles can be sensed by devices other than goiniometers and the art has demonstrated alternative means such as potentiometers and magnetic devices for achieving this objective.
Knowing the location of point <b>809</b> in FIG. 8<i>a, </i>or the human subject's body part, relative to the origin at <b>805</b> allows the microprocessor to then generate a current in the windings of the force actuators, which in turn produces, a proportionately valued electromagnetic field. An electromagnetic field of appropriate polarity local to the human subject and having a lower strength than the static, stationary electromagnetic B field will result in the B field repulsing the field local to the human subject resulting in a feeling of force on the human subject. The field B at <b>800</b> in FIG. 8 is constant, however, the local field at <b>801</b> may vary with time, producing a force reflected on the human, which varies with time. The variation of the forces produced at <b>801</b> will change depending on the position and orientation of the human arm. It is, therefore, the operation of the microprocessor to track the orientation of the force actuators as well as to coordinate their relative movement. The microprocessor will allow the gradual changes in forces such that the human operator does not experience sudden or abrupt force changes.
The inputs and outputs required for the microprocessor to work include all joint lengths and prior knowledge of the link lengths. As shown in FIG. 8<i>a, </i>each position sensor has a reference point and the goal is to track the position of the most distal point, point <b>809</b> in FIG. 8<i>a. </i>One method for accomplishing this task is to use the Denavit-Hartenberg (hereinafter “D-H”) method. The D-H method involves using a matrix, which keeps track of both position, and orientation changes as the human subject moves and rotates through space. The D-H matrix is of the form <maths><math><mtable><mtr><mtd><mrow><mrow><msub><mo> </mo><mrow><msup><mo> </mo><mi>A</mi></msup><mo></mo><mi>B</mi></mrow></msub><mo></mo><mi>T</mi></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mi>R</mi></mtd><mtd><mi>P</mi></mtd></mtr><mtr><mtd><mrow><mn>0</mn><mo>,</mo><mn>0</mn><mo>,</mo><mn>0</mn></mrow></mtd><mtd><mn>1</mn></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mstyle><mtext>Eq. 4</mtext></mstyle></mtd></mtr></mtable></math><img id="EMI-M00001" file="USH0002017-20020402-M00001.TIF" img-content="math" img-format="tif" alt="embedded image" /><attachments><attachment idref="MATHEMATICA-00001" attachment-type="nb" file="USH0002017-20020402-M00001.NB" /></attachments></maths>
where R is a 3×3-rotation matrix, and P is a 3×1 column vector which tracks the change in position. The 4×4 matrix <sup>A</sup><sub>B</sub>T tracks the change in position when the system moves from frame A to frame B. Appendix A illustrates representative software in MS BASIC to show a simple example in implementation.
FIG. 5 illustrates how both position and orientation can be tracked using a D-H matrix. A system is originally in frame A, shown at <b>500</b> and identified at <b>501</b> in FIG. 5, and is rotated and translated to frame B at <b>506</b> and identified at <b>507</b> by a 30 degree rotation, such angle shown at <b>502</b>, about the Z axis of frame A and translated 4 units in the X<sub>A</sub>, <b>503</b>, direction and 3 units in the Y<sub>A </sub><b>504</b>, direction. The D-H matrix corresponding to FIG. 5 is <maths><math><mtable><mtr><mtd><mrow><mrow><msub><mo> </mo><mrow><msup><mo> </mo><mi>B</mi></msup><mo></mo><mi>A</mi></mrow></msub><mo></mo><mi>T</mi></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><msub><mi>A</mi><mi>B</mi></msub><mo></mo><msup><mi>R</mi><mi>T</mi></msup></mrow></mtd><mtd><mrow><mrow><mo>-</mo><mmultiscripts><mi>R</mi><none /><mi>T</mi><mprescripts /><mi>B</mi><mi>A</mi></mmultiscripts></mrow><mo></mo><mmultiscripts><mi>P</mi><mi>BORG</mi><mstyle><mtext> </mtext></mstyle><mprescripts /><mstyle><mtext> </mtext></mstyle><mi>A</mi></mmultiscripts></mrow></mtd></mtr><mtr><mtd><mrow><mn>0</mn><mo>,</mo><mn>0</mn><mo>,</mo><mn>0</mn></mrow></mtd><mtd><mn>1</mn></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mstyle><mtext>Eq. 5</mtext></mstyle></mtd></mtr><mtr><mtd><mrow><mrow><mi>where</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><mmultiscripts><mi>R</mi><none /><mi>T</mi><mprescripts /><mrow><msup><mo> </mo><mi>A</mi></msup><mo></mo><mi>B</mi></mrow><none /></mmultiscripts></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><mi>c</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><msub><mi>θ</mi><mi>z</mi></msub></mrow></mtd><mtd><mrow><mi>s</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><msub><mi>θ</mi><mi>z</mi></msub></mrow></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mrow><mrow><mo>-</mo><mi>s</mi></mrow><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><msub><mi>θ</mi><mi>z</mi></msub></mrow></mtd><mtd><mrow><mi>c</mi><mo></mo><mstyle><mtext> </mtext></mstyle><mo></mo><msub><mi>θ</mi><mi>z</mi></msub></mrow></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>1</mn></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mstyle><mtext>Eq. 6</mtext></mstyle></mtd></mtr></mtable></math><img id="EMI-M00002" file="USH0002017-20020402-M00002.TIF" img-content="math" img-format="tif" alt="embedded image" /><attachments><attachment idref="MATHEMATICA-00002" attachment-type="nb" file="USH0002017-20020402-M00002.NB" /></attachments></maths>
where cθ<sub>z </sub>and sθ<sub>z </sub>are short hand notation for cosine and sine of the angle θ<sub>z</sub>. The vector <sup>A</sup>P<sub>BORG </sub>is given by col[4,3,0] and <maths><math><mtable><mtr><mtd><mrow><mrow><msub><mo> </mo><mrow><msup><mo> </mo><mi>B</mi></msup><mo></mo><mi>A</mi></mrow></msub><mo></mo><mi>T</mi></mrow><mo>=</mo><mrow><mo>[</mo><mtable><mtr><mtd><mn>0.866</mn></mtd><mtd><mn>0.5</mn></mtd><mtd><mn>0</mn></mtd><mtd><mrow><mo>-</mo><mn>4.964</mn></mrow></mtd></mtr><mtr><mtd><mrow><mo>-</mo><mn>0.5</mn></mrow></mtd><mtd><mn>0.866</mn></mtd><mtd><mn>0</mn></mtd><mtd><mrow><mo>-</mo><mn>0.598</mn></mrow></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>1</mn></mtd><mtd><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>0</mn></mtd><mtd><mn>1</mn></mtd></mtr></mtable><mo>]</mo></mrow></mrow></mtd><mtd><mstyle><mtext>Eq. 7</mtext></mstyle></mtd></mtr></mtable></math><img id="EMI-M00003" file="USH0002017-20020402-M00003.TIF" img-content="math" img-format="tif" alt="embedded image" /><attachments><attachment idref="MATHEMATICA-00003" attachment-type="nb" file="USH0002017-20020402-M00003.NB" /></attachments></maths>
The result shown in Eq. 7 is called forward kinematics. To determine inverse kinematics, compute <sup>A</sup><sub>B</sub>T by inverting the matrix of Eq. 7. In practice, the angles θ are measured, the rotation matrix is known, the P<sub>BORG </sub>matrix is determined using the known link lengths and <sup>A</sup><sub>B</sub>T or <sup>B</sup><sub>A</sub>T is calculated.
Thus, the D-H matrix keeps track of both the position and orientation change of a coordinate frame and can be used to track the point <b>809</b> in FIG. 8<i>a, </i>as an example. It is only required to know the link lengths and the angle changes to determine both the position and orientation of point <b>809</b>.
To calculate the strength and size of the magnetic fields used in the invention, the first, constant, stationary magnetic field and the varying magnetic field local to the body part of the human subject, assume, as an example, a 0.2 pound force is desired. Studies in the art dealing with subjects involving force-reflecting devices generally have demonstrated that significantly less than one pound of force on the arm or hand over any period of time exceeding a few seconds is extremely instrumental in modifying limb motion trajectories. It is easier to consider this problem in SI (Systems International) units. Thus, 0.2 pounds of force =0.2/(0.2248 pounds/Newton) which is approximately equivalent to 1 Newton of Force.
The equation B=u<sub>o</sub>i<sub>o</sub>n may be used to determine the parameters of a solenoid capable of providing an external magnetic field B supporting this force of 1 Newton. FIG. 9 shows a typical solenoid with an external electromagnetic field where n is the number of turns <b>901</b> of wire on the solenoid shown at <b>903</b>, i is the current in the solenoid as shown at <b>902</b>, and u is the permeability of air =4π×10<sup>−7</sup>. Thus, as an example, a solenoid of 1 meter in length, 3 centimeters in diameter, which has 10 layers of windings of 850 turns each and carries a current of 10 amperes generates an external field of 0.11 Weber/meters<sup>2</sup>. Note that a Weber is 10<sup>8 </sup>lines of force per square meter and levels of 0.1 Telsa (Webers/meters<sup>2</sup>) is not considered hazardous by OSHA standards. After the external field B is established, the force can be determined that acts on the actuator via the relationship set forth in Eq. 2.
The unattached force emulating device and method of the invention may be accomplished in three dimensions, increasing the realism of the simulation. FIG. 4 illustrates a three-axis element for use in a three-dimensional force reflection paradigm. A three-axis coil element which can generate forces and moments in all three-dimensions is obtained by wrapping three coils, shown at <b>400</b>, <b>401</b> and <b>402</b> in FIG. 4, about three ferrous metal cores shown at <b>403</b>, <b>404</b> and <b>405</b> in orthogonal axis.
The three ferrous metal cores <b>403</b>, <b>404</b> and <b>405</b> only touch each other at the X, Y and Z-axes, shown at <b>406</b>, <b>407</b> and <b>408</b>, respectively. At the intersections of the X, Y and Z-axes at <b>406</b>, <b>407</b> and <b>408</b>, the three ferrous metal cores are isolated from one another by a varnishing separator which provides high electrical resistance to eddy currents that may be induced yet permits the magnetic fields to be focused and concentrated in the ferrous material composing each ferrous metal core of the respective axis. Since each coil wrapping, <b>400</b>, <b>401</b> and <b>402</b> is orthogonal to the other two axes, this provides independent control. The wires carrying the control current from the microprocessor to each of the orthogonal coils have currents i<sub>x</sub>, i<sub>y </sub>and i<sub>z </sub>which give rise to their respective electromagnetic fields. One, two or three of the axes may be actuated simultaneously. It is not necessary to actuate every axes, only those necessary for creating the appropriate force vector. Accordingly, if a three-dimensional feeling of force is desired on the human operator, a microprocessor will be programmed to alter the currents <b>400</b>, <b>401</b> and <b>402</b> and a feeling of force will be emulated against the electromagnetic fields local to each current. Such a three-dimensional force emulation is more realistic than force emulation in a single plane.
The actuating elements which produce the force locally on the glove device in FIG. 2 have the design in FIG. 4 for another reason involving the removal of heat in an efficient manner. Heat is removed in an efficient manner because heat generating electric currents have to run through the coils <b>400</b>, <b>401</b> and <b>402</b> in order to generate the electromagnetic field and a feeling of force. The design in FIG. 4 reduces heat in an efficient manner by having each axes exposed to the air and separated in a spatial sense. This design allows for better conduction of heat from the device.
The three-dimensional force reflecting actuators can be further simplified as illustrated in FIG. <b>6</b>. FIG. 6 shows a force actuator, <b>600</b> with two metal cores <b>601</b> and <b>602</b> on top of each other and at a right angle to metal core <b>603</b>. In FIG. 6, the three-axis coil, <b>600</b>, is put in a form that appears as a two-dimensional plane but effectively acts as like a three-dimensional actuator (as in FIG. <b>4</b>). In FIG. 6, actuator bottom layers <b>601</b> and <b>602</b> are produced from material anisotropic in nature, that is, the magnetic properties of the material are more favored in one direction only as compared to isotropic materials in which magnetic properties are similar in all directions simultaneously. These properties of magnetic substances can be built into the material as the metal is formed and provides the directional vectors without the need for three-dimensional construction as depicted in FIG. <b>4</b>.
This arrangement can be further understood by considering FIG. <b>7</b>. FIG. 7 illustrates the three force vectors that result when actuated by these orthogonal electrical currents from the system in FIG. <b>4</b>. From FIG. 7, in the x, y and z directions shown at <b>700</b>, <b>701</b> and <b>702</b>, respectively, it is known these vectors now have forces in their respective coordinate systems through the vector relationship
<maths><formula-text>F<sub>j</sub>=i<sub>j</sub>L×B Eq. 3 </formula-text></maths>
Where the currents j=X,Y, or Z have been initiated by a microprocessor to the respective coils. By combining any two or more forces using Eq. 3, it is seen from FIG. 7 that force reflection can easily be accomplished in any arbitrary direction. A difficult task is for the microprocessor to keep track of the position and orientation of the force actuators on the human subject, a glove-type device in FIG. 2, and to coordinate their relative movement. With this information on the human subject, the hand in the arrangement of FIG. 2, the appropriate currents i<sub>x</sub>, i<sub>y</sub>, and/or i<sub>z </sub>can be generated to command the appropriate spatial force reflection paradigm.
The invention provides a more realistic feeling of force simulation than that available in the art by capitalizing on the concept of an “action at a distance” method of reflecting forces as opposed to the traditional Newton's third law concept of “action-reaction” with bodies in contact. The “action at a distance” concept is successfully employed by using electromagnetic fields and forces in three dimensions without the human operator being attached or linked to a reference source.
While the apparatus and method described herein constitute a preferred embodiment of the invention, it is to be understood that the invention is not limited to this precise form of apparatus or method, and that changes may be made herein without departing from the scope of the invention, which is defined in the appended claims.
Contents5
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| WO2016186932A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2017168576A1 | Cited by | United States of America | Pre-grant |
| US2017168576A1 | Cited by | United States of America | Search report |
| US9030307B1 | Cited by | United States of America | Search report |
| CN107807738A | Cited by | China | Search report |
| US2008284257A1 | Cited by | United States of America | Pre-grant |
| US4842607A | Cites | United States of America | Applicant |
| US4913000A | Cites | United States of America | Applicant |
| US5354162A | Cites | United States of America | Applicant |
| US5389865A | Cites | United States of America | Applicant |
| US5459382A | Cites | United States of America | Applicant |
| US5576727A | Cites | United States of America | Applicant |
| US5587937A | Cites | United States of America | Applicant |
| US5739811A | Cites | United States of America | Search report |
| US5767839A | Cites | United States of America | Search report |
| US5805140A | Cites | United States of America | Search report |
| US5898599A | Cites | United States of America | Search report |
| US5929846A | Cites | United States of America | Search report |
| US5959613A | Cites | United States of America | Search report |
| US6088017A | Cites | United States of America | Search report |
1 member in 1 office
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 5385098 | United States of America | A | |
| US19980053850 | – | – | – |
Members1
| Document | Office | Kind | |
|---|---|---|---|
| USH2017HThis record | United States of America | H |
2 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS |
Numbers
- Publication, DOCDB
- H2017
- Publication, EPODOC
- USH2017H
- Application
- 9053850
- Application, DOCDB
- 5385098
- Application, EPODOC
- US19980053850
Titles
- English
- Virtual reality force emulation
Classification
- CPC, 2
- G06F3/016
- G06F3/014
- IPC, 2
- G06F3 00
- G06F3 01