Noninvasive diagnostic system
Abstract
A method and system for diagnosing an injury to bodily tissue is provided. The device has a housing positioned proximate a portion of the musculoskeletal system of a patient and an ultrasonic transducer coupled to the housing for acquiring ultrasonic data indicative of a bone surface. A positional localizer tracks movement of the housing and generates movement data. A transmission system transmits the ultrasonic data from the ultrasonic transducer and the movement data from the positional localizer to a data analyzer for analysis. In another embodiment, a 3D model reconstruction module acquires data indicative of a bone surface comprising a portion of a musculoskeletal system of a patient and constructs a patient- specific model from the structural data. A tracking module tracks the portion of the musculoskeletal system as the portion is repositioned, the tracking module including an ultrasonic transducer and a positional localizer.

Term
3.4 yearsleft in the term
Expires 2 February 2030.
- Priority
- Filed
- Granted
- Today
- Expires
12 claims: 2 independent, 10 dependent
- 1CLAIMS:1. A device comprising: a housing configured to be mounted proximate a portion of the musculoskeletal system of a patient;an ultrasonic transducer coupled to the housing and configured to acquire ultrasonic data indicative of a bone surface;an accelerometer coupled to the housing at a known location relative to the ultrasonic transducer, the accelerometer configured to output acceleration data indicative of any movement of the housing in each of X, Y, and Z axes corresponding to yaw, pitch, and roll;and a wireless transmitter coupled to the housing and communicatively coupled to the ultrasonic transducer and accelerometer, the wireless transmitter configured to transmit the ultrasonic data and the acceleration data to a data analyzer for analysis.
- 9A system comprising:a tracking module configured to track a portion of a musculoskeletal system of a patient as the portion is repositioned, the tracking module including an ultrasonic transducer coupled to the portion of the musculoskeletal system and configured to acquire ultrasonic data indicative of a bone surface, the tracking module further including an accelerometer coupled to the portion of the musculoskeletal system and configured to generate acceleration data responsive to repositioning of the portion, and wireless transmitter coupled to the portion of the musculoskeletal system and communicatively coupled to the ultrasonic transducer and accelerometer to transmit the ultrasonic data and the acceleration data to a 3D model reconstruction module;and the 3D model reconstruction module configured to acquire structural data indicative of a bone surface comprising the portion of the musculoskeletal system of the patient and to construct a patient-specific model from the structural data and display on a display the patient-specific model dynamically moving in real-time using the ultrasonic data and the acceleration data.
Independent claims2
108 paragraphs in 3 sections, as filed
NONINVAS1VE DIAGNOSTIC SYSTEM (0001] This application is a division of Canadian Patent Application No. 2,751,422, filed
February 2, 2010.
Field of the Invention [0002] The present invention relates to diagnosis of bodily abnormalities, and more particularly, to devices and methods for evaluating the physiological condition of bodily tissue, such as bodily joints, to discern whether abnormalities exist and the extent of any abnormalities. While the exemplary embodiments disclosed herein are utilized and discussed with respect to a human knee joint, it is to be understood that other joints and bodily tissues may be similarly diagnosed.
RELATED ART |0003] In humans, the knee joint is functionally controlled by a mechanical system governed by three unique types of forces: (1) active forces resulting from motion, such as those resulting from muscle flexing or relaxing, (2) constraining forces that constrain motion, such as those resulting from ligaments being in tension; and (3) interaction forces that resist motion, such as those acting upon bones. In addition to these three types of forces, the soft tissue in the knee joint complex (e.g., cartilage and meniscus) produce a dampening effect distributing the compressive loads acting on the knee joint.
[0004] Knee joint motions are stabilized primarily by four ligaments, which restrict and regulate the relative motion between the femur, tibia, and patella. These ligaments are the anterior cruciate ligament (ACL), the posterior cruciate ligament (PCL), the medial collateral ligament (MCL), the lateral collateral ligament (LCL), and the patellar ligament, as shown in FIGS 1 and 2. An injury to any of these ligaments or other soft-tissue structures can cause detectable changes in knee kinematics and the creation of detectable vibrations representative of the type of knee joint injury and the seventy of the injury. These visual (knee kinematics) and
CA 2977574 2017-08-28 auditory (vibrations) changes arc produced by the bones while moving in a distorted kinematic pattern, and they differ significantly from the look and sound of a properly balanced knee joint moving through a range of motion.
INTRODUCTION TO THE INVENTION (0005) The exemplary embodiments of the present disclosure include a diagnostic system for mammalian bodies to determine what type of injury, if any, exists and extent of any such injury using kinematic data and/or sound data that is patient specific. In particular, an exemplary method and embodiment arc directed to a knee joint diagnostic system for automatically determining whether an injury exists, what the injury is (i.e., diagnosis), and die extent to which ligaments, muscles, bones, meniscus, and cartilage may be affected by the injury by gathering and analyzing patient specific kinematic data of the knee joint, while also gathering and analyzing the pattern and spatial distribution of sound(s) (i.e., vibrations) produced by movement of the patient’s knee joint. A low level exemplary process flow diagram for this exemplary method is shown in FIG. 3.
(0006] An exemplary method of the present disclosure includes generating a patientspecific 3D tissue model of the bodily area in question (eg., the bones of knee joint), obtaining patient-specific kinematic and sound data as the bodily area is taken through a range of motion, and finally analyzing the kinematic and sound data to discern whether an injury is present and, if so, the extent of any injury. In exemplary form, patient-specific 3D tissue models of the distal femur, proximal tibia, and the patella are constructed using conventional imaging technologies, such as computed tomography (CT) scans, fluoroscopy, magnetic resonance imaging (MRJ) scans, Xrays, and the like. Alternatively, the exemplary embodiments of the present disclosure provide an alternative to conventional imaging technologies by utilizing Λmodc ultrasound echo morphing technology to generate data necessary to construct 3D tissue models. After the patient-specific 3D tissue models have been generated, patient-specific kinematic data is gathered and evaluated for the motions of the femur, tibia, and patella. By way of example, this kinematic data may be obtained using the same A-modc ultrasound technology as is utilized to generate the data necessary to create the patient-specific 3D tissue models. In addition, patient-specific sound data is generated using accelerometers to monitor the knee joint while the joint is taken through a range of motion in a loaded, real-world condition. Finally, the kinematic
CA 2977574 2017-08-28 data and sound data are analyzed to determine the most accurate diagnosis, including whether an injury exists and the extent of any such injury. In exemplary form, the kinematic data and sound data arc analyzed by a neural network having actual kinematic and sound data correlated to correct diagnoses. The neural network is constantly updated with new data for eases where kinematic and sound data was obtained and the correct diagnosis was verified by in vivo assessment. Accordingly, as lhe neural network grows with more data, the precision of the diagnoses is correspondingly increased.
|0007) In exemplary form, the sound data and kinematic data may be obtained at the same rime using a single data acquisition device. Moreover, the sound data and kinematic data arc obtained in real time as the bodily area in question is taken through a range of motion. In a further exemplary embodiment, if the sound and kinematic data is acquired in a physician's office, the data may be displayed in real-time on a split screen monitor. If, however, the data is acquired outside of the doctor’s office, a recording device and memory may be utilized to record the data in a time synced manner. In a yet a further exemplary embodiment, the patient may be given an actuator that is operative to note the general time frame within which the patient experienced a particular pain or severe pain to allow a diagnosis that correlates pain experienced by the patient and the kinematics and sound occurring at precisely or generally the same time.
(0008] As discussed above, the kinematic data and sound data generated on a patientspecific basis is analyzed by a trained neural network in order to provide an automated output as to the existence of an injury, the type of injury, and the severity of the injury. This neural network may be accessible via the internet or may reside on a physician’s local computer. In addition, or in the alternative, patient-specific sound and kinematic data may be analyzed by a physician to make or verify the diagnosis with or without the aid of the neural network.
(0009( Using the exemplary methods and devices as disclosed herein, a physician may diagnose a bodily injury without requiring experimental surgery or requiring exposure of the patient to radiation of any from, such as X-rays or fluoroscopy. In addition, the data taken regarding each patient is continuous through a range of motion, in contrast to radiographic modalities that generate images at distinct points with significant range of motions gaps. In addition, data taken in accordance with the
CA 2977574 2017-08-28 exemplary methods and devices disclosed herein also contracts data taken by a magnetic resonance imaging machine, not only because the data taken is continuous along the range of motion, but also because the bodily portion evaluated is acting under loaded conditions in a dynamic environment.
(0009.1 J According to one aspect of the present invention there is provided a diagnostic device comprising: a housing configured to be positioned proximate a portion of the musculoskeletal system of a patient; an ultrasonic transducer operably coupled to the housing and configured to acquire ultrasonic data indicative of a bone surface; a positional localizer operably coupled to the housing at a select location relative to the ultrasonic transducer, the positional localizer configured to track movement of the housing and generate movement data; and a transmission system operably coupled to the housing and configured to transmit the ultrasonic data from the ultrasonic transducer and the movement data from the positional localizer to a data analyzer for analysis.
10009.2] According to a further aspect of the present invention there is provided a diagnostic system comprising: a 3D model reconstruction module configured to acquire structural data indicative of a bone surface comprising a portion of a musculoskeletal system of a patient and to construct a patient-specific model from the structural data; and, a tracking module configured to track the portion of the musculoskeletal system as the portion is repositioned, the tracking module including an ultrasonic transducer operably coupled to the portion of the musculoskeletal system and configured to acquire ultrasonic data indicative of a bone surface, the tracking module further including a positional localizer operably coupled to the portion of the musculoskeletal system and configured to generate movement data responsive to repositioning of the portion.
BRIEF DESCRIPTION OF THE DRAWINGS (0010] FIG. 1 is a postenor view of a human knee joint in a flexed position.
(0011] FIG. 2 is a postenor view of a human knee joint m an extended position.
|0012] FIG. 3 is an exemplary process flow diagram using exemplary methods within the scope of the present invention.
CA 2977574 2017-08-28 [0013] FIG. 4 is a schematic diagram of the modules of an exemplary diagnostic system.
[0014] FIG. 5 is frontal view of a knee brace in accordance with the instant disclosure that is mounted proximate a human knee joint.
[0015] FIG. 6 is a graphical depiction of an exemplar)' shoe having a sensor array in its insole that is operative to detect pressure forces applied by a human foot under loaded conditions.
[0016] FIG. 7 is an exemplary ultrasound transducer wand for use with the instant invention.
[0017] FIG. 8 is a schematic diagram of an ultra wide band transmitter, where a baseband pulse is upconverted, amplified, filtered, and transmitted via an omnidirectional antenna.
[0018] FIG. 9 is a schematic diagram of an ultra wide band receiver, where the signal is bandpass filtered, amplified, downconverted, low-pass filtered, sub-sampled, and converted to digital Leading-edge detection is performed on the Field Programmable Gate Array (FPGA), and the final timc-difference-of-arrival (TDOA) calculation is performed on a computer.
[0019) FIG. 10 is a 3D coordinate representation showing how the ultra wide band transmitter position m such a 3D coordinate system is determined.
[0020] FIG. 11 is a diagram depicting the similarities between using ultra wide band receivers and transmitters for 3D positioning, in comparison to how a GPS receiver and satellites work to provide global positioning.
4a
CA 2977574 2017-08-28 (0021] FIG. 12 is a 3-D dynamic error plot while collecting 1000 data points and showing the error in the position of the x, y, and z axes compared to an optical reference system.
(0022] FIG. 13 is a screen shot of a user interface of a computer where the 3D reference points taken of the patient’s bone are applied to a default bone model, thereby creating a patient-specific bone model.
|0023] FIG. 14 is a 3D representation of an exemplary patient-specific bone model that incorporates the distal femur, proximal tibia, and patella.
(0024] FIG. 15 is an elevated, profile view of an exemplary knee brace in accordance with the instant disclosure.
(0025] FIG. 16 is a schematic of the overall classification system flow chart.
(0026] FIG. 17 is a schematic representation of an exemplary neural network classifier.
(0027] FIG. 18 is an exemplary process flow for training an exemplary neural network.
|0028] FIG. 19 is an exemplary process flow for knee deficiency diagnosis using a trained neural network.
DESCRIPTION OF. EXEMP1-AJRY EMBODIMENTS (0029) The exemplary embodiments of the present disclosure are described and illustrated below to encompass diagnosis of bodily abnormalities and, more particularly, devices and methods for evaluating the physiological condition of bodily tissue (such as joints) to discern whether abnormalities exist and the extent of any abnormalities. Of course, it will be apparent to those of ordinary skill in the art that the exemplary embodiments discussed below are merely examples and may be reconfigured without departing from the scope and spirit of the present disclosure. However, for clarity and precision, the exemplary embodiments as discussed below may include optional steps, methods, and features that one of ordinary skill should recognize as not being a requisite to fall within the scope of the present invention. By way of example, the exemplary embodiments disclosed herein arc described with respect to diagnosing a knee joint injury. Nevertheless, the exemplary embodiments may be utilized to diagnose other bodily tissue injuries (such as a hip joint injury or a
CA 2977574 2017-08-28 bone fracture), as the knee joint is merely exemplary to facilitate an understanding of the embodiments disclosed.
(0030) Referencing FIG. 4, a first exemplary diagnostic system 100 includes a plurality of modules 102,104,106 that output data to a computer 108 for data processing by way of a neural network 110. The data processing, as will be discussed in more detail below, provides a visual output, an audible output, and a diagnosis by way of a visual display 112. Again, as will be discussed below, the diagnosis includes detection of an injury, as well as information pertaining to the severity of the injury. But before the output from the system 100 can be fully explained, the modules 102, 104,106 and the functionality of each will be described initially.
(0031) Referring to FIGS. 4 and 5, the system 100 includes a vibroarthography module (VM) 102 comprising a plurality of accelerometers 120 that arc utilized to detect sound, specifically vibrations occurring as a result of motion of the knee joint. In this exemplary VM 102, the accelerometers are mounted directly to the skin or external tissue surface of a patient in order to detect bone and soft tissue interaction. An intervening adhesive is utilized between the accelerometers 120 and the patient’s external tissue surface in order to secure the accelerometers in a fixed position.
J0032j In the context of a knee joint, an exemplary VM module includes three accelerometers 120, where one accelerometer 120 A is mounted on the medial side of the knee joint, while a second accelerometer 120B is mounted on the lateral side of the knee joint, while a third accelerometer 120C is mounted on the front side of the knee joint proximate the patella. In this exemplary embodiment, the accelerometers 120 arc mounted to the patient so that each lies along a common plane, though each could be mounted so as not to lie along a common plane. It should also be understood, however, that more than three accelerometers and less than three accelerometers may be utilized to detect sound generated by dynamic interactions of the tissues against one another.
(0033) Each of the accelerometers 120 is in communication with signal conditioning circuits 122 associated with the kinematics module 104. The accelerometers 120 are operative to detect sound, specifically vibrations, and output the sound detected in the form of frequency data measured in Hertz to the conditioning circuits. This frequency data is processed by the conditioning circuits 122 and communicated to the computer
CA 2977574 2017-08-28
108 as digital frequency data. At the same time as the accelerometers 120 arc generating frequency data, the conditioning circuits 122 may include a clock that time stamps the frequency data generated. As will be discussed in more detail below, correlating the frequency data with time provides a constant against which all of the detected data can be compared against on a relative scale.
[0034] As will be discussed in more detail hereafter, the interaction between bodily tissue (e.g., bone against cartilage, bone against bone) in a dynamic environment creates certain vibrations that arc indicative of the condition or state of health of the joint. Even the healthiest and youngest joints create vibrations of some sort. However, joints that exhibit degradation, through wear or injury, will exhibit vibrations much more pronounced and amplified over those of a healthy joint. The exemplary embodiment of the disclosure takes advantage of the sound, such as vibrations, exhibited by the joint during a range of motion to diagnosis the condition of the joint without requiring an invasive procedure or subjecting the patient to radiation.
[0035] In this exemplary embodiment, the first accelerometer 120A is mounted on the medial side of the knee joint and is operative to detect vibrations generated by the interactions between the medial condyle of the femur against the medial cartilage on top of the medial portion of the tibia. Similarly, the second accelerometer J 20B is mounted on the lateral side of the knee joint and is operative to detect vibrations generated by the interactions between the lateral condyle of the femur against the lateral cartilage on top of the lateral portion of the tibia. Finally, the third accelerometer I20C is mounted at the front of the knee joint, proximate the patella, and is operative to detect vibrations generated by the interactions between (he femur against the patella. The resulting data output by the accelerometers 120 is wirelessly transmitted to the computer 108 via a wireless transmitter 124, such as an ultra wide band transmitter. The data from the accelerometers 120 that is wirelessly transmitted to the computer is then utilized in combination with data from the other modules to ascertain the appropriate diagnosis.
[0036] Referring back to FIG. 4, the system 100 includes a contact force module (CFM) 104 comprising a plurality of pressure sensors 130 that arc utilized to detect pressure or contact forces occurring at the bottom of the foot when the knee joint is moved through a range of motion under a loaded condition. In other words, as the
CA 2977574 2017-08-28 patient walks, jogs, runs, etc., the CFM module 104 detects pressure data al the bottom of the foot when the foot is partially or fully in contact with the ground. In exemplary form, the pressure sensors 130 arc incorporated into an insole that conforms to the general shape of a patient’s foot. Because humans have different sized feet, the exemplary system includes insoles that are incrementally sized to accommodate humans with different sized feet or to accommodate the shoes (or lack thereof) needed for a certain activity.
(0037) Referring to FIG. 6, the exemplary CFM 104 includes pressure sensors 130 that are arranged in a grid on the insole 132 of a shoe 134. In exemplary form, the grid comprises a scries of rows and columns of pressure sensors that arc exposed to the underside of a patient’s foot so that contact forces applied by the foot to the shoe, by way of the insole, can be measured, as well as knowing the location where the forces were applied. As will be discussed in more detail hereafter, the location of the pressures and the relative amount of pressures provides information relevant to diagnosis of injury. For example, a patient with a limp, caused by a knee joint injury, would not apply pressure to the sole of a shoe in the same manner (amount or location) as would a patient with a healthy knee joint and a normal gait or kinematics.
10038] Each of the capacitive sensors 130, as the name implies, includes a capacitor that works on the principle that a deformable dielectric medium separates two plates. Changes in the pressure applied to the plates cause a strain (deformation) within the dielectric medium. Thus a pressure applied to the sensor changes the spacing between the plates and changes the capacitance measured between them. The sensors 130 are arrayed across the area of pressure measurement to provide discrete capacitive data points corresponding to strains at the various locations of the array. These strains are used to find the stresses and thus the forces to calculate the output of pressure data having units of force per unit area multiplied by time (i.e., N/m<sup>x</sup>sec).
|0039| In this exemplary embodiment, the sensors 130 arc arranged in a grid so that the position of each of the sensors relative to another sensor is known. This data, which includes the 2D orientation and spacing between the pressure sensors 130, is cither stored on the computer 108 or stored locally with the sensors. In this exemplary embodiment, the orientation and spacing data for the sensors 130 is stored on the computer 108. The resulting data output by the sensors 130 is wirelessly transmitted to the computer 108 via a wireless transmitter 136, such as an ultra wide
CA 2977574 2017-08-28 band transmitter. Using the orientation and spacing data for the sensors 130 stored on the computer 108, in combination with the computer receiving sensor pressure data, the computer is operative to generate data tying pressure to position, specifically the position of one pressure sensor with respect to another.
(0040] By tying force with position, the system 100 includes data reflecting precisely what pressures are exerted at what locations. In addition, the computer 108 includes an internal clock that also associates time with the pressure data generate by the pressure sensors 130. Accordingly, the system 100 not only knows how much pressure was exerted and the location where the pressure was applied, but also has time data indicating the duration of the applied pressures. Again, by tying the pressure data generated by the pressure sensors 130 to time, the pressure data can be correlated with the sound data generated by the VM module 102 using a time scale as a common scale. As a result, the system can evaluate how pressures exhibited at the bottom of the foot change as a function of time, along with how the vibrational data changes during the same time.
(0041] Referencing FIG. 4 again, the system 100 also includes a kinematics module (KM) 106 that is comprises of a plurality of submodules 140,142, 144 that include one or a plurality of Λ-modc ultrasound transducers. The submodules include an ultrasound creation and positioning submodule 140, an ultrasound registration submodule 142, and an ultrasound dynamic movement submodule 144. Specifically, the submodules include Λ-modc ultrasound transducers that generate sound and detect the sound that bounces back, which is representative of the structure, position, and acoustical impedance of the tissue in question. Commercially available transducers for use with the exemplary embodiments include, without limitation, the Olympus immersion unfocused 3.5MHz transducer. Those skilled in the art arc familiar with the operation of ultrasound transducers in general and Λ-mode ultrasound transducers, which generate sound pulses and operate to detect sound that bounces back within soft tissue at the interface between tissues having different acoustic impedances. The magnitude of the sound that bounces back and the time it lakes for the sound to bounce back to the ultrasound transducer arc utilized to determine the distance between the ultrasound transducer and the interface between the materials having different acoustic impedances.
CA 2977574 2017-08-28 [0042| In this exemplary embodiment, the transducers are utilized to detect the interface between bone and surrounding tissue so that the location of the bone surface can be determined. Because (he operation of ultrasound transducers and A-modc ultrasound transducers are well known to those skilled in the art, a detailed discussion of the operation of ultrasound transducers in general, and A-modc ultrasound transducers specifically, has been omitted only for purposes of brevity.
(0043) Referring to FIG. 7, the ultrasound creation and positioning submodule 140 comprises one or more A-modc ultrasound transducers 150 fixedly mounted to a wand 152 that also has mounted thereto at least one positioning device 170. In this exemplary embodiment, the ultrasound creation and positioning submodule 140 is physically separate from the ultrasound registration submodule 142 and an ultrasound dynamic movement submodule 144, which arc themselves mounted to a rigid knee brace 190 (see FIG. 5). In this fashion, the ultrasound creation and positioning submodule 140 is repositionable with respect to the rigid knee brace 190 and adapted to place one or more of its Λ-mode ultrasound transducers 150 in contact with the patients epidermis proximate the knee joint. It should be noted, however, that the knee brace 190 does not have to be rigid other than the linkages between certain components. Moreover, the knee should be scanned by the ultrasound wand 152 before the brace is put on.
[0044] One of the functions of the ultrasound creation and positioning submodule 140 is to generate electrical signal representative of the ultrasonic wave detected by the transducers 150 as the wand 152 is moved over lhe patient’s epidermis proximate the knee joint. The ultrasound transducers) 150 receives electrical signal pulses based upon the magnitude of the ultrasonic wave that bounces back to the transducer as a result of the sound reaching the bone and bouncing back. As discussed previously, the magnitude of the electrical signal and the delay between the generation of the ultrasonic wave by the ultrasound transducer 150 until a bounce back ullrasonic wave is detected by the ultrasound transducer is indicative of the depth of the bone underneath the transducer. But this depth data alone would not be particularly useful without positioning devices 170 that provide a 3D coordinate system.
[0045] The positioning devices 170 of the ultrasound creation and positioning submodule 140 arc fixedly mounted to the wand 152 and may comprise any of a number of devices. For example, the wand 152 may include optical devices 170 that
CA 2977574 2017-08-28 arc operative to generate, detect, or reflect pulses of light, which interacts with a corresponding detector or light generator to discern the 3D position of the wand with respect to a fixed or reference position. One such device includes a light detector operative to detect pulses of light emitted fiom light emitters having known positions. The light detector detects the light and sends a representative signal to control circuitry, which also knows when the light pulses were emitted as a function of time and position. In this matter, the control circuitry is operative to determine the position of the wand in a 3D coordinate system. Because the A-mode ultrasound transducers) 150 and optical devices 170 are fixedly mounted to the wand 152, the position of the ultrasound transducer!s) 150 with respect to the position of the optical devices 170 is known. Similarly, because the ultrasound transducers 150 arc generating signals representative of a straight line distance from the transducer to the surface of the bone, and the position of the transducers) 150 with respect to the optical devices 170 is known, the position of the bone with respect to the optical devices 170 can be easily calculated. In other words, as the wand 152 is repositioned, the optical devices 170 generate data reflecting that the relative position of the optica] devices has changed in the 3D coordinate system. This change in 3D position of the optical devices 170 can be easily correlated to the position of the bone in three dimensions because the position of the bone relative to the ultrasound transducer is known, as is the position of the optical devices with respect to the ultrasound transducers. Accordingly, the optica] devices 3D position data is used in combination with the fixed position data (distance data for the position of the ultrasound transducers) with respect to the optical devices) for the ultrasound transducers 150 in combination with the distance data generated responsive to the signals received from the ultrasound transducers to generate composite data that is used to create a plurality of 3D points representing a plurality of distinct points on the surface of the bone. As will be discussed in more detail below, these 3D points arc utilized in conjunction with a default bone model to generate a virtual, 3D representation of the patient’s bone.
[0046] Alternatively, the positioning devices 170 may comprise one or more inertial measurement units (IMUs). IMUs arc known to those skilled in the art and include accelerometers, gyroscopes, and magnetometers that work together to determine the position of the IMUs in a 3D coordinate system. Because the A-mode ultrasound transducers) 150 and IMUs 170 arc fixedly mounted to the wand 152, the position of
CA 2977574 2017-08-28 the ultrasound transducers) 150 with respect to the position of the IMUs 170 is known. Similarly, because the ultrasound transducers 150 are generating signals representative of a straight line distance from the transducer to the surface of the bone, and the position of the transducers) 150 with respect to the IMUs 170 is known, the position of the bone with respect to the IMUs 170 can be easily calculated. In other words, as the wand 152 is repositioned, the IMUs 170 generate data indicating that the relative position of the IMUs has changed in the 3D coordinate system. This change in 3D position of the IMUs 170 can be easily correlated to the position of the bone in three dimensions because the position of the bone relative to the ultrasound transducer is known, as is the position of the IMUs with respect to the ultrasound transducers. Accordingly, the IMU 3D position data is used in combination with the fixed position data (distance data for the position of the ultrasound transducers) with respect to the IMUs) for the ultrasound transducers 150 in combination with the distance data generated responsive to the signals received from the ultrasound transducers to generate composite data that is used to create a plurality of 3D points representing a plurality of distinct points on the surface of the bone. As will be discussed in more detail below, these 3D points are utilized in conjunction with a default bone model to generate a virtual, 3D representation of the patient’s bone.
(0047J Referring to FIGS. 8-10, the positioning devices 170 may alternatively comprise one or more ultra wide band (UWB) transmitters. UWB transmitters are known to those skilled in the art, but the use of UWB transmitters and receivers for millimeter-accuracy 3D positioning is novel. One or more UWB transmitters 170 is fixedly mounted to the wand 152 and is operative to transmit sequential UWB signals to a three or more UWB receivers (having known positions in a 3D coordinate system). The UWB positioning system is comprised of active tags or transmitters 170 that arc tracked by the UWB receivers 172. The system architecture of the UWB transmitter 170 is shown in FIG. 8, where a low noise system clock (clock crystal) triggers a baseband UWB pulse generator (for instance a step recovery diode (SRD) pulse generator). The baseband pulse is upconvcrtcd by a local oscillator (LO) via a double balanced wideband mixer. The upconvcrtcd signal is amplified and filtered. Finally, the signal is transmitted via an omni-directional antenna. The UWB signal
CA 2977574 2017-08-28 travels through an indoor channel where significant multipath and pathloss effects cause noticeable signal degradation.
(0048) Referencing FIG. 9, the UWB receiver 172 architecture is shown, where the signal is received via a directional UWB antenna and is filtered, amplified, downconverted, and low-pass filtered. Next, a sub-sampling mixer triggered by a second low noise system clock is used to time extend the pulse by 1000-100,OOOx. This effectively reduces the bandwidth of the UWB pulse and allows sampling by a conventional analog-to-digital converter (ADC).
(0049] Each UWB transmitter 170 is in communication with the computer 108, as are the UWB receivers 172. Accordingly, the computer 108 is aware each time the UWB transmitter transmits a UWB signal, as well as the time that the UWB transmitter transmits the UWB signal. Similarly, the computer 108 is aware of the position of each of the UWB receivers in a 3D coordinate system, as well as the time during which each of the UWB receivers receives the UWB signal from the UWB transmitter. By knowing the position of each UWB receiver, the time when each UWB receives the UWB signal from the UWB transmitter, and the time that the UWB transmitter transmitted the UWB signal, the computer 108 uses custom digital signal processing algorithms to accurately locate the leading-edge of the received UWB pulse to within sub-sample resolution. The final time-diffcrcncc-of-arriva) (TDOA) calculation (see FIG. 10) as well as additional filtering and averaging of data is also carried out by the computer 108.
(0050) At least four base stations (receivers) 172 are needed to localize the 3D position of the UWB transmitter 170. The geometry of the receivers 172 has important ramifications on the achievable 3D accuracy through what is known as geometric position dilution of precision (PDOP). A combination of novel filtering techniques, high sample rates, robustness to multipath interference, accurate digital ranging algorithms, low phase noise local oscillators, and high integrity microwave hardware arc needed to achieve millimeter range accuracy (e.g. 5-7 mm 3D rcallimc). The analogy of the UWB positioning system to a GPS system is shown in FIG. 11. Finally, FIG. 12 shows actual experimental errors in x.y.z coordinates for detecting the 3D position of the UWB transmitter 170 in real-time over 1000 samples while the transmitter is moving freely within the designated view volume.
CA 2977574 2017-08-28 (0051] Because the A-mode ultrasound transducers) 150 and UWB transmitters) 170 are fixedly mounted to the wand 152, the position of the ultrasound transducers) 150 with respect to the position of the UWB transmitter (s) 170 is known. Similarly, because the ultrasound transducers 150 arc generating signals representative of a straight line distance from the transducer to the surface of the bone, and the position of the transducers) 150 with respect to the UWB transmitters) 170 is known, the position of the bone with respect to the UWB transmitters) 170 can be easily calculated. In other words, as the wand 152 is repositioned, the UWB transmitters) 170 transmit UWB signals, which are correspondingly received by the UWB receivers. This information is processed by the computer 108 in order to discern whether the relative position of the UWB transmitters) has changed in the 3D coordinate system, as well as the extent of such a change. This change in 3D position of the UWB transmitters) 170 can be easily correlated to the position of the bone in three dimensions because the position of the bone relative to the ultrasound transducer is known, as is the position of the UWB transmitters) with respect to the ultrasound transducers. Accordingly, the UWB transmitters) 3D position data is used in combination with the fixed position data (distance data for the position of the ultrasound transducers) with respect to the UWB transmitters)) for the ultrasound transducers 150 in combination with the distance data generated responsive to the signals received from the ultrasound transducers to generate composite data that is used to create a plurality of 3D points representing a plurality of distinct points on the surface of the bone. As will be discussed in more detail below, these 3D points arc utilized in conjunction with a default bone model to generate a virtual, 3D representation of the patient's bone.
(0052] Regardless of the positioning devices 170 utilized with the ultrasound creation and positioning submodule 140, the wand 152 is repositioned over the skin of a patient, proximate the knee joint, while the knee joint is bent in order to individually, and successively maps (creation of 3D points corresponding ic points on the surface of the patient’s bone) the three bones of the knee joint (distal femur, proximal tibia, and patella). As the wand 152 is repositioned, the data from the transducers) 150 is transmitted to a wireless transmitter 171 mounted to the wand 152. When the wireless transmitter receives the data from the transducers) 150, the transmitter transmits (he data via a wireless link to the computer 108.
CA 2977574 2017-08-28 [0053] In order to power the devices on-board the wand 152, an internal power supply (not shown) is provided. In exemplary form, the internal power supply comprises one or more rechargeable batteries.
(0054) Referring to FIG. 13, before patient data is taken, lhe computer 108 software requests a scries of inputs to adapt lhe system to equipment specific devices and the particular bone being modeled. For example, a dropdown menu on the user interface allows the user to input precisely what type of digitizer will be utilized, which may include, without limitation, ultrasound. After the type of digitizer is selected, the user may actuate buttons to connect to or disconnect from (he digitizer. Before, during, or after the ultrasound transducer data is acquired, the software provides various dropdown menus allowing lhe software to load a bone model that roughly is the same shape as the patient’s bone.
(0055] After the computer 108 receives the ultrasound transducer 150 data, the computer 108 includes software that intciprets the A-mode ultrasound transducer data and is operative to construct a 3D map having discrete 3D points that correspond to points on the surface of the bone in question. Consequently, the wand 152 (sec FIG. 7) is repositioned over the bones (distal femur, patella, proximal tibia) for approximately 30 second so that the discrete points typify lhe topography of the bone. Consequently, repositioning the wand 152 over the bone in question for a longer duration results in more 3D points being generated by the computer J 08, which consequently helps ensure a more accurate patient-specific bone model, such as that shown in FIG. 14. A partial range of motion of the knee joint while repositioning the wand 152 over the joint can help the wand view new portions of the bone in question for new 3D points that may have been obscured by other bones in another range of motion position.
[0056] After each of the bones has been mapped, the computer 108 then uses a default bone model as a starting point to construction of the ultimate patient specific, virtual bone model. The default bone model may be a generalized average, as the morphing algorithms use statistical knowledge of a wide database population of bones for a very accurate model. However, for expedited computation, a more generalized default bone model may be selected based upon the patient’s gender, race, height, age, for example, as a starting point. For example, in the case of generating a patientspecific model of the femur where the patient is a 53 year old, Caucasian male, who is
CA 2977574 2017-08-28 six feet tall, a default femoral bone model is selected based upon the classification of Caucasian males having an age between 50-60, and a height between 5’10 and 6'2. In this manner, selection of the appropriate default bone model more quickly achieves an accurate patient specific, virtual bone model because the iterations between the patient’s actual bone (typified by the 3D map of bone points) and the default bone model arc reduced. After the appropriate default bone model is selected, the computer superimposes the 3D map of actual bone points onto the default bone model and thereafter carries out a deformation process so that the bone model exhibits the actual bone points detected during the wanding. The deformation process also makes use of statistical knowledge of the bone shape based upon reference bones of a wide population. After the deformation process is earned out, the resulting bone model is a paticnt-spccific, virtual 3D model of the patient’s actual bone. The foregoing process is carried out for each of the three bones of lhe knee joint to create patient-specific, virtual 3D models of lhe patient’s proximal tibia, distal femur, and patella.
(0057) Referring back to FIGS. 4,5, and 15 tbe ultrasound registration submodule 142 and the ultrasound dynamic movement submodule 144 arc mounted to a knee brace 190. The data output from these submodules 142, 144 is utilized to generate dynamic 3D models of the patient’s own bones through a range of motion. In other words, a visual terminal associated with the computer 108 can display the patient’s virtual own bone models moving in 3D that match the same movement of the patient’s own bones. As will be discussed later, this dynamic 3D model taken through a range of motion is part of what the neural network analyzed :o determine if an injury exists and the extent of the injury, (0058) In exemplary form, the ultrasound registration submodule 142 comprises a plurality of A-mode ultrasound transducers 158 fixedly mounted to the knee brace 190. Specifically, in the context of a knee joint, there are at least two A-mode ultrasound transducers 158 (i.e., a transducer group) fixedly mounted to the knee brace 190 for tracking of (he tibia and femur. In other words, the knee brace 190 includes at least six ultrasound transducers in order to track the two primary bones of the knee joint. Each transducer group 158 includes a rigid mechanical connection linking the transducers 158, the positioning devices 200, and a connection tbe knee brace 190 which may or may not be rigid. Each transducer group 158 includes a rigid mechanical connection linking the transducers 158, the positioning devices 200, and
CA 2977574 2017-08-28 the knee brace 190. In this manner, the relative positions of the transducers with respect to one another do not change. In exemplary form, a first transducer group Ι58Λ at least partially circumscribes a distal portion of the femur, while a second transducer group 158B at least partially circumscribes a proximal portion of the tibia, while an optional third transducer group (not shown) overlies the patella if patella kinematics are to be tracked. The ultrasound registration submodule 142 is accordingly operative to provide a plurality of static reference points for each bone as the bone is moved through a range of motion.
[0059) Referring back to FIG. 4, the ultrasound dynamic movement submodule 144 comprises a plurality of positioning devices 200 that arc operative to feed information to the computer 108 regarding the 3D position of each transducer group 158 A, 158B of the ultrasound registration submodule 142. In exemplary form, the positioning devices 200 may comprise light detectors operative to detect pulses of light emitted from light emitters having known positions. The light detectors 200 detect the light and send representative signals to control circuitry associated with the knee brace 190. The knee brace 190 transmits this information to the computer 108 (see FIG.4), which also knows when the light pulses were emitted as a function of time and position. In this manner, the computer can determine the position of the transducers 158 in a 3D coordinate system. Because the A-mode ultrasound transducers) 158 and optical devices 200 arc fixedly mounted to the knee brace 190, the position of the ultrasound transducers) 158 with respect to the position of the optical devices 200 is known. Similarly, because the ultrasound transducers 158 arc generating signals representative of a straight line distance from the transducer to the surface of the bone, and the position of the transducers) 158 with respect to the optica) devices 200 is known, the position of the bone with respect to the optical devices 200 can be easily calculated. In other words, as the knee is repositioned, and correspondingly so too is the knee brace 190, the optical devices 200 generate data reflecting that the relative position of the optical devices has changed in the 3D coordinate system. This change in 3D position of the optical devices 200 can be easily correlated to the position of the bone in question (femur, patella, or tibia) in three dimensions because the position of the bone relative to the ultrasound transducer groups 158A, 158B is known, as is the position of the optical devices with respect to the ultrasound transducer groups. Accordingly, the optical devices generate data that is used in combination with the
CA 2977574 2017-08-28 fixed position data (distance data for the position of the ultrasound transducers) with respect to the optical devices) for the ultrasound transducers 158 in combination with the distance data generated responsive to the signals received from the ultrasound transducers to generate composite data that is used to create dynamic movement map of the bone in question. By way of example, because the transducers 158 do not move with respect to the positioning devices 200, any movement of the transducers 158 in space means that the positioning devices 200 have moved in 3D space, and by continuing to track the distance data provided by each transducer 158, the movement of the bone in question can be correspondingly tracked.
(0060J Alternatively, the positioning devices 200 may comprise one or more inertial measurement units (IMUs). IMUs are known to those skilled in the art and include a combination of accelerometers, gyroscopes, and magnetometers that work together to determine the position of the IMUs in a 3D coordinate system. IMUs arc known to those skilled in the art and include accelerometers, gyroscopes, and magnetometers that work together to determine the position of the IMUs in a 3D coordinate system. Because the A-modc ultrasound transduccr(s) 158 arc fixedly mounted to the IMUs 200, the position of the ultrasound transducers) 158 with respect to the position of the IMUs 200 is known. Similarly, because the ultrasound transducers 158 are generating signals representative of a straight line distance from the transducer to the surface of the bone, and the position of the transducers) 158 with respect to the IMUs 200 is known, the position of the bone with respect to the IMUs 200 can be easily calculated. In other words, as the brace 190 is repositioned, the IMUs 200 generate data indicating that the relative position of the IMUs has changed in the 3D coordinate system. This change in 3D position of the IMUs 200 can be easily correlated to the position of the bone in 3D because the position of the bone relative to the ultrasound transducer is known, as is the position of the IMUs with respect to the ultrasound transducers. By way of example, because the transducers 158 do not move with respect to the brace 190, any movement of the transducers 158 in space means that the brace has moved in 3D space, and by continuing to track the distance data provided by each transducer 158, the movement of the bone in question can be correspondingly tracked. Such an 1MU 200 allows relative tracking of the bone movements and requires a static registration between the multiple IMU units with an initial known position (such as standing). Thus the IMU enables measurement of the relative motion
CA 2977574 2017-08-28 between different bones via their corresponding ultrasound transducer array data 158 and IMUs 200 data. The IMU 200 may be used alone or in conjunction with another positioning device 200 such as those described in paragraphs 0059 and 0061 .The IMU 200 may also be used in conjunction with another positioning devices 200 such as those described in paragraphs 0060 and 0062. In this scenario, the IMUs 200 position is updated at a certain interval with the absolute position from the other positioning system 200 as a reference to minimize errors, so the two positioning systems 200 act together as one positioning system 200.
[0061] Referring to FIGS. 8-10, the positioning devices 200 may alternatively comprise one or more ultra wide band (UWB) transmitters. UWB transmitters are known to (hose skilled in the art, but the use of UWB transmitters and receivers for 3D positioning is believed to be novel. One or more UWB transmitters 200 is fixedly mounted to the brace 190 and is operative to transmit sequential UWB signals to a three or more UWB receivers (having known positions in a 3D coordinate system). Each UWB transmitter 200 is in communication with the computer 108, as are a plurality of UWB receivers 202. Accordingly, the computer 108 is aware each time the UWB transmitter transmits a UWB signal, as well as the time that the UWB transmitter transmits the UWB signal. Similarly, the computer 108 is aware of the position of each of the UWB receivers in a 3D coordinate system, as well as the time during which each of the UWB receivers receives the UWB signal from the UWB transmitter. By knowing the position of each UWB receiver, lhe time when each UWB receives the UWB signa) from the UWB transmitter, and the time that the UWB transmitter transmitted the UWB signal, the computer 108 uses custom digital signal processing algorithms to accurately locate the leading-edge of the received UWB pulse to within sub-sample resolution. The final timc-diffcrence-of-arrival (TDOA) calculation (see FIG. 10) as well as additional filtering and averaging of data is also carried out by lhe computer 108. Again, because the transducers 158 do not move with respect to the brace 190, any movement of the transducers 158 in space means that lhe brace has moved in 3D space. Yet the movement of the brace is tracked using the computer 108 in combination with the UWB transmitter and UWB receivers. Similarly, because the fixed orientation of the UWB transmitter and the ultrasound transducers 158, changes in position in a 3D coordinate system of the
CA 2977574 2017-08-28
UWB transmitter 200 can correspondingly be used to track movement of the bone in question.
(0062J In order to communicate information from the submodules 142, 144 to tlie computer 108, the brace 190 includes an ultra wide band (UWB) transmitter 210 in communication with the ultrasound transducers 158 to facilitate wireless communication of data to the computer 108. It should be noted that if UWB transmitters are utilized as the positioning devices 200, a dedicated UWB transmitter is unnecessary as the UWB transmitters 200 could function to send ultrasound sensor data directly to the computer 108 over a wireless link.
(0063J It should be understood that the use of wireless transmitters and a field programmable gate array design enables the computations to be carried out on a realtime basis, with final processing and display carried out on the computer 108. It should be understood that the use of wireless transmitters and a computer 108 incoiporaling a field programmable gale array design enables the computations to be carried out on a real-time basis. For example, as the wand 152 is utilized to go across the epidermis covering the knee joint, the ultrasound transducer data is immediately transmitted to the computer, which in real time calculates the position of the bone in a 3D coordinate system and likewise displays the 3D points on a visual terminal again in real time. Similarly, when the knee brace 190 is utilized, the ultrasound transducer data and positioning device data is transmitted to the computer and evaluated in real time to provide motion to the static, 3D patient-specific bone models previously generated. Again, when the computer includes a visual terminal, the dynamic motion imparted to the 3D patient-specific bone models tracks in real rime the actual motion of the patient’s bones.
)0064) As discussed above, an exemplary knee brace 190 includes a plurality of Amodc ultrasound transducers 158 for transcutaneous detection of the bone’s surface and positioning devices 200 to track the motion of the ultrasound transducers 158, which in turn, track motion of the knee joint bones. The brace 190 is wirelessly connected to a computer 108 operative to perform computations and visualization in real-time showing movements of the patient-specific 3D bone models paralleling movements of the patient’s actual knee joint in a time synchronized manner. The exemplary brace J 90 includes a rigid or semi-rigid body having a plurality positioning devices 200 attached thereto. An even further alternate positioning device 200
CA 2977574 2017-08-28 includes a plurality of accelerometers -- in this case at least four accelerometers. The homogenous transformation between an accelerometer’s reference coordinate frame and (he world coordinate frame is calculated using the positions of the four accelerometers.
( 1 ) v(n+1 ) = v(n) 4 a(n)dt (2) s(n+1 ) = s(n) + v(n)dt - 0.5a(n)dt2 where s(n+l) is position al the current state, s(n) is the position from previous state, v(n+l) is instantaneous velocity of the current state, v(n) is the velocity from previous state, a(n) is the acceleration from the accelerometer and dt is the sampling time interval. The previous equations describe (he dynamic motion and positioning of a point in 3D
Euclidean space. Additional information is needed to describe a 3D body orientation and motion.
(0065] The orientation of the transducer can be described by using a gravity based accelerometer (example: ADXL-330, analog device) by extracting the tilting information from each pair of orthogonal axis. The acceleration output on x ,y, or z is due to gravity is equal to the following: Ai = (Voutx - Voft) / S, where Ai is the acceleration at the x, y, or z axis, Vout, is the voltage output from the x, y, or z axis, VofT is the offset voltage, and S is the sensitivity of the accelerometer. The yaw, pitch and roll can be calculated as shown in the following:
<img file="CA2977574C_D0001.tif" />
Θ = arc tan ί--—---J where pitch is p, which is the x-axis relative to the ground, roll is 0, which is the yaxis relative to the ground, and roll is Θ, which is the z-axis relative to the ground. Since the accelerometer is gravity based, the orientation docs not require information from the previous state once the sensor is calibrated. The static calibration requires the resultant sum of accelerations from the three axis equal to lg (the nominal acceleration due to gravity at the Earth’s surface at sea level, defined to be precisely
CA 2977574 2017-08-28
9.80665 m/s<sup>2</sup> (approximately, 32.174 ft/s<sup>2</sup>)). Alternatively, an orientation sensor that provides yaw, pitch, and roll information of the bodily tissue in question are also commercially available (e.g., IDG-300, available from Invensense). The orientation of the transducer can then be resolved by using direction cosine matrix transformation:
<td> pl·]</td><td> C0C0 C9S0Sp - SÔCp C0S0Cp - S6Sp</td><td> f*ll</td>
<td></td><td> seed) sesdsp - cecp sesticp - C6Sp</td><td></td>
<td> 2,J</td><td> -so cd>sp cecp</td><td></td>
where C represents cosine and S represents sine.
(0066] The interpretation of the vibration and kinematic data is a complicated task involving an in-depth understanding of data acquisition, training data sets and signal analysis, as well as the mechanical system characteristics. Vibrations generated through the implant components, bones, and/or soft tissues interaction result from a forced vibration induced by driving force leading to a dynamic response. The driving force can be associated with the impact following knee ligament instability, bone properties, and conditions. A normal, intact knee will have a distinct pattern of motion, coupled with distinct vibrational characteristics. Once degeneration or damage occurs to the knee joint, both the kinematic patterns and vibrational characteristics become altered. This altering, for each type of injury or degeneration, leads to distinct changes that can be captured using both kinematic and vibration determination.
(0067] Referencing FIGS. 16-19, the exemplary diagnostic system 100 includes an intelligent diagnosis module 110 operative to diagnose ligament, other soft tissue, and bone injuries. From previous studies, normal and anterior cruciate ligament deficient (ACLD) knee subjects exhibit a similar pattern of posterior femoral translation during progressive knee flexion, but the subjects exhibit different axial rotation patterns of 30 degrees of knee flexion. Accordingly, the diagnosis module 110 includes three stages: (1) a first stage that involves data gathering and analysis; (2) detection of an injury by sending the data to a neural network; and (3) another stage of a neural network that classifies or determines the severity of any injury that is detected.
(0068) This first stage includes acquisition of kinematic feature vectors using multiple physiological measurements taken from the patient while the patient moves the joint in question through a range of motion. Exemplary measurements include, without
CA 2977574 2017-08-28 limitation, medical condyle anteroposterior motion (MAP) and lateral condyle anteroposterior (LAP), with the latter pertaining to the anterior-posterior Λ/P distance of the medial and lateral condyle points relative to the tibia geometric center. Other exemplary measurements include LSI (distance between the lateral femoral condyle and the lateral tibial plateau) and MSI (distance between the medial femoral condyle and the medial tibial plateau) which are S/I (supcrior/inferior) distance of the lateral and medial condyle points to the tibial plane. Further exemplary measurements include condyle separation, which is the horizontal (x-y plane) distance between the two minimum condyle points to the tibia. Feature vectors also include the femoral position with respect to the tibia which is defined by three Euler angles and three translation components in addition to the vibration signal, and force data.
(0069] Referring to FIG. 16, the motion features vectors extracted from the kinematic and vibration analyses arc output to a multilayer back propagation neural network for detennining the injured ligament.
(0070) Referencing FIG. 17, an exemplary neural network classifier has multiple binary outputs. Each output is either a one or zero, with one corresponding to yes and zero corresponding to no. In this exemplary neural network classifier, each output represents the response of the neural network to a particular injury type; for example one output will represent the response for anterior cruciate ligament deficiency (ACLD), its state will be one if an ACL injury is detected, and zero otherwise. . Obviously, the neural network may be significantly more sophisticated or less sophisticated, depending upon the underlying model of the joint in question.
(0071] Referring to FIG. 18, construction of the exemplary neural network includes formulating a supervised classifier using a training set of the kinematic and vibration data corresponding to normal and injured knee joist. The NN is trained with a set of vectors. Each vector consists of data (kinematics, vibrations and forces) collected from one joint. Fluoroscopy data can be used to calculate the kinematics. Once the NN is trained, it can be used to classify new eases and categorize the injury type using these kinematics, vibration and forces data. Those skilled in the art will readily understand that the types and classifications desired to be accommodated by the neural network necessarily include training the neural network on these very types and classifications. Exemplary types and classifications of injuries to a mammalian knee joint include, without limitation, osteoarthritic conditions, soft tissue damage,
CA 2977574 2017-08-28 and abnormal growths. Likewise, the neural network also needs (o be trained as to indicators of normal knee function. In this manner, once the neural network is trained, it has the capability to differentiate between and output diagnosis data concerning normal and abnormal knee conditions.
(0072] Referencing FIG. 19, the vibration, kinematics, forces, and other features of a person’s knee joint arc compiled and fed to the trained neural network. The trained neural network then diagnoses the condition of the patient’s knee joint, identifying and degeneration by type and severity.
(0073] Exemplary embodiments may be adapted to collect data outside of a clinical setting. For example, an exemplary embodiment may be wom by a patient for an extended period of time while performing normal activities. For example, a patient may wear vibration sensors and/or a kinematics tracking brace during activities that are not reproducible in the office (for example, weight lifting, racquet ball etc.) that elicit the pain or symptom. In some embodiments, the patient may turn the device on immediately prior to the activity and/or the patient may mark (he event when it occurs. This enables analysis of the data just a few seconds before the marked time to see what abnormal sounds or joint kinematic were occurring. Data may be stored on a portable hard drive (or any other portable storage device) and then may be downloaded to exemplary systems for analysis. The data can be transmitted and stored in a computer wirelessly. It can also be stored with a miniature memory drive if field data is desired.) If the occurrence of the pain was more random, exemplary devices allow continuous gathering of data. In embodiments, the patient may mark the event. Devices capable of continuous monitoring may require a larger data storage capacity.
(0074) It should also be noted that electromagnetic tracking could be used as one of the positioning device 170, 200 alternatives.
(0075) It should further be noted that EMG electrodes may also be utilized as a data input for the computer 108 and neural network 110. In this fashion, one or more EMG electrodes arc mounted to the surface of the skin proximate the muscles adjacent the knee joint to monitor the electrical signal transmitted to the muscles in order to provide relevant data of a muscle injury or disorder.
(0076) Jt is also understood that while the exemplary embodiments have been described herein with respect to a knee joint, those skilled in the art will readily
CA 2977574 2017-08-28 understand (hat (he aforementioned embodiments may be easily adapted (o other joints of a mammalian animal. For example, embodiments may be adapted for use on hips, ankles, toes, spines, shoulders, elbows, wrists, fingers, and temporomandibular joints.
(0077J Following from the above description and invention summaries, it should be apparent to those of ordinary skill in the art while the methods and apparatuses herein described constitute exemplary embodiments of the present invention, the invention contained herein is not limited to this precise embodiment and that changes may be made to such embodiments without departing from the scope of the invention as defined by the claims. Additionally, it is to be understood that the invention is defined by the claims and it is not intended that any limitations or elements describing the exemplary embodiments set forth herein are to be incorporated into the interpretation of any claim element unless such limitation or element is explicitly stated. Likewise, it is to be understood that it is not necessary to meet any or all of the identified advantages or objects of the invention disclosed herein in order to fall within the scope of any claims, since the invention is defined by the claims and since inherent and/or unforeseen advantages of the present invention may exist even though they may not have been explicitly discussed herein.
Contents3
15 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US12582483B2 | Cited by | United States of America | Applicant |
55 members in 7 offices
Priority claims3
| Document | Office | Kind | Date |
|---|---|---|---|
| 12364267 | United States of America | – | |
| 36426709 | United States of America | A | |
| 2751422 | Canada | A |
Members55
| Document | Office | Kind | |
|---|---|---|---|
| CA2751422A1 | Canada | A1 | |
| CA2977574A1 | Canada | A1 | |
| CA3049975A1 | Canada | A1 | |
| CA3170396A1 | Canada | A1 | |
| CA3192190A1 | Canada | A1 | |
| US2010198067A1 | United States of America | A1 | |
| WO2010088696A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP2391971A1 | European Patent Office (EPO) | A1 | |
| US2012029345A1 | United States of America | A1 | |
| JP2012516719A | Japan | A | |
| US8444564B2 | United States of America | B2 | |
| US2013211259A1 | United States of America | A1 | |
| US2013217998A1 | United States of America | A1 | |
| US2013253379A1 | United States of America | A1 | |
| CA2906476A1 | Canada | A1 | |
| CA2906506A1 | Canada | A1 | |
| CA3187370A1 | Canada | A1 | |
| WO2014150780A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2014150961A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2014150780A3 | World Intellectual Property Organization (WIPO) | A3 | |
| JP5723788B2 | Japan | B2 | |
| JP2015109972A | Japan | A | |
| EP2391971A4 | European Patent Office (EPO) | A4 | |
| EP2967353A1 | European Patent Office (EPO) | A1 | |
| EP2967440A2 | European Patent Office (EPO) | A2 | |
| EP2967440A4 | European Patent Office (EPO) | A4 | |
| JP6005715B2 | Japan | B2 | |
| EP2967353A4 | European Patent Office (EPO) | A4 | |
| JP2016202974A | Japan | A | |
| HK1220341A | Hong Kong, China | A | |
| HK1220341A1 | Hong Kong, China | A1 | |
| HK1220343A | Hong Kong, China | A | |
| HK1220343A1 | Hong Kong, China | A1 | |
| US9642572B2 | United States of America | B2 | |
| CA2751422C | Canada | C | |
| US2017296115A1 | United States of America | A1 | |
| JP6404286B2 | Japan | B2 | |
| CA2977574CThis record | Canada | C | |
| EP3552538A1 | European Patent Office (EPO) | A1 | |
| US11004561B2 | United States of America | B2 | |
| US2021193313A1 | United States of America | A1 | |
| EP3552538B1 | European Patent Office (EPO) | B1 | |
| EP2391971B1 | European Patent Office (EPO) | B1 | |
| EP3968220A1 | European Patent Office (EPO) | A1 | |
| ES2900643T3 | Spain | T3 | |
| US11342071B2 | United States of America | B2 | |
| US2022215947A1 | United States of America | A1 | |
| CA3049975C | Canada | C | |
| CA2906506C | Canada | C | |
| CA3170396C | Canada | C | |
| US11776686B2 | United States of America | B2 | |
| US2024079125A1 | United States of America | A1 | |
| US11935648B1 | United States of America | B1 | |
| US2024266043A1 | United States of America | A1 | |
| EP3968220B1 | European Patent Office (EPO) | B1 |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee for patent paidMPN | MPN | |
| Fee paidST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVEDU00 | U00 | |
| Full renewal or maintenance fee paidST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULLU11 | U11 | |
| Full renewal or maintenance fee paidST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANTU11 | U11 | |
| Full renewal or maintenance fee paidST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULLU11 | U11 | |
| Maintenance fee for patent paidMPN | MPN | |
| Fee paidST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVEDU00 | U00 | |
| Examination requestEEER | EEER |
Numbers
- Publication
- 2977574
- Application
- 2977574
Titles2
- English
- NONINVASIVE DIAGNOSTIC SYSTEM
- French
- SYSTEME DIAGNOSTIC NON INVASIF
Classification
- CPC, 50
- G16H40/63
- A61B5/0002
- A61B5/1036
- A61B5/4533
- A61B5/6807
- A61B5/6828
- A61B5/6833
- A61B8/0858
- A61B8/4227
- A61B8/4472
- A61B2562/02
- A61B2562/0204
- A61B2562/0219
- A61B2562/0247
- A61B2562/046
- A61B5/7267
- A61B8/4254
- A61B8/0875
- A61B8/4236
- A61B8/4477
- A61B8/467
- A61B8/483
- A61B8/5223
- A61B8/5238
- A61B5/112
- A61B5/1038
- A61B5/4585
- A61B2034/105
- A61B5/002
- A61B5/1114
- A61B5/1121
- A61B5/1127
- A61B5/6831
- A61B8/4263
- A61B5/4528
- G16H50/50
- A61B5/0004
- A61B8/466
- G16H20/30
- A61B2034/2048
- A61B2034/2051
- A61B5/743
- A61B5/7435
- G06N3/084
- A61B34/20
- A61B5/389
- A61B5/24
- A61B5/0059
- A61B5/11
- A61B5/72
- IPC, 4
- A61B5 103
- A61B8 08
- G16H20 30
- G16H40 63