Systems, devices and methods for enhancing operative accuracy using inertial measurement units
24 claims: 2 independent, 22 dependent
- 1手術支援を提供するためのシステムであって、プロセッサであって、撮像装置から、1つ又は2つ以上の医療用画像を受信することであって、前記1つ又は2つ以上の医療用画像が、(1)患者の解剖学的構造の1つ又は2つ以上の図、及び(2)既知のサイズの1つ又は2つ以上のマーカーを表す、受信することと、前記1つ又は2つ以上のマーカーの各々の前記既知のサイズに基づいて、前記1つ又は2つ以上の医療用画像内に表される前記患者の解剖学的構造のサイズを較正することと、前記患者の解剖学的構造の3次元(3D)表現を、(1)前記1つ又は2つ以上の医療用画像内に表される前記患者の解剖学的構造に一致する1つ又は2つ以上の解剖学的画像と、(2)前記1つ又は2つ以上の医療用画像及び前記3D表現上で識別された1つ又は2つ以上の解剖学的ランドマークと、に基づいて、生成することと、前記患者の解剖学的構造の前記3D表現に基づいて手術パラメータを計算することと、前記患者及び/又は前記患者に対応する手術台上に、前記患者に対して第1の配向で位置決めされている第1のIMUセットから、当該第1のIMUセットの位置を示す第1の慣性計測装置(IMU)データを受信することと、IMU対応ツールから、前記第1のIMUセットに対する相対的な位置を示す第2の慣性計測装置(IMU)データを受信することと、前記IMU対応ツールが前記患者の実世界の解剖学的構造上の特定の点に接触した際の前記第2の慣性計測装置(IMU)データに基づいて、前記実世界の解剖学的構造上の特定の点を、対応する前記3D表現上の解剖学的構造上の特定の点に相関させることにより、前記患者の実世界の解剖学的構造を前記3D表現に一致させることと、(1)前記手術パラメータ、及び(2)1つ又は2つ以上のIMU対応ツールに対応する第2のIMUセットから受信された第3のIMUデータのうちの1つ又は2つ以上に基づいて、手術フィードバックを出力することと、を行うように動作可能である、プロセッサを備える、システム。
- 2前記患者の解剖学的構造に一致する前記1つ又は2つ以上の解剖学的画像が、通信可能に連結されたデータベース又はアトラス内に記憶された既存の解剖学的画像セットの中から識別される、請求項1に記載のシステム。
- 3前記1つ又は2つ以上の解剖学的画像が、最良適合法を使用して前記患者の解剖学的構造に対して一致される、請求項2に記載のシステム。
- 4前記手術パラメータが、(1)骨アンカー挿入位置、(2)骨アンカー軌道、及び(3)骨アンカー深さのうちの1つ又は2つ以上を含む、請求項1に記載のシステム。
- 5前記手術パラメータが、前記患者の解剖学的構造の前記3D表現に対して計測される、請求項4に記載のシステム。
- 6前記第1のIMUデータが、前記IMUの各々の絶対位置を含む、請求項1に記載のシステム。
- 7前記プロセッサが、前記第1のIMUデータに基づいて、前記第1のIMUセット内の前記IMUの各々の相対位置を計算するように更に動作可能である、請求項6に記載のシステム。
- 8前記第1のIMUデータが、前記IMUの各々の前記相対位置を含む、請求項6に記載のシステム。
- 9前記手術フィードバックの前記出力が、前記手術フィードバックをディスプレイ装置上に描画させる、請求項1に記載のシステム。
- 10前記手術フィードバックが、前記患者の解剖学的構造に対する前記1つ又は2つ以上のIMU対応ツールのそれぞれの位置において、前記3D表現上に重ねられた前記1つ又は2つ以上のIMU対応ツールの視覚的表現を含む、請求項9に記載のシステム。
- 11前記手術フィードバックが、前記手術パラメータの視覚的表現を更に含む、請求項10に記載のシステム。
- 12前記プロセッサに通信可能に連結された少なくとも1つのメモリを更に備え、前記少なくとも1つのメモリが、既存の解剖学的画像の前記データベース又はアトラスを記憶するように動作可能である、請求項2に記載のシステム。
- 13手術支援を提供するためのシステムに備えられるプロセッサ が以下の各工程を 実行 する医療機器の作動 方法であって、撮像装置から、1つ又は2つ以上の医療用画像を受信することであって、前記1つ又は2つ以上の医療用画像が、(1)患者の解剖学的構造の1つ又は2つ以上の図、及び(2)既知のサイズの1つ又は2つ以上のマーカーを表す、受信することと、前記1つ又は2つ以上のマーカーの各々の前記既知のサイズに基づいて、前記1つ又は2つ以上の医療用画像内に表される前記患者の解剖学的構造のサイズを較正することと、前記患者の解剖学的構造の3次元(3D)表現を、(1)前記1つ又は2つ以上の医療用画像内に表される前記患者の解剖学的構造に一致する1つ又は2つ以上の解剖学的画像と、(2)前記1つ又は2つ以上の医療用画像及び前記3D表現上で識別された1つ又は2つ以上の解剖学的ランドマークと、に基づいて、生成することと、前記患者の解剖学的構造の前記3D表現に基づいて手術パラメータを計算することと、前記患者及び/又は前記患者に対応する手術台上に、前記患者に対して第1の配向で位置決めされている第1のIMUセットから、当該第1のIMUセットの位置を示す第1の慣性計測装置(IMU)データを受信することと、IMU対応ツールから、前記第1のIMUセットに対する相対的な位置を示す第2の慣性計測装置(IMU)データを受信することと、前記IMU対応ツール によって取得された 前記患者の実世界の解剖学的構造上の特定の点 を示す 前記第2の慣性計測装置(IMU)データに基づいて、前記実世界の解剖学的構造上の特定の点を、対応する前記3D表現上の解剖学的構造上の特定の点に相関させることにより、前記患者の実世界の解剖学的構造を前記3D表現に一致させることと、(1)前記手術パラメータ、及び(2)1つ又は2つ以上のIMU対応ツールに対応する第2のIMUセットから受信された第3のIMUデータのうちの1つ又は2つ以上に基づいて、手術フィードバックを出力することと、を含む、 医療機器の作動 方法。
- 14前記患者の解剖学的構造に一致する前記1つ又は2つ以上の解剖学的画像が、通信可能に連結されたデータベース又はアトラス内に記憶された既存の解剖学的画像セットの中から識別される処理 を 前記プロセッサ が 実行 す る、請求項13に記載の 医療機器の作動 方法。
- 15前記1つ又は2つ以上の解剖学的画像が、最良適合法を使用して前記患者の解剖学的構造に対して一致される処理 を プロセッサ が 実行 す る、請求項14に記載の 医療機器の作動 方法。
- 16前記手術パラメータが、(1)骨アンカー挿入位置、(2)骨アンカー軌道、及び(3)骨アンカー深さのうちの1つ又は2つ以上を含む、請求項13に記載の 医療機器の作動 方法。
- 17前記手術パラメータが、前記患者の解剖学的構造の前記3D表現に対して計測される、請求項16に記載の 医療機器の作動 方法。
- 18前記第1のIMUデータが、前記IMUの各々の絶対位置を含む、請求項13に記載の 医療機器の作動 方法。
- 19前記第1のIMUデータに基づいて、前記第1のIMUセット内の前記IMUの各々の相対位置を計算する処理 を 前記プロセッサ が 実行 す る、請求項18に記載の 医療機器の作動 方法。
- 20前記第1のIMUデータが、前記IMUの各々の前記相対位置を含む、請求項18に記載の 医療機器の作動 方法。
- 21前記手術フィードバックの前記出力が、前記手術フィードバックをディスプレイ装置上に描画させる、請求項13に記載の 医療機器の作動 方法。
- 22前記手術フィードバックが、前記患者の解剖学的構造に対する前記1つ又は2つ以上のIMU対応ツールのそれぞれの位置において、前記3D表現上に重ねられた前記1つ又は2つ以上のIMU対応ツールの視覚的表現を含む、請求項21に記載の 医療機器の作動 方法。
- 23前記手術フィードバックが、前記手術パラメータの視覚的表現を更に含む、請求項22に記載の 医療機器の作動 方法。
- 24前記プロセッサに通信可能に連結された少なくとも1つのメモリに、既存の解剖学的画像の前記データベース又はアトラスを記憶する処理 を 前記プロセッサ が 実行 す る、請求項14に記載の 医療機器の作動 方法。
Independent claims24
155 paragraphs, as filed
The present application relates to inertial measurement units (IMUs), and more particularly to their use preoperatively, intraoperatively, and postoperatively to achieve improved accuracy.
Conventionally, preoperative, intraoperative, and postoperative accuracy and success are determined using a combination of medical imaging and surgical navigation systems and devices. Medical imaging devices use imaging modalities such as computed tomography (CT), magnetic resonance (MR), angiography or fluoroscopy to allow medical professionals to visualize a patient's anatomy of interest. It is a system or set of systems that allows imaging an area of interest. Medical imaging devices include X-ray imaging systems and C-arm systems. Surgical navigation systems use a combination of medical imaging and cameras or other sensors to allow medical professionals to navigate a patient's anatomy during surgery.
To achieve optimal surgical results, a patient's anatomy is often medically imaged multiple times. For example, if the patient is undergoing orthopedic surgery, such as spinal surgery, the patient should (1) ascertain the patient's condition and/or injury, identify the type of surgery and surgical parameters required, and/ or (2) one or more radiographs preoperatively to determine the exact condition of the patient's spine near the day of surgery; , guidewires, needles, drills, taps, drivers, etc.) to provide navigation as they are operated and/or to determine the accuracy of each surgical task performed. or two or more X-ray images and (3) to assess the patient's spine after surgery, determine changes induced by surgery, and/or confirm success of surgery against preoperative planning. and one or more postoperative X-ray images. Such frequent medical imaging of patients exposes patients or medical staff to high doses of radiation, which can lead to serious medical risks such as cancer.
In order to minimize radiation exposure, it is desirable to reduce the number of medical images a patient is subjected to. One means of reducing imaging of the patient is to avoid acquiring inaccurate or substandard images of the patient's target anatomy, which may result from the positioning of the imaging system. It can be caused by misalignment, whereby the target anatomy is not properly or optimally visible by the imaging system. Conventional medical imaging systems, such as C-arm systems, are manually positioned for optimal alignment, a task that is time consuming and subject to human error. In many cases, medical imaging systems must be aligned, removed to allow the patient to be operated on, and returned to the same optimal position multiple times during surgery. Also, sometimes medical imaging systems require multiple optimal positions during a single procedure, for example, to align different anatomical regions, such as different pedicles of a patient's spine during an orthopedic surgery. must be aligned with Proper and accurate registration is of high importance in the intraoperative environment, where time and accuracy are even more critical. Additionally, these medical imaging and surgical navigation systems and devices are expensive to purchase, maintain, and operate.
<p>Accordingly, there is a need for systems, methods, and apparatus that provide medical imaging and/or surgical navigation while reducing radiation exposure. There is also a need for such systems, methods and devices that are less expensive than conventional means while providing improved surgical accuracy.</p>
<p>Systems and methods are provided for using an inertial measurement unit (IMU) to improve surgical accuracy. In some exemplary embodiments, improved surgical accuracy includes providing surgical assistance by outputting surgical feedback. To generate surgical feedback, a three-dimensional (3D) representation of the patient's anatomy is generated from medical images of the patient. Surgical parameters are calculated based on the generated 3D representation. IMUs are used to measure the relative position of the patient, and similarly other IMUs are used to measure the relative position of IMU-enabled tools. Output surgical feedback is obtained based on surgical parameters and data obtained from IMU measurements.</p><p>In other exemplary embodiments, the enhanced surgical accuracy is positioned on or attached to patient anatomy, operating tables, surgical instruments, or medical imaging and navigation systems and devices. providing pre-, intra-, and post-operative assessment and/or feedback using an IMU. IMU data obtained from sensors in the IMU are used to calculate absolute and/or relative positions of patient anatomy, operating tables, surgical instruments, or medical imaging and navigation systems and devices. . IMU data is used, for example, to provide surgical navigation, instrument or device alignment and placement, to generate preoperative plans, to calculate surgical parameters, to determine intraoperative corrections, and to assess postoperative changes. It can be combined with medical imaging, cameras, and the like.</p><p>In some embodiments, providing surgical assistance includes receiving one or more medical images from an imaging device. The one or more medical images represent (1) one or more views of the patient's anatomy and (2) one or more markers of known size. The size of the patient's anatomy represented in the one or more medical images is calibrated based on the known size of each of the one or more markers. A three-dimensional (3D) representation of a patient's anatomy includes: (1) one or more anatomies that match the patient's anatomy represented in one or more medical images; and (2) one or more anatomical landmarks identified on one or more medical images and 3D representations. Surgical parameters are calculated based on a 3D representation of the patient's anatomy, and first inertial measurement unit (IMU) data is received from a first set of IMUs. The patient's real-world anatomy is matched to the 3D representation based on the first IMU data. The surgical feedback is one or more of (1) surgical parameters and (2) secondary IMU data received from a secondary IMU set corresponding to one or more IMU-enabled tools. is output based on</p><p>In some embodiments, the one or more anatomical images matching the patient's anatomy are extracted from an existing set of anatomical images stored in a communicatively linked database or atlas. can be identified from within and matched to the patient's anatomy using best-fit methods.</p><p>In some embodiments, the surgical parameters may include one or more of (1) bone anchor insertion location, (2) bone anchor trajectory, and (3) bone anchor depth. Surgical parameters can be measured against a 3D representation of the patient's anatomy.</p><p>In some embodiments, a first IMU set may be positioned on a patient and/or an operating table corresponding to the patient in a first orientation relative to the patient. The first IMU data may include absolute positions of each of the IMUs.</p><p>In some embodiments, calculating the relative position of each of the IMUs in the first IMU set is based on the first IMU data. The first IMU data may include relative positions of each of the IMUs.</p><p>In some embodiments, matching the patient's real-world anatomy to the 3D representation is performed by using one of the IMU-enabled tools to generate contact points on the patient's real-world anatomy. and associating contact points on the real-world anatomy with corresponding points on the 3D representation.</p><p>In some embodiments, outputting the surgical feedback may cause the surgical feedback to be rendered on the display device. Surgical feedback is a visual representation of one or more IMU-enabled tools superimposed on the 3D representation at their respective positions relative to the patient's anatomy. can contain. Surgical feedback may further include visual representations of surgical parameters. In some embodiments, a database or atlas of existing anatomical images may be stored in at least one memory.</p><p>In some embodiments, a surgical navigation system includes one or more IMU-enabled instruments, cameras, and IMU-based assistance systems. An IMU-enabled device collects IMU data intraoperatively from each IMU of the IMU-enabled device. A camera tracks the intraoperative movement and position of one or more IMU-enabled instruments. An IMU-based assistance system determines the presence of errors in the movement and position tracking of one of the one or more IMU-enabled instruments and transmits the IMU data to the one or more IMU-enabled instruments. and using the IMU data to supplement movement and position tracking of one of the one or more IMU-enabled instruments. do. The IMU of each of the one or more IMU-enabled devices may be embedded or removably attached to the IMU-enabled device. A camera may include an IMU.</p><p>In some embodiments, the presence of an error is determined by (1) the angle of one or more of the IMU-enabled instruments relative to the line of sight of the camera exceeds a threshold; It may be triggered by one or more of the following: one or more of which are outside the camera's line of sight; and (3) the camera malfunctions.</p><p>In some embodiments, providing surgical feedback may include calculating correction factors for one of the one or more IMU-enabled instruments based on the IMU data. Complementing the movement and position tracking of one of the one or more IMU-enabled instruments further uses correction factors.</p><p>In some embodiments, one or more of the IMU-enabled instruments may include colored markers, and the camera identifies the colored markers of each of the one or more IMU-enabled instruments to determine one Track the movement and position of one or more IMU-enabled instruments.</p><p>In some embodiments, IMU data may include an absolute position of each of the one or more IMU-enabled instruments and a relative position of each of the one or more IMU-enabled instruments. (1) one or more IMU-enabled instruments, (2) a camera, and (3) a patient, when the relative position of each of the one or more IMU-enabled instruments is visualized by a camera. and the position of one or more IMU-enabled instruments relative to one or more of the anatomy.</p><p>In some embodiments, the surgical navigation method is determining the presence of errors in tracking movement and position of an IMU-enabled instrument performed using a camera, wherein the IMU-enabled instrument includes an IMU. determining that , is operable to intraoperatively collect IMU data therefrom; collecting IMU data from an IMU-enabled instrument; and using the IMU data, one or more IMU-enabled devices. complementing tracking of movement and position of one of the instruments; and providing surgical feedback. The IMU of the IMU-enabled device may be embedded or removably attached to the IMU-enabled device. IMU data may include absolute positions of IMU-enabled instruments and relative positions of IMU-enabled instruments. A camera may include an IMU.</p><p>In some embodiments, the presence of an error means that (1) the angle of the IMU-enabled instrument relative to the camera's line of sight exceeds a threshold and (2) the IMU-enabled instrument is outside the camera's line of sight. and (3) the camera malfunctioning.</p><p>In some embodiments, providing surgical feedback may further include calculating correction factors for the IMU-enabled instrument based on the IMU data. Complementary movement and position tracking of IMU-enabled instruments may further use correction factors.</p><p>In some embodiments, the IMU-enabled instrument may include colored markers, and the camera tracks movement and position of the IMU-enabled instrument by identifying the colored markers of the IMU-enabled instrument.</p><p>In some embodiments, the relative positions of the IMU-enabled instruments, when visualized by the camera, are among (1) the IMU-enabled instrument, (2) the camera, and (3) the patient's anatomy. indicates the position of the IMU-enabled device relative to one or more of the</p><p>In some embodiments, an IMU-based assistance system may include at least one memory and a processor coupled to the at least one memory. First IMU data is collected from multiple IMUs attached to a patient associated with a first physical position at a first instance. A first attribute of the patient is calculated based on the first IMU data. The first IMU data and the first attribute are stored in at least one memory. Second IMU data is collected from multiple IMUs attached to the patient involved in the first physical position at the second instance after the first instance. A second attribute of the patient is calculated based on the second IMU data. Also, changes to the patient's anatomy are identified by comparing the first attribute to the second attribute. In some embodiments, the first instance may occur preoperatively and the second instance may occur intraoperatively or postoperatively.</p><p>In some embodiments, multiple IMUs are attached to the patient at skin level using one or more of straps, adhesives, or clothing.</p><p>In some embodiments, the patient first attribute and the patient second attribute each include patient flexibility.</p><p>In some embodiments, standard measurements are received from at least one memory or over a network. The first IMU data or first attribute is compared to standard measurements. Patient status is assessed based on comparison of the first IMU data or first attribute to standard measurements.</p><p>In some embodiments, an IMU-based support system includes at least one memory and a processor communicatively coupled to the at least one memory. First IMU data is collected from multiple IMUs attached to a patient associated with a first physical position at a first instance. A first attribute of the patient is calculated based on the first IMU data. The first IMU data and the first attribute are stored in at least one memory. Second IMU data is collected from multiple IMUs attached to the patient involved in the first physical position at the second instance after the first instance. A second attribute of the patient is calculated based on the second IMU data. A change to the patient's anatomy is identified by comparing the first attribute to the second attribute.</p><p>In some embodiments, the first instance may occur preoperatively and the second instance may occur intraoperatively or postoperatively.</p><p>In some embodiments, multiple IMUs may be attached to the patient at the skin level using one or more of straps, adhesives, or clothing.</p><p>In some embodiments, the patient's first attribute and the patient's second attribute may each include patient flexibility.</p><p>In some embodiments, standard measurements are obtained from at least one memory or over a network. The first IMU data or first attribute is compared to standard measurements. Patient status is assessed based on comparison of the first IMU data or first attribute to standard measurements.</p><p>In some embodiments, a system for providing IMU-based registration includes a medical imaging device for imaging a patient and an IMU-based assistance system. A medical imaging device is movable relative to a patient or operating table, and the patient or operating table has a first IMU set mounted thereon. A medical imaging device may include an imaging source and an imaging detector having a second set of IMUs mounted thereon. The IMU-based support system is communicatively coupled to the medical imaging device and receives first IMU data from the second IMU set, wherein the first IMU data causes the medical imaging device to and receiving second IMU data from a second IMU set, wherein the second IMU data is received by the medical imaging device from the second IMU set. Receiving, including information obtained when in two positions, a second measured relative to (1) a medical imaging device in a first position, or (2) a patient or operating table; and calculating the relative position of the medical imaging device at the position of the medical imaging device.</p><p>In some embodiments, the medical imaging device is a C-arm and includes an emitter and detector at each end of the C-arm.</p><p>In some embodiments, the first IMU set is attached to the C-arm emitter and detector.</p><p>In some embodiments, the IMU-based assistance system (1) guides the medical imaging device from the first position to the second position after calculating the relative position of the medical imaging device at the second position; and/or (2) driving the C-arm from the first position to the second position after calculating the relative position of the medical imaging device at the second position. can provide alignment.</p><p>In some embodiments, in a first position the medical imaging device is in a ground position remote from the patient and in a second position the medical imaging device images a first portion of the patient. aligned to .</p><p>In some embodiments, the first IMU data and the second IMU data may include location information of the medical imaging device.</p><p>In some embodiments, an IMU-based support system may provide intra-operative feedback via a display device, the intra-operative feedback indicating the position of one or more IMU-enabled instruments relative to the patient. Intraoperative feedback may be generated based on third IMU data received from one or more IMU-enabled instruments.</p>
The present disclosure may be more fully understood from the following detailed description read in conjunction with the accompanying drawings.
<figref num="1">1 is a diagram of an exemplary embodiment of a system architecture including an IMU-based assistance system; FIG.</figref><figref num="2">FIG. 4 is a sequence diagram of an exemplary embodiment of a process for using an exemplary configuration of an IMU-based assistance system;</figref><figref num="3">1 is an exemplary embodiment of a medical image representing a lateral and back-to-front view of a patient;</figref><figref num="4">4 illustrates an exemplary embodiment of another configuration of an IMU-based assistance system embedded in a surgical navigation system;</figref><figref num="5">1 is a side view of a surgical instrument used with an IMU-based support system; FIG.</figref><figref num="6">4 illustrates an exemplary embodiment of another configuration of an IMU-based assistance system embedded in a personal computing device;</figref><figref num="7">FIG. 12A is a side view of an exemplary embodiment of a segment of the spine with an IMU attached.</figref><figref num="8">FIG. 4 illustrates an exemplary embodiment of another configuration of an IMU-based assistance system embedded in a C-arm imaging system; FIG.</figref><figref num="9">FIG. 4 is a sequence diagram of an exemplary embodiment of a process for using the configuration of an embedded IMU-based assistance system in a C-arm imaging system;</figref>
To provide a general understanding of the principles of construction, function, manufacture, and use of the systems and methods disclosed herein, specific illustrative embodiments will now be described. One or more examples of these embodiments are illustrated in the accompanying drawings. Those skilled in the art will appreciate that the systems, devices and methods described in detail herein and illustrated in the accompanying drawings are non-limiting exemplary embodiments. Features illustrated or described in connection with one exemplary embodiment may be combined with features of other embodiments. Such modifications and variations are intended to be included within the scope of this disclosure. Further, to the extent, for example, that features or steps are described as "first" or "second", such numerical order is generally arbitrary and thus such numbering may be interchangeable.
This disclosure includes several illustrations and descriptions, including prototypes or bench models. A person of ordinary skill in the art would recognize that technology provided in products such as consumer ready-to-use, warehouse ready-to-use, or operating room ready-to-use surgical systems; It will be appreciated how to rely on the present disclosure to integrate systems, devices and methods.
Those skilled in the art will recognize that the present disclosure has application in conventional endoscopic minimally invasive surgical procedures, as well as open surgical procedures, as well as robotic-assisted surgery.
Exemplary embodiments of the present disclosure provide improved surgical assistance. Measurement data from the IMU's sensors are collected preoperatively, intraoperatively, and/or postoperatively. The IMU is attached to or provided with one or more of a patient's anatomy, an operating table, surgical instruments, or medical imaging and navigation systems and devices. Data obtained from the IMUs can be used to calculate absolute positions of and/or relative positions between the IMUs and their corresponding objects. The data received from the IMU, including the calculated absolute and relative positions, are used in medical imaging to provide, among other things, surgical navigation, imaging device alignment, preoperative planning, intraoperative correction, and postoperative evaluation. , information obtained from the camera, and other data.
System FIG. 1 illustrates one exemplary embodiment of a system architecture 100 for providing IMU-based assistance in pre-operative, intra-operative, and post-operative environments. As shown, system architecture 100 includes IMU-based support system 101 communicatively coupled to IMU 103 and medical devices and systems 105 .
An IMU is an electronic device equipped with sensors that can detect and report information about the object to which the IMU is attached. Sensors within the IMU may measure attributes of the object including, for example, its specific forces, angular velocities, magnetic fields, rotation (e.g., pitch, yaw, roll), acceleration, position, position, and angular references. It may include two or more accelerometers, gyroscopes, and magnetometers. The sensor may be a 3-axis sensor.
IMUs 103 include IMUs 103-1, 103-2, ..., and 103-n (collectively referred to as "IMUs" and/or "103"). Each of the IMUs 103 may be stand-alone IMUs, such as IMUs 103-2 and 103-n, or medical or surgical tools or instruments (hereinafter "IMU-enabled tools" or "IMU-enabled devices"), such as IMU 103-1. ). Although three IMUs are illustrated in FIG. 1, it should be understood that any number of IMUs and IMU-enabled tools exist and can be communicatively coupled to IMU-based support system 101. FIG.
As shown in FIG. 1, IMU 103-1 is provided on IMU-enabled tool 104-1. An IMU-enabled tool is an instrument, device, etc. that may be used in a surgical environment. Non-limiting examples of tools used in orthopedic surgical environments that may be IMU-compatible include guidewires, needles, taps, drivers, drills, cutters, blades, bone skids, retractors, access devices, and forceps; Also included are implants such as bone anchors, spacers, cages, rods, plates, connectors and the like. In some embodiments, the IMU-enabled tool can be an array that includes multiple surgical tools. Each of the tools may be manufactured with an IMU, or may have an IMU added to it at a later point after manufacture, either permanently or removably.
The IMU 103 may transmit data collected by their respective sensors to other communicatively coupled systems and devices via wired or wireless communication means known to those skilled in the art. For example, IMU 103 may communicate with IMU-based support system 101 or medical devices and systems 105 with each other. In some embodiments, IMUs with wireless communication capabilities communicate with each other using Wi-Fi, Near Field Communication (NFC), Bluetooth, and other short-range radio frequency means known to those skilled in the art. and communicate with other systems and devices.
Medical devices and systems 105, which may include one or more of C-arm system 105-1, medical imaging device 105-2, and surgical navigation system 105-n, may be used in a surgical environment. It should be understood that any number and type of devices and systems described may be included within medical devices and systems 105 . Each of the medical devices and systems 105 may include one or more of a processor, memory, display device, and wired and/or wireless communication means. C-arm system 105-1 is an X-ray fluoroscopy system used for diagnostic and surgical procedures. Medical imaging device 105-2 may be an X-ray machine for producing medical images of the patient in the preoperative environment. In some embodiments, the C-arm system 105-1 and medical imaging device 105-2 are known in the art, including computed tomography (CT), magnetic resonance (MR), angiography or fluoroscopy. It should be appreciated that other imaging means may be utilized. Surgical navigation system 105-n is a system of various instruments that can be tracked with respect to each other and to the patient. C-arm system 105-1, medical imaging device 105-2, and surgical navigation system 105-n are further described in greater detail below with reference to FIGS.
In some embodiments, IMU-based support system 101 is a stand-alone system including one or more of a processor, memory, display device, and communication means. For example, IMU-based assistance system 101 may be partially or fully integrated, embedded, or implemented in a personal computing device, mobile computing device, tablet, or the like. The display device of system 101 can display data obtained by system 101 from IMU 103 and/or medical devices and systems 105, or the output, display, or render information, including data calculated or generated by In other embodiments, IMU-based support system 101 includes one of IMUs (eg, IMUs 103-2, 103-n), IMU-enabled tools (eg, IMU 103-1), and/or medical devices and systems 105. are parts, are housed with them, are embedded in them, or are integrated in them. In such scenarios, system 101 may use or share memory, processors, displays, and/or communication means of IMUs, IMU-enabled tools, and medical devices and systems.
It should be appreciated that one or more of IMU-based support system 101, IMU 103 or IMU-enabled tools, and medical devices and systems 105 may be operated or interacted with by humans or by robotic systems.
First Embodiment FIG. 2 is a sequence diagram 200 illustrating one exemplary embodiment of the configuration of the IMU-based assistance system 101 for providing intraoperative feedback. More specifically, in the exemplary embodiment described with respect to FIG. 2, intraoperative feedback provided by IMU-based support system 101 is used to insert bone anchors (eg, pedicle or lateral mass screws). or include guidance for transplanting. As shown in step 250, imaging device 105-2 acquires medical images of the patient in the preoperative environment. The medical image obtained in step 250 is X-ray, but medical images can be of various types known in the art, including magnetic resonance (MR), computed tomography (CT), and fluoroscopy. It can be obtained using technology and technology.
In some embodiments, the medical images obtained in step 250 are obtained from the patient while the patient is in a standing position, but it should be understood that the patient may be imaged in any position. A medical image is a visual representation of a view of a patient, such as front-to-back views and side views. The patient, along with the patient, is also visually represented on the medical image using one or more radiographic film identification markers, such as X-ray markers commonly known in the art. imaged. Markers may also be established after images are taken using manual or automated techniques based on identification of anatomical features, as will be understood by those skilled in the art. Properties such as the size of the X-ray markers are known or can be calculated by the imager 105-2 and/or the IMU-based assistance system 101.
FIG. 3 illustrates one exemplary embodiment of medical images 310 and 312, which are X-rays representing a lateral view and an anterior-posterior view of a patient's spine, respectively. Identified in medical images 310 and 312 are the patient's pedicle center and spinous rim. Each of medical images 310 and 312 is also a visual representation of markers 314 used during the generation of X-rays or generated during X-ray review by manual or automated methods of identification of anatomical features. including. As described in detail in connection with flowchart 200, medical images, such as medical images 310 and 312, are used to provide patient intraoperative feedback.
Medical images 310 and 312 are transmitted from imaging device 105-2 to IMU-based support system 101 at step 252. FIG. Medical images may be transmitted by wired or wireless communication means. In some embodiments, the medical image is sent to the IMU-based assistance system 101 by capturing the medical image using a camera or other input or imaging device of the IMU-based assistance system 101 . In some embodiments, the medical images are transmitted as or compiled into a single medical image. Hereinafter, a medical image may refer to a grouping of one or more medical images (or photographs of medical images) representing one or more views of a patient.
Using the medical image obtained in step 252, the IMU-based assistance system 101, in step 254, determines the size of the anatomy (or part of the patient's body) visually represented in the medical image. calibrate. For example, to calibrate the size of an anatomical structure, the system 101 identifies markers used during imaging of the patient at step 250, which are visually represented in the medical image to obtain their size. or calculate. Having the size of the markers allows the system 101 to calculate attributes of the visually represented anatomy and medical images, such as its magnification and the distance from the patient at which the medical images were acquired. to enable. It should be appreciated that various calibration algorithms known to those skilled in the art may be used in step 252 . Examples of such algorithms for calculating X-ray magnification and calibration are found, for example, in Gorski, JM, and Schwartz, L. "A Device to Measure X-ray Magnification in Preoperative Planning for Cementless Arthroplasty," Clinical Orthopaedics and Related Research 202(1986):302-306, Conn, KS, MTClarke, and JPHallett, "A Simple Guide to Determine the Magnification of Radiographs and to Improve the Accuracy of Preoperative Templating," Bone & Joint Journal 84.2(2002):269 -272, The, B., et al., "Digital Correction of Magnification in Pelvic X-rays for Preoperative Planning of Hip Joint Replacements: Theoretical Development and Clinical Results of a New Protocol," Medical Physics 32.8(2005):2580- 2589, King, RJ, et al. Calculating the Radiological Magnification of the Hip," Bone & Joint Journal 91.9(2009):1217-1222, Schumann, S., Thelen, B., Ballestra, S., Nolte, LP, Buchler, P., & Zheng, G. , "X-ray Image Calibration and Its Application to Clinical Orthopedics," Medical Engineering & Physics (2014):36(7), 968-974, the contents of which are incorporated herein by reference in their entirety. be
Next, at step 256, a three-dimensional (3D) representation of the anatomy calibrated at step 254 is generated. A 3D representation is created by matching the calibrated anatomy to existing 2D and 3D anatomical images corresponding to the type of calibrated anatomy. The existing anatomical images used to generate the 3D representation may be one of the images stored and managed by system 101 or by a third party provider system communicatively coupled to IMU-based support system 101. Derived from one or more databases, atlases, or repositories. In some embodiments, generating a 3D representation of the calibrated anatomy includes a database, atlas or repository of images that most closely match or resemble the calibrated anatomy. It is performed using a best-fit method that identifies one or more 2D or 3D anatomical images from . The identified matching or similar images can be used alone or in combination with each other to generate a 3D representation of the calibrated anatomy. Examples of such algorithms for identifying anatomical images include, for example, Baka, Nora, et al. "2D-3D shape reconstruction of the distal femur from stereo X-ray imaging using statistical shape models," Medical image analysis 15.6(2011):840-850, Markelj, Primoz, et al. "A review of 3D/2D registration methods for image-guided interventions," Medical image analysis 16.3(2012):642-661, Lamecker, Hans, Thomas H. Wenckebach, and HC. Hege.
In some embodiments, the process of generating the 3D representation described in relation to step 256 includes (1) identifying specific anatomical landmarks on the patient's anatomy represented in the medical image; and (2) matching identified anatomical landmarks to corresponding points on the generated 3D representation. Using this information, and information calculated using the markers in the medical image (e.g., size of the anatomy), the medical image of the patient's anatomy is mapped to the 3D representation. can be mapped more accurately. This identification and matching also allows the system 101 to establish accuracy or errors in the 3D representations and ultimately the resulting 3D representations are optimal and possibly calibrated anatomical data. allow corrective action to be taken to ensure that the scientific structure is represented.
Moreover, this identification and matching of anatomical landmarks can be performed using one or more of a computing device, a robotic system, or a human. For example, in some embodiments, a medical image and a 3D representation of the calibrated anatomy are graphically rendered by the display device of the IMU-based support system 101, either simultaneously or sequentially. The display device prompts the user to identify designated anatomical landmarks within the graphically rendered medical image. The user can be any of a variety of medical professionals who can accurately identify the landmarks needed. For example, when the anatomical structure represented in the medical image is the spine or a portion thereof, the user may specify the pedicle or pedicle center, spinous margin, midline axis, as illustrated in FIG. , or an anatomical landmark such as an intervertebral disc. The user may use any of a variety of computing input devices known in the art such as mice, keyboards, microphones, touch pads, touch screens, etc., as well as various known in the art such as clicking, tapping, selecting, speech recognition, etc. Any desired input technique may be used to identify the desired anatomical landmarks on the displayed medical image.
Once the user has identified one or all of the requested anatomical landmarks on the medical image, the user can locate the matching anatomical landmarks on the displayed 3D representation of the patient's calibrated anatomy. You are similarly prompted to identify academic landmarks. Accordingly, system 101 may determine whether a 3D representation is missing based on information obtained from the identification and matching process. For example, the requested anatomical landmarks are identified on the medical image but are not identifiable on the 3D representation, or the anatomical landmarks identified on the medical image are not identifiable on the 3D representation. appears to have an unexpected size or positioning, system 101 may modify or generate a more accurate 3D representation, or may recalibrate the size of the anatomy. The generation of the 3D representation of step 256, including identification and matching of anatomical landmarks, may be repeated until a 3D representation of suitable accuracy is generated. The appropriate accuracy of the 3D representation is determined in real-time by the user viewing the 3D representation or by using thresholds and/or rules that determine the amount of deviation allowed between the 3D representation and the medical image. obtain. The final resulting 3D representation may also be referred to as the "first image" or the "pre-operative image".
At step 258, the IMU-based assistance system 101 uses the anatomical data to calculate surgical parameters from the pre-operative 3D representation generated at step 256. In some embodiments, the IMU-based assistance system uses a statistical shape model of the anatomy and the planned trajectory to calculate surgical parameters, then morphs this model to derive modify the target patient's anatomy. Non-limiting examples of surgical parameters include (1) identification of one or more bones or bone segments to which bone anchors are to be secured, (2) bone anchor entry points, and (3) bone anchors are driven. Target coordinates for the trajectory and (4) the depth to which the bone anchor is to be driven.
Next, at step 258 , IMU data is obtained by the IMU-based support system 101 from each of the IMUs 203 wirelessly coupled with the system 101 . IMU data may include, for example, rotation matrices and translation vectors that describe detected data such as orientation and position. In the exemplary embodiment, IMU 203 is multiple standalone IMUs, including IMUs 103-2 and 103-n. Prior to obtaining IMU data, in an intraoperative environment, the IMU 203 is positioned either on the operating table or on the patient aligned in a particular orientation. Thus, for example, the IMU can be aligned with the sagittal plane of the patient's anatomy and oriented perpendicular to gravity. IMU 203 may be positioned and/or aligned by a medical professional or the like who has access to the patient in an intraoperative environment. The IMU 203 is then turned on and the IMU data is transmitted to the system 101 by the IMU's wireless communication means (eg, Bluetooth). IMU data may be reported to system 101 unsolicited by each of IMUs 203 or may be requested by system 101 and sent to system 101 . IMU data reported by IMU 203 includes information generated and collected by each sensor of the IMU, such as the absolute position of each of IMUs 203 and/or their relative positions.
At step 262, the IMU-based support system 101 prompts the IMU-enabled surgical tool to be used to contact specific points on the patient's real-world anatomy. In some embodiments, the points to be contacted correspond to the anatomical landmarks described above in relation to step 256. By touching these points, it is possible to match the points in real-world space to the 3D model generated and stored by system 101 . Input requests by the system 101 may be made through the display device of the system 101 . For example, the IMU-based support system 101 may display a list of areas to be contacted using the IMU-based surgical tool, or their desired contact on a visual representation of the patient's anatomy. points can be displayed. It should be appreciated that prompts may be performed one point at a time, such that each subsequent prompt is presented only after the point prompted by the previous prompt has been touched. Alternatively, all points can be prompted using a single prompt.
At step 264 , the IMU-enabled tool 103 - 1 used to touch the points prompted at step 262 sends touch information to the IMU-based assistance system 101 . As discussed above, the manner in which contact information is transmitted may vary as the points to be touched may be prompted individually or as a group. Here, at step 264, IMU-enabled tool 103-1 transmits information indicating that the prompted point has been touched each time IMU-enabled tool 103-1 touches such point. The contact information sent by the IMU-enabled tool 103-1 for each touch point may include an indication that the point was touched and/or the coordinates of each particular point touched on the patient's anatomy.
The coordinates of each contact point are obtained from sensors within the IMU of the IMU-enabled tool 103-1. These coordinates may indicate, for example, relative to an operating table or an IMU positioned on the patient, the location of each particular point of the patient's anatomy that touches the IMU-enabled surgical tool in space. Next, in step 266, the IMU-based support system 101 uses the information received in step 264 indicating the coordinates of particular points on the patient's anatomy to generate the preoperative data generated in step 256. The patient's real-world anatomy is determined and matched to the anatomy represented in the image. This can be accomplished by correlating corresponding anatomical points or landmarks between the patient's real-world anatomy and the anatomy of the preoperative 3D representation. Once the real-world anatomy is matched to the pre-operative 3D representation, the system 101 aligns the positions of the patient's real-world anatomy and the IMU-enabled surgical tool relative to each other and to the pre-operative 3D representation. It can be recognized or determined with respect to the anatomy represented in the representation. Using this information, in an intraoperative environment, the IMU-based support system 101 may provide, apply, or verify application of the surgical parameters calculated in step 258.
Once the patient's real-world anatomy has been matched with the patient's pre-operative 3D representation, the system 101 provides an indication that the IMU-based support system 101 is ready to be used in conjunction with other tools. can provide. For example, as shown in FIG. 2, a tool 204, such as a pedicle preparation tool, will be used in a surgical environment. Therefore, system 101 can indicate that tools 204 that are IMU-enabled are ready to be used.
Accordingly, at step 268, the IMU-based support system may provide various intraoperative feedback as the tool 204 is used in surgery. Intraoperative feedback may be determined based in part on acquired or calculated surgical parameters, preoperative 3D representation images, patient anatomy matching the 3D representation, and/or IMU data. Feedback may be provided in real-time or substantially real-time through use of tool 204 . It should be appreciated that intraoperative feedback and information used to generate it, such as measured placement and movement of tools (eg, relative to surgical parameters), may be recorded in the memory of system 101 .
In some embodiments, the system 101 at step 268 displays a visual representation of the tool 204 and the position of the tool relative to the patient's anatomy or the pre-operative 3D representation image. The position of the tool 204 may be matched with position data generated by the sensors of the IMU of the tool 204, patient anatomy and/or pre-operative 3D images (as described in connection with step 266). can be obtained from
In some embodiments, a visual representation of the tool 204 may be superimposed over a pre-operative 3D image of the patient's anatomy and shown in real-time or substantially real-time. Calculated surgical parameters may also be displayed in conjunction with the tool's 204 visual representation. Thus, system 101 can provide real-time feedback of tool position compared to surgical parameters. For example, as the tool moves, the display depicts a visually represented trajectory of the tool and a target trajectory in the pre-operative image. Similarly, a visually represented tool may be shown with the identified bone to which the bone anchor is to be secured, the bone anchor entry point, the target depth of the bone anchor, and the like. Displaying a visual representation of the tool in this manner allows for real-time feedback and correction of the tool's motion to match surgical parameters. In some exemplary embodiments, system 101 may display other measurements of IMU-enabled tool 204, such as angle measurements.
In some embodiments, the intra-operative feedback provided at step 268 includes notifications, warnings, etc. that indicate specific amounts of deviation of IMU-enabled surgical tool operation from calculated surgical parameters.
Second Embodiment FIG. 4 illustrates another exemplary embodiment of an IMU-based assistance system 101 configuration. In FIG. 4, IMU-based support system 101 provides improved accuracy, such as error correction, for navigating surgeries performed using surgical navigation systems 105-n. The IMU-based assistance system 101 of FIG. 4 is incorporated into surgical navigation system 105-n such that system 101 shares the hardware (eg, processor and memory) and/or software resources of navigation system 105-n. there is However, in some embodiments, the functionality of the systems 101 and 105-n described in connection with FIG. 4 are in communication with the stand-alone IMU-based assistance system 101 and the stand-alone surgical navigation system 105-n. It should be understood that it can be provided using
As described above in connection with FIG. 1, surgical navigation system 105-n is a system that includes a set of instruments (tools) and devices that can be tracked intraoperatively relative to the patient's anatomy. . As shown in FIG. 4, surgical navigation system 105-n includes instrument array 405-1, camera 405-2, instrument shaft 405-3, and display device 405-4. Although not shown in FIG. 4, it should be appreciated that surgical navigation system 105-n may include other types and numbers of instruments and devices.
A conventional surgical navigation system uses a camera to track the position and positioning of its instruments to identify movement of the array relative to the camera. However, the accuracy of conventional navigation systems degrades when the instrument is rotated out of the camera's field of view, eg, when the instrument array is flipped 180 degrees out of the camera's line of sight. In this regard, to address shortcomings from conventional navigation systems, surgical navigation system 105-n may additionally or alternatively include IMUs mounted on instrument array 405-1 and/or instrument shaft 405-3. Included in
Although in some embodiments the IMU may be added to the instrument during manufacture of the navigation system, in FIG. 4 the IMU is removably attached to instrument array 405-1 and instrument shaft 405-3 after manufacture. there is As described in more detail above in connection with FIG. 2, IMUs include sensors that can measure and report attributes of the objects to which they are attached. Therefore, IMU-enabled instrument array 405-1 and shaft 405-3, along with information about their absolute positions, rotations, angles, etc., are positioned relative to each other and other instruments and devices of navigation system 105-n or relative to the patient. , sensors in their respective IMUs that can collect these and other attributes of instrument array 405-1 and shaft 405-3.
In some embodiments, IMU-enabled instruments 405-1 and 405-3 may report measured data of the IMU-enabled instruments to IMU-based assistance system 101. FIG. The measured data can be used to provide intraoperative feedback, such as error correction, in connection with instrument operation, patient anatomy, imaging of patient anatomy, and calculation of surgical parameters. . On the other hand, in some embodiments where IMU-enabled instrument array 405-1 and instrument shaft 405-3 are configured to work with camera 405-2, the IMU-enabled instrument is more efficient than using a camera alone. provide greater accuracy and/or error correction.
One non-limiting example of error correction is that the IMU-based assistance system 101 and the surgical navigation system 105-n may result from line-of-sight problems with the visual navigation system, where the cameras may lose sight of their respective tracking arrays. Including applying correction factors when identifying potential tracking errors, such as those that occur. The IMU can detect relative angular changes and report these changes to the surgical navigation system 105-n. If the angular change is different from that measured by camera 405-2, or if the camera is no longer able to see the instrument array, then the 3D angular change measured by the IMU will be measured by the instrument before it leaves the field of view of camera 405-2. Added to the last known position. The navigation system then displays the updated position and trajectory of the instrument until it is back in the correct field of view of camera 405-2. For example, surgical navigation system 105-n may determine that instrument array 405-1 (or another instrument) has been rotated or angled away from camera 405-2, or has been previously identified or calculated in real time. As determined based on the threshold, it may be detected that it is likely to be otherwise obscured and induce errors. In such cases, it is assumed that camera 405-2 can no longer accurately measure the position and/or other attributes of instrument array 405-1 with sufficient accuracy. Accordingly, IMU-based assistance system 101 acquires data from the IMU of the IMU-enabled instrument to complement the tool measurements obtained from camera 405-2. In other words, once instrument array 405-1 can no longer be reliably tracked by camera 405-2, the sensors of IMU-enabled instrument array 405-1 acquire and transmit data to system 101. FIG. IMU-based assistance system 101 and navigation system 105-n share their IMU data and camera positioning information to provide error correction for instruments 405-1 and 405-3, such as their positions. Generate positive information. Error correction information about instruments 405-1 and 405-3 is displayed when display 405-4 displays one or more of instruments, patient anatomy, imaging of patient anatomy, or surgical parameters. seamlessly continue to display the visual representation of
By supplementing instruments 405-1 and 405-3 with IMUs, the range of navigation system 105-n is extended by effectively increasing the field of view of camera 405-2 and reducing or eliminating its blind spots. can be
Third Embodiment Another exemplary embodiment of the configuration of the IMU-based support system 101 is used to provide visual tracking of surgical tools. In this embodiment, IMU-based assistance system 101 is similar to surgical navigation system 105-n described above in connection with FIG. 4, without the need for such surgical navigation systems and the high costs associated therewith. Provide navigation.
Instead, in the present exemplary embodiment, IMU-based support system 101 includes a processor, memory, display device, and camera. The camera of the IMU-based assistance system may be housed with other components of the IMU-based assistance system 101, or as a separate device communicatively coupled (eg, using Bluetooth) to the rest of the system 101. may be provided. In some embodiments, the camera is statically positioned, such as an operating table-mounted camera. An IMU-based support system wirelessly communicates with an IMU coupled to a surgical instrument and/or implant. As shown in FIG. 5, the surgical instrument also has a color, pattern, combination that uniquely identifies the instrument that can be used to track the surgical instrument using a camera as described below. They have markers 515 attached to them, such as spheres or flags with .
In the intraoperative environment, the cameras of the IMU-based support system 101 determine the position, angle, orientation, and orientation of the instruments by identifying and tracking markers attached or provided on each instrument in images stored by the cameras. Other attributes can be measured. Additionally, each IMU of an IMU-enabled instrument may collect measurement data from its sensors and transmit it to the IMU-based support system 101 . The IMU measurement data includes the various measurements described above in connection with FIG. 2 with respect to each other or other IMUs of the IMU-enabled instruments.
As described above in connection with FIG. 4, the IMU-based assistance system 101 combines the measurements obtained from the cameras of the IMU-based assistance system 101 of the present embodiment with the IMUs collected and reported by the IMU of the IMU-enabled instrument. It can be complemented with measurement data. In this manner, blind spots and line-of-sight problems resulting from statically positioned cameras of system 101 are reduced by using IMU metrology data to correct inaccurate or error-prone camera metrology data. or may be excluded.
By supplementing camera measurement data with IMU measurement data, the display of IMU-based assistance system 101 can be used even when the camera is unable to accurately measure instrument position, angle, orientation, and other attributes. can also provide continuous intraoperative feedback.
In some embodiments, IMU measurement data may be used as primary navigation information, and measurements obtained from the camera may be used to correct the IMU data as needed. For example, absolute position and/or orientation information obtained from a camera may be used periodically to correct drift errors that may occur in relative position and/or orientation measurements obtained from an IMU. In some embodiments, the IMU may be omitted and the instrument may be tracked using only markers and cameras.
Fourth Embodiment FIG. 6 illustrates another exemplary embodiment of an IMU-based assistance system 101 configuration. In FIG. 6, the IMU-based support system 101 provides preoperative planning and intraoperative and postoperative assessment capabilities. As shown, the IMU-based assistance system 101 illustrated in FIG. 6 is provided on or used in conjunction with a smart phone, tablet, or similar computing device.
In a preoperative environment, one or more IMUs may be attached to patient 620 to measure desired attributes about patient 620 . For example, in a preoperative environment for spine surgery, an IMU may be attached to the patient's 620 spine, pelvis, hips, head, and/or thighs at the skin level. Skin level refers to the area above or substantially adjacent to the patient's skin. Non-limiting examples of means by which the IMU may be attached to the patient 620 include using straps, adhesives, or clothing (eg, shirts, vests) with the IMU.
The patient's flexibility, range of motion, gait, or other parameters are then measured by prompting the patient 620 to assume various physical postures, such as the stooped posture illustrated in FIG. . Prompting the patient 620 may be performed by displaying the postures taken by the patient 620 via the display device of the IMU-based support system 101 . In some embodiments, the camera of system 101 may film or record the patient as he poses to ensure that it matches the input requirements for the pose. In some embodiments, photographic or video recordings may be stored using a separate device and sent to system 101 for processing. Once the patient 620 assumes the poses prompted by the system 101 , the IMU-based support system 101 obtains and/or requests sensor data from the IMU attached to the patient 620 . Sensor data includes, among other things, the relative position of each of the IMUs attached to patient 620 . For example, using sensor data obtained and/or requested from the IMU, system 101 may calculate the relative position and/or angle of the patient's head and cervical spine with respect to the patient's pelvis.
The patient's flexibility, range of motion, etc. determined by the system 101 using sensor data may be used by the system 101 to diagnose the patient's condition and/or identify the patient's target or desired flexibility. can be compared against an objective standard, which can be obtained from the memory of For example, a preoperative plan including desired or target flexibility is determined by a medical professional and/or a computing system (e.g., IMU-based support system 101) using objective standard measures of flexibility. obtain.
In an intraoperative setting, measurements of the patient 620 obtained preoperatively can be used to assess the patient and, if necessary, to make corrections as necessary. More specifically, one or more of the IMUs attached to the patient preoperatively may remain with the patient while the patient undergoes surgery. In some embodiments, additional IMUs may be attached to the patient. For example, during spinal surgery, an IMU can be attached to the patient's spine at various spinal levels, as shown in FIG. Thus, FIG. 7 illustrates an IMU 703 clipped or attached to each spinous process of each of a plurality of vertebrae.
Then during surgery, the IMU-based support system 101 may acquire and/or request sensor data from an IMU attached to the patient 620 . Sensor data may be continuously transmitted from the IMU to the IMU-based assistance system 101 in real-time or substantially real-time. Additionally or alternatively, sensor data may be sent from the IMU to the IMU-based support system 101 upon request, eg, when certain surgical milestones are reached during surgery on the patient 620 .
Referring to the spinal surgery example referenced above, the data transmitted intraoperatively from the IMU to the IMU-based support system 101 can be used to correct for detorsion, kyphosis/lordosis correction, distraction/compression, fracture reduction, etc. It can be used to measure patient attributes. Intraoperatively measured attributes are compared to preoperatively received IMU data and/or to a calculated preoperative plan that includes target measurements and/or attributes of the patient. For example, in artificial disc surgery, the IMU is used to set the spine in the proper position and to obtain measurements to ensure that the endplates are properly selected to keep the patient centered and neutral. , can be placed at different levels of the spine. For posterior neck surgery, the IMU measures and calculates whether the patient's head is properly positioned and whether the patient's gaze angle is optimal. can be placed in For surgery to correct spinal distraction, IMUs are placed at different levels above and below the relevant disc space, for example, to measure the disc space angle and determine the optimal cage size and angle.
In some embodiments, IMUs mounted at multiple spine levels are used to build a statistical geometric model of the patient's spine in 3D. In other words, the data generated by the IMU 703 produces information about the geometric properties of the patient's spine. The IMU-based assistance system 101 can generate shape models and track 3D spinal corrections without the need to acquire medical images. In another embodiment, for example, an IMU attached to the patient's pelvis, spine, and/or femur can be used to measure the tilt of the patient's pelvis preoperatively and intraoperatively. By comparing the two, the system 101 can determine whether the pelvic tilt has been corrected or how it has been altered relative to the preoperative measurements or plan.
Post-operatively, the IMU-based support system 101 acquires and/or requests sensor data from an IMU attached to the patient 620 at all or a portion of the patient's site where the IMU was attached before or during the operation. System 101 compares pre-operative and/or post-operative measurements obtained by system 101 via an IMU attached to patient 620 to post-operative sensor data to determine the effectiveness of such measurements as flexibility and head positioning. Changes to patient attributes may be calculated. This comparison yields the progress and/or progression of the patient. System 101 provides confirmation of whether targeted correction for the patient has been achieved by surgery.
The IMU-based support system 101 displays text and/or graphics indicative of one or more of the patient's pre-, intra-, or post-operative measurements and/or the patient's pre-operative plan via a display device. provide feedback by displaying For example, the display device of system 101 provides an illustration of the patient in the position taken preoperatively. An illustration of a patient 620 shows measurements obtained from data generated by an IMU attached to the patient, including posture, angle, and/or curvature of or between specific regions of the patient's body to which the IMU is attached. can include The system 101 may also illustrate the patient in the same position taken intra-operatively or post-operatively, with the same measurements of the patient 620 displayed with the pre-operative images. Additionally, the system 101 may display patient measurements and/or illustrations according to preoperative planning. Such a display allows a medical professional or other operator of system 101 to visualize the progress achieved by the surgery.
Fifth Embodiment FIG. 8 illustrates another exemplary embodiment of an IMU-based assistance system 101 configuration. In FIG. 8, IMU-based support system 101 provides precise alignment of a surgical system such as C-arm system 105-1. The IMU-based support system 101 of FIG. 8 is incorporated into C-arm system 105-1 such that system 101 shares the hardware and/or software resources of C-arm system 105-1. However, in some embodiments, the functionality of systems 101 and 105-1 described in connection with FIG. 8 uses standalone IMU-based assistance system 101 and standalone C-arm system 105-1 in communication with It should be understood that the
C-arm system 105-1 is an X-ray fluoroscopy system used, for example, to provide real-time medical images of patient 834 during surgery on the patient. C-arm system 105-1 includes a C-arm connecting X-ray detector 830-1 to X-ray source 830-2 (also referred to as an "X-ray radiator"), which is visible in FIG. No, but positioned under operating table 832 . In some embodiments, the positions of X-ray source 830-1 and X-ray detector 830-2 are inverted such that each is at a different end of C-arm 830 than shown in FIG. It should be understood that C-arm system 105-1 also includes a display device that can be used to input and output information. For example, the display device may output a medical image of the patient 834 and receive input such as manipulation of the patient's image. Although not illustrated in FIG. 8, C-arm system 105-1 includes one or more processors and memory, and may include other types and numbers of devices.
C-arm 830 of C-arm system 105-1 can be moved and rotated by various means known to those skilled in the art to position C-arm 830 in a desired position. In some embodiments, the C-arm can move horizontally, vertically, and about a pivot, allowing images of the patient 834 to be obtained from virtually any angle. Although the C-arm 830 can be manually positioned, in some embodiments the C-arm 830 is positioned using a combination of motors, wheels, and other motion mechanisms attached to the C-arm 830. It can be automatically driven by the C-arm system 105-1. Nevertheless, conventionally, the position at which the C-arm 830 is desired to be driven must be identified or determined each time the C-arm 830 is to be positioned for imaging of the patient 834. , the C-arm 830 must be manually moved or driven to that position. Positioning of the C-arm has traditionally been a critical and time-consuming process and is easily subject to human error.
In some embodiments, a C-arm system, such as C-arm system 105-1, has scanning capabilities integrated with a connected navigation system. Once the fiducial array is placed on the patient, a ring with fiducials visible by the navigation camera is placed on the C-arm radiator. The C-arm is powered and can scan a patient through 180 degrees without being driven by an operator. During this 180 degree (or 180+ degree) scan, the C-arm captures multiple images and feeds them to the navigation system for reconstruction into a 3D model. A camera observes each position of the C-arm relative to the patient's anatomy and uses these to orient the instrument being navigated to the reconstructed 3D anatomy within the virtual image.
In order to obtain an optimal image of relevant regions of the patient's 834 anatomy, the C-arm 830 must be positioned at precise positions and angles relative to the patient 834 . In some embodiments, during spinal surgery, the optimal position of the C-arm 830 is such that the patient-facing side of the x-ray detector 830-1 is parallel to the spinal plane and/or the x-ray is the position radiating perpendicular to the spinal plane of the patient 834. Since the spinal plane differs between each vertebral level, the C-arm 830 must be placed in a unique position for each vertebral level. As shown in FIG. 9, IMU-based assistance system 101 incorporated into C-arm system 105-1 enables automated alignment of C-arm 830 using an IMU.
FIG. 9 illustrates a sequence diagram for providing IMU-assisted alignment of C-arm system 105-1. As shown in FIG. 9, IMU-based support system 101 is incorporated into C-arm system 105-1. C-arm system 105-1 wirelessly communicates with IMU 803. Within IMU 903 are IMUs 103-2 and 103-n illustrated in FIG. As will be explained in more detail below, the IMUs 903 are arranged in one set positioned or attached to the patient and/or operating table and another set attached to a portion of the C-arm system 105-1. , containing two sets of IMUs. C-arm system 105-1 also communicates wirelessly with tools 904, such as pedicle preparation tools. It should be appreciated that tools other than and/or in addition to pedicle preparation tool 904 may communicate with C-arm system 105-1.
In the exemplary embodiment described in connection with FIG. 9, C-arm system 105-1 is used for spinal surgery. FIG. 9 illustrates an exemplary process for optimally aligning and realigning the C-arm system 105-1 so that each pedicle of the patient is accurately targeted by the C-arm 105-1. do. That is, the exemplary process of FIG. 9 can measure the positioning of C-arm system 105-1 and replicate that position.
At step 950, a first set of IMUs 903-a from among IMUs 903 is turned on for calibration. A first IMU set 903-a is an IMU that is placed or attached to the patient or operating table. As described above in connection with FIG. 2, IMU 903-a may be placed in a particular orientation, such as on or near an anatomical landmark of the patient. For example, IMU 903a can be positioned on the operating table similar to IMU 803-a shown in FIG.
Once the IMUs 903 - a are deployed and turned on, they can be calibrated by reporting their IMU data to each other and/or to the IMU-based support system 101 . The IMU data reported by each of the IMUs 903-a includes location information for each IMU. IMU 903-a and/or IMU-based support system 101 may calculate the location or position of each IMU with respect to each other and/or the ground. By calibrating IMUs 903-a, it is possible to understand or determine their position in space, and thus the positions of other IMUs relative to that space.
Next, at step 952, IMU data is collected by each IMU of the second IMU set 903-b. A second IMU set 903-b consists of the IMUs from IMU 903. Additionally, a second IMU set 903-b consists of IMUs located or attached to a portion of the C-arm system 105-1. For example, the second IMU set 903-b may consist of IMUs positioned over the X-ray source and/or X-ray detector, similar to IMU 803-b shown in FIG. The IMU data collected in step 952 includes information measured by each sensor of IMU 903-b.
In step 952, the C-arm of C-arm system 105-1 is positioned so that the X-ray emitter and/or X-ray detector are substantially parallel to the ground when data is collected from IMU 903-b. is positioned at In other words, the X-ray emitter and/or the X-ray detector being parallel to the ground means that their respective patient sides are substantially parallel to the ground. This position of C-arm system 105-1 is also referred to as the "0 position." At step 954, the IMU data collected by the IMU 903-b at step 952 while the C-arm system 105-1 was in the 0 position is sent to the IMU-based support system 101, which converts the received 0 position IMU data memorize
Next, at step 956, the C-arm of C-arm system 105-1 is moved to the first optimal position. The first optimal position is where the C-arm system 105-1 views selected pedicles in the patient's spine or other anatomy of interest and/or as known to those skilled in the art. It is the best aligned position for imaging. Once C-arm system 105-1 is positioned in the first optimal position, a second set of IMUs 903-b attached to C-arm system 105-1 acquires IMU data from their sensors in step 958. collect. In some embodiments, IMU data collection is triggered by C-arm system 105-1 indicating to IMU 903-b that the C-arm is in a first optimal position.
The data collected by IMU 903-b at step 958 includes information indicative of the position of the C-arm of C-arm system 105-1. The data collected at step 958 is then sent to the IMU-based support system 101 at step 960 . Next, at step 962, system 101 calculates the relative position of the C-arm in the first optimal position with respect to the 0 position and/or the position of IMU 903-a. Calculating the relative position of the C-arm at the first optimal position is based on the IMU data received at step 960 and the zero position data received at step 954 .
In an intraoperative environment, the C-arm of C-arm system 105-1 is removed from the first optimal position and returned to the 0 position in step 964 so that the patient can be operated on without obstruction. When desired, the C-arm system 105-1 can be automatically returned to the alignment indicated by the recorded first optimal position. Since the first optimal position is the position of the C-arm relative to the patient and/or operating table, the C-arm system 105-1 can always return accurately to the first optimal position, thereby , the potential for error and wasted time can be reduced or eliminated.
With the C-arm system 105-1 removed, IMU-compatible surgical instruments such as the pedicle preparation tool 904 can be used to prepare, size, and implant bone anchors into the pedicles. The position of the pedicle preparation tool 904 is identifiable from data generated by its sensors. Additionally, the position of the pedicle preparation tool 904 relative to the patient and/or operating table may be calculated from the IMU data of the preparation tool 904 and the data of the first IMU set 903-a.
At step 966, the display device of C-arm system 105-1, similar to display device 836 illustrated in FIG. 8, is used to provide intraoperative feedback as pedicle preparation tool 904 is operated. Intra-operative feedback may be provided continuously by the display device or may be provided upon request.
The display device of the C-arm system may render visual and numerical cues to guide the IMU-enabled pedicle preparation tool 904 to the desired portion of the patient's pedicle. The IMU-based support system 101 includes (1) data generated by the IMUs of the tool 904, and (2) a first set of IMUs 903-a that define the absolute and relative positions of the patient and/or operating table. and (3) data generated by the IMU 903-b defining the absolute and relative positions of the patient's pedicles, the patient's pedicles, an image of the patient , and/or the position of the pedicle preparation tool 904 relative to the actual patient.
In some embodiments, the pedicle preparation tool 904 can be positioned below the center of the pedicle in a direction orthogonal to the plane of the X-ray source or X-ray detector of the C-arm system 105-1. desirable. In such a case, the display device aligns the pedicle preparation tool 904 with the desired pedicle position based on the IMU data received at step 960 in relation to the first optimal position of the C-arm system 105-1. Provide feedback to locate areas to be tested. Other examples of providing intraoperative feedback are described above in connection with FIG.
Steps 956-966 of FIG. 9 may be repeated for each additional pedicle in the patient's spine. That is, in step 956, the C-arm of C-arm system 105-1 is instead placed in a second position in which the C-arm is aligned to best view and/or image the patient's next pedicle. be moved to the optimum position.
Although not illustrated in FIG. 9, the relative position of each optimally positioned C-arm system 105-1 can be recorded in relation to each corresponding pedicle of the patient. The recorded information can be added to a database of common pedicle angles that can later be used to calculate or predict possible positions of the C-arm system 105-1 for a particular pedicle.
Any portion of the above-described exemplary embodiments or their functionality, including the systems and procedures illustrated in or discussed in connection with FIGS. It can be implemented by using combinations. An implementation may be within one or more computers or other processing systems. Although the operations performed by these exemplary embodiments may be referred to in terms commonly associated with human intellectual activity, any of the operations described herein It does not require human operators to perform. In other words, the motion can be implemented entirely in mechanical motion. Useful machines for performing the operations of the exemplary embodiments presented herein include general purpose digital computers or similar devices.
Portions of the exemplary embodiments described herein may be implemented using conventional general purpose computers, special purpose digital computers, and/or programmed in accordance with the teachings of the present disclosure, as will be apparent to those skilled in the computer arts. can be conveniently implemented using a microprocessor. Appropriate software code can readily be prepared by knowledgeable programmers based on the teachings of the present disclosure.
Some embodiments may also be implemented by preparing an application specific integrated circuit, field programmable gate array, or interconnecting an appropriate network of conventional component circuits.
Some embodiments include computer program products. The computer program product may be a non-transitory storage medium or medium having instructions stored thereon that implements any of the procedures of the exemplary embodiments described herein. It can be used to control a computer or cause a computer to do something. Storage media include, but are not limited to, floppy discs, mini discs, optical discs, Blu-ray Discs, DVDs, CDs or CD-ROMs, microdrives, magneto-optical discs, ROM, RAM, EPROM, EEPROM, DRAM, VRAM, Flash memory, flash cards, magnetic cards, optical cards, nanosystems, molecular memory integrated circuits, RAID, remote data storage/archives/warehouses, and/or any other suitable for storing instructions and/or data Types of equipment may be mentioned.
Some implementations store on any one of non-transitory computer-readable media or media, both general purpose and/or special purpose computer or microprocessor hardware for controlling and computer or microprocessor hardware. includes software to enable it to interact with a human user or other mechanism using the results of the exemplary embodiments described herein. Such software may include, without limitation, device drivers, operating systems, and user applications. Ultimately, such computer-readable media further include software for implementing exemplary aspects of the systems and methods described above.
General-purpose and/or special-purpose computer or microprocessor programming and/or software includes software modules for implementing the above procedures.
While various exemplary embodiments have been described above, it should be understood that they have been presented by way of example and not limitation. It will be apparent to those skilled in the relevant art that various changes in form and detail may be made therein. Accordingly, the present disclosure should not be limited by any of the above-described exemplary embodiments.
Additionally, it should be understood that the drawings are presented for illustrative purposes only. The architecture of the exemplary embodiments presented herein is sufficiently flexible and configurable such that it can be utilized and navigated in ways other than those shown in the accompanying drawings.
Further, the purpose of the Abstract is generally to assist the US Patent and Trademark Office and the public, particularly scientists, engineers, and practitioners in the art who are unfamiliar with patent or statutory terminology or usage, to To be able to quickly determine the nature and essence from a cursory inspection. The abstract is not intended to limit the scope of the exemplary embodiments presented in any way. It should also be understood that the steps recited in the claims need not be performed in the order presented.
Those skilled in the art will appreciate further features and advantages of the present disclosure based on the above-described embodiments. Accordingly, the present disclosure is not to be limited by what has been specifically shown and described. All publications and references cited herein are expressly incorporated herein by reference in their entireties.
[Embodiment] (1) 1. A system for providing surgical assistance, the processor receiving one or more medical images from an imaging device, said one or more medical images represents (1) one or more views of the patient's anatomy and (2) one or more markers of known size; calibrating the size of the patient's anatomy represented in the one or more medical images based on the known size of each of one or more markers; a three-dimensional (3D) representation of anatomic structures by: (1) one or more anatomy corresponding to the patient's anatomy represented in the one or more medical images; (2) one or more anatomical landmarks identified on the one or more medical images and the 3D representation; calculating surgical parameters based on the 3D representation of the patient's anatomy; receiving first inertial measurement unit (IMU) data from a first set of IMUs; and the first IMU data. and a second method corresponding to (1) the surgical parameters and (2) one or more IMU-enabled tools, to the 3D representation based on outputting surgical feedback based on one or more of the second IMU data received from the set of IMUs;
(2) the one or more anatomical images corresponding to the patient's anatomy are among an existing set of anatomical images stored in a communicatively linked database or atlas; 2. A system according to embodiment 1, wherein the system is identified from:
(3) The system of embodiment 2, wherein the one or more anatomical images are matched to the patient's anatomy using a best fit method.
(4) The system of embodiment 1, wherein the surgical parameters include one or more of (1) bone anchor insertion position, (2) bone anchor trajectory, and (3) bone anchor depth. .
(5) The system of embodiment 4, wherein the surgical parameter is measured relative to the 3D representation of the patient's anatomy.
(6) The system of embodiment 1, wherein the first IMU set is positioned on the patient and/or an operating table corresponding to the patient in a first orientation relative to the patient.
(7) The system of embodiment 6, wherein the first IMU data includes absolute positions of each of the IMUs.
(8) The system of embodiment 7, wherein the processor is further operable to calculate a relative position of each of the IMUs within the first IMU set based on the first IMU data. .
(9) The system of embodiment 7, wherein the first IMU data includes the relative position of each of the IMUs.
(10) matching the real-world anatomy of the patient to the 3D representation on the real-world anatomy of the patient using one of the IMU-enabled tools; and associating the contact points of the real-world anatomy with corresponding points on the 3D representation.
(11) The system of embodiment 1, wherein said output of said surgical feedback causes said surgical feedback to be rendered on a display device.
(12) the surgical feedback of the one or more IMUs superimposed on the 3D representation at respective positions of the one or more IMU-enabled tools relative to the patient's anatomy; 12. A system according to embodiment 11, including a visual representation of the corresponding tool.
(13) The system of embodiment 12, wherein the surgical feedback further includes visual representations of the surgical parameters.
(14) An embodiment further comprising at least one memory communicatively coupled to said processor, said at least one memory operable to store said database or atlas of existing anatomical images. The system described in 2.
(15) 1. A method for providing surgical assistance, comprising receiving one or more medical images from an imaging device, the one or more medical images comprising: (1) Receiving one or more views of the patient's anatomy and (2) one or more markers of known size and of the one or more markers. 3. calibrating the size of the patient's anatomy represented in the one or more medical images based on each of the known sizes; A dimensional (3D) representation is defined as: (1) one or more anatomical images conforming to the patient's anatomy represented in the one or more medical images; 2) generating, based on said one or more medical images and one or more anatomical landmarks identified on said 3D representation, said patient anatomy; calculating surgical parameters based on the 3D representation of the physical structure; receiving first inertial measurement unit (IMU) data from a first set of IMUs; Matching the patient's real-world anatomy to the 3D representation and receiving from a second set of IMUs corresponding to (1) the surgical parameters and (2) one or more IMU-enabled tools. outputting surgical feedback based on one or more of the obtained second IMU data.
(16) the one or more anatomical images corresponding to the patient's anatomy among an existing set of anatomical images stored in a communicatively linked database or atlas; 16. The method of embodiment 15, wherein the method is identified from
(17) The method of embodiment 16, wherein the one or more anatomical images are matched to the patient's anatomy using a best fit method.
(18) The method of embodiment 15, wherein the preoperative parameters include one or more of (1) bone anchor insertion position, (2) bone anchor trajectory, and (3) bone anchor depth. .
(19) The method of embodiment 18, wherein the preoperative parameters are measured relative to the 3D representation of the patient's anatomy.
(20) The method of embodiment 15, wherein the first IMU set is positioned on the patient and/or an operating table corresponding to the patient in a first orientation relative to the patient.
(21) The method of embodiment 20, wherein the first IMU data includes an absolute position of each of the IMUs.
(22) The method of embodiment 21, wherein the processor is further operable to calculate a relative position of each of the IMUs within the first IMU set based on the first IMU data. .
(23) The method of embodiment 21, wherein the first IMU data includes the relative position of each of the IMUs.
(24) matching the real-world anatomy of the patient to the 3D representation is performed on the real-world anatomy of the patient using one of the IMU-enabled tools; and associating the contact points of the real-world anatomy with corresponding points on the 3D representation.
(25) The method of embodiment 15, wherein said output of said surgical feedback causes said surgical feedback to be rendered on a display device.
(26) the surgical feedback of the one or more IMUs superimposed on the 3D representation at respective positions of the one or more IMU-enabled tools relative to the patient's anatomy; 26. A method according to embodiment 25, comprising a visual representation of the correspondence tool.
(27) The method of embodiment 26, wherein said surgical feedback further comprises a visual representation of said preoperative parameters.
(28) An embodiment further comprising at least one memory communicatively coupled to said processor, said at least one memory operable to store said database or atlas of existing anatomical images. The method described in 16.
(29) A surgical navigation system, wherein one or more IMU-enabled instruments are operable to intraoperatively collect IMU data from each IMU of said IMU-enabled instrument. and a camera and an IMU-based support system operable to track intraoperative movement and position of the one or more IMU-enabled instruments, wherein the one or more IMU-enabled determining the presence of errors in the tracking of movement and position of one of the instruments; and collecting the IMU data from the at least one of the one or more IMU-enabled instruments. , using the IMU data to supplement the tracking of the movement and position of the one of the one or more IMU-enabled instruments; and and an IMU-based assistance system that is a surgical navigation system.
(30) The presence of an error is determined by (1) the angle of one or more of the IMU-enabled instruments with respect to the line of sight of the camera exceeds a threshold; is outside the line of sight of the camera; and (3) the camera is malfunctioning. The system described in .
(31) the providing of the surgical feedback further comprises calculating a correction factor for the one of the one or more IMU-enabled instruments based on the IMU data; 30. The system of embodiment 29, wherein the supplementing the tracking of the movement and position of the one or more IMU-enabled instruments further uses the correction factor.
(32) the one or more IMU-enabled devices include colored markers, and the camera identifies the colored markers of each of the one or more IMU-enabled devices, thereby 30. The system of embodiment 29, wherein the movement and position of one or more IMU-enabled instruments are tracked.
(33) According to embodiment 29, wherein the IMU of each of the one or more IMU-enabled devices is embedded in or removably attached to the one or more IMU-enabled devices. System as described.
(34) The implementation wherein the IMU data includes the absolute position of each of the one or more IMU-enabled instruments and the relative position of each of the one or more IMU-enabled instruments. A system according to aspect 29.
(35) The system of embodiment 34, wherein the camera includes an IMU.
(36) When the relative positions of each of the one or more IMU-enabled devices are visualized by the camera, (1) the one or more IMU-enabled devices, (2) the 36. The system of embodiment 35, wherein the position of the one or more IMU-enabled instruments relative to a camera and (3) one or more of the patient's anatomy.
(37) A method of surgical navigation, wherein surgical feedback determines the presence of errors in movement and position tracking of an IMU-enabled instrument performed using a camera, wherein the IMU-enabled instrument: comprising an IMU and operable to collect IMU data therefrom intraoperatively; collecting said IMU data from said IMU-enabled instrument; and using said IMU data, one or complementing said tracking of movement and position of said one of two or more IMU-enabled instruments; and providing by.
(38) The presence of an error is (1) an angle of the IMU-enabled instrument relative to the line-of-sight of the camera exceeds a threshold, and (2) the IMU-enabled instrument is outside the line-of-sight of the camera. and (3) the camera is malfunctioning.
(39) said providing of said surgical feedback further comprises calculating a correction factor for said IMU-enabled instrument based on said IMU data; and said supplementing said tracking of said movement and position of said IMU-enabled instrument by: 38. The method of embodiment 37, further using said correction factor.
40. Aspect 37, wherein the IMU-enabled device includes colored markers, and wherein the camera tracks the movement and position of the IMU-enabled device by identifying the colored markers of the IMU-enabled device. the method of.
(41) The method of embodiment 37, wherein the IMU of the IMU-enabled device is embedded in or removably attached to the IMU-enabled device.
(42) The method of embodiment 37, wherein the IMU data includes the absolute position of the IMU-enabled device and the relative position of the IMU-enabled device.
(43) The method of embodiment 42, wherein the camera comprises an IMU.
(44) When the relative positions of the IMU-enabled instruments are visualized by the camera, the relative positions of (1) other IMU-enabled instruments, (2) the camera, and (3) patient anatomy. 44. The method of embodiment 43, wherein the position of the IMU-enabled device relative to one or more is indicated.
(45) An IMU-based support system, comprising at least one memory and a processor communicatively coupled to said at least one memory, for a patient involved in a first physical position at a first instance; collecting first IMU data from a plurality of attached IMUs; calculating a first attribute of the patient based on the first IMU data; storing one IMU data and the first attribute; and from the plurality of IMUs attached to the patient involved in the first physical position at a second instance after the first instance. by collecting second IMU data, calculating a second attribute of the patient based on the second IMU data, and comparing the first attribute to the second attribute and a processor operable to: identify changes to the patient's anatomy.
(46) The system of embodiment 45, wherein the first instance occurs preoperatively and the second instance occurs intraoperatively or postoperatively.
(47) The system of embodiment 45, wherein the plurality of IMUs are attached to the patient at skin level using one or more of straps, adhesives, or clothing.
(48) The system of embodiment 45, wherein the first attribute and the second attribute of the patient each include flexibility of the patient.
(49) the processor obtaining standard measurements from the at least one memory or via a network; and comparing the first IMU data or first attribute with the standard measurements. 46. The method of embodiment 45, further operable to: assess the patient's condition based on a comparison of the first IMU data or first attribute and the standard measurement. system.
(50) An IMU-based support system, comprising at least one memory and a processor communicatively coupled to said at least one memory, wherein the patient engages in a first physical position at a first instance; collecting first IMU data from a plurality of attached IMUs; calculating a first attribute of the patient based on the first IMU data; storing one IMU data and the first attribute; and from the plurality of IMUs attached to the patient involved in the first physical position at a second instance after the first instance. by collecting second IMU data, calculating a second attribute of the patient based on the second IMU data, and comparing the first attribute to the second attribute and a processor operable to: identify changes to the patient's anatomy.
(51) The system of embodiment 50, wherein the first instance occurs preoperatively and the second instance occurs intraoperatively or postoperatively.
(52) The system of embodiment 50, wherein the plurality of IMUs are attached to the patient at skin level using one or more of straps, adhesives, or clothing.
(53) The system of embodiment 50, wherein the first attribute and the second attribute of the patient each include flexibility of the patient.
(54) the processor obtaining standard measurements from the at least one memory or via a network; and comparing the first IMU data or first attribute with the standard measurements. 51. The method of embodiment 50, further operable to: assess the patient's condition based on a comparison of the first IMU data or first attribute and the standard measurement. system.
(55) A system for providing IMU-based registration, comprising: a medical imaging device for imaging a patient, the medical imaging device being movable with respect to the patient or operating table; The patient or the operating table has a first IMU set attached thereto, the medical imaging device includes an imaging source and an imaging detector, and the imaging detector is attached to a second set of IMUs. and an IMU-based assistance system communicatively coupled to said medical imaging device, said IMU-based assistance system having said second IMU set to said first IMU set. receiving IMU data, the first IMU data including information obtained when the medical imaging device is in a first position; and the second set of IMUs. receiving second IMU data from (1 ) the medical imaging device in the first position; or (2) the relative position of the medical imaging device in the second position measured with respect to the patient or the operating table. A system operable to provide alignment of said medical imaging device by:
(56) The system of embodiment 55, wherein the medical imaging device is a C-arm and includes an emitter and detector at each end of the C-arm.
(57) The system of embodiment 56, wherein the first IMU set is attached to the emitter and the detector of the C-arm.
(58) the IMU-based assistance system guides the medical imaging device from the first position to the second position after calculating the relative position of the medical imaging device at the second position; 56. The system of embodiment 55, operable to provide the alignment of the medical imaging device by:
(59) the IMU-based assistance system driving the C-arm from the first position to the second position after calculating the relative position of the medical imaging device at the second position; 57. The system of embodiment 56, operable to provide the alignment of the medical imaging device by:
(60) The medical imaging device, in the first position, is at a ground position remote from the patient, and the medical imaging device, in the second position, images a first portion of the patient. 56. A system according to embodiment 55, wherein the system is aligned to.
(61) The system of embodiment 55, wherein the first IMU data and the second IMU data include location information of the medical imaging device.
(62) the IMU-based support system is further operable to provide intraoperative feedback via a display device, the intraoperative feedback indicating the position of one or more IMU-enabled instruments relative to the patient; 56. The system according to embodiment 55.
(63) The system of embodiment 62, wherein the intraoperative feedback is generated based on third IMU data received from the one or more IMU-enabled instruments.
9 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| US20160191887A1 | Cites | United States of America |
| US20110275957A1 | Cites | United States of America |
| JP2009273521A | Cites | Japan |
| JP2015213753A | Cites | Japan |
| JP2017510307A | Cites | Japan |
13 members in 6 offices
Priority claims3
| Document | Office | Kind | Date |
|---|---|---|---|
| 15475587 | United States of America | – | |
| 201715475587 | United States of America | A | |
| 2018024791 | United States of America | W |
Members13
| Document | Office | Kind | |
|---|---|---|---|
| US2018279913A1 | United States of America | A1 | |
| WO2018183461A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU2018246254A1 | Australia | A1 | |
| CN110475509A | China | A | |
| EP3600030A1 | European Patent Office (EPO) | A1 | |
| JP2020518315A | Japan | A | |
| EP3600030A4 | European Patent Office (EPO) | A4 | |
| US11089975B2 | United States of America | B2 | |
| US2021338107A1 | United States of America | A1 | |
| JP7204663B2This record | Japan | B2 | |
| AU2018246254B2 | Australia | B2 | |
| CN110475509B | China | B | |
| CN117159140A | China | A |
12 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for extension of timeJAPANESE INTERMEDIATE CODE: A601A601 | A601 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on retrievalJAPANESE INTERMEDIATE CODE: A971007A977 | A977 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 7204663
- Application
- 2019553503
Titles2
- Japanese
- 慣性計測装置を使用して手術の正確度を向上させるためのシステム、装置、及び方法
- English
- Systems, apparatus, and methods for improving surgical accuracy using inertial measurement devices
Classification
- CPC, 35
- G06T7/70
- A61B5/11
- A61B6/0407
- A61B6/0492
- A61B6/12
- A61B6/4441
- A61B6/4482
- A61B6/461
- A61B6/466
- A61B6/505
- A61B6/5217
- A61B6/5294
- A61B6/545
- A61B6/547
- A61B6/56
- A61B6/589
- A61B34/20
- A61B2090/376
- A61B2090/3983
- A61B2034/105
- A61B2090/372
- A61B2034/2048
- A61B2034/2055
- A61B2034/2065
- A61B2090/363
- A61B2090/3966
- A61B6/0487
- G06T7/33
- G06T2207/30008
- G06T2207/30204
- G06T2207/10116
- G06T2207/10072
- A61B5/107
- A61B5/7271
- A61B5/742
- IPC, 2
- A61B34 20
- G01P15 18
