System for controlling an instrument using shape sensors
23 claims: 2 independent, 21 dependent
- 1遠隔で制御される操縦可能器具の移動を制御するためのシステムであって、 前記システムは、 複数の関節運動可能セグメントを含む外科用器具であって、前記複数の関節運動可能セグメントは、前記外科用器具の形状を変化させるように互いに対して関節運動するように構成されている、外科用器具と、 前記複数の関節運動可能セグメントの周囲に螺旋構成で配置される光ファイバであって、前記光ファイバは、前記複数の関節運動可能セグメントのうちの少なくとも1つの関節運動可能セグメントの長さに沿った前記複数の関節運動可能セグメントのうちの前記少なくとも1つの関節運動可能セグメントの感知された形状に対応する形状信号を伝送するように構成されている、光ファイバと、 前記光ファイバと信号通信するコントローラであって、前記コントローラは、前記外科用器具に論理的に連結され、少なくとも前記光ファイバから 受信された 前記形状信 号に 応答して前記外科用器具を移動させる ことにより所望の形状を達成する ための制御信号を出力するように構成されて おり、前記制御信号は、前記外科用器具の前記形状を前記所望の形状に変化させるためのユーザ入力に基づいている 、コントローラと を含む、システム。
- 2前記光ファイバは、前記外科用器具の前記形状の変化に応答して前記形状信号を変更するように構成されている、請求項1に記載のシステム。
- 3前記コントローラは、前記複数の関節運動可能セグメントを独立して制御して前記外科用器具の前記形状を変化させるための制御信号を出力するように構成されている、請求項1に記載のシステム。
- 4前記複数の関節運動可能セグメントの各々は、前記複数の関節運動可能セグメントを互いに対して関節運動させるように構成されたアクチュエータをさらに含む、請求項1に記載のシステム。
- 5前記アクチュエータは、テンドンを介して前記複数の関節運動可能セグメントに連結されている、請求項4に記載のシステム。
- 6前記アクチュエータは、電子機械モータ、空気圧モータ、油圧モータおよび電子回転アクチュエータからなる群より選択される、請求項5に記載のシステム。
- 7前記複数の関節運動可能セグメントの前記形状を変化させるための制御信号を前記アクチュエータに伝送するように構成されたユーザ入力デバイスをさらに含む、請求項4に記載のシステム。
- 8前記コントローラは、前記ユーザ入力デバイスからの前記制御信号および前記光ファイバからの前記形状信号に応答して前記複数の関節運動可能セグメントのうちの少なくとも1つの関節運動可能セグメントを移動させるための信号を前記アクチュエータに出力するように構成されている、請求項7に記載のシステム。
- 9前記ユーザ入力デバイスは、前記外科用器具の少なくとも一部分の形状を表す出力を表示するように構成された双方向ディスプレイを含む、請求項7に記載のシステム。
- 10前記複数の関節運動可能セグメントは、第1の関節運動可能セグメントおよび第2の関節運動可能セグメントを含み、 前記コントローラは、前記外科用器具が経路に沿って前進または後退すると前記形状信号に基づいて前記第1の関節運動可能セグメントの形状および前記第2の関節運動可能セグメントの形状を計算するように構成されている、請求項1に記載のシステム。
- 11ユーザ入力デバイスは、前記外科用器具の形状を 前記 所望の形状に変化させるためのコマンドをユーザから受信するように構成されたインターフェースを含み、 前記コントローラは、前記光ファイバからの前記形状信号に基づいて前記外科用器具の前記形状を計算するように構成されており、前記コントローラは、前記形状信号に基づいて前記所望の形状と前記形状との差異を計算するように構成されている、請求項1に記載のシステム。
- 12前記コントローラは、前記形状信号に基づいて前記所望の形状と前記形状との間の前記計算された差異を補償するように前記外科用器具を移動させるための前記制御信号を出力するように構成されている、請求項11に記載のシステム。
- 13センサをさらに含み、 前記センサと比較した前記光ファイバの位置は、前記センサに対する前記外科用器具の位置を 決定 するために、または、前記外科用器具が前記センサを越えて挿入された深度を決定するために用いられる、請求項1に記載のシステム。
- 14前記光ファイバは、高空間解像度の光ファイバ曲がりセンサの直線状アレイを含む、請求項1に記載のシステム。
- 15前記光ファイバは、ブラッグ格子を含む、請求項1に記載のシステム。
- 16前記光ファイバは、前記光ファイバの螺旋の方向と反対の方向の逆撚りを含む、請求項1に記載のシステム。
- 17前記光ファイバは、前記関節運動可能セグメントの各々に沿って、単一完全螺旋巻きで延在する、請求項1に記載のシステム。
- 18前記光ファイバは、前記関節運動可能セグメントの各々に対して整数回の完全螺旋巻きで延在する、請求項1に記載のシステム。
- 19遠隔で制御される操縦可能器具の作動方法であって、前記遠隔で制御される操縦可能器具は、複数の関節運動可能セグメントを含む外科用器具であって、前記複数の関節運動可能セグメントは、前記外科用器具の形状を変化させるように互いに対して関節運動するように構成されている、外科用器具と、前記複数の関節運動可能セグメントの周囲に螺旋構成で配置される光ファイバと、コントローラとを含み、 前記方法は、 前記コントローラにより、前記光ファイバから前記複数の関節運動可能セグメントのうちの少なくとも1つの関節運動可能セグメントの長さに沿った前記複数の関節運動可能セグメントのうちの前記少なくとも1つの関節運動可能セグメントの感知された形状に対応する形状信号を受信することと、 前記コントローラにより、少なくとも前記光ファイバからの前記形状信号に応答して前記外科用器具を移動させる ことにより所望の形状を達成する ための制御信号を出力すること であって、前記制御信号は、前記外科用器具の前記形状を前記所望の形状に変化させるためのユーザ入力に基づいている、こと と を含む、方法。
- 20前記出力することは、前記コントローラにより、前記複数の関節運動可能セグメントを独立して移動させて前記外科用器具の前記形状を変化させるための制御信号を出力することを含む、請求項19に記載の方法。
- 21前記遠隔で制御される操縦可能器具は、入力デバイスをさらに含み、前記出力することは、前記コントローラにより、前記入力デバイスにおける入力に基づいて前記外科用器具を移動させるための制御信号を出力することをさらに含み、前記入力は、前記外科用器具を移動させるためのユーザコマンドである、請求項19に記載の方法。
- 22前記形状信号を受信することは、前記コントローラにより、前記外科用器具の移動中の前記外科用器具の前記形状の変化に依存した可変形状信号を受信することを含む、請求項19に記載の方法。
- 23前記遠隔で制御される操縦可能器具は、センサをさらに含み、前記方法は、 前記センサと前記光ファイバの位置を比較することと、 前記比較することに基づいて、前記センサに対する前記外科用器具の位置、または、前記外科用器具が前記センサを越えて挿入された深度を決定することと をさらに含む、請求項19に記載の方法。
Independent claims23
45 paragraphs, as filed
0001(Citation of related application) This application claims the benefit of priority under US Provisional Patent Application No. 60 / 898,200 (filed January 27, 2007). The entire contents of this provisional application are incorporated herein by reference.
0002(Incorporated by reference) All patents, patent gazettes, and patent applications described in this application are by reference to the same extent that each individual publication or patent application is indicated to be incorporated by reference in a specific and individual manner. As a whole, incorporated herein by reference. (Technical Field of the Present Invention) The present invention generally relates to range of motion equipment or serpentine robots. More specifically, the present invention relates to sensing the shape of a range of motion device or a serpentine robot.
0003Endoscopes, colonoscopies and other controllable instruments are found in a wide range of medical and industrial applications. As the complexity of moving or using such instruments increases, it is necessary to control the controllable instruments more accurately, place them within the body, and identify their shape. Several different types of shape sensing devices are available.
<p num="0004"> Although shape-sensing devices are available, challenges remain when integrating shape-sensing devices into controllable devices. Challenges remain for systems that allow the coordinated use of shape information to control the movement of controllable instruments or procedures that can benefit from shape information. Embodiments of the systems and controllable instruments of the invention described herein solve these and other issues.</p>
<p num="0005"> One aspect of the invention provides an instrument with an elongated body that comprises a maneuverable distal portion and multiple range of motion segments. The instrument can be modified to incorporate a shape sensor to indicate the shape of at least a portion of the instrument. In one embodiment, the shape sensor is an optical shape sensor. In other embodiments, the shape sensor can be, for example, a resistance change flexible band, a refraction sensor, a potentiometer, or a magnetic sensor.</p><p num="0006"> Another aspect of the invention provides a system that connects a control loop between a control signal used to guide the movement of an instrument and a shape indicator signal for the shape of all or part of the instrument. The system can include, for example, a user input device, a controller, an instrument with a range of motion segments, and a shape sensor. The controller is configured to guide the movement of the device in response to the control signal from the user input device and the shape signal from the shape sensor.</p><p num="0007"> Yet another aspect of the invention provides a method of controlling an instrument with an elongated body. The method corresponds to the step of inputting a control signal to the controller and changing the shape of the instrument, the step of detecting the shape of a part of the instrument by the shape sensor, and the shape sensor to the controller and the shape of a part of the instrument. The step of outputting the shape signal to be performed and the step of inducing the movement of the instrument in response to the control signal and the shape signal are included.</p><p num="0008"> One aspect of the invention provides a system for sensing the shape of an instrument. The system consists of an instrument with an elongated body, a shape sensor that extends in a spiral pattern along a portion of the elongated body, and indicators on each end of the shape sensor to maintain axial orientation of the ends of the shape sensor. And. The spiral pattern can include an integral number of complete spiral windings from one end to the other end of the elongated body. In one embodiment, the shape sensor is an optical shape sensor. Axial orientation of the shape sensor includes, but is not limited to, physical or visual markers on the shape sensor, clipping the shape sensor to the elongated body, or integrating the shape sensor into the elongated body. It can be maintained in a way.</p><p num="0009"> The novel features of the present invention are defined by the matters in the appended claims. A further understanding of the features and advantages of the present invention will be obtained by defining exemplary embodiments and referring to the following embodiments in which the principles of the invention are utilized. (Item 1) A system for controlling equipment with an elongated body, With multiple range of motion segments connected to each other along at least a portion of the elongated body, A user input device configured to provide a control signal that modifies at least one of the plurality of joint motion segments. A sensor in contact with the elongated body, configured to provide a shape signal corresponding to the shape of at least one of the plurality of joint motion segments. A controller that communicates with the user input device and the sensor and that induces movement of at least one of the plurality of joint motion segments in response to the control signal and the shape signal. The system. (Item 2) The system of item 1, further comprising an actuator configured to communicate with the controller and move at least one of the plurality of joint motion segments. (Item 3) The system according to item 2, wherein the actuator is positioned inside the appliance. (Item 4) The system according to item 2, wherein the actuator is located outside the appliance. (Item 5) The system according to item 1, wherein the sensor is long enough to show the overall shape of the elongated body. (Item 6) The system of item 1, wherein the sensor is long enough to show the shape of a portion of the elongated body that is inserted into the patient. (Item 7) The system according to item 1, wherein the sensor includes an optical shape sensor. (Item 8) The system according to item 1, wherein the sensor includes a plurality of magnetic sensors. (Item 9) The system according to item 1, wherein the sensor includes a plurality of bending sensors. (Item 10) The system according to item 1, wherein the sensor includes a plurality of telescopic sensors. (Item 11) The system according to item 1, wherein the sensor includes a plurality of potentiometers. (Item 12) The system of item 1, further comprising a video display configured to display an output representing the shape of a portion of the elongated body. (Item 13) A method of controlling an instrument with an elongated body, The step of inputting a control signal to the controller and changing the shape of the elongated body, A step of detecting the shape of at least a part of the elongated body by a shape sensor, A step of outputting a shape signal corresponding to the shape of the part of the elongated body from the shape sensor to the controller, and With the step of inducing the movement of the elongated body in response to the control signal and the shape signal. Including, methods. (Item 14) 13. The method of item 13, wherein the guiding step further comprises a step of guiding the action of the actuator and moving the elongated body. (Item 15) The method according to item 13, wherein the sensing step includes a step of sensing the shape of the entire length of the elongated body. (Item 16) 13. The method of item 13, wherein the sensing step comprises sensing the shape of a portion of the elongated body inserted into the patient. (Item 17) 13. The method of item 13, wherein the output step further comprises a step of outputting the shape signal to a video display displaying an output representing the shape of a portion of the elongated body. (Item 18) 13. The method of item 13, further comprising the step of creating a surgical opening in the patient. (Item 19) The method of item 18, wherein the surgical opening comprises a natural body hole. (Item 20) 18. The method of item 18, further comprising inserting at least a portion of the elongated body through the natural body hole prior to the step of creating a surgical opening. (Item 21) 18. The method of item 18, further comprising the step of inserting the elongated body into the surgical opening. (Item 22) 21. The method of item 21, further comprising the step of sensing the shape of at least a portion of the elongated body beyond the surgical opening. (Item 23) 22. The method of item 22, further comprising the step of outputting the shape signal to a video display and displaying an output representing the shape of a portion of the elongated body beyond the surgical opening. (Item 24) A system for sensing the shape of an instrument, Flexible elongated body and A shape sensor having a proximal end and a distal end that extends in a spiral pattern along a portion of the flexible elongated body and comprises approximately an integral number of approximately complete spiral windings. At least one indicator on the proximal end and on the distal end of the shape sensor, with respect to the flexible elongated body, from the proximal end of the shape sensor to the distal end of the shape sensor. With at least one indicator aligned to the edge to maintain the axial orientation of the shape sensor The system. (Item 25) The system according to item 24, wherein the shape sensor is an optical shape sensor. (Item 26) The system according to item 24, wherein the at least one indicator is a visual marker. (Item 27) 24. The at least one indicator is a plurality of clips configured to hold the proximal end of the shape sensor and the distal end of the shape sensor with respect to the flexible elongated body. System. (Item 28) The system according to item 24, wherein the at least one indicator is a physical indicator. (Item 29) The system according to item 28, wherein the physical indicator is a tab. (Item 30) The system according to item 28, wherein the physical indicator is a groove. (Item 31) 24. The system of item 24, further comprising a plurality of clips configured to hold the shape sensor proximal end and the shape sensor distal end to the flexible elongated body. (Item 32) The system according to item 24, wherein the shape sensor is integrated into the elongated body. (Item 33) The elongated body comprises a plurality of joint motion segments, the at least one indicator maintains the axial orientation of the shape sensor in the proximal portion of each joint motion segment with respect to the distal portion of each joint motion segment. , Item 24. (Item 34) 33. The system of item 33, wherein the spiral pattern comprises a substantially integer number of substantially complete spiral windings for each of the plurality of joint motion segments. (Item 35) 34. The system of item 34, wherein the substantially integer number of substantially complete spiral windings comprises approximately one complete spiral winding for each of the plurality of joint motion segments.</p>
0010<figref num="1">FIG. 1 shows a maneuverable endoscope according to an embodiment of the present invention.</figref><figref num="2">2A-2C show an embodiment of a spinal link according to an embodiment of the present invention.</figref><figref num="3">FIG. 3 connects a control loop between a control signal used to guide the movement of a controllable instrument according to an embodiment of the invention and a shape indicator signal for the shape of all or part of the controllable instrument. Indicates the system.</figref><figref num="4">FIG. 4 shows a range of motion segments having optical shape sensing fibers along their length according to an embodiment of the present invention.</figref><figref num="5">FIG. 5 shows a joint motion segment that senses the shape of the joint motion segment by using the resistance change flexion sensor according to the embodiment of the present invention.</figref><figref num="6">FIG. 6 shows a joint motion segment that senses the shape of the joint motion segment by using a bending sensor according to an embodiment of the present invention.</figref><figref num="7">FIG. 7 shows a process diagram showing steps taken to control an instrument with an elongated body according to an embodiment of the present invention.</figref>
0011FIG. 1 shows an instrument 10 according to an embodiment of the present invention. Instrument 10 has an elongated body 12 with a maneuverable distal portion 14, an automatically controlled proximal portion 16, and a flexible and passively manipulated proximal portion 18. Also, the automatically controlled proximal portion 16 may be flexible and passively manipulated, but it is preferred to provide an automatically controlled proximal portion 16. The elongated body 12 can also have only a steerable distal portion 14 and an automatically controlled portion 16. As described below and graphically shown in FIG. 3, the instrument 10 and ancillary control system or controller incorporate a shape sensor and are provided, at least in part, by one or more shape sensors on or associated with the instrument 10. It may be improved to control the device based on the shape indicating signal. The fiber optic imaging bundle 20 and the illumination fiber 22 may extend from the elongated body 12 to the steerable distal portion 14, or the video camera 24 (eg, a CCD or CMOS camera) may extend from the steerable distal portion 14. It may be located at the distal end. The user observes live or delayed video supplied by the video camera 24 via a video cable (eg, wire or fiber optic (not shown)) or through wireless transmission of a video signal. Typically, instrument 10 is also useful for one or more access lumens, work channels, optical channels, air and water channels, vacuum channels, and both medical and industrial endoscopy. Will include a number of other well-known auxiliary parts. These channels and other equipment are generally referred to as work channel 26. In particular, these devices reach the surgical site by passing the instrument through a natural hole close to the surgical target site, as in natural foramen transluminal (or gastrointestinal) endoscopic surgery (NOTES). Multiple tool channels may be included to provide access to the tool. The use of controllable instruments in transluminal or NOTES procedures, and various details of methods for using controllable instruments, can be found in the book. It is further described in US Patent Application No. 11 / 522,305, "Methods and MFP for Performing Transluminal and Other Procedures," filed September 14, 2006, assigned to the assignee of the invention. The systems, instruments, and devices described in the "Methods and MFP for Performing Transluminal and Other Procedures" have been improved as described herein to have shape sensing capability and / or the systems, instruments described herein. , As well as control of the method.
0012Preferably, the automatically controlled proximal portion 16 comprises a plurality of joint motion segments 28 controlled via a computer and / or electronic controller 30. Such an automatically controlled endoscope is U.S. Patent Application No. 10 / 229,577 (currently U.S. Pat. No. 6,858,005) assigned to the assignee of the invention, filed August 27, 2002. Tendon-Driven Endoscope and Methods of Insertion, and U.S. Patent Application No. 11 / 750,988, filed May 18, 2007, also assigned to the assignee of the invention, "Methods and MFP for Displaying Three-Dimensional Orientation of a." Steerable Distal Tip of an It is described in more detail in "Endoscope". Preferably, the distal end of the tendon is mechanically connected to each range of motion segment 28 or maneuverable distal portion 14, and the proximal end of the tendon is mechanically connected to the actuator and the range of motion segment 28 or maneuver. Move possible distal part 14. Actuators that drive tendons include various different types of mechanisms capable of applying force to tendons, such as electromechanical motors, pneumatic and hydraulic cylinders, pneumatic and hydraulic motors, solenoids, shape memory alloy wires, electronic rotary actuators, or the like. Other devices or methods well known in the art may be included. When shape memory alloy wires are used, they can be configured within several wire bundles installed at the respective proximal ends of the tendons within the actuator. The actuator that drives the tendon may be located within the appliance 10, or, as an alternative, the actuator may be located outside the appliance 10.
0013Even if the range of motion of the segment is achieved by applying energy, such as current, voltage, heat, etc., to each of the bundles to actuate the linear motion in the wire bundle, thereby activating the movement of the tendons. Good. The linear translation of the actuator in the controller may travel a relatively short distance and achieve effective range of motion, depending on the desired degree of segmental movement and range of motion. In one embodiment, a knob mounted on a rack and pinion gear can be used to actuate a tendon mounted on the steerable distal portion 14. Axial motion transducers 32 (also referred to as depth reference devices or depth references) may be provided to measure axial motion, i.e., depth changes, as the elongated body 12 moves forward and backward. When the elongated body 12 of the instrument 10 slides through the axial motion transducer 32, it indicates the axial position of the elongated body 12 with respect to the reference fixation point. Axial motion transducer 32 is described in US Patent Application No. 11 / 522,305, filed September 14, 2006, "Methods and MFP for Performing Transluminal and More fully described in "Other Procedures". In addition, an optical sensor may be used to determine the axial position of the instrument, either alone or in combination with an optical shape sensor, as described more fully below. In either case, the depth information combined with the shape information can be used to construct a three-dimensional image of the elongated body as it is inserted or pulled out. In addition, information from such systems may be used to provide the shape of the path that the sensor follows from a reference point (ie, datum). In addition, as input to the control system, using information from such a system, (i) driving the instrument to a position under the control of the user, (ii) providing the user's recommended maneuvering commands. And manipulating the instrument to the desired position or orientation, (iii) automatically controlling the instrument to accommodate user input, a given route (surgical plan), or input from the imaging system or display. Good.
0014In the embodiment described in FIG. 1, the handle 34 is connected to the lighting source 36 by a lighting cable 38 connected to or connected to the lighting fiber 22. The handle 34 is connected to the electronic controller 30 via the controller cable 40. The user input device 42 (eg, the joystick) is connected to the electronic controller 30 via a second cable 44 or directly to the handle 34. Controller 30 controls the movement of the segmented, automatically controlled proximal portion 16.
0015In one embodiment, the range of motion segment 28 of the device 10 can be constructed from multiple links 200, as shown in FIG. 2A-2C. FIG. 2A shows an end view of the single link 200. Each link 200 can define a central opening or work channel 202 that can collectively form an internal lumen, as described above. As shown in FIG. 2B, the link 200 may have two pairs of hinges 204 and 206. The first pair of hinges 204 can project vertically from the first surface of the link 200, and the second pair of hinges 206 located 90 degrees around the circumference from the first pair is the first. It projects vertically from the surface of the link 200 on the second surface of the spine opposite the surface. In the embodiment shown in FIG. 2C, each range of motion segment 28 can include four links 200, but any number of links may be used, including only one link. The final number of links 200 used is primarily defined by the purpose for which the range of motion segment 28 or instrument 10 is used. In this embodiment, each link 200 can be moved with one degree of freedom with respect to the adjacent link. Multiple links provide two degrees of freedom for segment 28. Further details of the articulation segment can be found in US Patent Application No. 11 / 871,104, "System for Managing Bowden Cables in Articulating Instruments," filed October 11, 2007, assigned to the assignee of the present invention.
0016FIG. 3 illustrates an exemplary system 300 and method connecting a control loop between a control signal used to guide the movement of an instrument and a shape indicator signal for the shape of all or part of the controllable instrument. Shown. Since the system 300 is implemented using an instrument such as the instrument 10, the following description of the system 300 includes a reference to the instrument 10 in FIG. To determine the shape of the elongated body 12, the instrument 10 may further include a shape sensor 302 in contact with the elongated body 12. For example, the shape sensor can be an optical sensing fiber or a bundle of fibers that extends along the length of the elongated body. Embodiments of the present invention build the concept of measuring the shape of an optical fiber and using those measurements to determine the curvature and / or relative position of an instrument associated with the optical fiber. In some embodiments, shape sensing is achieved by generating a linear array of high spatial resolution fiber optic refraction sensors. In general, the overall shape is reconstructed through the integration process by assuming that each element is small enough and knowing the curvature of the structure in each individual element. Additional types of shape sensors on or within instrument 10 and their orientation are detailed below.
0017In addition to the shape sensor 302, the system 300 of FIG. 3 also includes a user input device 42, a controller 30, an actuator 304, and a range of motion segment 28. As mentioned above, the user input device 42 is configured to communicate with the controller 30, provide control signals, and change the shape of at least one of the range of motion segments 28. The controller 30 communicates with the actuator 304 to guide the movement of the joint motion segment 28 and thus control the shape of the elongated body 12. In particular, the user inputs a control signal to the user input device 42 (ie, joystick, computer, etc.) and then transmits the control signal to the controller 30. The user may control the device 10 or exhibit the desired movement in some exemplary manner. In one embodiment, the user controls the maneuverable distal portion 14 with a user input device 42 to identify the direction in which the instrument 10 needs to travel. The instrument 10 is then advanced and the segment following the maneuverable distal portion 14 takes the form of the segment in front of it. This forefoot-following shape determination generally works with adjacent adjacent segments in the shape of adjacent distal segments as the instrument 10 advances distally. The determination of the degree of fit of a segment to the shape of another segment, and the determination of the shape of one or more segments, is determined, at least in part, by the shape sensor. The nose leg-following shape determination works the same regardless of whether it advances distally or retracts proximally. Alternatively, in another embodiment, the user can enter any desired shape of the elongated body, regardless of the maneuverable distal portion and without even advancing or retreating the elongated body 12 (ie). , On a computer that interacts with a visual display or graphical user interface, etc.). In other words, the controller can operate the elongated body 12 into any desired shape with or without input from the user. The elongated body 12 has the desired shape
0018When the shape of the instrument 10 changes in response to a control signal from the user input device 42, the shape sensor 302 provides a shape signal corresponding to at least one shape of the joint motion segment 28. For example, when the shape sensor 302 extends along the overall length of the elongated body 12, the shape signal can correspond to the shape of the overall length of the elongated body 12. However, in applications where the instrument 10 is inserted into the patient, the shape sensor 302 does not need to extend along the overall length of the elongated body 12, but rather is part of the elongated body 12 inserted into the patient (ie). It should be understood that a length that indicates the shape of the elongated body 12), which is invisible to the user, is sufficient.
0019The shape sensor 302 is configured to provide a shape signal corresponding to at least one shape of the range of motion segment 28. The controller 30, which communicates with both the user input device 42 and the shape sensor 302, moves at least one of the joint motion segments 28 in response to the control signal from the user input device 42 and the shape signal from the shape sensor 302. Can be induced. As mentioned above, it should be understood that range of motion equipment or serpentine robots may not always achieve the shape intended by the user. For example, the actuator may fail or the tendons involved in the movement of the range of motion segment 28 may bind, stretch, slide, or break, preventing the range of motion segment 28 from achieving the shape intended by the user. Therefore, the controller 30 guides the movement of the device 10 in response to the shape signal from the shape sensor 302 so that the device 10 can automatically achieve the shape intended by the user. Any error can be compensated.
0020In one embodiment, the user may guide or steer the appliance 10 with the user input device 42 while monitoring the actual shape of the elongated body 12 sensed by the shape sensor 302. For example, the system 300 further includes a video display (not shown in FIG. 3) configured to receive a shape signal from the shape sensor 302 and display an output representing a portion of the shape of the elongated body 12. be able to. Therefore, the user can guide, steer, or guide the movement or change of the shape of the appliance 10 by monitoring the shape of the elongated body 12 while displaying it on the video display. Since the controller 30 guides the movement of the elongated body 12 in response to the control signal from the user input device 42 and the shape signal from the shape sensor 302, the system 300 depends on the actual shape of the elongated body 12. Provided is a closed loop feedback control system for controlling the instrument 10.
0021In yet another embodiment of the system 300, the user can enter the desired shape on a bidirectional display such as a graphical user interface display, and the controller 30 guides the appliance 10 to automatically shape the desired shape. Can be achieved. This is achieved in the same manner as described above, in which the controller 30 responds to the shape signal from the shape sensor 302 until the shape of the elongated body 12 matches the desired shape from the user. Induce movement.
0022System 300 can be implemented in a variety of surgical procedures. For example, a surgical opening is created within the patient, the instrument 10 is inserted, and as described above, it can be controlled using the system. Surgical openings can also be natural body holes, or openings that are created after first passing at least a portion of an elongated body through a natural or generated opening within the body. In the NOTES procedure, for example, the elongated body 12 can be inserted into the patient's stomach through the nose or mouth and then through the esophagus. In this example, once the elongated body 12 has entered the stomach, a surgical opening can be made in the stomach wall to allow the elongated body 12 to enter the peritoneal cavity or abdominal cavity. Therefore, upon entering the patient, System 300 accurately senses the shape of the elongated body 12, including all or part of the elongated body 12 beyond the surgical opening, beyond the natural body foramen, or both. , Can be measured, judged, and / or controlled.
0023As is well known in the art, optical fiber bragg gratings (FBGs) on the core of multi-core fibers are described in "Sensing Shape", SPIE's OEMagazine, pp. 18-21 September 2005. A density linear array can be provided. There are multiple ways to measure the shape of the fiber, and thereby the shape of the instrument aligned with it. One method involves irradiating the fiber bundle with a sweep wavelength laser and measuring the reflected light from the fiber bundle. Bending in the fiber bundle modifies the reflection properties of the FBG, thereby acting as a local strain gauge. Challenges arise in accurately reading many FBG arrays and determining the shape of fiber bundles.
0024One of the techniques for reading the FBG array is an energy leakage technique for stripping the coating along a specific region of the fiber bundle. The bend associated with the coating process to be stripped increases or decreases the amount of light transmitted through the fiber, depending on the magnitude of the bend. One of the limitations of this technique is the need for one fiber in each direction for which measurement is desired.
0025Another technique is multi-core fiber cross-coupling, as described in US Pat. No. 6,888,623, "Fiber Optic Sensor for Precision 3-D Position Measurement," issued March 3, 2005. Cross-coupling is a function of the shape of the fiber, and the shape of the fiber can be determined by analyzing the energy in each core.
0026In Wavelength Division Multiplexing (WDM), Bragg grids are written at various locations along a multi-core fiber with different nominal center wavelengths. Each grid can be individually addressed by choosing the wavelength of the light emitted into the system to be close to the center wavelength of the grid. The strain (ie, bending) in the fiber near the grid slightly shifts the center wavelength of the grid, which can be measured by the shift of the reflection spectrum. The limitation of this technique is that the number of lattices that can be accommodated is controlled by the full range of wavelengths at which the input source can be scanned and the amount of offset expected within the wavelength due to the strain of the multi-core cable. It is limited by the minimum difference in wavelength. U.S. Pat. No. 7,317,849, "Optical Fiber Sensor and Method," issued January 8, 2008, further describes this technology.
0027Optical time domain reflectometer (OTDR) can be used as one solution to the limitations of WDM technology. This solution allows many simultaneous measurements by writing many grids at the same nominal center wavelength and using the time delay of reflection to separate the spatial positions of the grids. The reflection position in the fiber optic cable is determined by measuring the flight time of the light from the launch point into the fiber to the reception of the reflection back to the near point of launch. In principle, this technique can be used to separate identical central wavelength grids, however, in practice, the position resolution available by this technique is often poor.
0028In another more preferred technique, the OTDR uses a multi-core fiber, all grids are written at approximately the same nominal wavelength, and the grid position is with the reflection of the grid and the high reflector at the proximal end of the fiber. It is judged within the frequency domain by forming a resonance cavity between the two. This technique requires only one multi-core fiber to produce the shape sensor and writes many grids at the same nominal center wavelength, allowing for longer fibers. Lu na Innovations (Www.Lunainnovations.Com) is a tissue that is generating the shape sensor to be built based on this technology.
0029As used herein, the optical shape sensor includes any well known optical shape sensor. Details of the structure, operation, and use of the exemplary optical sensor can be found in US Pat. No. 6,376,830, issued April 23, 2002, "System and Method for Measuring the Transfer Function of a Guided Wave Device," July 30, 2002. US Pat. No. 6,426,496 "High Precision Wavelength Monitor for Tunable Laser Systems", US Pat. No. 6,856,400, issued February 15, 2005, "Apparatus and Method for the Complete characterization of Optical Device Including Loss," Birefringence and Dispersion Effects, US Pat. No. 7,113,659, issued September 26, 2006, "Efficient Distributed Sensor Fiber," and US Pat. No. 7,099,015, issued August 29, 2006, "Fiber Optic Sensing Device for Measuring a Physical Parameter." , But not limited to them.
0030If the shape sensor 302 comprises an optical shape sensor, one method is a proximal-to-distal shape sensor to improve the accuracy of the shape signal generated to correspond to the shape of the elongated body. The axial orientation of the device 10 must be aligned with the device 10. As mentioned above, the work channel 26 extends along the center of the instrument 10. In one embodiment, the work channel moves off-center and the shape sensor is positioned to occupy the space previously used by the work channel. Alternatively, the shape sensor 302 may be placed off-center within the instrument 10. However, all center shape sensor positions can cause difficulty in maintaining the axial orientation of the shape sensor 302, as the shape sensor can be compressed or stretched and damaged when the instrument 10 bends. is there.
0031There are several techniques that can be employed to ensure that shape sensors are positioned to minimize damage and provide accurate signals that represent the shape of all or part of an elongated body. Referring to FIG. 4, the optical shape sensor 402 extends in a spiral pattern along a portion of a flexible elongated body and comprises a single complete spiral winding along a single joint motion segment 28. In other embodiments, the optical shape is as long as the axial orientation of the shape sensor from the proximal end to the distal end of the shape sensor with respect to the instrument is maintained, as required by the special technical requirements of the particular optical shape sensor. The sensor 402 can extend in a spiral pattern for an integral number of complete spiral windings. The optical shape sensor can be extended in a spiral pattern along only the single joint motion segment 28, as shown in FIG. 4, or in multiple joint motion segments of the elongated body, including the overall length of the elongated body. Along, it can be extended in a spiral pattern. In one embodiment, when the shape sensor is screwed along a plurality of joint motion segments, the shape sensor is screwed into each joint motion segment with an integral number of complete spiral windings. This maintains axial orientation along each range of motion segment 28, and thus collectively, along the elongated body.
0032By screwing the optical shape sensor 402 along a portion of the flexible elongated body, it imparts an inevitable twist to the optical shape sensor, which extends along the flexible elongated body. Since it is installed, it interferes with the axial orientation of the shape sensor. Therefore, reverse twist is induced in the optical shape sensor, the natural twist caused by the spiral path along the elongated body is removed, and the axial orientation of the shape sensor from the proximal end to the distal end is maintained with respect to the elongated body. There must be.
0033As further shown in FIG. 4, the optical shape sensor 402 can include at least one indicator 404 on at least proximal and distal ends of the shape sensor. The indicator 404 can be aligned across the range of motion segment 28 to maintain the axial orientation of the proximal end of the shape sensor with respect to the range of motion segment 28 and keep the shape sensor distal. In the embodiment of FIG. 4, the indicator 404 is a physical indicator such as a tab extending from the shape sensor. These tabs fit into clip 406, which holds the optical shape sensor 402 in place at each end of the range of motion segment 28 and is proximal to the shape sensor relative to the distal end of the shape sensor. The axial orientation of the edges can be maintained. However, in this configuration, as described above, when the shape sensor is screwed along the range of motion segment, the axial orientation of the shape sensor from the proximal end to the distal end is still reverse twisted within the shape sensor. Must be aligned with the range of motion segment, such as by inducing. In another embodiment, the physical indicator can be a groove designed to fit the end of the range of motion segment. In yet another embodiment, the indicator 404 can be a visual marker on the shape sensor itself, such as a tint or dotted line on the length of the shape sensor. It should be understood that it is shown on the elongated body for the purpose of explaining the relative position of the sensor relative to the elongated body or its segments. In some embodiments, the shape sensor is integrated within the elongated body, or as a sleeve that is crowned or coupled over, in, or around one or more of the range of motion segments.
0034The shape sensor 302 described above is not limited to the optical shape sensor. With reference to FIG. 5, as an alternative, a resistance changing flexible band can be mounted within the elongated body 12. As is well known in the art, resistance-changing flexible bands change resistance as they expand and contract. An example of a resistance-changing flexible band is Stretch Sensors commercially available from Images SI Inc. (http://www.imagesco.com/sensors/stretch-sensor.html).<sup>TM</sup>Is. As shown in FIG. 5, the flexible band sensor 502 can extend along the length of the range of motion segment 28 of the elongated body 12. The pair of flexible band sensors 502 can be extended along the first and second pair of hinges 204 and 206 for each bend (x and y) of the range of motion segment 28. In this embodiment, the flexible band sensor will experience increased and decreased resistance during range of motion. It can be used to determine or measure the resistance difference between the flexible band sensors 502 and determine the shape of each range of motion segment 28. Therefore, the flexible band sensor 502 can provide the controller 30 with a shape signal corresponding to at least a part of the shape of the elongated body 12, as described above.
0035In an alternative embodiment, the shape sensor 302 can include a plurality of flexure sensors, such as those made by FlexPoint (www.flexpoint.com) or SpectraSymbol (www.spectrasymbol.com). As shown in FIG. 6, bending sensors 602 and 604 (the bending sensor 604 is provided along the hinge 204 but is hidden in FIG. 6) are attached to the hinges 206 and 204 of each link 200, respectively. It is provided and can provide a signal to the controller 30 indicating the angle of joint movement. Bending sensors 602 and 604 are flat and bend in one direction, but are essentially not bendable in orthogonal planes. Therefore, in the present embodiment, the bending sensors 602 and 604 are aligned so that the bending surface of each pair of links 200 is substantially parallel to the bending surface of the bending sensor that traverses each hinge. As mentioned above, the flexion sensors 602 and 604 can provide the controller 30 with shape signals corresponding to at least a portion of the shape of the elongated body 12.
0036In yet another embodiment, a potentiometer (POT) can be used to measure the coupling angle as yet another technique for determining the shape of all or part of an elongated body. Similar to the embodiments described above, a POT acquisition assembly can be provided for each hinge of the range of motion segment 28. In this embodiment, the POT has a wiper that rubs against the carbon film, thereby altering the resistance output from the POT. The wiper is mounted on a grooved piece, which is secured on hinges 204 and 206 between adjacent links 200 of the range of motion segment 28. As described, the range of motion of the link 200 turns the grooved piece, rubs the wiper against the carbon film, and changes the resistance output of the POT. As described above, this resistance can be provided to the controller 30 as a shape signal corresponding to at least a part of the shape of the elongated body 12. An alternative to POT sensors is the use of optical encoders, as will be appreciated by those skilled in the art.
0037Other alternative devices and techniques for shape sensing include the use of magnetic sensors, or, as an alternative, sensors that detect fluctuations in the magnetic field generated by the transmitter. Ascension Technology Corporation (http://www.ascension-tech.com/) has developed sensors suitable for the purposes described herein. In addition, US Patent Application No. 11 / 242,048, filed October 4, 2005, "DC Magnetic-Based Position and Orientation Monitoring System for Tracking Medical Instruments," discloses this technology. The magnetic sensors can be spaced apart along the elongated body 12 according to the embodiment of the present invention. The spatial orientation of the magnetic sensor and the movement detected thereby can be used to indicate, determine, or measure the shape of all or part of the elongated body. Similar to the above, the magnetic sensor can provide the controller 30 with a shape signal corresponding to at least a part of the shape of the elongated body 12.
0038FIG. 7 shows a process diagram showing a method of controlling an appliance having an exemplary elongated body according to an embodiment of the present invention. Details and features that are apparent to those skilled in the art are omitted from Schedule 700. For example, as is well known in the art, a step may consist of one or more substeps, or may be accompanied by special equipment or materials.
0039Since the method steps in process diagram 700 are implemented using an instrument such as instrument 10, the following description of process diagram 700 includes references to instrument 10 in FIG. 1 and system 300 in FIG. In step 702 of process diagram 700, a control signal is output to the controller to change the shape of the appliance with the elongated body. As described above, the user can input the control signal to the user input device 42 and transmit the control signal to, for example, the controller 30. In one embodiment, the controller 30 communicates with the actuator 304 to guide the movement of the elongated body 12.
0040In step 704 of process diagram 700, the shape of at least a part of the elongated body is sensed by the shape sensor. As mentioned above, the shape sensor 302 provides a shape signal corresponding to at least one shape of the range of motion segments 28. In one embodiment, the shape sensor 302 extends along the overall length of the elongated body 12 to provide a shape signal corresponding to the overall shape of the elongated body 12. However, in another embodiment, the instrument 10 is inserted into the patient, so the shape sensor 302 does not need to extend along the overall length of the elongated body 12, but rather the elongated body 12 inserted into the patient. A length indicating a part of the shape of is sufficient.
0041In step 706 of the process diagram 700, the shape signal corresponding to the shape of a part of the elongated main body is output from the shape sensor to the controller. In one embodiment, the output step may further include outputting a shape signal to a video display and displaying an output representing the shape of a portion of the elongated body. As mentioned above, the system 300 can include a video display configured to receive a shape signal from the shape sensor 302 and display an output representing the shape of a portion of the elongated body 12. Therefore, the user can guide, steer, or guide the movement or change of the shape of the appliance 10 by monitoring the shape of the elongated body 12 while displaying it on the video display.
0042In step 708 of process diagram 700, the movement of the elongated body is guided in response to control and shape signals. As described above, the controller 30 communicating with both the user input device 42 and the shape sensor 302 responds to the control signal from the user input device 42 and the shape signal from the shape sensor 302 in response to the joint motion segment 28. A closed-loop feedback control system can be provided to guide at least one movement and control the device 10.
0043In other embodiments, the method can further include the step of creating a surgical opening within the patient. A surgical opening can be created within the patient and the instrument 10 can be inserted and controlled using the system described above. Surgical openings can also be natural body holes, or openings that are created after first passing at least a portion of an elongated body through a natural or generated opening within the body. In addition, the method senses the shape of at least a portion of the elongated body beyond the surgical opening and outputs a shape signal to a video display, beyond the surgical opening and beyond the elongated body. It can further include a step of displaying an output representing the shape.
0044In addition to the step of sensing the shape of the elongated body, an optical sensor can be used to determine the insertion depth of the elongated body from a particular predetermined point. In addition, this information can be used to construct a three-dimensional shape of an elongated body, as described above. Two or more shape sensors may be used to determine the insertion depth of the instrument. Consider a pair of shape sensors. Each sensor can be provided at x, y, z positions in the x, y, z coordinate system. One sensor is placed in a fixed position and used as a reference position. In one embodiment, the x, y, z tip positions of the first sensor are used as reference points. The reference point may be located on or near a naturally or surgically generated opening in the body. The reference sensor point may be positioned adjacent to the surgically generated opening created in the body after entering the body through a natural opening or a surgically generated opening. The reference point may be located at or near the natural opening, even if the surgical opening is created or utilized elsewhere. For example, if the opening is created at another point in the stomach or gastrointestinal tract, the reference point may be at or near the mouth. In addition, the simultaneous pending patent application No. 11/522, filed September 14, 2006, Reference point openings are generated, shape sensors and flexible instruments are positioned and may be used with the assistance of NOTES, as described in No. 305, "Methods and MFP Useful in Performing Transluminal and Other Procedures". .. The second sensor is attached to the instrument. The instrument passes near the tip of the first sensor. The x, y, z positions of the second instrument are known. The x, y, z positions are then compared along the instrument until one matches or most closely corresponds to the x, y, z position of the tip. The x, y, z positions on the instrument are then used to determine the position of the instrument relative to the reference point and the depth at which the instrument was inserted beyond the reference point. In addition, the shape of the second instrument is also known based on the information from the second shape sensor. Also, the path, organ, or part of the body that has passed relative to the reference point may be determined using the insertion depth and shape of the second shape sensor. Also, similar techniques may be used when the instrument is withdrawn or manipulated.
0045In an alternative embodiment, the techniques described herein may be used to measure the relative position of the shape sensor relative to another position sensor that is not the shape sensor. For example, if the anus is located in a known position on the operating table and the base of the shape sensor is located in a known position with respect to the operating table, the insertion depth uses a single shape sensor within the area. The second sensor, which can be judged perfectly, becomes a "ruler" formed by the known relative positions of the anus and the base of the shape sensor.
0046Similarly, it would be possible to determine velocity, acceleration, and higher order derivatives from this configuration. Low error and low signal through redundancy, consistency / error matching, and various stochastic estimation techniques (extended Kalman filter, unsented conversion filter, Wiener filter, H_infinite optimal estimation, etc.) using multiple sensors. Can provide noise.
0047For additional details related to the various embodiments described herein, materials and manufacturing techniques may be employed within the standards of those skilled in the art. The same may apply to aspects based on the methods herein, in terms of additional actions that are generally or logically adopted. Shape sensor with elongated body and ancillary control system There are additional system requirements needed to ensure full integration and proper operation of the optical shape sensor, for example, ensuring that the light source is focused on the optical sensor. Requires light or optimal components to be provided. Also, these and other conventional components are included as part of System 300, as required by the technical requirements of the particular shape sensor or sensors used.
0048It is also contemplated that any optional feature of the modifications of the invention described may be described and claimed independently or in combination with any one or more of the features described herein. .. Similarly, a single item reference includes the possibility that multiple identical items may exist. More specifically, as used herein and in the appended claims, the singular forms "a", "and", "said", and "the" are not explicitly stated separately by context. As long as it includes the plural form. Furthermore, it should be noted that claims may be created excluding any optional elements. Therefore, this statement is intended to serve as a basis for the use of such exclusion terms, such as "simply", "only", or "negative" restrictions associated with the enumeration of claims elements. Unless otherwise defined herein, all techniques and specific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. The scope of the invention is not limited by this subject specification, but rather only by the explicit meaning of the claimed terms adopted.
0049The following claims define the scope of the invention, and methods and structures within the scope of these claims and their equivalents are intended to be covered therein.
7 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| JP05285091A | Cites | Japan |
| JP2003185897A | Cites | Japan |
| JP2005537063A | Cites | Japan |
| JP2006314775A | Cites | Japan |
| JP2000258190A | Cites | Japan |
| JP07234346A | Cites | Japan |
| JP2001169998A | Cites | Japan |
| JP05056910A | Cites | Japan |
| JP2004251779A | Cites | Japan |
24 members in 5 offices
Members24
| Document | Office | Kind | |
|---|---|---|---|
| WO2008094949A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2008094949A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO2008094949A8 | World Intellectual Property Organization (WIPO) | A8 | |
| EP2124705A2 | European Patent Office (EPO) | A2 | |
| KR20100018487A | Republic of Korea | A | |
| US2010099951A1 | United States of America | A1 | |
| JP2010516412A | Japan | A | |
| JP5373632B2 | Japan | B2 | |
| JP2014064917A | Japan | A | |
| US8784303B2 | United States of America | B2 | |
| KR101422558B1 | Republic of Korea | B1 | |
| US2014330080A1 | United States of America | A1 | |
| JP5694474B2 | Japan | B2 | |
| JP2015107363A | Japan | A | |
| JP2016129715A | Japan | A | |
| JP6139577B2This record | Japan | B2 | |
| US9737198B2 | United States of America | B2 | |
| US2017319049A1 | United States of America | A1 | |
| EP2124705B1 | European Patent Office (EPO) | B1 | |
| EP3542701A1 | European Patent Office (EPO) | A1 | |
| US10660509B2 | United States of America | B2 | |
| US2020229683A1 | United States of America | A1 | |
| EP3542701B1 | European Patent Office (EPO) | B1 | |
| US11039736B2 | United States of America | B2 |
16 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for extension of timeJAPANESE INTERMEDIATE CODE: A601A601 | A601 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on retrievalJAPANESE INTERMEDIATE CODE: A971007A977 | A977 |
Numbers
- Publication
- 6139577
- Application
- 19883
Titles2
- Japanese
- 形状センサを用い器具を制御するシステム
- English
- A system that controls equipment using shape sensors
Classification
- CPC, 9
- A61B1/0055
- A61B1/0052
- A61B2034/2061
- A61B1/009
- A61B1/01
- A61B1/045
- A61B1/00045
- A61B1/313
- A61B1/05
- IPC, 3
- A61B17 94
- A61B1 00
- G02B23 24
