Tablet ultrasound system
Abstract
Exemplary embodiments provide systems and methods for portable medical ultrasound imaging. Preferred embodiments utilize a tablet touchscreen display operative to control imaging and display operations without the need for using traditional keyboards or controls. Certain embodiments provide ultrasound imaging system in which the scan head includes a beamformer circuit that performs far field sub array beamfonning or includes a sparse array selecting circuit that actuates selected elements. Exemplary embodiments also provide an ultrasound engine circuit board including one or more multi-chip modules, and a portable medical ultrasound imaging system including an ultrasound engine circuit board with one or more multi-chip modules. Exemplary embodiments also provide methods for using a hierarchical two-stage or three-stage beamforming system, three dimensional ultrasound images which can be generated in real-time.

Term
No projected expiry on record.
- Priority
- Filed
- Granted
- Today
37 claims: 2 independent, 35 dependent
- 1一種行動醫療超聲波成像器件,其包括:一傳感器探測頭,其包含一傳感器陣列;一平板電腦殼體,該殼體具有一前面板;該殼體中之一電腦,該電腦包含至少一處理器及至少一記憶體;使用一圖形使用者介面(GUI)以顯示一超聲波影像之一觸控螢幕顯示器,該觸控螢幕顯示器定位於該前面板上;該電腦通信地連接至一超聲波波束成形器處理電路,該超聲波波束成形器處理電路自該傳感器陣列接收影像信號,該電腦可回應於來自該觸控螢幕顯示器之一第一手勢輸入而操作以變更該超聲波波束成形器處理電路之一操作;及其中該圖形使用者介面包含相對於一超聲波影像顯示視窗在該顯示器上所顯示之複數個圖標,且其中該該觸控螢幕顯示器包含掃描深度之觸控致動控制。
- 2如請求項1之器件,其中該第一手勢輸入對應於該觸控螢幕顯示器上之一移動手勢。
- 3如請求項1之器件,其中該傳感器陣列包括一雙平面傳感器陣列。
- 4如請求項3之器件,其進一步包括一第二輸入,該第二輸入包含抵靠該觸控螢幕顯示器之一點兩下手勢。
- 5如請求項3之器件,其進一步包括回應於來自該觸控螢幕顯示器之該第二輸入,顯示一虛擬視窗之一區域內部之一第一游標,該虛擬視窗顯示一經放大影像。
- 6如請求項5之器件,其進一步包括在該電腦處接收來自該觸控螢幕顯示器之一第三輸入,該第三輸入在該虛擬視窗之該區域內部接收。
- 7如請求項6之器件,其中該第三輸入對應於該觸控螢幕顯示器上之一拖曳手勢。
- 8如請求項6之器件,其進一步包括回應於來自該觸控螢幕顯示器之該第三輸入,將該第一游標移動至該虛擬視窗之該區域內部之一第一部位。
- 9如請求項1之器件,其中一進一步輸入對應於抵靠該觸控螢幕顯示器之一按壓手勢。
- 10如請求項9之器件,其進一步包括在該電腦處接收來自該觸控螢幕顯示器之一第二進一步輸入,該第二進一步輸入與進一步輸入實質上同時接收。
- 11如請求項1之器件,其進一步包括藉由在該平板電腦殼體中之一波束成形器處理電路操作之複數個傳感器陣列。
- 12如請求項10之器件,其進一步包括回應於來自該觸控螢幕顯示器之該第二進一步輸入,將該第一游標固定於該虛擬視窗之該區域內部之該第一部位處。
- 13如請求項12之器件,其進一步包括藉由該電腦執行至少部分基於該第一部位處之該第一游標之對該超聲波影像之至少一量測。
- 14如請求項12之器件,其進一步包括在該電腦處接收來自該觸控螢幕顯示器之一第三進一步輸入。
- 15如請求項14之器件,其中該第三進一步輸入對應於抵靠該觸控螢幕顯示器之一點兩下手勢。
- 16如請求項14之器件,其進一步包括回應於來自該觸控螢幕顯示器之該第三進一步輸入,顯示該虛擬視窗之該區域內部之一第二部位處之一第二游標。
- 17如請求項16之器件,其中該電腦處理至少部分基於該第一及該第二游標在該虛擬視窗之該區域內部之該等各自部位之關於該超聲波影像之至少一量測。
- 18如請求項9之器件,其中該進一步輸入對應於抵靠該觸控螢幕顯示器之一按壓及拖曳手勢。
- 19如請求項1之器件,其進一步包括一針導引器件。
- 20如請求項1之器件,其進一步包括複數個傳感器連接器且該傳感器可操作以自複數個經連接之傳感器選擇一傳感器。
- 21如請求項19之器件,其進一步包括在該顯示器上之一第二視窗中同時操作一成像程序及一經網路連線之通信協定。
- 22如請求項1之器件,其進一步包括使用一傳感器連接器連接至該殼體之一傳感器陣列,該傳感器陣列與該傳感器探測頭中之該超聲波波束成形器處理電路通信。
- 23如請求項1之器件,其中該殼體具有小於2500立方公分之一體積。
- 24如請求項1之器件,其進一步包括將該器件連接至諸如網際網路之一公共存取網路之一無線網路連接。
- 25如請求項1之器件,其進一步包括一無線卡埠及一卡讀取器。
- 26一種操作可攜式醫療超聲波成像設備之方法,該可攜式醫療超聲波成像系統包含:一傳感器探測頭;在一平板電腦外觀尺寸中之一殼體,該殼體具有一前面板;安置於該殼體中之一電腦,該電腦包含至少一處理器及至少一記憶體;一觸控螢幕顯示器,其用於顯示一超聲波影像,該觸控螢幕顯示器經安置於該前面板上;該電腦連接至一超聲波波束成形器電路,該觸控螢幕顯示器可通信耦合至該電腦,該方法包括以下步驟:在該電腦處接收來自該觸控螢幕顯示器之一第一輸入;回應於來自該觸控螢幕顯示器之該第一輸入,追蹤經顯示的該超聲波影像之一特徵;在該電腦處接收來自該觸控螢幕顯示器之一第二輸入,該第二輸入與該第一輸入之一部分實質上同時接收;及回應於來自該觸控螢幕顯示器之該第二輸入,完成經顯示的該超聲波影像之該特徵之追蹤。
- 27如請求項26之方法,其中該第一輸入對應於抵靠該觸控螢幕顯示器之一按壓及拖曳手勢。
- 28如請求項26之方法,其中該第二輸入對應於抵靠該觸控螢幕顯示器之一點選手勢。
- 29如請求項26之方法,其進一步包括在該電腦處接收一第三輸入以致動與該觸控螢幕顯示器一起操作之一圖形使用者介面之一圖標。
- 30如請求項29之方法,其中該第三輸入對應於抵靠該觸控螢幕顯示器之一點兩下手勢。
- 31如請求項29之方法,其進一步包括回應於來自該觸控螢幕顯示器之該第三輸入,顯示該觸控螢幕顯示器之一區域內部之一第一游標。
- 32如請求項26之方法,其進一步包括在該電腦處接收來自該觸控螢幕顯示器之一第四輸入。
- 33如請求項32之方法,其中該第四輸入對應於該觸控螢幕顯示器上之一拖曳手勢。
- 34如請求項32之方法,其進一步包括回應於來自該觸控螢幕顯示器之該第四輸入,將該第一游標移動至該觸控螢幕顯示器之該區域內部之一第一部位。
- 35如請求項26之方法,其進一步包括該超聲波影像之該特徵之追蹤,其包含從該觸控螢幕顯示器上之一顯示視窗之一區域內部之一第一部位處之一第一游標開始。
- 36如請求項26之方法,其進一步包括藉由該電腦執行至少部分基於該超聲波影像之該預定特徵之該追蹤之對該超聲波影像之至少一量測。
- 37如請求項26之方法,其進一步包括使用經插入至具有一卡讀取器電路之該平板電腦中之一卡連接至一無線資料網路。
Independent claims37
287 paragraphs in 1 section, as filed
Tablet ultrasound system
TABLET ULTRASOUND SYSTEM
<b>[Cross reference to related applications]</b>
This application is a partial continuation application of U.S. Application No. 14/037,106 filed on September 25, 2013, and the entire content of the case is incorporated herein by reference.
Medical ultrasound imaging has become one of the industry standards for many medical imaging applications. In recent years, there has been an increasing demand for medical ultrasound imaging equipment that can be carried to allow medical personnel to easily transport the equipment to and from the hospital and/or on-site locations, and more Humanely adapt to medical personnel who can have a series of skill levels.
The conventional medical ultrasound imaging equipment usually includes at least one ultrasound probe/sensor, a keyboard and/or a knob, a computer and a display. In a typical operation mode, the ultrasonic probe/sensor generates ultrasonic waves that can penetrate tissue to different depths based on frequency levels and receive ultrasonic waves reflected from the tissue. In addition, medical personnel can input the system input to the computer via the keyboard and/or knob, and view the ultrasound image of the tissue structure on the display.
However, the conventional medical ultrasound imaging equipment using these keyboards and/or knobs may be large in size, and therefore may not be suitable for portable use in hospitals and/or on-site locations. In addition, because these keyboards and/or knobs usually have uneven surfaces, they may be difficult to keep clean in a hospital and/or on-site environment. Maintaining a sterile site in these places may be critical to patient health. Some conventional medical ultrasound imaging equipment has been merged Incorporate touch screen technology to provide part of the user input interface. However, conventional medical ultrasound imaging devices using this touch screen technology generally only provide limited touch screen functionality combined with a traditional keyboard and/or knob, and therefore may not only be difficult to keep clean but also complicated to use.
According to the present invention, a system and method for medical ultrasound imaging are disclosed. The currently disclosed medical ultrasonic imaging system and method adopts a medical ultrasonic imaging device, which includes a handheld housing in the appearance size of a tablet computer and a touch panel arranged on a front panel of the housing. Control the screen display. The touch screen display includes a multi-touch touch screen that can identify and distinguish one or more single points, multi-points, and points on a surface of the touch screen display. / Or simultaneous touch, thereby allowing the use of gestures (ranging from simple single-point gestures to complex multi-point movement gestures) as user input to medical ultrasound imaging equipment.
According to one aspect, an exemplary medical ultrasound imaging system includes a housing having a front panel and a rear panel rigidly mounted to each other in parallel planes, a touch screen display, at least one processor and at least one memory It consists of a computer, an ultrasonic beamforming system and a battery. The shell system of the medical ultrasonic imaging equipment is implemented in the appearance size of a tablet computer. The touch screen display is arranged on the front panel of the housing and includes one or more single-point, multi-point and/or simultaneous touches or gestures that can be identified and distinguished on a surface of the touch screen display. Point-touch LCD touch screen. The computer, the ultrasonic beamforming system or the engine and the battery are operatively arranged in the housing. Medical ultrasonic imaging equipment can use a Firewire connection between the computer and the ultrasonic engine operatively connected in the housing and a probe attachment/detachment lever that facilitates the connection of at least one ultrasonic probe/sensor. Head connector. In addition, the exemplary medical ultrasound imaging system includes an I/O port connector and a DC power input.
In an exemplary mode of operation, medical personnel can use simple single-point gestures and/or relatively Complex multi-point gestures are used as user input to the multi-touch LCD touch screen to control the operation mode and/or function of an exemplary medical ultrasound imaging device. These single-point/multi-point gestures can correspond to single-point and/or multi-touch events mapped to one or more predetermined operations that can be performed by a computer and/or an ultrasound engine. Medical personnel can perform these single-point/multi-point gestures through various finger, palm and/or stylus movements on the surface of the touch screen display. The multi-touch LCD touch screen receives single-point/multi-point gestures as user input, and provides these user inputs to a computer, which uses a processor to execute program instructions stored in memory to communicate with these Single-point/multi-point gestures are associated with predetermined operations (at least in some cases combined with ultrasonic engines to perform such operations). These single-point/multi-point gestures on the surface of the touch screen display may include (but are not limited to): one-point selection gesture, one pinch gesture, one swipe gesture, one rotation gesture, one click and two gestures, and one unfolding gesture , A drag gesture, a press gesture, a press and drag gesture, and a palm gesture. In contrast to existing ultrasound systems that rely on many control features operated by mechanical switches, keyboard components or trackball interfaces, the preferred embodiment of the present invention uses a single on/off switch. All other operations have been performed using touchscreen controls. In addition, the preferred embodiment uses a capacitive touch screen display that is sensitive enough to detect touch gestures actuated by the user's bare fingers and the user's gloved fingers. Generally, medical personnel must wear sterile plastic gloves during medical procedures. Therefore, it is highly desirable to provide a portable ultrasound device that can be used by gloved hands; however, this has previously prevented the use of touch screen display control functions in ultrasound systems for many applications requiring sterile precautions. The preferred embodiment of the present invention provides that the gloved person uses programmed touch gestures on the touch screen display to control all ultrasound imaging operations.
According to an exemplary aspect, at least one toggle gesture can be used to control the tissue penetration depth of the ultrasound generated by the ultrasound probe/sensor. For example, a single swipe gesture in the "up" direction on the surface of the touch screen display can increase the penetration depth by one (1) cm or any other suitable amount, and the "down" direction on the surface of the touch screen display A single swipe gesture can reduce the penetration depth by one (1) centimeter or any other suitable amount. In addition, a drag gesture in one of the "up" or "down" directions on the surface of the touch screen display can increase or decrease the penetration depth by a multiple of one (1) centimeter or any other suitable amount. Additional operation modes and/or functions controlled by specific single-point/multi-point gestures on the surface of the touch screen display may include (but are not limited to): freeze/save operation, two-dimensional mode operation, gain control, color control, split Screen control, PW imaging control, movie/time series image editing scroll control, zoom and pan control, full screen control, Doppler and 2D beam steering control and/or body marking control. At least some operation modes and/or functions of the exemplary medical ultrasound imaging device can be controlled by one or more touch controls implemented on the touch screen display, wherein beamforming can be reset by moving touch gestures parameter. The medical staff may provide one or more specific single-point/multi-point gestures as user input for specifying at least a selected subset of touch control items to be implemented on the touch screen display according to requirements and/or needs. When some or more virtual buttons or icons are available, a larger number of touch controls achieve greater functionality when operating in a full-screen mode.
According to another exemplary aspect, a pressing gesture may be used in an area of the touch screen display, and in response to the pressing gesture, a virtual window may be provided on the touch screen display for displaying the touch screen At least one enlarged part of an ultrasound image is displayed on the display. According to yet another exemplary aspect, a pressing and dragging gesture can be used in the area of the touch screen display, and in response to the pressing and dragging gesture, a predetermined feature of the ultrasound image can be tracked. In addition, one-point selection gestures can be used in the area of the touch screen display (substantially at the same time as part of the pressing and dragging gestures), and in response to the click gestures, the tracking of predetermined features of the ultrasound image can be completed. These operations can be performed in different areas with a single display format, so that, for example, a movement gesture in an area of interest in an image can be performed differently from those performed in the image but outside the area of interest. One of the functions of gestures.
By providing medical ultrasound imaging equipment with a multi-touch touch screen, Medical staff can use simple single-point gestures and/or more complex multi-point gestures to control the device without requiring a traditional keyboard or knob. Because the multi-touch touch screen eliminates the need for a traditional keyboard or knob, this medical ultrasonic imaging device is easier to keep clean in the hospital and/or on-site environment, providing an intuitive and user-friendly interface, while providing full Functional operation. In addition, by providing the medical ultrasound imaging device with a tablet computer appearance size, medical personnel can easily transport the device between hospitals and/or on-site locations.
The system is operable to communicate with external and remote devices via a wireless communication network (such as a 3G or 4G wireless cellular network). The system can thus provide voice and data transmission (including via a wireless public access network used for mobile device communication).
Certain exemplary embodiments provide a multi-chip module for an ultrasound engine of a portable medical ultrasound imaging system, including a transmission/reception (TR) chip, and a preamplifier/time gain compensation (TGC) chip And a beamformer chip is assembled into a vertical stack configuration. The transmission circuit provides high-voltage electric driving pulses to the sensor element to generate a transmission beam. When the transmission chip is operated at a voltage greater than 80V, a CMOS process using a 1-micron design rule has been used for the transmission chip and a one-micron design rule has been used for the low-voltage receiving circuit (less than 5V).
The preferred embodiment of the present invention utilizes a single micron processing procedure to provide an integrated circuit with sub-circuits operating at multiple voltages (for example, 2.5V, 5V, and 60V or higher). According to some preferred embodiments of the present invention, these features can be used in conjunction with a dual-plane sensor probe.
Therefore, it is possible to use a single IC chip that combines high-voltage transmission, low-voltage amplifier/TGC, and low-voltage beamforming circuits into a single chip. Using a 0.25 micron design rule, this mixed-signal circuit can be less than 0.7 x 0.7 (0.49) cm<sup>2</sup>Beamforming with 32 sensor channels in one chip area. Therefore, it can be less than 1.5 x 1.5 (2.25) cm<sup>2</sup>One of the total circuit board area uses four 32-channel wafers to handle 128 channels.
As used herein, the term "multi-chip module" refers to an electronic package in which multiple integrated circuits (ICs) are packaged using a unified substrate, thereby facilitating their use as a single component (ie, as a package in a small One of the much higher processing capacity IC). Each IC may include a circuit fabricated in a thinned semiconductor wafer. Exemplary embodiments also provide a portable medical ultrasound imaging system including an ultrasound engine including one or more of these multi-chip modules and a circuit board including an ultrasound engine having one or more multi-chip modules. The exemplary embodiments also provide methods for facilitating and assembling multi-chip modules as taught herein. Stacking TR chips, preamplifier/TGC chips and beamformer chips vertically on a circuit board minimizes the package size (for example, length and width) and the footprint occupied by these chips on the circuit board.
The TR chip, preamp/TGC chip, and beamformer chip in a multi-chip module may each include multiple channels (for example, 8 channels per chip to 64 channels per chip). In some embodiments, the high-voltage TR chip, the preamplifier/TGC chip, and the sample insertion receiving beamformer chip may each include 8, 16, 32, and 64 channels. In a preferred embodiment, each circuit in a two-layer beamformer module has 32 beamformer receiving channels to provide a 64-channel receiving beamformer. A second 64-channel two-layer module can be used to form a 128-channel handheld tablet ultrasonic device with a total thickness of less than 2 cm. It is also possible to use a transmission multi-chip beamformer with the same or similar channel density in each layer.
The exemplary number of chips vertically integrated in a multi-chip module may include (but is not limited to): two, three, four, five, six, seven, eight, and the like. In an embodiment of an ultrasonic device, a single multi-chip module is provided on a circuit board of an ultrasonic engine that performs ultrasonic specific operations. In other embodiments, a plurality of multi-chip modules are provided on a circuit board of an ultrasonic engine. The plurality of multi-chip modules can be vertically stacked on top of each other on the circuit board of the ultrasonic engine to further minimize the package size and occupied area of the circuit board.
Provide one or more multi-chip modules on a circuit board of an ultrasonic engine to achieve a high channel count while minimizing the overall package size and footprint. For example, a multi-chip module can be used to assemble a 128-channel ultrasonic engine circuit board in an exemplary planar size of about 10 cm x about 10 cm, which is a significant improvement over the much larger space requirements of conventional ultrasonic circuits. In some embodiments, a single circuit board including an ultrasonic engine of one or more multi-chip modules may have 16 to 128 channels. In some embodiments, a single circuit board including one or more multi-chip modules and one ultrasonic engine may have 16, 32, 64, 128, or 192 channels and the like.
<p>3Detector head</p><p>5Host computer</p><p>9Remote display and/or recording device</p><p>100Medical ultrasound imaging equipment/equipment/portable ultrasound system/system/ultrasound system</p><p>101Front Panel</p><p>102Shell/Unit</p><p>103rear panel</p><p>104Touch screen display/Split touch screen display/Display/Multi-touch LCD touch screen display</p><p>105surface</p><p>106Computer motherboard/arithmetic circuit</p><p>107Touch Sensor/Sensor</p><p>108Ultrasonic Engine/128 Channel Ultrasonic Engine Circuit Board</p><p>109Touch Processor</p><p>110Battery</p><p>112Communication link/link/high-speed serial interface</p><p>114Probe connector/connector</p><p>115Detector attachment/detachment lever</p><p>116Input/Output (I/O) Port Connector</p><p>118Communication circuit/Subscriber Identity Module (SIM) interface circuit</p><p>119Subscriber Identity Module (SIM) Card Port</p><p>120Subscriber Identification Module (SIM) Card</p><p>140System</p><p>150Sensor housing/probe/ultrasonic probe/sensor/hand-held sensor probe/probe housing</p><p>152Sensor element array/sensor array</p><p>154Detector head recognition circuit</p><p>302Tap gesture</p><p>304Pinch gesture</p><p>306Toggle gesture/dynamic, continuous toggle gesture</p><p>308Rotation gesture</p><p>310Double tap gesture</p><p>312Expanding gesture</p><p>314Toggle gesture/dynamic, continuous toggle gesture</p><p>316Rotation gesture</p><p>318Drag Gesture/Dynamic, Continuous Drag Gesture</p><p>320Press gesture</p><p>322Press and drag gestures</p><p>324Palm Gestures</p><p>340Ultrasonic beamforming and imaging operations</p><p>342Beamforming and image processing operations</p><p>344Select a first display operation</p><p>346Adjust beamforming parameters</p><p>348Update and display the displayed image</p><p>350Perform a different gesture with a different speed characteristic (direction or speed or both) to adjust a second characteristic of the first ultrasonic display operation</p><p>352Update the displayed image</p><p>402subset</p><p>404subset</p><p>406subset</p><p>408Touch control item/2D touch control item</p><p>410Touch control item/Gain touch control item</p><p>412Touch control items/color touch control items</p><p>414Touch Control Item/Save Touch Control Item</p><p>416Touch Control Item/Split Touch Control Item</p><p>418Touch control items/PW imaging touch control items</p><p>420Touch Control Items/Beam Guided Touch Control Items</p><p>422Touch Control Items/Annotation Touch Control Items</p><p>424Touch control items / dynamic range operation touch control items</p><p>426Touch control items/Teravision<sup>TM</sup>Touch control</p><p>428Touch control items / mapping operation touch control items</p><p>430Touch Control Items/Needle Guided Touch Control Items</p><p>502Liver</p><p>504Cystic Lesions/Magnified Cystic Lesions</p><p>506Virtual window</p><p>508Finger</p><p>602Heart</p><p>604Endocardial border</p><p>606Left ventricle</p><p>607Cursor</p><p>608dotted line</p><p>610Finger</p><p>612Finger</p><p>702Liver</p><p>704Cystic lesions</p><p>706Virtual window</p><p>707First cursor</p><p>709Second cursor</p><p>710Finger</p><p>712Finger</p><p>802Liver</p><p>804Cystic lesions</p><p>806Virtual window</p><p>807First cursor/cursor</p><p>809Second cursor</p><p>810Finger</p><p>811Connecting line</p><p>812Finger</p><p>900Software flowchart</p><p>904Step</p><p>906Step</p><p>908Step</p><p>910Step</p><p>Step 912</p><p>914Step</p><p>916Step</p><p>918Step</p><p>920Step</p><p>921Step</p><p>922Step</p><p>924Step</p><p>926step</p><p>928Step</p><p>930Step</p><p>932Step</p><p>934step</p><p>936step</p><p>938Step</p><p>940step</p><p>942Step</p><p>944Step</p><p>946Step</p><p>948Step</p><p>950step</p><p>952Time integration of spectral Doppler average velocity/Handheld handheld personal computer</p><p>956Needle</p><p>958System</p><p>960Ultrasonic sensor element/sensor element</p><p>962Needle guide</p><p>964Ultrasonic reflector disk/reflector disk</p><p>966Needle guide mounting bracket</p><p>970Ultrasonic imaging probe assembly</p><p>972Ultrasound</p><p>974Reflected ultrasound</p><p>976Distance</p><p>978Linear ultrasonic sound array/Ultrasonic imaging probe assembly for imaging</p><p>980Ultrasonic sensor array/sensor element</p><p>982Ultrasonic imaging probe assembly/ultrasonic imaging probe assembly for imaging the patients body</p><p>984Ultrasonic sensor array</p><p>986System</p><p>1010Personal Computer (PC)/Host Computer</p><p>1012USB connection/custom or USB3 chipset</p><p>1014Microprocessor</p><p>1020Interface unit/Two-stage beamforming system/Interface circuit</p><p>1022USB connection/customized USB3 chipset/USB3 chipset/customized or USB3 chipset</p><p>1024System Controller</p><p>1025Connector</p><p>1026Field Programmable Gate Array/Field Programmable Gate Array (FPGA) Digital Beamforming/Communication Port</p><p>1027Connector</p><p>1028A/D converter</p><p>1030A/D converter</p><p>1032Memory</p><p>1034DC-DC converter</p><p>1040Integrated ultrasonic probe/ultrasonic probe/sensor/two-stage beamforming system</p><p>1042Power Supply</p><p>1044controller</p><p>1046Memory</p><p>1048Multiplexer 1</p><p>1050Transfer Drive 1</p><p>1052Sub-array/aperture/sub-array beamformer 1</p><p>1054Transmission drive m</p><p>1056Multiplexer m</p><p>1058Memory</p><p>1060Sub-array beamformer n</p><p>10621D sensor array</p><p>1064Image target</p><p>1066Cable</p><p>1068Cable</p><p>1075device</p><p>1082Host computer</p><p>1102Image target</p><p>1104Cable</p><p>1106High voltage transmission/reception (TR) module/transmission/reception (TR) module</p><p>1108Preamplifier/Time Gain Compensation (TGC) Module</p><p>1110Sampling data beamformer/sample interpolation using beamformer/beamformer</p><p>1112First-in-first-out (FIFO) buffer module</p><p>1114Memory</p><p>1116System Controller/Beamformer Control Processor</p><p>1118Communication Chipset</p><p>1120Communication Chipset</p><p>1122Core computer readable memory/memory</p><p>1124Microprocessor/beamformer control processor</p><p>1126Display Controller</p><p>1200Circuit board</p><p>1202HDI substrate/substrate</p><p>1204First Integrated Circuit Chip</p><p>1206The first compartment</p><p>1208Second Integrated Circuit Chip</p><p>1210Metal frame</p><p>1212Wiring</p><p>1214Wiring</p><p>1216Package</p><p>1302Step</p><p>1304Step</p><p>1306Step</p><p>1308Step</p><p>1310Step</p><p>1312Step</p><p>1600Multi-chip module</p><p>1602Transmit/Receive (TR) chip/chip</p><p>1604Amplifier chip/chip</p><p>1606Beamformer chip/chip</p><p>1608The first compartment</p><p>1610Second compartment</p><p>1612Metal frame</p><p>1614Substrate</p><p>1702Wireless Network Adapter/Adapter</p><p>1704Input/Output (I/O) and Graphics Chipset</p><p>1706serial or parallel interface</p><p>1708Power Module</p><p>1710The first multi-chip module/multi-chip module</p><p>1712The second multi-chip module/multi-chip module</p><p>1714Clock generates complex programmable logic device (CPLD)</p><p>1718Delay profile and waveform generator field programmable gate array (FPGA)</p><p>1720Memory</p><p>1722Scan sequence control field programmable gate array (FPGA)</p><p>1724Power Module</p><p>1802Touch Pen</p><p>1804Shell connector</p><p>1806Flexible cable</p><p>1900Main Graphical User Interface (GUI)</p><p>1902Function list</p><p>1904Image display window</p><p>1906Video control bar</p><p>1908Toolbar</p><p>2000Medical ultrasonic imaging equipment/ultrasonic imaging equipment/devices</p><p>2010Touch screen display/ultrasound imaging</p><p>2020Ultrasonic control items</p><p>2030Shell</p><p>2040Ultrasonic data</p><p>2060Front Panel</p><p>2070rear panel</p><p>2080Subscriber Identity Module (SIM) Card Port</p><p>2082Subscriber Identity Module (SIM) Card Tray</p><p>2084Subscriber Identity Module (SIM) Card</p><p>2100Trolley System/Trolley Configuration</p><p>2102Touch screen display</p><p>2104Tablet PC</p><p>2106Adjustable height device</p><p>2108Trolley/Trolley Bracket</p><p>2110Gel holder</p><p>2112Keyboard</p><p>2114Storage Box</p><p>2120Heat Probe Holder</p><p>2122Base assembly</p><p>2124Complete operator console/operator console</p><p>2200Trolley System/Trolley Assembly</p><p>2210 Holder</p><p>2212Vertical support component/support beam/beam</p><p>2214Console Panel</p><p>2216Multi-port probe multiplexer device/multiplexer device</p><p>2218 Holder</p><p>2222Storage box attachment mechanism</p><p>2224Storage Box/Accessory Holder</p><p>2226rope management system/height adjustment device</p><p>2228Base</p><p>2230Battery</p><p>2232Wheels</p><p>2300Configuration</p><p>2302Tablet PC/System</p><p>2304Connecting station/substrate connecting unit/substrate unit/connecting component</p><p>2305Electrical connector</p><p>2306Attaching mechanism/mounting seat assembly</p><p>2307Port</p><p>2308Hinged parts</p><p>2310Bracket</p><p>2312Vertical Parts/Beams</p><p>2400Trolley System/Configuration</p><p>2402Tablet PC</p><p>2404Connector/attachment mechanism</p><p>2406Installation Assembly/Hinge Parts</p><p>2408Vertical support parts</p><p>2502Connecting station</p><p>2504Tablet PC</p><p>2506Base assembly</p><p>2508Release mechanism</p><p>2510Sensor Probe/Sensor Probe Connector</p><p>2512Sensor port</p><p>2526Adjustable bracket/grip</p><p>2600Integrated Probe System/Integrated Ultrasonic Probe System/System</p><p>2602Front-end probe/probe</p><p>2604Host computer/Windows®-based host computer</p><p>2606Personal Digital Assistant (PDA)/Remote Display and/or Recording Device/Remote Device/Computer (Remote Device)</p><p>2608Communication link/communication link or interface</p><p>2610Communication link or interface/wireless link/communication link/wireless communication link</p><p>2612Remote Computing System</p><p>2802 Hub</p><p>2804Communication link</p><p>2906imaging system</p><p>2910Wireless proxy</p><p>2912Wireless Viewer/Viewer</p><p>3020Video Viewer</p><p>3024User Interface Button</p><p>3026User Interface Button</p><p>3028User Interface Button</p><p>3030Viewer</p><p>3142a to 3142nUltrasonic probe</p><p>3144a to 3144nlaptop</p><p>3146Image/Patient Information Dissemination Server</p><p>3148Structured Query Language (SQL) database server</p><p>3152Handheld equipment or other computing devices</p><p>3264Personal Digital Assistant (PDA)</p><p>3266Wireless communication link</p><p>3304Memory</p><p>3306Data Storage</p><p>3308Bus</p><p>3310Link interface or data interface circuit/data interface circuit</p><p>3312First connection</p><p>3314Radio Frequency (RF) Circuit/Radio Interface</p><p>3316Radio interface</p><p>3350Radio Frequency (RF) Stack</p><p>3370User Interface Circuit</p><p>3440Schematic</p><p>3446 Clinic</p><p>3448 Clinic</p><p>3450 Clinic</p><p>3502Two-dimensional image window</p><p>3504Two-dimensional image scanning</p><p>3506Flexible frequency sweep</p><p>3600Touch Screen Display for Tablet PC</p><p>3604Two-dimensional image window</p><p>3606Two-dimensional imaging / two-dimensional imaging</p><p>3608Motion mode imaging</p><p>3700Touch Screen Display for Tablet PC/Tablet PC Monitor</p><p>3702Color Doppler scan information</p><p>3704Flexible frequency control item</p><p>3706Two-dimensional image window</p><p>3708Color coding information</p><p>3710Two-dimensional image</p><p>3800Touch Screen Display for Tablet PC/Tablet PC Monitor</p><p>3802Two-dimensional image</p><p>3804Adjustable frequency control item</p><p>3806Mixed operation mode</p><p>3808Shades of Gray</p><p>3810Time/Doppler shift</p><p>3812Sample volume or sample gate</p><p>3900Touch Screen Display for Tablet PC/Tablet PC Monitor</p><p>3902Two-dimensional window</p><p>3904Color coding information</p><p>3906Overlay/Color Code Overlay</p><p>3908Sample Volume/Sample Gate</p><p>3910Flexible frequency control item</p><p>3912Time/Doppler shift</p><p>3916Two-dimensional image</p><p>4000Graphical User Interface (GUI) Main Screen Interface/Screen Interface for User Operation Mode/Graphical User Interface (GUI) Main Screen /Main Graphical User Interface (GUI) main screen</p><p>4002Image display window</p><p>4004Function list</p><p>4006Video control bar</p><p>4008Depth control touch control items</p><p>4010Two-dimensional gain touch control item</p><p>4012Full screen touch control</p><p>4014Text touch control</p><p>4016Split screen touch control</p><p>4018ENV touch control item</p><p>4022Pulse Wave Doppler (PWD) Touch Control</p><p>4024Freeze touch controls</p><p>4026Store touch control items</p><p>4028Optimized touch control items</p><p>4100Graphical User Interface (GUI) Menu Screen Interface/Screen Interface for User Operation Mode/Graphical User Interface (GUI) Main Screen/Main Graphical User Interface (GUI) Menu Screen</p><p>4102Image display window</p><p>4104Function list</p><p>4108Patient touch control items</p><p>4110Default touch control items</p><p>4112View touch controls</p><p>4114Report touch control</p><p>4116Set touch control items</p><p>4120Video control bar</p><p>4122Depth control touch control items</p><p>4124Two-dimensional gain touch control</p><p>4126Full screen touch control</p><p>4128Text touch control</p><p>4130Split screen touch control</p><p>4132Needle visualization ENV touch control</p><p>4136Pulse Wave Doppler (PWD) Touch Control</p><p>4138Freeze touch controls</p><p>4140Store touch control items</p><p>4142Optimized touch control items</p><p>4200Graphical User Interface (GUI) Patient Data Screen/Screen Interface for User Operation Mode/Graphical User Interface (GUI) Patient Data Screen/Patient Data Screen</p><p>4202Function list</p><p>4204New patient touch screen controls</p><p>4206New research on touch screen controls</p><p>4208Research List Touch Screen Control</p><p>4210Work list touch screen control</p><p>4212Edit touch screen controls</p><p>4214Patient Information Section</p><p>4216Research Information Section</p><p>4218Video control bar</p><p>4220Accepted research touch control items</p><p>4222Closely study touch control items</p><p>4224Printing touch controls</p><p>4226Print preview touch control</p><p>4228Eliminate touch controls</p><p>4230Two-dimensional touch control items</p><p>4232Freeze touch control items</p><p>4234Save touch control items</p><p>4300Graphical User Interface (GUI) Patient Data Screen Interface/Screen Interface for User Operation Mode/Default Screen</p><p>4302Function list</p><p>4304Preset selection mode</p><p>4308Video control bar</p><p>4310Save setting touch control items</p><p>4312Delete touch control items</p><p>4314Color Doppler (CD) touch control</p><p>4316Pulse Wave Doppler (PWD) Touch Control</p><p>4318Freeze touch controls</p><p>4320Store touch control items</p><p>4322Optimized touch control items</p><p>4400Graphical user interface (GUI) view screen interface/screen interface for user operation mode/view screen</p><p>4402Function list</p><p>4404Default extended view</p><p>4406Image display window</p><p>4408Image</p><p>4410Image</p><p>4412Image</p><p>4414Image</p><p>4416Video control bar</p><p>4418Thumbnail setting touch control items</p><p>4420Synchronous touch control items</p><p>4422Select touch control</p><p>4424Previous image touch control</p><p>4426Next image touch control</p><p>4428Two-dimensional image touch control</p><p>4430Pause video touch control</p><p>4432Save image touch control</p><p>4500Screen interface/report screen for user operation mode</p><p>4502Function list</p><p>4504Extended view of report</p><p>4506Display screen</p><p>4508Video control bar</p><p>4510Save touch control items</p><p>4512Save as touch control</p><p>4514Printing touch controls</p><p>4516Print Preview Touch Control</p><p>4518Closely study touch controls</p><p>4520Two-dimensional image touch control</p><p>4522Freeze image touch control</p><p>4524Save image touch control</p><p>4600Screen interface/view screen for user operation mode</p><p>4602Function list</p><p>4604Exam application extended view/set extended screen</p><p>4606Universal touch control items</p><p>4608Display touch control items</p><p>4610Measurement touch control items</p><p>4612Annotation touch control items</p><p>4614Printing touch controls</p><p>4616Save/Get Touch Control Items</p><p>4618Digital Imaging and Communication in Medicine (DICOM) Touch Control</p><p>4620Export touch control items</p><p>4622Research information and image touch control items</p><p>4624Configuration screen</p><p>4626Soft key connection position</p><p>4628Video control bar</p><p>4630Thumbnail setting touch control items</p><p>4632Synchronous touch control items</p><p>4634Select touch control</p><p>4636Previous image touch control</p><p>4638Next image touch control</p><p>4640Two-dimensional image touch control</p><p>4642Pause video touch control</p><p>4644Setting the control bar</p><p>4650Soft key control arrow</p><p>4652Soft key control items</p><p>4662Soft key control items</p><p>4700Screen interface/setting screen for user operation mode</p><p>4702Function list/configuration screen</p><p>4704Report extended view/setting extended screen/retroactive access</p><p>4706Universal touch control items</p><p>4708Display touch control items</p><p>4710Measurement touch control items</p><p>4712Annotation touch control items</p><p>4714Printing touch controls</p><p>4716Save/Get touch control items</p><p>4718Digital Imaging and Communication in Medicine (DICOM) Touch Control</p><p>4720Export touch control items</p><p>4722Research information and image touch control items</p><p>4728Video control bar</p><p>4730Thumbnail setting touch control items</p><p>4732Synchronous touch control items</p><p>4734Select touch control</p><p>4736Previous image touch control</p><p>4738Next image touch control</p><p>4740Two-dimensional image touch control</p><p>4742Pause video touch control</p><p>4744Setting the control bar</p><p>4880Physical shared memory</p><p>4882Shared memory header structure</p><p>4884Header array</p><p>4886Memory segment</p><p>4888Mutual exclusion of physical systems</p><p>4890System Event</p><p>4908Object transfer interface</p><p>4916Object Factory interface</p><p>5170Main screen</p><p>5172Function list</p><p>5174Image display window</p><p>5176Video control bar</p><p>5178Toolbar</p><p>5180Toolbar</p><p>5182Toolbar</p><p>5184Toolbar</p><p>5186Toolbar</p><p>5202Nested Level File Directory</p><p>5400Configuration</p><p>5402y direction/y axis/y plane</p><p>5404x direction/x axis/x plane</p><p>5406z axis/z plane</p><p>5408Polarization axis</p><p>5410Elevation axis</p><p>5412Configuration</p><p>5414Ultrasound imaging</p><p>5420Elevation axis</p><p>5422Polarization axis</p><p>5424Ultrasound imaging</p><p>5502Top Array</p><p>5504Bottom array</p><p>5506High voltage drive pulse</p><p>5508High voltage drive pulse</p><p>5510High voltage drive pulse</p><p>5512Array</p><p>5602High voltage pulse</p><p>5604High voltage pulse</p><p>5606High voltage pulse</p><p>5610Array</p><p>5612Top Array</p><p>5614Bottom array</p><p>5704Select bottom array</p><p>5708Select the top array</p><p>5710High Voltage Driver</p><p>5712High Voltage Driver</p><p>5802Apical two-chamber image</p><p>5804Apical four-chamber image</p><p>5902Image / Apex 2CH view</p><p>5904Image/Apial 4CH view</p><p>6002Step</p><p>6003Step</p><p>6004Step</p><p>6005Step</p><p>6006Step</p><p>6007Step</p><p>6008Step</p><p>6009Step</p><p>6010Step</p><p>A,aMethod</p><p>B,bMethod</p><p>C,cMethod</p><p>D, dMethod</p>
The foregoing description and other objectives, aspects, features, and advantages of the exemplary embodiment will be more understood and better understood by referring to the following description in conjunction with the accompanying drawings. Among them: FIG. 1 is an exemplary embodiment according to the present invention. A plan view of an exemplary medical ultrasound imaging device; Figures 2A and 2B are side views of a medical ultrasound imaging system according to a preferred embodiment of the present invention; Using exemplary single-point and multi-point gestures as user input to the medical ultrasound imaging system; FIG. 3B shows a flowchart of a processing procedure for operating a tablet ultrasound system according to a preferred embodiment of the present invention; 3C to 3K show the details of the touch screen gestures for adjusting beamforming and display operations; FIGS. 4A to 4C show the touch control items that can be implemented on the medical ultrasound imaging system according to a preferred embodiment of the present invention Exemplary subset; Figures 5A and 5B are exemplary representations of a liver with a cystic lesion on a touch screen display of a medical ultrasound imaging system according to a preferred embodiment of the present invention; Figures 5C and Figures 5D is the liver and cystic disease on the touch screen display of Fig. 5A and Fig. 5B An exemplary representation of the change, including a virtual window corresponding to an enlarged part of the liver; Fig. 6A is an exemplary view of a heart, an apex, and four (4) chambers on the touch screen display of a medical ultrasound imaging system Figures 6B to 6E show an exemplary manual tracking of one of the left ventricle and one of the endocardial border of the heart on the touch screen display of Figure 6A; Figures 7A to 7C show the virtual windows of Figures 5C and 5D An exemplary measurement of the size of the cystic lesions on the liver within; Figure 8A to Figure 8C show an exemplary caliper measurement of the cystic lesions on the liver within the virtual window of Figure 5C and Figure 5D; Figure 9A Shows one of a plurality of sensor arrays attached to the processor housing; FIG. 9B shows a software flowchart of a sensor management module in an ultrasonic application according to an exemplary embodiment; FIG. 9C shows information about A perspective view of a needle-sensing positioning system of an exemplary embodiment; FIG. 9D shows a perspective view of a needle guide of an exemplary embodiment; FIG. 9E shows a perspective view of a needle-sensing positioning system of an exemplary embodiment A perspective view; Figure 9F shows an exemplary system configured to receive a Subscriber Identity Module (SIM) card for wireless communication; Figure 10A shows an exemplary method of measuring heart wall motion; Figure 10B shows A schematic block diagram of an integrated ultrasonic probe for one of the exemplary embodiments; FIG. 10C shows an alternative schematic block diagram of an integrated ultrasonic probe for one of the exemplary embodiments; FIG. 11 is an ultrasonic engine (ie A detailed schematic block diagram of an exemplary embodiment of a computer motherboard (ie, a host computer) of an exemplary ultrasonic device and an exemplary embodiment of a front-end ultrasonic specific circuit); Configure a circuit of a multi-chip module A schematic side view of a board; FIG. 13 is a flowchart of an exemplary method for manufacturing a circuit board including a multi-chip module assembled into a vertical stack configuration; FIG. 14A includes four vertically stacked chips A schematic side view of a multi-chip module with one chip, in which the chips are separated from each other by a passivation silicon layer with a 2-in-1 dicing die attach film (D-DAF); FIG. 14B includes four A schematic side view of one of a multi-chip module of one vertically stacked die, where the die are spaced apart from each other by a DA film-based adhesive as a die-to-die spacer; FIG. 14C includes four A schematic side view of one of a multi-chip module with vertically stacked dies, where the dies are spaced apart from each other by DA paste or film-based adhesives as die-to-die spacers; Figure 15 Use (a) a passivation silicon layer with a 2-in-1 dicing die attach film (D-DAF), (b) DA paste, (c) a thick DA film, and (d) a 2-in-1 D-DAF A flow chart of another exemplary method of die-to-die stacking of film-covered wire (FOW); FIG. 16 includes an ultrasonic transmission/reception IC chip, an amplifier IC chip, and an amplifier IC chip that are vertically integrated into a vertical stack configuration. A schematic side view of a multi-chip module of an ultrasonic beamformer IC chip; FIG. 17 is an exemplary embodiment of an ultrasonic engine (ie, a front-end ultrasonic specific circuit) and is provided as a single-board complete ultrasonic system A detailed schematic block diagram of an exemplary embodiment of a computer motherboard (ie, a host computer); FIG. 18 is a perspective view of an exemplary portable ultrasound system according to an exemplary embodiment; FIG. 19 is a drawing An exemplary view of a main graphical user interface (GUI) on a touch screen display of an exemplary portable ultrasound system shown in FIG. 18; FIG. 20A is an exemplary view according to another preferred embodiment of the present invention Medical ultrasound imaging system A top view; FIG. 20B is a top view of a medical ultrasound imaging system configured to receive a wireless SIM card according to another embodiment of the present invention; FIG. 21 shows a flat panel according to a preferred embodiment of the present invention A preferred cart system for a computerized ultrasound system; FIG. 22 illustrates a preferred cart system for a modularized ultrasound imaging system according to a preferred embodiment of the present invention; FIG. 23A illustrates a preferred cart system according to the present invention The preferred embodiment of the preferred cart system for a modular ultrasonic imaging system; Figure 23B shows a module configured to receive a wireless SIM card according to another embodiment of the present invention An alternative to cart system for ultrasonic imaging system; Figure 24 shows a preferred cart system for a modularized ultrasound imaging system according to a preferred embodiment of the present invention; Figures 25A to 25B show a flat panel A multifunctional interface substrate for a computer ultrasonic device; FIG. 26A shows an integrated probe system configured according to an embodiment of the present invention; FIG. 26B shows a connection between the probe and the host computer according to an embodiment of the present invention Figure 26C shows a wireless ultrasound system according to an embodiment of the present invention; Figure 27 shows an alternative wireless ultrasound system according to an embodiment of the present invention; Figure 28 shows a wireless ultrasound system according to an embodiment of the present invention Another embodiment configures an alternative integrated probe system; Figure 29 shows the deployment of wireless access to images generated by an ultrasound imaging system according to an embodiment of the present invention; Figure 30 shows An image viewer that communicates with a personal computer according to an embodiment of the present invention; Figure 31 shows an exemplary ultrasound image collection and distribution system; Figure 32 shows an ultrasound imaging system with a wireless communication link between the remote computing device and the probe according to an embodiment of the present invention; 33 shows a data processing and storage system for wireless operation; FIG. 34 shows a schematic diagram of an imaging and telemedicine system integrating an ultrasound system according to an embodiment of the present invention; FIG. 35 shows a schematic diagram of an imaging and telemedicine system according to an embodiment of the present invention An embodiment of a 2D imaging operation mode using a modularized ultrasound imaging system; FIG. 36 illustrates a movement operation mode of using a modularized ultrasound imaging system according to an embodiment of the present invention; FIG. 37 illustrates A color Doppler mode of operation using a modularized ultrasound imaging system according to an embodiment of the present invention; FIG. 38 shows an operation mode of using a modularized ultrasound imaging system according to an embodiment of the present invention A pulse-wave Doppler operation mode; FIG. 39 shows a triple scan operation mode using a modular ultrasound imaging system according to an embodiment of the present invention; FIG. 40 shows one according to the present invention An embodiment of a GUI home screen interface for using a user operation mode of a modular ultrasonic imaging system; FIG. 41 shows another embodiment of the present invention for using a module A GUI function table screen interface of a user operation mode of an ultrasonic imaging system; FIG. 42 shows a GUI patient in a user operation mode for using a modular ultrasonic imaging system according to an embodiment of the present invention Data screen interface; FIG. 43 shows a GUI default screen interface for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention; FIG. 44 shows an implementation according to the present invention For example, it is used to use a modular ultrasonic A GUI view screen interface in a user operation mode of the imaging system; FIG. 45 illustrates a GUI report screen interface in a user operation mode in a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention; FIGS. 46A to 46C illustrate a GUI setting display interface for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention; FIG. 47 illustrates an embodiment according to the present invention It is used to use a GUI setting storage/acquisition screen interface in a user operation mode of a modular ultrasonic imaging system; FIG. 48 shows a block diagram of the structure of a physical shared memory according to an embodiment of the present invention Fig. 49 shows a shared memory system that enables communication between ultrasonic and non-ultrasonic operations; Fig. 50 is a view of a graphical user interface configured according to an embodiment of the present invention; Fig. 51 shows the basis A main screen display of a graphical user interface according to an embodiment of the present invention; FIGS. 52A to 52C show an alternate display of a graphical user interface according to another embodiment of the present invention; FIGS. 53A to 53B illustrate A patient folder and an image folder of a graphical user interface according to an embodiment of the present invention; FIGS. 54A to 54C show a preferred embodiment of the present invention including two one-dimensional, ID multi-element arrays XY dual-plane probe; Figure 55 illustrates the operation of a dual-plane image forming xy probe according to an embodiment of the present invention; Figure 56 illustrates a dual-plane image forming xy probe according to another embodiment of the present invention Operation of the head; Figure 57 shows a dual-plane image forming xy probe according to an embodiment of the present invention A high-voltage driving circuit; FIGS. 58A to 58B show the simultaneous biplanar evaluation of the left ventricular condition according to an embodiment of the present invention; and FIGS. 59A to 59B show the ejection according to a preferred embodiment of the present invention Fractional probe measurement technology; FIG. 60 shows an exemplary method for wirelessly transmitting data to and from a portable ultrasonic imaging device according to an embodiment of the present invention .
The present invention discloses a system and method for medical ultrasound imaging. The currently disclosed medical ultrasound imaging system and method use a medical ultrasound imaging device, which includes a housing in the size of a tablet computer and a touch screen display arranged on a front panel of the housing . The touch screen display includes a multi-touch touch screen that can identify and distinguish one or more single points, multi-points, and points on a surface of the touch screen display. / Or simultaneous touch, thereby allowing the use of gestures (ranging from simple single-point gestures to complex multi-point movement gestures) as user input to medical ultrasound imaging equipment. Further details on the tablet ultrasound system and operation are described in U.S. Application No. 10/997,062 filed on November 11, 2004, U.S. Application No. 10/386,360 filed on March 11, 2003, and U.S. Patent No. In No. 6,969,352, the entire contents of these patents and applications are incorporated herein by reference.
FIG. 1 depicts an illustrative embodiment of an exemplary medical ultrasound imaging apparatus 100 according to the present invention. As shown in FIG. 1, the medical ultrasound imaging device 100 includes a housing 102, a touch screen display 104, and a computer (which has at least one processor and at least one memory implemented on a computer motherboard 106) , An ultrasonic engine 108 and a battery 110. For example, the housing 102 can be implemented in a tablet computer appearance size or any other suitable appearance size. The housing 102 has a front panel 101 and a rear panel 103. The touch screen The screen display 104 is arranged on the front panel 101 of the housing 102, and includes one of one or more multi-point and/or simultaneous touches that can be identified and distinguished on a surface 105 of the touch screen display 104 Multi-touch LCD touch screen. The computer motherboard 106, the ultrasonic engine 108 and the battery 110 are operatively disposed in the housing 102. The medical ultrasonic imaging device 100 further includes a Firewire connection 112 (see also FIG. 2A) between the computer motherboard 106 and the ultrasonic engine 108 operatively connected in the housing 102, and a device that facilitates at least one ultrasonic probe/sensor A probe connector 114 is connected to a probe attachment/detachment lever 115 (see also FIG. 2A and FIG. 2B). In some preferred embodiments, the sensor probe housing may include circuit components including a sensor array, transmission and reception circuits, and beamformer and beamformer control circuits. In addition, the medical ultrasound imaging device 100 has one or more I/O port connectors 116 (see FIG. 2A). The I/O port connectors 116 may include (but are not limited to): one or more USB connectors, One or more SD cards, one or more network ports, one or more small display ports and a DC power input.
In an exemplary mode of operation, medical personnel (herein also referred to as "users" or "users") can use simple single-point gestures and/or more complex multi-point gestures as a connection to the touch screen display 104 The user input of the multi-touch LCD touch screen is used to control one or more operation modes and/or functions of the medical ultrasound imaging device 100. This gesture is defined herein as a movement, a tap, or a position of at least one finger, a stylus pen, and/or a palm on the surface 105 of the touch screen display 104. For example, such single-point/multi-point gestures may include static or dynamic gestures, continuous or segmented gestures, and/or any other suitable gestures. A single-point gesture is defined herein as a gesture that can be performed using a single touch point on the touch screen display 104 by a single finger, a stylus, or a palm. A multi-point gesture is defined herein as a gesture that can be performed using multiple touch contact points on the touch screen display 104 by any suitable combination of multiple fingers or at least one finger, a stylus, and a palm. A gesture. A static gesture is defined herein as not involving at least one finger, a stylus or a palm on the surface 105 of the touch screen display 104 One of the gestures on the move. A dynamic gesture is defined herein as a gesture involving the movement of at least one finger, a stylus, or a palm (such as movement caused by dragging one or more fingers across the surface 105 of the touch screen display 104). A continuous gesture is defined herein as a gesture that can be performed in a single movement or tapping of at least one finger, a stylus or a palm on the surface 105 of the touch screen display 104. A segmented gesture is defined herein as a gesture that can be performed in multiple movements or taps of at least one finger, a stylus or a palm on the surface 105 of the touch screen display 104.
These single-point/multi-point gestures performed on the surface 105 of the touch screen display 104 can correspond to single-point or multi-point touch events, and these touch events can be mapped to a computer and/or ultrasonic engine 108 Perform one or more predetermined operations. The user can perform these single-point/multi-point gestures by various single-finger, multi-finger, stylus, and/or palm movements on the surface 105 of the touch screen display 104. The multi-touch LCD touch screen receives single-point/multi-point gestures as user input, and provides these user inputs to the processor, which executes the program instructions stored in the memory to communicate with the single-point/multi-point gestures. Predetermined operations associated with point/multipoint gestures (at least in some cases combined with the ultrasound engine 108 to perform such operations). As shown in FIG. 3A, these single-point/multi-point gestures on the surface 105 of the touch screen display 104 may include (but are not limited to): one-point selection gesture 302, a pinch gesture 304, and a swipe gesture 306, 314 , A rotation gesture 308, 316, a one-click gesture 310, an expand gesture 312, a drag gesture 318, a press gesture 320, a press and drag gesture 322, and/or a palm gesture 324. For example, these single-point/multi-point gestures can be stored in at least one gesture library implemented in the memory on the computer motherboard 106. A computer program operable to control the operation of the system can be stored on a computer-readable medium and can be implemented using a touch processor connected to an image processor and a control processor connected to the system beamformer as needed. Therefore, the beamformer delay associated with transmission and reception can be adjusted in response to both static touch gestures and mobile touch gestures.
According to the illustrative embodiment of FIG. 1, a user of the medical ultrasonic imaging device 100 At least one toggle gesture 306 or 314 can be used to control the tissue penetration depth of the ultrasound generated by the ultrasound probe/sensor. For example, a dynamic, continuous flicking gesture 306 or 314 in the "up" direction or any other suitable direction on the surface 105 of the touch screen display 104 can increase the penetration depth by one (1) centimeter or any other suitable amount. In addition, a dynamic, continuous flicking gesture 306 or 314 in the "down" direction or any other suitable direction on the surface 105 of the touch screen display 104 can reduce the penetration depth by one (1) cm or any other suitable amount . In addition, a dynamic, continuous drag gesture 318 in the "up" or "down" direction or any other suitable direction on the surface 105 of the touch screen display 104 can increase or decrease the penetration depth by multiple centimeters or any other combination. Right amount.
Additional operation modes and/or functions controlled by specific single-point/multi-point gestures on the surface 105 of the touch screen display 104 may include (but are not limited to): freeze/save operation, two-dimensional mode operation, gain control, color Control, split screen control, PW imaging control, movie/time series image editing scroll control, zoom and pan control, full screen control, Doppler and 2D beam steering control and/or body marking control. At least some operation modes and/or functions of the medical ultrasound imaging apparatus 100 can be controlled by one or more touch control items implemented on the touch screen display 104. In addition, the user can provide one or more specific single-point/multi-point gestures as user input for specifying at least one selection of touch control items to be implemented on the touch screen display 104 according to requirements and/or needs Subset. A plurality of preset scanning parameters displayed as icons or selectable from a function table are associated with each imaging mode so that the scanning parameters are automatically selected for the mode.
FIG. 3B shows a processing sequence in which the ultrasonic beamforming and imaging operations 340 are controlled in response to touch gestures input on a touch screen. Various static and mobile touch gestures have been programmed into the system so that the data processor can operate to control the beamforming and image processing operations 342 in the tablet computer device. A user can select 344 a first display operation, the first display operation having a first plurality of touch gestures associated therewith. Using a static or moving gesture, the user can perform multiple operations that can be manipulated to control imaging operations One of the gestures and one of a plurality of gestures that can adjust the beamforming parameters 346 used to generate the image data associated with the first display operation can be specifically selected. The displayed image is updated and displayed 348 in response to the updated beamforming process. The user can further choose to perform a different gesture with a different speed characteristic (direction or velocity or both) to adjust 350 a second characteristic of the first ultrasonic display operation. Then, the displayed image is updated 352 based on the second gesture, which can modify the imaging processing parameters or beamforming parameters. An example of this processing procedure is described in further detail herein, where the changes in speed and direction of different gestures can be associated with different imaging parameters of a selected display operation.
Ultrasound images of blood flow or tissue movement (no matter color blood flow or spectral Doppler) are basically obtained from the measurement of movement. In an ultrasound scanner, a series of pulses are transmitted to detect the movement of blood. The echo from a fixed target is the same between pulses. The echo from the moving scatterer shows a slight difference in the time it takes for the signal to return to the scanner.
As can be seen from Figures 3C to 3H, there must be movement in the direction of the beam; if the blood flow is perpendicular to the beam, no relative movement from pulse to pulse is received, and no blood flow is detected. These differences can be measured as a direct time difference, or more generally, they can be measured in terms of a phase shift from which the "Doppler frequency" is obtained. Then, the differences are processed to produce a color blood flow display or a Doppler sonogram. In FIGS. 3C to 3D, the blood flow direction is perpendicular to the beam direction, and the pulse wave spectrum Doppler does not measure any blood flow. In FIGS. 3G to 3H, when the ultrasonic beam is directed to an angle that is better aligned to the blood flow, a weak blood flow is shown in the color blood flow image, and the blood flow is measured by pulse wave Doppler. In Figure 3H, when the ultrasound beam is directed to an angle that is better aligned to respond to a moving blood flow direction, the color blood flow image is stronger, and when the correction angle of the PWD is placed to be aligned to the blood flow At that time, PWD measured a strong blood flow.
In this tablet ultrasound system, an ROI (Region of Interest) is also used to define the direction in response to a movement gesture of the ultrasound transmission beam. Figure 3I shows a liver image with a branch of the renal blood flow in the color blood flow mode, because the ROI is from the sensor pen Straight down, the blood flow direction is almost normal to the ultrasound beam, so very weak renal blood flow is detected. Therefore, the color flow mode is used to image the blood flow in one of the kidneys in the liver. As can be seen, the beam is almost normal to the blood flow and very weak blood flow is detected. One of the finger gestures outside the ROI is used to steer the beam. As can be seen in FIG. 3J, by resetting the beamforming parameters to steer the ROI so that the beam direction is more aligned with the blood flow direction, a stronger blood flow in the ROI is detected. In FIG. 3J, one of the finger gestures outside the ROI is used to steer the ultrasound beam to a direction that is more aligned with the direction of blood flow. It can be seen that there is a stronger blood flow in the ROI. A gesture of moving the finger horizontally within the ROI will move the ROI frame to a position that overlaps the entire kidney area, that is, the horizontal movement allows one of the ROI frames to move in translation so that the frame overlaps the entire target area.
Figure 3K demonstrates a horizontal movement gesture. When the finger is in the ROI, the finger can move the ROI frame to any place in the image plane. In the above embodiment, it is easy to distinguish: one of the fingers outside of an "ROI" frame and one of the "swipe" gestures are intended to be used to guide a beam and one of the fingers is inside the "ROI", one of the "drag and The "move, that is, move horizontally" gesture is intended to be used to move the ROI frame. However, there are applications where there is no ROI as a reference area, it is obvious that it will be difficult to distinguish a "swipe" or a "horizontal movement" gesture. In this case, the touch screen program needs to track the initial speed or acceleration of the finger To determine whether the gesture is a "swipe" gesture or a "drag and move" gesture. Therefore, the touch engine receiving data from the touch screen sensor device is programmed to distinguish between the speed thresholds for indicating different gestures. Therefore, the time, speed, and direction associated with different movement gestures can have preset thresholds. Two and three finger static and moving gestures can have separate thresholds to distinguish these control operations. Note that the preset displayed icons or virtual buttons may have different static pressure or duration thresholds. When operating in the full screen mode, the touch screen processor (which preferably operates on the system central processing unit that performs other imaging operations (such as scan conversion)) turns off the static icon.
4A to 4C depict the touch that can be performed by the user of the medical ultrasound imaging device 100 Control the exemplary subsets 402, 404, 406 of touch controls on the screen display 104. It should be noted that any other suitable subset(s) of touch control items can be implemented on the touch screen display 104 according to requirements and/or needs. As shown in FIG. 4A, the subset 402 includes a touch control item 408 for performing two-dimensional (2D) mode operations, a touch control item 410 for performing gain control operations, and a touch control item 410 for performing color control operations. A touch control item 412 and a touch control item 414 for performing image/clip freeze/save operations. For example, a user can use the pressing gesture 320 to activate the touch control 408, so that the medical ultrasound imaging apparatus 100 returns to the 2D mode. In addition, the user can use a pressing gesture 320 against one side of the touch control item 410 to decrease a gain level, and use a pressing gesture 320 against the other side of the touch control item 410 to increase the gain level. In addition, the user can use a drag gesture 318 on the touch control 412 to use a predetermined color code to identify the density range on a 2D image. In addition, the user can use the pressing gesture 320 to activate the touch control 414 to freeze/save a still image or obtain a movie image clip.
As shown in FIG. 4B, the subset 404 includes a touch control item 416 for performing split screen control operations, a touch control item 418 for performing PW imaging control operations, and a touch control item 418 for performing Doppler and two-dimensional control operations. The touch control item 420 is one of beam steering control operations and the touch control item 422 is used to perform annotation operations. For example, a user can use a pressing gesture 320 against the touch control 416 to allow the user to alternately use the click gesture 302 on each side of the split screen to move between the opposite sides of the split touch screen display 104. Switch between. In addition, the user can use the press gesture 320 to activate the touch control 418 and enter the PW mode, which allows (1) the user to control the angle correction, and (2) move by using the press and drag gesture 322 (for example, "up" "Or "Down") can be displayed on the touch screen display 104 as a baseline, and/or (3) a scale that can be displayed on the touch screen display 104 by using a click gesture 302 to increase or decrease Proportion. In addition, the user can use the pressing gesture 320 against one side of the touch control item 420 to perform 2D beam steering to the "left" or any other suitable direction in five (5) increments or any other suitable increments. And touch control The other side of item 420 uses a pressing gesture 320 to perform 2D beam steering to the "right" or any other suitable direction in five (5) increments or any other suitable increments. In addition, the user can use the click gesture 302 on the touch control 422 to allow the user to input annotation information through a pop-up keyboard that can be displayed on the touch screen display 104.
As shown in FIG. 4C, the subset 406 includes a touch control item 424 for performing dynamic range operations, and for performing Teravision<sup>TM</sup>One of the software operations is a touch control item 426, a touch control item 428 for performing a mapping operation, and a touch control item 430 for performing a needle guiding operation. For example, a user can use the pressing gesture 320 and/or the pressing and dragging gesture 322 against the touch control item 424 to control or set the dynamic range. In addition, the user can use the click gesture 302 on the touch control item 426 to select the Teravision to be executed from the memory by the processor on the computer motherboard 106<sup>TM</sup>One of the required levels of software. Moreover, the user can use the click gesture 302 on the touch control item 428 to perform a desired mapping operation. In addition, the user can use the pressing gesture 320 against the touch control item 430 to perform a desired needle guiding operation.
According to the present invention, single-point/multi-point gestures can be used on the surface 105 of the touch screen display 104 of the medical ultrasound imaging device 100 (see FIG. 1) to execute an object displayed as an ultrasound image on the touch screen display 104 ( (Such as organs, tissues, etc.) various measurements and/or tracking. The user can directly view an original ultrasonic image of the displayed object, an enlarged version of the ultrasonic image of the displayed object, and/or a virtual window 506 on the touch screen display 104 (see FIGS. 5C and 5D). One of the ultrasound images in) performs such measurement and/or tracking of the object after the enlarged part.
5A and 5B depict an original ultrasound image of an exemplary object (ie, a liver 502 with a cystic lesion 504) displayed on the touch screen display 104 of the medical ultrasound imaging device 100 (see FIG. 1). It should be noted that this ultrasound image can be generated by the medical ultrasound imaging device 100 penetrating liver tissue in response to ultrasound (the ultrasound is generated by an ultrasound probe/sensor operatively connected to the device 100). Can The measurement and/or tracking of the liver 502 with the cystic lesion 504 is performed directly on the original ultrasound image displayed on the touch screen display 104 (see FIGS. 5A and 5B), or an enlarged version of the ultrasound image. For example, the user can use an unfolding gesture by placing two (2) fingers on the surface 105 of the touch screen display 104 and expanding and separating them to enlarge the original ultrasound image (for example, see the unfolding in Figure 3). Type gesture 312) to obtain this enlarged version of the ultrasound image. The measurement and/or tracking of the liver 502 and the cystic lesion 504 can also be performed on the enlarged part of one of the ultrasound images in the virtual window 506 (see FIG. 5C and FIG. 5D) on the touch screen display 104.
For example, using his or her finger (for example, see one finger 508 of FIGS. 5A to 5D), the user can press the touch screen display near the area of interest (such as the area corresponding to the cystic lesion 504) The surface 105 of 104 uses a pressing gesture (for example, see the pressing gesture 320 of FIG. 3) (see FIG. 5B) to obtain the virtual window 506. In response to the pressing gesture, a virtual window 506 (see FIG. 5C and FIG. 5D) is displayed on the touch screen display 104 (may be at least partially superimposed on the original ultrasound image), thereby providing the user with a location near the cystic lesion 504 An enlarged view of one of the liver 502. For example, the virtual window 506 of FIG. 5C can provide a view of an enlarged portion of an ultrasound image of the cystic lesion 504, which is a finger 508 pressed against the surface 105 of the touch screen display 104 Overlay. To reposition the enlarged cystic lesion 504 in the virtual window 506, the user can use a pressing and dragging gesture against the surface 105 of the touch screen display 104 (for example, see the pressing and dragging gesture 322 in FIG. 3) (see FIG. 5D), thereby moving the image of the cystic lesion 504 to a desired position in the virtual window 506. In one embodiment, the medical ultrasound imaging device 100 may be configured to allow the user to select an enlargement level in the virtual window 506 that is 2 times, 4 times, or any other suitable multiples of the original ultrasound image. The user can remove the virtual window 506 from the touch screen display 104 by lifting his or her finger from the surface 105 of the touch screen display 104 (see, for example, the finger 508 in FIGS. 5A to 5D).
6A depicts an ultrasound image of another exemplary object (ie, a view of a heart 602 and an apical four (4) chambers) displayed on the touch screen display 104 of the medical ultrasound imaging device 100 (see FIG. 1). It should be noted that this ultrasound image can be generated by the medical ultrasound imaging device 100 responding to ultrasound (the ultrasound is generated by an ultrasound probe/sensor operatively connected to the device 100) penetrating the heart tissue. The heart 602 can be measured and/or tracked directly on the original ultrasound image displayed on the touch screen display 104 (see FIGS. 6A to 6E), or an enlarged version of the ultrasound image. For example, using his or her fingers (for example, see fingers 610 and 612 in FIGS. 6B to 6E), the user can perform the heart by using one or more multi-finger gestures on the surface 105 of the touch screen display 104 One of 602 one of the left ventricle 606 (see Fig. 6B to Fig. 6E) one of the endocardial border 604 (see Fig. 6B) is manually tracked. In one embodiment, using his or her fingers (for example, refer to the fingers 610 and 612 in FIGS. 6B to 6E), the user can use one or two gestures on the surface 105 of the touch screen display 104 (for example, , Refer to the double-click gesture 310 of FIG. 3A) to obtain a cursor 607 (refer to FIG. 6B), and a drag gesture (for example, refer to the drag gesture 318 of FIG. 3A) using a finger (such as finger 610) By moving the cursor 607, the cursor 607 is moved to a desired location on the touch screen display 104. The system and method described herein can be used for the quantitative measurement of heart wall motion and specifically for the measurement of ventricular asynchrony, as described in detail in U.S. Application No. 10/817,316 filed on April 2, 2004 , The entire content of the case is incorporated into this article by reference.
Once the cursor 607 is at the desired location on the touch screen display 104 (as determined by the location of the finger 610), the user can use another finger (such as finger 612) to use a point selection gesture (for example, see Click gesture 302; see Figure 3) and fix the cursor 607 at the position. To perform a manual tracking of the endocardial boundary 604 (see FIG. 6B), the user can use a finger 610 to adopt a pressing and dragging gesture (for example, see pressing and dragging gesture 322 in FIG. 3), as shown in FIGS. 6C and 6D As shown. The endocardium can be displayed in reverse video on the touch screen display 104 in any suitable manner (such as by a dashed line 608 (see FIGS. 6C to 6E)) This manual tracking of the boundary 604. The manual tracking of the endocardial boundary 604 can continue until the finger 610 reaches any suitable location on the touch screen display 104, or until the finger 610 returns to the location of the cursor 607, as shown in FIG. 6E. Once the finger 610 is at the position of the cursor 607 or any other suitable location, the user can perform a manual tracking operation by using the finger 612 to use a point selection gesture (for example, see the click gesture 302; see FIG. 3). It should be noted that this manual tracking operation can be used to track any other suitable feature and/or waveform (such as a pulse wave Doppler (PWD) waveform). In one embodiment, the medical ultrasound imaging device 100 may be configured to perform any manual tracking based at least in part on one (several) of the respective feature/waveform(s) and the feature(s) and/or waveform(s). Appropriate calculation and/or measurement.
As described above, the user can perform measurement and/or tracking of an object in an enlarged part of an original ultrasonic image of a displayed object in a virtual window on the touch screen display 104. 7A to 7C depict an original ultrasound image of an exemplary object (ie, a liver 702 with a cystic lesion 704) displayed on the touch screen display 104 of the medical ultrasound imaging device 100 (see FIG. 1). 7A to 7C further depict a virtual window 706 that provides a view of an enlarged portion of an ultrasound image of the cystic lesion 704, which is pressed against the surface 105 of the touch screen display 104 One of the user's fingers (such as a finger 710) overlaps. Using his or her fingers (for example, see fingers 710 and 712 in FIGS. 7A to 7C), the user can execute the virtual window 706 by using one or more multi-finger gestures on the surface 105 of the touch screen display 104 The size of one of the cystic lesions within 704 is measured.
For example, using his or her fingers (for example, refer to fingers 710 and 712 in FIGS. 7A to 7C), the user can use a one-point and two-click gesture on the surface 105 (for example, refer to the point and two-click gesture 310 in FIG. 3). ) To obtain a first cursor 707 (see FIG. 7B, FIG. 7C), and the first cursor can be moved by using a finger (such as finger 710) using a drag gesture (for example, see drag gesture 318 in FIG. 3) 707, to move the first cursor 707 to a desired part Bit. Once the first cursor 707 is at the desired part (as determined by the position of the finger 710), the user can use another finger (such as the finger 712) to adopt a point selection gesture (for example, see the point selection gesture 302; see figure 3) The first cursor 707 is fixed at the position. Similarly, the user can obtain a second cursor 709 (see FIG. 7C) by using a one-point and two-click gesture on the surface 105 (see, for example, the two-click gesture 310 in FIG. 3), and by using a finger 710 A drag gesture (for example, see drag gesture 318 in FIG. 3) is used to move the second cursor 709, thereby moving the second cursor 709 to a desired location. Once the second cursor 709 is at the desired position (as determined by the position of the finger 710), the user can use the finger 712 to use a point selection gesture (for example, see the click gesture 302; see FIG. 3). The two cursors 709 are fixed at this position. In one embodiment, the medical ultrasound imaging device 100 may be configured to perform any suitable size calculation and/or measurement related to the cystic lesion 704 based at least in part on the positions of the first cursor 707 and the second cursor 709 .
8A to 8C depict an original ultrasound image of an exemplary object (ie, a liver 802 with a cystic lesion 804) displayed on the touch screen display 104 of the medical ultrasound imaging device 100 (see FIG. 1). 8a to 8c further depict a virtual window 806 that provides an enlarged view of an ultrasound image of the cystic lesion 804, which is pressed against the surface 105 of the touch screen display 104 One of the user's fingers (such as a finger 810) overlaps. Using his or her fingers (for example, see fingers 810 and 812 in FIGS. 8A to 8C), the user can execute the virtual window 806 by using one or more multi-finger gestures on the surface 105 of the touch screen display 104 A caliper measurement of the cystic lesion 804 inside.
For example, using his or her fingers (for example, see fingers 810 and 812 in FIGS. 8A to 8C), the user can use a one-point and two-click gesture on the surface 105 (for example, see the point and two-click gesture 310 in FIG. 3). ) To obtain a first cursor 807 (see FIGS. 8B and 8C), and the cursor 807 can be moved by using a finger (such as finger 810) using a drag gesture (for example, see drag gesture 318 in FIG. 3), In this way, the cursor 807 is moved to a desired position. once With the cursor 807 at the desired location (as determined by the position of the finger 810), the user can use another finger (such as the finger 812) to use a point selection gesture (for example, see the click gesture 302; see FIG. 3). Fix the cursor 807 at this location. Then, the user can use a pressing and dragging gesture (for example, see the pressing and dragging gesture 322 in FIG. 3) to obtain a connecting line 811 (see FIGS. 8B and 8C) and extend from the first cursor 807 across the cystic lesion 804 The connecting line 811 to a desired location on the other side of the cystic lesion 804. Once the connecting line 811 extends across the cystic lesion 804 to the desired location on the other side of the cystic lesion 804, the user can use the finger 812 to use a point selection gesture (for example, see the click gesture 302; see FIG. 3). Obtain a second cursor 809 (see FIG. 8C) and fix it at the desired location. In one embodiment, the medical ultrasound imaging apparatus 100 may be configured to perform any (several) any related to the cystic lesion 804 based at least in part on the connecting line 811 extending between the locations of the first cursor 807 and the second cursor 809 Appropriate caliper calculation and/or measurement.
FIG. 9A shows a system 140 in which a sensor housing 150 having an array of sensor elements 152 can be attached to the housing 102 at the connector 114. Each probe 150 may have a probe identification circuit 154 that uniquely identifies the attached probe. When the user inserts a different probe with a different array, the system recognizes the operating parameters of the probe. Note that the preferred embodiment can include a display 104 with a touch sensor 107 that can be connected to analyze the touch screen data from the sensor 107 and transmit commands to two images Processing operations (1124 as shown in FIG. 11) and a touch processor 109 to a beamformer control processor (1116 as shown in FIG. 11). In a preferred embodiment, the touch processor may include a computer-readable medium that stores instructions for operating an ultrasonic touch screen engine that is operable to control the display and imaging operations described herein .
FIG. 9B shows a software flowchart 900 of a typical sensor management module 902 in an ultrasonic application. When a TRANSDUCER ATTACH 904 event is detected, the sensor management software module 902 first reads the sensor type ID 906 and hardware version information from the IDENTIFICATION segment. This information is used to remove from the hard drive The specific sensor profile data set 908 is loaded into the memory of the application program. Then, the software reads the adjustment data 910 from the FACTORY segment and applies the adjustments to the profile data just loaded into the memory 912. Then, the software module sends a sensor attachment message 914 to the main ultrasound application, which uses the loaded sensor profile. After confirmation 916, an ultrasound imaging sequence is executed and the USAGE segment 918 is updated. Then, the sensor management software module waits for a TRANSDUCER DETACH event 920 or 5 minutes has elapsed. If a sensor detach event is detected 921, a message 926 is sent and confirmed 924, the sensor profile data set 928 is removed from memory and the module returns to wait for another sensor attach event. If a 5-minute time period expires without detecting a sensor detachment event, the software module adds a cumulative usage counter to the usage segment 922 and waits for another 5-minute time period or a sensor detachment event. Record the accumulated usage in the memory for maintenance and replacement records.
There are many types of ultrasonic sensors. They are different in terms of geometric structure, number of components, and frequency response. For example, a linear array having a center frequency of 10 MHz to 15 MHz is preferably suitable for chest imaging, and a curved array having a center frequency of 3 MHz to 5 MHz is preferably suitable for abdominal imaging.
It is often necessary to use different types of sensors for the same or different ultrasound scanning sessions. For ultrasound systems with only one sensor connection, the operator will change the sensor before starting a new scanning session.
In some applications, it is necessary to switch between different types of sensors during an ultrasound scanning session. In this case, it is more convenient to have multiple sensors connected to the same ultrasonic system, and the operator can click on the operator control without physically removing and reattaching the sensor (which takes a long time) A button on the stage to quickly switch between these connected sensors. The preferred embodiment of the present invention may include a multiplexer in the tablet computer housing, the multiplexer can be selected between a plurality of probe connector ports in the tablet computer housing, or alternatively, the tablet The computer case can be connected to Mount to an external multiplexer on a cart as described herein.
FIG. 9C is a perspective view of an exemplary needle-sensing positioning system that uses an ultrasonic sensor without any active electronics in the sensor assembly. The sensor sensor may include a passive ultrasonic sensor element. These elements can be used in a manner similar to one of the typical sensor probes using ultrasonic engine electronics. The system 958 includes the addition of an ultrasonic sensor element 960 to a needle guide 962, which is shown in FIG. 9C but can be of any suitable external size. A needle guide mounting bracket 966 can be used to mount the ultrasonic sensor element 960 and the needle guide 962 to an ultrasonic sensor probe sound grip or an ultrasonic imaging probe assembly 970. A magnetic disk (ultrasonic reflector magnetic disk 964) mounted on the exposed end is reflective to ultrasonic waves.
The ultrasonic sensor element 960 on the needle guide 962 can be connected to an ultrasonic engine. The connection can be made through a separate cable to a dedicated probe connector (similar to a common pencil-shaped CW probe connector) on the engine. In an alternative embodiment, a small short cable can be plugged into a larger image sensor probe grip or a split cable connected to the same probe connector at the engine. In another alternative embodiment, the connection can be made via an electrical connector between the image probe grip and the needle guide (without a cable between them). In an alternative embodiment, the ultrasonic sensor element on the needle guide can be connected to the ultrasonic engine by enclosing the needle guide and the sensor elements in the same mechanical enclosure of the imaging probe grip.
9D is a perspective view of a needle guide 962 positioned together with the sensor element 960 and the ultrasonic reflector disk 964. The position of the reflector disk 964 is located by transmitting the ultrasonic wave 972 from the sensor element 960 on the needle guide 962. The ultrasonic wave 972 travels through the air toward the reflector disk 964 and is reflected by the reflector disk 964. The reflected ultrasonic wave 974 reaches the sensor element 960 on the needle guide 962. The distance 976 between the reflector disk 964 and the sensor element 960 is calculated from the elapsed time and the speed of sound in the air.
Figure 9E uses ultrasonic sensors without any active electronics in the sensor assembly A perspective view of an alternative embodiment of an exemplary needle-sensing positioning system of the device. The sensor sensor may include a passive ultrasonic sensor element. These elements can be used in a manner similar to one of the typical sensor probes using ultrasonic engine electronics.
The system 986 includes a needle guide 962 that can be mounted to a needle guide mounting bracket 966, which can be coupled to an ultrasound imaging probe assembly 982 for imaging the patient's body or can be an alternative Appropriate appearance size. The ultrasonic reflector magnetic disk 964 can be installed at the exposed end of the needle 956. In this embodiment, a linear ultrasonic sound array 978 is installed parallel to the moving direction of the needle 956. The linear ultrasonic sound array 978 includes an ultrasonic sensor array 980 positioned parallel to the needle 956. In this embodiment, an ultrasound imaging probe assembly 982 is positioned for imaging the patient's body. An ultrasonic sensor array 984 is used to configure the ultrasonic imaging probe assembly 982 for imaging the patient's body.
In this embodiment, the position of the ultrasonic reflector disk 964 can be detected by using an ultrasonic sensor array 980 coupled to an ultrasonic imaging probe assembly 978 for imaging. The position of the reflector disk 964 is located by transmitting the ultrasonic wave 972 from the sensor element 980 on the ultrasonic imaging probe assembly 978 for imaging. The ultrasonic wave 972 travels through the air toward the reflector disk 964 and is reflected by the reflector disk 964. The reflected ultrasonic wave 974 reaches the sensor element 980 on the ultrasonic imaging probe assembly 978 for imaging. The distance 976 between the reflector disk 964 and the sensor element 980 is calculated from the elapsed time and the speed of sound in the air. In an alternative embodiment, an alternating algorithm can be used to sequentially scan the polarity of the elements in the sensor array and analyze the reflections generated by each sensor array element. In an alternative embodiment, multiple scans may occur before forming an ultrasound image.
Figure 9F shows a system 140 similar to the system shown in Figure 9A and configured to accept a Subscriber Identity Module (SIM) card for wireless communication. In this particular embodiment, the communication circuit 118 is connected to the computing circuit 106, and a SIM card port 119 is configured to receive a SIM card 120 and connect the SIM card 120 to the communication circuit 118 via many conductive contacts. In some embodiments, a SIM card port 119 configuration that can accept a standard SIM card, a small SIM card, a micro SIM card, a nano SIM card, an embedded SIM card, or other similar wireless identification/authorization cards or circuits can be used. Ultrasonic devices. The system incorporates a SIM card interface circuit 118 (such as the SIM card interface circuit available from NXP Semiconductors NV in Eindhoven, The Netherlands), and the SIM card interface circuit 118 may contain electromagnetic interference ( EMI) filtering and electrostatic discharge (ESD) protection features. The identification card incorporates an identification circuit (usually an integrated circuit embedded in a plastic card or substrate), the identification circuit includes storing the International Mobile Subscriber Identity (IMSI) and a mobile wireless network (such as 3G or 4G) Communication network) is a memory device that is a key for identifying and authenticating users.
FIG. 10A shows an exemplary method for monitoring the synchronization of a heart according to an exemplary embodiment. In this method, a reference template is loaded into the memory and used to guide a user to identify an imaging plane (according to step 930). Next, a user identifies a desired imaging plane (according to step 932). The apical 4-chamber view of one of the hearts is usually used; however, other views can be used without departing from the spirit of the present invention.
Sometimes, identifying the endocardial border can be difficult, and when such difficulties are encountered, tissue Doppler imaging of the same view can be used (according to step 934). Provide a reference template for identifying the septum and lateral free wall (according to step 936). Then, standard tissue Doppler imaging (TDI) with a preset velocity level of, for example, ±30 cm/sec can be used (according to step 938).
Then, a reference for one of the desired triple images can be provided (according to step 940). B-mode or TDI can be used to guide the distance gate (according to step 942). The B mode can be used to guide the distance gate (according to step 944) or TDI to guide the distance gate (according to step 946). Using TDI or B mode to guide the distance gate also allows the use of a direction correction angle to allow the spectral Doppler display of the radial average velocity of the partition. Next, a first pulse wave spectral Doppler is used to measure the average velocity of the middle wall using the dual or triple mode (according to step 948). The software used to process data and calculate out-of-synchronization can use a part (for example, a center point) to automatically set a note on a heart wall An angle between the dated parts to help simplify parameter setting.
A double image or a TDI is also used to guide a second distance gate position (according to step 950), and a directional correction angle can be used if necessary. After step 950, the system tracks the average speed of the intermediate wall and the lateral free wall. Then, the time integration 952 of the spectral Doppler average velocity at the region of interest (eg, the septum wall and the free wall of the left ventricle) provides the displacement of the septum and the free wall of the left ventricle, respectively.
The above method steps can be used in conjunction with a high-pass filter component (analog or digital) known in the related art for removing any baseline interference existing in the collected signal. In addition, the disclosed method uses multiple simultaneous PW spectral Doppler lines for tracking the movement of the interventricular septum and the free wall of the left ventricle. In addition, a multi-gate structure can be used along each spectrum line, thus allowing quantitative measurement of regional wall motion. Averaging multiple gates allows measurement of global wall movement.
10B is a detailed schematic block diagram of an exemplary embodiment of a system 1000 with an integrated ultrasonic probe 1040 that can be connected to any personal computer (PC) 1010 through an interface unit 1020. The ultrasonic probe 1040 is configured to transmit ultrasonic waves and reduce the ultrasonic waves reflected from one or more image targets 1064. The sensor 1040 may be coupled to the interface unit 1020 using one or more cables 1066 and 1068. The interface unit 1020 can be positioned between the integrated ultrasonic probe 1040 and the host computer 1010. The two-stage beamforming systems 1040 and 1020 can be connected to any PC through a USB connection 1022, 1012.
The ultrasonic probe 1040 may include a sub-array/aperture 1052 composed of adjacent elements having an aperture smaller than the aperture of the entire array. The returned echoes are received by the 1D sensor array 1062 and transmitted to the controller 1044. The controller initially forms a coarse beam by transmitting the signal to the memory 1058, 1046. The memories 1058 and 1046 transmit a signal to a transmission driver 1 1050 and a transmission driver m 1054. Then, the transmission driver 1 1050 and the transmission driver m 1054 send signals to the multiplexer 1 1048 and the multiplexer m 1056, respectively. Transmit this signal to the sub-array beamformer 1 1052 and sub-array beamformer n 1060.
The output of each rough beamforming operation may include further processing through one of the second-level beamforming in the interface unit 1020 to convert the beamforming output into a digital representation. The coarse beamforming operations can be summed consecutively to form a fine beam output for the array. The signal can be transmitted from the ultrasonic probe 1040 sub-array beamformer 1 1052 and sub-array beamformer n 1060 is transmitted to the A/D converters 1030 and 1028 in the interface unit 1020. In the interface unit 1020, there are A/D converters 1028 and 1030 for converting the first-stage beamforming output into a digital representation. A customer-specific application integrated circuit (ASIC) (such as a field programmable gate array (FPGA) 1026) can receive digital conversion from the A/D converters 1030, 1028 to complete the second-level beamforming. The FPGA digital beamforming 1026 can transmit information to the system controller 1024. The system controller can transmit information to a memory 1032, and the memory 1032 can send a signal back to the FPGA digital beamforming 1026. Alternatively, the system controller 1024 may transmit the information to the customized USB3 chipset 1022. The USB3 chipset 1022 can then transmit information to a DC-DC converter 1034. Then, the DC-DC converter 1034 can transmit power from the interface unit 1020 to the ultrasonic probe 1040. In the ultrasonic probe 1040, a power supply 1042 can receive power signals and interface with the transmission driver 1 1050 to provide power to the front-end integrated probe.
The interface unit 1020 is customized or the USB3 chipset 1022 can be used to provide a communication link between the interface unit 1022 and the host computer 1010. The customized or USB3 chipset 1022 transmits a signal to the customized or USB3 chipset 1012 of the host computer 1010. Then, the customized or USB3 chipset 1012 is interfaced with the microprocessor 1014. Then, the microprocessor 1014 can display information or send the information to a device 1075.
In an alternative embodiment, a narrowband beamformer may be used. For example, apply a different analog phase shifter to each of the received echoes. Then, the phase shift output in each sub-array is summed to form a rough beam. A/D converter can be used to digitize these coarse beams Each of them; a digital beamformer is then used to form fine beams.
In another embodiment, forming a 64-element linear array can use eight adjacent elements to form a rough beam output. This configuration can utilize eight output analog cables that connect the output of the integrated probe to the interface unit. The rough beam can be sent through the cable to the corresponding A/D converter located in the interface unit. The digital delay is used to form a fine beam output. Eight A/D converters may be required to form a digital representation.
In another embodiment, sixteen sub-array beamforming circuits can be used to form a 128-element array. Each circuit can be formed from an adjacent eight-element array to provide a rough beam in the first stage output to the interface unit. This configuration can use sixteen output analog cables that connect the output of the integrated probe to the interface unit for digital output. A PC microprocessor or a DSP can be used to perform down-conversion, base-banding, scan conversion, and post-image processing functions. The microprocessor or the DSP can also be used to perform all Doppler processing functions.
10C is a detailed schematic block diagram of an exemplary embodiment of the system 1080 of the integrated ultrasonic probe 1040 with the first sub-array beamforming circuit, and the second stage beamforming circuit is integrated in the host computer 1082. The back-end computer with the second-stage beamforming circuit can be a PDA, tablet computer or mobile device housing. The ultrasonic probe 1040 is configured to transmit ultrasonic waves and reduce the ultrasonic waves reflected from one or more image targets 1064. The sensor 1040 is coupled to the host computer 1082 using one or more cables 1066, 1068. Note that A/D circuit components can also be placed in the housing of the sensor probe.
The ultrasonic probe 1040 includes a sub-array/aperture 1052 composed of adjacent elements having an aperture smaller than the aperture of the entire array. The returned echoes are received by the 1D sensor array 1062 and transmitted to the controller 1044. The controller initiates a rough beam by transmitting the signal to the memories 1058, 1046. The memories 1058 and 1046 transmit a signal to a transmission driver 1 1050 and a transmission driver m 1054. Then, the transmission driver 1 1050 and the transmission driver m 1054 send signals to the multiplexer 1 1048 and multiplexers, respectively. Worker m 1056. The signal is transmitted to sub-array beamformer 1 1052 and sub-array beamformer n 1060.
The output of each rough beamforming operation is then passed through a second-stage beamforming in the interface unit 1020 to convert the beamforming output into a digital representation. Should other coarse coherent beamforming operation may be summed to form the output of one array is used for fine beam. The signals are transmitted from the ultrasonic probe 1040 sub-array beamformer 1 1052 and sub-array beamformer n 1060 to the A/D converters 1030 and 1028 in the host computer 1082. There are A/D converters 1028 and 1030 in the host computer 1082 for converting the first-stage beamforming output into digital representation. A client ASIC (such as an FPGA 1026) can receive the digital conversion from the A/D converters 1030, 1028 to complete the second-level beamforming. The FPGA digital beamforming 1026 transmits information to the system controller 1024. The system controller transmits the information to a memory 1032, which can send a signal back to the FPGA digital beamforming 1026. Alternatively, the system controller 1024 may transmit the information to the customized USB3 chipset 1022. The USB3 chipset 1022 can then transmit information to a DC-DC converter 1034. Then, the DC-DC converter 1034 can transmit power from the interface unit 1020 to the ultrasonic probe 1040. In the ultrasonic probe 1040, a power supply 1042 can receive power signals and communicate with the transmission driver 1 1050 interface to provide power to the front-end integrated detection head. The power supply may include a battery that enables wireless operation of the sensor assembly. A wireless transceiver can be integrated into a controller circuit or a separate communication circuit to enable wireless transmission of image data and control signals.
The customized or USB3 chipset 1022 of the host computer 1082 can be used to provide a communication link between the customized or USB3 chipset 1012 to transmit a signal to the microprocessor 1014. Then, the microprocessor 1014 can display information or send the information to a device 1075.
FIG. 11 is an exemplary embodiment of the ultrasonic engine 108 (ie, front-end ultrasonic specific circuit) and an exemplary embodiment of the computer motherboard 106 (ie, host computer) of the ultrasonic device shown in FIG. 1 and FIG. 2A One is a detailed schematic block diagram. The ultrasonic engine 108 and /Or the components of the computer motherboard 106 can be implemented in an application-specific integrated circuit (ASIC). The exemplary ASIC has a high channel count and can package 32 or more channels per chip in some exemplary embodiments. The ordinary skilled person will recognize that the ultrasonic engine 108 and the computer motherboard 106 may include more or less modules than the modules shown. For example, the ultrasonic engine 108 and the computer motherboard 106 may include the modules shown in FIG. 17.
A sensor array 152 is configured to transmit ultrasonic waves to one or more image targets 1102 and receive ultrasonic waves reflected from the one or more image targets 1102. The sensor array 152 is coupled to the ultrasonic engine 108 using one or more cables 1104.
The ultrasonic engine 108 includes a high-voltage transmission/reception (TR) module 1106 for applying driving signals to the sensor array 152 and for receiving return echo signals from the sensor array 152. The ultrasonic engine 108 includes a preamplifier/TGC module 1108 for amplifying the return echo signal and applying a proper time gain compensation (TGC) function to one of the signals. The ultrasonic engine 108 includes a sampled data beamformer 1110 in which the preamplifier/TGC module 1108 has been used to amplify and process the delay coefficient used in each channel after returning the echo signal.
In some exemplary embodiments, the high-voltage TR module 1106, the preamplifier/TGC module 1108, and the sample interpolation receiving beamformer 1110 may each be a silicon chip with 8 to 64 channels per chip, but The illustrative embodiments are not limited to this scope. In some embodiments, the high voltage TR module 1106, the preamplifier/TGC module 1108, and the sample interpolation receiving beamformer 1110 may each have 8, 16, 32, 64 channels, and the like. One of the silicon wafers. As shown in FIG. 11, an exemplary TR module 1106, an exemplary preamplifier/TGC module 1108, and an exemplary beamformer 1110 may each take the form of a silicon chip including 32 channels.
The ultrasonic engine 108 includes a first-in-first-out (FIFO) buffer module 1112, and the first-in-first-out (FIFO) buffer module 1112 is used to buffer the processed data output by the beamformer 1110. The ultrasonic engine 108 also includes a memory for storing program instructions and data 1114 and a system controller 1116 for controlling the operation of the ultrasonic engine module.
The ultrasonic engine 108 interfaces with the computer motherboard 106 via a communication link 112. The communication link 114 can follow a standard high-speed communication protocol, such as Firewire (IEEE 1394 standard serial interface) or fast (for example, 200 Mbit/s). Second to 400 Mbit/s or faster) Universal Serial Bus (USB 2.0 USB 3.0) protocol. The standard communication link to the computer motherboard operates at 400 Mbit/s or higher, preferably at 800 Mbit/s or higher. Alternatively, the link 112 may be a wireless connection, such as an infrared (IR) link. The ultrasonic engine 108 includes a communication chipset 1118 (for example, a Firewire chipset) that builds and maintains the communication link 112.
Similarly, the computer motherboard 106 also includes a communication chipset 1120 (for example, a Firewire chipset) that builds and maintains the communication link 112. The computer motherboard 106 includes a core computer-readable memory 1122 for storing data and/or computer-executable instructions (the computer-executable instructions are used to perform ultrasound imaging operations). The memory 1122 forms the main memory of the computer, and can store about 4GB of DDR3 memory in an exemplary embodiment. The computer motherboard 106 also includes a microprocessor 1124 for executing computer-executable instructions stored on the core computer-readable memory 1122, and the computer-executable instructions are used to perform ultrasound imaging processing operations. An exemplary microprocessor 1124 may be an existing commercial computer processor (such as an Intel-Core i5 processor). Another exemplary microprocessor 1124 may be a digital signal processor (DSP)-based processor (such as one or more DaVinci processors from Texas Instruments).<sup>TM</sup>processor). The computer motherboard 106 also includes a display controller 1126 for controlling a display device that can be used to display ultrasound data, scans, and maps.
Exemplary operations performed by the microprocessor 1124 include (but are not limited to): down conversion (used to generate I and Q samples from received ultrasonic data), scan conversion (used to convert ultrasonic data into one of a display device) Display format), Doppler processing (used to determine and/or image movement and/or flow information from ultrasound data), color blood flow processing (used to use the autocorrelation in an embodiment to generate superimposed on a B-mode ultrasound One of the Doppler shifts on the image Color coded image), energy Doppler processing (used to determine energy Doppler data and/or generate an energy Doppler image), spectral Doppler processing (used to determine spectral Doppler data and/or generate an energy Doppler image) Spectral Doppler diagram) and post-signal processing. These operations are described in further detail in WO 03/079038 A2 named "Ultrasound Probe with Integrated Electronics" filed on March 11, 2003, and the entire content of the case is expressly incorporated herein by reference.
In order to achieve a smaller and lighter portable ultrasonic device, the ultrasonic engine 108 includes providing a reduction in the overall package size and occupied area of a circuit board of the ultrasonic engine 108. To this end, exemplary embodiments provide a portable ultrasonic device that minimizes the overall package size and footprint while providing a small and lightweight portable ultrasound device with a high channel count. In some embodiments, a high-channel count circuit board of an exemplary ultrasonic engine may include one or more multi-chip modules, where each chip provides multiple channels (for example, 32 channels). The term "multi-chip module" as used herein refers to an electronic package in which multiple integrated circuits (ICs) are packaged into a unified substrate, thereby facilitating their use as a single component (ie, as a comparative Big IC). A multi-chip module can be used in an exemplary circuit board to enable two or more active IC components integrated on a high-density interconnect (HDI) substrate to reduce the overall package size. In an exemplary embodiment, a multi-chip module can be assembled by vertically stacking a transmission/reception (TR) silicon chip of an ultrasonic engine, an amplifier silicon chip, and a beamformer silicon chip. A single circuit board of the ultrasonic engine can include one or more of these multi-chip modules to provide a high channel count while minimizing the overall package size and footprint of the circuit board.
FIG. 12 depicts a schematic side view of a portion of a circuit board 1200 including a multi-chip module assembled in a vertical stack configuration. Two or more layers of active electronic integrated circuit components are vertically integrated into a single circuit. The IC layers are oriented in spaced planes that extend substantially parallel to each other in a vertical stack configuration. In FIG. 12, the circuit board includes an HDI substrate 1202 for supporting a multi-chip module. Contains (for example) a first beamformer The first integrated circuit chip 1204, one of the devices, is coupled to the substrate 1202 using any suitable coupling mechanism (for example, epoxy application and curing). A first spacer layer 1206 is coupled to the surface of the first integrated circuit chip 1204 opposite to the substrate 1202 using, for example, epoxy resin application and curing. A second integrated circuit chip 1208 having, for example, a second beamformer device, is coupled to the surface of the first spacer layer 1206 opposite to the first integrated circuit chip 1204 using, for example, epoxy resin application and curing. A metal frame 1210 for mechanical and/or electrical connection between integrated circuit chips is provided. An exemplary metal frame 1210 may be in the form of a lead frame. The first integrated circuit chip 1204 can be coupled to the metal frame 1210 using wires 1212. The second integrated circuit die 1208 can be coupled to the same metal frame 1210 using wires 1214. A package 1216 is provided to encapsulate the multi-chip module assembly and maintain the plurality of integrated circuit chips in a substantially parallel configuration with respect to each other.
As shown in Figure 12, the vertical three-dimensional stacking of the first integrated circuit chip 1204, the first spacer layer 1206, and the second integrated circuit chip 1208 provides high-density functionality on the circuit board while minimizing the overall package size and Occupy area (compared to an ultrasonic engine circuit board that does not use a vertically stacked multi-chip module). Those skilled in the art will recognize that an exemplary multi-chip module is not limited to two stacked integrated circuit chips. The exemplary number of chips vertically integrated in a multi-chip module may include (but is not limited to): two, three, four, five, six, seven, eight, and the like.
In an embodiment of an ultrasonic engine circuit board, a single multi-chip module as shown in FIG. 12 is provided. In other embodiments, a plurality of multi-chip modules are also shown in FIG. 12. In an exemplary embodiment, a plurality of multi-chip modules (for example, two multi-chip modules) may be stacked vertically on top of each other on a circuit board of an ultrasonic engine to further minimize the packaging of the circuit board Size and occupied area.
In addition to the need to reduce the occupied area, it is also necessary to reduce the overall package height in the multi-chip module. Exemplary embodiments may use wafers thinned to hundreds of micrometers to reduce the package height in a multi-chip module.
Any suitable technique can be used to assemble a multi-chip module on a substrate. Exemplary assembly techniques include (but are not limited to): multilayer MCM (MCM-L), where the substrate is a multilayer multilayer printed circuit board; deposition MCM (MCM-D), where multi-chip modules are deposited on the substrate using thin film technology On the substrate; and the ceramic substrate MCM (MCM-C), in which several conductive layers are deposited on a ceramic substrate and embedded in a glass layer (where the layers are co-fired at high temperature (HTCC) or low temperature (LTCC)).
FIG. 13 is a flowchart of an exemplary method for manufacturing a circuit board including a multi-chip module assembled into a vertical stack configuration. In step 1302, an HDI substrate is manufactured or provided. In step 1304, a metal frame (for example, a lead frame) is provided. In step 1306, a first IC layer is coupled or bonded to the substrate using, for example, epoxy application and curing. The first IC layer is wire-bonded to the metal frame. In step 1308, a spacer layer is coupled to the first IC layer using, for example, epoxy application and curing, so that the layers are stacked vertically and extend substantially parallel to each other. In step 1310, a second IC layer is coupled to the spacer layer using, for example, epoxy resin application and curing, so that all the layers are stacked vertically and extend substantially parallel to each other. The second IC layer is wire-bonded to the metal frame. In step 1312, a package is used to encapsulate the multi-chip module assembly.
The exemplary die layers in a multi-die module can be coupled to each other using any suitable technique. For example, in the embodiment depicted in FIG. 12, a spacer layer may be provided between the wafer layers to separate the wafer layers at intervals. The passivation silicon layer, the die attach paste layer, and/or the die attach film layer can be used as the spacer layer. Exemplary spacer technology that can be used to manufacture a multi-chip module is further described (May 27-30, 2008) at the 58th Electronic Components and Technology Conference (Electronic Components and Technology Conference) held in Florida, USA. Technology Conference) (ECTC2008) "Die Attach Adhesives for 3D Same-Sized Dies Stacked Packages" by Toh CH et al., pages 1538 to 1543, the entire content of the case is expressly incorporated herein by reference.
An important requirement for die attach (DA) paste or film is the passivation material for adjacent die Its excellent adhesion. In addition, a uniform bond chain thickness (BLT) is required for large-grain applications. In addition, high cohesive strength at high temperature and low moisture absorption is better for reliability.
14A to 14C are schematic side views of an exemplary multi-chip module including vertically stacked dies that can be used according to exemplary embodiments. Both peripheral and center pad wire bonding (WB) packages are shown and can be used to wire bond exemplary die layers in a multi-die module. 14A is a schematic side view of one of a multi-chip module including four vertically stacked dies, wherein the dies are passivated by having a 2-in-1 dicing die attach film (D-DAF) with a silicon layer Spaced apart from each other. 14B is a schematic side view of a multi-chip module including one of four vertically stacked dies, where the dies are spaced apart from each other by a DA film-based adhesive as a die-to-die spacer. Fig. 14C is a schematic side view of a multi-chip module including one of four vertically stacked dies, where the dies are separated by a DA paste or film-based adhesive as a die-to-die spacer. In some exemplary embodiments, the DA paste or film-based adhesive may have wire penetration capability. In the exemplary multi-chip module of FIG. 14C, film-covered wire (FOW) is used for die packaging that allows long wire bonding and center bonding pad stacking. FOW adopts a die attach film with wire penetration capability that allows wire bonding die of the same or similar size to be directly stacked on top of each other without a passivation silicon layer. This solves the problem of directly stacking dies of the same or similar size on top of each other. This also presents a challenge because there is no gap or there is not enough gap for bonding wires of lower die.
The DA material depicted in FIG. 14B and FIG. 14C preferably maintains a bond line thickness (BLT) that has almost no voids and is discharged through the assembly process. After assembly, the DA material sandwiched between the dies maintains excellent adhesion to the dies. Customize the material properties of DA materials as needed to maintain high cohesive strength for high-temperature reliability pressurization without lumpy cracking. Customizing the properties of DA materials as needed to also minimize or better eliminate can cause package reliability failure (for example, popping, thereby causing mediation due to pressure build-up from moisture in the package). Noodles or lumps cracked) moisture accumulation.
Figure 15 uses (a) a passivation silicon layer with a 2-in-1 dicing die attach film (D-DAF), (b) DA paste, (c) thick DA film, and (d) the same or similar size allowed The wire-bonded die is directly stacked on top of each other without passivation silicon spacers. The wire penetration ability is a specific example of die-to-die stacking of film-covered wire (FOW) of die attach film Flow chart of one of the methods. Each method performs back grinding of the wafer to reduce the thickness of the wafer to achieve stacking of integrated circuits and high-density packaging. The wafers are sawed to separate individual dies. A first die is applied and cured to a substrate of a multi-chip module using, for example, epoxy resin in an oven. Wire bonding is used to couple the first die to a metal frame.
In the method (A), a dicing die attach film (D-DAF) is used to bond a first passivation silicon layer to the first die in a stacked manner. D-DAF is used to bond a second die to the first passivation silicon layer in a stacked manner. Wire bonding is used to couple the second die to the metal frame. D-DAF is used to bond a second passivation silicon layer to the second die in a stacked manner. D-DAF is used to bond a third die to the second passivation silicon layer in a stacked manner. Wire bonding is used to couple the third die to the metal frame. DAF is used to bond a third passivation silicon layer to the third die in a stacked manner. D-DAF is used to bond a fourth die to the third passivation layer in a stacked manner. Wire bonding is used to couple the fourth die to the metal frame.
In method (B), repeated die attach (DA) paste dispensing and curing are applied to multiple thin die stacks. The DA paste is applied on a first die, and a second die is provided on the DA paste and cured to the first die. Wire bonding is used to couple the second die to the metal frame. The DA paste is applied on the second die, and a third die is provided on the DA paste and cured to the second die. Wire bonding is used to couple the third die to the metal frame. The DA paste is applied on the third die, and a fourth die is provided on the DA paste and cured to the third die. Wire bonding is used to couple the fourth die to the metal frame.
In the method (C), the die attach film (DAF) is cut and pressed to a bottom die and then a top die is placed and thermally compressed on the DAF. For example, pressing a DAF onto the first die and thermally compressing a second die onto the DAF. Wire bonding is used to couple the second die to the metal frame. Similarly, pressing a DAF onto the second die and thermally compressing a third die onto the DAF. Wire bonding is used to couple the third die to the metal frame. Pressing a DAF onto the third die and thermally compressing a fourth die onto the DAF. Wire bonding is used to couple the fourth die to the metal frame.
In method (D), film-covered wire (FOW) adopts a die attach that allows wire bonding die of the same or similar size to be directly stacked on top of each other without a passivation silicon layer. membrane. A second die is bonded and cured to the first die in a stacking manner. The film-covered wire bonding system is used to couple the second die to the metal frame. A third die is bonded and cured to the first die in a stacking manner. The film-covered wire bonding system is used to couple the third die to the metal frame. A fourth die is bonded and cured to the first die in a stacking manner. The film-covered wire bonding system is used to couple the fourth die to the metal frame.
After completing the above steps, in each of the methods (a) to (d), wafer molding and post molding curing (PMC) are performed. Afterwards, perform roll bead installation and singulation.
In the 58th Electronic Components and Technology Conference (ECTC2008) held in Florida (May 27-30, 2008), Toh CH et al. "Die Attach Adhesives for "3D Same-Sized Dies Stacked Packages", pages 1538 to 1543 provide further details on the above-described die attach technology, and the entire content of the case is expressly incorporated herein by reference.
16 is a schematic side view of a multi-chip module 1600 including a TR chip 1602, an amplifier chip 1604, and a beamformer chip 1606 that are vertically integrated on a substrate 1614 in a vertical stack configuration. Any suitable technique depicted in FIGS. 12-15 can be used to manufacture a multi-chip module. The ordinary skilled person will recognize that in other embodiments stacked chips The specific order can be different. The first spacer layer 1608 and the second spacer layer 1610 are provided to separate the wafers 1602, 1604, and 1606 at intervals. Each chip is coupled to a metal frame (eg, a lead frame) 1612. In some exemplary embodiments, a heat transfer and heat dissipation mechanism may be provided in a multi-chip module to maintain high-temperature reliability and pressure without lumps cracking. The other components of FIG. 16 are described with reference to FIG. 12 and FIG. 14.
In this exemplary embodiment, each multi-chip module can handle full transmission, reception, TGC amplification, and beamforming operations for a larger number of channels (for example, 32 channels). By vertically integrating three silicon chips into a single multi-chip module, the space required and occupied by the printed circuit board is further reduced. Multiple multi-chip modules can be provided on a single ultrasonic engine circuit board to further increase the number of channels while minimizing the package size and footprint. For example, a 128-channel ultrasonic engine circuit board 108 can be manufactured in an exemplary planar size of about 10 cm x about 10 cm, which is a significant improvement in the space requirement of conventional ultrasonic circuits. In a preferred embodiment, a single circuit board including one or more multi-chip modules and one ultrasonic engine can have 16 channels to 128 channels. In some embodiments, a single circuit board including one or more multi-chip modules and one ultrasonic engine may have 16, 32, 64, 128 channels, and the like.
17 is an exemplary embodiment of the ultrasound engine 108 (ie, front-end ultrasound specific circuit) and a detailed diagram of an exemplary embodiment of a computer motherboard 106 (ie, host computer) provided as a single-board complete ultrasound system Sexual block diagram. An exemplary single-plate ultrasound system as shown in FIG. 17 may have an exemplary planar size of about 25 cm x about 18 cm, but other sizes are also possible. The single-board complete ultrasound system of FIG. 17 can be implemented in the ultrasound devices depicted in FIGS. 1, 2A, 2B, and 9A, and can be used to perform the ultrasound devices depicted in FIGS. 3 to 8, 9B, and 10 operate.
The ultrasonic engine 108 includes a probe connector 114 that facilitates the connection of at least one ultrasonic probe/sensor. In the ultrasonic engine 108, a TR module, an amplifier module, and a beamformer module can be stacked vertically to form a multi-chip mold as shown in FIG. 16. Therefore, the overall package size and occupied area of the ultrasonic engine 108 are minimized. The ultrasonic engine 108 may include a first multi-chip module 1710 and a second multi-chip module 1712. Each module includes a TR chip and an ultrasonic pulse that are vertically integrated into a stacked configuration as shown in FIG. 16. Generator and receiver, an amplifier chip including a time gain control amplifier, and a data beamformer chip. The first multi-chip module 1710 and the second multi-chip module 1712 can be stacked vertically on top of each other to further minimize the area required on the circuit board. Alternatively, the first multi-chip module 1710 and the second multi-chip module 1712 may be horizontally arranged on the circuit board. In an exemplary embodiment, the TR chip, the amplifier chip, and the beamformer chip are each a 32-channel chip, and each of the multi-chip modules 1710 and 1712 has 32 channels. Those skilled in the art will recognize that the exemplary ultrasonic engine 108 may include (but is not limited to) one, two, three, four, five, six, seven, or eight multi-chip modules. Note that in a preferred embodiment, the system can be configured with a first beamformer in the sensor housing and a second beamformer in the tablet housing.
The ASIC and multi-chip module configuration enable a 128-channel complete ultrasound system to be implemented on a small single board of the size of a tablet computer format. An exemplary 128-channel ultrasonic engine 108 (for example) can be accommodated in an exemplary planar size of about 10 cm x about 10 cm, which is a significant improvement in the space requirement of conventional ultrasonic circuits. An exemplary 128-channel ultrasonic engine 108 can also be accommodated in about 100cm<sup>2</sup>One of the exemplary areas.
The ultrasonic engine 108 also includes a clock generation complex programmable logic device (CPLD) 1714 for generating a timing clock to perform an ultrasonic scan using the sensor array. The ultrasonic engine 108 includes an analog-to-digital converter (ADC) 1716 for converting the analog ultrasonic signal received from the sensor array into a digital RF beam. The ultrasonic engine 108 also includes a programmable gate array (FPGA) 1718 for managing one or more delay profiles and waveform generator fields for managing reception delay profiles and generating transmission waveforms. The ultrasound engine 108 includes a memory 1720 for storing delay profiles for ultrasound scanning. one The exemplary memory 1720 may be a single DDR3 memory chip. The ultrasound engine 108 includes configuration to manage the ultrasound scan sequence, transmission/reception timing, save configuration files to and retrieve configuration files from the memory 1720, and buffer and move digital RF data streams via a high-speed serial interface 112 A programmable gate array (FPGA) 1722 of a scan sequence control field to the computer motherboard 106. The high-speed serial interface 112 may include a Fire Wire or other serial or parallel bus interface between the computer motherboard 106 and the ultrasonic engine 108. The ultrasonic engine 108 includes a communication chipset 1118 (for example, a Fire Wire chipset) that builds and maintains the communication link 112.
A power module 1724 is provided to supply power to the ultrasonic engine 108, manage a battery charging environment, and perform power management operations. The power module 1724 can generate regulated, low-noise power for the ultrasonic circuit and can generate high voltage for the ultrasonic transmission pulse generator in the TR module.
The computer motherboard 106 includes a core computer-readable memory 1122 for storing data and/or computer-executable instructions (the computer-executable instructions are used to perform ultrasound imaging operations). The memory 1122 forms the main memory of the computer and can store about 4Gb of DDR3 memory in an exemplary embodiment. The memory 1122 may include a solid state drive (SSD) for storing an operating system, computer executable instructions, programs, and image data. An exemplary SSD may have a capacity of approximately 128 GB.
The computer motherboard 106 also includes a microprocessor 1124 for executing computer-executable instructions stored on the core computer-readable memory 1122 to perform ultrasonic imaging processing operations. Exemplary operations include (but are not limited to): down conversion, scan conversion, Doppler processing, color blood flow processing, energy Doppler processing, spectral Doppler processing, and post signal processing. An exemplary microprocessor 1124 may be an existing commercial computer processor (such as an Intel Core-i5 processor). Another exemplary microprocessor 1124 may be a digital signal processor (DSP)-based processor (such as DaVinci from Texas Instruments)<sup>TM</sup>processor).
The computer motherboard 106 includes an input/output (I/O) and graphics chipset 1704. The input The /output (I/O) and graphics chipset 1704 includes a co-processor that is configured to control I/O and graphics peripherals (such as USB ports, video display ports, and the like). The computer motherboard 106 includes a wireless network adapter 1702 configured to provide a wireless network connection. An exemplary adapter 1702 supports 802.11g and 802.11n standards. The computer motherboard 106 includes a display controller 1126 configured to interface the computer motherboard 106 to the display 104. The computer motherboard 106 includes a communication chipset 1120 (for example, a Fire Wire chipset or interface) configured to provide a fast data communication between the computer motherboard 106 and the ultrasonic engine 108. An exemplary communication chipset 1120 may be an IEEE 1394b 800 Mbit/sec interface. Other serial or parallel interfaces 1706 may alternatively be provided, such as USB3, Thunder-Bolt, PCIe, and the like. A power module 1708 is provided to supply power to the computer motherboard 106, manage a battery charging environment, and perform power management operations.
An exemplary computer motherboard 106 can be accommodated in an exemplary planar size of about 12 cm x about 10 cm. An exemplary computer motherboard 106 can be accommodated in about 120cm<sup>2</sup>One of the exemplary areas.
FIG. 18 is a perspective view of an exemplary portable ultrasound system 100 according to an exemplary embodiment. The system 100 is included in a tablet computer exterior size as shown in FIG. 18 but can be in a housing 102 in any other suitable exterior size. An exemplary housing 102 may have a thickness of less than 2 cm, and preferably between 0.5 cm and 1.5 cm. A front panel of the housing 102 includes a multi-touch LCD touch screen display 104, the multi-touch LCD touch screen display 104 is configured to identify and distinguish between one of the touch screen displays 104 One or more multi-point and/or simultaneous touch on the surface. One or more of a user's finger, a user's hand, or an optional stylus 1802 can be used to touch the surface of the display 104. The housing 102 includes one or more I/O port connectors 116 (the one or more I/O port connectors 116 may include (but are not limited to): one or more USB connectors, one or more SD cards , One or more network small display ports) and a DC power input. The embodiment of the housing 102 in Figure 18 can also be configured with a 150mm x 100mm x 15mm (225000mm<sup>3</sup>One body Product) or one of the smaller sizes within the external dimensions of the palm of the hand. The housing 102 may have a weight of less than 200 g. Optionally, the cabling between the sensor array and the display housing may include the interface circuit 1020 as described herein. The interface circuit 1020 may include, for example, a beamforming circuit and/or an A/D circuit in a pod suspended from the tablet computer. Separate connectors 1025, 1027 can be used to connect the hanging pod to the sensor probe cable. The connector 1027 may include a probe identification circuit as described herein. The unit 102 may include a camera, a microphone, and a speaker, as well as a wireless telephone circuit for voice and data communication, and software that can be used to control the voice activation of the ultrasound imaging operation as described herein.
The housing 102 includes a probe connector 114 that facilitates the connection of at least one ultrasonic probe/sensor 150 or is coupled to the probe connector 114. The ultrasonic probe 150 includes a sensor housing, and the sensor housing includes one or more sensor arrays 152. The ultrasonic probe 150 can be coupled to the probe connector 114 using a housing connector 1804 provided along a flexible cable 1806. Those skilled in the art will recognize that the ultrasonic probe 150 can be coupled to the housing 102 using any other suitable mechanism (for example, an interface housing including a circuit for performing ultrasonic specific operations (such as beamforming)). Other exemplary embodiments of the ultrasound system are described in further detail in WO 03/079038 A2 named "Ultrasound Probe with Integrated Electronics" filed on March 11, 2003. The entire content of the case is expressly incorporated by reference. In this article. The preferred embodiment may use a wireless connection between the handheld sensor probe 150 and the display housing. The beamformer electronics can be incorporated into the probe housing 150 to provide beamforming of sub-arrays in a 1D or 2D sensor array as described herein. The display housing can be sized to be held in the palm of the user's hand and can include wireless network connectivity to public access networks, such as the Internet.
FIG. 19 shows an exemplary view of a main graphical user interface (GUI) 1900 presented on the touch screen display 104 of the portable ultrasound system 100 of FIG. 18. When the super The main GUI 1900 can be displayed when the sonic system 100 is used. To assist a user in navigating the main GUI 1900, the GUI can be regarded as including four exemplary work areas: a function list 1902, an image display window 1904, an image control bar 1906, and a tool bar 1908. Additional GUI components can be provided on the main GUI 1900 to, for example, enable a user to close the GUI/or windows in the GUI, adjust the size of the GUI/or windows in the GUI, and exit the GUI and/or the GUI. The window in the GUI.
The function list 1902 allows a user to select the ultrasound data, images, and/or videos to be displayed in the image display window 1904. The function list 1902 may include, for example, GUI components for selecting one or more files in a patient folder directory and an image folder directory. The image display window 1904 displays ultrasound data, images, and/or video, and provides patient information as needed. Toolbar 1908 provides functionality associated with an image or video display, including (but not limited to): a save button for saving the current image and/or video to a file, saving the maximum allowable number of previous frames ( Such as a Cine loop), a save playback button, a print button used to print the current image, a freeze image button used to freeze an image, and one of the modes used to control the replay of a movie playback. Toolbar and the like. The exemplary GUI functionality that can be provided in the main GUI 1900 is described in further detail in WO 03/079038 A2 named "Ultrasound Probe with Integrated Electronics" filed on March 11, 2003. The entire content of the case is quoted The method is clearly incorporated into this article.
The image control bar 1906 includes touch control items that can be operated by touch and touch gestures directly applied to the surface of the display 104 by a user. Exemplary touch control items may include (but are not limited to): a 2D touch control item 408, a gain touch control item 410, a color touch control item 412, a storage touch control item 414, and a split touch control item Control item 416, a PW imaging touch control item 418, a beam-guided touch control item 420, an annotation touch control item 422, a dynamic range operation touch control item 424, and a Teravision<sup>TM</sup>The touch control item 426, a map operation touch control item 428, and a needle guide touch control item 430. Combine 4a to 4c describe these exemplary touch control items in further detail.
FIG. 20A depicts an illustrative embodiment of an exemplary medical ultrasonic imaging device 2000 implemented in the external dimensions of a tablet computer according to an embodiment of the present invention. The tablet computer can have a size of 12.5"x 1.25"x 8.75" or 31.7cm x 3.175cm x 22.22cm, but it can also have a size less than 2500cm<sup>3</sup>One volume and one weight less than 8lbs in any other suitable appearance size. As shown in FIG. 20A, the medical ultrasound imaging device 2000 includes a housing 2030, a touch screen display 2010, which can display ultrasound images 2010 and ultrasound data 2040, and ultrasound control items 2020 are configured to be touched by a touch The screen display 2010 is controlled. The housing 2030 may have a front panel 2060 and a rear panel 2070. The touch screen display 2010 forms the front panel 2060 and includes one or more multi-point and/or simultaneous touches of a multi-touch LCD touch that can identify and distinguish the user on the touch screen display 2010 Screen. The touch screen display 2010 may have a capacitive multi-touch and AVAH LCD screen. For example, capacitive multi-touch and AVAH LCD screens allow a user to view images from multiple angles without loss of resolution. In another embodiment, the user can use a stylus to input data on the touch screen. The tablet computer may include an integrated foldable stand that allows a user to rotate the stand from a storage position conforming to the external dimensions of the tablet computer so that the device can lie flat on the back panel, or instead Sexually, the user can rotate the stand so that the tablet computer can stand in an upright position at one of a plurality of inclination angles relative to a supporting surface.
The capacitive touch screen module includes an insulator (for example, glass) coated with a transparent conductor (for example, indium tin oxide). The manufacturing process may include a bonding process between glass, x-sensor film, y-sensor film, and a liquid crystal material. The tablet computer is configured to allow a user to perform multi-touch gestures (such as pinch and open) while wearing a dry glove or a wet glove. The surface of the screen records the electrical conductors in contact with the screen. This contact distorts the electrostatic field of the screen, resulting in a measurable change in capacitance. Then, a processor interprets the static electricity Changes in the field. Increase the response level by using "in-cell" technology to reduce layers and generate a touch screen. "In-cell" technology reduces layers by placing capacitors in the display. The application of "in-cell" technology reduces the visual distance between the users finger and the touch screen target, thereby generating a more directional contact with one of the displayed content and enabling the click gesture to have One response increased.
FIG. 20B depicts an illustrative embodiment of an exemplary medical ultrasound imaging device 2000 implemented in a tablet size and configured to receive a wireless SIM card according to an embodiment of the present invention. In this particular embodiment, the ultrasonic imaging apparatus/device 2000 includes a SIM card port 2080 configured to receive a SIM card 2084 and connect the SIM card circuit to a wireless communication circuit in the device. The SIM card port 2080 in this embodiment includes internal metal contacts that connect the ID circuit of the SIM card 2084 to the circuit of the device 2000. In this particular example, a SIM card tray 2082 is configured to receive a SIM card 2084 and connect it to the SIM card port 2080. In some embodiments, the SIM card port 2080 and/or the SIM card tray 2082 can be configured to accept a standard SIM card, small SIM card, micro SIM card, nano SIM card, or other similar wireless identification/authorization cards or circuits .
Figure 21 illustrates a preferred cart system for a modular ultrasonic imaging system according to an embodiment of the present invention. The cart system 2100 uses a base assembly 2122 that includes a docking frame for receiving a tablet computer. The cart configuration 2100 is configured to connect a tablet computer 2104 including a touch screen display 2102 to a cart 2108, which may include a complete operator console 2124. After the tablet computer 2104 is attached to the cart stand 2108, the system is formed to rotate around one of the complete features of the system. Rotating around the complete feature of the system may include an adjustable height device 2106, a gel holder 2110 and a bin 2114, a plurality of wheels 2126, a thermal probe holder 2120, and an operator console 2124. The control device may include a keyboard 2112 on the operator console 2124, and the keyboard 2112 may also have other peripheral devices added (such as a printer or a video interface or other control devices).
FIG. 22 illustrates a preferred cart system for an embodiment with a modularized ultrasound imaging system according to an embodiment of the present invention. The cart system 2200 can be configured using a vertical support member 2212 coupled to a horizontal support member. An auxiliary device connector 2018 having a position for auxiliary device attachment 2014 may be configured to be connected to the vertical support member 2212. A 3-port probe MUX connection device 2016 can also be configured to connect to a tablet computer. A storage box 2224 can be configured to be attached to the vertical support member 2212 by a storage box attachment mechanism 2222. The cart system can also include a rope management system 2226 that is configured to attach to a vertical support member. The cart assembly 2200 includes a support beam 2212 mounted on a base 2228. The support beam 2212 has wheels 2232 and a battery 2230 that provides power for the extended operation of the tablet computer. The assembly may also include an accessory holder 2224 installed using a height adjustment device 2226. The holders 2210 and 2218 can be installed on the beam 2212 or the console panel 2214. The multi-port probe multiplexer device 2216 is connected to the tablet computer to provide the user with simultaneous connection of several sensor probes that can be sequentially selected using the displayed virtual switch. Move a touch gesture (such as a three-finger flick) to one of the displayed images or touch a displayed virtual button or icon to switch between connected probes.
Figure 23A illustrates a preferred cart mount system for a modular ultrasonic imaging system according to an embodiment of the present invention. Configuration 2300 depicts tablet computer 2302 coupled to docking station 2304. The docking station 2304 is fixed to the attachment mechanism 2306. The attachment mechanism 2306 may include a hinge member 2308 that allows the user's display to tilt to a position desired by the user. The attachment mechanism 2306 is attached to the vertical part 2312. A tablet computer 2302 as described herein can be mounted on a base connecting unit 2304 which is mounted on a mounting seat assembly 2306 on the top of the beam 2212. The base unit 2304 includes a bracket 2310, an electrical connector 2305 for connecting the system 2302 to the battery 2230 and the multiplexer device 2216, and a port 2307.
Figure 23B illustrates a cart mount system for a modular ultrasonic imaging system configured to receive a wireless SIM card according to an embodiment of the present invention. In this particular reality In an embodiment, the docking station 2304 includes a SIM card port 2080 configured to receive a SIM card 2084 and connecting the SIM card circuit to a wireless communication circuit located in the docking station 2304 or tablet computer 2302. In this particular example, a SIM card 2084 can be directly inserted into the SIM card port 2080, while in other examples a SIM card tray (such as the SIM card tray shown in FIG. 20B) can be used to connect the SIM card 2084 to Metal contacts in the SIM card port 2080. In some embodiments, the SIM card port 2080 and/or the SIM card tray 2082 can be configured to accept a standard SIM card, small SIM card, micro SIM card, nano SIM card, or other similar wireless identification/authorization cards or circuits .
FIG. 24 illustrates a preferred cart system 2400 for a modular ultrasonic imaging system according to an embodiment of the present invention, in which a connector 2404 is used to connect a tablet computer 2402 to the mounting assembly 2406. The configuration 2400 depicts a tablet computer 2402 coupled to the vertical support member 2408 via the attachment mechanism 2404 without the engagement element 2304. The attachment mechanism 2404 may include a hinge part 2406 for display adjustment.
25A and 25B illustrate a multifunctional docking station system 2500. FIG. 25A shows a docking station 2502 and a tablet computer 2504 having a base assembly 2506 docked to the docking station 2502. The tablet computer 2504 and the docking station 2502 can be electrically connected. The tablet computer 2504 can be released from the docking station 2502 by engaging the release mechanism 2508. The docking station 2502 may include a sensor port 2512 for connecting a sensor probe 2510. The docking station 2502 can contain 3 USB 3.0 ports, a LAN port, a headphone socket and a power connector for charging. FIG. 25B shows a side view of a tablet computer 2504 and a docking station 2502 with a stand according to a preferred embodiment of the present invention. The docking station may include an adjustable bracket/grip 2526. The adjustable stand/grip 2526 can be tilted for multiple viewing angles. The adjustable stand/grip 2526 can be flipped upward for transportation purposes. The side view also shows a sensor port 2512 and a sensor probe connector 2510.
Referring to FIG. 26A, the integrated detection head system 2600 includes a front-end detection head 2602, a host computer 2604, and a portable information device (such as a human assistant (PDA) 2606). Should The PDA 2606 (such as a Palm Pilot device or other handheld computing device) is a remote display and/or recording device 2606. In the illustrated embodiment, the front-end probe 2602 is connected to the host computer 2604 via a communication link 2608 (which is a wired link). The host computer 2604 (a computing device) is connected to the PDA 2606 via a communication link or interface 2610 (which is a wireless link 2610).
Since the integrated ultrasonic probe system 2600 in the described embodiment has a Windows®-based host computer 2604, the system can utilize a wide selection of software available for the Windows® operating system. A potentially useful application is to electrically connect an ultrasound system to allow physicians to use the system to send and receive messages, diagnostic images, commands, reports, or even remotely control the front-end probe 2602.
The connection via the communication link or interface 2608 and 2610 can be wired via an Ethernet or via a wireless communication link (such as but not limited to: IEEE 802.11a, IEEE 802.11b, Hyperlink or HomeRF) ) Is wireless. FIG. 26A shows a wired link used for the communication link 2608 and a wireless link used for the communication link 2610. FIG. It should be appreciated that other wired embodiments or protocols may be used.
The wireless communication link 2610 may use various protocols (such as an RF link), and may use all or part of a dedicated protocol (such as IEEE 1394 protocol stack or Bluetooth system protocol stack) to implement these different protocols. IEEE 1394 is a preferred interface for high-bandwidth applications (such as high-quality digital video editing of ultrasound imaging data). The Bluetooth protocol uses a combination of circuit and packet switching. The time slot can be reserved for synchronizing packets. Bluetooth can support one asynchronous data channel (up to three simultaneous simultaneous channels), or support one channel of asynchronous data and synchronous voice at the same time. Each synchronization channel supports one 64kb/s synchronization (voice) channel in each direction. Asynchronous channels can support up to 723.2kb/s asymmetrical or 433.9kb/s symmetrical.
The Bluetooth system consists of a radio unit, a link control unit, and a support unit for link management and host terminal interface functions. The link controller implements the baseband protocol and other low-level link routines.
The Bluetooth system provides a point-to-point connection (only involving two Bluetooth units) or a single point-to-multipoint connection. In this single-point-to-multipoint connection, a channel is shared among several Bluetooth units. Two or more units sharing the same channel form a piconet. A Bluetooth unit serves as the master unit of the piconet, and the other units serve as slave units. Up to seven slave units can be active in a piconet.
The Bluetooth link controller has two main states: STANDBY and CONNECTION. In addition, there are seven sub-states: paging, paging scan, inquiry, inquiry scan, master unit response, slave unit response, and inquiry response. These sub-states are used to add new slave units to the temporary state of a piconet.
It is also possible to use (but not limited to) Home RF or IEEE 802.11 wireless LAN specifications to implement the link. For more information about the IEEE 802.11 wireless LAN specifications, see IEEE Standards for Wireless LANs, which is incorporated herein by reference. The IEEE standards can be found at www.ieee.org on the World Wide Web's Global Resource Locator (URL). For example, the hardware supports the IEEE standard 802.11b to provide one communication link at 2 Mbps and 11 Mbps for two personal computers. The frequency band allocated for signal transmission and reception is about 2.4 GHz. In contrast, the IEEE standard 802.11a provides 54 Mbps communication. The frequency allocation for this standard is about 5GHz. Recently, merchants (such as Proxim) have manufactured PC cards and access points (base stations) that use a proprietary data doubling, chipset technology to achieve 108 Mbps communication. A chip (AR5000) with doubled data, manufactured by Atheros Communications. As with any radio system, the actual data rate maintained between two computers is related to the physical distance between the transmitter and receiver.
The wireless link 2610 may also take other forms (such as an infrared communication link defined by the Infrared Data Association (IrDA)). Depending on the desired communication type (ie, Bluetooth, infrared, etc.), the host computer 5 and the remote display and/or recording device 9 each have the desired communication port.
Figure 26B shows the communication link 2608 between the probe 3 and the host computer 5 as a wireless link. The communication link 2610 between the host computer 2604 and the PDA 2606 is shown as a wired link.
The integrated probe system 2600 of FIG. 26C has a wireless link for both the communication link 2608 between the probe 2602 and the host computer 2604 and the communication link 2610 between the host computer 2604 and the PDA 2606 . It should be recognized that wired links and wireless links can be used together or alternatively can be purely wired links or wireless links in a system 2600.
The remote display and/or recording device 2606 of the integrated probe system 2600 in FIG. 27 is a remote computing system 2612. In addition to remote display and/or recording capabilities, the remote computing system 2612 can also remotely control the probe 2602. The communication link 2610 is shown as a wireless link. The communication link 2608 between the probe 2602 and the host computer 2604 is shown as a wired link.
An example of a remote control system includes the use of a wearable computer (such as a portable computer manufactured by Xybernaut), a pair of high-speed, wireless PC cards (such as those provided by Proxim), and ultrasonic programs and detectionhead2602. A portable network-connected ultrasound system can be configured to weigh less than 2.5 pounds. Use a program similar to Microsoft® NetMeeting to establish an instant connection between a remote PC and a portable computer. The remote host can monitor all interactions with the portable computer, including real-time ultrasound imaging (at a display rate of up to about 4 frames per second). NetMeeting can also be used to "control" a portable computer and real-time management of ultrasound sessions from remote personal computers. In addition, it can transfer images and repetitive executable software commands to the host computer at 108Mbps. With this technology, it can match a hard-wired local area network (LAN) rate of 100 million bits per second (100Mbps) to perform real-time ultrasound diagnosis and relay ultrasound diagnosis to a remote field of vision.
FIG. 28 shows an integrated detection head system 2800 having a hub 2802 for connecting a plurality of remote devices 2606 to a host computer 2604. From the hub 2802 to the remote The communication link 2804 of the device is shown as both a wireless link and a wired link. It should be recognized that a fully wired network (such as a LAN or Ethernet) can be used. Alternatively, using one of the wireless transceivers and ports in each of the computers (remote devices) 2606 can easily build a wireless network/communication system. Using recent high-speed wireless standards (such as IEEE 802.11a), the communication between the remote machine and the local machine can match that of a wired, 100Mbps local area network (LAN). Another alternative is to use a Bluetooth system to form a piconet.
The increase in the use of combined audio-visual and computer data has led to a greater need for multimedia network connectivity and the solutions included in the preferred embodiments of the present invention are beginning to appear. The standardization of multimedia network connections is underway, and IEEE 1394 has emerged as an important competitor that can interface with many audio-visual (AV) computers and other digital consumer electronic devices and provide a transmission bandwidth of up to 400Mbps.
The preferred embodiment uses IEEE 1394 technology, which uses a wireless solution for 1394 via IEEE 802.11 (the emerging standard for wireless data transmission in enterprise environments and increasingly in the home) Transmission of the agreement. In a preferred embodiment, IEEE 1394 is implemented as a Protocol Alignment Layer (PAL) on top of the 802.11 radio hardware and the Ethernet protocol, which brings about the convergence of one of these important technologies. This protocol docking layer enables the PC to operate as a wireless 1394 device. The engineering design goal is to make the actual delivered IEEE 1394 bandwidth sufficient for a single high-definition MPEG2 video stream (or multiple standard-definition MPEG2 video streams) from one room in a facility to another One-room transmission.
The preferred embodiment of the present invention includes the use of wireless transmission of IEEE 1394 at 2.4 GHz using Wi-LAN's Wideband Orthogonal Frequency Division Multiplexing (W-OFDM) technology. This development establishes W-OFDM (the most bandwidth-efficient wireless transmission technology) as one of the technologies that can provide the data rate required for home multimedia network connections.
The wireless IEEE 1394 system includes an MPEG-2 data stream generator that feeds a multi-transport stream such as those provided by Philips Semiconductors provides a set-top box (STB). The STB converts the signal to an IEEE 1394 data stream and applies the IEEE 1394 data stream to a W-OFDM radio system such as provided by Wi-LAN.TM. Then, the radio transmitter sends the IEEE 1394 data stream via the air to, for example, the corresponding W-OFDM receiver in the host computer. On the receiving side, the IEEE 1394 signal is demodulated and sent to two STBs, which display the contents of different MPEG-2 data streams on two separate TV monitors. Use IEEE As the interface of the wired part of the network, 1394 optimizes the entire system for the transmission of isochronous information (voice, live video) and provides an ideal interface for multimedia devices in the facility. The W-OFDM technology is essentially immune to multipath effects. As with all modulation schemes, OFDM encodes data within a radio frequency (RF) signal. Radio communications are often hindered by noise, stray interference, and reflected signals. By sending high-speed signals simultaneously on different frequencies, OFDM technology provides robust communication. Systems with OFDM capabilities are highly tolerant of noise and multipath, so that wide-area and home multi-point coverage becomes possible. In addition, because these systems are very efficient in using bandwidth, more high-speed channels are possible in one frequency band. W-OFDM is a cost-effective variant of OFDM that allows a much larger throughput than conventional OFDM by using a wide frequency band. W-OFDM further processes the signal to maximize the range. These improvements to the conventional OFDM result in a drastically increased transmission rate.
OFDM technology is becoming more and more visible, because the United States and the European Standardization Committee are choosing it as the only technology that can provide reliable wireless high data rate connections. European terrestrial digital video broadcasting uses OFDM and the IEEE 802.11 working group recently selected OFDM in its 6Mbps to 54Mbps wireless LAN standard. The European Telecommunications Standards Institute is considering W-OFDM for the ETSI BRAN standard. Detailed information about Wi-LAN.TM. can be found on the website http://www.wi-lan.com/Philips Semiconductors. Philips Semiconductors is a Royal company based in Eindhoven, the Netherlands. A division of Philips Electronics. Can be accessed by http://www.semiconductors.philips.com/ Visit its homepage for additional information about Philips Semiconductors.
In addition, a NEC based on IEEE 1394 high-speed serial bus can be used in the preferred embodiment, which can reach 400 megabits (Mbps) with a transmission range of up to 7 meters through the inner wall and up to 12 meters in the line of sight. The company's wireless transmission technology. With the development of an amplitude shift keying (ASK) modulation scheme and a low-cost transceiver, this embodiment uses a 60GHz millimeter wavelength for transmission, which does not require any kind of authorization. This embodiment incorporates an echo detection function in NEC's PD72880400Mbps long-distance transmission physical layer device to prevent the influence of signal reflection (this is a significant obstacle to the stable operation of IEEE 1394 via a wireless connection).
Wireless IEEE 1394 can play an important role in bridging a PC to a cluster of interconnected IEEE 1394 devices (which can be in another room in the facility). Three exemplary applications are to source video or audio streams from a PC, provide Internet content and connectivity to an IEEE 1394 cluster, and provide command, control, and configuration capabilities to the cluster. In the first embodiment, the PC can provide data to someone in another room in one facility. In the second embodiment, the PC can provide a channel for the 1394-enabled device to access the Internet. In the third embodiment, the PC plays the role of carefully arranging activities in the 1394 cluster and routing data within the cluster and via the bridge (although the actual data does not flow through the PC).
Figure 29 is a diagram showing the deployment of wireless access to images generated by a preferred embodiment ultrasound imaging system and associated architecture 2902. The imaging system 2906 exports the patient information and images to the files in the corresponding folder 2908. The executable software instructions have all the functionality required to implement the ultrasonic imaging method described above.
The wireless proxy 2910 is used to detect the patient directory and image files and open a port so that the wireless client can get a connection to it. After establishing a connection 2914, it sends the patient list and corresponding images back to the client. For example, the wireless agent 2910 may include a data interface circuit, and the data interface circuit may include a first port (such as an RF interface port).
The wireless viewer 2912 residing on the side of a handheld device can be built into a wireless proxy The connection of the device 2910 and the retrieval of patient and image information. After the user selects the patient and the image, it starts the file transfer from the wireless agent. After receiving an image, the viewer 2912 displays the image together with patient information. The image is stored on the handheld device for future use. Handheld device users can view images captured in previous sessions or can request new image transmissions.
FIG. 33 is a block diagram of a portable information device (such as a personal assistant (PDA) or any computing device) according to an exemplary embodiment of the present invention. The link interface or data interface circuit 3310 illustrates (but is not limited to) a link interface for establishing a wireless link to another device. The wireless link is preferably an RF link defined by the IEEE 1394 communication specification. However, the wireless link can take other forms (such as an infrared communication link as defined by the Infrared Data Association (IrDA)). The PDA includes a processor 3360 capable of executing an RF stack 3350 that communicates with a data interface circuit 3310 via a bus 3308. The processor 3360 is also connected to the user interface circuit 3370, the data storage 3306, and the memory 3304 through the bus 3308.
The data interface circuit 3310 includes a port (such as an RF interface port). The RF link interface may include a first connection 3312 that includes a radio frequency (RF) circuit 3314 for converting a signal into a radio frequency output and for receiving radio frequency input. The RF circuit 3314 can send and receive RF data communication via a transceiver built into the communication port 1026. The RF communication signal received by the RF circuit 3314 is converted into an electrical signal and relayed to the RF stack 3350 in the processor 3360 via the bus 3308. The radio interfaces 3314, 3316 and links between a laptop personal computer (PC) (host computer) and a PDA can be implemented by (but not limited to) IEEE 1394 specifications.
Similarly, the PC host computer has an RF stack and circuit capable of communicating to a remotely located video viewer. In a preferred embodiment, the remote image viewer can be used to monitor and/or control the ultrasound imaging operation (rather than just display the obtained imaging data).
The current market offers many different options related to wireless connectivity. In a better reality In the embodiment, the spread spectrum technology wireless LAN is used. Among wireless LAN solutions, the most advanced is the 802.11b standard. Many manufacturers provide 802.11b compliant devices. Compatibility with selected handheld devices is the main criterion in one of the designated categories of wireless connectivity options.
The handheld device market also offers a variety of handheld devices. For imaging purposes, it is very important to have a high-quality screen and sufficient processing power to display an image. Considering these factors, in a preferred embodiment, a Compaq iPAQ is used, and in particular, a Compaq iPAQ 3870 is used. Use a wireless PC card compatible with handheld devices (such as Compaq's wireless PC card WL110 and the corresponding wireless access point).
Figure 30 shows an image viewer 3020 communicating with a personal computer in a preferred embodiment or a probe in an alternative embodiment. The image viewer has user interface buttons 3022, 3024, 3026, 3028 that allow the user to interface with the ultrasound imaging system computer or probe according to the preferred embodiment of the present invention. In a preferred embodiment, a communication interface (such as button 3022) allows the user to initiate a connection with one of the ultrasound imaging applications. Similarly, the button 3024 is used to terminate the established connection with one of the ultrasound imaging applications. A button 3026 is used as a selection button for providing a patient list and corresponding images. Save these images locally or remotely. If selected, the image that can be stored remotely is transmitted to the viewer. The selected image is displayed on the viewer 3030.
The additional communication interface button (such as button 3028) serves as an option button, which can (but is not limited to) allowing configuration parameters (such as an Internet Protocol (IP) address) to be changed.
FIG. 31 is a diagram showing a preferred embodiment ultrasound image collection and distribution system 3140 including one of four main software components. The main hardware components of the system are ultrasonic probes 3142a to 3142n. The probes communicating with the laptop computers 3144a to 3144n allow generating ultrasound images and related patient information and submit the images and information to an image/patient information distribution server 3146. The distribution server uses a SQL database server 3148 to store and retrieve images and related patient information. The SQL server provides distributed database management. Multiple workstations can manipulate the data stored on the server, and the server coordinates operations and execution Resource-intensive computing.
The image viewing software or executable commands can be implemented in two different embodiments. In a first embodiment, a fully fixed version of the video viewer as described in Figure 30 can reside on a workstation or laptop equipped with a high-bandwidth network connection. In a second embodiment, a lightweight version of the video viewer can reside in a small handheld Pocket PC 3020 equipped with an IEEE 802.11b and/or IEEE 802.11a compliant network card. The handheld personal computer video viewer only implements limited functionality that allows basic video viewing operations. The wireless network protocol 3150 (such as IEEE 802.11) can be used to transmit information to a handheld device or other computing device 3152 that communicates with a hospital network.
This preferred embodiment describes an ultrasound imaging system that covers a wide range of image collection and capture needs of hospitals. It also provides instant access to non-imaging patient-related information. In order to provide information exchange between hospitals, the image distribution server has the ability to maintain mutual connectivity across the wide area network.
In another preferred embodiment, the probe 3262 can directly use a wireless communication link 3266 to communicate with a remote computing device (such as a PDA 3264), as shown in the system 3260 of FIG. 32. The communication link can use the IEEE 1394 protocol. Both the probe and the PDA3302 have an RF stack and circuit described with reference to FIG. 33 to communicate using wireless protocols. The detection head includes a sensor array, beamforming circuit, transmission/receiving module, a system controller and digital communication control circuit. Provide ultrasound image data in PDA for post-processing (including scan conversion).
FIG. 34 is a schematic diagram 3440 of an imaging and telemedicine system of the integrated ultrasound system 3442 according to a preferred embodiment of the present invention. The preferred embodiment of the system outputs real-time RF digital data or front-end data.
As will be understood, the various wireless connections described herein (such as ultrasound clinics 3442 (for example, for ultrasound capture), community clinics 3446 (for example, for general telemedicine capture), radiology clinics 3448 (for example, , For film digital capture) and the connection 3444 between the heart clinic 3450 (for example, for echocardiographic imaging capture); and the connection shown in Figure 26A to Figure 29 and Figure 31 to Figure 32) can Includes 3G, 4G, GSM, CDMA, CDMA2000, W-CDMA or any other suitable wireless connection using any number of communication protocols. In some love In this case, the ultrasound imaging device can be configured to respond to a command from the user executed via the touch-sensitive user interface (UI) of the ultrasound imaging screen to initiate a wireless connection with a remote computer or one of other electronic devices . For example, during, before, or after performing an ultrasound procedure, a user can initiate a wireless connection with a hospital or doctor to transmit ultrasound imaging data. The data can be transmitted in real time when the data is generated, or the data that has been generated can be transmitted. It is also possible to initiate an audio and/or video connection via the same wireless network so that the user of the ultrasound imaging device can contact a hospital or doctor while performing the procedure. Navigate through the touch screen UI provided on the ultrasound imaging screen and/or select the options described in this article. In some embodiments, JavaScript or some other browser-based technology may be used to provide all or part of the touch screen UI to the user via a wireless network. Part of the UI can be executed on the device or remotely, and various device-side and/or server-side technologies can be implemented to provide various UI features described herein.
FIG. 35 illustrates a 2D imaging operation mode using a modular ultrasonic imaging system according to an embodiment of the present invention. The touch screen of the tablet computer 2504 can display the image obtained by the two-dimensional sensor probe using a 256-digit beamformer channel. The 2D image window 3502 depicts a 2D image scan 3504. The flexible frequency control 3506 can be used to obtain two-dimensional images, where the control parameters are displayed on the tablet computer.
FIG. 36 illustrates a motion operation mode using a modularized ultrasound imaging system according to an embodiment of the present invention. The touch screen display 3600 of the tablet computer can display images obtained through a motion operation mode. The touch screen display 3600 of the tablet computer can display the two-dimensional mode imaging 3606 and the sports mode imaging 3608 at the same time. The touch screen display 3600 of the tablet computer can display a two-dimensional image window 3604 with a two-dimensional image 3606. The flexible frequency control item 3506 displayed on the graphical user interface can be used to adjust the frequency from 2MHz to 12MHz.
FIG. 37 illustrates a color Doppler operation mode using a modularized ultrasound imaging system according to an embodiment of the present invention. Tablet computer touch screen display 3700 display The image obtained by the color Doppler mode of operation. A two-dimensional image window 3706 is used as the base display. The color coded information 3708 is overlaid on the two-dimensional image 3710. The ultrasound-based imaging of red blood cells is derived from the received echo of the transmitted signal. The main characteristics of the echo signal are frequency and amplitude. The amplitude depends on the amount of moving blood within the volume sampled by the ultrasonic beam. The monitor can be used to adjust a high frame rate or high resolution to control the quality of scanning. Higher frequencies can be generated by fast blood flow and can be displayed in lighter colors, while lower frequencies are displayed in darker colors. The flexible frequency control item 3704 and the color Doppler scan information 3702 can be displayed on the tablet computer display 3700.
FIG. 38 illustrates a pulse wave Doppler operation mode using a modular ultrasonic imaging system according to an embodiment of the present invention. The touch screen display 3800 of the tablet computer can display the image obtained by the pulse wave Doppler operation mode. The pulse wave Doppler scan generates a series of pulses used to analyze the blood flow in a small area along a desired ultrasound cursor (called the sample volume or sample gate 3812). The tablet computer display 3800 can depict a two-dimensional image 3802 in which the sample volume/sample gate 3812 is overlapped. The tablet computer display 3800 can use a hybrid operating mode 3806 to depict a two-dimensional image 3802 and a time/Doppler shift 3810. If an appropriate angle between the beam and blood flow is known, the time/Doppler shift 3810 can be converted into velocity and blood flow. The gray shading 3808 in the time/Doppler shift 3810 can represent the strength of the signal. The thickness of the spectral signal can indicate laminar blood flow or turbulence. The tablet display 3800 can depict an adjustable frequency control 3804.
FIG. 39 illustrates a triple scanning mode of operation using a modular ultrasound imaging system according to an embodiment of the present invention. The tablet computer display 3900 may include a two-dimensional window 3902 capable of displaying two-dimensional images alone or in combination with color Doppler or directional Doppler features. The touch screen display 3900 of the tablet computer can display the image obtained by the color Doppler operation mode. A two-dimensional image window 3902 is used as the base display. The color coded information 3904 is overlaid 3906 on the two-dimensional image 3916. The pulse wave Doppler feature can be used alone or in combination with two-dimensional imaging or color Doppler imaging. Tablet PC monitor 3900 can be packaged Containing a sample volume/sample gate 3908 by overlaying on the two-dimensional image 3916 or by color code overlaying 3906 (alone or in combination) represents a pulse wave Doppler scan. The tablet display 3900 can depict a divided screen that represents a time/Doppler shift 3912. If an appropriate angle between the isolated beam and the blood flow is known, the time/Doppler shift 3912 can be converted into velocity and blood flow. The gray shading 3914 in the time/Doppler shift 3912 can indicate the strength of the signal. The thickness of the spectral signal can indicate laminar blood flow or turbulence. The tablet display 3900 can also depict the flexible frequency control item 3910.
FIG. 40 illustrates a GUI main screen interface 4000 for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. The screen interface 4000 for a user operation mode can be displayed when the ultrasound system is activated. To assist a user in navigating the GUI main screen 4000, the main screen can be regarded as including three exemplary work areas: a function list 4004, an image display window 4002, and an image control bar 4006. Additional GUI components can be provided on the main GUI main screen 4000 to enable a user to close the GUI main screen and/or the windows in the GUI main screen, adjust the GUI main screen and/or the windows in the GUI main screen Size and exit the GUI main screen and/or the windows in the GUI main screen.
The function list 4004 enables the user to select the ultrasound data, images, and/or videos to be displayed in the image display window 4002. The function list can include components for selecting one or more files in a patient folder directory and an image folder directory.
The image control bar 4006 includes touch control items that can be operated by touch and touch gestures directly applied to the surface of the display by the user. Exemplary touch control items may include (but are not limited to): a depth control touch control item 4008, a two-dimensional gain touch control item 4010, a full-screen touch control item 4012, a text touch control item 4014, a Split screen touch control 4016, one ENV touch control 4018, one CD touch control 4020, one PWD touch control 4022, one freeze touch control 4024, one storage touch control 4026 and one most Jiahua touch control item 4028.
FIG. 41 illustrates a GUI function table screen interface 4100 for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. When the menu selection mode is triggered from the function list 4104 to initiate the operation of the ultrasound system, a screen interface 4100 for a user operation mode can be displayed. To assist a user in navigating the GUI main screen 4100, the main screen can be regarded as including three exemplary work areas: a function list 4104, an image display window 4102, and an image control bar 4120. Additional GUI components may be provided on the main GUI menu screen 4100 to, for example, enable a user to close the GUI menu screen and/or windows in the GUI menu screen, adjust the GUI menu screen and/or the The size of the window in the GUI menu screen and exit the GUI menu screen and/or the window in the GUI menu screen.
The function list 4104 enables the user to select the ultrasound data, images, and/or videos to be displayed in the image display window 4102. The function list 4104 can include touch control components for selecting one or more files in a patient folder directory and an image folder directory. The list of functions depicted in an extended format 4106 may include exemplary touch controls, such as a patient touch control 4108, a default touch control 4110, a view touch control 4112, a report touch Control item 4114 and a setting touch control item 4116.
The image control bar 4120 includes touch control items that can be operated by touch and touch gestures directly applied by a user to the surface of the display. Exemplary touch control items may include (but are not limited to): depth control touch control item 4122, a two-dimensional gain touch control item 4124, a full-screen touch control item 4126, a text touch control item 4128, and a split Screen touch control 4130, one-pin visualization ENV touch control 4132, one CD touch control 4134, one PWD touch control 4136, one freeze touch control 4138, one storage touch control 4140 and An optimized touch control item 4142.
FIG. 42 shows a GUI patient data screen interface 4200 for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. When the ultrasound system is activated, when the self-function list 4202 triggers the patient selection mode, it can be displayed for a Screen interface 4200 for user operation mode. To assist a user in navigating the GUI patient data screen 4200, the patient data screen can be regarded as including five exemplary work areas: a new patient touch screen control 4204, a new research touch screen control 4206, and one Research list touch screen control 4208, a task list touch screen control 4210, and an edit touch screen control 4212. In each touch screen control, further information input fields 4214 and 4216 are available. For example, the patient information section 4214 and the research information section 4216 can be used to record data.
In the patient data screen 4200, the image control bar 4218 includes touch control items that can be operated by touch and touch gestures directly applied by the user to the surface of the display. Exemplary touch control items may include (but are not limited to): accept research touch control item 4220, close research touch control item 4222, print touch control item 4224, print preview touch control item 4226, eliminate touch A control item 4228, a two-dimensional touch control item 4230, a frozen touch control item 4232, and a storage touch control item 4234.
FIG. 43 illustrates a GUI patient data screen interface 4300 (such as a preset parameter screen interface) for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. When the ultrasound system is activated, the screen interface 4300 for a user operation mode can be displayed when the self-function list 4302 triggers the preset selection mode 4304.
In the default screen 4300, the image control bar 4308 includes touch control items that can be operated by touch and touch gestures directly applied to the surface of the display by the user. Exemplary touch control items may include (but are not limited to): a save setting touch control item 4310, a delete touch control item 4312, a CD touch control item 4314, a PWD touch control item 4316, and a freeze touch control item Item 4318, a stored touch control item 4320, and an optimized touch control item 4322.
FIG. 44 illustrates a GUI view screen interface 4400 for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. When the ultrasound system is activated, when the self-function list 4402 triggers the preset extended view 4404, it can be displayed for a Screen interface 4400 for user operation mode.
In the viewing screen 4400, the image control bar 4416 includes touch control items that can be operated by touch and touch gestures directly applied to the surface of the display by the user. Exemplary touch control items may include (but are not limited to): a thumbnail setting touch control item 4418, a synchronized touch control item 4420, a selected touch control item 4422, a previous image touch control item 4424, a next image Touch control item 4426, a two-dimensional image touch control item 4428, a pause image touch control item 4430, and a stored image touch control item 4432.
An image display window 4406 can allow the user to view images in a plurality of formats. The image display window 4406 can allow a user to view the images 4408, 4410, 4412, 4414 in a combination or a subset or to view any of the images 4408, 4410, 4412, 4414 individually. The image display window 4406 can be configured to display up to four images 4408, 4410, 4412, 4414 to be viewed simultaneously.
FIG. 45 illustrates a GUI report screen interface for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. When the ultrasound system is activated, when the report extended view 4504 is triggered from the function list 4502, the screen interface 4500 for a user operation mode can be displayed. The display screen 4506 contains ultrasound report information 4526. The user can use the worksheet selection in the ultrasound report 4526 to enter remarks, patient information, and research information.
In the report screen 4500, the image control bar 4508 contains touch control items that can be operated by touch and touch gestures directly applied by the user to the surface of the display. Exemplary touch controls may include (but are not limited to): one save touch control 4510, one save as touch control 4512, one print touch control 4514, one print preview touch control 4516, one close Study the touch control item 4518, a two-dimensional image touch control item 4520, a frozen image touch control item 4522, and a stored image touch control item 4524.
FIG. 46A illustrates a GUI setting screen interface for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. When the ultrasound system is activated In the system, when the report extended view 4604 is triggered from the function list 4602, the screen interface 4600 for a user operation mode can be displayed.
In the setting extension screen 4604, the setting control bar 4644 contains touch control items that can be operated by touch and touch gestures directly applied to the surface of the display by the user. Exemplary touch control items may include (but are not limited to): a general touch control item 4606, a display touch control item 4608, a measurement touch control item 4610, an annotation touch control item 4612, a print touch control item Control 4614, a storage/acquisition touch control 4616, a DICOM touch control 4618, an export touch control 4620, and a research information image touch control 4622. The touch control items may include a display screen that allows the user to input configuration information. For example, the universal touch control item 4606 includes a configuration screen 4624 in which the user can input configuration information. In addition, the universal touch control item 4606 contains a choice that allows the user to configure the soft key connection position 4626. Figure 46B depicts a soft key control 4652 with a right-side alignment. Figure 46B further illustrates that activation of the soft key control arrow 4650 will change the key alignment to the opposite side (in this case, the left alignment). FIG. 46C depicts the left side alignment of the soft key control item 4662. The user can initiate a directional change by using the soft key control arrow 4660 to change the position to the right side alignment.
In the viewing screen 4600, the image control bar 4628 includes touch control items that can be operated by touch and touch gestures directly applied to the surface of the display 4664 by the user. Exemplary touch control items may include (but are not limited to): a thumbnail setting touch control item 4630, a synchronized touch control item 4632, a select touch control item 4634, a previous image touch control item 4636, one image next Touch control item 4638, a two-dimensional image touch control item 4640, and a pause image touch control item 4642.
FIG. 47 illustrates a GUI setting screen interface for using a user operation mode of a modular ultrasonic imaging system according to an embodiment of the present invention. When the ultrasound system is activated, a screen interface 4700 for a user operation mode can be displayed when the report extended view 4704 is triggered from the function list 4702.
In the setting extension screen 4704, the setting control bar 4744 contains touch control items that can be operated by touch and touch gestures directly applied to the surface of the display by the user. Exemplary touch control items may include (but are not limited to) a plurality of icons, such as a general touch control item 4706, a display touch control item 4708, a measurement touch control item 4710, and an annotation touch control item 4712 , A print touch control item 4714, a store/acquire touch control item 4716, a DICOM touch control item 4718, an export touch control item 4720, and a research information image touch control item 4722. The touch control items may include a display screen that allows the user to input storage/acquisition information. For example, the storage/acquisition touch control item 4716 includes a configuration screen 4702 in which the user can input configuration information. The user can activate a virtual keyboard that allows the user to input alphanumeric characters in different touch-activated fields. In addition, the storage/acquisition touch control item 4702 contains an option that allows the user to enable retroactive acquisition 4704. When the user activates the storage function, the default system is to store the expected movie playback. If the user enables retrospective acquisition, the storage function can collect movie playbacks retrospectively.
In the setting screen 4700, the image control bar 4728 includes touch control items that can be operated by touch and touch gestures directly applied by the user to the surface of the display. Exemplary touch control items may include (but are not limited to): a thumbnail setting touch control item 4730, a synchronized touch control item 4732, a select touch control item 4734, a previous image touch control item 4736, and an image next Touch control item 4738, a two-dimensional image touch control item 4740, and a pause image touch control item 4742.
A preferred embodiment of a miniaturized PC-enabled ultrasound imaging system runs on an industry standard PC and Windows® 2000 operating system (OS). Therefore, a network that is ideal and cost-effective for telemedicine solutions is ready. Provide open architecture support for embedding and therefore integration with third-party applications. The preferred embodiment includes an improved application programming interface (API), common interface, for third-party applications (for example, such as (but not limited to): radiation therapy planning, image-guided surgery, integrated Export support for solutions (for example, calculation, 3D and report packaging). The API provides application process The mode is used to initiate a set of software interrupts, calls, and data formats with network services, host communication programs, telephone equipment, or program-to-program communication contacts. Software-based feature enhancement reduces hardware obsolescence due to obsolescence and provides effective upgrades.
In addition, the preferred embodiment includes system-on-chip integrated circuits (ICs) that run on a PC and have a large number of channels, large dynamic range, high image quality, and complete feature set. , Extensive diagnostic overlay, minimum supply chain requirements, simplified design for simple testing and high reliability, and very low maintenance costs.
As previously described in this article, the preferred embodiment includes a PC-based design that is intuitive, has a simple graphical user interface, is easy to use and train, and utilizes PC industry know-how, sound electronic devices, and high-quality Display and low manufacturing cost. It also provides support for software control communication with other applications. These applications are embedded applications that allow patient data, scanner images, and current procedural terminology (CPT) code management. The current procedural terminology (CPT) code management It is a digital coding system by which doctors record all their procedures and services, doctors plans, and result evaluation reports on an integrated PC. The reform of healthcare has exerted pressure to reduce costs, highlighting the need for solutions for first visits/infield diagnosis, data storage and retrieval, which are combined with technological innovations (for example, based on medical digital imaging and Communication (DICOM) standard data storage and retrieval, broadband and image archiving and communication system (PACS)), driving changes in patient record storage, retrieval and transmission, and lower cost/handheld devices for ultrasound data acquisition The innovations in this aspect all implement the preferred embodiments of the present invention. The DICOM standard facilitates the dissemination and viewing of medical images (such as ultrasound, magnetic resonance imaging (MRI), and computer tomography (CT) scans, for example). Broadband is a term for wide area networks, which refers to a transmission facility that provides a bandwidth greater than 45 Mbps. Broadband systems are generally optical fibers in nature.
A preferred embodiment of the present invention provides image acquisition and end-user applications (for example, radiation therapy, surgery, angiography), all applications are executed on the same platform superior. This provides low-cost, user-friendly control through a common software interface. The ultrasound system has a scalable user interface for advanced users and an intuitive Windows®-based PC interface. A preferred embodiment of the ultrasound system is due to the features of one-stop image capture, analysis, storage, retrieval, and transmission of data and images, which also provide an improved diagnostic capability. Provides a high image quality with a 128-channel bandwidth. In addition to being easy to use, the ultrasound system also provides patient access at any time, at any location, and with any tool. A 10-ounce probe according to a preferred embodiment of the present invention is used to provide point of care imaging. Data storage and retrieval capabilities are based on the DICOM standard and compatible with existing third-party analysis and patient record systems. The ultrasound system according to a preferred embodiment also uses (such as but not limited to) email, LAN/WAN, DICOM, and a digital imaging network image archiving and communication system (DINPAC) to provide direct image transmission capabilities. The options for displaying the captured images include (but are not limited to): a desktop computer, a laptop computer, a portable personal computer, and a handheld device (such as a personal digital assistant).
As described above, the ultrasound system of the present invention is used in minimally invasive surgery and robotic surgery methods, including (but not limited to): biopsy procedures, catheter introduction for diagnosis and therapeutic angiography, fetal imaging, Cardiac imaging, vascular imaging, imaging during endoscopy procedures, imaging for telemedicine applications and imaging for veterinary applications, radiation therapy and cold therapy. These embodiments use a computer-based tracking system and CT and MR images to accurately locate the precise location of the target area. Alternative preferred embodiments of the ultrasound system can provide images just before, during, and immediately after the procedure at a lower cost and using a smaller footprint device. The preferred embodiment overcomes the need for a method that requires a separate ultrasound device in a procedure room to be advanced and a device for moving the image from the ultrasound to the tracking position and registering the target for the previously captured CT and MR image. A preferred embodiment of the ultrasound system provides a fully integrated solution because it can run its ultrasound application on the same platform as any third-party application that processes images. The system includes a streaming video interface (a third-party application An interface between the system of ultrasound applications). A key component of this system allows the two applications to run on the same computer platform (using the same operating system (OS)), for example, such as Windows®-based platforms, other platforms (such as Linux) can also be used and therefore Provide seamless integration of one of the two applications. The following describes the details of the software interface that moves the image from the ultrasound application of the system to another application.
The preferred embodiment includes control and data transmission methods that allow a third-party Windows®-based application to run the ultrasound application as a background task, send control commands to the ultrasound application, and receive images in exchange ( Data) to control (for example) a portable Windows®-based ultrasound system. In addition, the embodiment configures a portable ultrasound Windows®-based application as a server for the live ultrasound image frame that supplies another Windows®-based application (which acts as a client). This client application receives these ultrasound image frames and further processes them. In addition, an alternative embodiment configures the portable ultrasound Windows®-based application as being used by two communication mechanisms (for example, by a third party (hereinafter interchangeably referred to as an external or a client) to activate and control Portable ultrasound applications based on Windows® are a component object model (COM) automation interface and a high-speed shared memory interface for delivering live ultrasound images) and a server that interacts with a third-party client application.
A preferred embodiment includes and configures a shared memory interface as a streaming video interface between a portable Windows®-based ultrasound application and another third-party Windows®-based application. This streaming video interface is designed to provide real-time ultrasound images to a third-party client.
A preferred embodiment allows a third-party Windows®-based application to control the flow rate of images from a portable ultrasound Windows®-based application through a shared memory interface in the same PC platform and the memory required to implement this interfaceThe amount. The amount. The amount. These controls are grouped by setting the number of image buffers, the size of each buffer, and the speed of image transmission become. This flow rate control can be set for zero data loss, so as to ensure that each frame is delivered from the ultrasound system to a third-party Windows®-based application, or set this flow rate control for the lowest delay, so that it will be generated by the ultrasound system first The latest frames are delivered to third-party Windows®-based applications.
A preferred embodiment formats the ultrasound image frame so that when a third-party Windows®-based application retrieves images (generated by a portable ultrasound Windows®-based application) from the shared memory interface, the third-party is based on Windows® applications can interpret the probe, space and time information. The actual image data transmitted between the server (ie, portable ultrasound application) and the client application (third-party Windows®-based application) has 8-bit pixels and a 256-item color table. Microsoft Device Independent Bit Map (DIB). The image frame also contains one of the following additional information headers, such as (but not limited to): probe type, probe serial number, frame serial number, frame rate, frame time stamp, frame trigger time stamp, image Width (in pixels), image height (in pixels), pixel size (on X and Y), pixel origin (the first pixel in the image is positioned relative to the x, y of the sensor head) and direction ( The spatial direction along or across the lines of the image).
In addition, the preferred embodiment uses ActiveX controls to control the shared memory interface for transmitting ultrasound images between a Windows®-based portable ultrasound system and a third-party Windows®-based system. The Windows®-based portable ultrasound application contains an ActiveX control that sends a frame to the shared memory and sends out a Windows® event (which contains an indicator for the frame just written ) To third-party Windows®-based applications. This third-party application has an ActiveX control that receives this event and retrieves the image frame from the shared memory.
The graphical user interface includes one or more control programs, each of which is preferably a self-contained (for example) client script code. These control programs are independently configured for (among other functions) to generate graphical or text-based user controls in the user interface Item is used to generate a display area in a user interface guided by user control items, or to display processed streaming media. These control programs can be implemented as ActiveX controls, Java applets, or any other self-contained and/or self-executing applications or parts thereof that can operate in a media gateway container environment and can be controlled through a web page.
The ultrasound content can be displayed in a frame in the graphical user interface. In one embodiment, the program generates an instance of an ActiveX control. ActiveX refers to a set of object-oriented programming technologies and tools provided by Microsoft® in Redmond, Washington. The core part of ActiveX technology is the Component Object Model (COM). A program that runs under the ActiveX environment is called a "component" and can be run anywhere on the network as a self-sufficient program (as long as the program is supported). This component is usually called an "ActiveX control". Therefore, an ActiveX control is a component program object that can be reused by many applications in a computer or in several computers in a network, regardless of which programming language is used to generate it. An ActiveX control runs in a so-called container, which is an application using the COM programming interface.
One of the advantages of using a component is that it can be reused by many applications (called "component container", etc.). Another advantage is that one of several well-known languages or development tools (including C++, Visual Basic or PowerBuilder) or script tools (such as VBScript) can be used to generate an ActiveX control. ActiveX controls can be downloaded as, for example, smaller executable programs, or downloaded as self-executable code for web animations. It is similar to the ActiveX control item and is suitable for the applet of the user-side script. An applet is usually a self-contained, self-executing computer written in Java.TM. (a web-based object-oriented programming language released by SUN Microsystems of Sunnyvale, California) Program.
The control program can be stored and accessed locally in the client system, or the control program can be downloaded from the Internet. It is usually downloaded by encapsulating a control program in one or more files based on markup language. The control program can also be used to run in one of several operating system environments Perform any task normally required by an application. Windows®, Linux, and Macintosh are examples of operating system environments that can be used in the preferred embodiment.
A preferred embodiment of the ultrasound imaging system has a specific software architecture for image streaming capabilities. This ultrasonic imaging system is an application that controls the ultrasonic probe of a preferred embodiment and allows obtaining and displaying visual images for medical purposes. The imaging system has its own graphical user interface. This interface has achieved features and is properly organized to provide maximum flexibility for working with separated images and image streaming. Some possible medical applications require the development of graphical user interfaces with significantly different characteristics. This involves integrating the imaging system into other more complex medical systems. The preferred embodiment allows the imaging data to be exported in a highly efficient and convenient way for original equipment manufacturers (OEMs) to directly access the imaging data.
The quality of the image streaming solution according to a preferred embodiment is measured by the following criteria (such as data transmission performance). Imaging data consumes a lot of memory and processor power. A larger number of separated image frames are required to generate live medical video patient examinations. It becomes very important to minimize the data response operations in the process of transferring data from one of the processing procedures of generating video data to one of the processing procedures of consuming video data. The second criterion includes industry standard imaging formats. Because it is intended to use a third-party company to develop an application that consumes video imaging data, the data can be represented in an industry standard format. One third criterion is convenience. The imaging data can be presented through a programming interface that is easy to use and does not require additional learning.
In addition, the criteria include scalability and scalability. A streaming data structure can be easily extended to adapt to new data types. It can provide a basic framework for the future multiplication of video streams targeting more than one data reception process.
The image streaming architecture of the preferred embodiment provides a method for data transmission between two processing procedures. The image stream framework defines the operating parameters for adjusting the data transmission processing program, and describes the mechanism for transmitting the parameters between processing programs. One of the methods of transmitting operating parameters from a third-party client application to the imaging system of a preferred embodiment is by using the existing COM interface.
In a preferred embodiment, the image delivery architecture intensively uses object-oriented programming methodology and the processing capabilities of the Microsoft Windows® operating system. The object-oriented methodology provides a necessary foundation for an architectural solution that allows to meet the necessary requirements. It also lays the foundation for future enhancements and extensions that make modifications relatively simple and backward compatible.
Video imaging data represents a complex data structure with mutual interference between different data elements. It also allows and often requires different interpretations of the same data element. The following preferred embodiment of the image transmission architecture includes a shared memory for physical data exchange. For example, the Windows® shared memory system is a fast and economical way to exchange data between processing programs. In addition, in some embodiments, the shared memory can be subdivided into separate sections with a fixed size. Then, each section can be located at a minimum controllable unit. In addition, imaging data can be abstracted into objects. Each frame of the imaging data can be represented by a separate object. These objects can then be mapped to sections of shared memory.
A preferred embodiment may include locking-unlocking of a segmented object. The programming API notification mechanism used is an event-driven mechanism. The event-driven mechanism is based on the implementation of C++ pure virtual functions.
In a preferred embodiment, the image transmission architecture consists of three layers: an application programming interface (API) layer, a programming interface implementation and shared memory access layer, and a physical shared memory layer. The application programming interface layer provides two different C++ library interfaces with applications on a client side and a server side. All related sequences of commands belonging to the application itself are also part of this layer. Derivative classes of application programs and their implementation schemes are the key elements of the application programming interface layer. As the server of the imaging data provider, use (for example) the object transmitter category and related derivatives and base categories. As a client of the consumer of imaging data, use (for example) an Object Factory category and related derivatives and base categories.
The programming interface implementation layer provides two different dynamic link library (DLL) implementation categories for the application. This layer maps objects of the category associated with the application to An internal implementation of an object that accesses objects in a shared memory physical system. This layer allows to hide all implementation-specific member variables and functions from the scope of the application. Therefore, the application programming interface layer becomes less messy, easy to understand and use. Server-side applications can use (for example) Object-Xmitter.DLL, and client applications can use (for example) ObjectFactory.DLL.
The physical shared memory layer represents an operating system object that implements the functionality of the shared memory. It also describes the structure of shared memory, its segmentation and memory control blocks.
Regarding the organization of shared memory, because shared memory is intended to be used for inter-program communication, the operating system assigns a unique name when it is created. In order to manage shared memory, other inter-program communication (IPC) system objects are required. They also need to have unique names. In order to simplify the process of generating a unique name, only one basic name is required. All other names are derived from the base name by an implementation code. Therefore, the application programming interface requires only a basic name specification for logical shared memory objects. Both the server side of the application and the client side of the application can use the same unique name.
The server side of the application is responsible for the generation of shared memory. In a generation process, not only the unique name of the shared memory must be specified, but also other configuration parameters must be specified. These parameters include (but are not limited to): the number of fragments that specify the number of fragments to be allocated, the size of the fragments, and the operation flag. In a preferred embodiment, there are three such flags. The first flag specifies the order of fragment submission and retrieval. The order can be one of last in first out (LIFO), first in first out (FIFO) or last in out (LIO). LIO is an ordinary LIFO so that whenever a new frame arrives, if a frame that is ready for retrieval but not locked for retrieval is found, one of the ways to erase the frame is modified. The second flag specifies the behavior of the shared memory implementation under one of the conditions when a new segment allocation is requested but there are no available segments. Usually this can happen when the receiving application processes the data more slowly than the submitting application. This flag may allow deletion of one of the previously allocated segments. If it does not allow deletion of one of the previously allocated fragments, it reports an abnormal situation back to the application. make With this flag, the application can automatically choose to rewrite the data into a shared memory or it can control the data rewriting process itself. The third flag can be used only when the second flag allows the segment to be rewritten into a shared memory. It specifies how to select a segment to be rewritten. By default, the shared memory implementation will delete the youngest or most recently submitted data fragments. Alternatively, the oldest fragment can be selected for use in the rewriting process.
When generating shared memory, initialize its physical layout. Because the operating system does not allow the calculation of addresses in a physical shared memory, data indicators are not used in the shared memory. All addresses in the shared memory control block and segment can be implemented based on the relative displacement from the virtual origin (VO). With zero displacement from VO, the shared memory header structure is allocated. It contains all the parameters listed above. FIG. 48 is a block diagram showing the structure of the physical shared memory 4880.
Immediately following the allocation of the shared memory header structure 4882 is to generate a header array 4884 for each memory segment. The header of the memory segment contains the size occupied by the segment, the unique tag of the object type mapped to the segment, and the status of the segment. Each fragment can be in one of the following four states: an unused state, where the fragment is available for allocation; a state locked for writing, where the fragment is mapped to an object of a specific category and is currently formed; written A state in which a fragment is mapped to an object of a specific category and can be used for retrieval; and a state locked for reading, in which a fragment is mapped to an object of a specific category and is currently in a process related to data retrieval . Because each fragment has its own state, it is possible for the application to lock more than one fragment for object formation and object retrieval. This allows the system to have a flexible multi-threaded architecture on both the server side and the client side of the application. In addition, the ability to put more than one segment in a "write" state provides a "buffering" mechanism that cancels or minimizes the performance difference between the server and client applications.
The last element in a physical shared memory layout contains memory segment 4888. In addition to the physical shared memory, the logical shared memory also contains a physical system mutual exclusion 4886 and system System incident 4890. The entity mutual exclusion provides mutually exclusive access to the entity's shared memory. The physical event has a manual control type. When at least one of the segments has a "write" state, it always remains at the level "high". It goes to the level "Low" only when there is no single segment in a "write" state. This mechanism allows "write" objects to be retrieved from shared memory without passing control to an operating system within the same time segment allocation used for threads.
In a preferred embodiment, the object transmission programming interface is composed of the following three categories: AObjectXmitter, USFrame, and BModeFrame. The AObjectXmitter class allows an object delivery service to be initially specified as one of the operating parameters. Once the AObjectXmitter class object is instantiated, initialized objects of the USFrame and BmodeFrame classes can be generated. The USFrame class builder needs to refer to an object of the AObjectXmitter class. The first action that must be done after instantiating the USFrame object is to establish an association between the object and one of the fragments in the shared memory. The function Allocateo maps an object to an unused shared memory segment and locks this segment for use by the current object. When mapping an object, an application can provide a one-bit mapping size. The provided size only represents the size required by the bitmap data (not including the memory size required by other data elements of the object).
The BModeFrame category is a category derived from the USFrame category. It inherits all the methods and functionality of the base class. The only additional functionality provided by the BModeFrame class is an additional method that allows providing information specific to the operation of BMode.
After instantiating an object of the USFrame or BModeFrame class and mapping it to a shared memory segment, the application can fill in all required data elements of the object. It is not necessary to provide a value for each data element. When an object is mapped to a shared memory segment, all data elements of the object are initialized with default values. The only data element that is not initialized after the mapping is the bit-mapped data element. When the server side of the application has provided all required data elements, it can call a method (for example, Submit( )) to transfer the object Deliver to the client of the application.
The USFrame or BModeFrame object can be reused by subsequent remapping and resubmission. Alternatively, when the object is suitable for an application, the object can be deleted and a new object can be created. Because object instantiation does not require any inter-program communication mechanism, it is as simple as memory allocation for an ordinary variable.
There are at least two advantages of the architecture of the preferred embodiment. Because the ObjectXmitter category does have knowledge about the USFrame or BModeFrame category, it can be very simple to introduce similar or additional categories derived directly or indirectly from the USFrame category. This allows the generation of future versions of the object transfer programming interface without any modification to the code or instruction sequence developed for use in the existing embodiment. In addition, the object transfer programming interface category does not have any member variables. This provides two other benefits of the interface. The first benefit is that these categories are oriented via the COM object interface and can be directly used in the COM object interface specifications and implementation schemes. The second benefit is that these categories effectively hide all implementation specific details, so that the interface is very clear, easy to understand and use.
Implement object transfer programming interface by ObjectXmitter.DLL. For each object generated by the application, there is a mirror implementation object generated by the code residing in the ObjectXmitter.DLL. Because each programming interface category has a corresponding mirroring category in the implementation, the modification is promoted and the modification is currently extended to the specified image type. This can be accomplished by generating a corresponding image category in the implementation DLL4910. The implementation object is responsible for handling the mapping of shared memory and programming interface objects. One embodiment of the present invention includes a DLL that allows only one object of the ObjectXmitter class to be instantiated using only one communication channel with a client application. The object transmission implementation not only transmits object data but also provides additional information describing the type of object being transmitted.
The Object Factory programming interface consists of three categories: AObjectFactory, USFrame and BModeFrame. The class AObjectFactory contains three pure virtual member functions. This makes this class an abstract class that cannot be instantiated by an application. must It must be its own category derived from the application-defined AObjectFactory category. There is no need to define any "special" categories derived from the AObjectFactory category. Because the application intends to process the image to be received, it has a very high chance of processing one type of image. An image processing category can be well derived from the AObjectFactory category.
A category derived from an AObjectFactory category must define and implement only pure virtual functions, such as OnFrameOverrun( ), OnUSFrame( ), and OnBModeFrame( ), for example. For example, once the exported category can be defined as follows: Class ImageProcessor: public AObjectFactory {public: ImageProcessor(void); ~ImageProcessor(void); virtual unsigned long OnFrameOverrun(void); virtual unsigned long OnBModeFrame(const BModeFrame * frame); virtual unsigned long OnUSFrame(const USFrame * frame); };
After instantiating a class object, the image processor base class member function Open() can be called. This function provides a shared memory name that matches one of the shared memory names used by the server side of the application. The function Open() connects the client application to the server application via a designated shared memory.
At any time after opening the shared memory, the application can expect to call one of the virtual functions OnFrameOverrun( ), OnUSFrame( ), and OnBModeFrame( ). Each call of the OnUSFrame() function carries an object of the USFrame class type as an independent variable. Each call of the OnBModeFrame() function carries an object of the BModeFrame class type as an independent variable. There is no need for an application to instantiate an object of the USFrame or BModeFrame class. By implementing the underlying implementation of an AObjectFactory class The solution "gives" the USFrame and BModeFrame objects to an application.
The only action the application needs to complete is to process the received frame and release the "given" object. The application did not attempt to delete a frame object, because the deletion was performed by a low-level implementation. Call the member function Release() of the USFrame object only when the application completes all data processing or the application no longer needs the USFrame object or the object of the exported class.
Once the application has received an object of a type of USFrame or BModeFrame, it can capture the imaging data and process it appropriately. The application needs to be aware that it does process the frame object data in a separate thread and ensure that the processing function is written using a thread-safe programming technology. Since any of the pure virtual functions are called in a separate thread generated by the implementation DLL, subsequent calls are impossible before the virtual function returns control to the calling thread. This means that as long as the application has not returned control to the thread generated by the implementation, the application cannot receive any new frames. At the same time, the server side of the application can continue to submit additional frames. This eventually leads to an overflow of the shared memory and prevents any new frame transfers.
When the application processes frame data, it always keeps the shared memory resources locked from subsequent remapping. The more frames the application has not released, the fewer shared memory fragments that can be used for the object transfer interface on the server side of the application. If the frame matching object is not released at an appropriate rate ratio, the client application will eventually lock all memory segments of the shared memory. At that time, the image transmission application stops sending new frames or rewrites frames that have not been locked by the receiving application. If the receiving application locks all the clips, the transmitting application cannot even choose to rewrite the existing frame.
The function OnFrameOverrun() is called when Frame Overrun is raised by the service application. This condition is raised whenever the service application attempts to submit a new frame and there are no available shared fragments to which an object is mapped. This item can be cleared only by calling the function ResetFrameOverrun() on the client side of the application Pieces. If the client application does not call this function, the Frame Overrun condition is raised and the OnFrameOverrun() pure virtual function is called again.
The Object Factory interface has the same advantages as outlined above when describing the object transfer interface. In addition to these advantages, it also implements an event-driven programming method that minimizes programming work and maximizes execution efficiency. There are functions at the same time, for example, such as USFrames( ), BModeFrames( ), GetUSFrame( ), and GetBModeFrame( ). These functions can be used to implement a less efficient "polling" programming method.
Implement Object Factory programming interface by ObjectFactory.DLL4918. This DLL retrieves an object type information and object related data from the shared memory. It produces an object of the type used by the transmitter. The Object Factory implementation scheme maps newly generated objects to corresponding data. The Object Factory implementation has a separate thread that fires one of the newly generated and mapped objects via pure virtual function events. The application "owns" the object during the entire processing period and instructs the application to no longer need the object by calling the Releaseo function. The factory implementation plan locally releases resources allocated for objects and shared memory resources.
The process flow 4900 described above is shown graphically in the block diagram of FIG. 49. The preferred embodiment includes the ease of code maintenance and the feature enhancement of the image transmission mechanism. The object delivery interface 4908 and the Object Factory interface 4916 and their implementations allow these modifications to be made at relatively low development costs. Regarding object modification, the shared memory implementation is completely independent of the type of transmitted data. Therefore, any type of modification does not require any changes to the underlying code that controls the shared memory. Because the transmitted data is encapsulated in a specific type of category, the only action required to modify an object is to modify the corresponding category that defines the object. Because the object represents a category derived tree, any modification of the base category causes appropriate changes for each object of the derived category. Such modification of the object type does not affect application code that is not related to the modified object type.
New types of objects can be introduced by deriving a new category from one of the existing categories. A newly derived category can be derived from the appropriate level of the base category. An alternative way of generating a new object type is by generating a new base type. This method can have advantages in a situation where the newly defined category is significantly different from the existing category.
Regarding multiple object transmission channels, the alternative preferred embodiment can support more than one AObjectXmitter type object and more than one corresponding communication channel. It can also be expanded in a way that allows it to allow communication channels to transmit objects in opposite directions. This allows the application to distribute the imaging data to more than one client application. It can accept incoming communication to control image generation and probe operation.
In addition, wireless and remote video streaming channels can be adapted to the preferred embodiment. A programming interface for the same object transmission can be implemented to transmit images not via shared memory but via high-speed wireless communication networks (for example, such as ISO 802.11a). The same object transmission programming interface can also be used to transmit images across a wired Ethernet connection. The remote and wireless video streaming assumes that the recipient's computing system may differ in performance. This makes the choice of a model of the recipient's device one of the important factors for successful implementation.
Therefore, the streaming imaging included in the preferred embodiment utilizes a shared memory client-server architecture that provides high bandwidth with low overhead.
A preferred embodiment of the ultrasound imaging system software application program is a client application 4904 used as a server 4902 of the live ultrasound imaging frame. This client-server relationship is supported by the two communication mechanisms described above. The client application uses a COM automation interface to activate and control the ultrasound imaging system application 4906. A high-speed shared memory interface 4912 delivers live ultrasound images with probe identification, space and time information from the application to the client application.
For a simple ActiveX COM API (TTFrameReceiver), the client application encapsulates the complexity of the shared memory implementation. Shared memory communication has flexible parameters specified by the client application. Queue sequence, number of buffers, buffer size Both the small and rewrite permissions are specified by the client when opening the image frame stream. The queue sequence mode can be designated as First In First Out (FIFO), Last In First Out (LIFO) and Last In and Out (LIO). Generally speaking, when zero data loss is more important than the lowest latency, the FIFO mode is better. LIO mode only delivers the most recent image frame and is better when the lowest latency is more important than data loss. LIFO mode can be used when minimum delay and minimum data loss are equally important. However, in the LIFO mode, the frames may not always be delivered in sequential order and a more complex client application is required to classify the frames after receiving the frames. When all the shared memory buffers are full, the rewrite permission is designated as not allowed, rewrite the oldest frame and rewrite the latest frame.
Each image frame contains a single ultrasound image, detection head identification information, pixel space information, and time information. The image format is a standard Microsoft Device Independent Bit Map (DIB) with 8-bit pixels and a 256-item color table.
The TTFrameReceiver ActiveX control provides two solutions for receiving frame. The first solution is event-driven. When a frame has been received, a COM event FrameReady is triggered. After the FrameReady event, the data access method of the interface can be used to read the image and associated data. After the image and other data have been copied, the client releases the frame by calling the ReleaseFrame method. The next FrameReady event will not occur until after the previous frame is released. In another embodiment, the client can use the WaitForFrame method to poll the next available frame.
In a preferred embodiment, both the client application and the server application are executed on the same computer. The computer can run (such as but not limited to) Microsoft® Windows® 2000/XP operating system. You can use Microsoft® Visual C++6.0 and MFC to develop client applications (USAutoView). The source code can be compiled in (for example) Visual Studio 6.0. The server-side COM automation interface and TTFrameReceiver ActiveX control are compatible with other MS Windows® software development environments and languages.
In an embodiment of the present invention, the name of the server-side COM automation interface (ProgfD) Call it (for example) "Ultrasound.Document" and register the interface on the computer when the application is run for the first time. The scheduling interface can be imported from a type library to a client application.
In a preferred embodiment, the automated interface is extended to support frame streaming by adding different methods (such as void OpenFrameStream(BSTR*queneName, short numBuffers, long buffersize, BSTR*queueOrder, short overwritepermission)). Open the frame streamer on the server side; open the shared memory interface with the client application, queueName is a unique name of the shared memory "file" and is the same name used when opening the receiver , NumBuffer is the number of buffers in the shared memory queue, bufferSize is the size in bytes of each buffer in the shared memory queue, where the buffer size is 5120 larger than the maximum image that can be transferred Bytes, queueOrder is "LIO", "FIFO" or "LIFO", the overwritePermission is 0 for rewrites that are not allowed, 1 for the oldest rewrite, or 2 for the latest rewrite. Note that you must call OpenFrameStream before opening the TTFrameReceiver control.
The next additional methods include: void CloseFrameStream( ), which closes the frame streaming transmitter on the server side; void StartTransmitting( ), which tells the server to start transmitting the ultrasound frame; void StopTransmitting( ), which tells the server The terminal stops transmitting the ultrasonic frame; and short GetFrameStreamStatus( ), which obtains the status of the frame streamer. It is important to check that the streaming transmitter is turned on before turning on TTFrameReceiver. The COM automation interface is not blocked and the OpenFrameStream call cannot occur at the moment when it is called from the client application.
In a preferred embodiment, the TTFrameReceiver ActiveX control is a client application program interface for streaming with live ultrasound frames. The frame stream control method includes boolean Open (BSTR name), which turns on the frame stream receiver. Until the server has been turned on Only after the frame streaming transmitter on the server can be opened the frame streaming receiver. The frame stream control method also includes: boolean Close( ), which closes the frame stream receiver; long WaitForFrame(long timeoutms), which waits for a frame to be ready or until the timeout period ends; and boolean ReleaseFrame( ), It releases the current image frame. Once all the required data has been copied, the current frame can be released. Until the current frame is released, the next frame cannot be received. The return value of other data access functions is not valid after the current frame is released until the next FrameReady event.
The data access method for images in a preferred embodiment includes long GetPtrBitmapinfo( ), which obtains an indicator of the header (with color table) of the DIB containing the image. The ultrasound image is stored as a standard Microsoft Device Independent Bit Map (DIB). The BITMAPINFO and BITMAPINFOHEADER structures can optionally be cast to the returned indicators. The memory system used for the BITMAPINFO structure is allocated to the shared memory and cannot be unallocated; instead, you can call ReleaseFrame() to return the memory to the shared memory mechanism. A further method includes long GetPtrBitmapBits( ), which obtains an index of the image pixel. The returned indicator can be used as needed to use with the Microsoft DIB API. The memory system used for bit-mapped pixels is allocated in the shared memory and cannot be unallocated; instead, you can call ReleaseFrame() to return the memory to the shared memory mechanism.
Methods related to probe identification include: short GetProbeType( ), which obtains the defined ultrasonic probe type used; BSTR GetProbeType( ), which obtains the defined probe name; long GetProbeSN( ), which obtains the used The serial number of the probe.
Regarding time information, the method includes short GetSequenceNum( ), which obtains the sequence number of the current frame. The serial number is derived from an 8-bit counter and therefore repeats every 256 frames. It is useful for determining gaps in the sequence of frames and reordering received frames when using LIFO buffer ordering mode. In addition, double GetRate() Get the frame rate when the serial number is combined, and provide accurate relative timing for the received frame; BSTR GetTimestamp( ), which obtains a timestamp of the current frame, which provides the possibility for the current frame to be synchronized to an external event One useful one is absolute time. The resolution is approximately milliseconds. The time stamp can be averaged and used in conjunction with rate and serial number to achieve higher accuracy. Finally, regarding time information, the method includes BSTR GetTriggerTimestamp( ), which obtains a time stamp of the start of the ultrasound scan, where the ultrasound probe is stopped when the image is "frozen". The trigger time stamp is recorded when the live imaging is resumed.
The spatial information in the preferred embodiment has the following methods: short GetXPixels( ), which obtains the width of the image in pixels; short GetYPixels( ), which obtains the height of the image in pixels; double GetXPixelSize( ), which Obtain the size of each pixel in the x direction (the x direction is defined as horizontal and parallel to each image line); and double GetYPixelSize( ), which obtains the size of each pixel in the y direction. The y direction is defined as vertical and perpendicular to each image line. In addition, double GetXOrigin( ), which obtains the x position of the first pixel in the image relative to the sensor head; and double GetYOrigin( ), which obtains the y position of the first pixel in the image relative to the sensor head. The positive y direction is defined as far away from the sensor head in the patient's body. Another method includes short GetXDirection( ), which obtains the spatial direction of each line along the image. The positive x direction is defined as away from the probe mark.
Short GetYDirection( ), get the spatial direction of each line across the image. The positive y direction is defined as far away from the sensor head in the patient's body.
The spatial position of any pixel in the image relative to the sensor head can be easily calculated as follows: PX=OX+NX*SX*DX
PY=OY+NY*SY*DY
Among them, P = the position of the pixel relative to the sensor head, O=origin, N=index value of pixel in image, S=pixel size, D=direction of pixel.
In addition, when a frame is ready and data can be read, the event void FrameReady() in a preferred embodiment is used. The processor copies the data from the data access method and then calls ReleaseFrame( ). It is recommended to avoid any kind of indefinite processing in the processor (for example, calling the message loop function). In addition, void FrameOverrun() is used when the server cannot send a frame or has to rewrite a frame in the buffer (because the buffer is full). This only applies to FIFO and LIFO modes, because LIO automatically releases old buffers. This event is useful for determining whether the client application is fast enough to read the frame and the number of allocated buffers is sufficient for the delay of the client.
In a preferred embodiment, USAutoView is a sample client application that automates the client and displays live ultrasound image frames. It can verify the start and stop of the server side, hide and display the server side, switch between the graphics on the displayed image and the graphics on the non-displayed image, freeze and resume ultrasonic acquisition, load a preset inspection, change the experience The function of specifying patient size, changing image size, spatial information and reversing image.
Figure 50 is a view of a graphical user interface 4950 for a USAutoView UI according to a preferred embodiment of the present invention. The USAutoView program is a Windows® dialog application with one of the three ActiveX components. TTFrameReceiver, which provides an ActiveX interface for receiving ultrasound frames; TTAutomate, which encapsulates the server-side automation; and TTSimplelmageWnd, which is an image display window. CUSAutoViewDlg is the main dialogue. It manages server-side automation through the TTAutomate control, receives ultrasound frames through TTFrameReceiver, and displays images through TTSimplelrnageWnd. The OnStartUS() method of CUSAutoViewDlg calls the TTAutomate and TTFrameReceiver methods needed to start or stop automation and data transmission from the server.
The method OnFramReady() handles the FrameReady event from TTFrameReciever. It copies the required data from TTFrameReceiver and then uses TTFrameReceiver's ReleaseFrame() method to release the frame. It avoids any function that performs uncertain processing (such as a function that calls a message loop).
TTAutomate is an ActiveX control that encapsulates one of the server-side automation functions. The native COM automation interface on the server side is not blocked and needs to wait with GetStatusFlags to coordinate the function. TTAutomate wraps each function in the required waiting loop. These waiting loops allow the processing of Windows® messages so that the user interface threads of the client application are not blocked while waiting. Although the automated method in TTAutomate cannot return before the function is completed, other Windows® messages are still processed before the function is completed. It is recommended to prevent multiple concurrent calls from the message processor to the TTAutomate method, because the coordination with the server side is generally not reentrant. The source code used for this control is contained in the USAutoView workspace. It can be reused or modified as needed.
TTSimplelmageWnd is an ActiveX control item that provides a display window for the device-independent bitmap (DIB). The two properties of the display interface are long DIBitmapInfo and long DIBits. DIBitmapInfo corresponds to an index to a block of memory containing the BITMAPINFO structure for DIB. DIBits corresponds to an index for a block of memory containing image pixels. To load a new image, set DIBitmapInfo as an indicator of the bitmap information of the DIB. Then set DIBits as an index for bit-mapping bits. When setting DIBits, it is expected that the indicator set for DIBitmapInfo is still valid and both bitmap information and bitmap bits are copied internally for display on the screen. Set DIBitmapInfo and DIBits to zero to clear the image. The source code used for this control is contained in the USAutoView workspace. It can be reused or modified as needed.
The preferred embodiment of the present invention includes a plurality of probe types. For example, the detection heads include (but are not limited to): a convex linear sensor array operating between 2MHz and 4MHz, a phased linear sensor array operating between 2MHz and 4MHz, and a phase-controlled linear sensor array operating between 2MHz and 4MHz. A convex linear lumen sensor array operated between 8 MHz, a linear sensor array operated between 4 MHz and 8 MHz, and a linear sensor array operated between 5 MHz and 10 MHz.
The preferred embodiment of the portable ultrasound system of the present invention provides high-resolution images during an inspection, such as the following images: B-mode, M-mode, color Doppler (CD), pulse wave Doppler (PWD), directional Power Doppler (DirPwr) and Power Doppler (PWR). Once the system software is installed, the probe device is connected to a desktop or laptop computer. The detection head can be an industry standard sensor connected to a 28oz. box containing the beamforming hardware of the system. If the probe is connected to a laptop computer, a 4-pin FireWire cable is connected to an IEEE 1394 serial connection located on a built-in MediaBay. However, if the probe is connected to a desktop computer, the computer may not be equipped with a MediaBay. We can use an external DC module (EDCM) connector to connect the probe head. Before connecting the probe, we need to make sure that the Firewire is connected to both the right and left sides of the computer.
In one embodiment, the EDCM is designed to accept a 6-pin IEEE 1394 (also known as FireWire) cable at one end and a Lemo connector from the probe head at the other end. The EDCM accepts an input DC voltage from +10 volts to +40 volts. In addition, in one embodiment, the system can use IEEE 1394 to connect to a host computer. The 6-pin IEEE 1394 input to the EDCM can be sourced from any IEEE 1394-equipped host computer running (for example) Windows® 2000 operating system. An external IEEE 1394 hub may also be necessary to provide the required DC voltage to the EDCM. In a host computer equipped with an IEEE 1394, there is one of two types of IEEE 1394 connectors (a 4-pin or a 6-pin). 6-pin connectors are most commonly found in PC-based workstations that use internal PCI bus cards. Usually, the 6-pin connector provides the required DC voltage to the EDCM. A 6-pin male to 6-pin male IEEE 1394 cable is used to connect the host computer to the EDCM.
The 4-pin connector does not contain a MediaBay or mention according to a preferred embodiment. Found in a laptop computer for a DC voltage output. When using this connector type, an external IEEE-1394 hub can be used to power the EDCM and probe head.
When the power is not supplied from the host computer, an external IEEE-1394 hub can be used between the host computer and the EDCM. The hub derives its power from a wall socket and is connected with a medical-grade power supply that complies with the IEC 60601-1 electrical safety standard.
To connect the hub to the host computer, a 4-pin male to 6-pin male or 6-pin male to 6-pin male IEEE cable is required. Plug the appropriate connector (4-pin or 6-pin) into the host computer and plug the 6-pin connector into the hub. Next, use a 6-pin male to 6-pin male IEEE 1394 cable to connect the hub to the EDCM. An IEEE 1394 hub is required only when the host computer cannot supply at least +10 volts to +40 volts direct current (DC) and 10 watts of power to the EDCM. If the host computer can supply enough voltage and power, a 6-pin male to 6-pin male IEEE 1394 cable can be used to connect the computer directly to the EDCM.
FIG. 51 illustrates a view of a main screen display of a graphical user interface according to a preferred embodiment of the present invention. When the user activates the system according to the present invention, the main screen 5170 is displayed. To help users navigate, the main screen can be regarded as four separate work areas that provide information to help us perform tasks. These working areas include a function list 5172, an image display window 5174, an image control row 5176, and a toolbar 5178-5186.
In order to adjust the size of the window and area, the user can click the small button at the top right of the window to close, resize and exit the program. A user interface or button closes the window but leaves the program to continue running (minimize the window). A system button appears at the bottom of the screen, in an area called the taskbar. By clicking the system button in the taskbar, the window reopens. Another interface button enlarges the window to fill the entire screen (called maximize). However, when the window is at its maximum, the frame rate can be reduced. Another interface button returns the window to its size before zooming in. The system program can be closed by another interface button.
Users can increase or decrease the width of each area of the application to meet our needs want. For example, to make the Explorer window narrower, place the cursor at either end of the area and click and drag to obtain a new desired size. We can reposition the size and position of each area so that it becomes a floating window. To create a floating window, the user simply selects his own mouse on the double-edge boundary of a specific area and drags it until it looks like a floating window. In order to restore the floating window to its original form, I double-clicked on the window. These functionalities are depicted in FIGS. 52A to 52C. FIGS. 52A to 52C are views of a graphical user interface 5200, 5208, 5220 according to a preferred embodiment of the present invention.
The Explorer window provides a nested level file directory 5202 for all patient folders of the generated and saved user-generated images. The folder directory structure includes the following (but not limited to): a patient folder and an image folder. The patient folder directory is where the patient information file and any associated images are stored. The image folder directory contains images by date and inspection type. The images in this catalog are not associated with a patient and are generated without patient information. 53A to 53B show a patient folder 5340 and an image folder 5350 according to a preferred embodiment of the present invention. The menu bar at the top of the screen provides nine options that we can use to perform basic tasks. To access a menu option, simply click the menu name to display the drop-down menu option. The user can also access any menu by using its shortcut key combination.
The image display window provides two tabs: Image Display and Patient Information. The user clicks on the image display index tab to watch the ultrasound image. The image is displayed in the window according to the defined control settings. Once the image is saved, when the user captures it again, the classification, date and time of the image are also displayed in the image display window. The patient information index label is used to input new patient information that will be stored in a patient folder later. The user can access this index tab to also modify and update the patient information.
Figure 54A and Figure 54C show an XY biplane probe consisting of two one-dimensional, multi-element arrays. The arrays can be stacked on each other to form a structure, and one of the polarization axes of each array is at the same Align in the direction. The elevation axes of the two arrays can be at right angles to each other or orthogonal to each other. Exemplary embodiments may employ a sensor assembly, such as the sensor assembly described in U.S. Patent No. 7,066,887 (the entire content of which is incorporated herein by reference) or Seide, Tours, France. A sensor sold by Vernon of Tours Cedex. As shown in FIG. 54A, the array orientation is represented by configuration 5400. The polarization axes (5408, 5422) of the two arrays are indicated in the z-axis 5406. The elevation axis of the bottom array is pointed in the y direction 5402, and the elevation axis of the top array is in the x direction 5404.
As further illustrated in FIG. 54B, a one-dimensional multi-element array forms an image as depicted in configuration 5412. A one-dimensional array with an elevation axis 5410 in a y direction 5402 forms an ultrasound image 5414 on the x-axis 5404 and z-axis 5406 planes. A one-dimensional array with an elevation axis 5410 in the x direction 5404 forms an ultrasound image 5414 on the y axis 5402 and the z axis 5406. A one-dimensional sensor array with an elevation axis 5410 along a y-axis 5402 and a polarization axis 5408 along a z-axis 5406 will result in an ultrasound image 5414 along the x-plane 5404 and z-plane 5406. An alternative embodiment is shown in FIG. 54C to depict a one-dimensional sensor array with an elevation axis 5420 on the x axis 5404 and a polarization axis 5422 on the z axis 5406 direction. Ultrasonic images 5424 are formed on the y plane 5402 and the z plane 5406.
Figure 55 illustrates the operation of a dual-plane image forming xy probe, where the array 5512 has a high voltage applied to form the image. High voltage driving pulses 5506, 5508, 5510 can be applied to the bottom array 5504 with a y-axis elevation angle. This application can result in the generation of transmission pulses for forming the received image on the XZ plane, while keeping the elements of the top array 5502 at a ground level. These probes enable the use of a 3D imaging mode, which is a simpler electronic device than a full 2D sensor array. As described herein, a touch screen activated user interface can use screen icons and gestures to activate 3D imaging operations. These imaging operations can be expanded by software running on a tablet computer data processor, which processes the image data into a 3D ultrasound image. The image processing software can use smoothing filtering and/or interpolation operations known in the art. Beam steering can also be used Enable 3D imaging operation. A preferred embodiment uses a plurality of 1D sub-array sensors configured for biplane imaging.
Figure 56 shows the operation of a dual-plane image forming xy probe. Figure 56 shows an array 5610 having a high voltage applied to it for forming an image. High voltage pulses 5602, 5604, 5606 can be applied to the top array 5612 with an elevation angle on the x axis, thereby generating transmission pulses for forming the received image on the yz plane, while keeping the elements of the bottom array 5614 grounded 5608. This embodiment can also utilize orthogonal 1D sensor arrays using sub-array beamforming operations as described herein.
Figure 57 shows the circuit requirements of a dual-plane image forming xy probe. The receive beamforming requirements are described for a dual-plane probe. Make a connection to one of the receiving electronics 5702. Next, connect the elements from the select bottom array 5704 and the select top array 5708 to share one of the channels of the receiving electronic device 5702. A two-to-one multiplexer circuit can be integrated on the high-voltage drivers 5706 and 5710. The two-to-one multiplexer circuit can be integrated on the high-voltage drivers 5706 and 5712. A receive beam is formed for each transmission beam. The dual-plane system requires a total of 256 transmission beams. For the 256 transmission beams, 128 transmission beams are used to form an XZ plane image and the other 128 transmission beams are used to form a YZ plane image. The beam forming technique that has been received multiple times can be used to improve the frame rate. An ultrasonic system with dual receiving beam capability for each transmission beam provides a system in which two receiving beams can be formed. The dual-plane detector only needs a total of 128 transmission beams to form two orthogonal plane images, of which 64 transmission beams are used to form an XZ plane image, and the other 64 transmission beams are used to form a YZ plane image. Similarly, for an ultrasonic system with a quadruple or 4 times receiving beam capability, the probe requires 64 transmission beams to form two orthogonal planar images.
Fig. 58A to Fig. 58B show an application program for simultaneous two-plane evaluation. The ability to use echocardiographic imaging to measure LV mechanical asynchrony can help identify patients who are more likely to benefit from cardiac resynchronization therapy. The LV parameters that need to be quantified are Ts-(lateral-septal), Ts-SD, Ts-peak, etc. The Ts-(lateral-septal) can be measured on a 2D apical 4-chamber view echo image, and Ts-SD, Ts-peak (medial), Ts-onset (medial), Ts-peak (basal), Ts-onset (basal) can be obtained on two separate parasternal short-axis views with 6 segments (providing a total of 12 segments) at the mitral valve and papillary muscle levels. Figures 58A to 58B depict an xy probe that provides an apical four-chamber image 5804 and an apical two-chamber image 5802 to be viewed simultaneously.
Figure 59A to Figure 59B illustrate the ejection fraction detection head measurement technology. When the visualization of two orthogonal planes ensures that an on-axis view is obtained, the biplane probe provides EF measurement. The automatic boundary detection algorithm provides quantitative echo results to select implanted responders and guide AV delay parameter settings. As depicted in Figure 59A, the XY probe acquires real-time simultaneous images from two orthogonal planes and the images 5902, 5904 are displayed on a split screen. A manual contour tracking or automatic boarder tracking technology can be used to track endocardial boarders at both end-systole and end-diastole (from which EF is calculated). The LV regions (A1 and A2, respectively) in the apical 2CH view 5902 and the apical 4CH view 5904 are measured at the end of diastole and end of systole. LVEDV (left ventricular end diastolic volume) and LVESV (left ventricular end systolic volume) are calculated using the following formula:<img file="TWI659727B_D0001.tif" wi="306" he="148" img-format="tif" img-content="character" orientation="portrait" inline="no" />. And the ejection fraction is based on<img file="TWI659727B_D0002.tif" wi="423" he="151" img-format="tif" img-content="character" orientation="portrait" inline="no" />calculate.
FIG. 60 illustrates an exemplary method for wirelessly transmitting data to and from a portable ultrasonic imaging device according to an embodiment of the present invention. The method can start by selecting 6001 to present one of the wireless communication menu options of various wireless connections available to the user. For example, a user may wish to connect to a WiFi network, a 3G or 4G cellular network, or some other wireless network. This method can select 6002 a desired wireless connection to continue. The method may further include selecting 6003 one or more destinations for transmitting ultrasound data. In some embodiments, this selection can be performed by using the touch screen UI to select one or more hospitals, doctors, clinics, etc., similar to our own A method of selecting a contact person from a phone contact list. The method may further include determining 6004 whether an audio connection and/or video connection is desired. In some embodiments, in addition to transmitting ultrasound and other medical data between the portable ultrasound device and a remote hospital or clinic, the user can also establish an audio and/or video connection via the same wireless network . This function allows users of ultrasound imaging devices (for example) to perform and transmit ultrasound data remotely when they are in direct audio and/or video contact with a hospital or medical professional. In one example, initiating an audio and/or video call with a hospital may allow a user of a portable ultrasound imaging device to receive guidance and/or advice from a doctor when performing an ultrasound procedure. If an audio and/or video call is desired, the method may further include initiating 6005 an audio/video call with the desired destination.
If no audio/video connection is desired, or after an audio/video call is initiated, the method may further include determining whether 6006 intends to transmit ultrasound imaging data in real time, or whether the user only wants to transmit the generated ultrasound data. If a real-time connection is desired, the method may further include starting a 6007 ultrasound scan and real-time transmission of 6008 ultrasound data to the desired destination(s). If real-time ultrasonic data transmission is not required, the method can select 6009 (several) desired files and transfer 6010 the (or these) selected files to (several) desired destinations to continue.
In some embodiments, a user can perform the method described above by navigating through various windows, folders, subfolders, menus, and/or submenus presented through the touch-sensitive UI. A touch screen gesture can be performed on an icon (by dragging and dropping an icon from one part to another, selecting or deselecting one or more check boxes, or performing any other sufficiently unique or distinguishable touch Control screen commands) to execute various UI commands for selecting a menu option, destination, file, etc. In some embodiments, the various touch screen commands described herein may be user-configurable, while in other embodiments they are hard-coded. As will be understood, the various elements of the methods described herein can be performed in any desired order. For example, in some embodiments, a user can select 6009 to be One or more destinations 6003 are selected before the file(s) to be transferred. In other embodiments, a user may select 6009 one or more files before selecting 6003 the desired destination. Similarly, other elements of the methods described above can be performed in various sequences or simultaneously, and unless otherwise stated, the methods described herein are not intended to be limited to any particular sequence.
It should be noted that the operations described herein are purely illustrative and do not imply any specific order. In addition, these operations can be used in any sequence when appropriate, and/or these operations can be used in part. Illustrative flowcharts are provided herein for illustrative purposes and these illustrative flowcharts are non-limiting examples of methods. Those skilled in the art will recognize that the exemplary method may include more or fewer steps than the steps shown in the proportional exemplary flowchart, and the steps in the exemplary flowchart may be performed in a different order than the one shown.
In describing the illustrative embodiments, specific terminology is used for clarity. For descriptive purposes, each specific term is intended to include at least all technical and functional equivalents that operate in a similar manner to accomplish a similar purpose. In addition, in some examples in which a particular exemplary embodiment includes a plurality of system elements or method steps, a single element or step may be used to replace these elements or steps. Similarly, multiple elements or steps serving the same purpose can be used to replace a single element or step. In addition, in the case where the exemplary embodiments are specified for parameters of various properties herein, unless otherwise specified, these parameters can be adjusted up to one-twentieth, one-tenth, and one-fifth. , One-third, one-half, etc., or rounded to approximate values.
In view of the above illustrative embodiments, it should be understood that these embodiments may employ various computer implementation operations involving data transmission or storage in a computer system. These operations require entities to manipulate physical quantities. Usually, although not necessarily, these equivalent quantities take the form of electrical, magnetic, and/or optical signals that can be stored, transmitted, combined, compared, and/or manipulated in other ways.
Furthermore, any of the operations described herein that form part of the illustrative embodiment are useful machine operations. These illustrative examples are also about the methods used to perform these operations A device or a device. The device can be specially constructed for the required purpose, or can be incorporated into a general-purpose computer device that is selectively activated or configured by a computer program stored in the computer. In particular, various general-purpose machines coupled to one or more processors of one or more computer-readable media can be used with computer programs written in accordance with the teachings disclosed herein, or configured to perform one of the required operations More dedicated devices may be more convenient.
The foregoing description has been directed to specific illustrative embodiments of the invention. However, it will be understood that other changes and modifications can be made to the described embodiments to obtain some or all of their associated advantages. In addition, the procedures, processing procedures, and/or modules described herein can be implemented in hardware, software (embodied as a computer-readable medium with program instructions), firmware, or a combination thereof. For example, one or more of the functions described herein can be performed by a processor that executes program instructions from a memory or other storage device.
Those familiar with the art will understand that modifications and changes to the systems and methods described above can be made without departing from the inventive concept disclosed in this article. Therefore, the present invention should not be regarded as restrictive, except as limited by the scope and spirit of the scope of the appended patent application.
117 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103 Sheet 104 Sheet 105 Sheet 106 Sheet 107 Sheet 108 Sheet 109 Sheet 110 Sheet 111 Sheet 112 Sheet 113 Sheet 114 Sheet 115 Sheet 116 Sheet 117
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| TWI378255B | Cites | Taiwan Province of China | Examiner |
| TWI380014B | Cites | Taiwan Province of China | Examiner |
| TWI406684B | Cites | Taiwan Province of China | Examiner |
| TWI378255 | Cites | Taiwan Province of China | – |
| TWI380014 | Cites | Taiwan Province of China | – |
| TWI406684 | Cites | Taiwan Province of China | – |
38 members in 5 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 14037106 | United States of America | – | |
| 201314037106 | United States of America | A | |
| 201314037106 | United States of America | A | |
| 14037106 | – | – | – |
| US201314037106 | – | – | – |
Members38
| Document | Office | Kind | |
|---|---|---|---|
| WO2013148730A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2013148730A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2014114190A1 | United States of America | A1 | |
| US2014121524A1 | United States of America | A1 | |
| EP2830507A2 | European Patent Office (EPO) | A2 | |
| WO2015048327A2 | World Intellectual Property Organization (WIPO) | A2 | |
| JP2015515312A | Japan | A | |
| WO2015048327A3 | World Intellectual Property Organization (WIPO) | A3 | |
| TW201531283A | Taiwan Province of China | A | |
| WO2015048327A8 | World Intellectual Property Organization (WIPO) | A8 | |
| US2016228091A1 | United States of America | A1 | |
| JP6195606B2 | Japan | B2 | |
| JP2017213427A | Japan | A | |
| US9877699B2 | United States of America | B2 | |
| US2018168548A1 | United States of America | A1 | |
| TWI659727BThis record | Taiwan Province of China | B | |
| TW201927247A | Taiwan Province of China | A | |
| JP2019141629A | Japan | A | |
| US10667790B2 | United States of America | B2 | |
| US2020268351A1 | United States of America | A1 | |
| TWI710356B | Taiwan Province of China | B | |
| JP6799104B2 | Japan | B2 | |
| JP2021037326A | Japan | A | |
| US11179138B2 | United States of America | B2 | |
| US2022125407A1 | United States of America | A1 | |
| US2022304661A1 | United States of America | A1 | |
| JP7304076B2 | Japan | B2 | |
| JP2023120341A | Japan | A | |
| EP4254157A2 | European Patent Office (EPO) | A2 | |
| US11857363B2 | United States of America | B2 | |
| EP4254157A3 | European Patent Office (EPO) | A3 | |
| US2024148358A1 | United States of America | A1 | |
| US12102480B2 | United States of America | B2 | |
| US12115023B2 | United States of America | B2 | |
| JP2025076481A | Japan | A | |
| JP7687708B2 | Japan | B2 | |
| US2025195037A1 | United States of America | A1 | |
| US2025213221A1 | United States of America | A1 |
Numbers
- Publication
- I659727
- Publication, DOCDB
- I659727
- Publication, EPODOC
- TWI659727B
- Application
- 103133359
- Application, DOCDB
- 103133359
- Application, EPODOC
- TW20140133359
Titles2
- English
- TABLET ULTRASOUND SYSTEM
- Chinese
- 平板電腦超聲波系統
Classification
- CPC, 29
- A61B8/467
- G01S7/52084
- A61B8/462
- A61B8/463
- A61B8/465
- G01S7/52074
- A61B8/565
- B06B1/0622
- G01S15/8979
- G01S15/8993
- G01S7/52066
- G01S7/52071
- G01S15/8925
- G01S15/8927
- G10K11/346
- G01S7/52082
- G01S7/5208
- B06B1/0611
- A61B8/4405
- A61B8/4411
- A61B8/4427
- A61B8/4433
- A61B8/4438
- G10K11/348
- G06F2203/04808
- G06F3/04883
- H10W90/736
- H10W90/756
- H10W74/00
- IPC, 1
- A61B8 00