Image display method, image display device and ultrasonograph

Description: TECHNICAL FIELD [Detailed description of the invention]

【0001】

[Technical field to which the invention belongs]

The present invention relates to an image display method, an image display device, and an ultrasonic diagnostic device, and more specifically, it is possible to display how the puncture needle invades in the depth direction so that the relative position of the puncture needle with respect to the tissue can be known. The present invention relates to an image display method, an image display device, and an ultrasonic diagnostic device.

【0002】

[Conventional technology]

8 and 9 are explanatory views of an image display method disclosed in Japanese Patent Application Laid-Open No. 2000-200340. As shown in FIG. 8, three scanning planes adjacent to each other in the depth direction in which the puncture needle n invades are scanned by a CT device to obtain GA, GB, and GC tomographic images. Next, a composite image is created in which the average value of the CT values of the pixels at the same position of each tomographic image GA, GB, and GC is used as the pixel value at the same position. Then, the CT values of the pixels at the same position of each tomographic image GA, GB, GC are compared, and (1) CT value of tomographic image GA >> CT value of tomographic image GB and CT value of tomographic image GA >> fault If it is the CT value of the image GC, the pixel at the same position is colored "blue". (2) CT value of tomographic image GB >> CT value of tomographic image GA and CT value of tomographic image GB >> If the CT value of tomographic image GC, the pixel at the same position is colored "green". (3) CT value of tomographic image GC >> CT value of tomographic image GA and CT value of tomographic image GC >> If the CT value of tomographic image GB, the pixel at the same position is colored "red". (4) Pixels other than the above (1), (2) and (3) are displayed in gray. As a result, as shown in the display image Gj shown in FIG. 9, the image M1 of the puncture needle n shown in the tomographic image GA is displayed in blue in the region in the composite image and is shown in the tomographic image GB. The image M2 of the puncture needle n is displayed in "green", and the image M3 of the puncture needle n shown in the tomographic image GC is displayed in "red". In addition, the image T of the tissue of the subject h in which the CT values of the pixels at the same positions of the tomographic images GA, GB, and GC are not significantly different is displayed in gray.

【0003】

According to the display image Gj, the appearance of the puncture needle n invading in the depth direction can be visually recognized by the display color of the image M of the puncture needle n.

【0004】

[Problems to be Solved by the Invention]

In the above-mentioned display image Gj, only the puncture needle n whose CT value is significantly larger than that of the tissue is colored, and the tissue whose CT value is not significantly different in each tomographic image is not colored. However, if the tissue is not colored, the position of the tissue in the depth direction cannot be known, so that there is a problem that the relative position of the puncture needle n with respect to the tissue cannot be known. For example, in the composite image Gk shown in FIG. 10, since the image M1 at the tip of the puncture needle n is displayed in red, it can be seen that it has penetrated to the tomographic image GC. However, since the tumor image K is gray, it is not clear whether it appears in the tomographic image GA, GB, or GC. That is, there is a problem that it cannot be determined whether or not the tip of the puncture needle n has exceeded the tumor. Therefore, an object of the present invention is to provide an image display method, an image display device, and an ultrasonic diagnostic device capable of displaying how the puncture needle invades in the depth direction so that the relative position of the puncture needle with respect to the tissue can be known. To do.

【0005】

[Means for solving problems]

From the first aspect, the present invention adds different coloring depending on the tomographic image to which the pixel having the maximum pixel value belongs among the pixels at the same position of a plurality of tomographic images adjacent to each other and according to the maximum pixel value. Provided is an image display method characterized by displaying a display image with a brightness value. In the image display method according to the first aspect, the brightness value is set according to the maximum pixel value among the pixel values of the pixels at the same position of a plurality of tomographic images adjacent to each other. That is, the brightness value of the pixels of the display image is determined by the MIP (Maximum Intensity Projection) process. Further, different coloring is added according to the tomographic image to which the pixel having the maximum pixel value among the pixels at the same position of the plurality of tomographic images adjacent to the scanning plane belongs. Therefore, even a structure having no large difference in pixel values is colored, so that the position of the structure in the depth direction can be known. Therefore, it is possible to display how the puncture needle invades in the depth direction so that the relative position of the puncture needle with respect to the tissue can be known.

【0006】

From the second viewpoint, in the present invention, with respect to the pixels located in the region of interest set on the scanning surface, the pixel having the maximum pixel value among the pixels at the same position of the plurality of tomographic images adjacent to the scanning surface belongs. Different coloring is added according to the tomographic image and the brightness value is set according to the maximum pixel value. For pixels located outside the region of interest, pixels at the same position of a plurality of tomographic images that are not colored and have adjacent scanning surfaces. Provided is an image display method characterized by displaying a display image having a brightness value corresponding to the maximum pixel value among the pixel values of the above. In the image display method from the second viewpoint, for example, if a partial region including the path of the puncture needle is set as the region of interest, the puncture needle moves in the depth direction as in the image display method from the first viewpoint. The state of invasion can be displayed so that the relative position of the puncture needle with respect to the tissue can be known. On the other hand, since it is not colored outside the area of interest, it is possible to prevent unnecessary coloring from becoming annoying.

【0007】

From the third viewpoint, in the present invention, among the pixel values of the pixels at the same position of a plurality of tomographic images having adjacent scanning surfaces, the scanning surfaces are adjacent to the pixels at that position when the maximum pixel value is larger than the threshold value. When the pixel having the maximum pixel value among the pixels at the same position of the plurality of tomographic images is colored differently according to the tomographic image to which the pixel has the maximum pixel value and the brightness value is set according to the maximum pixel value, and the maximum pixel value is smaller than the threshold value. For the pixel at that position, it is necessary to display a display image in which the brightness value is set according to the maximum pixel value among the pixel values of the pixels at the same position of a plurality of tomographic images adjacent to each other without coloring. A featured image display method is provided. In the image display method from the third viewpoint, for example, if a value slightly smaller than the pixel value of the tumor is set as the threshold value, the puncture needle penetrates in the depth direction as in the image display method from the first viewpoint. The state of progress can be displayed so that the relative position of the puncture needle with respect to the tumor can be known. On the other hand, in most normal tissues, the pixel value is smaller than the threshold value and the tissue is not colored, so that unnecessary coloring can be prevented from becoming annoying.

【0008】

From the fourth viewpoint, the present invention has a tomographic image storage means for storing a plurality of tomographic images adjacent to the scanning planes and a maximum pixel value among the pixels at the same position of the plurality of tomographic images adjacent to the scanning planes. Provided is an image display device provided with a display means for generating and displaying a display image in which different colors are added according to the tomographic image to which the pixels belong and the brightness value is set according to the maximum pixel value. In the image display device according to the fourth viewpoint, the image display method according to the first viewpoint can be preferably implemented.

【0009】

From the fifth aspect, the present invention includes a tomographic image storage means for storing a plurality of tomographic images adjacent to the scanning plane, a region of interest setting means for setting a region of interest on the scanning plane, and a pixel located in the region of interest. Of the pixels at the same position of a plurality of tomographic images having adjacent scanning surfaces, different coloring is added according to the tomographic image to which the pixel having the maximum pixel value belongs, and the brightness value is set according to the maximum pixel value. For pixels located outside the region, a display image is generated and displayed with the brightness value corresponding to the maximum pixel value among the pixel values of the pixels at the same position of multiple tomographic images adjacent to each other without coloring. Provided is an image display device characterized in that it is provided with a display means to be used. In the image display device according to the fifth viewpoint, the image display method according to the second viewpoint can be preferably implemented.

【0010】

From the sixth viewpoint, the present invention has a tomographic image storage means for storing a plurality of tomographic images adjacent to each other, a threshold setting means for setting a threshold, and a plurality of tomographic images having adjacent scanning planes at the same position. For the pixel at that position when the maximum pixel value is larger than the threshold among the pixel values of the pixels, the tomographic image to which the pixel having the maximum pixel value belongs among the pixels at the same position of the plurality of tomographic images adjacent to the scanning surface. Different coloring is added according to the above and the brightness value is set according to the maximum pixel value. When the maximum pixel value is smaller than the threshold value, the pixel at the position is not colored and the scanning surfaces are adjacent to each other. Provided is an image display device provided with a display means for generating and displaying a display image having a brightness value corresponding to the maximum pixel value among the pixel values of the pixels at the same position. In the image display device according to the sixth aspect, the image display method according to the third aspect can be preferably implemented.

【0011】

From the seventh aspect, the present invention uses an ultrasonic probe capable of scanning a plurality of adjacent scanning surfaces simultaneously or in a time-divided manner, and the plurality of adjacent scanning surfaces using the ultrasonic probe. Ultrasonic scanning means, a tomographic image generating means that generates a tomographic image based on the data obtained by scanning, a tomographic image storage means that stores a plurality of tomographic images, and a plurality of tomographic images having adjacent scanning planes. A display control means for generating a display image in which different coloring is applied according to the tomographic image to which the pixel having the maximum pixel value among the pixels at the same position belongs and the brightness value is set according to the maximum pixel value, and an image for displaying the image. Provided is an ultrasonic diagnostic apparatus provided with a display means. In the ultrasonic diagnostic apparatus according to the seventh aspect, the image display method according to the first aspect can be preferably carried out. The ultrasonic probe capable of simultaneously scanning a plurality of adjacent scanning surfaces is, for example, an ultrasonic probe of a two-dimensional array. Further, the ultrasonic probe capable of time-divisionally scanning a plurality of adjacent scanning surfaces is, for example, an ultrasonic probe capable of mechanically moving the scanning surfaces in a direction orthogonal to the scanning surfaces.

【0012】

From the eighth aspect, the present invention uses an ultrasonic probe capable of scanning a plurality of adjacent scanning surfaces simultaneously or in a time-divided manner, and the plurality of adjacent scanning surfaces using the ultrasonic probe. An ultrasonic scanning means for scanning, a tomographic image generating means for generating a tomographic image based on the data obtained by scanning, a tomographic image storage means for storing a plurality of tomographic images, and an area of interest for setting an area of interest on the scanning surface. For the setting means and the pixels located in the region of interest, different coloring is added according to the tomographic image to which the pixel having the maximum pixel value among the pixels at the same position of the plurality of tomographic images adjacent to the scanning plane belongs. The brightness value is set according to the maximum pixel value, and for pixels located outside the region of interest, the maximum pixel value is set among the pixel values of the pixels at the same position of a plurality of tomographic images adjacent to each other without coloring. Provided is an ultrasonic diagnostic apparatus including a display control means for generating a display image having a corresponding brightness value and an image display means for displaying the image. In the ultrasonic diagnostic apparatus according to the eighth aspect, the image display method according to the second aspect can be preferably carried out.

【0013】

From the ninth aspect, the present invention uses an ultrasonic probe capable of scanning a plurality of adjacent scanning surfaces simultaneously or in a time-divided manner, and scans the plurality of adjacent scanning surfaces using the ultrasonic probe. Ultrasonic scanning means, tomographic image generation means to generate tomographic images based on the data obtained by scanning, tomographic image storage means to store a plurality of tomographic images, threshold setting means to set a threshold, and scanning. Among the pixel values of the pixels at the same position of the plurality of tomographic images whose surfaces are adjacent to each other, the pixels at the position where the maximum pixel value is larger than the threshold value are the pixels of the pixels at the same position of the plurality of tomographic images whose scanning surfaces are adjacent to each other. Add different coloring according to the tomographic image to which the pixel with the maximum pixel value belongs and set the brightness value according to the maximum pixel value, and add coloring to the pixel at that position when the maximum pixel value is smaller than the threshold value. A display control means for generating a display image having a brightness value corresponding to the maximum pixel value among the pixel values of pixels at the same position of a plurality of tomographic images having adjacent scanning surfaces, and an image display means for displaying the image. Provided is an ultrasonic diagnostic apparatus characterized by the above. In the ultrasonic diagnostic apparatus according to the ninth aspect, the image display method according to the third aspect can be preferably carried out.

【0014】

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, the present invention will be described in more detail with reference to embodiments of the invention shown in the figure. It should be noted that this does not limit the present invention.

【0015】

-First embodiment- FIG. 1 is a configuration diagram showing an ultrasonic diagnostic apparatus according to a first embodiment of the present invention. The ultrasonic diagnostic apparatus 100A includes an ultrasonic probe 1 capable of simultaneously or timely scanning the adjacent first scanning surface S1, second scanning surface S2, and third scanning surface S3, and an ultrasonic probe 1 thereof. A transmitter / receiver 2 that cyclically scans each scanning surface S1, S2, S3 by the child 1 to output a received signal, and a B-mode image of each scanning surface S1, S2, S3 is cyclically generated from the received signal. The B-mode processing unit 3, the first scanning surface image storage unit 41 that stores the latest B-mode image of the first scanning surface, and the second scanning surface image storage unit 41 that stores the latest B-mode image of the second scanning surface. 42, the third scanning surface image storage unit 43 that stores the latest B-mode image of the third scanning surface, and the pixels of the pixels at the same position (x, y) of the B-mode image of each scanning surface S1, S2, S3. The maximum pixel value dm (x, y) is selected from the values d1 (x, y), d2 (x, y), and d3 (x, y) and output, and the maximum pixel value dm (x, y) is output. It is provided with a maximum value detecting unit 5 that outputs whether the scanning surface to which the pixel having the above is the first scanning surface S1, the second scanning surface S2, or the third scanning surface S3.

【0016】

In addition, the ultrasonic diagnostic apparatus 100A grayscales the region of interest setting unit 6A for the operator to set the region of interest and the maximum pixel value dm (x, y) if a certain position (x, y) is outside the region of interest. If the scanning surface to which the pixel that is output to unit 80 and has the maximum pixel value dm (x, y) at a certain position (x, y) in the region of interest belongs is the first scanning surface S1, the maximum pixel value dm (x, y) Is output to the blue scale unit 81, and if the scanning surface to which the pixel having the maximum pixel value dm (x, y) at a certain position (x, y) belongs is the second scanning surface S2, the maximum pixel value dm (x) , y) is output to the white scale unit 82, and if the scanning surface to which the pixel having the maximum pixel value dm (x, y) at a certain position (x, y) belongs in the region of interest is the third scanning surface S3, the maximum pixel value The color determination unit 7A that outputs dm (x, y) to the red scale unit 83 and the gray scale unit 80 that converts the input maximum pixel value dm (x, y) to gray brightness in gray scale are input. The blue scale unit 81 that converts the maximum pixel value dm (x, y) to blue brightness on a blue scale, and the white scale that converts the input maximum pixel value dm (x, y) to white brightness on a white scale. Part 82, red scale part 83 that converts the input maximum pixel value dm (x, y) to red brightness with red scale, gray scale part 80, blue scale part 81, white scale part 82 or red scale part It is provided with a display unit 9 that displays a display image in which the outputs of 83 are combined.

【0017】

FIG. 2 is a schematic diagram showing a situation in which three scanning surfaces adjacent to each other in the depth direction in which the puncture needle n penetrates are scanned by the ultrasonic diagnostic apparatus 100A to obtain each B mode image BA, BB, BC. is there. The puncture needle n penetrates the scanning surfaces of the B-mode images BA and BB, and the tip of the puncture needle n is on the scanning surface of the B-mode image BC. In addition, the scanning surface of the B-mode image BC contains the tumor k. In addition, bone b exists through the scanning surfaces of the B-mode images BA, BB, and BC. P1 represents the first scanning surface entry point where the puncture needle n penetrates the scanning surface of the B-mode image BA. P2 represents the second scanning surface entry point where the puncture needle n penetrates the scanning surface of the B-mode image BB. P3 represents the third scanning surface entry point where the puncture needle n penetrates the scanning surface of the B-mode image BC.

【0018】

FIG. 3 is an example diagram of the display screen G1 when the entire screen is set as the region of interest. The image M of the puncture needle n is displayed in blue between the first scanning surface intrusion point P1 and the second scanning surface intrusion point P2, and white between the second scanning surface intrusion point P2 and the third scanning surface intrusion point P3. Is displayed, and the area beyond the third scanning surface penetration point P3 is displayed in red. Image K of tumor k is displayed in red. Image B of bone b is displayed in blue, white and red. In addition, all pixels other than the above are also displayed in blue, white, or red. According to the above display screen G1, since the tip of the image M of the puncture needle n is displayed in red, it can be seen that it has penetrated to the scanning surface of the B mode image BC. Further, since the image K of the tumor k is red, it can be seen that the tumor k is on the scanning surface of the B-mode image BC. Therefore, it can be seen that the tip of the puncture needle n is correctly advanced toward the tumor k.

【0019】

FIG. 4 is an example diagram of the display screen G2 when the partial region including the path through which the puncture needle n invades is set as the region of interest. The image M of the puncture needle n is within the region of interest ROI and is displayed in blue, white and red. Image K of tumor k is within the region of interest ROI and is displayed in red. Also, all pixels in the region of interest ROI other than the above are also displayed in blue, white or red. Image B of bone b is outside the region of interest ROI and is displayed in gray. In addition, all pixels outside the ROI of interest other than the above are also displayed in gray. According to the above display screen G2, since the tip of the image M of the puncture needle n is displayed in red, it can be seen that it has penetrated to the scanning surface of the B mode image BC. Further, since the image K of the tumor k is red, it can be seen that the tumor k is on the scanning surface of the B-mode image BC. Therefore, it can be seen that the tip of the puncture needle n is correctly advanced toward the tumor k. And since the area outside the ROI of interest is displayed in gray, it is possible to prevent unnecessary coloring from becoming annoying.

【0020】

-Second embodiment- FIG. 5 is a configuration diagram showing an ultrasonic diagnostic apparatus according to a second embodiment of the present invention. The ultrasonic diagnostic apparatus 100B includes an ultrasonic probe 1 capable of simultaneously or timely scanning the adjacent first scanning surface S1, second scanning surface S2, and third scanning surface S3, and an ultrasonic probe 1 thereof. A transmitter / receiver 2 that cyclically scans each scanning surface S1, S2, S3 by the child 1 to output a received signal, and a B-mode image of each scanning surface S1, S2, S3 is cyclically generated from the received signal. The B-mode processing unit 3, the first scanning surface image storage unit 41 that stores the latest B-mode image of the first scanning surface, and the second scanning surface image storage unit 41 that stores the latest B-mode image of the second scanning surface. 42, the third scanning surface image storage unit 43 that stores the latest B-mode image of the third scanning surface, and the pixels of the pixels at the same position (x, y) of the B-mode image of each scanning surface S1, S2, S3. The maximum pixel value dm (x, y) is selected from the values d1 (x, y), d2 (x, y), and d3 (x, y) and output, and the maximum pixel value dm (x, y) is output. It is provided with a maximum value detecting unit 5 that outputs whether the scanning surface to which the pixel having the above is the first scanning surface S1, the second scanning surface S2, or the third scanning surface S3.

【0021】

Further, the ultrasonic diagnostic apparatus 100B includes a threshold setting unit 6B for the operator to set a threshold, and a maximum pixel value dm (x, y) when the maximum pixel value dm (x, y) at a certain position (x, y) is equal to or less than the threshold. x, y) is output to the grayscale unit 80, and the pixel whose maximum pixel value dm (x, y) at a certain position (x, y) is larger than the threshold value and has the maximum pixel value dm (x, y) is the first pixel. If it belongs to the scanning surface S1, the maximum pixel value dm (x, y) is output to the blue scale unit 81, and the maximum pixel value dm (x, y) at a certain position (x, y) is larger than the threshold value and the maximum pixel value dm. If the pixel with (x, y) belongs to the second scanning surface S2, the maximum pixel value dm (x, y) is output to the white scale unit 82, and the maximum pixel value dm (x, y) at a certain position (x, y) is output. If a pixel whose y) is larger than the threshold value and has the maximum pixel value dm (x, y) belongs to the third scanning surface S3, the color determination unit 7B which outputs the maximum pixel value dm (x, y) to the red scale unit 83 , The gray scale unit 80 that converts the input maximum pixel value dm (x, y) to gray brightness on a gray scale, and the input maximum pixel value dm (x, y) that is converted to blue brightness on a blue scale. The blue scale part 81 to be used, the white scale part 82 to convert the input maximum pixel value dm (x, y) into white brightness on a white scale, and the input maximum pixel value dm (x, y) to be red scaled. It is provided with a red scale unit 83 that converts to red brightness with, and a display unit 9 that displays a display image in which the outputs of the gray scale unit 80, the blue scale unit 81, the white scale unit 82, or the red scale unit 83 are combined. There is.

【0022】

Here, as shown in FIG. 2, the three scanning surfaces adjacent to each other in the depth direction in which the puncture needle n penetrates are scanned by the ultrasonic diagnostic apparatus 100B to obtain the B-mode images BA, BB, and BC. Imagine a situation where you are.

【0023】

FIG. 6 is an example diagram of the display screen G3 when the threshold value is set to be slightly smaller than the pixel value of the image K of the tumor k. The image M of the puncture needle n is displayed in blue between the first scanning surface intrusion point P1 and the second scanning surface intrusion point P2, and white between the second scanning surface intrusion point P2 and the third scanning surface intrusion point P3. Is displayed, and the area beyond the third scanning surface penetration point P3 is displayed in red. Image K of tumor k is displayed in red. Image B of bone b is displayed in blue, white and red. Pixels other than the above are displayed in gray when the maximum pixel value dm (x, y) is equal to or less than the threshold value, and are displayed in blue, white, or red when the maximum pixel value dm (x, y) is larger than the threshold value. In reality, most pixels are below the threshold and are displayed in gray. According to the above display screen G3, since the tip of the image M of the puncture needle n is displayed in red, it can be seen that it has penetrated to the scanning surface of the B mode image BC. Further, since the image K of the tumor k is red, it can be seen that the tumor k is on the scanning surface of the B-mode image BC. Therefore, it can be seen that the tip of the puncture needle n is correctly advanced toward the tumor k.

【0024】

FIG. 7 is an example diagram of the display screen G4 when the threshold value is set to be slightly smaller than the pixel value of the image K of the puncture needle n. The image M of the puncture needle n is displayed in blue, white, and red. The image K of the tumor k has a pixel value below the threshold value and is displayed in gray. The image B of the bone b also has a pixel value equal to or less than the threshold value and is displayed in gray. Pixels other than the above are displayed in gray when the maximum pixel value dm (x, y) is equal to or less than the threshold value, and are displayed in blue, white, or red when the maximum pixel value dm (x, y) is larger than the threshold value. In reality, most pixels are below the threshold and are displayed in gray. According to the above display screen G4, since the tip of the image M of the puncture needle n is displayed in red, it can be seen that it has penetrated to the scanning surface of the B mode image BC. Further, since the image M other than the image M of the puncture needle n is displayed in gray, it is possible to prevent unnecessary coloring from becoming annoying. The display screen G4 is similar to the conventional display screen Gj shown in FIG.

【0025】

In the above embodiment, the adjacent scanning surfaces are three surfaces, but two surfaces may be used, or four or more surfaces may be used. Further, as the coloring, yellow, green or the like may be used.

【0026】

[Effect of the invention]

According to the image display method, the image display device, and the ultrasonic diagnostic device of the present invention, it is possible to display how the puncture needle invades in the depth direction so that the relative position of the puncture needle with respect to the tissue can be known.

[Simple explanation of drawings]

[Figure 1]

It is a block diagram which shows the ultrasonic diagnostic apparatus which concerns on 1st Embodiment of this invention.

[Figure 2]

It is explanatory drawing which shows the imaging state by the ultrasonic diagnostic apparatus of FIG.

[Fig. 3]

It is an example figure of the display screen which concerns on 1st Embodiment when the area of interest is set to the full screen.

[Fig. 4]

It is an example figure of the display screen which concerns on the 1st Embodiment when the area of interest is set to the area near the entry path of a puncture needle.

[Fig. 5]

It is a block diagram which shows the ultrasonic diagnostic apparatus which concerns on 1st Embodiment of this invention.

[Fig. 6]

It is an example figure of the display screen which concerns on the 2nd Embodiment when the threshold value is set to the value slightly smaller than the pixel value of a tumor.

[Fig. 7]

It is an example figure of the display screen which concerns on the 2nd Embodiment when the threshold value is set to the value slightly smaller than the pixel value of a puncture needle.

[Fig. 8]

It is explanatory drawing for demonstrating the conventional image display method.

[Fig. 9]

It is an example figure of the display screen by the conventional image display method.

[Fig. 10]

It is another example figure of the display screen by the conventional image display method.

[Explanation of symbols]

100A, 100B ultrasonic diagnostic equipment 1 Ultrasonic probe 2 Transmitter / receiver 3 B mode processing unit 41 First scanning surface image storage unit 42 Second scanning surface image storage unit 43 Third scanning surface image storage unit 5 Maximum value detector 6A Area of interest setting section 6B Threshold setting unit 7A, 7B color determination section 80 grayscale part 81 Blue scale 82 White scale part 83 Red scale part 9 Display