Image display method, apparatus and storage medium

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] The present invention relates to an image display method, apparatus and storage medium, and more particularly to an image display method wherein a plurality of images are displayed on a CRT, LCD, etc. monitor according to a predetermined display layout, apparatus, and a computer-readable storage medium on which a program that causes a computer to execute the steps of the image processing method.

[0003] 2. Description of the Related Art

[0004] There are in use in the medical field today apparatus (modalities) for forming X-ray and other diagnostic images used in a variety of diagnosis, including CR (computed Radiography) apparatus, CT (Computerized Tomography) apparatus, MRI (Medical Resonance Imagery) apparatus, etc. The image data produced in each modality is displayed on a CRT terminal (hereinafter referred to simply as a CRT) , or output by a laser printer, etc. to film, etc. for use by a reader at a medical treatment site in ascertaining the presence or absence of a disease, tissue damage, etc.

[0005] In order to make images obtained by such modalities easy to use in diagnosis, it is necessary to display the images on a display means. At any rate, because a plurality of images are obtained in a single examination employing CT apparatus, MRI apparatus, etc., to provide for easy examination of such images it is necessary to line them up. In addition, when employing in diagnosis images obtained by CT apparatus, there are cases for which images acquired in the past are compared to images acquired in the present in a comparative diagnosis, and to facilitate easy performance of such comparison diagnosis it is necessary to line the images up and display them.

[0006] To this end, a display protocol is employed for defining the display format in which a plurality of images is to be displayed, and based on this display protocol; the plurality of images is displayed on the display means. The display protocol defines the layout of a plurality of images, the display conditions (for example, in what order images are to be displayed, etc.), the image processing conditions (hereinafter referred to as the layout, etc.); based on the examination, the series, the examining doctor or group of doctors, the place where the images are to be employed, the purpose for which the images are to be used, etc. For example, a given display protocol might be defined so that a screen is divided into four regions in which are displayed: in the upper left region, a front view X-ray image of the chest taken during the current examination; in the lower left region, a front view X-ray image of the chest taken in the past; in the upper right region, a side view X-ray image of the chest taken during the current examination; and in the upper right region, a side view X-ray image of the chest taken in the past. In addition, another display protocol might be defined so that a screen is divided into 9 regions in which a plurality of Tomography images obtained by a CT apparatus are lined up and displayed.

[0007] Further, although a display protocol is not employed, a method has been provide wherein each series (by type of examination) of images obtained in an examination employing MRI apparatus is lined up and displayed, and at the same time one series of images is switched, another series of images is also switched (refer to U.S. Pat. No. 5,452,416). According to this method, the examiner of images encounters no impediments in viewing of the images, and multiple series of images can be assigned to correspond to each other and displayed.

[0008] As examinations become more complex and the number of images increases, if only one display protocol is defined, it becomes difficult to display the images so that diagnosis can be performed without difficulty. Because of this, a plurality of display protocols is prepared, and the examiner switches the protocols in order, so that the plurality of images is displayed in the desired display layout. However, in this method of switching protocols a great burden is placed on the examiner in that he or she must memorize the type of layout defined by each display protocol. In addition, because it is necessary to specify the display protocol each time the layout is switched, the efficiency of displaying the images is extraordinarily low.

SUMMARY OF THE INVENTION

[0009] The present invention has been developed in consideration of the circumstances described above. A main objective of the present invention is to provide an image display method, apparatus and computer readable storage medium on which a program that causes a computer to execute the image display method is recorded, which can display with high efficiency a plurality of images.

[0010] In the image display method of the present invention for displaying a plurality of images on a display means, the display layout is switched by switching the display protocols, based on at least one display protocol sequence in which a plurality of display protocols that define a display layout are lined up in a predetermined order, and the plurality of images are displayed on the display means.

[0011] The expression “display means” refers to a CRT, LCD, etc monitor for displaying images.

[0012] The expression “display protocol” refers the protocol which defines image layout, image display conditions, image processing conditions, etc., based on an examination, a series, the examining doctor or group of doctors, the place an image will be used and/or the purpose of the image, etc. More specifically, a definition by which a screen is divided into four regions in which are displayed a front view X-ray image of the chest taken during the current examination in the upper left region, a front view X-ray image of the chest taken in the past in the lower left region, a side view X-ray image of the chest taken during the current examination in the upper right region, and a side view X-ray image of the chest taken in the past in the upper right region, or alternatively, a definition by which a screen is divided into 9 regions in which a plurality of Tomography images obtained by a CT apparatus are lined up and displayed, or a definition by which projection images and cross-sectional images obtained by a CT apparatus are lined up and displayed, or a definition by which cross-sectional images obtained by a CT apparatus are able to be switched and displayed, or a definition by which for images T<b>1</b> and T<b>2</b> obtained by an MRI apparatus in a special examination mode, a display screen may be dived up and images displayed based on whether or not a contrast medium was used when an image was taken, etc., may be employed as display protocols.

[0013] The expression “display protocol sequence” refers to an array of display protocols lined up in a predetermined order. Note that the display protocols in a display protocol sequence are lined up in an order according to the examination, the series, the examining doctor or the group of doctors the examining doctor belongs to, etc.

[0014] Moreover, switching of display protocols may be carried out manually or automatically.

[0015] Note that there may be only one display protocol sequence, however, for cases in which there are multiple display protocol sequences, it is desirable that it is possible to select one display protocol from said multiple protocols, and to have the plurality of images displayed on the display means based on the selected display protocol sequence.

[0016] In addition, when there are multiple display protocol sequences, they may be switched, and the plurality of images displayed, based on the display protocol sequence switched to, on the display means.

[0017] Further, the display protocol sequence can be set in advance, or it can be created based on the predetermined conditions when the images are displayed on the display means.

[0018] As the “predetermined conditions”, the type of examination, the series, the examining doctor or the group of doctors the examining doctor belongs to, etc. may be employed.

[0019] The image display apparatus of the present invention for displaying a plurality of images on a display means is provided with a memory means for remembering at least one display protocol sequence, in which a plurality of display protocols that define a display format are lined up in a predetermined order, and a control means for controlling the switching, based on at least one display protocol sequence, of display layouts by the switching of display protocols.

[0020] For cases in which multiple display protocol sequences are remembered by the memory means of the display apparatus of the present invention, an input means is provided for receiving selection of a desired display protocol sequence.

[0021] That aforementioned control means displays, based on the display protocol sequence selected in the input means, on the display means the plurality of images is desirable.

[0022] In addition, that the control means of the display apparatus of the present invention can also switch the multiple display protocol sequences, and based on the display protocol switched to, display the plurality of images is desirable.

[0023] Furthermore, that the control means of the image display apparatus according to the present invention creates the display protocol sequence based on the predetermined conditions, and displays the plurality of images on the display means based on the created display protocol sequence is desirable.

[0024] Note that image display method of the present invention may be provided as a program that causes a computer to execute the image display method of the present invention recorded on a computer-readable storage medium.

[0025] According to the present invention, based on a display protocol sequence in which a plurality of display protocols have been lined up in a predetermined order, the display layout of a plurality of images can be switched; therefore, it is not necessary for the examiner to memorize the display protocols, and the work load of the examiner is thereby reduced.

[0026] Further, for cases in which there are multiple display protocol sequences, because a desired display protocol sequence can be selected, the degree of freedom with respect to image display format is raised.

[0027] Additionally, for cases in which there is are multiple display protocol sequences, because the display protocol sequence can be switched, the examiner can display the plurality of images according to a desired display protocol sequence.

BRIEF DESCRIPTION OF THE DRAWINGS

P-0028[0028]FIG. 1 is a block drawing of the configuration of a medical image network, in which the display apparatus according to a preferred embodiment of the present invention is implemented,

P-0029[0029]FIG. 2 is a block diagram showing the detailed configuration of a workstation,

P-0030[0030]FIG. 3 shows examples of display protocols,

P-0031[0031]FIG. 4 shows the display protocol sequence selection screen, and

P-0032[0032]FIG. 5 is a flowchart of the operation of a preferred embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

P-0033[0033] Hereinafter, with reference to the drawings, the preferred embodiments of the present invention will be explained.

P-0034[0034]FIG. 1 is a block drawing of the configuration of a medical image network, in which the display apparatus according to a preferred embodiment of the present invention is implemented. As shown in FIG. 1, this medical image network comprises an image server <b>1</b> storing image data S and a workstation <b>2</b> connected by a network <b>3</b>. In such a medical image network, by workstation <b>2</b> accessing image server <b>1</b> and specifying that image data stored in image server <b>1</b> be transmitted, or by workstation <b>2</b> reading out from image server <b>1</b> image data stored from workstation to mage server <b>1</b>, images can be displayed at workstation <b>2</b> and diagnosis performed. Note that in FIG. 1, although only one workstation is shown, multiple workstation <b>2</b>'s are connected to image server <b>1</b> by network <b>3</b>.

P-0035[0035] Image server <b>1</b> is provided with: a temporary storage medium <b>11</b>, such as a RAID (Redundant Array of Inexpensive Disks), etc. for temporarily storing image data S; an archive disk <b>12</b>, such as a CD-R, DVD, DLI, etc. for providing semi-permanent storage of image data S after a specified period of time has elapsed; and a server computer <b>13</b> for controlling data-compression processing of image data S, data management, data transmission from workstation <b>2</b>, and various operations and processes of image server <b>1</b>. Further, image server <b>1</b> is connected to an input modality <b>4</b> such as CR apparatus, CT apparatus, MRI apparatus, etc., from which it receives formed image data S, which it stores and manages.

P-0036[0036] Note that, according to the set conditions (after a predetermined period of time elapses after diagnosis by a doctor has been performed, for example), image data S is copied from temporary storage medium <b>11</b> to archive <b>12</b>. For example, when said set conditions are satisfied, the exact same image data S as that stored in temporary storage medium <b>11</b> is copied to archive <b>12</b>, and as the amount of storage space on temporary storage medium <b>11</b> becomes unavailable for use, said image data S is deleted from temporary storage medium <b>11</b> in the order commencing from the oldest date thereof, whereby said image data S becomes stored exclusively in archive <b>12</b>. Note that according to the purpose of image data S, it may be compressed and stored in both temporary storage medium <b>11</b> and archive <b>12</b>. In addition, original image data or original image data that has been compressed and is extractable can be stored in temporary storage medium <b>11</b>, and when said image data is copied to archive <b>12</b> it can be made undecompressible.

P-0037[0037] Further, copying data S to archive <b>12</b> and deleting data S from temporary storage medium <b>11</b> are managed by the database DB, which is not shown in the drawings. Accordingly, if a request for image data S that has been deleted from temporary storage medium <b>11</b> is issued by display terminal <b>2</b>, said image data is read out from archive <b>12</b> and transmitted to display terminal <b>2</b>. In this case, although more time is required for such reading out and transmitting from archive <b>12</b>, compared to cases in which image data S is transmitted to display terminal <b>2</b> from temporary storage medium <b>11</b>, the image represented by image data S can be displayed by display terminal <b>2</b> without recognition of the storage location of said image data S.

P-0038[0038] Workstation <b>2</b> is provided with: a computer <b>21</b>; a CRT, LCD, etc. monitor <b>22</b>; and a keyboard, mouse, etc. input means <b>23</b>. By various input operations of input means <b>23</b>, image data S can be acquired from image server <b>1</b> and images displayed on monitor <b>22</b>.

P-0039[0039] Next, the image display method for displaying images on monitor <b>22</b> of workstation <b>2</b> will be explained. FIG. 2 is a block diagram showing the detailed configuration of a workstation. As shown in FIG. 2, workstation <b>2</b> is provided with a controller <b>27</b> and a memory <b>28</b>. Note that in the current embodiment two monitors, <b>22</b>A and <b>22</b>B are used for displaying images. In addition, controller <b>27</b> and memory <b>28</b> are provided in FIG. 2 for explanation purposes, however; actual processing is carried out by use of software installed in computer <b>21</b>. In memory <b>28</b>, multiple display protocol sequences PS, in which multiple display protocols P defining multiple display layouts are lined up in a predetermined order, are remembered.

P-0040[0040]FIG. 3 shows the display layouts according to each type of display protocol. Note that in the current embodiment, images obtained by a CT apparatus are displayed. More specifically, in a CT apparatus, two images are taken of the same position: one of the images has shadowed structures, and the other image does not. Generally, there is set of projection images (called “scout views”) composed of a projection image having shadowing and a projection image not having shadowing, and a set of cross-sectional images composed of a cross-sectional image having shadowing and a cross-sectional image not having shadowing, for a total of two sets of images. Each of the two sets of images obtained in this way are grouped so that there is a group containing an image S<b>1</b> (projection image with shadowing), and an image S<b>2</b> (cross-sectional image with shadowing), and a group containing an image S<b>3</b> (projection image without shadowing), and an image S<b>4</b> (cross-sectional image without shadowing). Here, there is only one image for each projection image; however, each cross-sectional image has 36 images, corresponding to the slice position, which are represented by S<b>2</b> and S<b>4</b>. Note that images S<b>1</b>-S<b>4</b> represent images obtained in the current examination.

P-0041[0041] In addition, the patient subjected to the current examination was subjected to an identical examination a week before (hereinafter referred to as a past examination) , and for the past examination, a group of images containing an image O<b>1</b> (projection image with shadowing), and an image O<b>2</b> (cross-sectional image with shadowing), and a group containing an image O<b>3</b> (projection image without shadowing), and an image O<b>4</b> (cross-sectional image without shadowing) were obtained. The number of images is the same as for S<b>1</b>-S<b>4</b>.

P-0042[0042] Furthermore, X-ray images of a front view and a side view of the chest of this patient were also obtained.

P-0043[0043] First, the examining doctor performs a brief examination of the images obtained in the current examination. In this case, as shown in FIG. 3(<i>a</i>), the display screen of monitors <b>22</b>A and <b>22</b>B are each divided into 9 sections, and image S<b>2</b> is displayed first, followed by image S<b>4</b>. Here, images S<b>2</b> and S<b>4</b> each have 36 cross-sectional images, however, because only 18 images can be displayed at one time on monitors <b>22</b>A and <b>22</b>B, according to a switching operation of input means <b>23</b>, the displaying of all the images is split into two times and carried out. This type of image protocol is designated as P<b>1</b>.

P-0044[0044] Next, for cases in which images obtained in a past examination are to be compared to images obtained in the current examination, the display screen of monitors <b>2</b>A and <b>22</b>B are each divided into four sections and each of the images are displayed: in region A<b>1</b>, image S<b>1</b>; in region A<b>2</b>, image S<b>2</b>; in region S<b>3</b>, image O<b>1</b>; in region A<b>4</b>, image S<b>4</b>; in region B<b>1</b>, image S<b>3</b>; in region B<b>2</b>, image S<b>4</b>; in region B<b>3</b>, image O<b>3</b>; and in region B<b>4</b>, image O<b>4</b>. Here, image S<b>1</b> has only one image, but image S<b>2</b>, S<b>4</b>, O<b>2</b> and O<b>4</b> each have 6 cross-sectional images, therefore, by employing input means <b>23</b>, the images are sent in order or in reverse order, according to the number assigned to each mage (generally, the slice order, in other words, the order of the slice position), and switched and displayed. Further, a mark for showing what is called the referencing position of the cross-section is displayed in images S<b>1</b>, S<b>4</b>, O<b>1</b> and O<b>4</b>. In this way, it is possible to see which position of the cross-sectional positions of images S<b>1</b>, S<b>4</b>, O<b>1</b> and O<b>4</b> is currently being displayed. This type of display layout is called a stack display, and by displaying such a stack display it is possible to compare image S<b>2</b> to image O<b>2</b>, and image S<b>4</b> to image O<b>4</b>; that is to say, comparing the images obtained in the past examination to the images obtained in the current examination is easy to perform. In addition, if switching of the images of the past examination and images of the present examination is carried out at the same time, by switching only the images on one side, because the images on the other side are also sent in order, it is easy to compare the images on both sides. This type of image protocol is designated as P<b>2</b>.

P-0045[0045] Next, when comparing the CT images and the chest X-ray images, the display screen of monitor <b>2</b>A is divided into four sections, and the display screen of monitor <b>22</b>B is divided into 2 sections and each image is displayed: on monitor <b>22</b>A, in region A<b>1</b>, image S<b>1</b>; in region A<b>2</b>, image S<b>2</b>; in region A<b>3</b>, image S<b>3</b>; in region A<b>4</b>, image S<b>4</b>; and on monitor <b>22</b>B, in region B<b>1</b>, the front view chest X-ray image; in region B<b>2</b>, the side view chest X-ray image. This type of image protocol is designated as P<b>3</b>.

P-0046[0046] Display protocol PS<b>1</b> is composed of aforementioned display protocols P<b>1</b>, P<b>2</b> and P<b>3</b>, lined up in that order, display protocol PS<b>2</b> is composed of aforementioned display protocols P<b>1</b>, P<b>2</b> and P<b>3</b>, lined up in the order P<b>1</b>, P<b>3</b>, P<b>2</b>, and display protocol PS<b>3</b> is composed of aforementioned display protocols P<b>1</b>, P<b>2</b> and P<b>3</b>, lined up in the order P<b>2</b>, P<b>1</b>, P<b>3</b>.

P-0047[0047] Note that for such display protocol sequences PS, there is a selection screen displayed on monitors <b>22</b>A and <b>22</b>B as shown In FIG. 4, from which it is possible to select by clicking with the mouse, a desired display protocol sequence PS. Further, at this time, it is beneficial that the display protocol sequence be selected corresponding to the examination, the series, the type of input modality <b>4</b> in which the images were formed (CR images, CT images, MRI images, etc.), the examining doctor or group of doctors to which the examining doctor belongs (reading doctor, clinical doctor, referring doctor, etc.) the place where the images are to be employed (an examination room, a doctor's residence, etc.), the purpose for which the images are to be used, (reading, reference, comparison, etc.), etc.

P-0048[0048] Then, by selecting the display protocol sequence from these type of display protocol sequences, controller <b>27</b> displays images on monitors <b>22</b>A and <b>22</b>B in the layout corresponding to the order of the display protocols in the selected display protocol sequence.

P-0049[0049] Next, the operation of the current embodiment will be explained. FIG. 5 is a flowchart of the operation of the current embodiment. First, the doctor who is the examiner of images on of workstation <b>2</b>, using the input means <b>23</b>, selects a display protocol sequence for use when images are displayed on monitors <b>22</b>A and <b>22</b>B (Step S<b>1</b>), and at the same time specifies that image server <b>1</b> transmit the image data S to be displayed (Step S<b>2</b>). Note that in the current embodiment, the display protocol sequence PS<b>1</b> selected is to be PS<b>1</b>. Accordingly, image data S is transmitted by image server <b>1</b> over network <b>3</b> to workstation <b>2</b> (Step S<b>3</b>). When controller <b>27</b> receives transmission of image data S, the selected display protocol sequence is read out from memory <b>28</b>, and at first, based on to the first display protocol P<b>1</b>, the layout is performed and the laid out images are displayed on monitors <b>22</b>A and <b>22</b>B.

P-0050[0050] Next, by pressing a function key, clicking on the screen with the mouse, etc. a check is conducted (Step S<b>5</b>) to determine whether or not switching of the display protocol sequence has been specified, and if a yes is registered in Step S<b>5</b>, a check to determine whether or not the current display protocol displaying the images is the last display protocol, P<b>3</b>, of the selected display protocol sequence PS<b>1</b> (Step S<b>7</b>). If a no is registered in Step S<b>7</b>, layout is performed using the next display protocol in order after P<b>1</b>, that is P<b>2</b>, and the images of the next layout are displayed on monitors <b>22</b>A and <b>22</b>B (Step <b>28</b>), and Step S<b>5</b> is returned to.

P-0051[0051] Further, when the display protocol sequence is switched, layout is performed using the next display protocol, P<b>3</b>, and the images of the next layout are displayed on monitors <b>22</b>A and <b>22</b>B.

P-0052[0052] On the one hand, if a no is registered in Step S<b>5</b>, a check is conducted to determine whether or not switching of the display protocol has been specified (Step S<b>6</b>), and if a yes is registered in Step S<b>6</b>, the display protocol sequence is switched from the display protocol sequence selected in Step S<b>1</b>, PS<b>1</b>, to the specified display protocol sequence (PS<b>2</b>, for example), and Step <b>4</b> is returned to; layout is performed using the first display protocol of the switched to display protocol sequence, and the images displayed. Note that if a no is registered in Step S<b>6</b>, Step S<b>5</b> is returned to and Steps S<b>5</b> and S<b>6</b> are repeated.

P-0053[0053] In addition, if a yes is registered in Step S<b>7</b>, Step <b>4</b> is returned to and the images are laid out according to the first display protocol P<b>1</b> and displayed. In this way, each time switching of the display protocol is performed, the display protocols are switched in the order P<b>1</b>, P<b>2</b>, P<b>3</b>, P<b>1</b>, etc., and the images laid out and displayed on monitors <b>22</b>A and <b>22</b>B.

P-0054[0054] In this way, because in the current embodiment, based on display protocol sequence PS<b>1</b>, in which the plurality of display protocols P<b>1</b>, P<b>2</b>, and P<b>3</b> are lined up in a predetermined order, the display format can be switched, the examiner of images at workstation <b>2</b>, by performing only the simple operation of switching the display protocols in a simply defined sequence, can switch the display layout of images displayed on monitors <b>22</b>A and <b>22</b>B. Accordingly, the examiner of images does not have to memorize the display protocols, and his or her workload is thereby reduced.

P-0055[0055] Further, for cases in which there are multiple display protocol sequences, because the display protocol sequence can be switched, the examiner of images can display the plurality of images according to a desired display protocol sequence.

P-0056[0056] Note that in the current embodiment, as shown in FIG. 3, the display layout of the images is switched using display protocols that define display layouts, however; display protocols may be defined for each type and level of multiple image processing processes, and the image display format changed according to display protocol sequences in which the multiple display protocols are lined up. For example, by using a display protocol sequence in which various display protocols for changing the intensity-level processing are lined up in a predetermined order, images having different intensity levels can be switched in order and displayed.

P-0057[0057] Further, in the current embodiment, the display protocols are switched by specifying the switching, it is also possible, for example, that display protocols be switched every so many seconds, etc., or automatically.

P-0058[0058] In addition, although in the current embodiment the display protocol sequence is selected in advance, the display sequence may also be created automatically corresponding to the examination, the series, the type of input modality <b>4</b> in which the images were formed (CR images, CT images, MRI images, etc.), the examining doctor or group of doctors to which the examining doctor belongs (reading doctor, clinical doctor, referring doctor, etc.) the place where the images are to be employed (an examination room, a doctor's residence, etc.), the purpose for which the images are to be used, (reading, reference, comparison, etc.), etc. In this case, the display format is switched according to the generated display protocol sequence.