Apparatus and system for rule based visualization of digital breast tomosynthesis and other volumetric images

PRIORITY CLAIM

0001This application is a continuation of (1) U.S. application Ser. No. 16/531,413 entitled Method and System for Rule Based Visualizing Digital Breast Tomosynthesis and Other Volumetric Images, filed Aug. 5, 2019, which claims priority to and is a continuation of (2) U.S. application Ser. No. 16/049,801 entitled Method and System for Rule Based Visualizing Digital Breast Tomosynthesis and Other Volumetric Images, filed Jul. 30, 2018, which issued as U.S. Pat. No. 10,631,812, which claims priority to and is a continuation of (3) U.S. application Ser. No. 15/220,325 entitled Method and System for Rule Based Visualizing Digital Breast Tomosynthesis and Other Volumetric Images, filed Jul. 25, 2016, which issued as U.S. Pat. No. 10,070,839, which claims priority to and is a continuation in part of (4) U.S. application Ser. No. 14/611,163 filed Jan. 30, 2015, which issued as U.S. Pat. No. 9,524,577 which is a continuation of (5) U.S. application Ser. No. 13/831,975 filed Mar. 13, 2013, which issued as U.S. Pat. No. 8,976,190, where (3) also claims priority to (6) U.S. Provisional application No. 62/197,956 filed Jul. 28, 2015. The specification and drawings of (1)-(6) are herein expressly incorporated by reference in their entireties and for all purposes.

FIELD OF INVENTION

0002The invention pertains to rule based ways of viewing volumetric images used for medical diagnosis.

BACKGROUND OF THE INVENTION

0003In order to diagnose a traditional X-Ray examination, the images printed on films would be ‘hung’ in front of a light box. For multi-image examinations, as well as for comparison with priors, the ‘hanging’ would often follow a specific protocol. For example, a particular organization or doctor may choose for a two-view chest X-Ray with a two-view prior exam, that the films be hung from left to right as follows: Frontal view of current examination, lateral view of current examination, frontal view of prior examination, lateral view of prior examination. In contrast, the doctor may hang mammography exams with the corresponding views of current and prior next to each other, if that was more appropriate for the diagnostic workflow in that case. Thus, the organization or doctor developed a traditional ‘Hanging Protocol’. Currently, the film and the light box are often being replaced by computer systems, called PACS (Picture Archiving and Communication System). PACS systems can mimic the Hanging Protocols.

0004Traditional X-Ray examinations typically produce one or a small number of single two dimensional (2D) images. In contrast, the more advanced imaging modalities such as Computer Tomography (CT), Magnetic Resonance Imaging (MRI) or Positron Emission Tomography (PET) can produce dozens of series, each consisting of a hundred or more images. It is possible and not uncommon to review images from these advanced modalities in the same manner as traditional X-Ray images, i.e., by hanging the individual images side-by-side, either on a light-box or using a PACS system.

0005Volumetric images play an increasingly important role in medical diagnosis including cancer treatments such as site directed chemotherapy and radiology. Volumetric images are being generated by a multitude of different devices, including Magnetic Resonance Imaging (MRI) scanners, see for example Nuclear magnetic resonance imaging apparatus, U.S. Pat. No. 4,534,358, or Computed Tomography (CT) scanners, see for example Patients' support installation for a tomographic X-ray apparatus, U.S. Pat. No. 3,974,388, or certain C-Arm devices, see for example C-Arm computerized tomography system, U.S. Patent Application Publication No. 2010/0284601.

0006A certain class of these modalities, such as the CT scanner computes the volumetric images from a series of 2D projections from different angles, see for example (i) Methods and Apparatus for Reconstruction of 3D Image Volumes From Projection Images, U.S. Pat. No. 7,876,944; (ii) Method of Reconstructing Computer Tomography (CT) Volumes Suitable for Execution on Commodity Central Processing Units (CPUS) and Graphics Processors, and Apparatus Operating in Accordance with those Methods, U.S. Pat. No. 7,778,392 and (iii) Method of Reconstructing Computer Tomography (CT) Volumes Suitable for Execution on Commodity Central Processing Units (CPUS) and Graphics Processors, and Apparatus Operating in Accordance with those Methods, U.S. Pat. No. 8,107,592, which references (i)-(iii) are herein expressly incorporated by reference in their entireties.

0007A recent advance in the field is the development of a Digital Breast Tomosynthesis (DBT) scanner which generates volumetric mammography images, see for example Integrated multi-mode mammography/tomosynthesis x-ray system and method, U.S. Pat. No. 7,869,563, which is herein expressly incorporated by reference in its entirety Similar to CT or C-Arm devices, the DBT devices acquire a number of 2D X-Ray images, or 2D projections, from different angles. From these projections a volumetric image is computed

SUMMARY OF THE INVENTION

0008The invention pertains to digital data processing and, more particularly, by way of example, to the visualization of image data. Three dimensional (3D) and four dimensional (4D) image data is routinely acquired with CT, MRI, PET, confocal microscopes, 3D ultrasound devices, and other imaging devices. The medical imaging market is just one example of a market that uses these devices. The visualization of image data market is growing rapidly, with new CT scanners collecting larger amounts of data more quickly than previous generation CT scanners. The invention has application to areas including medical imaging, atmospheric studies, astrophysics and geophysics.

0009With the rapid increase in the amounts and types of information that can be acquired using imaging technology, we have identified an advantage in presenting volumetric image-based information in a form that can be used by a physician or diagnostician. Namely, although there may be many different types of image data, the forms, formats, integration, and display of relevant information can be optimized for diagnosis.

0010In an embodiment of the present invention, a method for displaying volumetric images comprises computing a projection image using a viewing direction, displaying the projection image and then varying the projection image by varying the viewing direction. In an embodiment of the present invention, the viewing direction can be varied based on a periodic continuous mathematical function. In an embodiment of the present invention, a graphics processing unit (GPU) can be used to compute the projection image and bricking can be used to accelerate the computation of the projection images. In another embodiment of the present invention, a sequence of projections covering one period can be rendered, cached and then played back one or more times, where the rendering is carried out on a server and the caching and play back is carried out on a client computer. A render server program is described in U.S. application Ser. No. 13/831,967, entitled ‘Multi-User Mult-GPU Render Server Apparatus and Methods’, which was filed Mar. 15, 2013 is herein expressly incorporated by reference in its entirety. A rule based render server program is described in ‘Method and System for Rule-Based Display of Sets of Images’ which issued as U.S. Pat. No. 8,976,190 on Mar. 10, 2015, and is herein expressly incorporated by reference in its entirety. In an alternative embodiment of the present invention, the viewing direction can be varied based on user input. In a different embodiment of the present invention, a system that displays two or more volumetric images by computing a projection image of each of the volumetric images, using the same viewing direction v for each volumetric image, displaying each projection images, and varying the projection image by varying the viewing direction, where the varied viewing direction is changed in the same way for each of the projections. In an embodiment of the present invention, the volumetric images are computed from a number of 2D X-Ray images, or 2D projections, from different angles generated by a DBT device. In an embodiment of the present invention, volumetric mammography images are displayed. In an alternative embodiment of the present invention, volumetric images are computed from a number of 2D X-Ray images generated by angiography. In an embodiment of the present invention, the volumetric cerebral angiography images of the human brain are displayed. In another alternative embodiment of the present invention, volumetric images are computed from a confocal microscope using antibody staining. In an embodiment of the present invention, volumetric cell tissue generated by the confocal microscope is displayed.

0011These and other aspects of the invention are evident in the drawings and in the description that follows

BRIEF DESCRIPTION OF THE DRAWINGS

0012This invention is described with respect to specific embodiments thereof. Additional features can be appreciated from the Figures in which:

0013<figref idref="DRAWINGS">FIG. 1A</figref> shows the specimen imaged using an X-Ray source from two positions spanning an angular range;

0014<figref idref="DRAWINGS">FIG. 1B</figref> shows the specimen imaged using an X-Ray source and an X-Ray detector from a multitude of positions. The positions span a certain angular range that is defined by the physical constraints of the machine and the patient's position;

0015<figref idref="DRAWINGS">FIG. 2</figref> illustrates the calculation of a projection P from the volumetric image I, where the projection is defined by the viewing direction v, which defines the Projection plane, according to an embodiment of the invention;

0016<figref idref="DRAWINGS">FIG. 3A</figref> shows a specimen with two areas of increased density, according to an embodiment of the invention;

0017<figref idref="DRAWINGS">FIG. 3B</figref> shows the two areas in <figref idref="DRAWINGS">FIG. 3A</figref> projected to the same spot in the projection Image, according to an embodiment of the invention;

0018<figref idref="DRAWINGS">FIG. 3C</figref> shows the two areas in <figref idref="DRAWINGS">FIG. 3A</figref> projected to different spots in the projection Image, according to an embodiment of the invention;

0019<figref idref="DRAWINGS">FIG. 4</figref> shows how only a subset of the acquisition volume is covered by the specimen, while other areas (hatched) only contain background pixels, according to an embodiment of the invention;

0020<figref idref="DRAWINGS">FIG. 5</figref> shows the volume subdivided into sub-volumes, according to an embodiment of the invention;

0021<figref idref="DRAWINGS">FIG. 6</figref> illustrates the dynamic variation of the viewing direction <u style="single">v</u> according to Equation 2, according to an embodiment of the invention;

0022<figref idref="DRAWINGS">FIG. 7A</figref> shows an artists impression of an image of a human breast computed from a number of images recreated from a specific angle where a micro calcification is occluded by denser breast tissue, according to an embodiment of the invention;

0023<figref idref="DRAWINGS">FIG. 7B</figref> shows an artists impression of an image of a human breast taken from a different angle to that shown in <figref idref="DRAWINGS">FIG. 7A</figref>, where the micro calcification is visible and not occluded by the denser breast tissue, according to an embodiment of the invention;

0024<figref idref="DRAWINGS">FIG. 8A</figref> shows an artists impression of a screen dump of a video image at approximately the two (2) second time point, where the video shows a dynamic comparison of a human breast computed from a number of images recreated as the viewing direction is changed, where micro calcification occluded by denser breast tissue can be revealed, according to an embodiment of the invention;

0025<figref idref="DRAWINGS">FIG. 8B</figref> shows an artists impression of a screen dump of a video image at approximately the five (5) second time point, where the video shows a dynamic comparison of a human breast computed from a number of images recreated as the viewing direction is changed, where micro calcification occluded by denser breast tissue can be revealed, according to an embodiment of the invention;

0026<figref idref="DRAWINGS">FIG. 8C</figref> shows an artists impression of a screen dump of a video image at approximately the nine (9) second time point, where the video shows a dynamic comparison of a human breast computed from a number of images recreated as the viewing direction is changed, where micro calcification occluded by denser breast tissue can be revealed, according to an embodiment of the invention;

0027<figref idref="DRAWINGS">FIG. 8D</figref> shows an artists impression of a screen dump of a video image at approximately the twelve (12) second time point, where the video shows a dynamic comparison of a human breast computed from a number of images recreated as the viewing direction is changed, where micro calcification occluded by denser breast tissue can be revealed, according to an embodiment of the invention;

0028<figref idref="DRAWINGS">FIG. 9A</figref> shows the artists impression of a screen dump of a video image at at approximately the five (5) second time point shown in <figref idref="DRAWINGS">FIG. 8B</figref>, according to an embodiment of the invention;

0029<figref idref="DRAWINGS">FIG. 9B</figref> shows the artists impression of a screen dump of a video image at approximately nine (9) second time point shown in <figref idref="DRAWINGS">FIG. 8C</figref>, according to an embodiment of the invention;

0030<figref idref="DRAWINGS">FIG. 10</figref> depicts a flow chart showing the steps of applying various rules to the selected Study, according to an embodiment of the invention;

0031<figref idref="DRAWINGS">FIG. 11</figref> depicts the resulting display for an example study, according to an embodiment of the invention;

0032<figref idref="DRAWINGS">FIG. 12A</figref> shows an example of a user interface to specify rules including a dialog box to configure Study Selection rules applied to a prior chest CR, according to an embodiment of the invention;

0033<figref idref="DRAWINGS">FIG. 12B</figref> shows an example of a user interface to specify rules including a dialog box to configure Study Selection rules applied to a prior left breast mammogram, according to an embodiment of the invention;

0034<figref idref="DRAWINGS">FIG. 13A</figref> shows the image of a human breast represented in <figref idref="DRAWINGS">FIG. 7A</figref>, according to an embodiment of the invention;

0035<figref idref="DRAWINGS">FIG. 13B</figref> shows the image of the human breast taken from a different angle to that shown in <figref idref="DRAWINGS">FIG. 13A</figref>, represented in <figref idref="DRAWINGS">FIG. 7B</figref>, according to an embodiment of the invention;

0036<figref idref="DRAWINGS">FIG. 14A</figref> shows a screen dump from the mp3 video at approximately the two (2) second time point, represented in <figref idref="DRAWINGS">FIG. 8A</figref>, according to an embodiment of the invention;

0037<figref idref="DRAWINGS">FIG. 14B</figref> shows a screen dump from the mp3 video at approximately the five (5) second time point, represented in <figref idref="DRAWINGS">FIG. 8B</figref>, according to an embodiment of the invention;

0038<figref idref="DRAWINGS">FIG. 14C</figref> shows a screen dump from the mp3 video at approximately the nine (9) second time point, represented in <figref idref="DRAWINGS">FIG. 8C</figref>, according to an embodiment of the invention;

0039<figref idref="DRAWINGS">FIG. 14D</figref> shows a screen dump from the mp3 video at approximately the twelve (12) second time point, represented in <figref idref="DRAWINGS">FIG. 8D</figref>, according to an embodiment of the invention;

0040<figref idref="DRAWINGS">FIG. 15A</figref> shows the screen dump from the mp3 video at approximately the five (5) second time point, as represented in <figref idref="DRAWINGS">FIG. 9A</figref>, according to an embodiment of the invention; and

0041<figref idref="DRAWINGS">FIG. 15B</figref> shows the screen dump from the mp3 video at approximately the nine (9) second time point, as represented in <figref idref="DRAWINGS">FIG. 9B</figref>, according to an embodiment of the invention

DETAILED DESCRIPTION OF THE INVENTION

0042Definitions

0043The transitional term “comprising” is synonymous with “including,” “containing,” or “characterized by,” is inclusive or open-ended and does not exclude additional, unrecited elements or method steps.

0044The transitional phrase “consisting of” excludes any element, step, or ingredient not specified in the claim, but does not exclude additional components or steps that are unrelated to the invention such as impurities ordinarily associated with a composition.

0045The transitional phrase “consisting essentially of” limits the scope of a claim to the specified materials or steps and those that do not materially affect the basic and novel characteristic(s) of the claimed invention.

0046The term ‘bandwidth’ and ‘send bandwidth’ refer to various bit-rate measures, representing the available or consumed data communication resources expressed in bits per second or multiples of it.

0047The phrase ‘adaptive bandwidth management’ means methods that continuously adjust the amount of data that is sent into a network per time in order to avoid or reduce network congestion and transfer delay.

0048The term ‘client-server’ refers to a computer system that selectively shares its resources with ‘clients’. A ‘client’ is a computer or computer program that initiates contact with a ‘client-server’ or ‘server’ in order to make use of the server resources. A client-server can be especially useful to undertake volume rendering tasks. Such a server can have one or more graphics processing units. Further, by sharing the server's computer resources, multiple clients can access and use the server resources at the same time. Because a computer does a limited amount of work at any moment, a time-sharing system must quickly prioritize its tasks to accommodate the clients. Clients and servers exchange messages in a request-response messaging pattern: The client sends a request, and the server returns one or multiple responses, synchronously or asynchronously.

0049The term ‘video’ means the display of three (3) or more 2-D projection images where there is a time delay between the first 2-D projection image and a second 2-D projection image and a time delay between the second 2-D projection image and a third 2-D projection image. A video may be displayed using a number of formats including avi, fly, H.262, H.263, H.264, m4v, mov, MPEG-1, MPEG-1 Part 2, MPEG-2, MPEG-4 Part 2, nsv, ogv, roq, vp6, vp8, vp9, webm, and wmv.

0050The phrase ‘host computer’ means a server or other processor with associated memory. In an embodiment of the invention, a host computer is enabled to provide measured 2-D projection images to a client.

0051The term ‘caching’ means storing in memory. A generated projection image from a volumetric image can be cached in one or both a client associated memory and a server associated memory, where the memory can be accessed rapidly by either the client processor or the server processor respectively.

0052The phrase ‘measured 2-D projection image’ means a two-dimensional (2-D) scan of biological tissue produced by forward-projection or back-projection of medical imaging equipment as described in U.S. Pat. No. 8,107,592 to A. Berman, and U.S. Pat. No. 7,876,944 to D Stalling et al.

0053The phrase ‘volumetric image’ refers to a three-dimensional (3-D) representation reconstructed from the data produced from a series of measured 2-D projection images or other 2-D representations of a tissue, an organ or an entity.

0054The term ‘reconstruction’ means generating a 3-D volumetric image based on a plurality of measured 2-D projection images. The phrase ‘reconstruction of a volumetric image’ means calculating a 3-D volumetric image based on a plurality of measured 2-D projection images.

0055The term ‘generated’ means constructing one or more generated 2-D projection images from a 3-D volumetric image. The phrase ‘generating an image’ or means ‘generating a plurality of images’ means constructing one or more generated 2-D projection images from a 3-D volumetric image. In an embodiment of the invention, the one or more generated 2-D projection images can be generated at different viewing directions.

0056The phrase ‘viewing direction’ means the line constructed passing through a viewing position to an object. As the designated position changes, the viewing direction changes. As shown in <figref idref="DRAWINGS">FIG. 1A</figref> a first viewing direction <b>111</b> is generated by the line between position <b>110</b> and the object <b>105</b>. A second viewing direction <b>116</b> is generated by the line between position <b>115</b> and the object <b>105</b>. The angle (θ) between the first viewing direction <b>111</b> and the second viewing direction <b>112</b> increases from 0 to θ. The smallest viewing direction is when the angle=0. The largest viewing direction is when the angle=θ.

0057The phrase ‘equivalent viewing direction’ means the same viewing direction in the absence of physiologic changes in the tissue or an equivalent viewing direction when physiologic changes have occurred or a comparable tissue is utilized, where the equivalent viewing direction can compensate for changes in the tissue in the body with time and/or can compensate for the symmetry and asymmetry of different tissue in the body. The equivalent viewing direction can be used to ascertain the presence or absence of physiologic changes in the tissue with time, or when physiologic changes have occurred based on the inspection of a comparable tissue. The equivalent viewing direction can compensate for changes in the tissue in the body with time and/or can compensate for the symmetry and asymmetry of viewing projection images of different tissues in the body.

0058The phrase ‘improves the visual clarity of identification’ means a process or technique that compares or changes one or more projection images to allow an obstruction including a micro calcification to be identified in the one or more projection images.

0059The term ‘Study’ will be used to refer to the set of images produced by an examination. A Study consists of one or more images. The images can be grouped into one or more image series. Each image, each series, and the whole Study can have different parameters attached. For medical images these can be defined by the Digital Imaging and Communication in Medicine (DICOM) standard.

0060The phrase ‘Hanging Protocol’ will be used to refer to specific conventions how X-Ray films are arranged (hung) at a light box.

0061The phrase ‘Display Protocol’ will be used to refer to the way images are displayed in a computer system, specifically the selection of the images to be displayed, the layout of the images, as well as the rendering parameters and styles.

0062The term ‘Viewport’ will be used to refer to the logical part of the screen on the client computer in which a particular View is displayed, for example the user interface on the client computer can contain four rectangular Viewports <b>1160</b> of which three show a frontal, left, and bottom view respectively of a particular data, while the fourth viewer might show a 2D cross section through the same or a different data set.

0063The phrase ‘Sets of Images’ or ‘Image Set’ will be used to refer to one or more images, selected based on the rules.

0064The phrase ‘Study Selection Rules’ will be used to refer to the rules used to select the studies to be displayed.

0065The phrase ‘Protocol Selection Rules’ will be used to refer to the rules used to select the layout of the images to be displayed.

0066The phrase ‘Image Set Rules’ will be used to refer to the rules used to form Image Sets <b>1165</b> from the images of one or more Study by applying selection, sorting, and breaking rules.

0067The phrase ‘Style Rules’ will be used to refer to the rules to determine which rendering type, rendering style, and rendering parameters are used for a particular Image Set <b>1165</b> in a particular viewer.

0068The phrase ‘Volume Rendering’ will be used to refer to Volume Rendering techniques including shaded Volume Rendering techniques, maximum intensity projection (MIP), oblique slicing or multi-planar reformats (MPR), axial/sagittal and coronal slice display, and thick slices (also called slabs). In medical imaging, for example, Volume Rendering is used to display 3D images from 3D image data sets, where a typical 3D image data set is a large number of 2D slice images acquired by a CT or MRI scanner and stored in a data structure.

0069The terms ‘brick’ or ‘bricking’ mean partitioning a 3D image or a portion of the 3D image. Bricking is an iterative process involving determining the intensity of pixels in the 2D image based on the rule that all points in the 3D image data that are required for evaluating the intensities of the sample points along a ray passing through a brick are located within that brick. That is in an imaging apparatus having a CPU and a GPU with a plurality of programmable vertex shaders coupled to a plurality of programmable pixel shaders, the CPU partitions the 3D image into a plurality ‘bricks’ based on the vertex shaders and pixel shaders determining the intensities of one or more pixels in the 2D image as an iterative function of intensities of sample points in one or more bricks in the 3D image through which viewing rays associated with those pixels are passed, and where any two adjacent bricks preferably have a sufficient overlap such that all points in the 3D image data that are required for evaluating the intensities of the sample points along a ray passing through a brick are located within that brick.

0070The term ‘display’ means in the context of aspects and embodiments disclosed herein and refers in the usual and customary sense to physical representation of data e.g. a printed page or an electronic representation on a visual display monitor, a cathode ray oscilloscope, a liquid crystal display, a nixie tube, a light emitting diode display, a plasma display and the like. The display of sensitive information can be anonymized as described in U.S. patent application Ser. No. 15/218,993 titled ‘Method and Apparatus for Anonymized Display and Data Export’ filed Jul. 25, 2016 inventors D. Stalling et al., the specification and drawings of which are herein expressly incorporated by reference in their entirety.

0071The terms ‘view’ or ‘viewing’ mean a display of a 3D or 2D image.

0072The phrases ‘viewing position’ or ‘viewing ray’ refer to a display of a 3D or 2D image as observed from the viewing position or along a line defined by the viewing ray.

0073The term ‘identifies’ refers to a 3D or 2D image corresponding to a view that is displayed and/or compared with other views that reveals or more clearly elucidates a microcalcification or obstruction through one or more processes selected from the group consisting of: observation by the human eye, identification by a segmentation algorithm, identification by a bricking algorithm.

0074The term ‘microcalcification’ refers to small deposits of calcium typically seen in a breast mammogram which depending on shape, number, pattern and/or relative position can be used as an early sign of breast cancer and/or presenting sign of breast cancer.

0075The term ‘obstruction’ means a filling defect or other ductal abnormality, such as ductal ectasia, fibrocystic changes or a ductal irregularity such as can be observed with ductography of the breast including galactography and ductogalactography.

0076In the following description, various aspects of the present invention will be described. However, it will be apparent to those skilled in the art that the present invention may be practiced with only some or all aspects of the present invention. For purposes of explanation, specific numbers, materials, and configurations are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced without the specific details. In other instances, well-known features are omitted or simplified in order not to obscure the present invention.

0077Parts of the description will be presented in data processing terms, such as data, selection, retrieval, generation, and so forth, consistent with the manner commonly employed by those skilled in the art to convey the substance of their work to others skilled in the art. As is well understood by those skilled in the art, these quantities (data, selection, retrieval, generation) take the form of electrical, magnetic, or optical signals capable of being stored, transferred, combined, and otherwise manipulated through electrical, optical, and/or biological components of a processor and its subsystems.

0078Various operations will be described as multiple discrete steps in turn, in a manner that is most helpful in understanding the present invention; however, the order of description should not be construed as to imply that these operations are necessarily order dependent.

0079Various embodiments will be illustrated in terms of exemplary classes and/or objects in an object-oriented programming paradigm. It will be apparent to one skilled in the art that the present invention can be practiced using any number of different classes/objects, not merely those included here for illustrative purposes. Furthermore, it will also be apparent that the present invention is not limited to any particular software programming language or programming paradigm.

0000Receiving a Volumetric Image.

0080A computed tomography (CT) scan can generate many 2-D images taken from different angles around a scanned object to produce cross-sectional (tomographic) images (‘virtual slices’) of the scanned object. Alternatively, positron emission tomography (PET), single photon emission computed tomography (SPECT), computer assisted tomography (CAT) scanners or tomosynthesis systems can produce ‘measured projection images’. These measured 2-D projection images can be used to reconstruct a ‘volumetric image’, where the virtual slices form a volumetric image or 3-D image of the scanned object. The phrase ‘volumetric image’ refers to a 3-D representation reconstructed from the data produced by forward-projecting or back-projecting medical imaging equipment. Measured projection images can be measured by medical technologists, and can be used to reconstruct a volumetric image and then the volumetric image can be received by a physician in order to diagnose a patient.

0081In an embodiment of the invention, using the reconstructed 3-D image it is possible to form a generated 2-D projection image, that is, a representation can be generated from a volumetric image by identifying a point source at a distinct focus and thereby a ‘projection direction’ through the volume to a plane at which the respective generated 2-D projection image can be formed, as described in U.S. patent application Ser. No. 15/218,972 titled ‘Apparatus and Method for Visualizing Digital Breast Tomosynthesis and Other Volumetric Images’ inventors M. Westerhoff et al., filed Jul. 25, 2016, the specification and drawings of which are herein expressly incorporated by reference in their entirety.

0000Computing a Plurality of Projection Images

0082One or more generated 2-D projection images can be generated from a volumetric image. Computing a plurality of generated 2-D projection images of the volumetric image using a plurality of viewing directions between a first viewing direction and a second viewing direction can be used to produce generated 2-D projection images required by a physician but otherwise not revealed by a measured 2-D projection image. Alternatively, by generating a plurality of generated 2-D projection images, a dynamic view of the volumetric image can be generated, which allows for better diagnosis than a single or static measured 2-D projection image or a single or static generated 2-D projection image.

0000Comparing a First Projection Image a Second Projection Image

0083The phrase ‘time comparison’ means comparing a projection image obtained at a specific viewing direction with an earlier in time projection image of a tissue obtained at an equivalent viewing direction of the same tissue. In an embodiment of the invention, a time comparison compares one or more projection images of a right breast with one or more projection images of the same right breast measured at an earlier time point, where the projection images are generated at equivalent viewing directions. In an embodiment of the invention, a time comparison compares one or more measured 2-D projection images of a right breast with one or more generated 2-D projection images of the same right breast generated from a volumetric image reconstructed from a plurality of measured 2-D projection images from an earlier time point, where the projection images are generated at equivalent viewing directions. In an alternative embodiment of the invention, a time comparison compares one or more generated 2-D projection images of a right breast with one or more measured 2-D projection images of the same right breast measured at an earlier time point, where the projection images are generated at equivalent viewing directions.

0084The phrase ‘structural comparison’ means comparing a projection image obtained at a specific viewing direction with a projection image of a tissue obtained at an equivalent viewing direction of a different but comparable tissue. In an embodiment of the invention, a structural comparison compares one or more projection images of a right breast with one or more projection images of a left breast both viewed at equivalent viewing directions. In an embodiment of the invention, a structural comparison compares one or more generated 2-D projection images of a right breast with one or more generated 2-D projection images of a left breast, where each of the generated 2-D projection images are viewed at equivalent viewing directions. In an alternative embodiment of the invention, a structural comparison compares one or more measured 2-D projection images of a right breast with one or more generated 2-D projection images of a left breast, where each of the measured and generated 2-D projection images are viewed at equivalent viewing directions. In another embodiment of the invention, a structural comparison compares one or more generated 2-D projection images of a right breast with one or more measured 2-D projection images of a left breast, where each of the measured and generated 2-D projection images are viewed at equivalent viewing directions.

0085The phrase ‘dynamic comparison’ means comparing a series of projection images obtained at a variety of viewing directions. In an embodiment of the invention, a dynamic comparison compares one or more DBT projection images of a right breast that change in time as the viewing direction is scanned as a video. In an embodiment of the invention, the change in viewing direction can adjust for the type of tissue being scanned.

0086The phrase ‘visual comparison’ means time comparing, structurally comparing, and/or dynamically comparing one or more projection images with the naked eye.

0087The phrase ‘direct comparison’ means one or more of time comparing, structurally comparing, and dynamically comparing one or more projection images using a computer to analyze changes in the intensity density of a voxel matrix represented by the projection images. In an embodiment of the invention, one or more generated 2-D projection images are compared with one or more measured 2-D projection images using one or more of time comparing, structurally comparing, and dynamically comparing, wherein a computer is used to analyze changes in the intensity density of a voxel matrix represented by the one or more generated 2-D projection images and the one or more measured 2-D projection images.

0088A first viewing direction <b>111</b> corresponds with the line between position <b>110</b> and the object <b>105</b>. A second viewing direction <b>116</b> corresponds with line between position <b>115</b> and the object <b>105</b> (see <figref idref="DRAWINGS">FIG. 1A</figref>). The increment <b>112</b> is the angle between the first viewing direction <b>111</b> and the second viewing direction <b>112</b> (see <figref idref="DRAWINGS">FIG. 1A</figref>). By selecting a first viewing direction, a first generated 2-D projection image can be formed. Similarly, selecting a second viewing direction allows a second generated 2-D projection image at the second viewing direction to be formed. In an embodiment of the invention a first generated 2-D projection image can be dynamically compared with one or more second generated 2-D projection images. In an alternative embodiment of the invention a measured 2-D projection image can be dynamically compared with one or more generated 2-D projection images. In an alternative embodiment of the invention, a first projection image can be time compared with a second projection image measured at an earlier time. In another embodiment of the invention, a generated 2-D projection image can be time compared with a measured 2-D projection image measured at an earlier time. In another embodiment of the invention, a first projection image can be structurally compared with a second projection image of a control tissue. In another embodiment of the invention, a generated 2-D projection image can be structurally compared with a measured 2-D projection image of a control tissue. In an embodiment of the invention, a density map for the first projection image is visually compared with a density map of the second projection image. In an embodiment of the invention, a density map for a generated 2-D projection image is visually compared with a density map of a measured 2-D projection image. In an alternative embodiment of the invention, a computer program is used to directly compare the density map for the first projection image with a density map of the second projection image. In another alternative embodiment of the invention, a computer program is used to directly compare the density map for a generated 2-D projection image with a density map of a measured 2-D projection image.

0000Volume Rendering

0089Volume rendering, or reconstructing a volume, includes a variety of standard visualization methods including volume rendering techniques (VRT), shaded volume rendering techniques (sVRT), maximum intensity projection (MIP), oblique slicing or multiplanar reformats (MPR), axial/sagittal and coronal slice display, and thick slices (also called slabs). Within the scope of the invention, other methods and apparatus of forward-projection and back-projection can be used for generating a series of measured 2-D projection images with which to reconstruct 3-D volumetric image representations, as described in ‘Client-Server Visualization System with Hybrid Data Processing’ which issued as U.S. Pat. No. 9,019,287 Apr. 28, 2015, and which is herein expressly incorporated by reference in its entirety.

0090In an embodiment of the invention, a computer chip, chip set, computer board and/or computer processor can be configured as a ‘graphics processing unit’ (GPU) to perform volume rendering and or to generate one or more reconstructed 2-D projection views from a volumetric image. In an embodiment of the invention, volume rendering includes initializing to arbitrary values the volume density distribution in a voxel matrix, iteratively estimating and comparing with a measured projection, and then correcting each pixel based on the comparison as described in U.S. Pat. No. 7,876,944.

0000Intensity Values.

0091Image segmentation is an automated technique that facilitates distinguishing objects and other features in digital images. The technique can be used, for example, to simplify digitized images so that they can be more readily interpreted by computers (e.g., image analysis software) and/or by their users. An image can be made up of pixels containing a wide range of undifferentiated intensity values that although, possibly recognizable to the human eye as skeletal bones and digestive tract are largely uninterpretable by a computer. In an embodiment of the invention, a comparison between a first projection image with a second projection image that reveals an area of increased intensity values in the second projection image can indicate that the second viewing direction which generated the second projection image reveals an unobstructed projection image. In an alternative embodiment of the invention, a comparison between a generated 2-D projection image with a measured 2-D projection image that reveals an area of increased differentiated intensity values in the measured 2-D projection image can indicate that the viewing direction which formed the generated 2-D projection image reveals an unobstructed viewing direction. In an alternative embodiment of the invention, a comparison between a first projection image with a second projection image that reveals an area of increased differentiated intensity values in the second projection image can indicate that the second viewing direction which generated the second projection image reveals an increased clarity projection image, as described in U.S. Pat. No. 8,548,215, ‘Automatic Image Segmentation of a Volume by Comparing and Correlating Slice Histograms with an Anatomic Atlas of Average Histograms’ Oct. 1, 2013 and which is herein expressly incorporated by reference in its entirety. In an alternative embodiment of the invention, a comparison between a generated 2-D projection image with a measured 2-D projection image that reveals an area of increased differentiated intensity values in the measured 2-D projection image can indicate that the viewing direction which formed the generated 2-D projection image reveals an advantageous viewing direction.

0000Primary Study Versus Secondary Study

0092A primary study is a study carried out at a specified time point. A secondary study is a study carried out at a subsequent time point. In an embodiment of the invention, a computer chip, chip set, computer board and/or computer processor can be configured as a ‘digita data processor’ to perform volume rendering, to generate one or more projection views from a volume and or to compare two or more projection views. The digital data is generated by forward-projecting or back-projecting medical imaging equipment used to generate measured projection images or other 2-D representations. In an embodiment of the invention, a comparison between a generated 2-D projection image from a secondary study with a generated 2-D projection image from a primary study that reveals an area of increased differentiated intensity values can be used to assess the development or changes occuring over time. In an embodiment of the invention, a comparison between a generated 2-D projection image from a secondary study with a measured 2-D projection image from a primary study that reveals an area of increased differentiated intensity values in the measured 2-D projection image can indicate that the viewing direction which formed the generated 2-D projection image reveals an unobstructed viewing direction.

0000Overview

0093Due to the physical constraints of the acquisition setup, the possible angular range of the acquisition is often limited. Typically the angular range <b>112</b> is less than 180° in digital breast tomosynthesis (DBT) (see <figref idref="DRAWINGS">FIG. 1A</figref>). For mathematical reasons, this results in volumetric images with a non-isotropic resolution. More precisely, the resolution in the plane perpendicular to the average projection direction is much higher, than the reconstructed resolution in the average direction of the X-Ray beam.

0094This aspect has to be taken into account when designing viewing methods for such images. Given the reconstructed volumetric image, in the following the direction of the lowest resolution will be referred to as the z-direction, or z. The vectors defining the average detector orientation, i.e. the plane with the highest resolution are denoted as <u style="single">x</u>, and <u style="single">y</u>. The <u style="single">x</u>, <u style="single">y</u>, and <u style="single">z</u> directions are mutually perpendicular to each other.

0095In order to display a volumetric image on a standard computer screen, which is two dimensional, a transformation has to be applied in order to compute a 2-D representation of the volumetric image.

0096For DBT viewing, a slicing transformation can be used, where a single slice perpendicular to the z-direction is shown on the screen. Typically a user interface, such as a slider or text input field, allows the user to select which slice can be shown. In the following this will be referred to as ‘xy-slicing’ or ‘slicing’. While xy-slicing is an important viewing tool, it has some limitations. In particular it only takes into account a small subset of the information present in the volumetric data set.

0097The present invention overcomes the limitation of using only a small subset of the information by using a projection method to incorporate the entirety of the volumetric information. In an embodiment of the present invention, time is used as a third dimension to resolve ambiguities in a comprehensible and intuitive way.

0098From the volumetric image a projection can be computed. Let

0099I: R³→R be the volumetric image.

0100Let <u style="single">v</u> e R³be a three dimensional vector defining a first viewing direction.

0101Let <u style="single">i</u>_{<u style="single">x</u>} and <u style="single">i</u>_{<u style="single">y</u>} be two vectors spanning a projection plane perpendicular to v and perpendicular to each other.

0102Then a projection P(<u style="single">v</u>,) can be defined as follows:

0103P(<u style="single">v</u>,): R²→R

0104P(<u style="single">v</u>,p)=max(I(<u style="single">r</u>)) |<u style="single">r</u> e R³where v dot <u style="single">i</u>_{<u style="single">x</u>}=p₁, v dot <u style="single">i</u>_{<u style="single">y</u>}=p₂and P(<u style="single">v</u>,) is a 2D image that can be displayed on a computer screen using standard methods.

0105Displaying P(<u style="single">v</u>,) as defined above provides the user with additional diagnostic information as it takes into account the whole data set. For example if there was a lesion in the examined specimen and the volumetric image was viewed using xy-slicing then that lesion would only be visible in a subset of the slices at or around the z-position of the lesion. If the wrong z-position was chosen, the lesion can be missed. Therefore the user would have to examine each slice to be certain there was no lesion present, or alternatively risk overlooking a lesion. In an unexpected result, viewing a dynamic comparison in the form of a video can allow the information to be quickly and efficiently compared.

0106<figref idref="DRAWINGS">FIG. 1A</figref> shows a specimen <b>105</b> imaged from two positions <b>110</b>, <b>115</b> spanning an angular range <b>112</b> which generate viewing directions <b>111</b>, <b>116</b> respectively. <figref idref="DRAWINGS">FIG. 1B</figref> shows the principle of DBT. In <figref idref="DRAWINGS">FIG. 1B</figref>, the specimen <b>105</b> (e.g. a human breast) can be imaged using an X-Ray source and an X-Ray detector from a multitude of positions that lie on the arc beginning at position <b>110</b> and ending at position <b>115</b> and which are detected at detector positions <b>120</b> and <b>125</b>, respectively. The average acquisition direction is indicated by the dotted line <b>130</b>. The positions span a certain angular range that is defined by the physical constraints of the machine and the patient's position. The z vector (<u style="single">z</u>) <b>130</b> denotes the middle projection direction in that angular range. <figref idref="DRAWINGS">FIG. 2</figref> illustrates the calculation of a projection P from the volumetric image I, <b>235</b>. The projection is defined by the viewing direction <u style="single">v</u><b>245</b>, which defines the projection plane <b>240</b>. In general <u style="single">v</u><b>245</b> is not necessarily identical to the average acquisition direction <u style="single">z</u><b>250</b>. The two vectors <u style="single">i</u>_{<u style="single">x</u>}<b>252</b> and <u style="single">i</u>_{<u style="single">y</u>}<b>254</b> are the x-direction and y-direction of the projection image P, respectively. The vectors <u style="single">i</u>_{<u style="single">x</u>}<b>252</b> and <u style="single">i</u>_{<u style="single">y</u>}<b>254</b> are perpendicular to the viewing direction <u style="single">v</u><b>245</b>. The vector <u style="single">i</u>_{<u style="single">x</u>}<b>252</b> is perpendicular to the vector <u style="single">i</u>_{<u style="single">y</u>}<b>254</b>, and can be chosen according to the users viewing preferences or automatically specified according to automated rules, as described in more detail in ‘Method and System for Rule-Based Display of Sets of Images’ issued as U.S. Pat. No. 8,976,190. Digital Imaging and Communication in Medicine (DICOM1 parameters for making rule based decisions include the time of generation of the measured projection images, the type of tissue measured and whether the tissue has an equivalent control that can be used as a control. For example for mediolateral acquisition directions, the y-axis will typically be chosen such that it aligns with the projection of the patient's head-foot axis.

0107Instead, when looking at the projection image P(<u style="single">v</u>,), an area of increased density, such as a lesion or calcification will appear as a brighter spot, irrespective of its z-position, making it possible to detect in many cases. <figref idref="DRAWINGS">FIG. 7A</figref> shows an artists impression of an image of a human breast computed from a number of 2D X-Ray images produced by a DBT device taken from a specific angle where a micro calcification is occluded by denser breast tissue. In <figref idref="DRAWINGS">FIG. 7A</figref> a region <b>774</b> is identified. <figref idref="DRAWINGS">FIG. 7B</figref> shows an artists impression of an image of a human breast taken from a different angle to that shown in <figref idref="DRAWINGS">FIG. 7A</figref>. Comparison of <figref idref="DRAWINGS">FIG. 7A</figref> and <figref idref="DRAWINGS">FIG. 7B</figref> show a micro calcification is visible in <figref idref="DRAWINGS">FIG. 7B</figref> when the tissue is not occluded by denser breast tissue. Unexpectedly, in <figref idref="DRAWINGS">FIG. 7B</figref> the region <b>774</b> which was identified in <figref idref="DRAWINGS">FIG. 7A</figref> shows a micro calcification is visible and not occluded by the denser breast tissue.

0108<figref idref="DRAWINGS">FIGS. 8A-8D</figref> show an artists impression of four (4) images which make up time points in a mp3 video of a dynamic comparison of DBT of a right breast while the viewing direction changes, according to an embodiment of the invention. The mp3 video used to generate <figref idref="DRAWINGS">FIGS. 8A-8D</figref> had a duration of approximately 13 seconds. Unexpectedly, the mp3 video is an excellent means of inspecting DBTs to identify micro calcifications. <figref idref="DRAWINGS">FIG. 8A</figref> shows the artists impression of a screen dump from the mp3 video at approximately the two (2) second time point. <figref idref="DRAWINGS">FIG. 8B</figref> shows the artists impression of a screen dump from the mp3 video at approximately the five (5) second time point. <figref idref="DRAWINGS">FIG. 8C</figref> shows the artists impression of a screen dump from the mp3 video at approximately the nine (9) second time point. <figref idref="DRAWINGS">FIG. 8D</figref> shows the artists impression of a screen dump from the mp3 video at approximately the twelve (12) second time point. The dynamic comparison illustrates the differences between the intensity of the voxel matrix from which the projection image is calculated. Unexpectedly, when viewing the video a spot becomes apparent, which is shown in <figref idref="DRAWINGS">FIG. 8B</figref> and <figref idref="DRAWINGS">FIG. 8C</figref> but is not present in <figref idref="DRAWINGS">FIG. 8A</figref> or <figref idref="DRAWINGS">FIG. 8D</figref>. <figref idref="DRAWINGS">FIG. 9A</figref> shows an enlarged version of <figref idref="DRAWINGS">FIG. 8B</figref>, the artists impression of the screen dump from the mp3 video at approximately the five (5) second time point where the region <b>774</b> is identified. <figref idref="DRAWINGS">FIG. 9B</figref> shows an enlarged version of <figref idref="DRAWINGS">FIG. 8C</figref>, the artists impression of the screen dump from the mp3 video at approximately the nine (9) second time point where the region <b>774</b> is again identified. The spot seen in <figref idref="DRAWINGS">FIG. 8B</figref> (<figref idref="DRAWINGS">FIG. 9A</figref>) and <figref idref="DRAWINGS">FIG. 8C</figref> (<figref idref="DRAWINGS">FIG. 9B</figref>) reduces in intensity between the observation in <figref idref="DRAWINGS">FIG. 8B</figref> (<figref idref="DRAWINGS">FIG. 9A</figref>) and the observation in <figref idref="DRAWINGS">FIG. 8C</figref> (<figref idref="DRAWINGS">FIG. 9B</figref>). Unexpectedly, the emergence and dimunition of a relatively bright spot in the same position when viewing a video, can also be used to confirm a microcalcification rather than an artifact of the imaging system. Thus, based on the mp3 video a microcalcification <b>774</b> jumps to the viewer's attention by way of the nature of the dynamic comparison, as shown in the difference between <figref idref="DRAWINGS">FIG. 8A</figref> where no microcalcification is present and <figref idref="DRAWINGS">FIG. 8B</figref> (<figref idref="DRAWINGS">FIG. 9A</figref>) where the microcalcification, <b>774</b> is present. Viewing the mp3 video improves the visual clarity of identification of a micro calcification.

0109<figref idref="DRAWINGS">FIG. 13A</figref> shows the image of a human breast generated from a volumetric image reconstructed from a number of 2D X-Ray images produced by a DBT device, where the generated 2-D projection image was formed at a specific angle, where a micro calcification is occluded by denser breast tissue, as represented in <figref idref="DRAWINGS">FIG. 7A</figref>. <figref idref="DRAWINGS">FIG. 13B</figref> shows the generated 2-D projection image of the human breast formed from a different angle to that shown in <figref idref="DRAWINGS">FIG. 13A</figref>, where the micro calcification is visible and not occluded by the denser breast tissue, as represented in <figref idref="DRAWINGS">FIG. 7B</figref>. <figref idref="DRAWINGS">FIGS. 14A-14D</figref> show four (4) images which make up time points in the mp3 video of the dynamic comparison of the DBT of the right breast. <figref idref="DRAWINGS">FIG. 14A</figref> shows a screen dump from the mp3 video at a two (2) second time point, as represented in <figref idref="DRAWINGS">FIG. 8A</figref>. <figref idref="DRAWINGS">FIG. 14B</figref> shows a screen dump from the mp3 video at the five (5) second time point, as represented in <figref idref="DRAWINGS">FIG. 8B</figref>. <figref idref="DRAWINGS">FIG. 14C</figref> shows a screen dump from the mp3 video at the nine (9) second time point, as represented in <figref idref="DRAWINGS">FIG. 8C</figref>. <figref idref="DRAWINGS">FIG. 14D</figref> shows a screen dump from the mp3 video at the twelve (12) second time point, as represented in <figref idref="DRAWINGS">FIG. 8D</figref>. <figref idref="DRAWINGS">FIG. 15A</figref> shows an enlarged version of <figref idref="DRAWINGS">FIG. 14B</figref>, the screen dump from the mp3 video at the five (5) second time point where the region <b>774</b> is identified, as represented in <figref idref="DRAWINGS">FIG. 9A</figref>. <figref idref="DRAWINGS">FIG. 15B</figref> shows an enlarged version of <figref idref="DRAWINGS">FIG. 14C</figref>, the screen dump from the mp3 video at the nine (9) second time point where the region <b>774</b> is identified, as represented in <figref idref="DRAWINGS">FIG. 9B</figref>.

0110A draw-back of any projection method, is that there can be an occlusion or overlay effect. In the case of a maximum intensity projection as defined above, consider the case where two (2) separate areas of increased density are at different z positions on approximately the same viewing ray <u style="single">v</u>. <figref idref="DRAWINGS">FIG. 3A</figref> shows a specimen <b>356</b> with two separate areas <b>353</b> and <b>355</b> of increased density. In the projection they will appear as one, potentially larger spot. That is, for one viewing direction (v<b>1</b>) <b>358</b> the two separate areas <b>353</b> and <b>355</b> can be projected to the same spot in the projection image (projection <b>1</b>) shown in <figref idref="DRAWINGS">FIG. 3B</figref>.

0111In an embodiment of the present invention, this ambiguity can be resolved by making the projection dynamic. Instead of choosing a fixed viewing direction <u style="single">v</u>, a dynamic viewing direction can be used. Using an alternative viewing direction (v<b>2</b>) <b>360</b>, the two separate areas <b>353</b> and <b>355</b> project to different spots in the projection image, making it obvious that there are two areas of interest. <figref idref="DRAWINGS">FIG. 3C</figref> shows for the second viewing direction (v<b>2</b>) <b>360</b> the two separate areas <b>353</b> and <b>355</b> can be projected to different spots in the generated 2-D projection image (projection <b>2</b>).

0112In an alternative embodiment of the invention, different dynamic functions can be used to generate dynamic projection viewing directions. Given the non-isotropy of the input data mentioned above, the most useful dynamic functions are continuous periodic functions around the z direction. Two non-limiting examples of dynamic functions include: <br /><i>v</i>(<i>t</i>)=normalize(<i><u style="single">z</u>+A </i>sin(ω<i>t</i>)<i><u style="single">x</u></i>)  Equation 1<br /><i>v</i>(<i>t</i>)=normalize(<i><u style="single">z</u>+A </i>sin(ω<i>t</i>)<i><u style="single">x</u>+A </i>cos(ω<i>t</i>)<i><u style="single">y</u></i>)  Equation 2

0113where normalize(<u style="single">v</u>)=<u style="single">v</u>/|v|; t: time; ω=2πf; f: frequency of the dynamic movement and A: Amplitude of the dynamic movement, e.g. A=0.05.

0114In other embodiments of the invention, different alternative dynamic functions can be used to generate dynamic projection viewing directions. In an embodiment of the invention, a linear function can be used in which the angle can be changed linearly. In an alternative embodiment of the invention, a z direction can be chosen and either the x or the y direction can be incremented. <figref idref="DRAWINGS">FIG. 6</figref> illustrates the dynamic variation of the viewing direction <u style="single">v</u> according to Equation 2. The viewing direction at two different points <u style="single">v</u>_{<u style="single">t1</u>}<b>666</b> and <u style="single">v</u>_{<u style="single">t2</u>}<b>668</b> at time t₁and t₂is shown, as well as the corresponding projection planes projection plane (t₁) <b>670</b> and projection plane (t₂) <b>672</b>. Over time the viewing direction <u style="single">v</u> can be varied around the main acquisition direction <u style="single">z</u><b>130</b>.

0115In another embodiment of the invention, the viewing direction can be determined by the user. In another alternative embodiment of the invention, the viewing direction can be determined by the user with an appropriate input device, such as a mouse. In an embodiment of the present invention, let (m_x1, m_y1) be the position of the mouse (or appropriate input device) at a starting time t₁. The starting time can then be defined by a mouse click (or appropriate input device). In an alternative embodiment of the present invention, the starting time can be triggered by the user entering a certain window with the mouse (or appropriate input device), or other graphical or non graphical criteria.

0116Assuming the user is moving the mouse, let (m_x2, m_y2) be the position of the mouse (or appropriate input device) at time t₂. Let s_widthand s_heightbe the width and height of the screen.

0117Then v(t<b>2</b>)=normalize (<u style="single">z</u>+2 A <u style="single">x</u>(m_x2−m_x1)/s_width+2 A <u style="single">y</u>(m_y2−m_y1)/s_height) can be the interactively controlled viewing direction at time t₂. A person of ordinary skill in the art will appreciate that alternative mappings from the mouse coordinates to viewing directions can be used. In various embodiments of the present invention, alternative input methods or devices can be used including, a slider, a trackball, a head tracking device or an eye tracking device.

0118The above projection is a maximum intensity projection. In various other embodiments of the present invention, other projection functions can be used, including emission absorption models or minimum intensity projections. The above projection is equivalent to an orthographic projection, where a 3-D object is represented in two dimensions through parallel projection, where all the projection lines are orthogonal to the projection plane. A person of ordinary skill in the art will appreciate that alternative projections including perspective projections can be used.

0119In an embodiment of the invention, an optimal viewing direction can be selected by comparing the resulting projection images at a plurality of viewing directions. In an embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that identifies an unobserved obstruction. In an alternative embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that improves the visual clarity of an initial projection image. In another alternative embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that improves the visual clarity of an improved projection image compared with an initial projected image. In a different embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that improves the visual clarity of identification of an obstruction. In another different embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that identifies an obstruction using direct comparison. In another embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that improves the direct comparison clarity of an initial projection image. In an embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that improves the direct comparison clarity of an improved projection image compared with an initial projected image. In another embodiment of the invention, the criterion used for determining the optimal viewing direction can be a viewing direction that improves the direct comparison clarity of identification of an obstruction.

0120Volumetric images in DBT are quite large data sets, as the xy-resolution is an order of magnitude larger than for example a standard CT scan. In order to render such large images at interactive speeds graphics processing units (GPU) can be utilized, see for example, U.S. Pat. No. 8,189,002, ‘Methods and Apparatus for Visualizing Three-Dimensional and Higher-Dimensional Image Data Sets’ May 29, 2012 and which is herein expressly incorporated by reference in its entirety. In typical DBT images, only a subset of the voxels of the volumetric image contain tissue, while other voxels are background pixels that are irrelevant for the diagnosis. In an embodiment of the present invention, by using a threshold segmentation these background pixels can be identified. <figref idref="DRAWINGS">FIG. 4</figref> shows how only a subset of the acquisition volume is covered by the specimen <b>462</b>, while other areas (hatched) <b>464</b> only contain background pixels. These background pixels can be identified using threshold segmentation. <figref idref="DRAWINGS">FIG. 5</figref> shows the volume can be subdivided into sub-volumes. In one embodiment of the invention, an octree decomposition scheme can be used for this subdivision. In another embodiment of the invention, a binary space partitioning (BSP) scheme can be used for the subdivision. A person with ordinary skills in the art will appreciate that other subdivision schemes can be used. Sub-volumes that contain only background voxels (shown as hatched in <figref idref="DRAWINGS">FIG. 4</figref> and <figref idref="DRAWINGS">FIG. 5</figref>) <b>464</b> can be skipped during the rendering process. Sub-volumes <b>463</b> that contain both, background voxels and tissue voxels can be further sub-divided until a configured minimum size containing specimen <b>462</b> or background <b>464</b> can be reached. In an embodiment of the invention, bricking can be used to display only those sub-volumes that are not background-only. The technique of bricking for GPU based rendering is described in U.S. Pat. No. 8,189,002.

0121In an embodiment of the present invention, for the effective use of dynamic projection images, a sufficiently high frame rate is required in order to allow for a smooth rendering that appears natural to the user. This can be achieved in many cases by using GPU hardware combined with the bricking technique.

0122In an alternative embodiment of the present invention, a periodic dynamic viewing direction function can be used, and a sequence of projections covering one full period (1/f) can be pre-rendered, and then be played back in a loop. In case of a client server visualization system, the pre-rendered images can be computed on the server side and cached on the client side thereby making optimal use of the bandwidth and allowing for smooth playback even on slow networks.

0123In radiological diagnostics, comparison to prior images is relevant to detect change, e.g. tumor growth. In an embodiment of the present invention, a projection of a current image and a projection of the corresponding prior image can be displayed side-by-side and used to determine the change in tumor characteristics. The comparison can include the user visually comparing with the naked eye. The comparison can also be undertaken by a direct comparison program where equivalent viewing directions are used for the direct comparison. In various embodiments of the present invention, the user can choose the same dynamic viewing direction function for both, the current and the prior image, thereby allowing for direct comparison.

0124Another aspect of the invention is to combine the projection display of the volumetric image with conventional 2D mammograms or other X-Ray or radiological images, by dividing the available computer screens into virtual view ports and using one or more of the virtual view ports to display the one or more projection images, and one or more of the virtual viewports to display the other radiological images.

0125A method for displaying one or more optimal projection images generated from a volumetric image comprising the steps of receiving the volumetric image, computing a plurality of projection images of the volumetric image using a plurality of viewing directions, where at least an initial projection image of the plurality of projection images is computed using a first viewing direction, where a second viewing direction of the plurality of viewing directions is not equal to the first viewing direction, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal projection images and displaying the optimal projection images.

0126A method for identifying one or more optimal projection images generated from a volumetric image comprising the steps of receiving the volumetric image, computing a plurality of projection images of the volumetric image using a plurality of viewing directions, where at least an initial projection image of the plurality of projection images is computed using a first viewing direction, where a second viewing direction of the plurality of viewing directions is not equal to the first viewing direction, and one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal projection images.

0127A method for identifying one or more optimal projection images generated from a volumetric image comprising the steps of receiving the volumetric image, computing a plurality of projection images of the volumetric image using a plurality of viewing directions, where at least an initial projection image of the plurality of projection images is computed using a first viewing direction, where a second viewing direction of the plurality of viewing directions is not equal to the first viewing direction, and one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal projection images, where the optimal viewing direction is selected from the group consisting of a viewing direction that identifies an unobserved obstruction, a viewing direction that improves the visual clarity of the first projection image, a viewing direction that improves the visual clarity of the second projection image, a viewing direction that improves the visual clarity of identification of an obstruction, a viewing direction that identifies an obstruction using direct comparison, a viewing direction that increases the differentiated intensity values of the first projection image, a viewing direction that increases the differentiated intensity values of the second projection image, a viewing direction that improves the direct comparison clarity of the first projection image, a viewing direction that improves the direct comparison clarity of the second projection image, and a viewing direction that improves the direct comparison clarity of identification of an obstruction.

0128A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images.

0129A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where the optimal viewing direction is selected from the group consisting of a viewing direction that identifies an unobserved obstruction, a viewing direction that improves the visual clarity of the first projection image, a viewing direction that improves the visual clarity of the second projection image, a viewing direction that improves the visual clarity of identification of an obstruction, a viewing direction that identifies an obstruction using direct comparison, a viewing direction that improves the direct comparison clarity of the first projection image, a viewing direction that improves the direct comparison clarity of the second projection image, and a viewing direction that improves the direct comparison clarity of identification of an obstruction.

0130A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where the volumetric image is a 3D image.

0131A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where the plurality of projection images are 2D images.

0132A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function.

0133A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projections images spanning one period of the periodic continuous mathematical function.

0134A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projections images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images.

0135A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projections images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images, where the rendered and cached sequence of projections are played back one or more times.

0136A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projections images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images, where the rendering is carried out on a server and one or both the caching and play back is carried out on a client computer.

0137A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where a graphics processing unit is used to compute one or more of the plurality of projection images.

0138A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where a graphics processing unit is used to compute one or more of the plurality of projection images, where bricking is used to accelerate computation of one or more of the plurality of projection images.

0139A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, where one or more of the plurality of viewing directions is based on user input.

0140A method to determine one or more optimal projection images from a volumetric image comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images to determine one or more optimal viewing directions, and correlating the optimal viewing directions with one or more projection images of the plurality of projection images to determine one or more optimal projection images, further comprising visually comparing the plurality of projection images.

0141A system that displays a first projection image and a second projection image of a volumetric image comprising computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, where the first viewing direction is not equal to the second viewing direction, and displaying the first projection image and the second projection image.

0142A system that displays a first projection image and a second projection image of a volumetric image comprising computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, where the first viewing direction is not equal to the second viewing direction, and displaying the first projection image and the second projection image, further comprising computing a third projection image using a third viewing direction, and displaying one or both the first projection image and the second projection image with the third projection image.

0143A system that displays a first projection image and a second projection image of a volumetric image comprising computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, where the first viewing direction is not equal to the second viewing direction, and displaying the first projection image and the second projection image, further comprising computing a third projection image using a third viewing direction, and displaying one or both the first projection image and the second projection image with the third projection image, where one or both the second viewing direction and the third viewing direction are determined using a periodic continuous mathematical function.

0144A system that compares a first projection image and a second projection image of a volumetric image comprising computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, and one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image.

0145A system that compares a first projection image and a second projection image of a volumetric image comprising computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, and one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image, further comprising computing a third projection image using a third viewing direction, and comparing one or both the first projection image and the second projection image with the third projection image.

0146A system that compares a first projection image and a second projection image of a volumetric image comprising computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, and one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image, further comprising computing a third projection image using a third viewing direction, and comparing one or both the first projection image and the second projection image with the third projection image, where one or both the second viewing direction and the third viewing direction are determined using a periodic continuous mathematical function.

0147A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images.

0148A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function.

0149A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projection images spanning one period of the periodic continuous mathematical function.

0150A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projection images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images.

0151A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projection images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images, where the rendered and cached sequence of projection images are played back one or more times.

0152A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projection images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images, where the rendering is carried out on a server.

0153A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projection images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images, where the caching is carried out on a client computer.

0154A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where the plurality of projection images is a sequence of projection images spanning one period of the periodic continuous mathematical function, further comprising rendering and caching a sequence of projection images, where the rendering is carried out on a server, where the play back is carried out on a client computer.

0155A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where a graphics processing unit is used to compute one or more of the plurality of projection images.

0156A method for identifying an object in a projection image comprising the steps of receiving a three dimensional volumetric image of a tissue, computing a plurality of projection images of the three dimensional volumetric image of the tissue using a plurality of viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the plurality of projection images, and identifying an object that is present in a projection image selected from the plurality of projection images that is not present in one or more of the one or more projection images selected from the plurality of projection images, where at least one of the plurality of viewing directions is determined using a periodic continuous mathematical function, where a graphics processing unit is used to compute one or more of the plurality of projection images, where bricking is used to accelerate computation of one or more of the plurality of projection images.

0157A method for identifying an optimal projection image comprising the steps of receiving a volumetric image, computing the plurality of projection images based on the volumetric image using a plurality of viewing directions, and comparing the plurality of projection images to determine an optimal viewing direction corresponding to an optimal projection image.

0158A method for identifying an optimal projection image comprising the steps of receiving a volumetric image, computing the plurality of projection images based on the volumetric image using a plurality of viewing directions, and comparing the plurality of projection images to determine an optimal viewing direction corresponding to an optimal projection image, where the optimal viewing direction is selected from the group consisting of a viewing direction that identifies an unobserved obstruction, a viewing direction that improves the visual clarity of the first projection image, a viewing direction that improves the visual clarity of the second projection image, a viewing direction that improves the visual clarity of identification of an obstruction, a viewing direction that identifies an obstruction using direct comparison, a viewing direction that improves the direct comparison clarity of the first projection image, a viewing direction that improves the direct comparison clarity of the second projection image, and a viewing direction that improves the direct comparison clarity of identification of an obstruction.

0159A method for displaying a plurality of projection images comprising the steps of receiving a volumetric image, computing the plurality of projection images based on the volumetric image using a plurality of viewing directions and displaying the plurality of projection images.

0160A method for comparing a first projection image and a second projection image comprising the steps of receiving a volumetric image, computing the first projection image based on the volumetric image using a first viewing direction, computing the second projection image based on the volumetric image using a second viewing direction, where the first viewing direction is not equal to the second viewing direction and one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image.

0161A method for comparing a first projection image and a second projection image comprising the steps of receiving a volumetric image, computing the first projection image based on the volumetric image using a first viewing direction, computing the second projection image based on the volumetric image using a second viewing direction, where the first viewing direction is not equal to the second viewing direction and one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image, further comprising one or more steps selected from the group consisting of identifying visually an obstruction, improving the visual clarity of the first projection image, improving the visual clarity of the second projection image, improving the visual clarity of identification of an obstruction, identifying an obstruction using direct comparison, improving the direct comparison clarity of the first projection image, improving the direct comparison clarity of the second projection image, and improving the direct comparison clarity of identification of an obstruction.

0162A method for displaying one or more unobstructed projection images comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, where at least a first projection image of the plurality of projection images is computed using a first viewing direction and at least a second projection image of the plurality of projection images is computed using a second viewing direction, where the first viewing direction is not equal to the second viewing direction, one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image to determine if one or both of the first projection image and the second projection image are unobstructed, and displaying based on the comparison one or both the first projection image and the second projection image.

0163A method for displaying an unobstructed projection image of a breast comprising the steps of receiving a volumetric image of the breast, computing a first projection image of the breast based on the volumetric image using a first viewing direction and a second projection image of the breast based on the volumetric image using a second viewing direction, where the first viewing direction is not equal to the second viewing direction, one or more of time comparing, structurally comparing and dynamically comparing the second projection image of the breast with the first projection image of the breast to determine if one or both the first projection image of the breast and second projection image of the breast is unobstructed, and based on the comparison displaying one or both the first projection image of the breast and second projection image of the breast.

0164A system for displaying unobstructed breast projection images comprising receiving a plurality of volumetric images of a breast, where a first volumetric image of the plurality of projection images is measured at a first time and a second volumetric image of the plurality of projection images is measured at a second time, where the first time differs from the second time by a time interval, computing a first projection image from the first volumetric image measured at the first time using a first viewing direction, computing one or more projection images from the first volumetric image measured at the first time using one or more viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the one or more projection images to determine an unobstructed viewing direction, where a second projection image corresponds with the one or more projection images at the unobstructed viewing direction, computing a third projection image from the second volumetric image measured at the second time using the unobstructed viewing direction, and displaying the second projection image and the third projection image.

0165A system for displaying unobstructed breast projection images comprising receiving a plurality of volumetric images of a breast, where a first volumetric image of the plurality of projection images is measured at a first time and a second volumetric image of the plurality of projection images is measured at a second time, where the first time differs from the second time by a time interval, computing a first projection image from the first volumetric image measured at the first time using a first viewing direction, computing one or more projection images from the first volumetric image measured at the first time using one or more viewing directions, one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the one or more projection images to determine an unobstructed viewing direction, where a second projection image corresponds with the one or more projection images at the unobstructed viewing direction, computing a third projection image from the second volumetric image measured at the second time using the unobstructed viewing direction, and displaying the second projection image and the third projection image, further comprising computing a fourth projection image from the second volumetric image measured at the second time using the first viewing direction.

0166A method for identifying additional lesions in a tissue comprising the steps of computing a plurality of projection images of the tissue using a plurality of viewing directions, where a first projection image is computed using a first viewing direction and a second projection image is computed using a second viewing direction, displaying the first projection image and the second projection image, one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image, visually identifying an intense spot that separates in the second projection image from the first projection image.

0167A system that displays a first projection image and a second projection image of a volumetric image comprising a processor responsive to a command to select a volumetric image one or more digital data processors capable of carrying out the steps including, computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, and graphics resources for displaying the first projection image and the second projection image.

0168A system that compares a first projection image and a second projection image of a volumetric image comprising a processor responsive to a command to select a volumetric image, one or more digital data processors capable of carrying out the steps including computing a first projection image of the volumetric image using a first viewing direction, computing a second projection image of the volumetric image using a second viewing direction, and graphics resources for comparing the first projection image and the second projection image.

0169A method for displaying one or more unobstructed projection images comprising the steps of receiving a volumetric image, computing a plurality of projection images based on the volumetric image using a plurality of viewing directions, where at least a first projection image of the plurality of projection images is computed using a first viewing direction and at least a second projection image of the plurality of projection images is computed using a second viewing direction, where the first viewing direction is not equal to the second viewing direction, one or more of time comparing, structurally comparing and dynamically comparing the first projection image and the second projection image to determine if one or both of the first projection image and the second projection image are unobstructed, and displaying based on the comparison one or both the first projection image and the second projection image.

0170A method of visualizing a dynamic comparison of a volumetric image comprising the steps of receiving the volumetric image, computing a plurality of projection images of the volumetric image using a plurality of viewing directions between a smallest viewing direction and a largest viewing direction, and displaying a video showing the plurality of projection images, where the viewing direction changes with time.

0171Often, the traditional ‘Hanging Protocol’ is either not intuitive, cannot display the information in a manner in which it can be reviewed or is not the most efficient way to display images. Alternative ways of rendering the acquired images can be more efficient or more appropriate for displaying the information. Examples include Volume Rendering techniques or maximum intensity projections of stacks of cross-sectional images, rendering of oblique slices, rendering of thick slices or slabs, or rendering of fused images (e.g. in PET/CT). Specialized diagnostic workstations that are often specific to a clinical application area are used to provide appropriate rendering of the acquired images. As organizations and doctors require better and faster visualization methods that allow users to interact with the image data in real-time, the requirements and demands for displaying the data will increase.

0172<figref idref="DRAWINGS">FIG. 11</figref> depicts an example study where the rules have created two Sets of Images. One Set of Images consists of a series of CT images forming a 3D volume, which is depicted in a volume rendered style in the Viewport <b>1160</b> in the upper left and in three orthogonal cross sections in the three other viewports in the left half of the screen. The second Set of Images consist of one chest X-Ray, assigned to a single Viewport <b>1160</b> covering the right half of the screen and rendering the X-Ray in 2D style. Appropriate data windows have been chosen by the rules to highlight the vasculature in the 3D rendering, as this is a study with contrast, as the rules can determine by the StudyDescription containing the word ‘contrast’.

0173<figref idref="DRAWINGS">FIG. 10</figref> is a flow chart showing how the rules are used to create the two Sets of Images shown in <figref idref="DRAWINGS">FIG. 11</figref>. As shown in <figref idref="DRAWINGS">FIG. 10</figref>, a primary Study <b>1105</b> which can be manually selected by a user. In step (i) <b>1120</b>, based on Study Selection Rules <b>1115</b> which interrogate parameters in the primary Study <b>1105</b> such as DICOM Parameters and Abstract Tags of both the primary Study <b>1105</b> and the candidate studies <b>1110</b>, the Study Selection Rules <b>1115</b> can identify additional candidate studies <b>1110</b>. The second set of studies <b>1125</b> which includes the candidate studies <b>1110</b> and the primary Study <b>1105</b> are available to be loaded into Viewports <b>1160</b>. In step (ii) <b>1140</b>, the Protocol Selection Rules <b>1135</b> select a Display Protocol <b>1145</b> from the Available Display Protocols <b>1130</b> based on DICOM Parameters and Abstract Tags present in the second studies <b>1125</b>. In step (iii) <b>1155</b>, Image Set Rules <b>1150</b> are used to define a plurality of Image Sets <b>1165</b> from the second studies <b>1125</b>. The one or more Viewports <b>1160</b> are defined in the Display Protocol <b>1145</b>. In step (iv) <b>1175</b>, Viewport Assignment Rules <b>1170</b> assign one or more Image Sets <b>1165</b> to one or more Viewports <b>1160</b>. In step (v) <b>1185</b>, Style Rules <b>1180</b> define a rendering style and rendering parameters. In an embodiment of the invention steps (i) through (v) are performed by a server processor running a render server program with an interface shown in <figref idref="DRAWINGS">FIG. 12A</figref> in which the rules (Study Selection Rules <b>1115</b>, Protocol Selection Rules <b>1135</b>, Image Set Rules <b>1150</b>, Viewport Assignment Rules <b>1170</b>, and the one or more Style Rules <b>1180</b>) are used to automatically select and display the Image Sets <b>1165</b> in the Viewports <b>1160</b> for a prior chest CR analysis. In an embodiment of the invention steps (i) through (v) are performed by a server processor running a render server program with an interface shown in <figref idref="DRAWINGS">FIG. 12B</figref> in which the rules (Study Selection Rules <b>1115</b>, Protocol Selection Rules <b>1135</b>, Image Set Rules <b>1150</b>, Viewport Assignment Rules <b>1170</b>, and the one or more Style Rules <b>1180</b>) are used to automatically select and display the Image Sets <b>1165</b> in the Viewports <b>1160</b> for a prior left breast mammogram analysis.

0174A render server program is described in U.S. application Ser. No. 13/831,967, entitled ‘Multi-User Mult-GPU Render Server Apparatus and Methods’, inventors M. Westerhoff et al., which was filed Mar. 15, 2013 is herein expressly incorporated by reference in its entirety. A rule based render server program is described in ‘Method and System for Rule Based Display of Sets of Images’, inventors M. Westerhoff et al., which issued as U.S. Pat. No. 8,976,190 on Mar. 10, 2015, and is herein incorporated by reference in its entirety. A program for improving data transfer is described in U.S. patent application Ser. No. 13/831,982 filed on Mar. 13, 2013, entitled ‘Method and System for Transferring Data to Improve Responsiveness when Sending Large Data Sets’, inventors D Stalling et al., which is herein incorporated by reference in its entirety.

0000Study Selection Rules <b>1115</b>

0175In an embodiment of the present invention, based on the Study that the user selects for display (primary Study <b>1105</b>), the system can first apply user defined rules to determine additional studies to be displayed together with the primary Study <b>1105</b>. Such additional studies can be prior examinations that are relevant for the diagnosis of the current Study, or additional current studies. For example, a PET examination will often be looked at together with a CT examination acquired at the same time. The set of rules are constructed as follows:

0176Each rule consists of a matching criterion for the primary Study <b>1105</b> (primary condition), as well as matching criteria for additional studies (secondary condition). The matching criterion is an expression consisting of operators that allow evaluating the parameters of the Study and comparing them to defined values. The parameters of the Study are any parameters defined by the DICOM standard, such as Study Description, Study Date, Modality, Patient Age, as well as any other parameters that can be derived from the DICOM parameters or from the Study itself, such as number of images, or number of image series. The operators are numeric or string based operators, such as equals, greater than, less than, contains, etc. Expressions can be combined using Boolean operators such as AND, OR, NOT. Operators can also contain more complex expressions, including user defined functions defined in an appropriate programming language, such as JavaScript or VisualBasic.

0177Once a primary Study <b>1105</b> has been selected for display, the primary condition of each rule is evaluated. Those rules that match, i.e., evaluate to ‘true’ for the given primary Study <b>1105</b>, will then be applied to all other studies that are available for the same patient. Those other studies for which the secondary condition matches will be added to the list of studies to be displayed.

0178The following rule illustrates the concept. This rule will automatically load prior Chest X-Rays or prior Chest CT if the primary Study <b>1105</b> is a Chest X-RAY.

0000Study Selection Rule 1:

0000<ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0179">IF (Primary.Dicom.BodyPartExamined=‘CHEST’ and Primary.Dicom.Modality=‘CR’) THEN SELECT other studies for loading WHERE (Other.Dicom. BodyPartExamined=‘CHEST’ and (Other.Dicom.Modality=‘CR’ or Other.Dicom.Modality=‘CT’))</li></ul>

0180The rule is expressed in pseudo-code with the primary condition specified in the IF-clause and the secondary condition expressed in the SELECT-clause.

0000Study Selection Rules: Normalization of DICOM Parameters

0181In an embodiment of the present invention, the rules can normalize DICOM parameters. As described above, a Study Selection Rule can contain arbitrary DICOM parameters. The DICOM standard specifies if a particular parameter is defined on a patient, Study, series, or image level. For example, a Study-level parameter should have the same value in all images of a Study, while a series-level parameter should have the same value in all images of a series. There are two problems related to assuming that this statement is always the case. Firstly, although a Study-level tag should have the same value for all images of a Study this is not always true. Secondly, some parameters are defined on a series- or image-level (e.g. modality is a series-level parameter) and therefore can be unavailable. In both cases it can be unclear what value is to be used when evaluating the rule. The invention described here provides different solutions to this problem.

0182In an embodiment of the present invention, a first approach is to choose a reference image and to read the value of a particular DICOM parameter from the reference image. The reference image can be: (i) the image that was inserted into the system first, (ii) the image with the oldest image content date, (iii) the image that was inserted into the system last, or (iv) the image with the earliest image content date. The choice of which image is to be chosen as the reference image can be configured for each parameter separately.

0183In an embodiment of the present invention, a second approach is to only allow original images to be chosen as the reference image. Non-viewable DICOM objects like structured reports, key objects, or presentation states are disregarded, as well as derived images such as secondary capture images or reformatted images.

0184In an embodiment of the present invention, a third approach is to provide a list of all distinct values that a particular DICOM parameter has in the images of a Study. In a Study Selection Rule one can then check if that list contains a particular value. The example above can then read as follows:

0000Study Selection Rule 2:

0000<ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0185">IF (Primary.Dicom.BodyPartExamined=‘CHEST’ and Primary.DicomList.Modality contains ‘CR’) THEN SELECT other studies for loading WHERE (Other.Dicom.BodyPartExamined=‘CHEST’ and (Other.DicomList.Modality contains ‘CR’ or Other.DicomList.Modality contains ‘CT’)) <br /> Study Selection Rules: Abstract Tags </li></ul>

0186In an embodiment of the present invention, the Study Selection Rules <b>1115</b> contain other derived parameters such as Abstract Tags that characterize a Study in addition to or instead of DICOM parameters. Abstract tags that are useful within Study Selection Rules <b>1115</b> include the following: <ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0187">(i) RelativeStudyAge indicates relative age of Study in days compared to primary Study <b>1105</b>.</li><li id="ul0003-0002" num="0188">(ii) PriorIndex indicates an index that enumerates all other studies from youngest to oldest.</li><li id="ul0003-0003" num="0189">(iii) NumImages indicates number of images in Study.</li><li id="ul0003-0004" num="0190">(iv) NumSeries indicated number of image series in Study.</li><li id="ul0003-0005" num="0191">(v) Num3DVolumes indicates number of 3D volumes in Study.</li><li id="ul0003-0006" num="0192">(vi) Num4DSequences indicates number of 4D sequences in Study (e.g. Cardiac CT).</li><li id="ul0003-0007" num="0193">(vii) HasReport indicates a flag that indicates if a report is available for a Study.</li><li id="ul0003-0008" num="0194">(viii) HasThinSliceVolumes indicates whether the study has at least one set of images that form a true 3D volume, i.e. a sufficiently large number of equidistant slices (the exact number can be user configurable, e.g. 30 would be a common choice) and a sufficiently small spacing between two consecutive slices to guarantee an isotropic (or close to isotropic) (again, this parameter can be user defined, values between 1 mm and 3 mm are common thresholds for CT and MR examinations).</li></ul>

0195For example, a rule that applies to a Mammogram Study and that selects at maximum three prior Mammogram studies no older than five years can read as follows:

0000Study Selection Rule 3:

0000<ul id="ul0004" list-style="none"><li id="ul0004-0001" num="0196">IF (Primary.Dicom.Modality=‘MG’ THEN SELECT other studies for loading WHERE (Other.Dicom.Modality=‘MG’ and Other.Abstract.PriorIndex &lt;=3 and Other.Abstract.RelativeStudyAge &lt;5*365) <br /> Protocol Selection Rules <b>1135</b></li></ul>

0197In an embodiment of the present invention, once the studies to be displayed are determined as described above, a suitable display protocol can be selected. This is done using matching rules. Each matching rule consists of conditions that are applied to the primary and other studies to be loaded. Like in Study Selection Rules <b>1115</b>, protocol selection rules may contain DICOM parameters (either taken from a reference image or provided as a list of distinct values gathered from all images of a study), as well as abstract tags and user-defined functions. Each matching rule has a score and an associated display protocol.

0198In an embodiment of the present invention, all matching rules are evaluated and the display protocol of the matching rule that evaluates to true can be selected. If multiple matching rules evaluate to true, the one with the highest score can be selected.

0199The following example rule illustrates a matching rule that can apply for PET/CT studies of the abdomen to select a protocol named ‘StandardPetCTProtocol1’ with a score of 10.

0000Protocol Selection Rule 1:

0000<ul id="ul0005" list-style="none"><li id="ul0005-0001" num="0200">IF (Primary.Dicom.BodyPartExamined=‘ABDOMEN’ and Primary.Dicom.Modality=‘CT’ and Exists(Other1) and Other1.Dicom.Modality=‘PET’) THEN SELECT ‘StandardPetCTProtocol1’ with score=10</li></ul>

0201In an embodiment of the present invention, the rule is expressed in pseudo-code with the matching condition specified in the IF-clause and the chosen protocol specified by the SELECT.

0000Image Set Rules <b>1150</b>

0202In an embodiment of the present invention, once a display protocol is selected, further rules defined within the protocol are evaluated. The next step comprises creation of so-called image sets. An image set consists of images that are logically grouped together. Usually, an image set is represented by a single preview icon in the application. It is an image set that is loaded into a viewer or tiled viewer. Note that DICOM series also represent a logical grouping of images. However, often DICOM series are not well suited for hanging of images and viewing. For example, in Mammography a single DICOM series may contain images of both left and right breast, in MRI it may contain both T<b>1</b> and T<b>2</b> images, or in CT it may contain both a localizer image (topogram) and a 3D image stack. In all these cases the DICOM series can be split into different logical image sets. On the other hand, multiple DICOM series may represent the phases of a single 4D cardiac data set. In this case all those series can be joined into a single logical image set. p Thus the creation of image sets based on rules is a key component of the rule-based display system, specifically for the more advanced rendering techniques. For example, the rules-based display system is used to create image sets that are very similar to the rules described above in Study Selection Rules <b>1115</b> and Protocol Selection Rules <b>1135</b> sections. A rule is a Boolean expression that can contain DICOM parameters, abstract tags, or used-defined functions that are based on the DICOM parameters, abstract tags, or used-defined functions. Image set rules however, are applied to all images of a study that was selected for loading (and not to the study itself). Image-level parameters thus represent no problem and do not need to be normalized or otherwise treated specially. All images that match an image-set rule are grouped into a respective image set.

0203In an embodiment of the present invention, the following rule (expressed in pseudo-code) collects all images of a current CT study:

0000Image Set Rule 1:

0000<ul id="ul0006" list-style="none"><li id="ul0006-0001" num="0204">IF (Dicom.Modality=‘CT’ and Abstract.PriorIndex=0)</li><li id="ul0006-0002" num="0205">THEN CREATE image set with ID 1</li></ul>

0206In an embodiment of the present invention, the resulting image sets can be assigned IDs or names that allow for referencing the image sets later in layout and display set rules. In the above example an image set with ID 1 was defined. If no image matches an image set rule, no such corresponding image set will be created.

0000Image Set Rules: Sorting

0207In an embodiment of the present invention, the order of images within an image set is an important aspect. It determines how images are shown when the user browses through the image set or how images are distributed into the tiles of a tiled viewer. In one embodiment of the present invention, in order to specify image sorting, the image set rules can contain an ordered list of sorting criteria. All images that are matched by a rule are sorted according to those criteria.

0208For example, the following rule collects all images of a current CT study and sorts them according to DICOM series number at first and DICOM instance/image number at second.

0000Image Set Rule 2:

0000<ul id="ul0007" list-style="none"><li id="ul0007-0001" num="0209">IF (Dicom.Modality=‘CT’ and Abstract.PriorIndex=0)</li><li id="ul0007-0002" num="0210">THEN CREATE image set with ID 1 <ul id="ul0008" list-style="none"><li id="ul0008-0001" num="0211">SORTED BY Dicom.SeriesNumber ORDER:=ascending</li><li id="ul0008-0002" num="0212">SORTED BY Dicom.InstanceNumber ORDER:=ascending <br /> Image Set Rules: Splitting </li></ul></li></ul>

0213In an embodiment of the present invention, sorting criteria can be extended by a split flag. With the split flag it is possible to create multiple image sets from a single image set rule. When the value of a sorting criterion with split flag set to true changes, sub-sequent images are automatically inserted into a new image set. The resulting image sets are automatically enumerated by a sub-level ID.

0214For example, the following rule essentially creates image sets that correspond to DICOM series, because all images with different series number will be split into different sets:

0000Image Set Rule 3:

0000<ul id="ul0009" list-style="none"><li id="ul0009-0001" num="0215">IF (Dicom.Modality=‘CT’ and Abstract.PriorIndex=0)</li><li id="ul0009-0002" num="0216">THEN CREATE image set with ID 1.x <ul id="ul0010" list-style="none"><li id="ul0010-0001" num="0217">SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true</li><li id="ul0010-0002" num="0218">SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false</li></ul></li></ul>

0219In applications where a CT has been measured, it can happen that a study contains both a soft-kernel series and a hard kernel series and both series have the same series number. In order to separate the images into different image sets the above rule can be extended by the following:

0000Image Set Rule 4:

0000<ul id="ul0011" list-style="none"><li id="ul0011-0001" num="0220">IF (Dicom.Modality=‘CT’ and Abstract.Priorindex=0)</li><li id="ul0011-0002" num="0221">THEN CREATE image set with ID 1. <ul id="ul0012" list-style="none"><li id="ul0012-0001" num="0222">SORTED BY Condition.CTSoftTissueKernel SPLIT:=true</li><li id="ul0012-0002" num="0223">SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true</li><li id="ul0012-0003" num="0224">SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false</li></ul></li></ul>

0225Here, Condition.CTSoftTissueKernel denotes a user-defined Boolean condition that tests whether an image has a CT soft-tissue kernel. The actual implementation of this condition can for example evaluate the manufacturer (which is encoded in a DICOM parameter). Depending on its value the rule can evaluate further parameters to find out if an image was reconstructed using a soft-tissue kernel or not. Since this Boolean condition was used as a sorting criterion with the split flag set to true, all non-soft-kernel images can be put into an image set with ID 1.1 and all soft-kernel images can be put into an image set with ID 1.2 (unless the image set is further split and IDs like 1.3 or 1.4 are created).

0000Image Set Rules: More Abstract Tags

0226In an embodiment of the present invention, additional abstract tags are used in image set rules. One example is a tag that identifies whether an image has already been put into an image set. In principle, a single image can be put into multiple image sets, but sometimes this should be avoided. This can be achieved by evaluating image set rules in a pre-defined order and introducing an abstract tag AlreadyReferenced.

0227For example, in CT study that has a localizer image and a 3D image stack both stored in one DICOM series, one may want to create an image set, one for the localizer and one for the 3D image stack. Accordingly, the image set rules are defined as follows:

0000Image Set Rule 5 (Localizer):

0000<ul id="ul0013" list-style="none"><li id="ul0013-0001" num="0228">IF (Dicom.Modality=‘CT’ and Condition.IsLocalizer=true)</li><li id="ul0013-0002" num="0229">THEN CREATE image set with ID 1 <ul id="ul0014" list-style="none"><li id="ul0014-0001" num="0230">SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true</li><li id="ul0014-0002" num="0231">SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false <br /> Image Set Rule 6 (Images): </li></ul></li><li id="ul0013-0003" num="0232">IF (Dicom.Modality=‘CT’ and Abstract.AlreadyReferenced=false)</li><li id="ul0013-0004" num="0233">THEN CREATE image set with ID 2 <ul id="ul0015" list-style="none"><li id="ul0015-0001" num="0234">SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true</li><li id="ul0015-0002" num="0235">SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false</li></ul></li></ul>

0236Here Condition.IsLocalizer is a user-defined condition that returns true if an image is a localizer image, and false otherwise. In an embodiment of the present invention, Rule 1 is applied first. Therefore the localizer image is put into a separate image set with ID 1. Next rule 2 is applied. This rule can match for all CT images including the localizer image. However, because AlreadyReferenced=false is specified, the localizer image is skipped and not placed into image set <b>2</b>.

0237In an embodiment of the present invention, the creation of the image sets based on rules is a key component of the efficient rules based display, specifically for the more advanced rendering techniques. For example rules can be used to identify sets of 2D images that together form a 3D volume.

0000Viewer Assignment Rules

0238In another embodiment of the present invention, a display protocol defines multiple viewers, each with one or more tiles, i.e., viewports. To each viewer one or more image sets can be assigned based on Viewer Assignment Rules that are similar to the protocol section rules described herein. Viewer Assignment Rules are defined in the display protocol. The rules determine which image set shall be initially shown in a viewer. In case multiple image sets are assigned to a viewer, the one with the highest score is chosen. Afterwards users may cycle quickly through the remaining image sets using dedicated tools (Previous/Next Image Set), or pick another image set from a special image set menu.

0239Like the other rule types Viewer Assignment Rules contain Boolean expressions of DICOM parameters, abstract tags, or user-defined conditions based on DICOM parameters, or abstract tags. In many cases it is sufficient to specify the image sets to be assigned to a viewer by their image set ID instead of evaluating the underlying DICOM parameters and abstract tags again. Therefore, the image set ID is simply set as a separate abstract tag. In the following example the two rules load image sets with the IDs 1 and 2 into a viewer, but assign ID 1 a higher score so that this image set is initially visible (provided such an image set exists):

0000Viewer Assignment Rule 1:

0000<ul id="ul0016" list-style="none"><li id="ul0016-0001" num="0240">IF (EXISTS ImageSet[1])</li><li id="ul0016-0002" num="0241">THEN Viewport[0].AddImageSet(ID=1, score=10) <br /> Viewer Assignment Rule 2: </li><li id="ul0016-0003" num="0242">IF (EXISTS ImageSet[2])</li><li id="ul0016-0004" num="0243">THEN</li><li id="ul0016-0005" num="0244">Viewport[0].AddImageSet(ID=2, score=5)</li></ul>

0245In an embodiment of the present invention, viewer assignment rules are applied to image sets. Thus there is a possible conflict regarding ambiguous image-level and series-level tags. This conflict is resolved in the same way as described herein in the Normalization of DICOM Parameters section. This means that values of DICOM parameters, but also abstract tags, are automatically taken from some reference image. Alternatively, for all DICOM parameters a list of distinct values occurring in all images of the image set can be used in an assignment rule.

0000Style Rules

0246In one embodiment of the present invention, there is a final set of rules that specify the rendering style and other rendering parameters to be used when showing a particular image set. For example, for a CT Angiogram study, often a volume rendering style display (VRT) is desired, whereas for a study looking for lung nodules a maximum intensity projection (MIP) of 20 mm slabs may be desired. Style rules, that can be user specific, allow driving that automatically. The rules can use the same parameters as discussed above, as well as the existence or absence of certain image sets.

0247In one embodiment of the present invention, the system uses a global, ordered list of style rules that is evaluated independently for each viewer and each image set loaded into a viewer. An abstract tag DisplaySetID is provided that allows formulating style rules for a specific viewer or group of viewers. p Parameters driven by Style Rules include the following: <ul id="ul0017" list-style="none"><li id="ul0017-0001" num="0248">i) Rendering style (can be 2D, oblique, curved, MIP slab, 3D MIP, VRT, shaded VRT, etc.);</li><li id="ul0017-0002" num="0249">ii) Image alignment (left, right, top, bottom, centered);</li><li id="ul0017-0003" num="0250">iii) Inverse display (black on white versus white on black);</li><li id="ul0017-0004" num="0251">iv) Colormap or transfer function;</li><li id="ul0017-0005" num="0252">v) Window/level (data window);</li><li id="ul0017-0006" num="0253">vi) Slice thickness;</li><li id="ul0017-0007" num="0254">vii) Zoom factor;</li><li id="ul0017-0008" num="0255">viii) Camera position and orientation; and</li><li id="ul0017-0009" num="0256">ix) Labels/OverlayDisplay of labels, annotations and other overlay elements.</li></ul>

0257The following is an example of a style rule that activates inverse 3D MIP rendering in all viewers with a DisplaySetID between 101 and 104, provided a PET data set is loaded into those viewers (modality PT, i.e., positron emission tomography). Also, an automatic window/level setting is used that is computed from the histogram of the image set (the 2% lowest values are all mapped to white, and the 2% highest values are all mapped to black):

0000Style Rule 1:

0000<ul id="ul0018" list-style="none"><li id="ul0018-0001" num="0258">IF (Abstract.DisplaySetID >100 and <ul id="ul0019" list-style="none"><li id="ul0019-0001" num="0259">Abstract.DisplaySetID <105 and</li><li id="ul0019-0002" num="0260">Dicom.Modality=‘PT’)</li></ul></li><li id="ul0018-0002" num="0261">THEN SET <ul id="ul0020" list-style="none"><li id="ul0020-0001" num="0262">RenderingStyle:=‘3D MIP’</li><li id="ul0020-0002" num="0263">Inverse:=true</li><li id="ul0020-0003" num="0264">DataWindow:=‘2% 98%’</li></ul></li></ul>

0265The following is another example of a different style rule that always causes the image set with image set ID 200 to be displayed in MPR mode using 20 mm thick slices, with a window/level as specified in the DICOM parameters, and with a zoom factor so that the whole viewer window is filled out. The rule is:

0000Style Rule 2:

0000<ul id="ul0021" list-style="none"><li id="ul0021-0001" num="0266">IF (Abstract.ImageSetID=200)</li><li id="ul0021-0002" num="0267">THEN SET <ul id="ul0022" list-style="none"><li id="ul0022-0001" num="0268">RenderingStyle:=‘MPR’</li><li id="ul0022-0002" num="0269">SliceThickness:=‘20’</li><li id="ul0022-0003" num="0270">DataWindow:=‘DICOM1’</li><li id="ul0022-0004" num="0271">ZoomFactor:=‘FitToWindow’ <br /> Summary of Rule Types </li></ul></li></ul>

0272Table I summarizes all types of rules that are applied in the rule-base display system:

0273<tables id="TABLE-US-00001" num="00001"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="1" colwidth="84pt" align="left" /><colspec colname="2" colwidth="35pt" align="left" /><colspec colname="3" colwidth="42pt" align="left" /><colspec colname="4" colwidth="56pt" align="left" /><thead><row><entry namest="1" nameend="4" rowsep="1">TABLE I</entry></row><row><entry namest="1" nameend="4" align="center" rowsep="1" /></row><row><entry /><entry /><entry>Normalized</entry><entry /></row><row><entry>Rule Type</entry><entry>Applies to</entry><entry>Parameters</entry><entry>Defined where</entry></row><row><entry namest="1" nameend="4" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>Study Selection Rule</entry><entry>Studies</entry><entry>yes</entry><entry>globally</entry></row><row><entry>Protocol Selection Rule</entry><entry>Studies</entry><entry>yes</entry><entry>globally</entry></row><row><entry>Image Set Rule</entry><entry>Images</entry><entry>not required</entry><entry>protocol</entry></row><row><entry>Viewer Assignment Rule</entry><entry>Image Sets</entry><entry>yes</entry><entry>globally, protocol</entry></row><row><entry>Style Rule</entry><entry>Image Sets</entry><entry>yes</entry><entry>globally, protocol</entry></row><row><entry namest="1" nameend="4" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> Example Shown in <figref idref="DRAWINGS">FIG. 11</figref>

0274An example of how these aspects can be combined is shown in <figref idref="DRAWINGS">FIG. 11</figref>. In the example the user has selected a CT examination of the abdomen. The following rules have been used to determine that a recent X-Ray of the chest is relevant and shall be displayed as well: <ul id="ul0023" list-style="none"><li id="ul0023-0001" num="0275">IF (Primary.Dicom.BodyPartExamined=‘ABDOMEN’ and Primary.Dicom.Modality=‘CT’) THEN SELECT other studies for loading WHERE (Other.Dicom. BodyPartExamined=‘ABDOMEN’ OR Other.Dicom. BodyPartExamined=‘CHEST’) and (Other.Dicom.Modality=‘CR’ or Other.Dicom.Modality=‘CT’) AND Other.RelativeStudyAge &lt;‘90 days’</li></ul>

0276From this rule, a hanging protocol can be selected. In the example the protocol selection rules determine that the CT study is a thin slice CT study (i.e. that it has image series that form a 3D volume with sufficient resolution in all directions to display volume rendering or non-axial slices in a meaningful way). Furthermore the example rule determines that this is a study with enhanced vasculature, by looking for the key words ‘contrast’ or ‘angio’ in the study description. The display protocol selection rule that applies here and select the protocol CTThinSliceVesselWithPrior can read <ul id="ul0024" list-style="none"><li id="ul0024-0001" num="0277">IF (Primary.Dicom.BodyPartExamined=‘ABDOMEN’ and Primary.Dicom.Modality=‘CT’ and Primary.Abstract.HasThinSliceVolumes and (Primary.Dicom.StudyDescription containsAnyOf ‘contrast, angio’ and exists Other1 THEN SELECT ‘CTThinSliceVesselWithPrior’ with score=10</li></ul>

0278From this image sets are generated using Image Set Rules: <ul id="ul0025" list-style="none"><li id="ul0025-0001" num="0279">IF (Dicom.Modality=‘CT’ and Abstract.Priorindex=0 and</li><li id="ul0025-0002" num="0280">Condition.IsPartOfThinSliceVolume and Condition.CTSoftTissueKernel)</li><li id="ul0025-0003" num="0281">THEN CREATE image set with ID 1.x <ul id="ul0026" list-style="none"><li id="ul0026-0001" num="0282">SORTED BY Abstract.NumberOfSlicesInVolume ORDER:=descending SPLIT:=true</li><li id="ul0026-0002" num="0283">SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true</li><li id="ul0026-0003" num="0284">SORTED BY Dicom.Abstract.VolumeIndex ORDER:=ascending SPLIT:=true</li><li id="ul0026-0004" num="0285">SORTED BY Dicom.Abstract.SlicePosition ORDER:=ascending SPLIT:=false</li></ul></li></ul>

0286This rule will actually form sets from images that contain images that are part of a ThinSliceVolume and that have been reconstructed with a ‘soft tissue’ kernel. Given the protocol selection rule has specifically matched for just CT studies, the conditions Dicom.Modality=‘CT’ and Abstract.Priorindex=0 are actually redundant, but could be useful if a different selection rule was used.

0287The images will first be sorted by the size of the volume of which they are part (Abstract.NumberOfSlicesInVolume), then by DICOM series. The split parameter in this case will ensure that an image set contains images from on series only. A DICOM series can sometimes contain multiple non-consecutive volumes. The abstract tag VolumeIndex will then indicate for each image, which of those volumes it is part of. If a series contains only one volume, then this will be ‘1’ for all images in the series. The split=true in this part of the rule would result in a separate image set for each of those volumes. Finally, within each volume, the images are ordered by slice position, but not split. This way we end up with one image set for each soft kernel thin slice volume, the largest volume being the first image set (ID 1.1). This ID will be used further in subsequent rules.

0288The rule to form an image set from any CR prior study in this example is much simpler: <ul id="ul0027" list-style="none"><li id="ul0027-0001" num="0289">IF (Dicom.Modality=‘CR’ and Abstract.Priorindex=1)</li><li id="ul0027-0002" num="0290">THEN CREATE image set with ID 10 <ul id="ul0028" list-style="none"><li id="ul0028-0001" num="0291">SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=false</li><li id="ul0028-0002" num="0292">SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false</li></ul></li></ul>

0293This creates one image set with ID=10 containing all images for the first prior study, if that is a CR.

0294In practice, additional rules, such as Image Set Rule 5 and 6 (see above) will be used to collect the remaining images of the primary Study <b>1105</b>. The remaining images are not shown in the layout depicted in the example <figref idref="DRAWINGS">FIG. 11</figref>.

0295The Display Protocol <b>1145</b> contains multiple layouts. The one shown in <figref idref="DRAWINGS">FIG. 11</figref> is defined as follows:

0296<tables id="TABLE-US-00002" num="00002"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="42pt" align="left" /><colspec colname="2" colwidth="175pt" align="left" /><thead><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry> </entry><entry>DEFINE Layout { </entry></row><row><entry /><entry>ID=‘Layout5’;</entry></row><row><entry /><entry>NAME=‘+PlainFilm’</entry></row><row><entry /><entry>Viewports {</entry></row><row><entry /><entry> { ID=50, Geometry=‘(0,0)-(0.25,0.5)’},</entry></row><row><entry /><entry> { ID=51, Geometry=‘(0.25,0)-(0.5,0.5)’},</entry></row><row><entry /><entry> { ID=52, Geometry=‘(0,0.5)-(0.25,1)’},</entry></row><row><entry /><entry> { ID=53, Geometry=‘(0.25,0.5)-(0. 5,0.5)’},</entry></row><row><entry /><entry> { ID=54, Geometry=‘(0.5,0)-(1,1)’, Style=‘2D’}</entry></row><row><entry /><entry> }</entry></row><row><entry /><entry>}</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0297In this example the geometry is defined in a coordinate system having the origin in the upper left corner of the screen with the x axis pointing to the right and the y axis pointing down. Please note how parameters of the viewers can be set in the layout definition. Parameters can also be set or overridden in the assignment and style rules, as will be explained next.

0298In this example, viewer assignment and style rules are as follows:

0299<tables id="TABLE-US-00003" num="00003"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="35pt" align="left" /><colspec colname="2" colwidth="182pt" align="left" /><thead><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry> </entry><entry>IF ImageSetExists (1.1) and ImageSetExists(10) THEN</entry></row><row><entry /><entry>SHOW_LAYOUT Layout5 WITH</entry></row><row><entry /><entry> Viewport[0].AddImageSet(1.1)</entry></row><row><entry /><entry> Viewport [0].Style,=‘VRT(diffuse)’</entry></row><row><entry /><entry> Viewport [0].Colormap=‘CTAngioSoftTissue’</entry></row><row><entry /><entry> Viewport [1,2,3].AddImageSet(1.1)</entry></row><row><entry /><entry> Viewport [1,2,3].Style,=‘MPR’</entry></row><row><entry /><entry> Viewport [1,2,3].DataWindow,=‘DICOM1’</entry></row><row><entry /><entry> Viewport [1].orientation=‘axial’</entry></row><row><entry /><entry> Viewport [2].orientation=‘sagittal’</entry></row><row><entry /><entry> Viewport [3].orientation=‘coronal’</entry></row><row><entry /><entry> Viewport [4].AddImageSet(10)</entry></row><row><entry /><entry> IF (ImageSet[10].Dicom.Columns > 1024) THEN</entry></row><row><entry /><entry> Viewport[4].Zoom=‘FitToWindow’</entry></row><row><entry /><entry> ELSE</entry></row><row><entry /><entry> Viewport[4].Zoom=‘1:1’</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>

0300In this particular example, the rule to select the layout is rather simple: It is shown if the two image sets used exist. This is because the criteria to construct these images sets have been rather specific. As will be appreciated, the proposed system gives this type of flexibility.

Aspects of the Invention

0301Some aspects of this invention include methods of displaying one or more Sets of Images comprising the steps of: a. selecting a primary Study; b. selecting one or more Study Selection Parameters based on the primary Study; c. selecting one or more Study Selection Rules based on the one or more Study Selection Parameters; d. selecting one or more Sets of Images from a plurality of images based on the one or more Study Selection Rules; e. selecting one or more Display Protocol Selection Parameters based on the one or more Sets of Images selected; f. selecting one or more Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters; g. selecting one or more Display Parameters using the one or more Display Protocol Selection Rules; and h. displaying the one or more Sets of Images according to the Display Parameters.

0302Additional aspects include methods one or more Display Parameter are selected from the group consisting of Image Set Selection Parameters and View and Viewport Selection Parameters.

0303Further aspects include methods where the one or more Display Parameters are selected from the group consisting of Image Set Selection Rules, View and Viewport Selection Rules, and Display Protocol Selection Rules.

0304Yet further aspects include methods where the step of identifying one or more Image Set Selection Rules is based on the one or more Image Set Selection Parameters.

0305Still further aspects include methods where the step of selecting one or more Viewpoint Selection Rules is based on one or more View and Viewport Selection Parameters.

0306Other aspects include methods where the step of displaying the one or more Sets of Images is based on one or more Display Protocol Selection Rules, one or more Image Set Selection Rules, and one or more View and Viewport Selection Rules.

0307Still other aspects include methods where one or more of the Study Selection Parameters are selected from the group consisting of DICOM parameters and Abstract Tags.

0308Other aspects include methods where one or more of the Display Protocol Selection Parameters are selected from the group consisting of DICOM parameters and Abstract Tags.

0309Additional aspects include methods where one or more of the Image Set Selection Parameters are selected from the group consisting of DICOM parameters and Abstract Tags.

0310Further aspects include methods where one or more of the View and Viewport Selection Parameters are selected from the group consisting of DICOM parameters and Abstract Tags.

0311More aspects include methods where one or more Study Selection Parameters are derived from a single reference image.

0312Still more aspects include methods where one or more Study Selection Parameters are derived from a single reference image DICOM Parameters.

0313Yet other aspects include methods where one or more Display Protocol Selection Parameters are derived using a list of all values of a DICOM parameter occurring in any of the one or more Sets of Images.

0314Alternative aspects include methods where the one or more View and Viewport Selection Rules contain protocols for one or more Viewports displaying images as 2D.

0315Other alternative aspects include methods where the one or more View and Viewport Selection Rules contain protocols for one or more Viewports displaying images in a 3D rendering mode.

0316Further alternative aspects include methods where one or more Study Selection Parameters include one or more Abstract Tags selected from the group consisting of RelativeStudyAge, PriorIndex. NumImages, NumSeries, Num3DVolumes, Num4DSequences and HasReport.

0317In other aspects, this invention includes methods where one or more View and Viewport Selection Rules include one or more Abstract Tags selected from the group consisting of Image Sets to be displayed, Rendering Style, Additional image sets for image fusion, Image Alignment, Colormap/Transfer Function, Slice Thickness, Zoom Factor, Camera position, Camera orientation and Labels/Overlay elements.

0318In still other aspects, this invention comprises receiving one or more Sets of Images based on the Study Selection Rules, selecting one or more Image Set Selection Parameters, selecting one or more Image Set Selection Rules based on the one or more Image Set Selection Parameters and displaying the one or more Sets of Images based on the Display Protocol Selection Rules and the Image Set Selection Rules.

0319In another aspect, this invention comprises selecting one or more Study Selection Parameters, selecting or more Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more Sets of Images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more Sets of Images selected, selecting one or more Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters and displaying the one or more Sets of Images based on the Display Protocol Selection Rules.

0320Another aspect of this invention comprises selecting one or more Study Selection Parameters, selecting Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, selecting Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, selecting Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, selecting View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0321Other aspects of the invention include methods where the Study Selection Rule is: IF (Primary.Dicom.BodyPartExamined=‘CHEST’ and Primary.Dicom.Modality=‘CR’) THEN SELECT other studies for loading WHERE (Other.Dicom. BodyPartExamined=‘CHEST’ and (Other.Dicom.Modality=‘CR’ or Other.Dicom.Modality=‘CT’)).

0322In another aspect, this invention includes methods where the Study Selection Rule is: IF (Primary.Dicom.BodyPartExamined=‘CHEST’ and Primary.DicomList.Modality contains ‘CR’) THEN SELECT other studies for loading WHERE (Other.Dicom.BodyPartExamined=‘CHEST’ and (Other.DicomList.Modality contains ‘CR’ or Other.DicomList.Modality contains ‘CT’)).

0323In other aspects, this invention includes methods where the Study Selection Rule is IF (Primary.Dicom.Modality=‘MG’ THEN SELECT other studies for loading WHERE (Other.Dicom.Modality=‘MG’ and Other.Abstract.PriorIndex &lt;=3 and Other.Abstract.RelativeStudyAge &lt;5*365).

0324In yet another aspect, this invention includes methods where the Protocol Selection Rule is IF (Primary.Dicom.BodyPartExamined=‘ABDOMEN’ and Primary.Dicom.Modality=‘CT’ and Exists(Other1) and Other1.Dicom.Modality=‘PET’) THEN SELECT ‘StandardPetCTProtocol1’ with score=10.

0325In aspects of the invention, methods include an Image Set Rule IF (Dicom.Modality=‘CT’ and Abstract.Priorindex=0) THEN CREATE image set with ID 1.

0326Additionally, other aspects include methods where the Image Set Rule is: IF (Dicom.Modality=‘CT’ and Abstract.Priorindex=0) THEN CREATE image set with ID 1, SORTED BY Dicom.SeriesNumber ORDER:=ascending, SORTED BY Dicom.InstanceNumber ORDER:=ascending.

0327Still other aspects include methods where the Image Set Rule is IF (Dicom.Modality=‘CT’ and Abstract.Priorindex=0) THEN CREATE image set with ID 1.x, SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true, SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

0328Moreover, other aspects include methods where the Image Set Rule is IF (Dicom.Modality=‘CT’ and Abstract.Priorindex=0) THEN CREATE image set with ID 1.x, SORTED BY Condition.CTSoftTissueKernel SPLIT:=true, SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true, SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

0329Yet other aspects include methods where the Image Set Rule (Localizer) is IF (Dicom.Modality=‘CT’ and Condition.IsLocalizer=true) THEN CREATE image set with ID 1, SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true, SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

0330Other aspects of the methods of this invention include an Image Set Rule (Images) IF (Dicom.Modality=‘CT’ and Abstract.AlreadyReferenced=false) THEN CREATE image set with ID 2, SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true, SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

0331Yet other aspects of the methods of this invention include using Image Set Rule (Images), IF (Dicom.Modality=‘CT’ and Abstract.AlreadyReferenced=false) THEN CREATE image set with ID 2, SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true, SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

0332Additionally, other aspects include methods where the Display Parameters include Viewer Assignment Rule IF (Abstract.ImageSetID=1), THEN SELECT image set with score=10.

0333Yet further aspects include methods where the Display Parameters include a Viewer Assignment Rule IF (Abstract.ImageSetID=2) THEN SELECT image set with score=5.

0334Additional aspects include methods further comprising a Viewer Assignment Rule IF (Abstract.ImageSetID=2) THEN SELECT image set with score=5.

0335In other aspects of this invention, methods include one or more Study Selection Rules comprising one or more Abstract Tags selected from the group consisting of RelativeStudyAge indicates relative age of Study in days compared to primary Study <b>1105</b>, PriorIndex indicates an index that enumerates all other studies from youngest to oldest, NumImages indicates number of images in Study, NumSeries indicated number of image series in Study, Num3DVolumes indicates number of 3D volumes in Study, Num4DSequences indicates number of 4D sequences in Study (e.g. Cardiac CT), and HasReport indicates a flag that indicates if a report is available for a Study, IsThinSliceVolume.

0336Aspects of methods also include a step of displaying including use of an Abstract Tag DisplaySetID.

0337Other aspects of methods include Abstract Tag DisplaySetID having a Style Rule selected from the group consisting of Rendering style (can be 2D, oblique, curved, MIP slab, 3D MIP, VRT, shaded VRT, etc.), Image alignment (left, right, top, bottom, centered), Inverse display (black on white versus white on black), Colormap or transfer function, Window/level (data window), Slice thickness, Zoom factor, Camera position and orientation; and Labels/OverlayDisplay of labels, annotations and other overlay elements.

0338Still other methods include steps where the Style Rule is IF (Abstract.DisplaySetID >100 and Abstract.DisplaySetID <105 and Dicom.Modality=‘PT’) THEN SET RenderingStyle:=‘3D MIP’, Inverse:=true, DataWindow:=‘2% 98%’.

0339Other aspects of methods include use of a Style Rule IF (Abstract.ImageSetID=200) THEN SET RenderingStyle:=‘MPR’, SliceThickness:=‘20’, DataWindow:=‘DICOM1’, and ZoomFactor:=‘FitToWindow’,

0340Another aspect of the present invention is a method of displaying one or more Sets of Images comprises selecting one or more Study Selection Parameters, identifying one or more Study Selection Rules based on the one or more Study Selection Parameters, selecting one or more Sets of Images from a plurality of images based on the one or more Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more Sets of Images selected, identifying one or more Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, using the one or more Display Protocol Selection Rules to select one or more Display Parameters and displaying the one or more Sets of Images according to the Display Parameters.

0341Still other aspects of methods of displaying one or more Sets of Images comprising the steps of selecting one or more Study Selection Parameters, selecting Study Selection Rules based on the one or more Study Selection Parameters, selecting one or more Sets of Images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more Sets of Images selected, selecting Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, selecting Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, selecting View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more Sets of Images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0342In systems of this invention, aspects include system for displaying one or more Sets of Images comprises selecting one or more Study Selection Parameters, selecting one or more Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more Sets of Images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more Sets of Images selected, selecting Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, selecting one or more Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, selecting View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and graphics resources for displaying the one or more Sets of Images based on one or more of Display Protocol Selection Rules, Image Set Selection Rules, the View and Viewport Selection Rules, and Viewer Assignment Rules.

0343Additional system aspects include Sets of Images comprises one or more digital data processors for carrying out the steps according to any of the above described methods aspects and graphics resources for displaying the one or more Sets of Images.

0344In an embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0345In another embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying a Study Selection Rule based on the one or more Study Selection Parameters, where the Study Selection Rule is: IF (Primary.Dicom.BodyPartExamined=‘CHEST’ and Primary.Dicom.Modality=‘CR’) THEN SELECT other studies for loading WHERE (Other.Dicom. BodyPartExamined=‘CHEST’ and (Other.Dicom.Modality=‘CR’ or Other.Dicom.Modality=‘CT’)), receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters. selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0346In an alternative embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying a Study Selection Rule based on the one or more Study Selection Parameters, where the Study Selection Rule is IF (Primary.Dicom.BodyPartExamined=‘CHEST’ and Primary.DicomList.Modality contains ‘CR’) THEN SELECT other studies for loading WHERE (Other.Dicom.BodyPartExamined=‘CHEST’ and (Other.DicomList.Modality contains ‘CR’ or Other.DicomList.Modality contains ‘CT’)), receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0347In another alternative embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying a Study Selection Rule based on the one or more Study Selection Parameters, where the Study Selection Rule is IF (Primary.Dicom.Modality=‘MG’ THEN SELECT other studies for loading WHERE (Other.Dicom.Modality=‘MG’ and Other.Abstract.PriorIndex &lt;=3 and Other.Abstract.RelativeStudyAge &lt;5*365), receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters; selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0348In an embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying a Display Protocol Selection Rule based on the one or more Display Protocol Selection Parameters, where the Display Protocol Selection Rule is IF (Primary.Dicom.BodyPartExamined=‘ABDOMEN’ and Primary.Dicom.Modality=‘CT’ and Exists(Other1) and Other1.Dicom.Modality=‘PET’) THEN SELECT ‘StandardPetCTProtocol1’ with score=10, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0349In a further embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying an Image Set Selection Rule based on the one or more Image Set Selection Parameters, where the Image Set Selection Rule (Localizer) is IF (Dicom.Modality=‘CT’ and Abstract.AlreadyReferenced=false) THEN CREATE image set with ID 2, SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true, SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false; selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0350In another embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, where the one or more Display Protocol Selection Parameters include Viewer Assignment Rule IF (Abstract.ImageSetID=1) THEN SELECT image set with score=10; identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters; identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0351In an additional embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, where the one or more Display Protocol Selection Parameters include Viewer Assignment Rule IF (Abstract.ImageSetID=1) THEN SELECT image set with score=10, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters; identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0352In a further embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, where the one or more Display Protocol Selection Parameters include Viewer Assignment Rule IF (Abstract.ImageSetID=2) THEN SELECT image set with score=5, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters; selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0353In a still further embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters, displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules; and selecting Viewer Assignment Rule IF (Abstract.ImageSetID=2) THEN SELECT image set with score=5.

0354In an embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, where the one or more Study Selection Rules comprise one or more Abstract Tags selected from the group consisting of RelativeStudyAge indicates relative age of Study in days compared to primary Study, PriorIndex indicates an index that enumerates all other studies from youngest to oldest, NumImages indicates number of images in Study, NumSeries indicated number of image series in Study, Num3DVolumes indicates number of 3D volumes in Study, Num4DSequences indicates number of 4D sequences in Study (e.g. Cardiac CT) and HasReport indicates a flag that indicates if a report is available for a Study; receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules.

0355In another embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules, where the step of displaying includes an Abstract Tag DisplaySetID.

0356In another embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules, where the step of displaying includes an Abstract Tag DisplaySetID, where the Abstract Tag DisplaySetID has a Style Rule selected from the group consisting of Rendering style (can be 2D, oblique, curved, MIP slab, 3D MIP, VRT, shaded VRT, etc.), Image alignment (left, right, top, bottom, centered), Inverse display (black on white versus white on black), Colormap or transfer function, Window/level (data window), Slice thickness, Zoom factor, Camera position and orientation and Labels/OverlayDisplay of labels, annotations and other overlay elements.

0357In a further embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters an displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules, where the step of displaying includes an Abstract Tag DisplaySetID, where the Abstract Tag DisplaySetID has a Style Rule selected from the group consisting of Rendering style (can be 2D, oblique, curved, MIP slab, 3D MIP, VRT, shaded VRT, etc.), Image alignment (left, right, top, bottom, centered), Inverse display (black on white versus white on black), Colormap or transfer function, Window/level (data window), Slice thickness, Zoom factor, Camera position and orientation and Labels/OverlayDisplay of labels, annotations and other overlay elements; where the Style Rule is IF (Abstract.DisplaySetID >100 and Abstract.DisplaySetID <105 and Dicom.Modality=‘PT’) THEN SET RenderingStyle:=‘3D MIP’, Inverse:=true and DataWindow:=‘2% 98%’.

0358In a still further embodiment of the invention, a method of displaying images comprises selecting one or more Study Selection Parameters, identifying Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more images selected, identifying Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Image Set Selection Parameters, identifying Image Set Selection Rules based on the one or more Image Set Selection Parameters, selecting one or more View and Viewport Selection Parameters, identifying View and Viewport Selection Rules based on the one or more View and Viewport Selection Parameters and displaying the one or more images based on the Display Protocol Selection Rules, the Image Set Selection Rules and the View and Viewport Selection Rules, where the step of displaying includes an Abstract Tag DisplaySetID, where the Abstract Tag DisplaySetID has a Style Rule selected from the group consisting of Rendering style (can be 2D, oblique, curved, MIP slab, 3D MIP, VRT, shaded VRT, etc.), Image alignment (left, right, top, bottom, centered), Inverse display (black on white versus white on black), Colormap or transfer function, Window/level (data window), Slice thickness, Zoom factor, Camera position and orientation and Labels/OverlayDisplay of labels, annotations and other overlay elements; where the Style Rule is IF (Abstract.ImageSetID=200) THEN SET RenderingStyle:=‘MPR’, SliceThickness:=‘20’, DataWindow:=‘DICOM1’ and ZoomFactor:=‘FitToWindow’.

0359In an embodiment of the invention, a method of displaying one or more Sets of Images comprises selecting one or more Study Selection Parameters, selecting or more Study Selection Rules based on the one or more Study Selection Parameters, receiving one or more Sets of Images based on the Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more Sets of Images selected, selecting one or more Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters and displaying the one or more Sets of Images based on the Display Protocol Selection Rules.

0360In a further embodiment of the invention, a method of displaying one or more Sets of Images comprises selecting a primary Study, selecting one or more Study Selection Parameters based on the primary Study, selecting one or more Study Selection Rules based on the one or more Study Selection Parameters, selecting one or more Sets of Images from a plurality of images based on the one or more Study Selection Rules, selecting one or more Display Protocol Selection Parameters based on the one or more Sets of Images selected, selecting one or more Display Protocol Selection Rules based on the one or more Display Protocol Selection Parameters, selecting one or more Display Parameters using the one or more Display Protocol Selection Rules, where the one or more Display Parameter are selected from the group consisting of Image Set Selection Parameters and View and Viewport Selection Parameters and displaying the one or more Sets of Images according to the Display Parameters.

0361In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules.

0362In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one study from the plurality of Image Sets is a two dimensional image.

0363In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one study from the plurality of Image Sets is a three dimensional (3D) image displayed with a 3D rendering style.

0364In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays an oblique cross section through a volumetric image set.

0365In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a maximum intensity projection of an image set.

0366In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a post processed rendering of an image set.

0367In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a thick slab image.

0368In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a volume rendered image.

0369In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a three dimensional image.

0370In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where one or more Study Selection Rules used DICOM parameters and Abstract Tags derived from a single reference image.

0371In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where the primary Study selected is a single reference image.

0372In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where the primary Study selected is a single reference image, where one or more Study Selection Rules are derived from the single reference image DICOM Parameters.

0373In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where the one or more Viewport Assignment Rules contain protocols for displaying two dimensional images in the one or more Viewports.

0374In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where the one or more Abstract Tags are selected from the group consisting of RelativeStudyAge, PriorIndex. NumImages, NumSeries, Num3DVolumes, Num4DSequences and HasReport.

0375In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where the one or more Viewport Assignment Rules include one or more Abstract Tags selected from the group consisting of Image Sets to be displayed, Rendering Style, Additional image sets for image fusion, Image Alignment, Colormap/Transfer Function, Slice Thickness, Zoom Factor, Camera position, Camera orientation and Labels/Overlay elements.

0376In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where the one or more Image Set Rules are selected from selection, sorting, and breaking rules, where the one or more Image Set Rules are Boolean expressions that contain parameters selected from the group consisting of DICOM parameters, abstract tags, and used-defined functions.

0377In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where in order to specify image sorting, the Image Set Rules contain an ordered list of sorting criteria.

0378In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where in order to specify image sorting, the Image Set Rules contain an ordered list of sorting criteria, where a split flag is used in order to specify image splitting.

0379In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where Abstract Tags are used in Image Set Rules.

0380In an embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises a processor capable of selecting a primary Study from a plurality of studies, one or more digital data processors capable of carrying out the steps including applying one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the plurality of Image Sets based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where Abstract Tags are used in Image Set Rules, where an Abstract Tag identifies whether an image has already been placed into an Image Set.

0381In an alternative embodiment of the invention, a system of displaying one or more Sets of Images from a plurality of images comprises selecting one or more studies from a plurality of studies, one or more digital data processors for carrying out the steps including applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and Abstract Tags from the plurality of studies, applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of studies, applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and graphics resources for displaying the one or more Image Sets based on one or more of the Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a three dimensional image.

0382In another alternative embodiment of the invention, a method of displaying one or more Sets of Images from a plurality of images comprises selecting a primary Study from a plurality of studies, executing on a server digital data processor a render server program which applies one or more of one or more Study Selection Rules, one or more Protocol Selection Rule, one or more Image Set Rules, one or more Viewport Assignment Rules, and one or more Style Rules to display the one or more Sets of Images including the steps of applying the one or more Study Selection Rules to generate a plurality of second studies based on one or more DICOM parameters and one or more Abstract Tags from the primary Study and one or more DICOM parameters and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study, applying the one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on one or more DICOM parameters and one or more Abstract Tags from the plurality of second studies, applying the one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying the one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying the one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and displaying the one or more Sets of Images in one or more Viewports based on one or more of the Protocol Selection Rule, the Image Set Rule, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a volume rendered image.

0383In a further embodiment of the invention, a method of displaying one or more Sets of Images from a plurality of images comprises selecting a primary Study from a plurality of studies, executing on a server digital data processor a render server program which applies one or more of one or more Study selection Rules, one or more Protocol Selection Rules, one or more Image Set Rules, one or more Viewport Assignment Rules, and one or more Style Rules to display the one or more Sets of Images including the steps of applying the one or more Study Selection Rules to generate a plurality of second studies based on DICOM parameter BodyPartExamined, DICOM parameter Modality, DICOM parameter RelativeStudyAge and Abstract Tag RelativeStudyAge, Abstract Tag PriorIndex, Abstract Tag NumImages, Abstract Tag NumSeries, Abstract Tag Num3DVolumes, Abstract Tag Num4DSequences and Abstract Tag HasReport from the plurality of studies, where the plurality of second studies include the primary Study, applying the one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on DICOM parameter BodyPartExamined, DICOM parameter Modality, DICOM parameter HasThisSliceVolumes, DICOM parameter StudyDescription and Abstract Tags from the plurality of second studies, applying the one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying the one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying the one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and displaying the one or more Sets of Images in one or more Viewports based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a post processed rendering of an image set.

0384In a further embodiment of the invention, a method of displaying one or more Sets of Images from a plurality of images comprises selecting a primary Study from a plurality of studies, executing on a server digital data processor a render server program which applies one or more of one or more Study selection Rules, one or more Protocol Selection Rules, one or more Image Set Rules, one or more Viewport Assignment Rules, and one or more Style Rules to display the one or more Sets of Images including the steps of applying the one or more Study Selection Rules to generate a plurality of second studies based on DICOM parameter BodyPartExamined, DICOM parameter Modality, DICOM parameter RelativeStudyAge and Abstract Tag RelativeStudyAge, Abstract Tag PriorIndex, Abstract Tag NumImages, Abstract Tag NumSeries, Abstract Tag Num3DVolumes, Abstract Tag Num4DSequences and Abstract Tag HasReport from the plurality of studies, where the plurality of second studies include the primary Study, applying the one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on DICOM parameter BodyPartExamined, DICOM parameter Modality, DICOM parameter HasThisSliceVolumes, DICOM parameter StudyDescription and Abstract Tags from the plurality of second studies, applying the one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies, applying the one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, applying the one or more Style Rules to define a rendering style and rendering parameters of the one or more Viewports and displaying the one or more Sets of Images in one or more Viewports based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, the one or more Viewport Assignment Rules, and the one or more Style Rules, where at least one of the one or more Viewports displays a post processed rendering of an image set, where the step of displaying is carried out on a client display device.

0385In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a Study from the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a volumetric image reconstructed from the Study, the render server defining at least three viewing directions for the Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server generating at least three projection images from the volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the server selecting three or more images of the Study from the at least three projection images and the server sending the three or more images to the remote computer.

0386In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a Study from the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a volumetric image reconstructed from the Study, the render server defining at least three viewing directions for the Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server generating at least three projection images from the volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the server selecting three or more images of the Study from the at least three projection images and the server sending the three or more images to the remote computer, further comprising displaying a video comprising the three or more images.

0387In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images and one or both the render and the render program sending the first Set of Images to the remote computer.

0388In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer.

0389In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images where one or more Protocol Selection Rules are used to select a viewing direction that improves identification of a first projection image, identification of a microcalcification, identification of an obstruction, resolution of two microcalcifications, resolution of a microcalcification and an obstruction, resolution of two obstructions, direct comparison of a microcalcification and direct comparison of an obstruction, and one or both the render and the render program sending the first Set of Images to the remote computer.

0390In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports, where the first Study is a Digital Breast Tomosynthesis scan and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, where the second Study is a Digital Breast Tomosynthesis scan corresponding to the first Study, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer.

0391In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports, where the first Study is a first volumetric image reconstructed from a Digital Breast Tomosynthesis scan and one or more of one or more Study Selection Rules based on the first Study to one or both select and generate a second Study of the plurality of medical diagnostic reports, where the second Study is a second volumetric image reconstructed Digital Breast Tomosynthesis scan, where the second Study is a corresponding tissue to the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer.

0392In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer, where the first Set of Images are displayed as a video.

0393In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer, where the first Set of Images are displayed as a video, where the video displays a dynamic comparison.

0394In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, where the viewing directions are selected according to a periodic continuous mathematical function, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer.

0395In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, where the viewing directions are selected according to a periodic continuous mathematical function, where the at least three projection images are generated from viewing directions spanning one period of the periodic continuous mathematical function, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer.

0396In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images to the remote computer, where the remote computer stores the first Set of Images.

0397In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, and one or both the render and the render program sending the first Set of Images and instructions to display the first Set of Images to the remote computer.

0398In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer.

0399In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where one or more Protocol Selection Rules are used to select a viewing direction that identifies a microcalcification, an obstruction, that a microcalcification includes two or more microcalcifications, that an obstruction includes a microcalcification and an obstruction, that an obstruction includes two or more obstructions, a microcalcification using direct comparison and an obstruction using direct comparison, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer.

0400In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where one or more Protocol Selection Rules are used to select a viewing direction selected from the first Set of Images that improves identification of an initial projection image, a viewing direction selected from the first Set of Images that improves comparison of an initial projection image and a subsequent projection image, a viewing direction selected from the first Set of Images that improves identification of a microcalcification, a viewing direction selected from the first Set of Images that improves identification of an obstruction, a viewing direction selected from the first Set of Images that improves resolution of two microcalcifications, a viewing direction selected from the first Set of Images that improves resolution of a microcalcification and an obstruction, a viewing direction selected from the first Set of Images that improves resolution of two obstructions, a viewing direction selected from the first Set of Images that improves direct comparison with an initial projection image and a subsequent projection image, a viewing direction selected from the first Set of Images that improves direct comparison of a microcalcification and a viewing direction selected from the first Set of Images that improves direct comparison of an obstruction, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer.

0401In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports, where the first Study Study is a Digital Breast Tomosynthesis scan and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, where the second Study Study is a complementary Digital Breast Tomosynthesis scan of the first Study, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer.

0402In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer, where one or both the first Set of Images and the second Set of Images are displayed as a video.

0403In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer, where one or both the first Set of Images and the second Set of Images are displayed as a video, where the video displays a dynamic comparison.

0404In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, where the at least three viewing directions are selected according to a periodic continuous mathematical function, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer.

0405In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, where the at least three viewing directions are selected according to a periodic continuous mathematical function, where the at least three viewing directions span one period of the periodic continuous mathematical function, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer.

0406In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer, where the remote computer stores one or both the first Set of Images and the second Set of Images.

0407In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images and instructions to one or both display the first Set of Images and the second Set of Images to the remote computer.

0408In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, where the first Study is a first reconstructed volumetric image, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to one or both select and generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer.

0409In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer, where the first Set of Images is displayed as a first video and the second Set of Images is displayed as a second video.

0410In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer, where the first Set of Images is displayed as a first video and the second Set of Images is displayed as a second video, where the first video and the second video display a time comparison.

0411In an embodiment of the invention, a method comprises providing a server computer in communication with one or more remote computers, where the server computer includes one or more processors and an associated memory, where a plurality of medical diagnostic reports are stored on the memory, where the plurality of medical diagnostic reports can be accessed by the one or more processors based on a plurality of patient IDs, where a patient ID corresponds with one or more medical diagnostic reports selected from the plurality of medical diagnostic reports, the server receiving a patient ID from a remote computer from the one or more remote computers, the server executing a render server program which applies one or more of one or more Study Selection Rules based on the patient ID to select a first Study of the plurality of medical diagnostic reports and one or more of one or more Study Selection Rules based on the first Study to select a second Study of the plurality of medical diagnostic reports, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a first volumetric image reconstructed from the first Study, the render server program defining at least three viewing directions for the first Study based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program generating at least three first projection images from the first volumetric image at the at least three viewing directions based on the one or more Protocol Selection Rules and the one or more Display Protocols, the render server program selecting three or more images from the at least three first projection images which correspond with three or more viewing directions to form a first Set of Images, the render server program applying one or more Protocol Selection Rules and one or more Image Set Rules to generate a second volumetric image reconstructed from the second Study, the render server program using the three or more viewing directions to generate three or more second projection images from the second volumetric image, where the three or more second projection images form a second Set of Images and the render program sending the first Set of Images and the second Set of Images to the remote computer, where the first Set of Images is displayed as a first video and the second Set of Images is displayed as a second video, where the first video and the second video display a structural comparison.

0412In an embodiment of the invention, a method comprises providing a remote computer, the remote computer selecting a Study including a plurality of measured projection images, sending instructions to a host computer based on one or more Protocol Selection Rules and one or more Image Set Rules to generate a volumetric image reconstructed from the plurality of measured projection images, instructing the host computer to compute three or more projection images of the volumetric image using three or more viewing directions defined based on the one or more Protocol Selection Rules and the one or more Display Protocols, where the three or more viewing directions change with time, instructing the host computer to send the three or more projection images to the remote computer, applying one or more Protocol Selection Rules with the Set of Images to generate a Set of Images and displaying on the remote display the Set of Images.

0413In an embodiment of the invention, a method comprises for a first tissue, selecting a first Study including a plurality of measured projection images, generating a primary volumetric image reconstructed from the first Study based on one or more Protocol Selection Rules and one or more Image Set Rules, defining three or more viewing directions for the first Study based on one or more Protocol Selection Rules and one or more Display Protocols, generating three or more primary projection images from a volumetric image based on the three or more viewing directions, where the three or more primary projection images form a first Set of Images, applying the one or more Protocol Selection Rules with the first Set of Images to generate a first video of the first Study, for a second tissue, applying one or more Study Selection Rules to generate a second Study based on one or more DICOM parameters and one or more Abstract Tags of the first Study and one or more DICOM parameters and one or more Abstract Tags of the second Study, generating a volumetric image reconstructed from the second Study based on the one or more Protocol Selection Rules and one or more Image Set Rules, defining three or more equivalent viewing directions for the second Study based on one or more of the three or more viewing directions, the one or more Protocol Selection Rules and the one or more Display Protocols, generating three or more second projection images from the second volumetric image based on the three or more equivalent viewing directions, where the three or more second projection images form a second Set of Images, applying the one or more Protocol Selection Rules with the second Set of Images to generate a second video of the second Study and displaying the first video and the second video.

0414Described above are methods and systems for implementing a rule derived basis to display three or more 2-D projections of volumetric image sets including DBT volume sets. The foregoing description of embodiments of the methods, systems, and components of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations will be apparent to one of ordinary skill in the relevant arts. For example, steps performed in the embodiments of the invention disclosed can be performed in alternate orders, certain steps can be omitted, and additional steps can be added. The embodiments were chosen and described in order to best explain the principles of the invention and its practical application, thereby enabling others skilled in the art to understand the invention for various embodiments and with various modifications that are suited to the particular used contemplated. Other embodiments are possible and are covered by the invention. Such embodiments will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein. The breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.