Method of determining a symmetry line in a radiation image
Abstract
A method of determining (a) symmetry line(s) in horizontal (vertical) direction in an image that is represented by a matrix of digital pixel values by (i) calculating a symmetry point for each column (row) of the image, and (ii) interconnecting calculated symmetry points.

Term
Term ended
Projected expiry passed 12 June 2018, 8.3 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
8 claims: 3 independent, 5 dependent
- 1Method of determining a symmetry line in at least one of a horizontal and vertical direction in a radiation image that is represented by a matrix of digital pixel values, comprising the steps of (i) calculating in case of horizontal direction a symmetry point for each column of said image, calculating in case of vertical direction a symmetry point for each row of said image, (ii) interconnecting calculated symmetry points.
- 5Method according to 1 wherein a horizontal symmetry index is calculated as and a vertical symmetry index is calculated as and wherein a main orientation index SI of the image is determined as SI = min( SI h , SI v ) and wherein a symmetry line with associated symmetry index equal to SI determines a direction of orientation of said image.
- 7Method of providing a radiation image in a position in which a horizontal or vertical symmetry line respectively in said image is parallel to a horizontal or vertical coordinate axis comprising the steps of (i) determining a horizontal or vertical symmetry line in said image, (ii) determining an orientation angle α by which said image is tilted relative to a horizontal or vertical coordinate axis respectively, (iii) rotating said image by an angle -α.
Independent claims3
75 paragraphs, as filed
Field of the invention
The invention relates to an image processing method to find the symmetry line and orientation angle of a radiation image, such as a medical radiation image.
Background of the invention
One of the basic properties of shapes and objects is symmetry. The human body shows symmetry along an axis oriented from top to bottom.
Medical images originating from image acquisition modalities such as computed projection radiography show symmetry to a large extent for examination types of body parts which are essentially symmetric. Examples of such examination types are e.g. frontal skull, frontal spine, frontal thorax, frontal abdomen, frontal pelvis.
In US 5,533,143 a method is disclosed for determining whether an image is symmetric or asymmetric. Image processing conditions are based on the judgment that the image is a frontal (symmetric) object image or a lateral (asymmetric) image.
The disclosed method is based on the assumption that the hypothetical symmetry axis is always fixed and coincides with a vertical center line passing through the center of the image. The method does not discriminate between vertical or horizontal symmetry.
By studying a large mixture of all symmetric examination types, it is observed that (1) the symmetry line in most cases does not coincide with the center line of the image, nor is its angle with respect to a perfectly vertical (or perfectly horizontal) line equal to zero and (2) horizontal symmetry occurs equally well as vertical symmetry.
The above-mentioned observations limit the accuracy and applicability of the prior art method disclosed in the above-mentioned patent.
In US 4,903,310 and US 4,951,201 various histogram based methods are proposed to discriminate between a frontal and a lateral body posture. It is however not possible to decide by applying these methods whether the object is symmetrical and whether the object is positioned horizontally or vertically.
The above methods are thus not adequate.
Experience has learnt that radiologists prefer to examine radiographic images in standard viewing conditions, i.e. with the image displayed so that a symmetry axis in the image is substantially horizontally or vertically oriented.
Object of the invention
It is an object of the invention to provide a method of determining a symmetry line of a radiation image.
It is a further object of the invention to provide a method of determining an orientation angle associated with such a symmetry line.
It is still a further object to provide a method by means of which images can be provided having a symmetry axis directed in a predetermined orientation.
Further objects of the present will become apparent from the description hereafter.
Summary of the invention
The objects of the present invention are achieved by a method of determining a symmetry line in a radiation image represented by a raster of pixel values comprising the steps of <ul id="ul0001" list-style="none" compact="compact"><li>(i) calculating a symmetry point for each column (row) of said image,</li><li>(ii) interconnecting symmetry points calculated for each column (row).</li></ul>
The way in which (a) symmetry point(s) is calculated, is described further on.
The method of the present invention can be applied to a digital signal representation of a radiation image such as a medical X-ray image. But it can also be applied to other kinds of radiation images such as images originating from non-destructive testing (NDT) of objects by irradiation of these objects.
Collimation and direct exposure areas in the image need to be excluded from consideration since they are not necessarily present in the image in a symmetrical way. In European patent application 97201683.6 an ensemble of methods is disclosed to perform a raw segmentation of a radiation image into collimation areas (foreground), direct exposure areas (background) and diagnostic areas (body parts).
The method of the present invention can also be applied to each of the sub-images of a multiply exposed image.
The method of the present invention permits to compute a symmetry index for a horizontal and vertical direction in the image, and to classify the image as either horizontally or vertically oriented based on the horizontal and vertical symmetry index referred to further on.
The matrix of pixel values representinga radiation image can be obtained by means of a wide variety of image acquisition techniques.
In one example of an image acquisition technique, a radiation image which is temporarily stored in a photostimulable phosphor screen is read out by scanning the screen with stimulating radiation, detecting light emitted by the screen upon radiation and converting detected light into a digital signal representation. However, other acquisition techniques may be envisaged.
Brief description of the drawings
Further details of the present invention as well as preferred embodiments hereof will be explained hereafter with reference to the drawings in which <ul id="ul0002" list-style="none" compact="compact"><li>Fig. 1 shows a thorax image in the presence of collimation areas and direct exposure areas. The automatically computed vertical symmetry axis is superimposed.</li><li>Fig. 2 shows the fitted symmetry axis of the thorax image.</li><li>Fig. 3 shows a pelvis image in the presence of collimation areas and direct exposure areas. The automatically computed horizontal symmetry axis is superimposed.</li><li>Fig. 4 shows-the fitted symmetry axis of the pelvis image.</li></ul>
Detailed description
Computation of the symmetry line
The method of the present invention is described in the following for application to the columns <i>j</i> of an image. An analogous description applies to rows <i>i</i>.
Given an image represented by a raster of <i>M</i>x<i>N</i> pixel values <i>g</i>(<i>i,j</i>) with <i>M</i> rows ranging from (0,...,<i>M</i>-1) and <i>N</i> columns ranging from (0<i>,</i>...,<i>N-</i>1)<i>,</i> and with larger gray values <i>g</i> representing less exposed image pixels. A symmetry measure is computed for each pixel on row <i>i</i>, assuming that the pixel be the most symmetrical point on the line.
The basic consideration is that, in the assumption that the central pixel be the symmetry point for the interval of which it is the center, the gray values at symmetrical positions at either side of the symmetry point will nearly be equal, hence their difference will nearly be zero.
The symmetry measure can thus be expressed as a sum <i>S</i> of squared or absolute differences of gray values taken symmetrically around a hypothesized symmetry center <i>c</i> :<maths id="math0001" num=""><img file="EP0889438A2_D0001.tif" /></maths> in which <i>g</i>(<i>i,j</i>) denotes the gray value at row <i>i</i> and column <i>j, c</i> is the row index of the current hypothesized symmetry center, and T is an offset parameter denoting the number of pixels to skip at the start of the column resp. to omit at the end of the column.
In the start and end interval <i>T</i>, it is assumed that too few points are available to compute <i>S</i> reliably.
The measure <i>S</i> will be minimal for the most symmetrical point in the column <i>j</i>. The parameter <i>m</i> denotes the maximum number of difference terms at row location cand is given by<maths id="math0002" num=""><math display="block"><mrow><mtext mathvariant="italic">m</mtext><mtext>(</mtext><mtext mathvariant="italic">i</mtext><mtext>) = min(</mtext><mtext mathvariant="italic">i</mtext><mtext>,</mtext><mtext mathvariant="italic">M</mtext><mtext>-</mtext><mtext mathvariant="italic">i</mtext><mtext>-1)</mtext></mrow></math><img file="EP0889438A2_D0002.tif" /></maths>
Each sum for a row index ineeds proper normalization in order to make correct comparisons possible. A straightforward normalization is to divide <i>S</i> by the number of terms <i>m</i> involved in its computation:<maths id="math0003" num=""><math display="block"><mrow><msub><mrow><mover accent="true"><mrow><mtext>S</mtext></mrow><mo>¯</mo></mover></mrow><mrow><mtext>1</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>)= </mtext><mfrac><mrow><mtext mathvariant="italic">S</mtext><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>) </mtext></mrow><mrow><mtext mathvariant="italic">m</mtext></mrow></mfrac><mtext> </mtext><mtext mathvariant="italic">c</mtext><mtext> = </mtext><mtext mathvariant="italic">T</mtext><mtext>,...,</mtext><mtext mathvariant="italic">M</mtext><mtext>-</mtext><mtext mathvariant="italic">T</mtext><mtext>-1</mtext></mrow></math><img file="EP0889438A2_D0003.tif" /></maths>
A further refinement takes into account particularities of geometry and exposure level of the examination. It has been observed that (1) the symmetry line has higher probability to lie nearby the center of the (sub-)image than nearby the borders of the image, and (2) the symmetry line runs through more exposed body parts.
Therefore, the refined normalization first takes the number <i>m</i> of terms into account, and second the gray value of the hypothesized center <i>c</i> itself:<maths id="math0004" num=""><math display="block"><mrow><msub><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow><mrow><mtext>2</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>) = </mtext><mfrac><mrow><mtext mathvariant="italic">S</mtext><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>) </mtext></mrow><mrow><msup><mrow><mtext mathvariant="italic">g</mtext></mrow><mrow><mtext mathvariant="italic">u</mtext></mrow></msup><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>)·</mtext><msup><mrow><mtext mathvariant="italic">m</mtext></mrow><mrow><mtext mathvariant="italic">v</mtext></mrow></msup></mrow></mfrac><mtext> </mtext><mtext mathvariant="italic">c</mtext><mtext> = </mtext><mtext mathvariant="italic">T</mtext><mtext>,...,</mtext><mtext mathvariant="italic">M-T-</mtext><mtext>1.</mtext></mrow></math><img file="EP0889438A2_D0004.tif" /></maths>
In the context of the present invention, <i>u</i> = 2 and <i>v</i> = 3. The use of exponents larger than 1 has been found to have a stabilizing effect on the location of symmetry points for subsequent rows. Clearly, the measure <maths id="math0005" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0005.tif" /></maths><sub>2</sub> favours potential symmetry centers having sufficiently large gray value <i>g</i>, that is, being more -attenuated, and which have more number of terms <i>m</i> involved in their computation. Intuitively stated, symmetry lines nearby the image center line (but not necessarily coinciding with it) and more attenuating body parts such as bone are better candidates for being the actual symmetry line than any other lines. Examination types such as thorax, spine and skull all adhere to these underlying assumptions. In the sequel, it is assumed that the refined normalization is used, i.e. <maths id="math0006" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0006.tif" /></maths><i> = </i><maths id="math0007" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0007.tif" /></maths><sub><i>2</i></sub><i>.</i>
Finally, the symmetry center <i>C</i><sub><i>h</i></sub>(<i>j</i>) of column <i>j</i> is assigned to row <i>c</i> for which <maths id="math0008" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0008.tif" /></maths><i>(c,j)</i> is minimal:<maths id="math0009" num=""><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">C</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">j</mtext><mtext>)=min(</mtext><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>), </mtext><mtext mathvariant="italic">c</mtext><mtext> = </mtext><mtext mathvariant="italic">T</mtext><mtext>,...,</mtext><mtext mathvariant="italic">M-T-</mtext><mtext>1)</mtext></mrow></math><img file="EP0889438A2_D0009.tif" /></maths>
The sequence<maths id="math0010" num=""><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">C</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">j</mtext><mtext>) </mtext><mtext mathvariant="italic">j</mtext><mtext>=0,...,</mtext><mtext mathvariant="italic">N-</mtext><mtext>1</mtext></mrow></math><img file="EP0889438A2_D0010.tif" /></maths> is defined as the horizontal symmetry line of the image.
An analog description holds for deriving a vertical symmetry line <i>C</i><sub><i>v</i></sub>(<i>i</i>). Similarly, a diagonal symmetry line can be derived for objects having a principal axis along the main diagonal or secondary diagonal of the image.
In general, for linear symmetry of two-dimensional objects, i.e. symmetry expressed by a symmetry line running along a one-dimensional curve, at any point along the symmetry curve, the difference accumulation measure <maths id="math0011" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0011.tif" /></maths> reaches a minimum along a line locally perpendicular to the symmetry curve.
Hence, for symmetry lines slightly oblique with respect to the perfectly horizontal resp. vertical direction, the method presented here yields an approximation to the ideal algorithm in which the measure <maths id="math0012" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0012.tif" /></maths> is computed along several trajectories through the hypothesized symmetry center, one trajectory of which is perpendicular to the yet unknown symmetry curve and thus having the smaller value of <maths id="math0013" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0013.tif" /></maths> associated with it.
The computation of a symmetry point becomes unreliable when the gray value profile is constant. Indeed, according to definition <i>S</i><sub>1</sub> of the normalized sum, every point along a constant profile is an equally potential symmetry center since the symmetry measure is constant zero everywhere. According to definition <i>S</i><sub>2</sub>, the center point of the line will a priori be symmetry point. Therefore, a quality measure is needed to express the reliability of the symmetry point. Obviously, when the line shows a large degree of signal energy variation, the most symmetrical point is also considered more reliable since, despite the variability of gray value data, all difference terms around the true symmetry center amount to a small value. The inverse of the standard deviation of data around the gray value of the hypothesized symmetry center is therefore a good candidate to measure the reliability of the hypothesized symmetry center. This reliability measure can thus be expressed as<maths id="math0014" num=""><math display="block"><mrow><mtext mathvariant="italic">R</mtext><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>)=1- </mtext><mfrac><mrow><mtext>1 </mtext></mrow><mrow><msqrt><msup><mrow><mtext>σ</mtext></mrow><mrow><mtext>2</mtext></mrow></msup><mtext> (</mtext><mtext mathvariant="italic">c,j</mtext><mtext>)+1</mtext></msqrt></mrow></mfrac></mrow></math><img file="EP0889438A2_D0014.tif" /></maths> with<maths id="math0015" num=""><img file="EP0889438A2_D0015.tif" /></maths>
The additive term 1 in the denominator avoids zero division for perfectly flat gray value profiles. Obviously, 0 < <i>R</i>(<i>c,j</i>) ≤ 1. The associated sequence of reliability measures for each of the most symmetrical points in a column jis defined as<maths id="math0016" num=""><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">R</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">j</mtext><mtext>)=</mtext><mtext mathvariant="italic">R</mtext><mtext>(</mtext><mtext mathvariant="italic">i</mtext><mtext>=</mtext><msub><mrow><mtext mathvariant="italic">C</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">j</mtext><mtext>),</mtext><mtext mathvariant="italic">j</mtext><mtext>) </mtext><mtext mathvariant="italic">j</mtext><mtext>=0,...,</mtext><mtext mathvariant="italic">N</mtext><mtext>-1</mtext></mrow></math><img file="EP0889438A2_D0016.tif" /></maths>
The computations of <maths id="math0017" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0017.tif" /></maths><i>(c,j)</i> and <i>R</i>(<i>c,j</i>) are further refined in two ways: <ul id="ul0003" list-style="bullet" compact="compact"><li>points (<i>c,j</i>) belonging to either the collimation area or direct exposure area are excluded from consideration since potential symmetry points must lie in diagnostic areas. The availability of the collimation areas and direct exposure areas as bitmap images is segmented on the original x-ray as disclosed in European patent application 97201683.6. These points are disregarded by putting <maths id="math0018" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0018.tif" /></maths><i>(c,j)</i> and <i>R(c,j)</i> to their corresponding extreme values<maths id="math0019" num=""><math display="block"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>) = LARGE_ FLOAT and </mtext><mtext mathvariant="italic">R(c,j)</mtext><mtext> = 0.0</mtext></mrow></math><img file="EP0889438A2_D0019.tif" /></maths></li><li>terms in the sums of <maths id="math0020" num=""><math display="inline"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover></mrow></math><img file="EP0889438A2_D0020.tif" /></maths><i>(c,j)</i> and <i>R(c,j)</i> are disregarded whenever they exceed an upper limit on the difference value. This threshold is empirically determined as a fraction of the full scale range <i>L</i> :<maths id="math0021" num=""><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">T</mtext></mrow><mrow><mtext mathvariant="italic">diff</mtext></mrow></msub><mtext>= </mtext><mfrac><mrow><mtext mathvariant="italic">L</mtext><mtext></mtext></mrow><mrow><mtext>4</mtext></mrow></mfrac></mrow></math><img file="EP0889438A2_D0021.tif" /></maths></li></ul>
This has the effect of ignoring large valued terms due to gray values belonging to direct exposure areas.
At this point it is clear that the concept of minimizing sums of difference values along trajectories perpendicular to the symmetry line searched for and running through the hypothesized symmetry center is applicable for other kinds of symmetry as well.
Rotational symmetry, in which a two-dimensional object shows symmetry around its center point (mostly coinciding with the object's center), can be detected by finding the point at which the sum of difference values between points lying symmetrically at either side of a hypothesized symmetry center, is minimal. An alternate form of rotational symmetry is presented by the N-degree rotational symmetry in which an object is identical to its rotation by N degrees around its symmetry center. Here, differences between rotated points are accumulated and minimized.
Rotational symmetry frequently occurs in radiation images of man-made objects such as rings, wheels, gears etc.
Fitting a polynomial to the symmetry line
The symmetry line computation is completed by idealizing the empirically found sequence <i>C</i><sub><i>h</i></sub>(<i>j</i>) or <i>C</i><sub><i>v</i></sub>(<i>i</i>) to a polynomial equation. For most examination types (such as thorax, pelvis, skull, abdomen), the symmetry line is a straight line. The regression model is the well-known linear combination of 1 and <i>x</i> (namely <i>a+bx</i>). More general, the model solved for can be a linear combination of any <i>K</i> specified functions of <i>x</i>. Here <i>x</i> stands for the running abscissa coordinate along rows <i>i</i> for the vertical symmetry axis fitting or columns <i>j</i> for the horizontal symmetry axis fitting. Prior art such as described in "W.H. Press, Numerical Recipes in C, The art of scientific computing, Cambridge University Press, 1st ed. 1988, Chapter 14, Modeling of Data" is used to solve a general linear least squares fitting or regression. For example, the functions could be 1,<i>x</i>,<i>x</i><sup>2</sup>,...,<i>x</i><sup><i>k</i></sup><sup>-1</sup>, in which case the general linear combination<maths id="math0022" num=""><math display="block"><mrow><mtext mathvariant="italic">y</mtext><mtext>(</mtext><mtext mathvariant="italic">x</mtext><mtext>) = </mtext><msub><mrow><mtext mathvariant="italic">a</mtext></mrow><mrow><mtext>1</mtext></mrow></msub><mtext> + </mtext><msub><mrow><mtext mathvariant="italic">a</mtext></mrow><mrow><mtext>2</mtext></mrow></msub><mtext mathvariant="italic">x</mtext><mtext> + </mtext><msub><mrow><mtext mathvariant="italic">a</mtext></mrow><mrow><mtext>3</mtext></mrow></msub><msup><mrow><mtext mathvariant="italic">x</mtext></mrow><mrow><mtext>2</mtext></mrow></msup><msub><mrow><mtext>+...a</mtext></mrow><mrow><mtext mathvariant="italic">k</mtext></mrow></msub><msup><mrow><mtext mathvariant="italic">x</mtext></mrow><mrow><mtext mathvariant="italic">K</mtext></mrow></msup><msup><mrow><mtext></mtext></mrow><mrow><mtext>-1</mtext></mrow></msup></mrow></math><img file="EP0889438A2_D0022.tif" /></maths> is a polynomial of degree <i>K</i>-1. The general form of this kind of model is<maths id="math0023" num=""><img file="EP0889438A2_D0023.tif" /></maths> where <i>X</i><sub>1</sub>(<i>x</i>),...,<i>X</i><sub><i>K</i></sub>(<i>x</i>) are arbitrary fixed functions of <i>x</i>, called the basis functions. The <i>X</i><sub><i>k</i></sub>(<i>x</i>) can be nonlinear functions of <i>x</i>. The term linear only refers to the model's linear dependence on the parameters <i>a</i><sub><i>k</i></sub>. As best parameters <i>a</i><sub><i>k</i></sub>, those that minimize the chi-square figure of merit are computed<maths id="math0024" num=""><img file="EP0889438A2_D0024.tif" /></maths> where the notation is given for the horizontal symmetry line, with <i>C</i><sub><i>h</i></sub>(<i>j</i>) the location in each column <i>j</i> of the most symmetrical point and 1-<i>R</i><sub><i>h</i></sub>(<i>j</i>) its associated measurement error. The influence on the fitting result of the incorporation of measurement errors is such that unreliable symmetry centers will be taken less into account. Hence, the fit result will have the effect to only 'follow' reliable data points, and 'ignore' the others. This property is particular advantageous for examination types having portions of relatively flat gray value regions where it is difficult to assign a true symmetry center. The symmetry center points of those regions are disregarded in the computation and do not influence the correct symmetry line.
Standardization of image viewing conditions
The most symmetrical orientation, either horizontally or vertically, can be derived on the basis of the sequence of symmetry measures<maths id="math0025" num=""><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">S</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">j</mtext><mtext>) </mtext><mtext mathvariant="italic">j</mtext><mtext>=0,...,</mtext><mtext mathvariant="italic">N</mtext><mtext>-1</mtext></mrow></math><img file="EP0889438A2_D0025.tif" /></maths><maths id="math0026" num=""><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">S</mtext></mrow><mrow><mtext mathvariant="italic">v</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">i</mtext><mtext>) </mtext><mtext mathvariant="italic">i</mtext><mtext>=0,...,</mtext><mtext mathvariant="italic">M</mtext><mtext>-1</mtext></mrow></math><img file="EP0889438A2_D0026.tif" /></maths> by computing their associated symmetry index<maths id="math0027" num=""><img file="EP0889438A2_D0027.tif" /></maths> resp.<maths id="math0028" num=""><img file="EP0889438A2_D0028.tif" /></maths> and taking the smaller of the two as the symmetry index and associated main orientation of the image, i.e.<maths id="math0029" num=""><math display="block"><mrow><mtext mathvariant="italic">Sl</mtext><mtext> = min(</mtext><msub><mrow><mtext mathvariant="italic">SI</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><msub><mrow><mtext mathvariant="italic">,SI</mtext></mrow><mrow><mtext mathvariant="italic">v</mtext></mrow></msub><mtext>)</mtext></mrow></math><img file="EP0889438A2_D0029.tif" /></maths>
The orientation angle α is derived from the symmetry line and the image is rotated by an angle -α to make the orientation coincide with the perfectly horizontal or perfectly vertical orientation depending on the applicable case. Prior art is used to rotate a digital image artifact-free over a given angle, such as described in "G. Wolberg, Digital Image Warping, IEEE Computer Society Press Monograph, 1990, Chapter 7.3. Rotation". The rotated image is subsequently sent to a soft-copy or hardcopy device for display, review or diagnosis.
Stepwise summary of operations
A stepwise description of operations for performing the image standardization algorithm is given in the sequel.
<u>Step 1</u>: for each sub-image of a possibly partitioned image
<u>Step 2</u>: for each column <i>j</i>
<u>Step 3</u>: for each pixel <i>c</i> at position <i>i</i> in column <i>j</i>,
<i>T≤c≤M-T-</i>1,excluding pixels in collimation areas or direct exposure areas
<u>Step 4</u>: Compute <ul id="ul0004" list-style="bullet" compact="compact"><li>the maximum range for the subsequent sums<maths id="math0030" num=""><math display="block"><mrow><mtext mathvariant="italic">m</mtext><mtext> = min(</mtext><mtext mathvariant="italic">i,M-i-</mtext><mtext>1)</mtext></mrow></math><img file="EP0889438A2_D0030.tif" /></maths></li><li>the symmetrical difference sums around hypothesized symmetry center <i>c</i><maths id="math0031" num=""><img file="EP0889438A2_D0031.tif" /></maths></li><li>the normalized symmetry measure<maths id="math0032" num=""><math display="block"><mrow><mover accent="true"><mrow><mtext mathvariant="italic">S</mtext></mrow><mo>¯</mo></mover><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>) = </mtext><mfrac><mrow><mtext mathvariant="italic">S</mtext><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>) </mtext></mrow><mrow><msup><mrow><mtext mathvariant="italic">g</mtext></mrow><mrow><mtext mathvariant="italic">u</mtext></mrow></msup><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>)·</mtext><msup><mrow><mtext mathvariant="italic">m</mtext></mrow><mrow><mtext mathvariant="italic">v</mtext></mrow></msup></mrow></mfrac></mrow></math><img file="EP0889438A2_D0032.tif" /></maths></li><li>the associated reliability measure<maths id="math0033" num=""><math display="block"><mrow><mtext mathvariant="italic">R</mtext><mtext>(</mtext><mtext mathvariant="italic">c,j</mtext><mtext>) = 1- </mtext><mfrac><mrow><mtext>1</mtext></mrow><mrow><msqrt><msup><mrow><mtext>σ</mtext></mrow><mrow><mtext>2</mtext></mrow></msup><mtext> (</mtext><mtext mathvariant="italic">c,j</mtext><mtext>)+1</mtext></msqrt></mrow></mfrac></mrow></math><img file="EP0889438A2_D0033.tif" /></maths></li></ul>
<u>Step 2'</u>: repeat for the next pixel in the column
<u>Step 4</u>: From the sequences of symmetry measure and associated reliability measure <ul id="ul0005" list-style="bullet" compact="compact"><li>find the most symmetric point in the column<maths id="math0034" num=""><img file="EP0889438A2_D0034.tif" /></maths></li><li>find the associated reliability<maths id="math0035" num=""><math display="block"><mrow><msub><mrow><mtext mathvariant="italic">R</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">j</mtext><mtext>)=</mtext><mtext mathvariant="italic">R</mtext><mtext>(</mtext><mtext mathvariant="italic">i</mtext><mtext>=</mtext><msub><mrow><mtext mathvariant="italic">C</mtext></mrow><mrow><mtext mathvariant="italic">h</mtext></mrow></msub><mtext>(</mtext><mtext mathvariant="italic">j</mtext><mtext>),</mtext><mtext mathvariant="italic">j</mtext><mtext>)</mtext></mrow></math><img file="EP0889438A2_D0035.tif" /></maths></li></ul>
<u>Step 3'</u>: repeat for the next column <i>j</i>+1
<u>Step 5</u>: Form the sequences of symmetry centers and associated reliability measure for all columns <ul id="ul0006" list-style="bullet" compact="compact"><li><i>C</i><sub><i>h</i></sub>(<i>j</i>) <i>j</i>=0,...,<i>N</i>-1</li><li><i>R</i><sub><i>h</i></sub>(<i>j</i>) <i>j</i>=0,..,<i>N</i>-1</li></ul>
<u>Step 6</u>: Compute the linear least squares fitting on the data tuples (<i>j</i>,<i>C</i><sub><i>j</i></sub>(<i>j</i>))and associated measurement error 1-<i>R</i><sub><i>h</i></sub>(<i>j</i>) to find the horizontal symmetry line <i>SL</i><sub><i>h</i></sub> of the examination body part.
<u>Step 7</u>: Compute the symmetry index <i>SI</i><sub><i>h</i></sub> corresponding to the horizontal symmetry line
<u>Step 8</u>: Repeat steps 3 through 7 to obtain the vertical symmetry line <i>SL</i><sub><i>v</i></sub> and associated symmetry index <i>SI</i><sub><i>v</i></sub>.
<u>Step 9</u>: Retain the smaller of the symmetry indexes (<i>SI</i><sub><i>h</i></sub><i>,SI</i><sub><i>v</i></sub>)for the horizontal and vertical hypothesized symmetry lines (<i>SL</i><sub><i>h</i></sub><i>,SL</i><sub><i>v</i></sub>) as the final image's main symmetry line <i>SL</i> and associated symmetry index <i>SI.</i>
<u>Step 10</u>: Derive the orientation α of the retained symmetry line <i>SL</i>.
<u>Step 11</u>: Rotate the image over an angle -α to its standard viewing position.
<u>Step 1</u>': Repeat steps 2 through 11 for each sub-image of a possibly multiply exposed image
51 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US7409085B2 | Cited by | United States of America | Applicant |
| US7796793B2 | Cited by | United States of America | Applicant |
| US2017024607A1 | Cited by | United States of America | Pre-grant |
| US9990537B2 | Cited by | United States of America | Search report |
| WO2008036181A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| CN112767472A | Cited by | China | Search report |
| US9996732B2 | Cited by | United States of America | Search report |
| WO03060827A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2017024608A1 | Cited by | United States of America | Pre-grant |
| EP0288037A1 | Cites | European Patent Office (EPO) | Search report |
| FR2583547A1 | Cites | France | Search report |
| US5533143A | Cites | United States of America | Search report |
| WO9420922A1 | Cites | World Intellectual Property Organization (WIPO) | Search report |
5 members in 3 offices
Priority claims6
| Document | Office | Kind | Date |
|---|---|---|---|
| 97202033 | European Patent Office (EPO) | A | |
| 97202033 | European Patent Office (EPO) | – | |
| 98202004 | European Patent Office (EPO) | A | |
| 97202033 | – | – | – |
| EP19970202033 | – | – | – |
| EP19980202004 | – | – | – |
Members5
| Document | Office | Kind | |
|---|---|---|---|
| EP0889438A2This record | European Patent Office (EPO) | A2 | |
| JPH1139497A | Japan | A | |
| EP0889438A3 | European Patent Office (EPO) | A3 | |
| US6263097B1 | United States of America | B1 | |
| JP4127901B2 | Japan | B2 |
16 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Application deemed to be withdrawnWithdrawn18D | 18D | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWNSTAA | STAA | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | |
| First examination report despatched17Q | 17Q | |
| First examination report despatched17Q | 17Q | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | |
| Designation fees paidBE DE FR GBAKX | AKX | |
| Request for examination filed17P | 17P | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAL;LT;LV;MK;RO;SIAX | AX | |
| Information provided on ipc code assigned before grant6G 06T 7/00 A, 6G 06K 9/52 BRIC1 | RIC1 | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAL;LT;LV;MK;RO;SIAX | AX | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI |
Numbers
- Publication
- 0889438
- Publication, DOCDB
- 0889438
- Publication, EPODOC
- EP0889438
- Application
- 98202004
- Application, DOCDB
- 98202004
- Application, EPODOC
- EP19980202004
Titles3
- German
- Verfahren zur Ermittlung einer Symmetrielinie in einem Strahlungsbild
- English
- Method of determining a symmetry line in a radiation image
- French
- Procédé de détermination d'un axe de symétrie dans une image de type radiographique
Classification
- CPC, 4
- G06T7/68
- G06T7/70
- G06T2207/10116
- G06T2207/30004
- IPC, 2
- G06T7 00
- G06T7 60
Designated states3
- Contracting states, 2
- United Kingdom
- Sweden
- Extension states, 1
- Slovenia