Camera system for detecting codings

CROSS-REFERENCE TO PRIOR APPLICATION

Priority is claimed to German Patent Application No. DE 10 2018 119 691.1, filed on Aug. 14, 2018, the entire disclosure of which is hereby incorporated by reference herein.

FIELD

The invention relates to a camera, and in particular to a camera system, for detecting codings, contours, and/or surfaces.

BACKGROUND

EP 1022608 A1 already discloses a device for detecting an image plane, in which device the camera projects a visible light pattern onto a subject in order to mark the detection range of the camera for a user. The light sources are arranged such that the light beams of the light source substantially follow the field of view of the camera.

A possible focusing device is known, for example, from DE 10 2015 214 032 A1, in which the focus of an optical system can be changed via a motor-gear assembly.

SUMMARY

In an embodiment, the present invention provides . . . .

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be described in even greater detail below based on the exemplary figures. The invention is not limited to the exemplary embodiments. All features described and/or illustrated herein can be used alone or combined in different combinations in embodiments of the invention. The features and advantages of various embodiments of the present invention will become apparent by reading the following detailed description with reference to the attached drawings which illustrate the following:

<figref idref="DRAWINGS">FIG. 1</figref> a typical detection situation of a coding,

<figref idref="DRAWINGS">FIG. 2</figref> an incorrect setting of a search zone,

<figref idref="DRAWINGS">FIG. 3</figref> a well-adjusted search zone,

<figref idref="DRAWINGS">FIG. 4</figref> a search zone incorrectly adjusted in the depth of field,

<figref idref="DRAWINGS">FIG. 5</figref> a search zone well-adjusted as to both area and depth,

<figref idref="DRAWINGS">FIG. 6</figref> a possible weighting of the reading reliability of positions in the search zone,

<figref idref="DRAWINGS">FIG. 7</figref> a search zone histogram with critical reading reliability,

<figref idref="DRAWINGS">FIG. 8</figref> a search zone histogram with a drift of the contour positions,

<figref idref="DRAWINGS">FIG. 9</figref> a contour in a search zone.

DETAILED DESCRIPTION

In an embodiment, the present invention provides an improved camera system for detecting codings with a view to a high reading reliability.

These improvements are achieved with the camera system according to an embodiment of the invention, as well as by a method for operating such a camera system.

Advantageously provided is a method for operating a camera system for detecting codings, in which positions of contour points of the codings are determined in relation to edges of a search zone of the camera system, wherein a reading reliability of the search zone is determined from a distance of the contour points from the edges of the search zone.

This approach has the advantage that this information can be made available to a user for optimizing his search zone. Optionally, such settings can also be performed automatically on the basis of the data determined for reading reliability.

It is particularly useful if the reading reliability of the search zone is classified as critical if a number of the contour point positions which fall within a boundary region of the search zone exceeds a frequency limit value.

A further embodiment provides for determining a drift of the contour point positions over a plurality of detected contour point positions.

Likewise advantageously provided according to an embodiment is a camera system which is designed to carry out one of the aforementioned methods.

The invention is explained in more detail below based upon exemplary embodiments with reference to the drawings.

In the following description of the preferred embodiments, the same reference signs denote the same or comparable components.

<figref idref="DRAWINGS">FIG. 1</figref> shows a stationary camera system <b>10</b> for detecting a coding in a typical detection situation. For example, several subjects <b>20</b> move past the detecting camera system <b>10</b> on a conveyor belt <b>40</b>. The position and field of view FOV of the camera or camera system <b>10</b> are adjusted in such a way that a coding <b>30</b> can be reliably detected in a predetermined search zone SZ. However, in the left subject <b>20</b>, the coding <b>30</b> is not located in a central region of the subject <b>20</b>, and it is to be expected that the coding <b>30</b> is not to be detected within the predetermined search zone SZ.

As can then be seen in <figref idref="DRAWINGS">FIG. 2</figref>, at a later point in time, the coding <b>30</b> is partially outside the search zone SZ and is expected to be recognized only with poor quality or not at all.

Enlarging the search zone SZ, e.g., by enlarging the field of view FOV, as shown in <figref idref="DRAWINGS">FIG. 3</figref> is therefore advantageous. This enlargement of the search zone SZ can take place without any problems as long as the necessary search zone SZ does not exceed a maximum possible detection range EB predetermined by the camera <b>10</b>. If a search zone SZ which exceeds the size of the maximum possible detection range EB is necessary, the search zone SZ can be enlarged, for example, by increasing the distance of the camera <b>10</b> and/or by shortening the focal length of the camera lens or exchanging it with a lens of a shorter focal length.

<figref idref="DRAWINGS">FIG. 4</figref> shows another source of error, in which the subjects <b>20</b> have different heights, such that some subjects are outside of the depth of field range and are not reliably recognized.

As shown in <figref idref="DRAWINGS">FIG. 5</figref>, it is advantageous to select the position of the camera, the aperture of the camera, and/or the focus of the lens such that all expected subject heights or distances of the codings <b>30</b> fall within the search zone SZ and within the predetermined depth of field range ST. The search zone SZ is thus extended three-dimensionally around the depth of field range ST. Strictly speaking, it is therefore a search space SR. Below, the term, search zone SZ, is also used synonymously for a search space SR.

The invention now provides for checking or determining the reading reliability of the search zone SZ during ongoing operation of the camera system <b>10</b> or in a calibration phase.

For this purpose, the positions of relevant contour points, such as the contour of the coding, a bounding box in OCR recognition, or points determined by other contour-matching methods, are detected and evaluated for each image with a successful reading or decoding. From the determined contour points, a position of the coding <b>30</b> in relation to the search zone SZ or the positions of the relevant contour points in relation to the edges of the search zone SZ can be determined. In a simple case, a relevant contour point can also be the center of gravity/center of the coding. In such a case, the limit values would have to be adapted accordingly.

In order to evaluate the search zone SZ, several subjects <b>20</b> with codings <b>30</b> are brought into the search zone SZ of the camera system <b>10</b>, and images from which the position of the codings <b>30</b> or of the relevant contour points are determined are recorded. A statistic that allows statements about the frequency of the number of times the contour points come close to an edge of the search zone SZ is now generated over several images. A reading reliability of the search zone SZ can be determined from this statistic.

<figref idref="DRAWINGS">FIG. 6</figref> shows a possible weighting of the position with a view to reading reliability. The reading reliability has its highest value in the central region of the search zone SZ, while it decreases strongly in the edge regions.

Instead of or in addition to a weighting of the positions, a distance of the coding or relevant contour points from the edge can also be detected and evaluated. Preferably, a shortest distance between the edge of the search zone SZ and the contour points of the coding <b>30</b> is determined for this purpose.

<figref idref="DRAWINGS">FIG. 7</figref> shows a histogram of such a view. The frequency with which certain positions or distances occur is plotted. If possible and necessary, the histogram may optionally be expanded to the entire detection range EB of the camera. In order to evaluate the reading reliability of the search zone SZ, a boundary region GB or a distance limit value AG at the edges is defined as ‘too close,’ wherein a maximum number of events to be tolerated can additionally be defined as the frequency limit value HG, denoted here by ‘too frequent.’ If the number of positions that are ‘too close’ exceeds the defined frequency limit value HG, the reading reliability is considered critical, as illustrated by way of example in <figref idref="DRAWINGS">FIG. 7</figref>. In the case of a particularly sensitive application, the frequency limit value HG can optionally be adjusted to zero, so that the reading reliability is already classified as critical in the case of a single contour position that is ‘too close.’ It should be noted that the frequency limit value HG may be defined both as an absolute and as a percentage value.

If the limit values, ‘too close’ and/or ‘too frequent,’ are exceeded, an alarm can be provided, for example. For example, a user can be notified by the alarm that an improvement in reading reliability could be achieved.

Such a notification could, for example, serve to indicate:

a) that, although no erroneous readings have occurred, the positions of the codings or contour points in the search zone SZ are so unfavorable that, with a small change in position, erroneous readings are to be expected with high probability.

b) that erroneous readings have already occurred.

A histogram of the frequency distribution of the relevant contour positions corresponding to <figref idref="DRAWINGS">FIG. 7</figref> can, for example, be displayed to the user, in order to rectify the situations according to a) or b). The histogram of <figref idref="DRAWINGS">FIG. 7</figref> then readily shows in which direction the search zone must be moved for higher reading reliability. The histogram is preferably shown two-dimensionally in order to take into account x- and y-axes. If a three-dimensional search zone SR or a search space SR is to be viewed, the histogram can of course also be shown three-dimensionally, or a separate histogram be displayed for each axis.

As an alternative to the histogram, it is also possible to display the occurred positions of the contour points as an image. In the simplest case, each contour point found could be drawn as a simple point.

Particularly preferred is a representation as a so-called “heat map” in which, similar to a 2-D histogram, the affected cells are incremented and then displayed in color. A contour point is considered to be a Gaussian curve and affects several pixels of the image, depending upon how far they are from its center. Hot spots can thereby be recognized more easily.

Furthermore, specific settings of the camera system could be proposed, e.g., a change in the focal length of the lens or a change of the lens in order to change the field of vision or the aperture angle. In the case of a critical depth of field range ST, notifications regarding the focus to be adjusted, the camera distance to the subjects <b>20</b>, or codings <b>30</b> could be provided. A recommendation regarding an adjustable aperture could also be given.

Particularly in the case of codings which already touch an edge of the search zone, an enlargement of the search zone SZ may no longer be possible. In such a case, a notification regarding the optimization of the sensor alignment could also be made, or, as already mentioned, a change to a larger aperture angle could be indicated. As stated, this can be made dependent upon how well the search zone or the complete detection range EB or the camera image is utilized.

This degree of utilization can be determined, for example, via features such as ‘previously unused detection area.’ This area is indicated as ‘ug’ by way of example in <figref idref="DRAWINGS">FIG. 7</figref>. This information can also be provided to the user independently of the previous warning notifications.

Optimization of the sensor alignment can consist in a lateral displacement or tilting, or even in a rotation, if, for example, the detection range EB or image region is not utilized sufficiently well due to the rotational position of the subject.

Further features, such as the center of gravity or orientation of the subject, can also be used to evaluate the direction of movement. A trend analysis that detects the drifts in these values over a sufficient number of images is conceivable. This effect is shown schematically in <figref idref="DRAWINGS">FIG. 8</figref> by way of example. From a trend analysis, it can be seen that the frequency distribution moves to an edge of the search zone SZ with a drift velocity v.

The user can then be warned preventatively if, for example, an approximately linear drift of the position is detected. Rotation of the frequency distribution could also be detected in a two-dimensional view. A systematic change in the rotational position could indicate, for example, a misalignment of the sensor so that a corresponding warning can likewise be output.

<figref idref="DRAWINGS">FIG. 9</figref> shows an example of a coding <b>30</b> in a search zone SZ. The relevant contour points KP of the coding <b>30</b> are in this case the corner points of the rectangular outline of the coding <b>30</b>. In the illustrated case, a contour point KP<b>1</b> is within the boundary region GB of the search zone SZ. The coding <b>30</b> is thus evaluated as ‘too close.’ Whether the setting of the safety zone is considered to be critical in reading reliability then depends upon what frequency of such ‘too close’ events is acceptable.

While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. It will be understood that changes and modifications may be made by those of ordinary skill within the scope of the following claims. In particular, the present invention covers further embodiments with any combination of features from different embodiments described above and below. Additionally, statements made herein characterizing the invention refer to an embodiment of the invention and not necessarily all embodiments.

The terms used in the claims should be construed to have the broadest reasonable interpretation consistent with the foregoing description. For example, the use of the article “a” or “the” in introducing an element should not be interpreted as being exclusive of a plurality of elements. Likewise, the recitation of “or” should be interpreted as being inclusive, such that the recitation of “A or B” is not exclusive of “A and B,” unless it is clear from the context or the foregoing description that only one of A and B is intended. Further, the recitation of “at least one of A, B and C” should be interpreted as one or more of a group of elements consisting of A, B and C, and should not be interpreted as requiring at least one of each of the listed elements A, B and C, regardless of whether A, B and C are related as categories or otherwise. Moreover, the recitation of “A, B and/or C” or “at least one of A, B or C” should be interpreted as including any singular entity from the listed elements, e.g., A, any subset from the listed elements, e.g., A and B, or the entire list of elements A, B and C.

LIST OF REFERENCE SIGNS

<ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0050"><b>10</b> Reading device</li><li id="ul0001-0002" num="0051"><b>20</b> Subject</li><li id="ul0001-0003" num="0052"><b>30</b> Code</li><li id="ul0001-0004" num="0053"><b>40</b> Conveyor belt</li><li id="ul0001-0005" num="0054">FOV Field of view</li><li id="ul0001-0006" num="0055">SZ Search zone</li><li id="ul0001-0007" num="0056">SR Search space</li><li id="ul0001-0008" num="0057">EB Detection range</li><li id="ul0001-0009" num="0058">ST Depths of field</li><li id="ul0001-0010" num="0059">GB Boundary region</li><li id="ul0001-0011" num="0060">KP Contour point</li></ul>