Rail-based closed circuit T.V. surveillance system with automatic target acquisition
28 claims: 2 independent, 26 dependent
- 1A surveillance system comprising:an elongated track positioned along a path;carriage means supported on and movable along said track for transporting a television camera (10) along said path;carriage moving means coupled to said carriage means for selectively moving said carriage means along said track;means associated with said television camera (10) and responsive to camera control signals for selectively adjusting a direction of view and a zoom condition of said television camera (10);carriage control means coupled to said carriage moving means and responsive to carriage control signals for selectively positioning said carriage means along said track;and first and second sets of initialization parameters and initialization means for entering both first and second sets of initialization parameters, said first set of initialization parameters including first position data representative of a first selected point along said elongated track and first camera direction data representative of a first camera direction selected so that said television camera (10) provides an image of a predetermined target object when said carriage means is positioned at said first selected point, said second set of initialization parameters including second position data representative of a second selected point along said elongated track and second camera direction data representative of a second camera direction selected so that said television camera provides an image of said predetermined target object when said carriage means is positioned at said second selected point.
- 14A method of initializing a rail-based closed circuit television surveillance system, the surveillance system including an elongated track positioned along a path, carriage means supported on and movable along said track for transporting a television camera (10) along said path, carriage moving means coupled to said carriage means for selectively moving said carriage means along said track, camera control means for selectively adjusting a direction of view and a zoom condition of said television camera (10), and carriage control means for selectively positioning said carriage means along said track, the method comprising the steps of:positioning said carriage means at a first selected point along said elongated track;orienting the direction of view of said television camera (10) in a first orientation so that said television camera (10) provides an image of a predetermined target object at a time when said carriage means is at said first selected point;storing a first set of initialization parameters which includes first track position data representative of said first selected point and first camera direction data representative of said first orientation of the direction of view of said television camera (10);positioning said carriage means at a second selected point along said track;orienting the direction of view of said television camera (10) in a second orientation so that said television camera (10) provides an image of said predetermined target object at a time when said carriage means is at said second selected point;and storing a second set of initialization parameters which includes second track position data representative of said second selected point and second camera direction data representative of said second orientation of the direction of view of said television camera (10).
Independent claims2
74 paragraphs in 5 sections, as filed
FIELD OF THE INVENTION
0001This invention relates generally to closed-circuit television surveillance systems and pertains more particularly to such systems in which a television camera is mounted on a carriage for movement along a rail or track, and in which the system is subject to automatic control by a computer or the like.
BACKGROUND OF THE INVENTION
0002It is known to provide closed circuit television surveillance systems using either cameras in a fixed location or cameras that are mounted for movement along a rail or track. It is also known, in the case of a system using a fixed-position camera, to provide automatic acquisition of a fixed target object in response to an alarm signal or the like. For example, a target object such as a door can be equipped with a sensor which provides an alarm signal to a central control portion of the surveillance system when the door is opened. Assuming that data has previously been stored in the control system to indicate the required direction of view and appropriate zoom and/or focus condition for the camera to provide an image of the target door, the control system can implement an immediate adjustment to the camera direction, zoom condition, etc. so that an image of the door is provided by the camera within a very short time after the door is opened.
0003However, when the system utilizes a moving camera, such as a camera mounted on a carriage which travels along a rail, the camera may be located at any arbitrary position in its range of movement at the time an alarm is received. Since the camera location at the time of the alarm cannot be known in advance, it is not possible to store in advance data defining a particular direction and zoom condition of the camera which will enable the camera to provide an image of the target from the position of the camera at the time of the alarm.
0004In the case of an operator-attended surveillance system, the human operator may attempt to respond to the alarm signal by operating system controls to reposition the camera carriage and to adjust the camera direction, etc. so that an image of the target object is obtained. However, the variety of possible camera positions and directions-of-view may lead to disorientation on the part of the operator. Also, if the system is set up with multiple target objects (e.g., multiple doors, windows, cabinets and so forth) for which alarms may be actuated, the operator may have difficulty identifying the particular target to which the alarm pertains. As a result, the human operator's response to the alarm may be too slow to capture an image of the event (such as entry of an intruder) which caused the alarm.
0005While it might be proposed to define a predetermined position along the track to which the camera should be moved in response to an alarm which pertains to a particular target, and then an appropriate direction of view and zoom condition data could also be stored for providing an image of the target from that predetermined position, such an approach carries the disadvantage that a significant amount of time may be required to move the carriage to the predetermined position from the position of the carriage at the time the alarm is received. Even if automatic camera direction and zoom adjustments are performed before or during carriage movement so that the camera will be in an appropriate orientation and zoom condition to provide the image of the target as soon as the predetermined carriage position is reached, still target acquisition cannot take place during the time the carriage is in motion, and target acquisition thus may be substantially delayed.
0006US-A-4 510 526 discloses a surveillance system wherein a TV-camera is pivotally mounted along its optical axis on or along a ceiling, and a mirror is pivotally mounted about an axis perpendicular to the optical axis to intercept the view of the camera. Then, by selected rotation of the camera and mirror about these axes, both pan and tilt functions are achieved in a very compact structure. Further this system comprises an open-door sensor which is responsive to a door being opened and provides a signal to a control console, which automatically causes a tilt signal and a pan signal to operate different motors. These motors train the camera and the door and operate the zoom-mechanism of the camera to adjust the focal lens of the camera to the desired field of view.
SUMMARY OF THE INVENTION
0007The present invention has as its primary object the provision of a closed circuit television surveillance system, using a rail-based television camera, that is capable of acquiring an image of a fixed target within a minimum amount of time after receipt of an alarm signal or the like.
0008Another object of the invention is provision of a surveillance system using a rail-mounted camera in which the camera is controlled to continuously track a target while the camera is moving along the rail.
0009In attaining the foregoing and other objects, the invention provides a method of operating a rail-based closed-circuit television surveillance system wherein the system includes an elongated track positioned along a path, a carriage supported and movable along the track for transporting a television camera along the path, carriage moving means coupled to the carriage for selectively moving the carriage along the track, camera control means for selectively adjusting a direction of view and a zoom condition of the television camera, and carriage control means for selectively positioning the carriage along the track, and wherein the method includes the steps of initializing the system by capturing an image of a predetermined target object by means of the television camera at respective times when the camera is at two different selected points along the track and storing initialization data indicative of the selected points and the respective directions of view of the camera used for capturing the target object image at the selected points; calculating from the stored initialization data an optimum viewpoint along the track for capturing an image of the predetermined target object and an optimum pan angle, an optimum tilt angle and an optimum zoom condition for capturing the image of. the predetermined target object when the camera is at the optimum viewpoint; receiving a target acquisition signal; and moving the carriage to the optimum viewpoint in response to the target acquisition signal.
0010According to an aspect of the invention, the direction of view of the camera is continuously adjusted while the carriage is moved from one of the two selected points to the optimum point so that the direction of view of the camera remains oriented towards the target object during the movement of the carriage from the one of the two selected points to the optimum point.
0011It is desirable that the optimum viewpoint be between the selected points used during initialization and that the optimum viewpoint be the closest point along the track to the target object.
0012In other practice in accordance with the invention, if the target acquisition signal is received at a time when the carriage is not between the two selected points, the carriage is moved toward the closer of the two points and the direction of view of the camera is adjusted, while the carriage is being moved toward the closer of the two selected points, so that the camera has the same direction of view that was used during the initialization to capture the image of the predetermined target object from the closer of the two selected points.
0013It is also contemplated by the invention that the carriage be reciprocated between the two selected points in response to the target acquisition signal and that the direction of view of the camera be continuously adjusted so that the direction of view of the camera remains oriented towards the target object during the reciprocating movement of the carriage.
0014The foregoing and other objects and features of the invention will be further understood from the following detailed description of preferred embodiments and practices thereof and from the drawings, wherein like reference numerals identify like components and parts throughout.
DESCRIPTION OF THE DRAWINGS
0015Fig. 1 is a perspective view of a closed-circuit television surveillance system, using a rail mounted camera, in which the present invention may be applied.
0016Fig. 2 is a block diagram of a surveillance system in accordance with the invention.
0017Figs. 3A and 3B are respectively top and back isometric schematic diagrams used for explaining initialization and automatic target acquisition procedures carried out in accordance with the invention.
0018Fig. 4 is a flow chart of an initialization routine carried out in accordance with the invention.
0019Fig. 5 is a flow chart of a routine carried out in accordance with the invention for automatically acquiring a target in response to an alarm signal.
DESCRIPTION OF PREFERRED EMBODIMENTS AND PRACTICES
0020Fig. 1 shows the interior of a building in which there is installed a surveillance system in accordance with the present invention. The system includes a surveillance camera 10 that is mounted on a carriage 12. The carriage 12, in turn, is movably supported on an elongated track or rail 14, which is suspended from the ceiling 16 of the building.
0021The camera 10 may be of a conventional type which is subject to remote control as to the direction in which the camera is oriented. In particular, the camera is controllable for horizontal pivoting movement, known as "panning", as well as vertical pivoting movement known as "tilting". Alternatively, as will be recognized by those skilled in the art, a motorized mirror assembly may be mounted on the carriage in association with the camera 10 for accomplishing tilting and panning adjustments of the direction of view of the camera.
0022The carriage 12 includes a motor 18 which is also subject to remote control by the surveillance system. Appropriate encoding such as optical encoding (not shown) is provided along the rail 14 so that the position of the carriage 12 along the rail can be sensed and an appropriate carriage position signal provided to the control system. Alternatively, other techniques may be employed to determine the position of the carriage, such as detecting operation of motor 18. Thus, the carriage can be controllably moved to desired positions along the rail 14. It should be understood that connections for controlling the camera 10 and the carriage 12 can be via cable (in which case a cable reel carriage may be provided integrated with or separate from camera carriage 12) or by wireless communication links.
0023Although not shown in Fig. 1, it will be recognized that an opaque cover or the like for hiding the camera 10 may be provided surrounding the rail 14 and the path of travel of the carriage 12.
0024The building interior shown in Fig. 1 includes a door 20 located at the end of an aisle 22 formed between racks or tiers 24 of merchandise or the like. A sensor 26 is installed in proximity to the door 20 and provides an alarm signal when, for example, the door is opened.
0025Fig. 2 illustrates the surveillance system of the present invention in block diagram form. At the heart of the system is a central processing unit (CPU) 28, which includes a microprocessor 30. Associated with the microprocessor 30 are a program memory 32, for storing control software, and a data memory 34 in which working data are stored, including, as will be seen, parameter data collected during an initialization routine. CPU 28 also includes an input/output (I/O) module 36 which is connected to microprocessor 30 and provides an interface between the CPU 28 and other portions of the surveillance system.
0026In particular, I/O module 36 is connected by way of a signal path 37 to a pan motor 38, a tilt motor 40, a zoom motor 42 and a rail motor 44. Pan motor 38 provides the above-mentioned panning adjustments for the video camera 10, tilt motor 40 provides the above-mentioned tilt adjustments of the video camera 10, zoom motor 42 implements changes in the zoom condition of the camera 10, and rail or carriage motor 44 propels the carriage 12 along the rail 14. Each of these motors receives control signals from the CPU 28 by way of the I/O module 36 and the signal path 37, and all of these motors are carried on the carriage 12 (although, as an alternative, the carriage 12 may be driven by an off-board motor through a belt drive or the like). It should also be understood that each of the motors 38, 40, 42, and 44 are arranged to provide position feedback signals indicative of the position of the motor or of the carriage, as the case may be. These signals are transmitted back to the CPU 28 by way of a signal path 46 and I/O module 36. The paths 37 and 46 may, for example, be embodied by appropriate caoling, or wireless data channels, etc.
0027Also connected to CPU 28 by way of I/O module 36 are a user terminal 48 and the above-mentioned sensor 26. The terminal 48 permits a human operator to input data to the CPU 28 in a conventional manner, and also permits the CPU 28 to display data to the human operator in a conventional manner. Also, the I/O module 36 is provided with a communication channel from the sensor 26 for receiving therefrom the above-mentioned alarm signal, upon opening of the door 20 (Fig. 1).
0028It should also be understood that the surveillance system shown in Fig. 2 provides the customary capabilities for remote control of the camera 10 and carriage 12 by the human operator, including selective positioning of the carriage 12, and panning, tilting and zooming of the camera 10, all by way of signals input via the terminal 48.
0029The surveillance system also includes a video display monitor 49 connected (or linked by wireless channel) to receive and display the video output signal provided by the camera 10. Although display 49 is shown as being separate from terminal 48, it is also contemplated to share a monitor portion of terminal 41 with display 49, by means of split screen, windowing, time sharing, superposition of a cursor and characters on the video display, and so forth.
0030Referring again to Fig. 1, it will be assumed that the rail 14, door 20 and merchandise tiers 24 are positioned with respect to each other so that the door 20 is within a line of sight of the camera 10 over a portion of the rail 12, but when the carriage 12 is positioned outside of that portion of the rail 14, the line of sight from the camera 10 to the door 20 is occluded by, for example, the tiers of merchandise 24. It is also assumed for the purposes of the,following discussion that the door 20 is a target for which automatic image acquisition is desired. Accordingly, there will first be described an initialization procedure during which appropriate data is stored in the CPU 28 to allow for an automatic target acquisition operation in accordance with the invention.
0031In describing the initialization procedure, reference will be made to Fig. 3A and 3B, which are respectively top and back diagrammatic views which illustrate geometric relationships among a target (assumed to be door 20), the rail 14 (taken to be the "z-axis"), and various positions along rail 14 at which the carriage 12 may be located. In the coordinate system used in Figs. 3A and 3B, the x-axis direction is taken to be the horizontal direction perpendicular to the rail 14, and the y-axis direction is taken to be the vertical direction. In addition, the horizontal plane which passes through the rail 14 will be referred to as the x-z plane, while the vertical plane which passes through rail 14 will be referred to as the y-z plane.
0032Point R1 corresponds to a right-most position on the rail 14 from which there is a line of sight to the target door 20, and point R2 corresponds to the left-most position on the rail 14 from which there is a line of sight to the target door 20. As seen from Figs. 3A and 3B, a zero-reference or origin point is taken to be at a leftward position along the rail(z-axis), so that the position index of R1 is larger than the position index of R2. Further, point Rn represents a position on the rail 14 that is closest to the target 20, and Rz indicates an arbitrary position between points R2 and R1 at which the carriage 12 and camera 10 may be located at any given time. It should also be understood that the system is arranged so that the camera 12 may at some times be at positions along rail 14 that are outside of the range defined between point R2 and R1. Further, and referring particularly to Fig. 3A, the line B1 represents the projection on the x-z plane of the line of sight from point R1 to the target, and, similarly, the line B2 represents the projection on the x-z plane of the line of sight from point R2 to the target. The dashed line Bz similarly represents the projection on the x-z plane of the line of sight from the arbitrary point Rz to the target, and the dotted line N represents the projection of the x-z plane of the line of sight from the point Rn to the target. The line segment A2 is defined between the points R2 and Rn, and the line segment A1 is defined between points Rn and R1. In addition, the line segment A12 is defined between the points Rn and Rz. The point Txz is located in the x-z plane directly above the target.
0033Moreover, the angle θ1 between line B1 and the z axis represents the required pan angle for the camera to acquire the target when the carriage is located at point R1, while the angle θ2 between the line B2 and the z axis represents the appropriate pan angle for the camera to acquire the target when the carriage is located at the point R2. Similarly, the angle θz formed between the line Bz and the z axis represents the appropriate pan angle for acquiring the,target when the camera is located at point R<sub>z</sub>.
0034Reference to Fig. 3B will indicate that the appropriate camera tilt angles for target acquisition from points R2, Rz and R1 are schematically represented by the angles α2, α<sub>z</sub> and α1. It will also be noted from Fig. 3B that the line Dz represents the line of sight from point Rz to the target (not a projection), while the dotted line Y is the projection on the y-z plane of a normal line from the z axis to the target. Thus Y represents the vertical distance between the target and the x-z plane.
0035Continuing to refer to Figs. 3A and 3B, and also now making reference to Fig. 4, there will be described an initialization routine to be carried out in accordance with the invention for enabling the surveillance system to perform automatic target acquisition.
0036As shown in Fig. 4, the initialization procedure is commenced at step 50 by entry of an appropriate signal via user terminal 48 so that the microprocessor 30 begins to carry out an initialization routine.
0037Following step 50 is step 52, at which appropriate data entry is made to identify the target for purposes of future reference within the surveillance system. For example, an appropriate prompt may be displayed on the terminal 48, and in response thereto the operator may enter a designation such as "target No. 1". In other words, the target object for which initialization data is about to be issued will thereafter be referred to within the surveillance system as "target No. 1" and a sensor or sensors associated with that target object will accordingly be recognized by the surveillance system as providing an alarm signal with respect to the identified target object. It is also contemplated that an alarm signal can be actuated with respect to a particular target by an appropriate operator input via the terminal 48. It will be understood that this arrangement permits the surveillance system to provide automatic acquisition for plural targets in response to respective alarm signals pertaining to the targets.
0038The next step in the initialization routine is. step 54, at which the terminal 48 is operated so that the carriage is moved to the point at the end (for example at the right end) of a rang of positions along the rail 14 from which the target object may be acquired by the camera 10. For the purposes of this example, that point will be identified as R1. For example, such a point may be a short distance to the right of aisle 22 as shown in Fig. 1. Once step 54 has been accomplished, step 56 is carried out, in which the operator causes the camera's direction of view to be adjusted, and perhaps also adjusts the zoom and focus condition of the camera, so that the target object (door 20) is imaged by the camera 10. When a satisfactory image of the target door 20 has been acquired through the camera 10, the human operator then enters a "select" signal or the like, in response to which the surveillance system stores in data memory 34 data which represents the current position (now assumed to be R1) of the carriage 12, as well as data indicating the pan and tilt angles of the direction of view of the camera 10 (step 58).
0039Following step 58 is step 60, at which the human operator moves the carriage 12 to the other end of the range from which there is a line of sight to the target door 20. In this case it is assumed that the other end is the left-most end of the viewable range, at point R2.
0040When the carriage has been properly positioned at R2, the operator again causes the camera direction and zoom/focus conditions to be adjusted so that a satisfactory image of the target door 20 is obtained (step 62). Then, at step 64, again the "select" signal is entered via the terminal 48 so that the data representing the carriage position, as well as the camera direction (pan and tilt angles) is entered into the data memory 34.
0041Step 66 follows, at which the position of point Rn is calculated on the basis of the data stored during steps 58 and 64. As noted before, point Rn is assumed to be the optimum point for acquiring an image of the target 20, namely the closest position to the target along rail 14.
0042This calculation begins by determining the values for angle for θ<sub>T1</sub> and θ<sub>T2</sub> (Fig. 3A) which are respectively complimentary angles to θ1 and θ2. Thus, calculations are made according to the following formulas:<maths id="math0001" num="(1)"><math display="block"><mrow><msub><mrow><mtext>θ</mtext></mrow><mrow><mtext>T1</mtext></mrow></msub><mtext> = 90° - θ1</mtext></mrow></math><img file="EP0701232B1_D0001.tif" /></maths><maths id="math0002" num="(2)"><math display="block"><mrow><msub><mrow><mtext>θ</mtext></mrow><mrow><mtext>T2</mtext></mrow></msub><mtext> = 90° - θ2.</mtext></mrow></math><img file="EP0701232B1_D0002.tif" /></maths>
0043Then a parameter k<sub>1</sub> is calculated according to the formula<maths id="math0003" num="(3)"><math display="block"><mrow><mtext mathvariant="italic">k</mtext><mtext> = </mtext><mfrac><mrow><msub><mrow><mtext>tanΘ</mtext></mrow><mrow><mtext mathvariant="italic">T1</mtext></mrow></msub></mrow><mrow><msub><mrow><mtext>tanΘ</mtext></mrow><mrow><mtext mathvariant="italic">T2</mtext></mrow></msub></mrow></mfrac></mrow></math><img file="EP0701232B1_D0003.tif" /></maths>
0044It will be recognized that the parameter k is equal to the ratio of the lengths of the line segments A1 and A2; that is,<maths id="math0004" num="(4)"><math display="block"><mrow><mtext mathvariant="italic">k</mtext><mtext> = </mtext><mfrac><mrow><mtext>A</mtext><mtext mathvariant="italic">1</mtext></mrow><mrow><mtext>A</mtext><mtext mathvariant="italic">2</mtext></mrow></mfrac></mrow></math><img file="EP0701232B1_D0004.tif" /></maths>
0045Next the distance Z between the points R1 and R2 is calculated according to:<maths id="math0005" num="(5)"><math display="block"><mrow><mtext>Z = R1 - R2.</mtext></mrow></math><img file="EP0701232B1_D0005.tif" /></maths>
0046Since<maths id="math0006" num="(6)"><math display="block"><mrow><mtext>Z = A1 + A2</mtext></mrow></math><img file="EP0701232B1_D0006.tif" /></maths> the simultaneous equations (4) and (6) can be solved to express A1 and A2 in terms of k and Z as follows:<maths id="math0007" num="(7)"><math display="block"><mrow><mtext mathvariant="italic">A1</mtext><mtext> = </mtext><mfrac><mrow><mtext mathvariant="italic">kZ</mtext><mtext></mtext></mrow><mrow><mtext>1 + </mtext><mtext mathvariant="italic">k</mtext></mrow></mfrac></mrow></math><img file="EP0701232B1_D0007.tif" /></maths><maths id="math0008" num="(8)"><math display="block"><mrow><mtext mathvariant="italic">A2</mtext><mtext> = </mtext><mtext mathvariant="italic">Z</mtext><mtext>(1 - </mtext><mfrac><mrow><mtext mathvariant="italic">k</mtext></mrow><mrow><mtext>1 + </mtext><mtext mathvariant="italic">k</mtext></mrow></mfrac><mtext>)</mtext></mrow></math><img file="EP0701232B1_D0008.tif" /></maths>
0047Then Rn can be calculated either as (R1 - A1) or (R2 + A2). Step 66 may be considered complete upon calculation of the position of the optimum viewpoint Rn.
0048As will be seen, the calculated position of Rn, together with the stored data indicative of the locations and the appropriate pan and tilt angles for the points R2 and R1, make it possible to calculate an appropriate camera direction (pan and tilt angles) as well as appropriate zoom and focus conditions for target acquisition from any carriage position between points R2 and R1. It will be understood that the zoom and focus conditions are a function of the distance from the carriage position to the target, and this quantity can be calculated based on the stored data.
0049There will now be described, with reference to Fig. 5, an operation in which the surveillance system automatically acquires an image of the target on the basis of the data stored and calculated during the initialization procedure of Fig. 4.
0050It is assumed that the automatic target acquisition routine is entered from a normal surveillance routine, represented by a step 70 in Fig. 5. Specifically, it should be understood that step 70 may include an automatically controlled procedure in which the carriage 12 is moved along rail 14 according to a predetermined pattern, while the direction, zoom, focus and so forth of the camera 10 are also adjusted in a predetermined pattern so that camera 10 performs routine surveillance by "walking a beat."
0051As indicated at step 72, the normal surveillance routine 70 continues until an alarm signal is received. Step 72 may be implemented by applying an interrupt to microprocessor 30 upon receipt of an alarm signal. Alternatively, for example, periodic polling may be carried out during normal surveillance to detect the presence of an alarm signal. If an alarm signal is received it is then determined whether the carriage 12 is located within range along the rail 14 from which there is a line of sight to the target (step 74). It will be assumed in the present case, initially, that an alarm signal has been generated by the sensor 26 associated with the door 20 ("target No. 1") and that the carriage 12 is at a point Rz (Figs. 3A and 3B) that is between points R1 and R2, and thus is within the range from which the target 20 can be acquired by the camera 10. In accordance with this assumption, step 76 follows step 74, and in step 76 the surveillance system (CPU 28) calculates an appropriate pan angle tilt angle, zoom condition and focus condition for the camera 10 so that an image of target 20 can be immediately provided on the video display 49.
0052First the calculation of the pan angle θz will be described with reference to Fig. 3A. Using the common side of the triangles Rn/R1/Txz and Rn/Rz/Txz, the following equation can be obtained:<maths id="math0009" num="(9)"><math display="block"><mrow><mfrac><mrow><mtext>A1</mtext></mrow><mrow><msub><mrow><mtext>tan θ</mtext></mrow><mrow><mtext>T1</mtext></mrow></msub></mrow></mfrac><mtext>= </mtext><mfrac><mrow><mtext>A12</mtext></mrow><mrow><mtext>tan θzc</mtext></mrow></mfrac></mrow></math><img file="EP0701232B1_D0009.tif" /></maths> where θzc is the complimentary angle to θz.
0053This equation can be rewritten as<maths id="math0010" num="(10)"><math display="block"><mrow><mtext>tan θzc = </mtext><mfrac><mrow><mtext>A12 </mtext></mrow><mrow><mtext>A1</mtext></mrow></mfrac><msub><mrow><mtext>(tan θ</mtext></mrow><mrow><mtext>T1</mtext></mrow></msub><mtext>)</mtext></mrow></math><img file="EP0701232B1_D0010.tif" /></maths>
0054Since<maths id="math0011" num=""><math display="block"><mrow><mtext>θz = 90° - θzc</mtext></mrow></math><img file="EP0701232B1_D0011.tif" /></maths> it follows from equation 10 that the pan angle θz can be calculated as follows:<maths id="math0012" num="(11)"><math display="block"><mrow><mtext>Θ</mtext><mtext mathvariant="italic">z</mtext><msup><mrow><mtext> = 90° - tan</mtext></mrow><mrow><mtext>-1</mtext></mrow></msup><mtext>[(</mtext><mfrac><mrow><mtext mathvariant="italic">A12</mtext></mrow><mrow><mtext mathvariant="italic">A1</mtext></mrow></mfrac><msub><mrow><mtext>)tanΘ</mtext></mrow><mrow><mtext mathvariant="italic">T1</mtext></mrow></msub><mtext>]</mtext></mrow></math><img file="EP0701232B1_D0012.tif" /></maths>
0055From equation 11, it will be recognized that the pan angle θz can be readily calculated from the initialization data and the current position Rz.
0056Alternatively, θz can be calculated according to the following equation:<maths id="math0013" num=""><math display="block"><mrow><mtext>Θ</mtext><mtext mathvariant="italic">z</mtext><msup><mrow><mtext> = tan</mtext></mrow><mrow><mtext>-1</mtext></mrow></msup><mtext>(</mtext><mfrac><mrow><mtext mathvariant="italic">A1</mtext><mtext>·tanΘ1</mtext></mrow><mrow><mtext mathvariant="italic">A12</mtext></mrow></mfrac><mtext>) (11</mtext><mtext mathvariant="italic">A</mtext><mtext>)</mtext></mrow></math><img file="EP0701232B1_D0013.tif" /></maths> which can be obtained from,<maths id="math0014" num="(11B)"><math display="block"><mrow><mtext>N = A1·tanθ1</mtext></mrow></math><img file="EP0701232B1_D0014.tif" /></maths> and<maths id="math0015" num=""><math display="block"><mrow><msub><mrow><mtext>Θ</mtext></mrow><mrow><mtext mathvariant="italic">z</mtext></mrow></msub><msup><mrow><mtext> = tan</mtext></mrow><mrow><mtext>-1</mtext></mrow></msup><mtext>(</mtext><mfrac><mrow><mtext mathvariant="italic">N</mtext><mtext></mtext></mrow><mrow><mtext mathvariant="italic">A12</mtext></mrow></mfrac><mtext>) (11</mtext><mtext mathvariant="italic">C</mtext><mtext>)</mtext></mrow></math><img file="EP0701232B1_D0015.tif" /></maths>
0057In order to find the tilt angle α<sub>z</sub> (Fig. 3B), the vertical distance Y between the target and the x-z plane is first calculated according to the formula:<maths id="math0016" num="(12)"><math display="block"><mrow><mtext mathvariant="italic">Y</mtext><mtext> = (</mtext><mfrac><mrow><mtext mathvariant="italic">A1</mtext></mrow><mrow><mtext>cos Θ1</mtext></mrow></mfrac><mtext>) tanα1</mtext></mrow></math><img file="EP0701232B1_D0016.tif" /></maths>
0058(As an alternative to calculating Y during automatic target acquisition, Y may be calculated at step 66 of the initializatior routine (Fig. 4).)
0059Then α<sub>z</sub> is determined according to:<maths id="math0017" num="(13)"><math display="block"><mrow><msub><mrow><mtext>α</mtext></mrow><mrow><mtext mathvariant="italic">z</mtext></mrow></msub><msup><mrow><mtext> = tan</mtext></mrow><mrow><mtext>-1</mtext></mrow></msup><mtext>(</mtext><mfrac><mrow><mtext mathvariant="italic">Ycos</mtext><msub><mrow><mtext>Θ</mtext></mrow><mrow><mtext mathvariant="italic">z</mtext></mrow></msub></mrow><mrow><mtext mathvariant="italic">A12</mtext></mrow></mfrac><msup><mrow><mtext>) = tan</mtext></mrow><mrow><mtext>-1</mtext></mrow></msup><mtext>(</mtext><mfrac><mrow><mtext mathvariant="italic">Y</mtext></mrow><mrow><msub><mrow><mtext mathvariant="italic">B</mtext></mrow><mrow><mtext mathvariant="italic">z</mtext></mrow></msub></mrow></mfrac><mtext>)</mtext></mrow></math><img file="EP0701232B1_D0017.tif" /></maths>
0060Next, in order to determine the appropriate zoom and focus conditions for the camera 10, the distance Dz from the point Rz to the target along the line of sight from point Rz for the target is calculated.
0061First it will be noted that<maths id="math0018" num="(14)"><math display="block"><mrow><msub><mrow><mtext>cos α</mtext></mrow><mrow><mtext mathvariant="italic">z</mtext></mrow></msub><mtext> = </mtext><mfrac><mrow><msub><mrow><mtext mathvariant="italic">B</mtext></mrow><mrow><mtext mathvariant="italic">z</mtext></mrow></msub></mrow><mrow><msub><mrow><mtext mathvariant="italic">D</mtext></mrow><mrow><mtext mathvariant="italic">z</mtext></mrow></msub><msup><mrow><mtext></mtext></mrow><mrow><mtext mathvariant="italic">o</mtext></mrow></msup></mrow></mfrac></mrow></math><img file="EP0701232B1_D0018.tif" /></maths> so that<maths id="math0019" num="(15)"><math display="block"><mrow><mtext>Dz = </mtext><mfrac><mrow><mtext mathvariant="italic">Bz</mtext><mtext></mtext></mrow><mrow><msub><mrow><mtext>cos α</mtext></mrow><mrow><mtext>z</mtext></mrow></msub></mrow></mfrac></mrow></math><img file="EP0701232B1_D0019.tif" /></maths> Then, substituting for α <sub>z</sub> (from equation 13), and expanding, yields:<maths id="math0020" num=""><img file="EP0701232B1_D0020.tif" /></maths>
0062Then, since Bz = A12/cos θz, substituting in equation 16, provides<maths id="math0021" num=""><img file="EP0701232B1_D0021.tif" /></maths>
0063Thus it is seen that the distance to the target from the current position of the camera 10 can be expressed in terms of the current position of the carriage 12 and other data that has previously been stored or calculated. Accordingly, at step 78, which follows step 76, the direction of view of the camera adjusted in accordance with the calculated pan and tilt angles and the appropriate zoom and focus conditions are applied so that the camera 10 provides an image of the target door 20. Then step 80 follows step 78, so that the carriage 12 is moved from the point Rz, at which the carriage was located when the alarm was received, to the optimum viewpoint Rn. Also, while this carriage movement is taking place, the pan angle, the tilt angle, the zoom condition and the focus condition are continuously updated, by calculations as described above, so that the camera continues to "track" the target; that is, the camera continuously provides an image of the target while the carriage is in motion from point Rz to point Rn.
0064As will be recognized by those of ordinary skill in the art the above described calculations and adjustments to the camera direction, zoom condition, etc. are performed quite rapidly relative to the motion of the carriage, which makes possible the continuous tracking of the target by the camera. Of course, it is also possible to overlap in time the logically separate operations described above with respect to steps 76, 78 and 80.
0065Returning now to decision step 74, let it be assumed that, at the time the alarm signal was received, the carriage 12 was positioned outside of the range defined by points R2 and R1, and more specifically, assume that the carriage 12 was located to the right of point R1.
0066In that case, it is determined at step 74 that the carriage 12 is not within the range from which the target can be acquired, and step 82 therefore follows step 74. At step 82, it is first determined whether the carriage 12 is closer to point R1 or point R2, and then the pan and tilt angles and the zoom and focus conditions for the camera are established in accordance with the previously stored parameters appropriate for that nearest point. Since, according to the present assumption, R1 is the nearest of the two points, the camera is adjusted to have a pan angle θ1 and a tilt angle α<sub>1</sub>. It will also be recognized that the appropriate camera focus and zoom conditions for the two limit points R1 and R2 can either be stored as part of the initialization procedure or can be calculated from other data obtained during initialization.
0067Following step 82 is step 84, at which the carriage 12 is moved toward the nearest limit point, in this case R1. Because the camera has already been adjusted so as to assume the appropriate pan and tilt, etc. for point R1, it will be understood that the target will be acquired immediately when the carriage reaches point R1.
0068Following step 84 is a decision step 86, at which it is determined whether the nearest limit point has been reached. If not, the routine loops back to step 84. Otherwise, the routine proceeds to step 80, at which the carriage is moved from the limit point to optimum position Rn while providing continuous tracking of the target by the camera 10.
0069It should also be noted that although steps 82 and 84 are presented as logically separate, those two steps can be overlapped in time so that the camera angle adjustment is carried out during movement of the carriage 12 toward the nearest point.
0070The above description of steps 76 and 80 referred to calculations carried out to obtain pan, tilt, zoom and focus data for immediate target acquisition in response to an alarm (step 76) or during carriage movement (step 80) to update the pan and tilt angles and the zoom and focus conditions so that target acquisition was maintained during the carriage movement within the viewing range. However, according to an alternative preferred practice, pan, tilt, zoom and focus data are retrieved for target acquisition from a look up table that was formed during initialization. More specifically, according to this preferred practice, step 66 of the initialization procedure (Fig. 4) includes calculating, for each separately detectable carriage position in the target viewing range, appropriate pan, tilt, zoom and focus parameters for target acquisition. The resulting data is stored in a look up table for the target, and indexed in the table according to carriage position. The parameters stored in the look up table entries for the limit points are, of course, those obtained at steps 58 and 64. Then, during the target acquisition routine of Fig. 5, access is had to the look up table corresponding to the target to be acquired, and camera positioning and focus and zoom data are read out based on the current carriage position. If the current carriage position is outside of the viewing range for the target, the camera positioning data corresponding to the nearest position in the viewing range (i.e., the nearest limit point) is read out.
0071According to an alternative technique for practicing the invention, the procedure described with respect to step 80 can be changed, or selectively changed, so that the carriage 12 is caused to reciprocate or "pace" back and forth between the points R1 and R2 in response to receipt of an alarm signal. While such "pacing" takes place, calculations as described above are carried out (or positioning data is retrieved from a look up table) so that the camera continuously tracks the target. The "pacing" may also be arranged to be performed over less than the entire range from which a line of sight exists. It is also contemplated that the carriage be moved, in response to an alarm, according to more complex patterns than simple pacing between two points in the viewing range. For example, the system could be programmed during initialization so that, in response to an alarm, the carriage first paces a predetermined number of times between the optimum viewpoint and the right limit point, and then paces a predetermined number of times between the optimum viewpoint and the left limit point, and then paces again between the optimum viewpoint and the right limit point, and so forth. As an alternative "beat" that could be programmed to be "walked" in response to an alarm, the carriage could be reciprocated several times over a narrow range around the optimum point, then over a wider range around the optimum point, and then over a still wider range. Other variations and permutations of such programmed responses to an alarm will readily occur to those who are skilled in the art.
0072Further, although the above-described practice of the invention entails calculating the location of a closest point Rn to the target to provide an optimum viewpoint, it is possible as an alternative to manually set the desired optimum viewpoint during initialization. For example, if some obstruction happens to block the line of sight from the closest point Rn to the target, a different point can be manually selected and appropriate pan, tilt and zoom data stored.
0073It should also be understood that an alarm signal can be generated from a source other than a sensor. For example, an alarm signal can be actuated by appropriate operator input via terminal 48 in a circumstance in which the operator wishes to obtain rapid and automatic acquisition of a particular target.
0074Various changes to the foregoing surveillance system and modifications in the described practices may be introduced without departing from the invention. The particularly preferred methods and apparatus are thus intended in an illustrative and not limiting sense. The scope of the invention is set forth in the following claims.
Contents5
26 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| WO9222172A | Cites | World Intellectual Property Organization (WIPO) |
| FR2633134A | Cites | France |
| US4027329A | Cites | United States of America |
| US4510526A | Cites | United States of America |
| US5225863A | Cites | United States of America |
| US5327233A | Cites | United States of America |
11 members in 6 offices; this record represents the family
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 30234194 | United States of America | A | |
| 302341 | United States of America | – | |
| US19940302341 | – | – | – |
| 302341 | – | – | – |
Members11
| Document | Office | Kind | |
|---|---|---|---|
| CA2149730A1 | Canada | A1 | |
| EP0701232A2 | European Patent Office (EPO) | A2 | |
| JPH0888847A | Japan | A | |
| US5526041A | United States of America | A | |
| BR9503950A | Brazil | A | |
| BR9503950A | Brazil | A | |
| EP0701232A3 | European Patent Office (EPO) | A3 | |
| EP0701232B1This record | European Patent Office (EPO) | B1 | |
| DE69526397D1 | Germany | D1 | |
| DE69526397T2 | Germany | T2 | |
| CA2149730C | Canada | C |
36 legal events, as 4 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent expired after termination of 20 yearsExpiredPE20 | PE20 | GB | |
| Expiry of rightR071 | R071 | DE | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Change of applicant/patenteeR081 | R081 | DE | |
| Change of applicant/patenteeR081 | R081 | DE | |
| Change of representativeR082 | R082 | DE | |
| Change of representativeR082 | R082 | DE | |
| Transmission of propertyTP | TP | FR | |
| Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)REGISTERED BETWEEN 20101111 AND 20101117732E | 732E | GB | |
| Se: european patent has lapsedLapsedEUG | EUG | EP | |
| Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)732E | 732E | GB | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Change of addressCA | CA | FR | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Fr: translation filedET | ET | EP | |
| Corresponds to:REF | REF | EP | |
| Designated contracting statesAK | AK | EP | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOS IGRAGRAH | GRAH | EP | |
| European patent in force as of 2002-01-01IF02 | IF02 | GB | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| Despatch of communication of intention to grantORIGINAL CODE: EPIDOS AGRAGRAG | GRAG | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOS IGRAGRAH | GRAH | EP | |
| Despatch of communication of intention to grantORIGINAL CODE: EPIDOS AGRAGRAG | GRAG | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP | |
| Designated contracting statesAK | AK | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 0701232
- Publication, DOCDB
- 0701232
- Publication, EPODOC
- EP0701232
- Application
- 95112903
- Application, DOCDB
- 95112903
- Application, EPODOC
- EP19950112903
Titles3
- German
- Geschlossenes Fernsehüberwachungssystem mit fahrbarer Kamera und selbsttätiger Zielerfassung
- English
- Rail-based closed circuit T.V. surveillance system with automatic target acquisition
- French
- Système de télévision à circuit fermé à caméra mobile et acquisition automatique de cible
Classification
- CPC, 3
- G08B13/19689
- G08B13/19623
- G08B13/1968
- IPC, 4
- H04N5 232
- G08B13 196
- G08B15 00
- H04N7 18
Designated states4
- Contracting states, 4
- Germany
- France
- United Kingdom
- Sweden
