Event driven video tracking system
9 claims: 2 independent, 7 dependent
- 1An event driven video tracking system, comprising a first video surveillance camera (24) having video coverage within a first zone (4), said first video surveillance camera (24) including means for tracking an image within said first zone (4);and a second video surveillance camera (26) having video coverage within a second zone (4), said first zone (4) and said second zone (4) having an overlapping portion, said second video surveillance camera (26) having means for acquiring said image within said overlapping portion, and including means for tracking said image within said second zone (4) said system comprising RFID tags (20) connected to assets and at least one zone sensor (12) comprising an RFID reader (22) for sensing a preselected event caused by one of said RFID tags (20), said preselected event having a location disposed within said first zone (4);characterized in that said first video surveillance camera (24) responsive to said zone sensor (12), said zone sensor (12) activating said first video surveillance camera (24) in response to said preselected event, wherein said first video surveillance camera (24) monitors an image associated with said preselected event, said system comprising a video controller (2) activating the second video surveillance camera (26) and passing along the location of said image to said second video surveillance camera (26) when the RFID tag (20) moves into said overlapping portion.
- 9A method for tracking a video image initiated by an even comprising:providing an event driven video tracking system comprising a first (24) and a second (26) video camera, wherein said first video surveillance camera (24) including means for tracking said image within a first zone and said second video surveillance camera having video coverage within a second zone, said first zone and said second zone having an overlapping portion, said second video surveillance camera (26) having means for acquiring said image within said overlapping portion and including means for tracking said image within said second zone (4) sensing the occurrence of a preselected event by reading from an RFID reader an RFID tag (20) connected to an asset within a first zone (4) within the video coverage of said first video surveillance camera (24), characterized in that activating said first video surveillance camera (24) in response to said preselected event, monitoring an image associated with said preselected event, and tracking said image within said first zone (4), said system comprising a video controller (2) activating the second video surveillance camera (26) and passing along the location of said image to said second video surveillance camera when the RFID tag (20) moves into said overlapping portion.
Independent claims2
23 paragraphs in 4 sections, as filed
BACKGROUND OF THE INVENTION
Field of the Invention
0001This invention relates to video tracking of moving targets, and more particularly to video tracking initiated by an event trigger and where the target is tracked through a plurality of video zones.
Description of the Related Art
0002There are presently systems, such as disclosed in <patcit id="pcit0001" dnum="US5708423A"><text>U.S. Patent No. 5,708,423</text></patcit>, for keeping track of the location of individuals or objects by attaching transponders to the individuals or objects and receiving identification signals transmitted by the transponders. A common technology to accomplish this is termed radio frequency identification (RFID). Typically, each transponder transmits a unique identification signal, which is used to identify the individual or object to which the transponder is attached. The identification signals generated by the transponders in such systems are, in general, to be received by an antenna and associated receiving circuitry. In some cases, the antenna is to be associated with a doorway or portal, which gives access to a room. There has also been some consideration given to determining the direction of an object being tracked with respect to a portal. A building in which articles are to be tracked may include a number of controlled zones, and zones that are not controlled. Articles may be permitted in certain zones, but not other zones. Alarms are often used to alert personnel of articles that are moved into or removed from specific controlled zones.
0003Controlled zones and associated portals may also be under video surveillance. Alarms are typically used to trigger video recording equipment to record various zones of interest. As disclosed in <patcit id="pcit0002" dnum="US6028626A"><text>U.S. Patent No. 6,028,626</text></patcit>, the video surveillance system may be capable of determining speed, direction, and acceleration of objects within the video coverage.
0004Problems currently exist in present technology when certain incidents occur. For example, when a triggering event occurs, such as when an article with an attached RFID tag passes through an RFID monitored portal, video surveillance of the portal and/or associated zone may be initiated. When the triggering article moves into a different zone that may not include RFID antennas, the video surveillance in that zone will not be triggered and video surveillance of the article will be lost. Zone to zone video surveillance of specific assets is needed. In another example, an article may be authorized for removal from a controlled zone only by certain personnel. Without manual intervention, an alarm will be triggered if the article removed from the zone, even if the person removing the article has the proper authority to remove the article. Association of an asset with, not only a zone, but with a specific person is needed.
0005<patcit id="pcit0003" dnum="US5317394A"><text>US 5,317,394</text></patcit> discloses an imaging system comprising a plurality of video sensors capable of sensing objects within a field of view about a sight line. At least two sensors have different sight lines which the sight lines having known relative positions. Each sensor produces signals corresponding to positions of objects within a field of view over time. At least one sensor signal memory receives those signals and stores them in a manner enabling concurrent access to signals received from any selected combination of sensors. Motion detectors are provided for determining vibration, flexure or movement of each sensor.
0006<patcit id="pcit0004" dnum="FR2805895A1"><text>FR 2 805 895 A1</text></patcit> discloses a tracking system for tracking visitors of a fun park. There are means for acquiring images or sound, if a visitor enters an observation zone. The entry into the observation zone is sensed with identification means that identify an identification badge that must be carried by the visitor.
BRIEF SUMMARY OF THE INVENTION
0007The present invention provides a system that tracks assets from zone to zone within a controlled location. The tracking is initiated by a triggering event. The system may also electronically identify the assets, and selectively records and displays the asset and identity.
0008The invention discloses an event driver video tracking system according to claim 1 and a corresponding method according to claim 9.
0009The system may have a plurality of the sensors and a plurality of video surveillance cameras defining a plurality of zones.
0010A predictive algorithm for predicting the speed and direction of the image can be used for tracking of the image.
0011In acquiring the image within the overlapping portion, translating coordinates of the image from the first zone to the second zone may be used.
0012Claim 9 characterizes a method for tracking a video image initiated by an event.
0013Objectives, advantages, and applications of the present invention will be made apparent by the following detailed description of embodiments of the invention.
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
0014<ul id="ul0001" list-style="none" compact="compact"><li><figref idref="f0001">Figure 1</figref> is a block diagram of one embodiment of the present invention.</li><li><figref idref="f0002">Figure 2</figref> is an illustrative block diagram of video zone handoff of assets in the present invention.</li></ul>
DETAILED DESCRIPTION OF THE INVENTION
0015Referring to <figref idref="f0001">Fig. 1</figref>, video controller 2 controls each of "n" video surveillance zones 4, where "n" is greater than or equal (≥) to 2. Each video surveillance zone 4 can have a fixed focal length, zoom, pan and tilt, wide angle, or other camera, which is controlled by video controller 2. Video controller 2 also controls video recorder 6, which can be one or more analog or digital recorders, and video display 8, which can be one or more video displays. Event driven tracking controller 10, directs how the video controller 2 controls the video cameras in video surveillance zones 4 for tracking an asset. Event driven tracking controller 10 receives input from zone sensor 12. Zone sensor 12 uses one or more sensors "m", where "m" ≥ 1, to monitor selected areas called zones. Sensor "m" can be an RFD reader, infrared sensor, motion senor, optical sensor, audio sensor, or another sensor the output of which can be used to trigger event driven tracking controller 10. Event driven tracking controller 10 communicates with asset database 14, which includes a list of all the assets under system control, and can include the zones in which each asset is authorized to be within. If the asset leaves its associated zone, the video surveillance is triggered. Asset database 14 may include other rules as desired for asset control. An example of a rule is to trigger video tracking if a specific person enters a controlled area. An alternate rule would be asset number X is not permitted to leave controlled zone Y unless accompanied by one of assets A, B, or C, where A, B, and C are personnel authorized to remove asset X from zone Y. If the rule is violated, video tracking is triggered. Other associated actions can be initiated, such as alarms, automatic calls to authorized personnel, and other desired actions can be triggered as-well-as video tracking. Rule selection for the intended application is flexible, and can be implemented via programming.
0016Upon a triggering input to event driven tracking controller 10 from zone sensor 12, the event driven tracking controller 10 directs video controller 2 to begin tracking the asset in the appropriate video surveillance zone 4, and identifies the asset if the triggering event includes identification. The triggering event may be selected as desired, and may be an RFID read, which would include the asset's identification, or other sensor input that may not include identification, from a zone of interest. Once the video controller begins tracking the asset, the asset's identification, if known, can be stored and displayed, along with the video image, in video recorder 6 and video display 8, respectively. If multiple triggering events occur, a plurality of assets can be tracked, and identified.
0017Referring to <figref idref="f0002">Fig. 2</figref>, one embodiment will be operationally described to illustrate the invention. Sensor "m" will be one or more RFID reader 22, and the input from zone sensor 12 to event driven tracking controller 10 will be the output of an RFID reader 22, which may be positioned near an entrance to video surveillance zone 1. Video surveillance zone 1 and video surveillance zone 2 are under surveillance by video camera 24 and video camera 26, respectively, which are controlled by video controller 2. Upon entry into zone 1, RFID reader 22 reads RFID tag 20. RFID reader 22 is in communication with event driven tracking controller 10, as shown by zone sensor 12 in <figref idref="f0001">Fig. 1</figref>, and communicates relevant information about the asset to which RFID tag 20 is connected, attached, or associated. Event driven tracking controller 10 is in communication with asset database 14 and will associate the information received from RFID tag 20 with relevant stored information.
0018As stated above, asset database 14 can include rules to be used to determine triggering events. Triggering events are events that occur with assets that are desired to be video tracked, and recorded and/or displayed. Assuming the information obtained from RFID tag 20 and communicated to event driven tracking controller 10 is a triggering event, event driven tracking controller 10 commands video controller 2 to begin tracking the triggering asset. At this point, the location of the asset will be known as it will be adjacent the RFID reader 22, and the tracking video camera 24 will easily acquire an image of the asset. The asset will now be under video surveillance and it will be identified according to information obtained from the RFID tag 20, and/or asset database 14. The asset can be a person with an RFID badge or an object with an RFID tag concealed within, connected to, attached to, or associated with in some manner. As the asset moves within zone 1, camera 24, under control of video controller 2, will track the asset, electronically and/or mechanically depending on the camera used. When RFID tag 20 moves into zone 1+2, video controller 2 will activate camera 26 and will pass along the location of the image associated with RFID tag 20 as known from camera 24. There are multiple ways in which the position of RFID tag 20 can be passed, such as establishing a coordinate system associated with each camera and translating the coordinates from the coordinate system of camera 24 to the coordinate system of camera 26. As RFID tag 20 moves into zone 2, camera 26 will continue surveillance, and camera 24 will lose surveillance. The number of zones and cameras can increase to virtually an unlimited number.
0019A combination of triggering sensors "m" can be used. For example, in certain zones only a motion detector may be implemented, the asset will be tracked but may not be identified. As the asset is tracked, it may move into a zone having an RFID sensor. Once the RFID reader 22 communicates with controller 10, the asset will be identified. Many other variations of sensors and zones are possible and easily accounted for with flexible programming of video controller 2 and event controller 10.
0020To assist in tracking the asset, video controller 2 may use predictive algorithm 16, as shown in <figref idref="f0001">Fig. 1</figref>, to determine useful tracking features of the asset. Useful tracking features included the image speed, direction, acceleration, and other relevant parameters. Optical flow computation, and other known techniques can be used in the predictive algorithm 16. The use of predictive algorithm 16 is particularly advantageous when the surveillance camera used is electronically or mechanically capable of pan and tilt, and zoom functions.
0021It is to be understood that variations and modifications of the present invention can be made without departing from the scope of the invention. The example provided in <figref idref="f0002">Fig. 2</figref> is one embodiment and the specific implementation details can be altered. For example, a single controller or computer, or a plurality of controllers or computers may be implemented to perform the stated functions. It is also to be understood that the scope of the invention is not to be interpreted as limited to the specific embodiments disclosed herein, but only in accordance with the appended claims when read in light of the forgoing disclosure.
Contents4
2 sheets
Sheet 1 Sheet 2
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| FR2805895A1 | Cites | France | Examiner |
| FR2805895A1 | Cites | France | – |
| US4952911A | Cites | United States of America | – |
| US5317394A | Cites | United States of America | – |
| US5708423A | Cites | United States of America | – |
| US5949335A | Cites | United States of America | – |
| US6580385B1 | Cites | United States of America | – |
23 members in 13 offices
Priority claims3
| Document | Office | Kind | Date |
|---|---|---|---|
| 308508 | United States of America | – | |
| 30850802 | United States of America | A | |
| 0336674 | United States of America | W |
Members23
| Document | Office | Kind | |
|---|---|---|---|
| US2004105006A1 | United States of America | A1 | |
| CA2504788A1 | Canada | A1 | |
| WO2004051985A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU2003290998A1 | Australia | A1 | |
| US6791603B2 | United States of America | B2 | |
| TW200507632A | Taiwan Province of China | A | |
| AR042283A1 | Argentina | A1 | |
| KR20050084060A | Republic of Korea | A | |
| EP1568213A1 | European Patent Office (EPO) | A1 | |
| BR0316342A | Brazil | A | |
| CN1720719A | China | A | |
| JP2006509422A | Japan | A | |
| HK1086414A1 | Hong Kong, China | A1 | |
| TWI289404B | Taiwan Province of China | B | |
| CN100355270C | China | C | |
| AU2003290998B2 | Australia | B2 | |
| JP2009159648A | Japan | A | |
| EP1568213A4 | European Patent Office (EPO) | A4 | |
| KR101046873B1 | Republic of Korea | B1 | |
| CA2504788C | Canada | C | |
| EP1568213B1This record | European Patent Office (EPO) | B1 | |
| ES2397278T3 | Spain | T3 | |
| BRPI0316342A8 | Brazil | A8 |
69 legal events, as 9 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Announcement of lapse in spainLapsedFD2A | FD2A | ES | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| No opposition filedOpposition26N | 26N | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Notification of lapseLapsedST | ST | FR | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Patent lapsedLapsedMM4A | MM4A | IE | |
| Change of applicant/patenteeR081 | R081 | DE | |
| Change of applicant/patenteeR081 | R081 | DE | |
| Change of applicant/patenteeR081 | R081 | DE | |
| Change of applicant/patenteeR081 | R081 | DE | |
| Change of representativeR082 | R082 | DE | |
| Change of representativeR082 | R082 | DE | |
| Change of representativeR082 | R082 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| Change of representativeR082 | R082 | DE | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Deletion acc. to par. 5 (withdrawal of the translation of the ep patent)MK05 | MK05 | AT | |
| Discontinued in the netherlands as no translation has been filedVDEP | VDEP | NL | |
| Definitive protectionFG2A | FG2A | ES | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Dpma publication of mentioned ep patent grantGrantedR096 | R096 | DE | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Reference to at number (ep patent enters austrian national phase)REF | REF | AT | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Supplementary search report drawn up and despatchedA4 | A4 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information on inventor provided before grant (corrected)RIN1 | RIN1 | EP | |
| Information on inventor provided before grant (corrected)RIN1 | RIN1 | EP | |
| Request for extension of the european patent (deleted)DAX | DAX | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1568213
- Application
- 37835832
Titles3
- German
- EREIGNISGESTEUERTES VIDEO-TRACKING-SYSTEM
- English
- EVENT DRIVEN VIDEO TRACKING SYSTEM
- French
- SYSTEME DE POURSUITE VIDEO DECLENCHE PAR L'EVENEMENT
Classification
- CPC, 7
- G01S3/7864
- H04N7/18
- G07C9/28
- G06V20/44
- G06V20/52
- G06F18/251
- H04N23/00
- IPC, 4
- H04N5 225
- H04N7 18
- G01S3 786
- G07C9 00
Designated states27
- Contracting states, 27
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Hungary
- Ireland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Portugal
- Romania
- Sweden
and 3 moreShow fewer
- Slovenia
- Slovakia
- Türkiye
