Method of monitoring an object using ID recognization

Method of object monitoring by identity recognition

The present invention relates to a video monitoring system, in particular to a method for monitoring objects by identification.

The conventional digital video recorder (DVR) mostly adopts a closed system architecture, for example, 4-channel, 8-channel, 16-channel, 32-channel DVR, which all use multiple cameras to route the cables. Method, connect the signal line to a digital monitor set-top box with multiple inputs, and play the video signal on the display, and store it at the same time for subsequent video review.

This design can be applied to traditional collective houses or individual homes. However, for those with remote monitoring needs, this closed system does not meet the requirements. Therefore, combining Internet technology and wireless communication network (Telnet), the monitoring data can be transmitted through the network to meet the needs of remote monitoring. There are two ways to do it. One is to add a network communication module to the digital surveillance set-top box, and to provide a network transmission environment to transmit digital image data. Another way is to directly convert the camera to IP (Internet Protocol), that is, add a network interface module to the camera, and the fixed network address (IP Address) on the camera can be used for point-to-point Digital video signal transmission, and then achieve the purpose of remote monitoring.

Please refer to Figure 1, which is a system architecture diagram of a conventional IP Camera 10, which consists of a lens group 11, a polarizer 12, an image sensor 13, an image compression unit 14, a control unit 15, and a memory unit 16. The infrared transmitter 17, the network interface unit 18, etc. are constituted and installed in the housing 19. The light is transmitted to the image sensor 13 through the lens group 11 and then through the polarizer 12. The image sensor 13 converts the incoming light into an analog induced voltage, and passes it to the image compression unit 14 to convert it into a digital image signal and perform image compression; or, the image sensor 13 itself includes an analog-to-digital converter (ADC) directly converts the analog image signal into a digital image signal, and then transmits it to the image compression unit 14 for image compression. Among them, image compression technologies include MJPEG, MPEG II, MPEG IV, H.263, H.264, JPEG2000, etc., depending on the image compression chip used. Generally speaking, the reason for using image compression is that the amount of image data is huge, which is not suitable for direct transmission.

The control unit 15 controls the work of the overall system, by controlling the memory unit 16 to temporarily store the compressed digital image data, and then controlling the network interface unit 18 to transmit to the Internet or local area network. Among them, the network interface unit 18 is generally connected to a network cable by an RJ45 connector through a wired method, and includes a network physical layer (MAC), which has a network physical address (IP Address) that can be directly connected to the Internet Way to access. That is, as long as the IP address of the network camera 10 is known and the control code is transmitted, the Internet can be used for point-to-point image data transmission.

In addition, the webcam 10 generally includes an infrared transmitter 17 which can emit infrared to provide night light to achieve the night vision function. However, if the infrared transmitter 17 is installed, the sensitivity and requirements of the image sensor 13 are still required, and its dynamic range (Dynamic Range) must be large enough to enable it to perform image processing under weak light. Sensing.

Whether it is a conventional digital surveillance system or the most advanced IP camera system, when it is used in an environment that requires high security requirements, it will still have its shortcomings. For example, in the access control of an organization with confidentiality protection, it is still necessary to use an access control card (usually using radio frequency identification tags, RFID Tag) system for control. However, in organizations with more high-level confidentiality protection, when they have space designs such as forbidden zones and control zones, they often have to adopt the design of protective doors. Therefore, it takes a lot of manpower and equipment to stop the prevention of those who are interested.

In order to solve such problems, many manufacturers have tried their best to solve them from the functional aspect of the monitoring system. For example, those who adopt a face recognition system, although they have been researching for some time, have not yet entered a large amount of commercialization, which is actually the reason for the low success rate of face recognition at night.

In a word, the conventional monitoring system, when monitoring objects, needs to read the recorded data and perform time-consuming screen tracking in order to track and monitor specific objects. As for the precautions in the security zone, personnel check is required, which is not only time-consuming, but also the personnel costs and the cost of setting up gates are quite high.

Therefore, if an Internet-based surveillance system that can not only achieve identity recognition but also provide appropriate image data, to perform various real-time monitoring, better object monitoring and dynamic control of the control zone can be used to solve the problem. Insufficiency of existing technology.

In view of the above-mentioned problems of the conventional technology, the present invention proposes a method for object monitoring by identification to achieve the effect of real-time monitoring, which can greatly reduce the burden on the operator of the monitoring system and improve its monitoring efficiency.

The present invention further provides a method for object monitoring by identification, which is applied to a network monitoring system including a plurality of network cameras, and includes the following steps: generating a data stream from the network cameras; When the camera reads a radio frequency identification tag and generates an identity data, import the data stream; when the network projection machines detect a heat source and generate a movement data, import the data stream; detect the data Whether the stream carries the identity data; if the data stream carries the identity data, generate an object appearance message and perform a warning action; detect whether the data stream carries the mobile data; and if the data stream With the movement data, an object movement message is generated and the warning action is performed.

The present invention further provides a method for object monitoring by identity recognition, which includes the following steps: generating a data stream from a plurality of network cameras; reading a radio frequency identification tag to generate identity data, and importing the data stream; Detect a heat source to generate a movement data, and import the data stream; generate a warning message based on the result of detecting the identity data and the movement data; receive a selection command of the warning message; send according to the selection command A warning command is connected to the network address of the network camera generating the warning event; receiving an audio dialogue command; and warning by the voice playback unit of the network camera generating the warning event Broadcast action.

The present invention also provides a method for object monitoring by identity recognition, which includes the following steps: generating a data stream from a plurality of network cameras; reading a radio frequency identification tag to generate identity data, and importing the data stream; Detect a heat source to generate a mobile data, and import the data stream; provide one of the network cameras related data, the related data is the network of each network camera adjacent to the network camera Address; generate a warning message based on the result of detecting the identity data and the movement data; receive a tracking command of the warning message; select the network camera to be tracked according to the tracking command, and perform a tracking warning action; Perform screen display of the web cameras associated with the web camera in which the alarm event has occurred based on the associated data; and switch tracking alarms when the alarm event moves to the web cameras associated with the web camera .

The detailed features and advantages of the present invention will be described in detail in the following embodiments. The content is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and according to the content disclosed in this specification, the scope of patent application and the drawings. Anyone who is familiar with the relevant art can easily understand the related purpose and advantages of the present invention.

Please refer to Figure 2, which is a system architecture diagram of the IP Camera 100 of the present invention. The present invention uses infrared sensing means to achieve object detection (human body detection), and at the same time uses radio frequency identification tags (RFID) for identity recognition. Integrate these two technical methods into the webcam, so that the webcam can obtain information representing the appearance (movement) of the object and the identification of the object due to the infrared sensing method and the RFID tag reading method while transmitting the image data . In this way, these two messages can be fully used to make the tracking ability of the monitoring system stronger. The IP Camera 100 consists of a lens group 110, a polarizer 120, an image sensor 130, an image processing unit 140, a control unit 150, a memory unit 160, an infrared transmitter 171, an infrared receiver 172, and a sound processing unit 173 , The sound source output interface 174, the sound source input interface 175, the network interface unit 180, and the RFID reading unit 190 are composed of, and are installed in the housing 101.

The polarizer 120 is installed above the image sensor 130 to generate different polarization effects, and the installation end depends on the requirements of the camera. The light is transmitted to the image sensor 130 through the lens group 110 and then through the polarizer 120. The image sensor 130 converts the incoming light into an analog induced voltage, and transmits it to the image processing unit 140 to convert it into a digital image signal and perform image processing; or, the image sensor 130 itself includes an analog-to-digital converter (ADC) directly converts the analog image signal into a digital image signal, and then transmits it to the image processing unit 140 for image processing. Among them, image processing technologies include MJPEG, MPEG II, MPEG IV, H.263, H.264, JPEG2000, etc., depending on the image compression chip used. In the future, under the trend of increasing network bandwidth, increasing storage media capacity and decreasing prices, it is also possible to directly store the original digital image data without compression.

The control unit 150 controls the work of the overall system. It is connected with the image processing unit 140, the memory unit 160, the infrared transmitter 171, the infrared receiver 172, the audio processing unit 173, the audio output interface 174, the audio input interface 175, and the network. The interface unit 180 and the RFID reading unit 190 are connected; the sound effect processing unit 173 has a sound source output interface 174 that can be connected to an external speaker and the sound source input interface 175 can be connected to a microphone. The control unit 150 temporarily stores the processed digital image data by controlling the memory unit 160, and then controls the network interface unit 180 to transmit the data to the Internet or a local area network. Among them, the network interface unit 180 has two options: one is a wired network module, which is connected to an external network line with an RJ45 connector; the other is a wireless network module, such as a WLAN module, WiMAX module or wireless communication Network module (such as 3G, 3.5G module). Whether it is a wired or wireless network interface unit, it includes a network physical layer (MAC), which has a network physical address (IP Address) that can be accessed directly through the Internet. That is, as long as the IP address of the network camera 100 is known and the control code is transmitted, the Internet can be used for peer-to-peer data transmission.

The network interface unit 180 can be directly connected to the control unit 150 by using a circuit board, and can also be connected to the control unit 150 in a modular design manner, so that designers can design for different application requirements and enable the network of the present invention. The road camera 100 is more flexible. With a modular design, a connector can be added between the control unit 150 and the network interface unit 180, so that the network interface unit 180 can be directly installed and replaced in a pluggable manner.

In addition, the infrared transmitter 171 of the webcam 100 can emit infrared rays to supply night light to achieve the night vision function. However, if the infrared transmitter 171 is installed, the sensitivity and requirements of the image sensor 130 are still required, and its dynamic range (Dynamic Range) must be large enough so that it can still perform image processing under weak light. Sensing.

The infrared receiver 172 of the present invention is used to receive the reflected light of the infrared transmitter 171 to determine the movement of the heat source. The control unit 150 can use the movement signal of the sensing voltage sent from the infrared receiver 172 to determine the movement of the object. If the judgment result of the movement of the object occurs, the control unit 150 transmits the generated movement data, which includes The time code and the mobile code of the object movement. Among them, the infrared transmitter 171 and the infrared receiver 172 can be manufactured by using an infrared transceiver module.

The time code is a time message, and there can be two generation mechanisms: generated internally by the camera or supplied externally. The internal generators are generated internally by the control unit 150. Many chips that can meet the functions of the control unit 150 have the RTC (Real Time Clock) function, or the control unit 150 generates the relative time according to the clock generator. Or, the absolute time is generated from time data received by a radio control clock (Radio Control Clock). An external provider can obtain time information from a fixed URL through the network interface unit 180. There are quite a lot of mechanisms for time generation, so I won't repeat them here.

The RFID reading unit 190 of the present invention is used to read an RFID tag (Radio Frequency Identification Tag), and when the RFID tag is read, it is transmitted to the control unit 150. After the control unit 150 receives the RFID tag, it sends an identity data to the network interface unit 180 and transmits it, which includes the identity code (RFID tag data) and the read time code.

Among them, the RFID tag can be an active RFID tag or a passive RFID tag. If a passive RFID tag is used, the web camera 100 of the present invention can use a higher-power reading unit to increase the RFID reading distance. If an active RFID tag is used, the web camera 100 of the present invention can reach a farther sensing distance. The working frequencies of RFID generally include 135kHz in the low-frequency band, 13.56MHz in the high-frequency band, and 433MHz, 860~960MHz and 2.45GHz in the UHF band.

The RFID reading unit 190 can be directly connected to the control unit 150 by using a circuit board, and can also be connected to the control unit 150 in a modular design manner, so that designers can design for different application requirements and enable the network of the present invention. The road camera 100 is more flexible. With a modular design, a connector can be added between the control unit 150 and the RFID reading unit 190, so that the RFID reading unit 190 can be directly installed and replaced in a pluggable manner.

Through the Voice over Internet Protocol (VOIP), the present invention can also be used for the transmission of Internet voice. This function can be achieved through the audio processing unit 173. The sound effect processing unit 173 receives the microphone signal from the control center and processes it into an analog signal that can play sound effects. The sound source output interface 174 is connected to a speaker to perform remote sound playback for warning or scare. The function of blocking. Wherein, the microphone signal is transmitted from the network interface unit 180 to the audio processing unit 173 via the control unit 150, and finally to the speaker via the audio output interface 174. In addition, the second sound source received by the microphone connected to the sound source input interface 175 is the second sound source data converted into digital by the sound effect processing unit 173, which is transmitted to the network interface unit 180 by the control unit 150, and then sent to the control unit. Center, you can monitor the far-end sound.

In summary, the webcam 100 of the present invention can not only transmit the digital image data of the original webcam and related information such as the network address, but also can transmit the identity data that represents the movement of the object and the identity data read by the RFID tag. . These two signals are generated by the infrared receiver 172, the RFID reading unit 190 and the control unit 150 of the present invention, as well as the external RFID and the user carrying the RFID. In actual operation, the user has an RFID tag that can be read by the webcam 100 of the present invention. When the user passes through the sensing range of the webcam 100 of the present invention, on the one hand, the infrared receiver 172 can detect Detecting the user, the control unit 150 uses the signal change from the infrared receiver 172 to calculate that someone is approaching (the human body is a heat source), and then the generated movement data can be transmitted; on the other hand, RFID reading When the unit 190 reads the RFID tag, it transmits the identity information. Since these two data should be generated at the same time or within close time, the back-end system can track and monitor objects based on the presence or absence of these two data to achieve the effect of strict monitoring.

In addition, the webcam 100 can also be designed to transmit image data when it receives identity data or generates mobile data. In this way, a large amount of data can be saved, and the monitoring personnel can only monitor the network cameras with objects moving, which can greatly reduce the burden on the monitoring personnel. Its actions are also controlled by the control unit 150 as a whole. When the control unit 150 receives identity data or generates mobile data, it controls the network interface unit 180 to transmit image data and the received identity data and mobile data; After the identity data is received and no mobile data is generated, the network interface unit 180 is controlled to stop transmitting the image data.

In addition, because the network interface unit 180 transmits digital data, the control unit 150 can stream image data representing images, mobile messages, and identity data representing identity messages through the network interface unit 180 Send them separately. If the present invention of the wireless network module is adopted, the wiring of the network line can be omitted; and if there is already a network line wiring in the field, the present invention of the wired network module can be used.

As mentioned above, the present invention uses the webcam 100 to provide image data, identity data, and mobile data, all of which have time stamps for the system to distinguish. The network modules that the network camera 100 may use include wired network modules, wireless network modules, and wired and wireless network modules. Therefore, the present invention should have multiple combinations in the erection of the entire monitoring system: I. Wired LAN connection; II. Wireless LAN connection; III. Internet connection; IV. Combination of the above optional network connections . Therefore, the system can be set up according to actual monitoring requirements.

For example, if there is only a single area of demand, you can plan based on the on-site network environment. If the on-site network environment is sufficient for the wired local area network, the wired local area network can be used. If the on-site network environment is reachable by a wired local area network, but some areas have no wired local area network, a mixture of wired local area network and wireless local area network can be used. If the on-site network environment does not have a wired local area network, and the wired local area network environment is not easy to set up, a wireless local area network can be used.

For example, if there are remote monitoring and local monitoring requirements, the local terminal can be wired LAN or wireless LAN or a combination thereof, and the remote terminal can be directly monitored through the Internet. The remote part can also be set up by wired LAN, wireless LAN or a combination of them. In the following, part of the implementation framework will be introduced.

Use the network camera in Figure 2 to properly install and set it up to achieve the purpose of rigorous monitoring that the invention intends to achieve. For the specific layout, please refer to the example in Fig. 3, which is an example of installation in a physical location using a webcam rack in the present invention at time T1.

Among the monitored places, it is divided into multiple blocks, namely: gate 302,314, area 304,306,308,310,311,312,316,318,320,322,324,326,328,330,332,334,336,338,340,342,344,346,348, etc. Each block has at least one network camera 402~464 installed, for example, area 320,340,324,326,338 etc. , It is a small personal office. Due to its small space, only one network camera is installed, which are network cameras 402, 404, 406, 408, 410, 412, 444, 446, 448, 450, 452, etc. In addition, the area 346 is a toilet, and it is not suitable to install a webcam, so as not to infringe on personal privacy, so it is not installed. Areas 304, 306, 308, and 310 are corridors. Because of their long and narrow spatial structure, two web cameras are installed, namely web cameras 414, 416, 418, 420, 422, 424, 436, 438, 440, 442, etc. Areas 332 and 334 are medium-sized spaces, and 2 to 3 network cameras are installed respectively, which are network cameras 426, 428, 430, 432, 434 and so on. Area 348 is the laboratory space, which has two walkway areas, areas 316 and 318 respectively. Due to its large range, multiple webcams are installed, namely, webcams 454,456,458,460,464, etc.

In addition, Figure 3 also shows some fixed office equipment. For example, the computer equipment 502 is installed in the aforementioned room, and the locker 504, the locker 506, the work platform 508, etc., are located in different areas.

The configuration of such a network camera allows every corner of the entire workplace to be monitored closely. For example, in Figure 3, at time T1, user 901 is located in area 308, that is, in the corridor. His images will be captured by 6 webcams at the same time, namely webcams 414, 416, 418, 420, 422, 424. The six network cameras will generate mobile data separately, which will be transmitted to the monitoring center via the network (either a local network or a remote Internet) for storage in the database. At the same time, because the user 901 has an RFID that represents the identity, some of the network cameras will sense the existence of the RFID within the distance that the RFID can be sensed, and then generate the identity data, and pass it through the network. It is transmitted to the monitoring center for storage in the database.

If multiple network cameras capture RFID data at the same time, it is easier to burden the system. Therefore, a more appropriate approach is to use the active RFID transmission power, which has a limited transmission distance, and matches the distance that can be captured by the infrared sensor of the webcam. For example, generally speaking, infrared sensing can detect 5 meters, and it is better to use RFID with a transmission distance of 5 meters. Of course, other sensing distances can also achieve the effects of the present invention.

In this way, at time T1 in Figure 3, although there are six webcams to capture the user 901, due to the limitation of the capture distance, it is better to have only three webcams 416,418,422 that can move at the same time Data and RFID identification data representing the user 901.

Next, please refer to Fig. 4, which is an example of installation in a physical location using a webcam rack according to the present invention, at time T2. At T2, user 901 moved from the position of T1 to the other side of the corridor. At this time, five webcams captured the image of user 901, namely webcams 436,438,440,442,424. Due to the aforementioned distance limitation, there are four network cameras that capture user 901s RFID identity data, namely network cameras 438,440,424,422. However, only three network cameras capture user 901s RFID identity data. The mobile data of is 438,440,424 webcams. The reason for this difference is that the webcam has its viewing angle, which is not 360-degree viewable. Therefore, although the user 901 has left the visible range of the webcam 422, he has not left the RFID sensing range. Therefore, When the IP camera 422 should leave, it will happen that the mobile data has disappeared, but the RFID identity data will still be generated until it leaves the sensing range of the RFID.

Next, please refer to Figure 5, which is an example of the installation in a physical location using the webcam rack according to the present invention, at time T3. At T3, the user 901 moves from the position of T2 to the area 348 and approaches the corridor of the area 316. At this time, the six webcams in the area 348 will capture the image of the user 901. They are webcams 454,456,458,460,462,464. Due to the aforementioned distance limitation, there are two webcams that capture the RFID identity data of user 901, namely webcams 460 and 462. Similarly, these two webcams will also capture the user's RFID identity data. 901's mobile data.

Next, please refer to Fig. 6, which is an example of installation in a physical location using a webcam rack according to the present invention, at T4 time. At T4, the user 901 moves from the T3 position to the area 332 representing the meeting room. At this time, there are three network cameras that capture the image of the user 901, namely the network cameras 426, 428, and 430. Due to the aforementioned distance limitation, there is a web camera that captures the RFID identity data of the user 901, which is the web camera 430, and at the same time, it captures the mobile data of the user 901.

Next, please refer to Fig. 7, which is an example of an erection in a physical location using a webcam rack according to the present invention, another situation at T4 time. At T4, the user 901 first moves from the position of T3 to the area 346 representing the toilet, and then to the area 332 representing the conference room. Since the user 901 loses the RFID in the toilet, different sensing situations will occur. 1. The network camera 442 next to the toilet will continuously sense the RFID that represents the user's identity and continue to send the identity data to the monitoring center; 2. The user will pass through the area when moving from area 346 to area 332 312,308,304, the webcams 442,440,438,436,424,422,416,414,418,420,430,428,426 among them will capture the images. However, the users are detected by several webcams that are close to each other, and mobile data are generated. These are webcams 442,420,424,422,416,430, etc. These web cameras continue to capture images of the user 901, and some of them continue to transmit mobile data, but because the user 901 does not carry RFID, the identity data is not captured. This situation can be easily distinguished by the method of the present invention, and the purpose of strict monitoring can be achieved.

Next, please refer to Figure 8, which is an example of the moving line diagram of the object drawn during T1~T4 according to Figures 3-7. In order to access the relevant information with the conventional technology, it is necessary to use manual methods to drop images and make judgments. By using the present invention, various monitoring requirements can be easily completed. When the user 901 enters through the gate 302, in the process, the identity data and mobile data representing his identity will be captured by various network cameras. Since both identity data and mobile data are included in the data stream, they are transmitted together with the image data captured by the Internet and stored in the database. Therefore, every piece of identity data, image data, and mobile data contains a time stamp. Since the webcam has a network address, the data stream also contains the data of the network address. In this way, each data stream has its own data file header that can be retrieved, namely: time , Network address (representing a specific webcam), identity data (representing the captured RFID), and mobile data (representing the existence of the user). With the data stored in the database, the present invention can perform various monitoring applications.

Please refer to Figure 9, which is the first specific flowchart of the method for object monitoring by identity recognition of the present invention, which includes the following steps:

Step 601: Receive and store the approved identity data.

The monitoring software of the monitoring center can design a user interface to allow the operator to log in the identity information when entering the place to be monitored. Generally speaking, since each person entering the monitoring site needs to be equipped with an RFID for personnel control. Therefore, through the input of the operator, the monitoring software receives the identity data entered by the operator and stores it in the database for subsequent monitoring actions.

Step 602: It is detected that the data stream carries identity data.

The monitoring software will continue to detect whether there is identity data in the data stream from each network camera.

Step 603: Generate an object appearance message and give a warning.

Once the data stream contains identity data, a warning will be issued. There are several warning methods, for example, warning symbols pop up on the screen, warning messages pop up on the screen, warning sounds, warning voices, or any combination of the above actions can be used. The content of the aforementioned various warning methods can be adjusted by the designer. In addition, the warning voice can be generated by the player of the monitoring center computer or externally connected to the speaker system of the monitoring center to produce a stronger warning effect.

Step 604: Detecting non-approved identity data.

The identity data detected in step 602 may be the identity data not recorded in step 601. This situation may be caused by the operator's login error, or someone else has entered with other unregistered RFID, etc., various possible situations. At this point, this step can be used to alert this event.

Step 605: Generate an illegal identity entry message and give a warning.

The warning method is as mentioned above, and will not be repeated here.

Step 606: No movement data is detected after T1 time.

The length of this T1 time can be designed according to the on-site environment. For example, if the distance of the web camera is relatively short, it can be set to a shorter time. Conversely, if the distance of the web camera is far away, it can be set to a longer time.

Step 607: Generate an object disappearing message and give a warning.

The warning method is as mentioned above, and will not be repeated here.

Step 608: It is detected that the identity information disappears.

When the original detected identity data disappears in the data stream of the same source, the monitoring software can also detect it.

Step 609: Generate an object leaving message and alert for T3 time.

The length of this T3 time can be designed according to actual needs. Among them, a longer time, such as 3 to 5 seconds, can achieve a more continuous warning; a shorter time can reduce the burden on the monitoring personnel, for example, less than 3 seconds. Different lengths of time have different effects, which can be adjusted by practical requirements.

The flowchart in Figure 9 illustrates the basic function of the present invention, that is, using a database that simultaneously stores image data, identity data, mobile data, and time stamp data streams to perform various monitoring applications. The following , Will introduce various monitoring warnings or application functions respectively.

Please refer to Fig. 10, which is the second specific flow chart of the method for object monitoring by identity recognition of the present invention, which illustrates the handling method of the present invention when the user moves but does not carry the RFID, including the following steps:

Step 611: Receive and store the approved identity data.

The monitoring software of the monitoring center can be designed with an interface that allows the operator to log in the identity information when entering the place to be monitored. Generally speaking, since each person entering the monitoring site needs to be equipped with an RFID for personnel control. Therefore, through the input of the operator, the monitoring software receives the identity data entered by the operator and stores it in the database for subsequent monitoring actions.

Step 612: It is detected that the data stream contains mobile data.

When the user moves, the webcam will generate movement data if it enters the monitoring range of the heat source detection of the webcam. At this time, the data stream will contain mobile data, and the monitoring software will perform this monitoring at any time.

Step 613: Generate an object movement message and give a warning.

When the movement data is detected, an object movement message is generated immediately. Similarly, the warning method is as described above, and will not be repeated here.

Step 614: No identity data is detected after T4 time.

If T4 time has passed, but the identity data representing the user is still not detected, it means that the user does not carry RFID. The T4 time is calculated based on the possible gap between the distance when the mobile data is generated and the distance at which the RFID is detected. For example, in the situation in Figure 3, when the user walks from the gate 302 to the area 308, the webcam 422 may first detect the heat source of the user 901 and generate movement data first. Unless the user 901 stops at the gate, the result of the user's continuous advancement should reach the detection range of the RFID in a very short time. Generally speaking, the walking speed of a person is about 2 steps per second, the step distance of a man is about 75 cm, and that of a woman is about 60 cm. The result of conversion is about 1.5 meters per second for men and 1.2 meters per second for women. Therefore, it depends on the actual RFID reading distance and the infrared heat source detection distance.

Step 615: Generate an unknown object intrusion message and give a warning.

When the situation in step 614 occurs, a warning of such an event is performed, and the warning method is as described above, and will not be repeated.

Next, please refer to Figure 11, which is the third specific flow chart of the method for object monitoring by identification of the present invention, which illustrates the monitoring measures applied in the control area of the present invention, including the following steps:

Step 621: Receive and store the IP of the IP camera in the restricted zone.

The monitoring software can provide an operating platform for the operator to operate, and enter the IP camera IP in the control zone. Since each network camera has a network address, as long as the layout of the floor plan, as shown in the example in Figure 3, can correspond to the network camera in the restricted area. With the setting of the operator, the IP information of the IP camera in the restricted zone can be stored in the database.

Step 622: Receive and store the identity data allowed to enter the restricted area.

The monitoring software of the monitoring center can design a user interface to allow the operator to log in the identity information when entering the place to be monitored. Generally speaking, since each person entering the monitoring site needs to be equipped with an RFID for personnel control. Therefore, through the input of the operator, the monitoring software receives the identity data entered by the operator and stores it in the database for subsequent monitoring actions.

Step 623: It is detected that the data stream contains both the IP camera IP in the restricted zone and the unauthorized identity data.

Step 624: Generate an illegal break-in message and give a warning.

The warning method is as mentioned above, and will not be repeated here. In this case, it can also be designed according to the needs of on-site control. Since the control of the control zone is emphasized by companies that value confidentiality measures, strict control is particularly required. For related control methods, please refer to the method in Figure 12.

Please refer to Figure 12, which is the fourth specific flowchart of the method for object monitoring by identity recognition of the present invention, which illustrates the interactive active personnel control method of the present invention, which includes the following steps:

Step 631: Receive a warning event selection instruction.

When a warning event as shown in Figures 9-11 occurs, the operator can select one of the warning events according to the interface provided by the monitoring software. When the operator makes a selection, the monitoring software receives a warning event selection instruction. Then, the control action is carried out. Because the webcam used in the present invention has the broadcasting function of a speaker, and can also optionally have the function of a microphone. Therefore, the network camera used in the present invention can conduct a two-way conversation with the monitoring center. When a warning event is selected, it means that a specific webcam has been selected. You can select one or more for wider broadcast or two-way communication.

Step 632: Send a warning command to the webcam where the warning event occurred according to the selection command for connection.

When a specific webcam is selected, the monitoring software will send a warning command to the related webcam and connect to prepare for the warning.

Step 633: Receive an announcement dialogue instruction.

Next, once the operator activates the broadcast dialogue button, that is, gives the broadcast dialogue command to the monitoring software, the monitoring software obtains the control of the two-way communication between the speaker and microphone interface of the selected IP camera.

Step 634: Perform a warning broadcast action by the voice playback unit of the network camera that generated the warning event.

Therefore, the monitoring software can use the network to allow the operator to listen to the voice of the selected network camera, and the selected network camera can play the voice of the operator of the monitoring center.

Figure 13 illustrates the active warning function achieved by the method of the present invention. This function uses the method of the present invention to instantly remind the operator of the monitoring center of the occurrence of a warning event. Then, the operator performs real-time monitoring according to the method of the present invention to achieve the functions of warning, deterrence, and explanation. In this way, hazardous events or accidental entry into the control zone can be prevented immediately.

Next, please refer to Figure 13, which is the fifth specific flow chart of the method for monitoring objects by identity recognition of the present invention, which explains how the present invention achieves the function of playing or burning the movement history of objects, including the following step:

Step 641: Receive the identity information to be searched.

The monitoring software can provide a user interface for the operator to enter the identity data to be searched.

Step 642: Search the data stream containing the identity data in the database.

When the surveillance software receives the searched identity data, it searches the database and finds out the data stream containing the identity data.

Step 643: Whether to perform event programming.

The monitoring software can provide an option for the operator to choose whether to burn for subsequent evidence preservation.

Step 644: Retrieve the data stream with the identity data, and merge the streams according to the chronological order for burning.

When the operator chooses to burn, the data can be burned. Since the data streams are all time stamped, the monitoring software can be provided to the burning software to burn into a disc according to the chronological order, or it can be saved as a data file for easy access in the future.

Step 645: Retrieve the data stream with the identity data, and play it in chronological order.

When the operator does not choose to burn, the movement history of the identity data can be played. The playback process may be the screen of a single webcam or multiple webcams, depending on the number of webcams that actually capture the identity data.

The above methods in Figures 9 to 13 can be simply explained by the screen in Figure 14, which is a simulation diagram on the monitoring platform 700 of the method for monitoring objects using the network monitoring system using the radio frequency identification function of the present invention.

On the monitoring platform 700, there are a total of 16 monitoring screens 701 to 716. There is an event message display screen in the upper left corner of each monitoring screen, and warning symbols may pop up in the upper right corner. Among them, in the example in Figure 14, the event message in the upper left corner includes ID, time, and event. Among them, the monitoring screen 707 and the monitoring screen 708 are network cameras in the control area.

Taking Figure 14 as an example, there are 4 events in total, which occurred on the monitoring screens 703, 706, 707, and 711 respectively. The status displays are: screen 703, ID: 0001111, time: 12:31:56, event: ID without personnel, red warning symbol; screen 706, ID: 0001234, time: 12:31:56, event: personnel Enter, blue warning symbol; screen 707, ID: 0004321, time: 12:31:56, event: illegal entry into the control zone, red warning symbol; screen 711, ID: N/A, time: 12:31:56, Event: No ID, red warning symbol;

With Figure 14, the operator of the monitoring center can clearly know the status of each screen, and directly deal with it according to the status of the screen. Moreover, according to the method shown in Figure 13, all the movement history of the personnel can be easily accessed, without the need to access a large number of image files. Therefore, the effect of strict monitoring can be achieved by the present invention.

Next, please refer to Figure 15 which is the sixth specific flowchart of the method for object monitoring by identity recognition of the present invention. Examples of personnel tracking. The five flowchart embodiments in Figures 9 to 13 illustrate the application of the present invention to various object monitoring methods. Among them, under different event conditions, continuous event monitoring and tracking may be required. . Using the method in Figure 15 of the present invention, you can directly track the object, which includes the following steps:

Step 651: Provide the associated data of the IP camera IP. The IP of each IP camera can be known in advance through the layout of the plan to know the IP of its neighboring IP cameras. Pre-establishing this associated data will quickly alert the neighboring cameras on the display screen.

Step 652: Receive an object tracking command. In the methods in Figures 9-11, there are events such as the appearance of objects, the leaving of objects, the disappearance of objects, the entry of illegal identity, the movement of objects, the intrusion of unknown objects, and the illegal intrusion. According to the urgency of the event, the monitoring personnel can take different warning actions accordingly. Among them, the object tracking is the one demanded in Figure 15. Monitoring personnel can select events and issue object tracking instructions, and the system can act accordingly. Among them, the person who issues an object tracking command can design a tracking option in the software and display it on the screen for monitoring personnel to operate. The tracking options can use icons, texts, etc.

Step 653: Select the IP of the network camera to be tracked according to the object tracking command, and perform a tracking alert. When issuing an object tracking command, you must select the IP camera IP to be tracked. Among them, one or more may be selected, depending on the number of webcams that captured the event. The selected webcam will be displayed as a tracking state.

Step 654: Display the tracking screen of the webcam adjacent to the webcam based on the associated data. At this point, based on the associated data, you can select the network camera adjacent to the network camera that captured the event, and let it perform screen tracking synchronously, so as to facilitate the monitoring by the monitoring personnel. For example, use the method of continuously popping out on the screen or displaying warnings simultaneously.

Step 655: Receive a tracking stop instruction. When the system is in the tracking state, it can provide a stop tracking instruction, so that the monitoring personnel can perform the stop tracking action

Step 656: The tracked object moves to other webcams. When the tracked object moves to another webcam, that is, when the adjacent webcam, the moved webcam will generate the identity data or mobile data representing the object. Judging by identification data or mobile data, it can be confirmed that the tracked object has moved to other webcams.

Step 657: After moving according to the identity data or mobile data of the webcam that generated the tracked object, switch the webcam, and return to step 654 to continue monitoring. Once step 656 has occurred, the main alert screen can be switched to the tracked webcam. Similarly, there may be one or more devices that capture data at the same time.

Please refer to Fig. 16, which is a simulation diagram on the monitoring platform 700 using the method of Fig. 15 of the present invention, which is a way of displaying warnings simultaneously. As can be seen from the figure, there is an incident of illegal entry into the control area in the monitoring screen 707. At this time, a tracking word, or pattern, etc. can be generated next to the person involved in the incident or other parts for the monitoring personnel to choose. . Once the monitoring staff selects the tracking option, the tracking instruction is issued. The system can start tracking at this time, and the network cameras adjacent to the monitoring screen 707, such as the four monitoring screens 706, 709, 703, and 711 in the figure, change their colors and have yellow warning lights to warn them. When the person involved in the incident is constantly moving, the monitoring screen will constantly switch to the tracked person. In this way, the purpose of continuous tracking can be achieved.

The way of popping out of the screen can also achieve the purpose of continuous tracking.

Although the technical content of the present invention has been disclosed in the preferred embodiment as above, it is not intended to limit the present invention. Anyone who is familiar with this technique and makes some changes and modifications without departing from the spirit of the present invention should be covered by the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of the attached patent application.

<p>10. . . Webcam</p><p>11. . . Lens group</p><p>12. . . Polarizer</p><p>13. . . Image sensor</p><p>14. . . Image processing unit</p><p>15. . . control unit</p><p>16. . . Memory unit</p><p>17. . . Infrared transmitter</p><p>18. . . Network interface unit</p><p>19. . . shell</p><p>100. . . Webcam</p><p>101. . . shell</p><p>110. . . Lens group</p><p>120. . . Polarizer</p><p>130. . . Image sensor</p><p>140. . . Image processing unit</p><p>150. . . control unit</p><p>160. . . Memory unit</p><p>171. . . Infrared transmitter</p><p>172. . . Infrared receiver</p><p>173. . . Audio processing unit</p><p>174. . . Audio output interface</p><p>175. . . Audio input interface</p><p>180. . . Network interface unit</p><p>190. . . RFID reading unit</p><p>302. . . door</p><p>304. . . area</p><p>306, 308, 310, 312, 314, 316, 318, 320, 322, 324, 326, 328, 330, 332, 334, 336, 338, 340, 342, 344, 346, 348. . . area</p><p>402, 404, 406, 408, 410, 412, 414, 416, 418, 420, 422, 424, 426, 428, 430, 432, 434, 436, 438, 440, 442, 444, 446, 448, 450, 452, 454, 456, 458, 460, 462, 464. . . Webcam</p><p>502. . . Computer equipment</p><p>504. . . Locker</p><p>506. . . Locker</p><p>508. . . Work platform</p><p>700. . . monitoring platform</p><p>701, 702, 703, 704, 705, 706, 707, 708, 709, 710, 711, 712, 713, 714, 715, 716. . . Monitor screen</p><p>901. . . user</p><p>RFID. . . Radio Frequency Identity (Radio Frequency Identity)</p>

Figure 1 is a functional block diagram of a conventional webcam;

Figure 2 is a functional block diagram of the webcam of the present invention;

Figure 3 is an example of the installation in a physical location using the webcam rack according to the present invention, at time T1;

Figure 4 is an example of the present invention using the web camera to be installed in a physical location, at time T2;

Figure 5 is an example of the present invention using the web camera to be installed in a physical location, at time T3;

Figure 6 is an example of the present invention using the web camera to be installed in a physical location, at time T4;

Figure 7 is an example of the present invention using the web camera to be installed in a physical location, at time T5;

Picture 8 is pictures 3~7, examples of moving lines of objects drawn during T1~T5;

Figure 9 is the first specific flow chart of the method for object monitoring by identification of the present invention;

Figure 10 is the second specific flow chart of the method for object monitoring by identification of the present invention;

Figure 11 is the third specific flow chart of the method for object monitoring by identification of the present invention;

Figure 12 is the fourth specific flow chart of the method for object monitoring by identification of the present invention;

Figure 13 is the fifth specific flow chart of the method for object monitoring by identification of the present invention;

Figure 14 is a simulation diagram on the monitoring platform 700 using the method of identity recognition for object monitoring of the present invention;

Figure 15 is the sixth specific flow chart of the method for object monitoring by identification of the present invention; and

Figure 16 is a simulation diagram of the monitoring platform 700 using the method of Figure 15 of the present invention.