Photographic information server and photographic information transmission system
Abstract
[Subject] The change of a situation about a surveillance object is interlocked with, and it enables it to aim at effective use of a network zone by constituting the image information which should be sent out to a network, supplying the image information adapted to an actual employment situation. [Solution means] Take in the photography information about a surveillance object two or more kinds, and the account of front the taken-in photography information, The judgment part 16a which judges the generating existence of the change of state about the surveillance object which is a photography information server sent out to a monitor station through a network, and starts two or more above-mentioned kinds of photography information, respectively, Priority is given to the photography information about the surveillance object judged in this judgment part 16a to be those of the above-mentioned change of state with generating over the photography information about the surveillance object judged that has no generating of the above-mentioned change of state, and it constitutes so that the priority sending-out part 16b sent out to the above-mentioned monitor station may be offered. [Selection figure] Fig. 1
Term
Term ended
Projected expiry passed 31 March 2024, 2.5 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
10 claims: 3 independent, 7 dependent
- 1A shooting information server that captures multiple types of shooting information about the monitoring target and sends the captured shooting information to the monitoring station via the network, and the occurrence of a state change of the monitoring target related to the multiple types of shooting information. The shooting information of the determination unit that determines the presence or absence and the monitoring target that is determined by the determination unit that the state change has occurred is prioritized over the shooting information of the monitoring target that is determined that the state change has not occurred. A shooting information server, characterized in that it is configured to include a priority transmission unit for transmitting to the monitoring station. 監視対象についての撮影情報を複数種類取り込み、前記取り込んだ撮影情報を、ネットワークを介して監視局へ送出する撮影情報サーバであって、 前記複数種類の撮影情報にかかる監視対象についての状態変化の発生有無をそれぞれ判定する判定部と、 該判定部にて前記状態変化の発生有りと判定された監視対象についての撮影情報を、前記状態変化の発生無しと判定された監視対象についての撮影情報に優先して、前記監視局へ送出する優先送出部と、をそなえて構成されたことを特徴とする、撮影情報サーバ。
- 8The priority sending unit stops the transmission of shooting information about the monitoring target determined by the determination unit to have no change of state, and the determination unit determines that the change of state has occurred. The shooting information server according to claims 1 to 5, wherein the shooting information server is configured to include a shooting information selection sending unit that sends shooting information about a target. 該優先送出部が、該判定部にて前記状態変化の発生無しと判定された監視対象についての撮影情報の送出を停止させるとともに、該判定部にて前記状態変化の発生有りと判定された監視対象についての撮影情報を送出する撮影情報選択送出部をそなえて構成されたことを特徴とする、請求項1~5記載の撮影情報サーバ。
- 10A plurality of imaging devices that capture images of the monitoring target, a monitoring station that receives images captured by the imaging devices for monitoring, and imaging information captured by each imaging device is captured and captured. It is equipped with a shooting information server that sends information to the monitoring station via a network, and the shooting information server determines whether or not a state change has occurred in the monitoring target related to the shooting information shot by each shooting device. The imaging information about the determination unit and the monitoring target determined by the determination unit to have a change of state is prioritized over the imaging information about the monitoring target determined to have no change of state. A shooting information transmission system characterized in that it is configured with a priority transmission unit that transmits to a monitoring station. 監視対象についての映像を撮影する複数の撮影装置と、 該撮影装置にて撮影された映像を監視用に受信する監視局と、 各撮影装置にて撮影された撮影情報を取り込み、前記取り込んだ撮影情報を、ネットワークを介して該監視局へ送出する撮影情報サーバとをそなえ、 該撮影情報サーバが、 各撮影装置にて撮影された撮影情報にかかる監視対象についての状態変化の発生有無をそれぞれ判定する判定部と、 該判定部にて前記状態変化の発生有りと判定された監視対象についての撮影情報を、前記状態変化の発生無しと判定された監視対象についての撮影情報に優先して、前記監視局へ送出する優先送出部と、をそなえて構成されたことを特徴とする、撮影情報送信システム。
Independent claims3
102 paragraphs, as filed
The present invention relates to a shooting information server and a shooting information transmission system, which are suitable for use when remotely monitoring a video for surveillance.
In recent years, due to the frequent occurrence of crimes, for the purpose of crime prevention in towns, shopping districts, schools or important facilities, sites, etc., these places or facilities are monitored, and the images are taken with a camera and isolated from the monitored targets. There is an increasing need for a shooting information transmission system that monitors in real time with a monitor. On the other hand, the spread of broadband Internet services and the development of large-capacity intranets are steadily progressing. Against this background, the introduction of image surveillance systems using IP (Internet Protocol) networks is increasing.
FIG. 16 shows a general configuration example of the photographing information transmission system 100 that performs remote image monitoring by utilizing the IP transmission line. The system 100 shown in FIG. 16 is a monitored station 110 that remotely transmits a monitored image, a monitoring station 120 that monitors the monitored object by monitoring the monitored image from the monitored station 110, and a monitoring station 120 thereof. It is configured with an IP network 130 that connects the monitored station 110 and the monitoring station 120.
Here, the monitored station 110 is configured to include, for example, four cameras 101 to 104 that capture images of a location to be monitored, as well as a camera server 106 and a router 107. Further, among the cameras 101 to 104, while the cameras 101 to 103 are fixed cameras, some cameras (for example, the camera 104) can be moved in the shooting posture via the camera server 106 by the control information from the monitoring station 120. A movable camera that can be controlled.
Further, the camera server 106 has a function of converting the video information captured by the cameras 101 to 104 into IP packets and sending them to the IP network 130, and receives control information from the monitoring station 120 via the IP network 130. It has a function to transmit to cameras 101 to 104. Further, the router 107 sends an IP packet from the camera server 106 to the IP network 130, and outputs an IP packet addressed to the camera server 106 transmitted through the IP network 130 to the camera server 106.
Further, the monitoring station 120 can receive the video information sent from the monitored station 110 via the IP network 130 and display it as a monitoring image through a display or the like. Therefore, the monitoring station 120 sends the terminal device 121 with the display 121a and the router 122 that sends the IP packet from the terminal device 121 to the IP network 130 and outputs the IP packet from the IP network 130 to the terminal device 121. I have it.
Further, the monitoring station 120 can transmit control information as an IP packet to the camera server 106 as described above, and the camera server 106 that receives the control information can appropriately control the operating state of the camera 104. The monitoring station 120 may be configured to accommodate a plurality of monitored stations as the monitored station 110. Since the amount of information in image information is generally large, in the photographing information transmission system 100 as described above, the information is usually compressed and transmitted by an image compression technique or the like. Then, it is necessary to secure a transmission line as a network having a sufficient capacity in advance at the time of network design so that the band necessary for transmitting this information can be secured.
As a known technique related to the present invention, there is one described in Patent Document 1 shown below. In this Patent Document 1, in order to shorten the time for delivering the moving image information to a plurality of clients after the moving image information is obtained, the moving image information from the camera is compressed, encoded and packetized in the IP encoder without being temporarily accumulated. The video server is equipped with a video server that collects and stores video information and a management device that receives distribution requests to the video server and executes distribution processing, and stores only the necessary video on the video server. It describes a network system that enables efficient use of the network in this way.<patcit num="1"><text>Japanese Unexamined Patent Publication No. 2001-245281</text></patcit>
<p> However, in the general shooting information transmission system 100 as described above, even if the image is compressed and transmitted by the image compression technology, the user needs fine image quality due to the monitoring situation, or the subject is subject to fine image quality. When the number of monitoring points is large, a large-capacity transmission line is always required, so it is necessary to secure a network with a considerable capacity. Since it is often not necessary to monitor with, there is a problem that the network bandwidth cannot be effectively used.</p><p> Further, even in the technique described in Patent Document 1, an image is compressed and transmitted by an image compression technique for a monitoring target that requires fine image quality when a situation change occurs with respect to the monitoring target. Even so, since a large-capacity transmission line is always required for real-time monitoring, there is a problem similar to that of the above-mentioned shooting information transmission system 100. The present invention was devised in view of such a problem, and by configuring the video information to be transmitted to the network in conjunction with the change in the situation regarding the monitoring target, the video information according to the actual operation situation can be obtained. It is an object of the present invention to provide a shooting information server and a shooting information transmission system capable of effectively using the network bandwidth while supplying the data.</p>
<p> Therefore, the shooting information server of the present invention is a shooting information server that captures a plurality of types of shooting information about a monitoring target and sends the captured shooting information to a monitoring station via a network, and the shooting information server of the plurality of types. The determination unit that determines whether or not a state change has occurred for the monitored object related to the information, and the shooting information for the monitoring object that has been determined by the determination unit that the state change has occurred are defined as no state change. It is characterized in that it is configured to include a priority transmission unit for transmitting to the monitoring station in preference to shooting information about the determined monitoring target.</p><p> In this case, preferably, an external sensor for detecting the state change of each monitoring target is provided, and the determination unit is a sensor for determining whether or not the state change has occurred based on the detection information from the external sensor. It is configured with an information judgment unit. Alternatively, the determination unit calculates the frame difference of the shooting information captured for each of the plurality of monitoring targets, and the frame difference calculation unit calculates the frame difference, and the state is based on the calculation result of the frame difference. It is configured to include a frame difference determination unit that determines whether or not a change has occurred.</p><p> Alternatively, the determination unit is based on the transmission environment setting reception unit that accepts the transmission environment setting for specific shooting information from the monitoring station and the transmission environment setting received by the transmission environment setting reception unit. , A priority request determination unit for determining whether or not the state change has occurred is provided. Further, the priority transmission unit may be configured to include an image quality control transmission unit that enhances the image quality and transmits the shooting information of the monitoring target determined by the determination unit to have a change of state. ..</p><p> Further, the priority transmission unit is configured to include a priority packet generation unit that generates a packet to which priority processing information is added from shooting information about a monitoring target determined by the determination unit to have a state change. You may do it. Further, the priority transmission unit is provided with a bandwidth securing control unit that controls to secure the bandwidth of the network for transmitting shooting information about the monitoring target determined by the determination unit to have a state change. It may be configured as such.</p><p> Further, the priority transmission unit stops the transmission of shooting information about the monitoring target determined by the determination unit to have no change of state, and the determination unit determines that the change of state has occurred. It may be configured to include a shooting information selection sending unit that sends shooting information about the monitoring target. Further, preferably, the shooting information server can also include an end control unit that terminates the priority transmission in the priority transmission unit.</p><p> Further, the photographing information transmission system of the present invention captures images with a plurality of photographing devices that capture images of the monitored object, a monitoring station that receives the images captured by the photographing devices for monitoring, and each photographing device. It is equipped with a shooting information server that captures the captured shooting information and sends the captured shooting information to the monitoring station via a network, and the shooting information server monitors the shooting information shot by each shooting device. The determination unit that determines whether or not a state change has occurred for the target and the imaging information for the monitoring target that has been determined by the determination unit to have a state change are monitored by determining that the state change has not occurred. It is characterized in that it is configured to include a priority transmission unit for transmitting to the monitoring station in preference to shooting information about the target.</p>
<p> As described above, according to the present invention, the photographing information server monitors the imaging information about the monitoring target determined by the determination unit to have a state change by the priority sending unit, and determines that the state change has not occurred. Since it can be sent to the monitoring station in preference to the shooting information about the target, the network can be linked to changes in the situation regarding the monitoring target while realizing real-time (real-time) remote monitoring of the monitoring target. It is possible to configure the video information to be sent to the server, and while supplying the video information according to the operation status, the shooting information about the important monitoring target that is considered to have a change of state can be effectively used while utilizing the network bandwidth. , There is an advantage that it can be reliably sent.</p>
Hereinafter, embodiments of the present invention will be described with reference to the drawings. [A] Explanation of the overall configuration of the shooting information transmission system according to the present embodiment FIG. 1 is a block diagram showing the shooting information transmission system 1 according to the embodiment of the present invention, and the shooting information transmission system 1 shown in FIG. Also, for the purpose of crime prevention in the city, shopping district, school or important equipment, site, etc., these places or equipment are targeted for monitoring, the images are taken with a camera, and monitored with a monitor in a place isolated from the monitoring target. It can be applied as a system to be used.
Then, also in the shooting information transmission system 1 shown in FIG. 1, as in the case of FIG. 16 described above, the monitored station 10 that remotely transmits the monitored image and the monitored image from the monitored station 10 are monitored. By doing so, the monitoring station 20 that monitors the monitoring target and the IP network 30 that connects these monitored stations 10 and the monitoring station 20 are provided. For example, if the monitored station 10 is an unmanned communication machine room, the monitoring targets include the instrument panel and lamps that indicate the operating status of the communication machine, as well as the situation of people entering the machine room. Can be done. If such an unmanned facility or the like is set as the monitored station 10, the monitoring station 20 located at a point isolated through the IP network 30 can perform manned monitoring through a display or the like.
Here, the monitored station 10 captures a plurality of photographing devices 11 to 14 for photographing images of the monitored object, and photographing information photographed by each photographing device 11 to 14, and obtains the captured shooting information as an IP. It is configured to include a camera server (shooting information server) 16 that is sent to the monitoring station 20 via the network 30 and a router 17 similar to that shown in FIG. 16 (see reference numeral 107). The photographing devices 11 to 14 can be, for example, a moving image camera capable of performing moving image shooting, and can also be a movable camera capable of changing the posture based on the control information from the monitoring station 20. In the present embodiment, the photographing devices 11 to 13 are fixed cameras, and the photographing devices 14 are movable cameras.
Further, the monitoring station 20 receives the images taken by the photographing devices 11 to 14 transmitted from the camera server 16 via the IP network 30 for monitoring, and is shown in FIG. 16 described above. It is configured with a terminal device 21 and a router 22 similar to those (see reference numerals 121 and 122). As in the case of FIG. 16 described above, the monitoring station 20 is configured to accommodate a plurality of the same as the monitored stations 10, and one monitoring station 20 performs centralized monitoring of the plurality of monitored stations 10. You can do it. In the following, for convenience of explanation, a single monitored station 10 is illustrated.
Further, the camera server 16 has a characteristic function of the present invention, and focusing on the function, the state change (event) of the monitoring target related to the shooting information taken by the shooting devices 11 to 14, respectively. The shooting information of the determination unit 16a for determining the presence or absence of occurrence and the monitoring target determined by the determination unit 16a to have a state change is prioritized over the shooting information for the monitoring target determined to have no state change. Then, the priority transmission unit 16b to be transmitted to the monitoring station 20 and the end control unit 16c to end the priority transmission in the priority transmission unit 16b are provided.
As a result, in the camera server 16, the determination unit 16a determines the state change of the monitoring target, and the priority transmission unit 16b dynamically selects the band usage of the network 30 according to the determination result, and the number is small. Bandwidth can be used effectively. That is, in the normal time when the state change is not detected, the IP network 30 uses a relatively narrow band to synthesize and transmit all the video information captured by the photographing devices 11 to 14, and the state change is detected. When it is detected, the IP network 30 can preferentially transmit the shooting information of the shooting devices 11 to 14 related to the monitored target in which the state change is detected by using a relatively wide band. is there.
In addition, in FIG. 1, the external sensors 15-1 to 15-4 provided in the vicinity of the respective photographing devices 11 to 14 for detecting the state change according to the first aspect in the determination unit 16a are also shown. Has been done. With these external sensors 15-1 to 15-4, detection output related to the state change of the monitoring target to be photographed by each imaging device 11 to 14 (for example, sound detection output, door opening / closing detection output in the monitoring target, etc.) Can be obtained.
Further, as the monitoring targets to be photographed by the above-mentioned photographing devices 11 to 14, different objects may be photographed as monitoring targets, or the same monitoring object may be photographed from different angles. For example, in the photographing devices 11 to 14, it is possible to photograph a plurality of points in a shopping district or the like as monitoring targets. Further, when photographing the area around the boundary of the site as a monitoring target, it is possible to photograph the same point from the photographing devices 11 to 14 provided at a plurality of positions.
Next, the configuration of the main parts of the camera server 16 described above will be described. FIG. 2 is a block diagram showing a main configuration of the camera server 16 according to the present embodiment, and the camera server 16 shown in FIG. 2 synthesizes moving image information taken by the photographing devices 11 to 14 for each frame. The still image information is sequentially transmitted in IP packet format, and is image compression coding unit 41, frame memory 42, network processing unit 43, transmission setting processing unit 44, sensor signal processing unit 45, command analysis / processing. It is configured to include a unit 46 and a transmission setting pattern memory 47.
Here, the image compression coding unit 41 generates a still image frame from the video information (for example, moving image information) taken by the photographing devices 11 to 14, and also compresses and encodes it in the MJPEG (Motion Joint Photographic Experts Group) format, for example. The frame memory 42 temporarily stores the still image frame generated by the image compression coding unit 41. Further, the network processing unit 43 performs signal-type interface processing (network processing) between the camera server 16 and the IP network 30, and includes a network transmission processing unit 43A and a network reception processing unit 43B. ..
The network transmission processing unit 43A receives the video information compressed and encoded by the image compression coding unit 41, converts the video information into packet format data, and adds header information to the router 17. The network reception processing unit 43B outputs an IP packet input from the monitoring station 20 through the IP network 30 (incorporating control information such as attitude control information of the photographing devices 11 to 14). It terminates this IP packet.
Further, the transmission setting processing unit 44 determines whether or not there is a change in the state of the monitoring target related to the video information captured by the photographing devices 11 to 14, and makes the above-mentioned priority transmission setting based on the determination result. It is a thing. There are three modes for determining the presence or absence of the above-mentioned state change, which will be described later. As for the priority transmission mode, as described later, the image compression coding unit 41 is set and the network processing unit is used. There is a mode in which 43 settings are made.
Therefore, the transmission setting processing unit 44 described above has a function as the determination unit 16a shown in FIG. 1, and functions as the priority transmission unit 16b shown in FIG. 1 by the image compression coding unit 41 and the network processing unit 43. There is. The transmission setting processing unit 44 has a function as the end control unit 16c shown in FIG. 1, as will be described later. Further, the sensor signal processing unit 45 is provided with external sensors 15-1 to 15 in the vicinity of the imaging devices 11 to 14 in order to detect the state change of the first aspect in the transmission setting processing unit 44a as the determination unit 16a. Interface signal processing is performed for the signal (contact or serial signal) from -4, and the transmission setting processing unit 44 converts the video information captured by each imaging device 11 to 14 based on the signal processing result. It is possible to determine whether or not the state of the monitored object has changed.
Further, the command analysis / processing unit 46 receives the control information transmitted from the monitoring station 20 through the IP network 30 from the network processing unit 43, analyzes the control information content as command information, and uses the content as the command information. The processing is performed accordingly. In the second aspect of the determination of the presence / absence of the state change in the determination unit 16a described later, the presence / absence of the state change is determined based on the command from the command analysis / processing unit 46.
Further, the transmission setting pattern memory 47 stores the setting information for preferential transmission through the setting of the image compression coding unit 41 in a file or the like, and the transmission setting processing unit 44 stores the transmission setting pattern memory 47. By referring to the contents of the above, the transmission setting of the image compression coding unit 41 can be performed as the first mode for the priority transmission described later.
With the above configuration, in the shooting information transmission system 1 according to the present embodiment, the images shot by all the shooting devices 11 to 14 are usually transmitted in a narrow band, and the monitored station 10 changes some state. Only when the above occurs, the images of the corresponding imaging devices 11 to 14 are transmitted in a wide band with priority given to others. Specifically, when the transmission setting processing unit 44 detects a state change of the monitoring target being photographed by the photographing devices 11 to 14, the transmission setting processing unit 44 of the camera server 16 refers to the transmission setting pattern memory 47. By doing so, the setting processing of the image compression coding unit 41 and the network processing unit 43 is performed so that the transmission setting environment according to the above-mentioned state change is obtained.
As a result, in the camera server 16, the images captured by the photographing devices 11 to 14 related to the monitored object for which the state change is detected can be preferentially transmitted to the monitoring station 20 via the IP network 30. Further, the video preferentially transmitted from the camera server 16 can be enlarged and displayed on the terminal device 21 of the monitoring station 20 through the display 21a.
The operation mode for preferentially transmitting the video captured by the photographing devices 11 to 14 at the location where the state change is detected is determined by the end control unit 16c provided in the transmission setting processing unit 44, and then thereafter. After determining that the priority transmission is no longer necessary, return to the normal transmission setting (setting to transmit the video shot by all the shooting devices 11 to 14 in a narrow band). [B-1-1] Explanation of the first aspect of the state change detection in the determination unit By the way, FIG. 3 shows the main parts of the image compression coding unit 41, the network processing unit 43, and the transmission setting processing unit 44 of the camera server 16. It is a figure which pays attention to the structure for realizing the 1st aspect of the state change (event) detection described above about the structure.
Here, as shown in FIG. 3, the image compression coding unit 41 includes a still image generation unit 41a, a selection / composition unit 41b, a DCT (Discrete Cosine Transform) / quantization unit 41c, and a coding unit 41d. The video information from the imaging devices 11 to 14 input as NTSC (National Television Standards Committee) signals is synthesized and compressed and coded.
Further, in the network transmission processing unit 43A of the network processing unit 43, the data division unit 43a, the RTP (Real-time Transport Protocol) / UTP (User Datagram Protocol) header addition unit 43b, the IP header addition unit 43c, and the priority information addition unit 43c. With 43d and MAC header adding section 43e, the image information compressed and encoded by the image compression coding section 41 is converted into IP packet format data and sent to the IP network 30 via the router 17. There is.
The transmission setting processing unit 44 that realizes the first aspect of the state change detection receives the detection signals from the external sensors 15-1 to 15-4 provided in the vicinity of each imaging device 11 to 14 from the sensor signal processing unit 45. Based on this detection signal, it is equipped with a sensor state change detection unit 44a-1 that determines whether or not a state change has occurred in the monitoring target imaged by each of the photographing devices 11 to 14. For example, when the external sensors 15-1 to 15-4 are configured by a door open / close sensor that detects the opening / closing of a door entering or exiting a room (for example, an unmanned communication machine room) for monitoring, the transmission setting process is performed. The sensor state change detection unit 44a-1 of unit 44 determines that there is a state change when the corresponding closed door is opened. In addition, when sensors 15-1 to 15-4 are used to detect the approach of a person, it is determined that there is a state change when a person approaches the sensors 15-1 to 15-4. It has become.
The transmission setting processing unit 44 shown in FIG. 3 includes a priority setting unit 44f and an end control unit 44g together with the sensor state change detection unit 44a-1 described above. When the sensor state change detection unit 44a-1 determines that there is a state change of the monitoring target for any of the imaging devices 11 to 14 as described above, the sensor state change detection unit 44a-1 In, the priority setting unit 44f is notified to that effect. As a result, the priority setting unit 44f performs setting processing of the image compression coding unit 41 and the network processing unit 43 in order to preferentially transmit the images taken by the corresponding photographing devices 11 to 14.
In other words, the sensor state change detection unit 44a-1 of the transmission setting processing unit 44 cooperates with the sensor signal processing unit 45, based on the detection information from the external sensors 15-1 to 15-4. It constitutes a sensor information determination unit (determination unit 16a in FIG. 1) that determines whether or not a state change has occurred. Further, the image compression coding unit 41 and the network processing unit 43 realize the function as the priority transmission unit 16b (see FIG. 1) by cooperating with the priority setting unit 44f of the transmission setting processing unit 44. ..
The priority setting unit 44f includes an image quality setting unit 44b that performs setting processing of the still image generation unit 41a of the image compression coding unit 41, a transmission image selection unit 44c that performs setting processing of the selection / composition unit 41b, and a DCT. -The compression rate setting unit 44d that performs the setting processing of the quantization unit 41c and the network priority setting unit 44e that performs the setting processing of the priority information giving unit 43d of the network transmission processing unit 43A forming the network processing unit 43 are provided. It is configured. The operation in each of these functional units will be described in detail in the description of each aspect of packet priority transmission.
Further, the end control unit 44g of the transmission setting processing unit 44 terminates the priority transmission performed by the cooperation of the image compression coding unit 41, the network processing unit 43, and the priority setting unit 44f. It corresponds to the end control unit 16c shown. The operation of the end control unit 44g will be described in detail when each mode of priority transmission end is described. [B-1-2] Explanation of the second aspect of the state change detection in the determination unit FIG. 4 shows the main configuration of the image compression coding unit 41, the network processing unit 43, and the transmission setting processing unit 44 of the camera server 16. It is a figure which pays attention to the structure for realizing the 2nd mode of the state change (event) detection mentioned above.
In the one shown in FIG. 4, the frame memory 42 is provided, the image compression coding unit 41 is provided with the inter-frame comparison unit 41e, and the transmission setting processing unit 44 is provided with the image state change detection unit 44a-2. The difference is that the state change is detected. In FIG. 4, the same reference numerals as those in FIG. 3 indicate substantially the same parts. Here, the frame memory 42 stores still images sequentially generated by the still image generation unit 41a of the image compression coding unit 41, and the frame-to-frame comparison unit 41e generates still images as a frame difference calculation unit. The difference between the still image generated in Part 41a and the immediately preceding still image stored in the frame memory 42 is calculated, and the frame immediately before the monitoring image is compared with the latest frame.
Further, the image state change detection unit 44a-2 is provided in place of the sensor state change detection unit 44a-1 of the transmission setting processing unit 44 shown in FIG. 3 described above, and the frame-to-frame comparison unit 41e described above is provided. It is determined whether or not the frame difference calculated in (1) exceeds a predetermined threshold value. Then, when the threshold value is exceeded, it is possible to determine that there is an image change (state change) and notify the priority setting unit 44f to that effect.
In other words, the image state change detection unit 44a-2 has a function as a frame difference determination unit that determines whether or not a state change has occurred based on the calculation result of the frame difference from the frame-to-frame comparison unit 41e. There is. As a result, when the image state change detection unit 44a-2 determines that there is an image change (state change) of the monitoring target for any of the photographing devices 11 to 14 as described above, the priority is given. Notify the setting unit 44f to that effect. Then, the priority setting unit 44f can perform the setting processing of the image compression coding unit 41 and the network processing unit 43 for the priority transmission of the images taken by the corresponding photographing devices 11 to 14.
[B-1-3] Explanation of the third aspect of the state change detection in the determination unit FIG. 5 shows the main configuration of the image compression coding unit 41, the network processing unit 43, and the transmission setting processing unit 44 of the camera server 16. It is a figure which pays attention to the structure for realizing the 3rd mode of the state change (event) detection mentioned above. In the configuration shown in FIG. 5, the network reception processing unit 43B and the command analysis / processing unit 46 of the network processing unit 43 are compared with the configurations according to the first and second aspects described above (see FIGS. 3 and 4). The difference is that the execution state change detection unit 44a-3 of the transmission setting processing unit 44 realizes the state change detection. In FIG. 5, the same reference numerals as those in FIGS. 3 and 4 indicate substantially the same parts.
Here, the command analysis / processing unit 46 receives command information from the monitoring station 20 to the monitored station 10 through the network reception processing unit 43B, and analyzes and processes the command contents. In the case of a command for requesting a change in transmission settings in the conversion unit 41 and the network processing unit 43, particularly a command for instructing that video information related to specific photographing devices 11 to 14 should be preferentially transmitted, that fact is executed. The change detection unit 44a-3 is notified. In other words, the command analysis / processing unit 46 functions as a transmission environment setting reception unit that receives the transmission environment setting for specific shooting information from the monitoring station 20.
Further, the execution state change detection unit 44a-3 is provided in place of the sensor state change detection unit 44a-1 (image state change detection unit 44a-2) of the transmission setting processing unit 44 shown in FIG. 3 (Fig. 4) described above. When the command analysis / processing unit 46 notifies the command reception of the above-mentioned instruction, it is determined that there is a state change, and the priority setting unit 44f is notified to that effect. be able to. In other words, the execution state change detection unit 44a-3 functions as a priority request determination unit that determines whether or not a state change has occurred based on the transmission environment settings received by the command analysis / processing unit 46.
As a result, it is determined that the execution state change detection unit 44a-3 has a command to change the setting of the image transmission environment to be monitored for any of the photographing devices 11 to 14 as described above (there is a state change). If the determination is made, the priority setting unit 44f is notified to that effect. Then, the priority setting unit 44f can perform the setting processing of the image compression coding unit 41 and the network processing unit 43 for the priority transmission of the images taken by the corresponding photographing devices 11 to 14.
[B-2] Description of Packet Priority Transmission by Priority Transmission Unit When the transmission setting processing unit 44 determines that there is a state change as in the first to third aspects described above, FIGS. 3 to 5 show. The priority setting unit 44f shown is notified of the determination result, and the image quality setting unit 44b can set the image quality setting unit 44b to increase the resolution of the images of the photographing devices 11 to 14 to be preferentially transmitted.
First, the still image generation unit 41a of the image compression coding unit 41 generates still image frames at predetermined time intervals from each video signal (NTSC signal) from the photographing devices 11 to 14, and the frame interval and The resolution can be set by the image quality setting unit 44b of the priority setting unit 44f. Further, in the transmission setting pattern memory 47, a plurality of types of generation patterns for the still image frames generated by the still image generation unit 41a are stored, for example, as shown in FIG. Then, in the transmission setting pattern memory 47, as shown in FIG. 6, a pattern of the resolution of the transmission frame can be set according to the priority.
Here, in order to preferentially send the video information in which the state change is detected to the network 30, the still image generation unit 41a determines the image quality of the generated still image (number of frames generated per unit time, resolution, etc.). It can be switched. Specifically, in the image quality setting unit 44b of the priority setting unit 44f, when the video information is to be transmitted with a high priority, the corresponding high priority level resolution setting information is transmitted from the transmission setting pattern memory 47. (For example, the information of the No. 1 pattern file shown in FIG. 6) can be extracted, and based on the extracted resolution setting information, the image quality setting processing of the still image frame generated by the still image generation unit 41a can be performed. is there. In this case, as a high-priority pattern, the number of frames per unit time and the resolution are both high quality.
Therefore, by the cooperation of the still image generation unit 41a, the image quality setting unit 44b, and the transmission setting pattern memory 47 described above, any of the sensor state change detection units 44a-1, the image state change detection unit 44a-2, and the execution state The image quality of the imaging information about the monitoring target determined to have a state change by the change detection unit 44a-3 (hereinafter, these may be collectively referred to as the state change detection unit) has been improved. The image quality control transmission unit to be transmitted is configured.
Further, the selection / compositing unit 41b of the image compression coding unit 41 selects a necessary still image frame from the still image frames from the photographing devices 11 to 14 generated by the still image generation unit 41a. It is combined into one still image frame and output at predetermined time intervals. The selection of the still image frame required for frame composition in the selection / composition unit 41b is selected and set by the transmission image selection unit 44c.
That is, in the transmission image selection unit 44c, since the video information in which the state change is detected is preferentially transmitted to the network 30, the images were taken by the photographing devices 11 to 14 so that only the video information related to the state change can be transmitted. From the video information, it is possible to select the video information to be sent to the IP network 30. [B-2-1] Specifically, in the state where the state change detection unit 44a-1 to 44a-3 does not detect the state change, among the still image frames generated by the still image generation unit 41a. , While synthesizing all the images from the imaging devices 11 to 14, when the state change detection unit 44a-1 to 44a-3 detects the state change, the imaging devices 11 to 14 that have detected the state change are stationary. Only the image frame is selected and output to the DCT / quantization unit 41c. As a result, it is possible to stop the transmission of camera images other than the image corresponding to the state change and transmit only the image in which the state change is detected to the IP network 30.
For example, as shown in the signal sequence diagram of FIG. 7, in the normal time when the state change does not occur, all the images of the video information C1 from the photographing devices 11 to 14 are combined and the network processing unit 43 It is sent to the IP network 30 as an IP packet P1 through the image, but when a state change of the photographing device 13 is detected by any of the state change detecting units 44a-1 to 44a-3, the image information from the photographing device 13 A still image frame is generated only from C2 and sent to the IP network 30 as an IP packet P2. At this time, the transmission of images from the photographing devices 11, 12, and 14 other than the photographing device 13 is stopped.
Therefore, the transmission image selection unit 44c and the selection / composition unit 41b described above stop the transmission of shooting information about the monitoring target determined by the state change detection units 44a-1 to 44a-3 that no state change has occurred. At the same time, the state change detection unit 44a-1 to 44a-3 constitutes a shooting information selection sending unit that sends shooting information about the monitoring target determined to have a state change.
Further, the DCT / quantization unit 41c performs discrete cosine transform processing and quantization processing (compression processing) on the still image frame output from the selection / synthesis unit 41b at predetermined time intervals, and causes the coding unit 41d to perform discrete cosine transform processing and quantization processing (compression processing). Although it is output, the compression rate setting unit 44d of the priority setting unit 44f can also set the compression rate by the compression process in the DCT / quantization unit 41c.
[B-2-2] Further, in order to preferentially send the video information in which the state change is detected to the network, the priority information addition unit 43d of the network transmission processing unit 43A is assigned an IP header by the IP header addition unit 43c. An MPLS (Multi Protocol Label Switching) label for RSVP-TE (Resource Reservation Protocol Traffic Engineering; RFC3209) can be added as priority information to the transmitted pre-transmission packet. IP packets with this MPLS label are configured to secure bandwidth by following a defined route on the IP network 30.
The network priority setting unit 44e of the priority setting unit 44f performs the setting processing of the priority information giving unit 43d described above, and through this setting processing, a label requesting bandwidth allocation in the specified route on the IP network 30. Can be added to the packet from the IP header adding unit 43c and added. As a result, the router 17, which is the entrance of the MPLS network, receives the packet with the label requesting the bandwidth allocation and performs the corresponding bandwidth allocation process. Then, when the bandwidth is secured, the camera server 16 is notified of the answer that the bandwidth has been secured. In the camera server 16, when the network reception processing unit 43B receives a response from the router 17 that the bandwidth has been secured, the network priority setting unit 44e performs label setting processing to ensure that the video information is monitored through the band-secured route. Can be transmitted to.
For example, as shown in the signal sequence diagram of FIG. 8, in the normal time when the state change does not occur, the video information C3 from the photographing devices 11 to 14 is the IP network 30 as the IP packet P3 through the network processing unit 43. Has been sent to. At this time, the state change of the photographing device 13 is changed based on the signal from one of the state change detection units 44a-1 to 44a-3 (in FIG. 8, the external sensors 15-1 to 15-4). When detected by the sensor status change detection unit 44a-1) to be detected, the network priority setting unit 44e controls the priority information assignment unit 43c to request the allocation of bandwidth for the IP packet transmitted to the IP network 30 through the router 17. Give the MPLS label (see page 4 in Figure 8).
The router 17 performs a process for securing the bandwidth in response to the above-mentioned bandwidth reservation request, and responds to the camera server 16 to that effect when the bandwidth is secured (see P5 in FIG. 8). Upon receiving the response from the router 17 that the bandwidth has been secured, the priority information assigning unit 43d assigns a label indicating that the packet is forwarded on the route with the bandwidth secured as priority information, so that the camera server 16 sends the packet. The IP packet P6 is forwarded following a bandwidth-secured route in the IP network 30.
Therefore, in order for the above-mentioned network priority setting unit 44e and priority information giving unit 43d to send shooting information about the monitoring target determined by the state change detection units 44a-1 to 44a-3 that a state change has occurred. A bandwidth securing control unit that controls to secure the bandwidth of the network 30 of the above is configured. [B-2-3] Further, in order to preferentially send the video information in which the state change is detected to the network 30, the priority information addition unit 43d of the network transmission processing unit 43A is modified by the IP header addition unit 43c. The priority information bit may be added to the pre-transmission packet to which the IP header is added in.
Specifically, the priority information assigning unit 43d assigns a priority bit to the Virtual LAN Tag priority field and the ToS (Type of Service) field under the control of the network priority setting unit 44e. The Virtual LAN Tag priority is a 3-bit user priority (priority description) field included in the VLAN (virtual LAN) tag header of IEEE (Institute of Electrical and Electronic Engineers) 802.1Q, and is IEEE802.1p. It is standardized in. The Type of Service is an 8-bit length field in the IP header that describes the packet priority.
For example, in the normal time when the state change does not occur, as shown in the signal sequence diagram of FIG. 9A, the image compression coding unit 41 and the network processing are performed on the video information C4 from the photographing devices 11 to 14. It is sent to the IP network 30 as an IP packet P7 through unit 43. At this time, it is assumed that the content of the priority information bit assigned to the IP packet P7 by the priority information giving unit 43c is "non-priority".
Then, as shown in the signal sequence diagram of FIG. 9B, the state change (event) E of the photographing device 13 is detected in any of the state change detection units 44a-1 to 44a-3 (in FIG. 9B). Is detected by the sensor state change detection unit 44a-1), and the network priority setting unit 44e of the priority setting unit 44f controls the priority information assignment unit 43c to transmit the IP packet to the IP network 30 through the router 17. The content of the priority information bit assigned to P8 is set to "high priority".
As shown in FIG. 10, the router 17 can be provided with an L2 (Layer-2) switch 17a for switching the IP packet from the camera server 16 according to the content of the priority information bit as described above. As shown in FIG. 10, the L2 switch 17a is assigned a high-priority ToS bit value among IP packets input from a plurality of user ports 17-1 (input from the camera server 16 side). It preferentially outputs IP packets to network port 17-2 (to the IP network 30 side).
For example, if "00" is the "non-priority" bit value and "10" is the "high priority" bit value as the 2-bit ToS value as the priority control bit, the L2 switch 17a of the router 17 will have a bit value of "high priority". Of the multiple IP packets input from user port 17-1, the IP packet with the "10" ToS bit, which is the "high priority" bit, is preferentially output to network port 17-2. ..
As a result, for example, as shown in FIG. 11, when the monitoring station 20 accommodates two monitored stations 10-1, 10-2 via an IP network 30 having a bandwidth of about 100 Mbps, both monitored stations In normal times when there is no change of state in both 10-1 and 10-2, the camera server 16 of each monitored station 10-1 and 10-2 synthesizes the video information from the imaging devices 11 to 14. It is transmitted as an IP packet with a "non-priority" ToS bit added.
At this time, as shown in the signal sequence diagram of FIG. 12, the camera servers 16 of the monitored stations 10-1 and 10-2 both synthesize 10 Mbps video information from the photographing devices 11 to 14 accommodated by themselves. It is transmitted as video information P1 and P2 with a total of 40 Mbps. Therefore, in the IP network 30, IP packets of video information are transferred using a total bandwidth of 80 Mbps.
Then, when the camera server 16 of the monitored station 10-2 detects a state change (event) E for the monitoring target of the photographing devices 11 to 14 accommodated by the camera server 16, the image from the monitored station 10-1 is obtained. Is transmitted as an IP packet with a "non-priority" ToS bit attached, but a "high priority" ToS bit is added to the video from the monitored station 10-2 where the status change is detected. Transmit as an IP packet.
At this time, one photographing device 11 to 14 (for example, photographing device 13) in which a state change is detected by the setting of the still image generation unit 41a by the image quality setting unit 44b of the priority setting unit 44f (see FIGS. 3 to 5). It is possible to improve the image quality by changing the bandwidth from 10 Mbps to 40 Mbps for the video information from. In this case, the IP packet to which the "high priority" ToS bit is added from the monitored station 10-2 uses the band of 70 Mbps. Therefore, in the IP network 30, the IP packet of the video information is transferred using the band of 110 Mbps in total, which exceeds the band (100 Mbps) of the IP network 30.
At this time, since the video information is transmitted from the monitored station 10-1 as an IP packet to which the "non-priority" ToS bit is added, packet discard may occur in the portion exceeding the band of the IP network 30. It is conceivable that the video information from the monitored station 10-2 is transmitted as an IP packet with the "high priority" ToS bit added, so the packet should be reliably transferred through switching by the L2 switch 17a of the router 17. Can be done.
That is, it is conceivable that the display display of the "non-priority" packet in which the packet is discarded may be delayed or information may be lost, but the display display of the "high priority" packet is "non-priority". Since it is more important than the display of the packet, the delay and omission as described above can be ignored. Therefore, the above-mentioned network priority setting unit 44e and the priority information giving unit 43d cooperate with each other to monitor the monitoring target determined by the state change detection units 44a-1 to 44a-3 to have a state change. A priority packet generation unit that generates a packet to which priority processing information is added is configured from the shooting information.
[B-3] Explanation of Display Display Mode by Monitoring Station As described above, in the image compression coding unit 41 and the network processing unit 43, the IP packet that has been subjected to the transmission processing as the priority transmission unit 16b is a packet through the IP network 30. It will be transferred and received by the monitoring station 20. In the terminal device 21 of the monitoring station 20, in the normal time when the state change is not detected, for example, as shown in FIG. 13A, the video information from the monitored station 10 is displayed by dividing a plurality of screens. By displaying it on 21a, the video information from each shooting device 11 to 14 can be displayed evenly (4 screens of A to D).
When a state change is detected in any of the imaging devices 11 to 14 of the monitored station 10, the monitored station 10 preferentially sends out the video information from the imaging devices 11 to 14 related to the state change detection. ing. In the monitoring station 20, the video information preferentially transmitted from the camera server 16 is enlarged and displayed on the display 21a. When a state change is detected in any one of the photographing devices 11 to 14 of the monitored station 20, for example, as shown in FIG. 13 (b), the photographing devices 11 to 14 Only the video information from is enlarged and displayed in a display that occupies the entire screen (single screen display).
In other words, as shown in FIG. 1, the terminal device 21 in the monitoring station preferentially sends out shooting information about the monitoring target determined by the determination unit 16a to have a state change. It has a function as a close-up display control unit that controls to close-up and display the shooting information. [B-4] Explanation of Packet Priority Transmission Termination by End Control Unit As described above, when a state change is detected, the camera server 16 gives priority to such video information by the priority transmission unit 16b (see FIG. 1). After that, the end control unit 16c (see FIG. 1, see reference numeral 44g in FIGS. 3 to 5) can end the preferential transmission of the video information by the following two modes. ..
[B-4-1] Explanation of the first aspect of the packet priority transmission end by the end control unit FIG. 14 is for explaining the first aspect of the packet priority transmission end by the end control unit 44g (see FIGS. 3 to 5). It is a flowchart of. That is, as shown in FIG. 14, in the end control unit 44g, after a predetermined fixed time elapses (for example, after 5 minutes, the time elapses until T with T = 60 in FIG. 14 becomes T <0. Later), the transmission settings can be automatically returned to the normal state.
That is, in the normal state, the priority setting unit 44f (see FIGS. 3 to 5) extracts the transmission setting file in the normal state (for example, the setting file of No. 2) from the transmission setting pattern memory 47 (step A1), and the state. Assuming that the initial value of the variable T for measuring the priority transmission time after the change is T = -1 (step A2), the video signals (NTSC signals) from the photographing devices 11 to 14 are subjected to the image coding compression unit 41, network. It is converted into an IP packet through processing by the processing unit 43 (step A3) and sent to the IP network 30 (step A4).
Then, during transmission in such a normal state (loop by the YES route in steps A1 to A4, the YES route in step A5, and the none route in step A6), the state changes for the monitoring target in any of the photographing devices 11 to 14. In the case of (Yes route in step A6), the priority setting unit 44f extracts the transmission setting file (for example, No1 setting file) at the time of state change detection from the transmission setting pattern memory 47, and this file. According to this, the setting process is performed for the transmission setting in the image compression coding unit 41 and the network processing unit 43 (step A7).
In the image compression coding unit 41 and the network processing unit 43 in which the transmission setting processing is performed in this way, the input video signal is converted into an IP packet for priority transmission and transmitted to the IP network 30. At this time, in the end control unit 44g, the above-mentioned variable T is set to T = "60", and the time is measured by decreasing this T by "1" (step A8 to step A9, step A3,). Step A4).
After that, the image compression coding unit 41 and the network processing unit 43 continue the priority transmission at the time of state change detection as the priority transmission unit 16b until the variable T managed by the end control unit 44g becomes T <0 (step). NO route of A5, loop by step A9, step A3, step A4). Then, in the end control unit 44g, when the managed variable T becomes T <0, the above-mentioned priority transmission can be terminated. At this time, the state change detection as the determination unit 16a is further performed. It is also possible to end the priority transmission after determining that the state change has been resolved in parts 44a-1 to 44a-3.
Specifically, when the state change detection units 44a-1 to 44a-3 as the determination unit 16a have resolved the state change, the priority transmission operation by the priority transmission unit 16b at that time is performed as normal video information. Return to the send operation (YES route in step A5, "none" route in step A6). If it is determined that the state change has not been resolved (for example, when the door remains open in the external sensor 15-3), the end control unit 16c waits until the state change is resolved. , The priority transmission in the priority transmission unit 16b is continued while timing is performed again with the value of T set to "60" (the "yes" route in step A6).
In the sensor state change detection unit 44a-1 (see Fig. 3), the state change is eliminated when there is no signal input to notify the state change from the external sensors 15-1 to 15-4 that have detected the state change. Identify what you have done. Further, in the image state change detection unit 44a-2 (see FIG. 4), when the difference smaller than the preset threshold value is detected in the image in which the difference between frames is recognized and the state change is detected, the difference is detected. Identify that the state change has been resolved. Further, the execution state change detection unit 44a-3 (see FIG. 5) identifies that the state change has been resolved when the command for canceling the change request of the transmission setting by the request from the monitoring station 20 is received.
Therefore, the end control unit 44g (16c) that performs the end control according to the first aspect has a function as a timekeeping unit that measures the time during which the priority transmission is performed by the priority transmission unit 16b, and a priority transmission in the timekeeping unit. It has a function as a first control unit that terminates the priority transmission in the priority transmission unit when a predetermined time elapses. [B-4-2] Explanation of the second aspect of the packet priority transmission end by the end control unit FIG. 15 is for explaining the second aspect of the packet priority transmission end by the end control unit 44g (see FIGS. 3 to 5). It is a flowchart of. That is, as shown in FIG. 15, in the end control unit 44g, the state change detection units 44a-1 to 44a-3 as the determination unit 16a have eliminated the state change as in the case of the first aspect described above. Is identified and the transmission setting is automatically returned to the normal state.
That is, in the normal state, the priority setting unit 44f (see FIGS. 3 to 5) takes out the transmission setting file (for example, the setting file of No. 2) in the normal state from the transmission setting pattern memory 47 (step B1) and shoots. The video signals (NTSC signals) from the devices 11 to 14 are converted into IP packets through processing by the image coding compression unit 41 and the network processing unit 43 (step B2), and sent to the IP network 30 (step B3). ..
Then, during transmission in such a normal state (loop by the none route in steps B1 to B3 and step B4), if a state change occurs for the monitoring target in any of the photographing devices 11 to 14. (Yes route in step B4), the priority setting unit 44f extracts the transmission setting file (for example, No1 setting file) at the time of state change detection from the transmission setting pattern memory 47, and the image compression encoding unit according to this file. Perform the setting process for the transmission setting in 41 and the network processing unit 43 (step B5).
In the image compression coding unit 41 and the network processing unit 43 in which the transmission setting processing is performed in this way, the input video signal is converted into an IP packet for priority transmission and transmitted to the IP network 30 (steps B2 and B3). ). After that, the state change detection units 44a-1 to 44a-3 as the determination unit 16a determine that the state change has been resolved, and then terminate the priority transmission. Specifically, when the state change detection units 44a-1 to 44a-3 as the determination unit 16a have resolved the state change, the priority transmission operation by the priority transmission unit 16b at that time is performed as normal video information. Return to the send operation (from the "none" route in step B4 to step B1).
If it is determined that the state change has not been resolved (for example, when the door remains open in the external sensor 15-3), the end control unit 16c waits until the state change is resolved. , Continue the priority transmission in the priority transmission unit 16b (Yes route in step B4). Therefore, the state change detection units 44a-1 to 44a-3 as the determination unit 16a serve as a state recovery determination unit for determining whether or not the occurrence of the state change has disappeared for the monitoring target determined to have the occurrence of the state change. Has the function of. Further, the end control unit 44g (16c) that performs the end control according to the second aspect causes a state change in the monitoring target determined by the state change detection units 44a-1 to 44a-3 to have a state change. It has a function as a second control unit for terminating the priority transmission in the image compression coding unit 41 and the network processing unit 43 when it is determined that the image is lost.
[C] Explanation of the action and effect of the photographing information transmission system according to the present embodiment As described above, according to the present embodiment, the camera server 16 has a state change in the determination unit 16a due to the priority transmission unit 16b. Since the shooting information about the determined monitoring target can be sent to the monitoring station 20 in preference to the shooting information about the monitored target determined to have no change of state, it can be sent to the monitoring station 20 in real time (real time). ), While realizing remote monitoring, there is an advantage that shooting information about an important monitoring target that has undergone a state change can be reliably transmitted while making effective use of the network bandwidth.
In addition, since the priority transmission unit 16b can be configured to transmit with higher image quality, it is possible to make the display display of the shooting information about the important monitoring target in which the state change has occurred clearer. Therefore, the monitoring station 20 has an advantage that more accurate monitoring can be performed. Further, since the transmission image selection unit 44c and the selection / composition unit 41b as the shooting information selection control unit can configure a video frame to be transmitted only from an important monitoring target in which a state change has occurred, monitoring can be performed. In this case, only important video can be transmitted by efficiently using the band, and there is an advantage that the network cost can be improved.
In addition, by combining the above-mentioned function of improving the image quality of the monitored object for which the state change has occurred and the function of the shooting information selection control unit, a network having the maximum band when the state change occurs in advance. It is possible to dramatically improve the efficiency of bandwidth use as compared with the case of preparing. Furthermore, the network priority setting unit 44e and the priority information assignment unit 43d as the priority packet generation unit or the bandwidth reservation control unit are used to effectively use the network bandwidth without considering the bandwidth used by the other camera server 16. , It is possible to ensure the transmission of important monitoring targets that have been identified as having a state change.
That is, when an event occurs in a certain image, the event is detected when the event occurs in a certain image, assuming a mode in which the transmission rate of the image from the other camera server 16 is lowered or the information transmission is stopped. The camera server needs to control the image of the camera connected to it (decrease or stop the transmission rate), and at the same time notify other camera servers of the detection of the event. Therefore, a procedure for control signals between camera servers or with a monitoring station is required. As the number of camera servers increases, this control signal uses a large band.
On the other hand, according to the present embodiment, it is not necessary to consider the band used by other camera servers, only the transmission packet of the image in which the event is detected is controlled, and the signal exchange between the camera servers is unnecessary. .. Therefore, in this embodiment, the influence on the network load and the processing procedure can be reduced as compared with the embodiment assumed as described above.
[D] Others Regardless of the above-described embodiment, various modifications can be made without departing from the spirit of the present invention. For example, in the above-described embodiment, the camera server 16 sequentially transmits still image frames, but the present invention is not limited to this, and for example, the photographing device 11 to It is also possible to synthesize the moving image information as the video information taken in 14 and transmit the video information obtained by compressing and encoding by a method such as MPEG (Moving Picture Experts Group). In this case, in realizing the second aspect of the state change detection in the determination unit 16 described above, the inter-frame difference is calculated based on the information from the DCT / quantization unit 41c, and the obtained calculation result is also obtained. It is possible to determine the presence or absence of a state change.
Further, in each of the above-described embodiments, the priority setting unit 44f of the transmission setting processing unit 44 includes an image quality setting unit 44b, a transmission image selection unit 44c, a compression rate setting unit 44d, and a network priority setting unit 44e. However, according to the present invention, by providing any one of the transmission image selection unit 44c, the compression rate setting unit 44d, and the network priority setting unit 44e and performing the setting process, at least a state change is detected. It is possible to ensure the transmission of the video related to the devices 11 to 14. By appropriately combining these settings, the reliability of video communication related to the photographing device in which the state change is detected is improved, and by combining with the setting process in the image quality setting unit 44b, not only the reliability but also the image Needless to say, the quality is also improved.
Further, according to the above-described embodiment, it is possible to manufacture the apparatus of the present invention. [E] Appendix (Appendix 1) An imaging information server that captures multiple types of shooting information about the monitoring target and sends the captured shooting information to the monitoring station via the network, and is related to the plurality of types of shooting information. The determination unit that determines whether or not a state change has occurred for the monitored object and the shooting information for the monitored object that has been determined by the determination unit to have a state change have been determined to have no state change. A shooting information server characterized in that it is configured to include a priority sending unit that sends out to the monitoring station in preference to shooting information about a monitoring target.
(Appendix 2) An external sensor for detecting the state change of each monitoring target is provided, and the determination unit uses the sensor information determination unit for determining whether or not the state change has occurred based on the detection information from the external sensor. The shooting information server described in Appendix 1, which is characterized by being configured in preparation for this. (Appendix 3) Based on the frame difference calculation unit that calculates the frame difference of the shooting information captured for each of the plurality of monitoring targets and the calculation result of the frame difference in the frame difference calculation unit. The shooting information server according to Appendix 1, characterized in that it is configured to include a frame difference determination unit that determines whether or not a state change has occurred.
(Appendix 4) The determination unit also sets the transmission environment setting reception unit that receives the transmission environment setting for specific shooting information from the monitoring station and the transmission environment setting received by the transmission environment setting reception unit. The shooting information server according to Appendix 1, further comprising a priority request determination unit for determining whether or not a state change has occurred.
(Appendix 5) The priority transmission unit is configured to include an image quality control transmission unit that enhances the image quality and transmits the shooting information of the monitoring target determined by the determination unit to have a change of state. The shooting information server according to any one of Appendix 1 to 4, which is characterized by the above. (Appendix 6) The priority transmission unit is provided with a priority packet generation unit that generates a packet to which priority processing information is added from shooting information about a monitoring target determined by the determination unit to have a state change. The shooting information server according to any one of Appendix 1 to 5, which is characterized in that it is configured in the above manner.
(Appendix 7) Bandwidth securing control unit that controls the priority sending unit to secure the bandwidth of the network for transmitting the photographing information about the monitoring target determined by the determination unit that the state change has occurred. The shooting information server according to any one of Appendix 1 to 5, which is characterized in that it is configured in accordance with the above. (Appendix 8) The priority transmission unit stops the transmission of shooting information about the monitoring target determined by the determination unit to have no change of state, and the determination unit indicates that the change of state has occurred. The shooting information server described in Appendix 1 to 5, characterized in that it is configured to include a shooting information selection sending unit that sends shooting information about the determined monitoring target.
(Supplementary note 9) The photographing information server according to any one of Supplementary note 1 to 8, characterized in that it is configured to include an end control unit for terminating the priority transmission in the priority transmission unit. (Appendix 10) A time lapse of a predetermined time between the timekeeping unit for measuring the time during which the priority transmission is performed by the priority transmission unit and the time during which the priority transmission is performed at the timekeeping unit. The photographing information server according to Appendix 9, wherein the first control unit for terminating the priority transmission in the priority transmission unit is provided in the case of the above-mentioned case.
(Appendix 11) The end control unit is provided with a state recovery determination unit for determining whether or not the occurrence of the state change has disappeared for the monitoring target determined by the determination unit to have the occurrence of the state change. With respect to the monitoring target determined to have the occurrence of the state change in the determination unit, when it is determined that the occurrence of the state change has disappeared, the second control unit that terminates the priority transmission in the priority transmission unit. The shooting information server described in Appendix 9, which is characterized in that it is configured in preparation.
(Appendix 12) Multiple imaging devices that capture images of the monitoring target, a monitoring station that receives the images captured by the imaging devices for monitoring, and the imaging information captured by each imaging device are captured. A shooting information server that sends the captured shooting information to the monitoring station via a network is provided, and the shooting information server generates a state change of the monitoring target related to the shooting information shot by each shooting device. The shooting information of the determination unit that determines the presence or absence and the monitoring target that is determined by the determination unit that the state change has occurred is prioritized over the shooting information of the monitoring target that is determined that the state change has not occurred. A shooting information transmission system, characterized in that it is configured to include a priority transmission unit for transmitting to the monitoring station.
(Appendix 13) When the monitoring station receives the shooting information about the monitoring target determined by the determination unit to have the change of state, which is preferentially sent from the shooting information server, the shooting information is received. The shooting information transmission system according to Appendix 12, characterized in that it is configured to have a close-up display control unit that controls close-up display.
<figref num="1">It is a block diagram which shows the photographing information transmission system which concerns on one Embodiment of this invention.</figref><figref num="2">It is a block diagram which shows the main part structure of the camera server which concerns on this embodiment.</figref><figref num="3">It is a figure which pays attention to the configuration for realizing the 1st mode of the state change (event) detection about the main part configuration of the camera server of this embodiment.</figref><figref num="4">It is a figure which pays attention to the configuration for realizing the second aspect of the state change (event) detection about the main part configuration of the camera server of this embodiment.</figref><figref num="5">It is a figure which pays attention to the structure for realizing the 3rd mode of state change (event) detection about the main part structure of the camera server of this embodiment.</figref><figref num="6">It is a figure which shows the transmission setting pattern memory in this embodiment.</figref><figref num="7">It is a signal sequence diagram for demonstrating the operation of this embodiment.</figref><figref num="8">It is a signal sequence diagram for demonstrating the operation of this embodiment.</figref><figref num="9">Both (a) and (b) are signal sequence diagrams for explaining the operation of the present embodiment.</figref><figref num="10">It is a figure which shows the L2 switch provided in the router of the monitored station which concerns on this embodiment.</figref><figref num="11">It is a figure which shows the network configuration assumed for demonstrating the operation of this embodiment.</figref><figref num="12">It is a signal sequence diagram for demonstrating the operation of this embodiment.</figref><figref num="13">Both (a) and (b) are diagrams for explaining the display mode at the monitoring station in the present embodiment.</figref><figref num="14">It is a flowchart for demonstrating operation of this Embodiment.</figref><figref num="15">It is a flowchart for demonstrating operation of this Embodiment.</figref><figref num="16">It is a figure which shows the conventional example.</figref>
Code description
1 Shooting information transmission system 10,10-1,10-2 Monitored station 11 ~ 14 Camera (shooting device) 15-1 ~ 15-4 External sensor 16 Camera server (shooting information server) 16a Judgment unit 16b Priority transmission unit 16c , 44g Termination control unit 17 Router 17a L2 switch 17-1 User port 17-2 Network port 20 Monitoring station 21 Terminal device 21a Display 22 Router 41 Image compression coding unit 41a Still image generation unit 41b Selection / synthesis unit 41c DCT / Quantum Conversion unit 41d Encoding unit 41e Frame-to-frame comparison unit 42 Frame memory 43 Network processing unit 43a Data division unit 43b RTP / UDP header addition unit 43c IP header addition unit 43d Priority information addition unit 43e MAC header addition unit 43A Network transmission processing unit 43B Network reception processing unit 44 Transmission setting processing unit 44a-1 Sensor status change detection unit 44a-2 Image status change detection unit 44a-3 Execution state change detection unit 44b Image quality setting unit 44c Transmission image selection unit 44d Compression rate setting unit 44e Network priority setting unit 44f Priority setting unit 45 Sensor signal processing unit 46 Command analysis / processing unit 47 Transmission setting pattern memory 100 Shooting information transmission system 101 ~ 104 Camera 106 Camera server 107 Router 110 Monitored station 120 Monitoring station 121 Terminal device 121a Display 122 Terminal device
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| WO2017134793A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| WO2020039898A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| CN112640444A | Cited by | China | Search report |
| JP2007221693A | Cited by | Japan | Search report |
| JP2007221693A | Cited by | Japan | Search report |
| JP2009015536A | Cited by | Japan | Examiner |
| CN107278371A | Cited by | China | Search report |
| JPWO2020039898A1 | Cited by | Japan | Search report |
| JP2002024975A | Cites | Japan | Examiner |
| JP2003009130A | Cites | Japan | Examiner |
| JP2003306106A | Cites | Japan | Search report |
| JP2004023505A | Cites | Japan | Search report |
2 priority claims, no other members on record
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 2004102546 | Japan | A | |
| JP20040102546 | – | – | – |
3 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Decision of refusalA02 | A02 | |
| Notification of reasons for refusalA131 | A131 | |
| Written request for application examinationA621 | A621 |
Numbers
- Publication
- 2005292879
- Publication, DOCDB
- 2005292879
- Publication, EPODOC
- JP2005292879
- Application
- 102546
- Application, DOCDB
- 2004102546
- Application, EPODOC
- JP20040102546
Titles3
- Japanese
- 撮影情報サーバおよび撮影情報送信システム
- English
- Shooting information server and shooting information transmission system
- English
- PHOTOGRAPHIC INFORMATION SERVER AND PHOTOGRAPHIC INFORMATION TRANSMISSION SYSTEM
Classification
- CPC, 3
- G08B13/19693
- G08B13/19656
- G08B13/19695
- IPC, 6
- H04N7 18
- G06K9 00
- G08B13 196
- G08B25 00
- H04N7 00
- H04Q9 00