Control system for camera

【0001】

[Industrial application field]

The present invention relates to a control device for a camera device capable of controlling operations such as panning and tilting, and is particularly suitable for use in a video conferencing system.<u style="single">Camera device control system, camera system management method, and management device</u>It is about.

【0002】

[Conventional technology]

Conventionally, a video conferencing system equipped with a plurality of cameras whose operations such as pan, tilt, and zoom can be controlled by a computer has been proposed, but this proposed system is a dedicated system installed in a conference room or the like. Is the mainstream, and the connection between the terminal devices used in the system is fixed when the conference starts, and new terminal devices are not connected or the terminal devices are separated in the middle. ..

【0003】

[Problems to be Solved by the Invention]

However, when a video conferencing system for individuals using a device such as a personal computer is used in addition to a dedicated video conferencing system installed in a conference room or the like, a large number of users will use video conferencing as needed. And the camera control software may be executed or stopped. In such cases, users joining or leaving the conference (connecting or disconnecting terminals to the system), setting permissions for mutual terminals of users participating in the conference, and the system. It is necessary to manage the system such as notifying the access status of the terminal device of the user connected to.

【0004】

The present invention provides a camera device control system that solves the above problems and enables a large number of users to control a camera device connected to a network as needed without stopping the system. With the goal.

【0005】

Another object of the present invention is to provide a control system for a camera device that facilitates participation in and withdrawal from a video conference.

【0006】

[Means for solving problems]

In order to achieve the above object, in the control system of the camera device of the present invention, a plurality of control devices and a management device are connected to each other via a network, and the camera device connected on the network is connected by the plurality of control devices. A control system for a camera device that can be controlled, in order to enable the management device to set a registration means for registering the camera device in the system and a connection of the control device to the camera device. And a management means for managing the connection state of the control device registered in the system to the camera device, and the registration means responds to a registration request issued by the control device. The device is set to be registered in the system, and the setting means responds to the access right change request issued by the control device.<u style="single">Operation control based on camera control signals from other control devices for the camera device registered by the registration means</u>It is characterized in that the setting of permission and non-permission is changed.

【0007】

Further, the camera system management method of the present invention is a camera system in which a plurality of control devices and management devices are connected to each other via a network, and the camera devices connected on the network can be controlled by the plurality of control devices. In the camera system management method, the registration of the camera device to the system, the setting of the connection of the control device to the camera device, and the management of the connection state of the control device registered in the system to the camera device are performed. Then, the management device is set to register the camera device in the camera system in response to the registration request issued by the control device, and in response to the access right change request issued by the control device.<u style="single">Operation control based on camera control signals from other control devices for the registered camera device</u>It is characterized in that the setting of permission and non-permission is changed.

【0008】

Further, the management device of the present invention is a management device connected to the plurality of control devices via the network in order to manage a system in which a camera device connected on the network can be controlled by a plurality of control devices. The registration means for registering the camera device in the system, the setting means for enabling the setting of the connection of the control device to the camera device, and the control device registered in the system. The registration means has a management means for managing the connection state to the camera device, and the registration means sets the camera device to be registered in the system in response to a registration request issued from the control device. In response to the access right change request issued by the control device<u style="single">Operation control based on camera control signals from other control devices for the camera device registered by the registration means</u>It is characterized in that the setting of permission and non-permission is changed.

【0009】

[Example]

Hereinafter, examples of the present invention will be described in detail with reference to the drawings.

【0010】

FIG. 1 is a block diagram showing a schematic configuration of a camera control device according to an embodiment of the present invention. The camera device 10 has a camera unit 12 capable of capturing an image of a subject and capable of performing a zoom operation, and a posture (rotation) of the camera unit 12 in a pan direction (horizontal direction in FIG. 1) and a tilt direction (vertical direction in FIG. 1). (Dynamic position) It has a controllable pan head portion 14. The display device 16 can display an image captured by the camera unit 12 on the screen 16a. The workstation 20 gives instructions for controlling the state of the camera device 10 (for example, the position in the pan and tilt directions, and even the position in the zoom direction), and displays the image information captured by the camera device 10. A CPU 21, a ROM (not shown), a storage unit 22 having RAM, I / O ports 24 and 29 as input / output units, and a video board 25 are provided to display data on the display device 16 as a means. A mouse 26 and a keyboard 27 as pointing devices for input are connected. Each of these elements is connected via bus 28. Here, the CPU 21 as a system control unit controls the system. On the other hand, the ROM of the storage unit 22 stores a program for executing the system, and the RAM stores each data. The I / O port 24 outputs a camera state control signal emitted by the CPU 21 to the camera device 10, and inputs a value indicating each state of the camera device 10 from the camera device 10. This I / O port 24 is connected to the camera device 10 via RS232C in this embodiment. The video board 25 transmits the image information obtained from the camera device 10 to the display device 16. In this embodiment, the NTSC signal is converted into RGB format and output.

【0011】

A plurality of camera control devices 2 as described above can be connected via the network 30, and signals are transmitted and received through the I / O port 29. These configurations make so-called video conferencing feasible. In this embodiment, the workstation is used as a control device in consideration of versatility and processing capacity, but of course a personal computer may be used, or a dedicated control device may be used. Further, in such a video conferencing system, it is possible to participate in the conference in the form of attendance. Therefore, as shown in the middle part of FIG. 1, the camera control device 2'to which the camera device 10 is not connected is connected to the network 30. It is also possible to do.

【0012】

FIG. 2 is a diagram showing a configuration of software for executing this embodiment. The software configuration is as follows. The workstation 20 (strictly speaking, the storage unit 22) connected to the camera device 10 has a video conferencing software 40 as software for transmitting image information obtained by the camera device 10 to another point such as a remote location, and a camera. , The camera control server 41 as software for controlling is stored. Further, the camera control server 41 causes the camera management server 45, which will be described later, to register that the camera device 10 is connected to the video conferencing system (network) when the camera device 10 is started. Therefore, in this embodiment, the camera management server 45 can be regarded as a registration means.

【0013】

On the other hand, the workstation 20 (strictly speaking, the storage unit 22) connected to the display device 16 has video conferencing software 42 as software for displaying transmitted image information and software for remote control of the camera. The camera control panel 43 is stored. The camera control panel 43 can also refer to, describe, correct, and the like the list (details will be described later) managed by the camera management server 45. Therefore, in this embodiment, the camera control panel 43 can be seen as a part of the setting means. Further, when the camera management server 45 permits the connection with the camera device 10, the camera control panel 43 transmits the camera control signal to the camera control server 41 without going through the camera management server 45.

【0014】

The above software 41 and 43 will be collectively referred to as "camera control client" below.

【0015】

Further, the camera management server 45 is prepared as software for managing the access of all the camera devices 10. The camera management server 45 may be stored in any one workstation 20 connected to the system. The camera management server 45 may be stored in any workstation 20, and any one of the workstations 20 may function as a server when the video conferencing system is started on the network. Further, in the above description, the workstation 20 is described as being connected to the camera device 10 and the display device 16, respectively. However, since each user normally uses the camera device 10 and the display device 16, respectively, FIG. As can be seen in the block diagram of, there is one workstation 20 for the camera device 10 and the display device 16. Therefore, the video conferencing software 40 and 42 are configured as one software.

【0016】

Next, in the configuration of this embodiment, the main operations of remote control of the camera device 10 by the camera control server 41, user management by the camera management server 45, and access management by the camera management server 45 will be described below.

【0017】

First, a means for realizing remote control of the camera device 10 connected to any other workstation 20 from the workstation 20 connected to the network 30 will be described.

【0018】

Since the camera device 10 can be controlled by transmitting a control signal from the workstation 20 in which the camera control server 41 exists to the camera device 10 via RS232C, the pan existing on the camera control server 41 can be controlled. By remotely activating camera control functions such as tilt and zoom using RPC (Remote Procedure Call), a method that outputs a command sequence corresponding to this operation to the RS232C port (not shown) on the pan head 14 is used. It should be realized. Note that this control signal (command sequence) is transmitted to a control unit (not shown) related to the operation of the pan head 14 such as pan and tilt, and is related to the operation of the camera unit 12 such as zooming to the camera unit 12. Is transmitted to a control unit (not shown).

【0019】

Therefore, for the purpose of camera control, a function as shown in FIG. 3A is prepared as a function for calling the camera control server 41 in a remote location from the camera control client using RPC. In explaining this function, the description of the commands shown in the figure is enclosed in [,]. The following explanation is based on the description in C language adopted in this embodiment, but it may be described in another language. In the function shown in FIG. 3 (a), [struct camera_in {~} camera_in] declares data for setting a set of parameters to be passed from the camera control panel 43 to the camera control server 41 for the operation of the camera device 10. So, here, tilt, pan, and zoom are set. Also, [struct func_out {~} func_out] is a data declaration for setting the output value. For example, if there is no problem with the processing result of the function, ret = 0, if there is a problem, ret = -1. can do. In addition, [camera_open] is the client handler [CLIENT] required to communicate with the camera control server 41. * cl] is a function to create, and [camera_close] is a function to delete it. The camera control client first calls [camera_open] to connect with the camera control server 41, then executes commands such as [camera_pan_pos_1], and finally calls [camera_close] to call the camera. End control.

【0020】

Next, the management of users by the camera management server 45 will be described.

【0021】

The camera management server 45 uses the camera status list 50 as shown in FIG. 4 for user management. In this camera status list 50, the host name registered in the camera control server 41, that is, the name indicating the camera device 10 connected on the network 30, and the usage status of the camera device 10 (vacant, accessed by other users). (Middle) is stored, and data on the position (x, y, z) and posture (panning angle, tilting angle) of the camera device 10 are also stored. As described in this embodiment, the above host name can be matched with the user name when only one camera device 10 is connected to the camera control device 2, but when a plurality of camera devices 10 are connected, the host name can be matched. Should not match. In the example shown in Listing 50, the camera devices 10 shown by host1, host2, host3, and host4 are connected, and the camera device 10 of host2 is controlled by the user of host3, and the camera device 10 of host4 is controlled by the user of host1. It is ready and host1 and host3 Indicates that no user is operating.

【0022】

Here, for user registration / deletion, when the camera control server 41 is started, the started user name is notified to the camera management server 45 and registered in the camera status list 50, and when the camera control server 41 is stopped, the camera is registered / deleted. The process of deleting the user name from the status list 50 is realized by using the function shown in Fig. 3 (b) using RPC. In the function shown in Fig. 3 (b), [struct host_name {~} host_name] is a data type declaration that sets the parameters passed from the camera control panel 43 to the camera control server 41 in order to set the host name. , Specifies the number of characters in the name set by [MAXNAME]. [append_camera_list_1] is a function that is started by the camera control server 41 and executed in the camera management server 45. When this function is executed, that is, when the camera control server 41 is started (step P1) as shown in FIG. 5 (a), the camera management server 45 registers the host name in the camera status list 50 (as shown in FIG. 5 (a)). Step P2). This host name is host_name, as you can see in Figure 3 (b). Consists of types and is indicated by [host_name-&gt; name]. After that, it is stored that the camera device 10 can be controlled through the camera control server 41. When the camera control server 41 is stopped, as shown in FIG. 5 (b), a function in the camera control server 41 that starts [delete_host_list_1] from another program is called (step PP1), and then the camera control server 41 calls the function. All you have to do is delete the host name and end the process execution (step PP2). Therefore, in this embodiment, the camera management server 45 can be regarded as a setting means.

【0023】

Access management by the camera management server 45 will be described.

【0024】

As an access control method by the camera management server 45, the functions [access_begin_1] and [access_end_1] that are started by the camera control client and executed by the camera management server 45 as shown in FIG. 6 are added. This function allows you to start and end access. In addition, [struct access_in {~} access_in] is a parameter declaration to be passed from the camera control panel 43 to the camera management server 45 in order to set the access target. Set the user (self) by.

【0025】

The procedure for processing the access request will be described below. Prior to the description, the access permission list will be described with reference to FIG. 7. The permission lists 60 and 61 are held by the camera management server 45, and for each individual camera device 10 registered in the list 60, there is a list 61 of users who can access the camera device 10. In the example shown in Figure 7, Listing 61 for camera device 10 represented by host2 is shown, and the users represented by host1 and host4 are in a state where they can be granted access, and the users of host3 are not allowed access. It is set. Since the user of host2 can control the camera device 10 indicated by host2 without going through the camera management server 45, it is not involved in this list 61.

【0026】

Then, the access request processing is performed according to the flowchart shown in FIG.

【0027】

When the camera control client requests access to the camera device 10, the camera device name requested by the camera control client to access is first decoded from [target_name] (step S1).

【0028】

Next, it is confirmed whether or not the camera device 10 is activated by referring to the camera status list 50. If it is not started, move to step S7 (step S2).

【0029】

If it was started in step S2, it decrypts [user_name] and sees the permission list 61 to see if the user named by this name has the right to access the camera device 10 requesting access. If there is no permission, move to step S7 (step S3).

【0030】

If you have permission in step S3, check the camera status list 50 to see if the camera device 10 is being used by another user. If used, move to step S7 (step S4).

【0031】

If it is not used in step S4, the user name (host name) is registered in the camera status list 50 (step S5), and the process returns as successful access request (step S6).

【0032】

In step S7, it is determined that the access has failed and the process returns.

【0033】

On the camera control client side, be sure to execute [access_begin_1] and [access_end_1] before and after performing the access operation.

【0034】

Further, in order to realize the means for the user to set the permission of the access right for each user, the user provides an instruction [change_access_mode_1] for changing the access permission lists 60 and 61 in the camera management server 45. This will be described with reference to FIG.

【0035】

The camera control client calls [change_access_mode_1] by setting the host name to change the access permission to [target_name] and the access state to change to [access_mode] by [struct change_in {} change_in]. The camera management server 45 first executes the [gethost] instruction, which is a UNIX library function, and confirms from which user the instruction was called. Next, in the access permission lists 60 and 61, the camera item indicated by [target_name] in the item of the user who called the command is changed to the mode indicated by [access_mode]. Here, set the mode to allow access and the mode to not allow access as the contents of [access_mode]. Here, when the mode is set to allow, "OK" is displayed in Listing 61 shown in FIG. 7, and when the mode is set not to allow, "NO" is displayed. Therefore, in this embodiment, the camera management server 45 can be regarded as a connection permission setting means.

【0036】

In this embodiment, in order to further realize a means for accurately transmitting the access status to the user and easily performing processing such as an access request and a change in the access permission status, a GUI as shown in FIG. 10 is used. Graphical User Interface) is displayed on screen 16a. With this GUI, the user can obtain information on the current registration status, usage status, and usage permission status of the camera device 10. In addition, the camera device 10 can be switched, and the access permission state can be changed. An example of GUI operation shown in FIG. 10 will be described below.

【0037】

By pressing the camera status list update button 73, the user can obtain the access information of each current camera from the camera management server 45 by the same method as the method using RPC described above. The button is pressed by operating the mouse 26 to move the cursor 18, position it on the desired button, and click the first button 26a. The obtained information is displayed in the list window 72. In addition, the user can set the camera device 10 to be controlled by operating the mouse 26 or the keyboard 27 on the camera status list 50 displayed on the list window 72.

【0038】

Further, the above-mentioned access request processing and access end processing are executed by pressing the access start button 74 and the access end button 75, respectively. Further, in the above-mentioned access permission change process, by pressing the access permission setting button 76, the mouse 26 or the keyboard 27 is operated on the list displayed on the list window 72 corresponding to the access permission list 60. Can be changed with. The application end button 77 is pressed when all operations are completed. Therefore, in this embodiment, the mouse 26 or the keyboard 27 can be seen as a part of the setting means or the connection permission setting means.

【0039】

An image window 71 is provided on the screen 16a, and an image captured by the camera device 10 is displayed. By operating the pan operation buttons 78a, 78b, tilt operation buttons 78c, 78d, home position return button 78e, and zoom operation buttons 78f (enlargement) and 78g (reduction) of the camera control unit 78 on the screen 16a. The camera device 10 can be controlled, and this control changes the image displayed on the image window 71. This control is performed by moving the cursor 18 with the mouse 26 to position it on a predetermined button and clicking the first button 26a. The operation buttons 78a, 78b, 78c, and 78d are provided for each of the pan and tilt movement directions for easy identification, and by providing the home position return button 78e, the camera device 10 is placed in the home position (reference). Position: In this embodiment, it can be easily returned to the center of the rotation angle in the pan and tilt directions), and this button 78e is placed in the central empty space where the operation buttons 78a, 78b, 78c, 78d are arranged. Since it is arranged, it is easy to visually understand that it is returned to the home position, and it is easy for the user to operate it. It should be noted that the zoom operation buttons may be unified, and the enlargement / reduction may be divided into the first button 26a and the second button 26b for operation.

【0040】

An example of performing a video conference by operating the above GUI will be described.

【0041】

First, prior to the start of the video conference, the video conference software 40, 42, the camera management server 45, the camera control server 41, and the camera control panel 43 are launched. Considering the functions of each software, this order is desirable, but it may be started at the same time in conjunction with the power-on of the camera device 10. Also, if you want to participate in a video conference that has already been held, you do not need to start up the camera management server 45.

【0042】

To participate in a video conference under such a state, press the camera status list update button 73 to display the camera status list 50 in the list window 72, and the cameras displayed in the camera status list 50. Select the camera device 10 to be operated from the devices 10, and then press the access start button 74. At this time, the above-mentioned [access_begin_1] is executed. This enables the above-mentioned access processing and control of the camera device 10.

【0043】

To exit the video conference, press the access end button 75. At this time, [access_end_1] is executed. In this state, since the camera device 10 is connected to the network 30, it can be controlled by the other party, and the transmitted image information can also be viewed on the display device 16. Then, when all the operations are finished, the application end button 77 is pressed.

【0044】

In this embodiment, the one described as a user can also be regarded as the camera control device 2.

【0045】

[Effect of the invention]

As described above, according to the present invention, there is provided a camera device control system that enables a large number of users to control a camera device connected to a network as needed without stopping the system. can do.

【0046】

In addition, it is possible to provide a control system for a camera device that facilitates participation in and withdrawal from a video conference.

[Simple explanation of drawings]

FIG. 1 is a block diagram showing a schematic configuration of an embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of software for executing the operation of this embodiment.

FIG. 3 is an example of a program, (a) is a function for calling the camera control server 41, and (b) is a function for registering and deleting a user.

FIG. 4 is a diagram showing an example of a camera state list.

5A and 5B are flowcharts for explaining the operation, in which FIG. 5A shows a registration process when the camera is started, and FIG. 5B shows a deletion process when the camera is stopped.

FIG. 6 is an example of a program and is a function for performing access processing.

FIG. 7 is a diagram showing an example of a permission list.

FIG. 8 is a flowchart showing a process for a camera access request.

FIG. 9 is an example of a program and is a function for setting access permission.

FIG. 10 is a diagram showing an example of GUI.

[Explanation of symbols]

2 Camera control device 10 Camera device 16 Display device 20 Workstation 26 Mouse 27 Keyboard 30 Network 40 Video conferencing software 41 Camera control server 42 Video conferencing software 43 Camera control panel 45 Camera management server