Network capturing apparatus, displaying method, computer-readable recording medium, and network system

BACKGROUND OF THE INVENTION

The present invention relates to a network capturing apparatus capable of performing a voice communication, a displaying method for activating a computer system to control the network camera, a computer-readable recording medium storing the program, and a network system for performing image and voice communications with the computer system.

In recent years, there has spread the network system, in which an image is taken by a network camera and is transmitted to a computer system through the network such as the internet. However, this network system can acquire the image information by controlling the computer system but not the surrounding voice information. Thus, there has been developed the network camera (as will be called the “voice mapping type network camera”), which is enabled to perform not only the image communication but also the voice communication by mounting a speaker and a microphone.

<figref idrefs="DRAWINGS">FIG. 8</figref> is an explanatory diagram of a network system for the voice communication of the related art. In this network system, in connection with the transmission of an image, an image taken by a camera <b>1</b> of a voice mapping type network camera <b>1</b> is compressed by an image processor <b>12</b>, and this compressed image data is processed in a protocol by a communication control unit <b>13</b>. This processed data is sent to a network <b>3</b> and to a computer system <b>2</b>. This computer system <b>2</b> decompresses the image data received, and displays it on a screen. Although not shown in <figref idrefs="DRAWINGS">FIG. 8</figref>, a plurality of voice mapping type network cameras <b>1</b> are connected with the network <b>3</b> so that the computer system <b>2</b> acquires the image information taken by each camera <b>10</b> by interchanging the voice mapping type network cameras <b>1</b>.

In connection with the voice communication, moreover, the voice inputted from a microphone <b>17</b> is subjected to an AD conversion and a compression by a voice transmission processor <b>15</b> so that the voice transmission data is sent through the communication control unit <b>13</b> and the network <b>3</b> to the computer system <b>2</b>. This computer system <b>2</b> processes the voice transmission data received, and outputs a voice from a speaker <b>28</b>. Likewise, the voice inputted from a microphone <b>27</b> of the computer system <b>2</b> is processed by the computer system <b>2</b> and is transmitted as the voice reception data so that it is sent through the network <b>3</b> to the voice mapping type network camera <b>1</b>. In this voice mapping type network camera <b>1</b>, the voice reception data received is transferred through the communication control unit <b>13</b> to a voice reception processor <b>14</b>, in which the data is decompressed and DA-converted and is outputted to a speaker <b>18</b>.

In case a user of the voice mapping type network camera <b>1</b> in this network system sends a voice and listens to a collected sound, the user inputs the voice to the microphone <b>27</b> of the computer system <b>2</b>. After voice data was transmitted, the voice is outputted from the speaker <b>18</b> of the voice mapping type network camera <b>1</b>. Simultaneously with this, the voice is collected by the microphone <b>17</b> and is transmitted to the computer system <b>2</b> so that it is outputted from the speaker <b>28</b>. A control unit <b>19</b> controls the entire system of the voice mapping type network camera <b>1</b>. On the other hand, the voice is processed in the computer system <b>2</b> by the JAVA (of a registered trade mark) applet program downloaded from the voice mapping type network camera <b>1</b>.

When the image information is to be acquired from the plural voice mapping type network cameras <b>1</b>, it has been proposed (as referred to JP-A-9-247637, for example) that the states of the voice being transmitted and received are displayed on the display. The network system of JP-A-9-247637 has been proposed for a TV conference system or the like, in which a plurality of video/audio communication terminals each equipped with a video camera, a microphone and a speaker are connected with the network. The screens to be displayed on the displays of the video/audio communication terminals display a list of the multi-point video display windows of the video cameras. There are also displayed camera control panels, direction buttons for the pan (horizontal) control and the tilt (vertical) control, and zoom buttons for the zoom controls. Moreover, there are further displayed the symbols for indicating the video transmissions. The displays of symbols indicate that the images taken by the video cameras are being sent to the network <b>3</b>. While the symbol indicating the voice transmission is displayed and being displayed, it is indicated that the input by the microphone and the output of the input voice to the network are effective. While the symbol indicating the voice being received is being displayed, the voice received from the network and outputted by the speaker is effective.

In case the voice transmission/reception between the voice mapping type network camera <b>1</b> and the computer system <b>2</b> is made in a half duplex manner, the microphone <b>27</b> of the computer system <b>2</b> cannot be used while the sound around the voice mapping type network camera <b>1</b> is being outputted from the speaker <b>28</b> of the computer system <b>2</b>. During the inputting from the microphone <b>27</b> of the computer system <b>2</b>, on the other hand, the sound around the voice mapping type network camera <b>1</b> cannot be outputted from the speaker <b>28</b>.

In case, moreover, the plural voice mapping type network cameras <b>1</b> are shared by a plurality of users in such network system, only earlier one of the users can use the microphone <b>27</b>, but the remaining users cannot. If the information is not transmitted the individual users, the controls lose comfortableness.

Here in JP-A-9-247637, the symbol indicating the voice being transmitted is displayed in the display of the video/audio communication terminal of the TV conference system or the like, to indicate that the input and the transmission of the input voice to the network are effective. At the same time, the symbol indicating the voice being received is displayed to indicate that the voice output of the received voice from the network is effective. However, this TV conference system or the like does not perform the aforementioned voice transmission/reception in the half duplex communication.

In view of the problems of the related art thus far described, therefore, the invention has an object to provide a network capturing apparatus, a displaying method, a computer-readable recording medium, and a network system, which can perform voice communications simply by comfortable operations.

In order to solve the above problems of the related art, according to the invention, there is provided a network capturing apparatus capable of transmitting an image taken with a camera to one or more terminals made possible to perform the half duplex voice communication, through a network and communicating the terminal in voice. When a communication unit receives a demand from the terminal, a page information creation unit creates the page information, which makes: a first button display indicating the voice outputting possibility, in case the voice output is not inhibited and another terminal is not the voice output; a second button display indicating the voice output in case the voice output is performed; and a third button display indicating a temporary voice output inhibit, in case another terminal is in the voice transmission, and which can be altered, when selected, to another button display in accordance with the change in the communication state, and the communication unit transmits the page information to the terminal.

According to the network capturing apparatus, the displaying method, the computer-readable recording medium, and the network system of the invention, the voice communication can be done comfortably and simply merely by making controls while observing the icon on the screen displaying page.

In order to solve the above problems of the related art, according to the invention, there is provided a network capturing apparatus which is adapted to connect to at least one terminal through a network, comprising: <ul><li id="ul0001-0001" num="0000"><ul><li id="ul0002-0001" num="0014">a page information generating unit that generates first page information to be displayed on the terminals;</li><li id="ul0002-0002" num="0015">a communication unit that communicates with the terminal through the internet;</li><li id="ul0002-0003" num="0016">a capturing unit that captures an image around the network capturing apparatus;</li><li id="ul0002-0004" num="0017">a voice collecting unit that collects a sound around the network capturing apparatus;</li><li id="ul0002-0005" num="0018">a voice outputting unit that outputs a sound based on sound data transmitted from the network; and</li><li id="ul0002-0006" num="0019">a control unit that controls a voice communication with the sound data regarding the collected sound and the outputted sound in half duplex communication,</li><li id="ul0002-0007" num="0020">wherein the page generating unit generates the first page information in response to a request of the first page information from the at least one of the terminal;</li><li id="ul0002-0008" num="0021">wherein the first page information includes an caption image captured by the capturing unit and at least one of a first display information, a second information and a third information;</li><li id="ul0002-0009" num="0022">wherein the first page information includes the first display information that indicates a voice outputting possibility in a case that the voice output is not inhibited at the terminal that transmits the request of the first page information and the another terminal does not output the sound data to the communication unit;</li><li id="ul0002-0010" num="0023">wherein the first page information includes the second display information that indicates a voice is outputting in a case that a voice output is performed at the terminal that transmits the request of the first page information;</li><li id="ul0002-0011" num="0024">wherein the first page information includes the third display information that indicates a temporary voice output inhibit in a case that the another terminal is in the voice data transmission; and</li><li id="ul0002-0012" num="0025">wherein the page generating unit generates a second page information so as to change one display information to another display information in accordance with the change in a communication state of the network and a selection regarding at least one of the first to third display information and the communication unit transfers the second generated page information to the terminal.</li></ul></li></ul>

In the above configuration, since the first display information (first button display) indicating a voice outputting possibility, the second display information (second button display) indicating a voice outputting, and a third display information (third button display) indicating a temporary voice output inhibit are displayed in the first page information, a current state of the voice communication is easily grasped at the terminal. Further, when some button display is depressed, the depressed button display is altered to other button display in accordance with the change of the state of the voice communication. Therefore, the voice communication can be easily and comfortably performed by operating while seeing the button display.

BRIEF DESCRIPTION OF THE DRAWINGS

The above objects and advantages of the present invention will become more apparent by describing in detail preferred exemplary embodiments thereof with reference to the accompanying drawings, wherein:

<figref idrefs="DRAWINGS">FIG. 1A</figref> is a configuration diagram of a network camera in the first embodiment of the invention, and <figref idrefs="DRAWINGS">FIG. 1B</figref> is an internal block configuration diagram of the inside of a control unit of the network camera in the first embodiment of the invention;

<figref idrefs="DRAWINGS">FIG. 2A</figref> is a block configuration diagram of a computer system in the first embodiment of the invention, and <figref idrefs="DRAWINGS">FIG. 2B</figref> is a block configuration diagram of the computer system of <figref idrefs="DRAWINGS">FIG. 2A</figref> having downloaded another program;

<figref idrefs="DRAWINGS">FIG. 3</figref> is an explanatory view of a top page of the computer system in the first embodiment of the invention;

<figref idrefs="DRAWINGS">FIG. 4</figref> is an explanatory diagram of a voice transmission display and a voice reception display in the first embodiment of the invention.

<figref idrefs="DRAWINGS">FIG. 5A</figref> is an explanatory diagram of an initial communication state of the case of a single user of a network system in the first embodiment of the invention, and <figref idrefs="DRAWINGS">FIG. 5B</figref> is an explanatory diagram at the time when the voice display in the initial communication state of <figref idrefs="DRAWINGS">FIG. 5A</figref> is pushed;

<figref idrefs="DRAWINGS">FIG. 6A</figref> is an explanatory diagram of an initial communication state of the case of a plurality of users of a network system in the first embodiment of the invention, and <figref idrefs="DRAWINGS">FIG. 6B</figref> is an explanatory diagram at the time when the voice display of a first computer system in the initial communication state of <figref idrefs="DRAWINGS">FIG. 5A</figref> is pushed;

<figref idrefs="DRAWINGS">FIG. 7</figref> is a flow chart of the voice transmission display in the network system in the first embodiment of the invention;

<figref idrefs="DRAWINGS">FIG. 8</figref> is an explanatory diagram of the network system for the voice communications of the related art;

<figref idrefs="DRAWINGS">FIG. 9</figref> shows a hardware configuration diagram of a camera of Embodiment 2 of the invention; and

<figref idrefs="DRAWINGS">FIG. 10</figref> shows an appearance of the camera of Embodiment 2 of the invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

First Embodiment

A network camera, a program and a network system according to the first embodiment of the invention will be described in the following. <figref idrefs="DRAWINGS">FIG. 1A</figref> is a configuration diagram of the network camera in the first embodiment of the invention; <figref idrefs="DRAWINGS">FIG. 1B</figref> is an internal block configuration diagram of the inside of a control unit of the network camera in the first embodiment of the invention; <figref idrefs="DRAWINGS">FIG. 2A</figref> is a block configuration diagram of a computer system in the first embodiment of the invention; <figref idrefs="DRAWINGS">FIG. 2B</figref> is a block configuration diagram of another program downloaded to the computer system of <figref idrefs="DRAWINGS">FIG. 2A</figref>; <figref idrefs="DRAWINGS">FIG. 3</figref> is an explanatory view of a top page of the computer system in the first embodiment of the invention; and <figref idrefs="DRAWINGS">FIG. 4</figref> is an explanatory diagram of a voice transmission display and a voice reception display in the first embodiment of the invention.

In <figref idrefs="DRAWINGS">FIGS. 1A and 1B</figref>: numeral <b>1</b> designates a voice mapping type network camera (or a network camera of the invention) having such a voice communication device mounted thereon and capable of taking and sending image and having voice communications; numeral <b>2</b> a computer system (or a terminal of the invention) such as a personal computer capable of having the voice communications; and numeral <b>3</b> a network such as the internet or Ethernet (of a registered trade mark). Numeral <b>10</b> designates a camera of the voice mapping type network camera <b>1</b>; numeral <b>11</b> a CORDIC unit for compressing and decompressing the data to be transmitted and received; numeral <b>12</b> an image processor for compressing the image signals taken by the camera <b>10</b>; and numeral <b>13</b> a communication control unit for processing the image data compressed by the image processor <b>12</b> in the protocol and for transmitting the processed data. Here, this protocol processing indicates the processing such as the TCP/IP protocol or the IEEE 802.03 protocol of the Ethernet (of the registered trade mark).

Numeral <b>14</b> designates a voice reception processor for decoding the voice reception data (or the PCM data) received by the voice mapping type network camera <b>1</b>; numeral <b>14</b><i>a </i>a DA converter for converting the output or a digital signal (or a PAM signal) of the voice reception processor <b>14</b> into an analog signal; numeral <b>15</b> a voice transmission processor for encoding the voice inputted to the voice mapping type network camera <b>1</b>; numeral <b>15</b><i>a </i>an AD converter for converting the output or an analog signal from a voice input adjusting circuit <b>17</b><i>a </i>(as will be described hereinafter); numeral <b>16</b> a camera control unit for controlling the pan, tilt and zoom of the camera <b>10</b>; numeral <b>17</b> a microphone for inputting the voice of the surrounding of the voice mapping type network camera <b>1</b>; numeral <b>17</b><i>a </i>the voice input adjusting circuit; numeral <b>18</b> a speaker for outputting a voice; and numeral <b>18</b><i>a </i>a voice output adjusting circuit.

Numeral <b>19</b> designates a control unit of the voice mapping type network camera <b>1</b>; numeral <b>20</b> a storage unit; numeral <b>20</b><i>a </i>a set value storage stored with a set value; numeral <b>20</b><i>b </i>a symbol data storage stored with symbol data for displaying icons or the like on the screen of the computer system <b>2</b>; and numeral <b>20</b><i>c </i>a transmission file stored with a program (as will be called the “terminal side communication processing unit”) to be transmitted to the computer system <b>2</b> and executed by the CPU of the computer system <b>2</b>, such as the active x or the JAVA (of a registered trade name) applets. The control unit <b>19</b> is provided with a central processing unit (CPU) and the storage unit <b>20</b> stored with the control program and data of the former, and the individual control functions are executed as a function realizing unit in the software by the program loaded from the storage unit <b>20</b>. The reference numerals thus far described are basically identical to those, which have been explained in connection with the voice mapping type network camera <b>1</b> and the computer system <b>2</b>.

With reference to <figref idrefs="DRAWINGS">FIG. 1B</figref>, here will be described a configuration and the program, which is read in the CPU and executed. The configuration communicates with the terminal side communication processing unit of the computer system <b>2</b>, and displays the following items on the screen of the computer system <b>2</b> for the voice communications: (1) the display of voice transmitting (i.e., the display of a second button of the invention); (2) the display of voice transmittable (i.e., the display of a first button of the invention): (3) the display of temporary voice transmission inhibit (i.e., the display of a third button of the invention); (4) the display of voice transmission inhibit; (1*) the display of voice receiving (i.e., the display of a fifth button of the invention); (2*) the display of temporary voice reception inhibit (i.e., the display of a fourth button of the invention); and (3*) the display of voice reception inhibit. In the following, the case, in which the voice data is transmitted to the voice mapping type network camera <b>1</b> and outputted from the speaker, will be called the “voice transmission” (i.e., the voice output of the invention), and the case, in which the voice data inputted from the microphone of the voice mapping type network camera <b>1</b> is received so that the voice is outputted, will be called the “voice reception”. Those displays (1) to (4) will be detailed hereinafter.

In <figref idrefs="DRAWINGS">FIG. 1B</figref>, numeral <b>19</b><i>a </i>designates a communication execution unit (or the communication unit of the invention) for performing the voice communication and the image transmission when the voice transmission mode is selected from the computer system <b>2</b>, and numeral <b>19</b><i>b </i>designates a display page creation unit for creating the page information to be transmitted from the voice mapping type network camera <b>1</b> to the computer system <b>2</b>. The aforementioned voice communication mode is composed of four kinds: a voice transmission/reception (half duplex) mode; a first one-way (i.e., the network camera→the computer system) mode; a second one-way (i.e., the computer system→the network camera) mode; and a voice inhibit mode. Numeral <b>19</b><i>c </i>designates a flag for indicating the communication sates of the plural computer systems <b>2</b> making access to the voice mapping type network camera <b>1</b>, such as what is communicating or what is inhibited from the voice communication, and numeral <b>19</b><i>d </i>designates a timer unit for measuring the time of the case, in which the communication state mode is changed after lapse of the time. This timer unit <b>19</b><i>d </i>counts a predetermined time by utilizing the fundamental dock of the computer system <b>2</b>. Numeral <b>19</b><i>e </i>designates a file transfer unit for downloading the later-described terminal side communication processing unit <b>26</b>, such as the program of the active x or the JAVA (of the registered trade mark) stored in the transmission file <b>20</b><i>c. </i>

When the communication execution unit <b>19</b><i>a </i>is demanded for a voice by the terminal side communication processing unit <b>26</b>, the display page creation unit <b>19</b><i>b </i>creates the page information with reference to the flag <b>19</b><i>c</i>. Here, the communication execution unit <b>19</b><i>a</i>, the display page creation unit <b>19</b><i>b </i>and the file transfer unit <b>19</b><i>e </i>configure altogether the function realizing unit of the aforementioned control unit <b>19</b>. The communication execution unit <b>19</b><i>a </i>confines the individual image and voice data and the page information created by the display page creation unit <b>19</b><i>b</i>, in the IP packet, and communicates in the HTTP through the communication control unit <b>13</b>.

The configuration of the computer system <b>2</b> will be described with reference to <figref idrefs="DRAWINGS">FIG. 2A</figref>. In <figref idrefs="DRAWINGS">FIG. 2A</figref>: numeral <b>21</b> designates a communication control unit acting as an interface with the network <b>3</b>; numeral <b>22</b> a control operation unit equipped with a CPU as a hardware and realized as a function realizing unit by reading the program from a storage unit-<b>23</b> for storing a program and data; numeral <b>24</b> designates a browser unit for acquiring and perusing the image displaying information (e.g., the web page) from the site on the network <b>3</b>, numeral <b>25</b> designates a voice processing unit realized as a function realizing unit with the program for the voice communication, such as the JAVA (of the registered trade mark) applet program or the plug-in; numeral <b>26</b> designates the terminal side communication processing unit which is realized by the program downloaded by the file transfer unit <b>19</b><i>e </i>of the voice mapping type network camera <b>1</b>, such as the active x or the JAVA (of the registered trade mark); numeral <b>27</b> a microphone; numeral <b>27</b><i>a </i>a voice input circuit; the numeral <b>28</b> a speaker; numeral <b>28</b><i>a </i>a voice output circuit; and numeral <b>29</b> a display unit. The browser unit <b>24</b> is the function realizing unit to be realized by the general-purpose browser program. The terminal side communication processing unit <b>26</b> expands the functions of the browser unit <b>24</b> and the voice processing unit <b>25</b> there to perform the half duplex communications so that the voice processing unit <b>25</b> may perform the transmission/reception alternately on the voice communication. A dedicated program can also be mounted as the terminal side communication processing unit <b>26</b>.

Subsequently, here is described the actions of the voice mapping type network camera <b>1</b> and the computer system <b>2</b> of the first embodiment at the voice communication time. The browser unit <b>24</b> of the computer system <b>2</b> makes access to the communication execution unit <b>19</b><i>a </i>of the voice mapping type network camera <b>1</b> and demands the voice mapping type network camera <b>1</b> for the top page. The (not-shown) top page is provided with select buttons for selecting whether or not the communication is to be performed and whether or not the set value of the system is to be inputted. When the communication select button is pushed, the portal screen displaying information such as the HTML is transmitted from the voice mapping type network camera <b>1</b>. In case the setting select button is pushed, on the other hand, the set input page is transmitted from the voice mapping type network camera <b>1</b>. The setting is completed when the input is made on the setting input page.

At first, here is described the portal screen displaying information. In <figref idrefs="DRAWINGS">FIG. 3</figref>, numeral <b>51</b> designates an image area of time-varying images or still images, and numeral <b>52</b> designates c control bar for controlling the camera <b>10</b> of the voice mapping type network camera <b>1</b>. Numeral <b>53</b> designates a voice transmission display button for displaying the current communication state of the voice transmission to the voice mapping type network camera <b>1</b> and for changing the communication state when pushed, and numeral <b>54</b> designates a voice reception display button for indicating the current output state of the voice inputted to the voice mapping type network camera <b>1</b>. Numeral <b>55</b> designates a volume adjusting bar for adjusting the volume to be outputted from the speaker <b>18</b> of the voice mapping type network camera <b>1</b>. The client of the voice mapping type network camera <b>1</b> receives the portal screen displaying information on the monitor and controls the direction control button and the zoom adjusting bar of the control bar <b>52</b> while observing the image on the portal screen thereby to switch the angle or the like of the camera <b>10</b> and to acquire a new image. In the voice communication mode, the client controls the voice transmission display button <b>53</b>, the voice reception display button <b>54</b> and the volume adjusting bar <b>55</b>.

Here in the first embodiment, the voice transmission display buttons <b>53</b> are exemplified by four kinds (although three kinds in the first embodiment) of buttons indicating the communication states: (1) the display of voice transmitting; (2) the display of voice transmittable: (3) the display of temporary voice transmission inhibit; and (4) the display of voice transmission inhibit (although not displayed in the first embodiment), and by three kinds (although two kinds in the first embodiment) of buttons indicating the communication states: (1*) the display of voice receiving; (2*) the display of temporary voice reception inhibit; and (3*) the display of voice reception inhibit (although not displayed in the first embodiment). These displays individually indicate, when active, the present states of the voice transmission and the voice reception, and the modes can be changed by depressing the voice transmission display button <b>53</b> and the voice reception display button <b>54</b>.

The display of voice transmitting is activated when the display of voice transmittable is pushed, and the voice transmission is ended to restore the display of voice transmittable when the display of voice transmitting is pushed. In the absence of any user in the voice transmission when the display of temporary voice transmission inhibit is pushed, the display is changed into that of voice transmission. Likewise, the display of voice receiving is activated when the display of temporary voice reception inhibit is pushed, and the display of temporary voice reception inhibit is restored when the display of voice receiving is pushed. Thus in the invention, the display is changed into another button display according to the change in the communication state, when each button display is depressed. Moreover, the display of temporary voice transmission inhibit can be automatically returned to the mode of initial communication state by a timer after a predetermined time elapsed. These actions will be detailed hereinafter.

The communication state displayed in the portal screen displaying information of <figref idrefs="DRAWINGS">FIG. 3</figref> reflects the setting by the user. The voice transmission display button <b>53</b> indicates the display of voice transmittable, and the voice reception display button <b>54</b> indicates the display of voice receiving (as will be called the “voice transmittable/voice receiving”) in the voice transmission/reception (half duplex) mode. The voice transmission display button <b>53</b> could also be set to the voice transmitting, and the voice reception display button <b>54</b> could also be set to the temporary voice reception inhibit (as will be called the “voice transmitting/temporary voice reception inhibit”). However, those buttons <b>53</b> and <b>54</b> are usually set to the (voice transmittable/voice receiving), because other clients are affected. In addition, in case the voice reception inhibit and the voice reception inhibit (as will be called the “voice reception inhibit/voice reception inhibit”) are selected by using a setting input page, for example, the voice inhibit mode comes in so that the voice transmission display button <b>53</b> and the voice reception display button <b>54</b> are not displayed. At this time, the voice inhibit prevails so that the display of the volume adjusting bar <b>55</b> is stopped. When the voice transmission display button <b>53</b> and the voice reception display button <b>54</b> are set to the (voice transmission inhibit/voice receiving) and the (voice transmittable/voice reception inhibit), respectively, they come into the first one-way mode and the second one-way mode, respectively. By pushing the voice transmission display button <b>53</b> and the voice reception display button <b>54</b>, moreover, the communication state can be changed to make the mode change. In the first embodiment, however, the initial setting mode is restored when a predetermined time elapses after the mode changed from the initial setting.

Here, the processing differs in the voice mapping type network camera <b>1</b> between the cases, in which the voice mapping type network camera <b>1</b> and the computer system <b>2</b> performs the (half duplex) voice transmission/reception in one-to-one (i.e., a single user) and in one-to-plurality (i.e., plural users). Especially when a plurality of computer systems <b>2</b> are connected, this voice transmission is the half duplex one so that the portal screen display information differs between the computer system <b>2</b> having acquired the voice path and the remaining computer systems <b>2</b> having failed.

First of all, here will be described the case, in which the voice mapping type network camera <b>1</b> and the computer system <b>2</b> performs the (half duplex) voice transmission/reception in one-to-one (with the single user). In the initial communication state, as shown in <figref idrefs="DRAWINGS">FIG. 5A</figref>, the portal screen displaying information described with the HTML or the like of <figref idrefs="DRAWINGS">FIG. 3</figref>, and the communication state is in the (voice transmittable/voice receiving) so that the screen has the display of voice transmittable and the display of voice receiving. In case the voice is to be sent in the state of <figref idrefs="DRAWINGS">FIG. 5A</figref> from the computer system <b>2</b> to the voice mapping type network camera <b>1</b>, the voice transmission display button <b>53</b> of the display of voice transmittable is depressed. At this time, the terminal side communication processing unit <b>26</b> informs the voice mapping type network camera <b>1</b> of it, the communication execution unit <b>19</b><i>a </i>of the voice mapping type network camera <b>1</b> changes the flag <b>19</b><i>c </i>from the initial communication state (i.e., the voice transmittable/voice receiving) to the state of (the voice transmitting/temporary voice reception inhibit). The display page creation unit <b>19</b><i>b </i>creates the page information described in the HTML or the like so that the voice transmission display button <b>53</b> of the portal screen displaying information may change into the displace of voice transmitting. At the same time, because of the half duplex communication, the voice reception display button <b>54</b> changes from the display of voice receiving into the display of temporary voice reception inhibit. As a result, the communication execution unit <b>19</b><i>a </i>transmits the portal screen displaying information displaying the (voice transmitting/temporary voice reception inhibit), as shown in <figref idrefs="DRAWINGS">FIG. 5B</figref>, to the computer system <b>2</b>, and displays it on the monitor. Here, the packet of the voice transmission data is transmitted from the voice mapping type network camera <b>1</b>, but the voice data received by the computer system <b>2</b> is muted by the terminal side communication processing unit <b>26</b> so that it is not outputted from the speaker <b>28</b>.

After this, if the no-voice state continues after the communication through the microphone <b>27</b>, the timer unit <b>19</b><i>d </i>counts a predetermined time period. When this time period elapses, the communication execution unit <b>19</b><i>a </i>changes the flag <b>19</b><i>c </i>from the communication state of the (voice transmitting/temporary voice reception inhibit) into the communication state of the (voice transmittable/voice receiving), and informs the computer system <b>2</b> of this change. If the computer system <b>2</b> having received this demands a new portal screen displaying information, the communication execution unit <b>19</b><i>a </i>the portal screen displaying information of the display indicating the updated (voice transmittable/voice receiving) to the computer system <b>2</b>, and displays the information on the display. In case, therefore, the voice transmission is further continued, it is necessary to push the voice transmission display button <b>53</b> again.

Here, the configuration thus far described for updating the portal screen displaying information can also be replaced by a configuration of the program containing the terminal side communication processing unit <b>26</b>, as shown in <figref idrefs="DRAWINGS">FIG. 2B</figref>, so that the portal screen displaying information can be updated. Numeral <b>26</b><i>a </i>designates a display page updating unit for updating a portal description of the page information described in the HTML or the like; numeral <b>26</b><i>b </i>a flag for indicating the communication state; and numeral <b>26</b><i>c </i>a timer unit for measuring the time period of the case, in which the mode is altered with the time lapse.

In the case of the configuration of this program, when the voice transmission display button <b>53</b> for the display of voice transmittable is depressed, the terminal side communication processing unit <b>26</b> informs the voice mapping type network camera <b>1</b> of the depression. Moreover the flag <b>26</b><i>b </i>indicating the communication state is altered to the (voice transmitting/temporary voice transmission inhibit); the voice transmission display button <b>53</b> of the portal screen displaying information is altered from the display of voice transmittable to the display of voice transmitting; and the voice reception display button <b>54</b> is altered from the display of voice receiving to the display of temporary voice reception inhibit. Here, the data of these individual icons is downloaded together with the program of the terminal side communication processing unit <b>26</b>. The portal screen displaying information thus processed is instantly displayed on the monitor of the computer system <b>2</b>.

In the update of the portal screen displaying information continuing in the no-voice state, the time lapse is measured by the timer unit <b>26</b><i>c </i>on the side of the computer system <b>2</b>. The terminal side communication processing unit <b>26</b> alters the flag <b>26</b><i>b </i>from the (voice transmitting/temporary voice reception inhibit) to the (voice transmittable/voice receiving), and the portal screen displaying information altered is displayed on the monitor. If the portal screen displaying information is updated with this configuration of <figref idrefs="DRAWINGS">FIG. 2B</figref>, the processing can be facilitated for the high-speed processing.

Subsequently, here is described the case, in which the voice mapping type network camera <b>1</b> and the computer system <b>2</b> perform the (half duplex) voice transmission/reception in one-to-plurality (with plural users). <figref idrefs="DRAWINGS">FIG. 6A</figref> is an explanatory diagram of the initial communication state of the case of the plural users of the network system in the first embodiment of the invention, and <figref idrefs="DRAWINGS">FIG. 6B</figref> is an explanatory diagram of the communication state at the time when the voice display of the first computer system in the initial communication state of <figref idrefs="DRAWINGS">FIG. 6A</figref> is pushed. If the user of a computer system <b>2</b>A shown in <figref idrefs="DRAWINGS">FIG. 6A</figref> makes access to the voice mapping type network camera and if the user of a computer system <b>2</b>B then makes access, the communication execution unit <b>19</b><i>a </i>refers at first to the flag <b>19</b><i>c</i>, and starts the (half duplex) voice transmission/reception with the computer system <b>2</b> having made access, only when the flag of voice transmitting is not raised. In short, only the voice communication between the computer system <b>2</b>A and the voice mapping type network camera <b>1</b> is effective for the earlier user. Therefore, the computer system <b>2</b>A starts the voice communication according to the setting. The setting of the computer system <b>2</b>A of <figref idrefs="DRAWINGS">FIG. 6A</figref> is in the communicating state of the (voice transmitting/temporary voice reception inhibit), and the voice is outputted from the voice mapping type network camera <b>1</b> so that the output of the voice collected by the microphone <b>17</b> of the voice mapping type network camera <b>1</b> is stopped from the computer system <b>2</b>A. If the computer system <b>2</b>A has the setting of the (voice transmittable/voice receiving), the state is established, as shown in <figref idrefs="DRAWINGS">FIG. 5A</figref>. In this state, the voice cannot be outputted from the speaker <b>18</b> of the voice mapping type network camera <b>1</b>, but the voice collected by the microphone <b>17</b> can be outputted from the computer system <b>2</b>A.

When the computer system <b>2</b>B makes second access while the computer system <b>2</b>A making access, the communication execution unit <b>19</b><i>a </i>of the voice mapping type network camera <b>1</b> refers to the flag <b>19</b><i>c </i>and detects that the flag of the computer system <b>2</b>A is in the voice transmission. The communication execution unit <b>19</b><i>a </i>alters the flag of the computer system <b>2</b>B from the communicating state of the set (voice transmittable/voice receiving) to the communicating state of the (temporary voice transmission inhibit/voice receiving), and transmits the portal screen displaying information having the display of the temporary voice transmission inhibit <b>1</b> voice receiving, and displays it in the computer system <b>2</b>B. When the user of the computer system <b>2</b>B pushes the display of temporary voice transmission inhibit, the terminal side communication processing unit <b>26</b> of the computer system <b>2</b>B inquires the communication execution unit <b>19</b><i>a </i>of the voice mapping type network camera <b>1</b> whether or not the communication can be made. In case the communication execution unit <b>19</b><i>a </i>refers to the flag <b>19</b><i>c </i>so that the flag of the computer system <b>2</b>A is in the voice transmission, the communication execution unit <b>19</b><i>a </i>continues the display of temporary voice transmission inhibit.

When this state of temporary voice transmission inhibit then continues for a predetermined time, in the first embodiment, the communication execution unit <b>19</b><i>a </i>alters the flag of the computer system <b>2</b>B to the (voice transmittable/voice receiving), and causes the display page creation unit <b>19</b><i>b </i>to create new portal screen displaying information and the monitor of the computer system <b>2</b>B to display the portal screen displaying information having the display of voice transmittable/voice receiving, as shown in <figref idrefs="DRAWINGS">FIG. 6B</figref>. When this display of voice transmittable of the portal screen displaying information is depressed, the voice can be transmitted from the voice mapping type network camera <b>1</b>. When the voice communication of the computer system <b>2</b>A ends to leave the display of temporary voice transmission inhibit as it is, the terminal side communication processing unit <b>26</b> of the computer system <b>2</b>B is caused by the push of the display of voice transmission inhibit by the user of the computer system <b>2</b>B to inquire the communication execution unit <b>19</b><i>a </i>of the voice mapping type network camera <b>1</b>. The terminal side communication processing unit <b>26</b> refers to the flag <b>19</b><i>c </i>and knows that the flag of the computer system <b>2</b>A disappears in the voice transmission, and alters the display to the portal screen displaying information of the display of voice transmittable/voice receiving, as shown in <figref idrefs="DRAWINGS">FIG. 6B</figref>.

Here, it is also possible to adopt the method, in which after the display of temporary voice transmission inhibit was pushed, the terminal side communication processing unit <b>26</b> of the computer system <b>2</b>B periodically demands the communication execution unit <b>19</b><i>a </i>of the voice mapping type network camera <b>1</b> for the notification of the network camera. At this time, the communication execution unit <b>19</b><i>a </i>refers to the flag <b>19</b><i>c </i>and can cause the display page creation unit <b>19</b><i>b </i>to create new portal screen displaying information at the instant when the flag of the computer system <b>2</b>A is not transmitting the voice. The communication execution unit <b>19</b><i>a </i>can also transmit the portal screen displaying information to the computer system <b>2</b>B and can display it on the monitor. In this case, when the voice communication ends, the display automatically changes into the display of voice transmittable <b>1</b> voice receiving so that the communication execution unit <b>19</b><i>a </i>is remarkably usable for the user.

In the computer system <b>2</b>A of the first embodiment, the terminal side communication processing unit <b>26</b> mutes the voice data, which is sent from the voice mapping type network camera <b>1</b>, in the computer system <b>2</b>A so that no influence is exerted on the voice transmission data transmitted from the voice mapping type network camera <b>1</b>. By bringing the computer system <b>2</b>B into the communication state of (voice transmittable/voice receiving), the voice collected by the microphone <b>17</b> can be outputted from the computer system <b>2</b>A. It should be noted at this time in connection with privacy that the voice being outputted by the user of the computer system <b>2</b>A from the speaker <b>18</b> of the voice mapping type network camera <b>1</b> can be heard with the microphone <b>17</b> by the user of the computer system <b>2</b>B making access to the same voice mapping type network camera <b>1</b>. Here, the echo to be produced when the voice loop is formed is not applied to the output from the speaker <b>28</b> of the computer system <b>2</b>B.

The description thus far made is directed to the case of the (half duplex) voice transmission/reception. However, the one-way communication mode is established in case the voice transmission inhibit or the voice reception inhibit is set. This one-way communication is divided into a first one-way communication mode for transmitting the voice from the voice mapping type network camera <b>1</b> to the computer system <b>2</b>, and a second one-way communication mode, in which the voice is transmitted from the computer system <b>2</b> to the voice mapping type network camera <b>1</b>.

In the first one-way communication mode, the display of voice transmission inhibit is not made, but either the display of voice receiving indicating the output from the speaker <b>28</b> or the display of temporary voice reception inhibit is made. In case the display of temporary voice reception inhibit is made, the display is altered to the display of voice receiving when the voice reception display button <b>54</b> is depressed.

In the second one-way communication mode, on the other hand, the display of voice reception inhibit is not made. When the display of voice transmittable is pushed, the display is altered to the display of voice inputting, in which the voice can be inputted as it is from the microphone <b>27</b>, in case the single user is making access. When the user pushes the display of voice receiving at the end of the communication, the display is altered into the display of voice transmittable. When the communication ends, the display is automatically altered without any action into the display of voice transmittable when a predetermined time elapses.

In case a plurality of users are making access, the first access user can perform the voice communication if he or she pushes the voice transmission display button <b>53</b> in the display of voice transmittable. Another user of later access cannot perform the voice communication because of the display of temporary voice transmission inhibit, even if he or she pushes the voice transmission display button <b>53</b>. When the display is altered to the display of voice transmittable when a time elapses after the end of the first communication, the communication is reopened by pushing that voice transmission display button <b>53</b>.

In the case of the voice inhibit mode, the voice transmission display mode <b>53</b> and the voice reception display button <b>54</b> are not displayed, but the display of the volume adjusting bar <b>55</b> is stopped. Merely by the setting of the user, therefore, the information is altered to the portal screen displaying information only for the transmission/reception of the image from the voice mapping type network camera <b>1</b>.

Subsequently, here is described the flow for the voice transmission display in the network system of the first embodiment of the invention. The voice transmittable mode is set as a reference communication state mode. <figref idrefs="DRAWINGS">FIG. 7</figref> is a flow chart of the voice transmission display in the network system in the first embodiment of the invention. In <figref idrefs="DRAWINGS">FIG. 7</figref>, it is checked (at step <b>1</b>) whether or not the voice communication is permitted by the setting and whether or not the voice transmission is inhibited. In case the setting is the voice transmission inhibit, the display of voice transmission is not made (at step <b>2</b>). In case the voice communication is permitted at step <b>1</b>, it is decided (at step <b>3</b>) with reference to the flag whether or not the communication is being made with other clients (or the computer system). In the communication with other clients, the display of temporary voice transmission inhibit is made (at step <b>4</b>), and the routine returns to step <b>3</b> and stands by till the voice communication with other clients ends. Not in the communication with other clients, the display of voice transmittable is made (at step <b>5</b>).

Next, it is decided (at step <b>6</b>) whether or not the display of voice transmittable is depressed. In the case of no depression, the routine is returned to step <b>3</b> and stands by till the depression. In case the display of voice transmittable is depressed at step <b>6</b>, the display is altered to the display of voice transmitting (at step <b>7</b>). At the same time, the timer is reset (at step <b>8</b>). When the time elapsed (at step <b>8</b>), the routine returns to step <b>3</b>, and the routine is repeated.

In case the voice communication is permitted by the actions thus far described, the display of voice transmittable is made unless the communication is made with other clients. When the voice communication is to be made, the display of voice transmittable is pushed for the communication with the display of voice transmitting. When a time elapses after the end of communication, the routine is automatically restored. The icon display of the portal screen displaying information is made understandable so that the controls can be made easy and excellent.

As has been described hereinbefore, the voice mapping type network camera, the program and the network system of the first embodiment are enabled to perform the voice communication comfortably and simply by the controls made by observing the icon for the portal screen displaying information.

In the above configurations, the page generating unit generates the page information in which no display information (no button display) is displayed in a case of the voice outputting inhibit. Therefore, a content of a display is not complex since the display indicating the voice outputting inhibit is not displayed.

Preferably, the page generating unit of the network camera generates a page information having the second display information (second button display) indicating that the voice is outputting, instead of the first display information (first button display), when the communication unit receives a request indicating that the first display information (first button display) is selected in the page information from the terminal. Therefore, when the first button display (first button display) is depressed, the display is altered to the second button display indicating a voice outputting in accordance with the change of communication state. As a result, the operation of the network system and the state of the network are easily grasped.

Preferably, the page information having the first display information (first button display), further includes a fourth display information (fourth button display) indicating a temporary voice output inhibit. The page generating unit generates the page information having the second display information (second button display) and a fifth display information (fifth button display) indicating that a voice is received, instead of the first display information (first button display) and the fourth display information (fourth button display) (fourth button display), when the communication unit receives a request indicating that the fourth display information (fourth button display) is selected in the page information from the terminal. Therefore, since the fourth display information (fourth button display) (fourth button display) and the fifth display information (fifth button display) (fifth button display) are displayed on the page information, the button operation can be performed with a focus on listening the sound. Further, since the button display regarding a sound outputting can be simultaneously changed, the operation becomes more easily.

Preferably, the page generating unit generates the page information having the first display information (first button display), instead of the second display information (second button display), when the communication unit receives a request indicating that the second display information (second button display) is selected in the page information from the terminal. Therefore, when the second button display indicating the sound outputting is depressed, the display is cyclically returned to the first button display (first button display) indicating the voice outputting possibility in accordance with the change of communication state. As a result, the operation of the network system and the state of the network are easily grasped.

Preferably, the page generating unit generates the page information having the first display information (first button display), instead of the third display information (third button display), when the communication unit receives a request indicating that the third display information (third button display) in the page information is selected from the terminal. Therefore, when the third button display indicating the temporary voice output inhibit is depressed, the display is altered to the first button display indicating the voice outputting possibility in accordance with the change of communication state. As a result, the operation of the network system and the state of the network are easily grasped.

Preferably, the page generating unit generates the page information instead of the second display information (second button display), when a predetermined time counted by timer unit elapses in a case that the second display information (second button display) is displayed on the terminal after a termination of the voice communication. Therefore, when the time counted by the timer unit is reached to a predetermined time, the button display is altered to the first button display indicating the voice outputting possibility automatically. As a result, the operation becomes more easily.

Preferably, the control unit transmits the page information having the third display information (third button display), instead of the first display information (first button display), to the terminal in communication, when the communication unit receives a request for a network capturing apparatus state notification periodically after a termination of the voice output of another terminal in communication. Therefore, the button display is automatically altered from the first button display indicating the voice outputting possibility to the third button display indicating the temporary voice output inhibit.

Second Embodiment

<figref idrefs="DRAWINGS">FIG. 9</figref> shows a hardware configuration diagram of the camera of the invention.

<figref idrefs="DRAWINGS">FIG. 10</figref> shows an appearance of the camera of the invention.

Numeral <b>301</b> designates a camera chip containing the CPU and its peripheral circuits. Numeral <b>302</b> designates a flash ROM stored with the program and data for the actions of the camera chip <b>301</b>. Numeral <b>303</b> designates a working S-DRAM for the cameral chip <b>301</b> to act. Numeral <b>304</b> designates a CCD and a CMOS chip for converting a taken image into electric signals. Numeral <b>305</b> designates an Audio PCM chip for inputting/outputting voice signals. Numeral <b>306</b> designates a LANPHY chip for an electric interface at the time of physical connections with a LAN interface. Numeral <b>307</b> designates a motor drive chip for moving the camera within a taking range, i.e., a Tilt motor <b>308</b> and a Pan motor <b>309</b>. There are a microphone for voice inputting and a speaker for voice outputting, although not shown.

The camera chip <b>301</b> is configured to include: a CPU <b>301</b>-<b>1</b>; a JPEG converter <b>301</b>-<b>2</b> for converting a taken image in electric signals, into an image of the JPEG format; a G.726 converter <b>301</b>-<b>3</b> for conversions into the voice data format for the network communication; an MMU (Memory Management Unit) <b>3014</b>; a GPIO (General Purpose Input/Output); and a LAN (Local Area Network) <b>301</b>-<b>6</b>.

This hardware configuration diagram of <figref idrefs="DRAWINGS">FIG. 9</figref> and the camera configuration diagram of <figref idrefs="DRAWINGS">FIG. 1</figref> are mapped, as follows. The camera <b>10</b> corresponds to the CCD <b>304</b>; the voice input adjusting circuit <b>17</b><i>a </i>and the voice output adjusting circuit <b>18</b><i>a </i>to the Audio PCM <b>305</b>; the portion of the communication control unit <b>13</b> to be connected with the LAN to the LANPHY <b>306</b>; the portion for the communication control unit <b>13</b> for the control actions to the LAN unit <b>301</b>-<b>6</b>; the pan motor <b>10</b><i>b </i>to the Pan Motor <b>309</b>; the tilt motor <b>308</b> to the Tilt Motor <b>308</b>; the image processor <b>12</b> to the JPEG converter <b>301</b>-<b>2</b>; the voice reception processor <b>14</b> and the voice transmission processor <b>15</b> to the G.726 converter <b>301</b>-<b>3</b>; the camera control unit <b>10</b><i>a </i>and the control unit <b>19</b> for their controls to the CPU <b>301</b>-<b>1</b>; and the storage unit <b>20</b> to the S-DRAM <b>303</b>.

Moreover, it is possible to realize: the flash ROM <b>302</b> with MX29LV320; the S-DRAM <b>303</b> with MT48CM16; the Audio PCM chip <b>305</b> with AK2308; the LANPHY chip <b>306</b> with ICS1893; the CCD chip <b>304</b> with the combination of ICX098, MN5400 and HV7131; and the motor drive chip <b>307</b> with LB1937.

With these configurations, there can be realized the network camera, which is enabled to make the display of voice transmittable not in the communication with other clients, in case the voice communication is permitted, to communicate, when the voice communication is intended, by pushing the display of voice transmittable to the display of voice receiving, and to restore the initial state automatically when a time elapses after the end of the communication, and which is made understandable in the icon display for the portal screen displaying information, easy in the controls and excellent in the controllability.

The invention can be applied to the network system for image transmissions and voice communications by using the voice mapping type network camera.

Although the invention has been illustrated and described for the particular preferred embodiments, it is apparent to a person skilled in the art that various changes and modifications can be made on the basis of the teachings of the invention. It is apparent that such changes and modifications are within the spirit, scope, and intention of the invention as defined by the appended claims.

The present application is based on Japan Patent Application No. 2004-191147 filed on Jun. 29, 2004, the contents of which are incorporated herein for reference.