Communication system and sound source reproduction method in communication system

The present invention relates to a monitoring system that inputs and outputs data between a mobile phone terminal and a camera.

Conventionally, as an example of a surveillance system that inputs / outputs data between a mobile phone terminal and a camera, a surveillance camera system that easily remotely monitors from a remote location and monitors the monitoring target by bidirectional communication of video and audio has been used. It is known (see, for example, Patent Document 1).

The monitoring system shown in Patent Document 1 includes a controller, which is a monitoring server installed in a home distribution board in a predetermined residential premises (inside the premises), a first camera unit, which is an intercom slave unit installed at the entrance gate, and a first camera unit. A second camera unit installed in the dining room, a third camera unit installed in the bedroom, an indoor unit that is an intercom master unit installed in the living room, and a mobile phone in one or more remote locations. It is a configuration including. For example, when the resident goes out, the controller switches the video signal and the audio signal captured and picked up so as to capture the intruder and transfers the intruder to the mobile phone each time each camera unit detects the intruder.

<p num="0004"><patcit num="1"><text>Japanese Patent Application Laid-Open No. 2007-323533</text></patcit></p>

<p num="0005"> However, in the configuration of Patent Document 1 described above, the video signal and the audio signal from each camera unit are appropriately switched and transferred to the mobile phone so as to capture the movement and sound of the intruder, so that the configuration of the controller becomes complicated. It was unavoidable to increase the cost, and it was difficult to introduce a monitoring system including a controller at low cost.</p><p num="0006"> In order to solve the conventional problem, the present invention uses an existing fixed telephone that is connected to a fixed telephone network and can talk to another fixed telephone, and inputs and outputs data between a mobile phone terminal and a camera by a user. The purpose is to provide a monitoring system that can be realized at low cost without impairing the convenience of the telephone.</p>

<p num="0007"> The present invention includes a surveillance camera having a microphone, a speaker, and an imaging unit and having a call function, and a master unit capable of communicating with the surveillance camera and being connected to a fixed telephone network to talk with another fixed telephone. The master unit includes a mobile phone terminal having a display input unit, capable of wireless communication with the master unit using a wireless router, and connecting to another mobile phone via a mobile phone network. In response to the first operation on the display input unit, the predetermined sound source list data is transferred to the mobile phone terminal, and the mobile phone terminal transfers the predetermined sound source list data transferred from the master unit to the display input unit. In response to the operation of selecting one of the sound sources from the sound source list data, the information on the selected sound source is transmitted to the master unit, and the master unit transmits the information on the sound source from the mobile phone terminal. When received, it is a monitoring system that outputs selected audio data corresponding to information about the selected sound source from the speaker of the monitoring camera.</p>

<p num="0008"> According to the present invention, data input / output between a mobile phone terminal and a camera can be performed without impairing user convenience by using an existing fixed telephone that is connected to a fixed telephone network and can talk to another fixed telephone. It can be realized at low cost.</p>

<figref num="1">The figure which shows an example of the system configuration of the surveillance camera system of this embodiment</figref><figref num="2">Block diagram showing an example of the internal configuration of the master unit</figref><figref num="3">Block diagram showing an example of the internal configuration of a cordless cordless handset</figref><figref num="4">Block diagram showing an example of the internal configuration of a camera</figref><figref num="5">Block diagram showing an example of the internal configuration of the sensor</figref><figref num="6">Block diagram showing an example of the internal configuration of a smartphone</figref><figref num="7">(A) A diagram showing an example of the Lullaby sound source selection screen in which the Lullaby sound source list including the selection target Lullaby sound source of the master unit is displayed on the smartphone, (B) The Lullaby sound source list including the selection target Lullaby sound source of the baby monitor camera. A diagram showing an example of a lullaby sound source selection screen displayed on a smartphone, and (C) a diagram showing an example of a lullaby sound source selection screen in which a lullaby sound source list including a selection target lullaby sound source possessed by the smartphone is displayed on the smartphone.</figref><figref num="8">A diagram showing an example of a live monitor screen displayed on a smartphone during recording by a baby monitor camera.</figref><figref num="9">In the surveillance camera system of the present embodiment, a sequence diagram illustrating an example of an operation procedure in which the master unit transfers and displays the image being recorded by the baby monitor camera to the smartphone.</figref><figref num="10">A sequence diagram illustrating an example of an operation procedure in the surveillance camera system of the present embodiment when the master unit or the baby monitor camera has the selection target lullaby sound source.</figref><figref num="11">A sequence diagram illustrating an example of an operation procedure in the surveillance camera system of the present embodiment when the smartphone has a selection target lullaby sound source.</figref>

Hereinafter, an embodiment in which the monitoring system according to the present invention is specifically disclosed (hereinafter, referred to as the present embodiment) will be described with reference to the drawings. In the following embodiment, as an example of the surveillance system according to the present invention, a surveillance camera system used for home security will be described as an example. The present invention is not limited to the surveillance camera system, and can be expressed as a device or a method or program in each device constituting the surveillance camera system.

The surveillance camera system of the present embodiment has a microphone, a speaker, and an imaging unit, can communicate with the surveillance camera having a call function, and can talk with another fixed telephone by being connected to a fixed telephone network. It includes a master unit and a mobile phone terminal having a display input unit, capable of wireless communication with the master unit using a wireless router, and connected to another mobile phone via a mobile phone network. The master unit transfers a predetermined sound source list data to the mobile phone terminal in response to a predetermined first operation on the display input unit, and the mobile phone terminal displays the predetermined sound source list data transferred from the master unit to the display input unit. Is displayed in, and information about the selected sound source is transmitted to the master unit in response to the operation of selecting one of the sound sources from the sound source list data. The selected audio data corresponding to the information about the sound source is output from the speaker of the surveillance camera.

FIG. 1 is a diagram showing an example of the system configuration of the surveillance camera system 5 of the present embodiment. The surveillance camera system 5 is mainly installed in the house 8, and includes a master unit 10, two cordless slave units (hereinafter, also simply referred to as "slave units") 20A and 20B, and multiple cameras (indoor cameras). 30A, surveillance camera 30B, baby monitor camera 30C, ...), various sensors (specifically, human sensor 40A, 40B, smoke sensor 40C, open / close sensor 40D, ...), smartphone 50, The configuration includes the wireless router 60. The configuration of the surveillance camera system 5 is an example, and can be changed to various modes.

The master unit 10 having a function as gateware in the surveillance camera system 5 is a control device that controls the overall operation of the surveillance camera system 5, and is a slave unit using, for example, a DECT (Digital Enhanced Cordless Telecommunications) communication method. , Camera, sensor, etc. can be connected. Further, the master unit 10 is connected to the Internet 65 via a wireless router 60 using a wireless LAN. Further, the master unit 10 is connected to the fixed telephone network 85 by wire and can talk to the fixed telephone 80. Further, the master unit 10 has a function of charging the slave unit 20A inserted into the insertion port 10a.

The slave units 20A and 20B are connected to the master unit 10 using the DECT communication method and can talk to the master unit 10. Hereinafter, when it is not necessary to distinguish between the two slave units 20A and 20B, they are collectively referred to as the slave unit 20.

Various sensors 40 (specifically, motion sensors 40A, 40B, smoke sensor 40C, open / close sensor 40D, ...) are connected to the master unit 10 using the DECT communication method. Here, as sensors, an open / close sensor 40D for detecting the opening / closing of a window, a smoke sensor 40C for detecting smoke, and a motion sensor 40A, 40B for detecting a person by infrared rays are used. Hereinafter, when it is not necessary to distinguish the types of these sensors, they are collectively referred to as the sensor 40. Further, as will be described later, an infrared sensor 313 (see FIG. 4) built in the camera 30 is also used as a motion sensor.

A plurality of cameras (for example, indoor camera 30A, surveillance camera 30B, baby monitor camera 30C, ...) have a call function and are connected to the master unit 10 using the DECT communication method. Here, as the cameras, a surveillance camera 30B that images the outdoors, an indoor camera 30A that images the inside of the house 8, and a baby monitor camera 30C that images the sleeping place of an infant (for example, a crib (not shown) or its surroundings) are used. .. Hereinafter, when it is not necessary to distinguish the types of cameras, they are collectively referred to as the camera 30.

The smartphone 50 is connected to the master unit 10 via a wireless router 60 using a wireless LAN, and also uses communication methods such as 3G (3rd generation), HSPA (High Speed Packet Access) or LTE (Long Term Evolution). It is connected to the mobile phone 70, other smartphones, etc. via the mobile phone network 75 used.

FIG. 2 is a block diagram showing an example of the internal configuration of the master unit 10. The master unit 10 has a configuration including a control unit 109, a storage unit 103, an operation unit 105, and a display unit 106. The master unit 10 accepts various input operations and displays an image and information such as a lullaby sound source selection screen described later on the display unit 106. The Lullaby sound source is audio data that can be output (reproduced) by the camera 30 (for example, the baby monitor camera 30C), and is audio data such as a lullaby that can be heard by an infant, for example. The control unit 109 incorporates a call control unit 110 and a voice stream processing unit 112, and performs call control of a call, processing of voice data, and the like. Further, the master unit 10 stores the audio data of one or more lullabies sound sources that can be output by the baby monitor camera 30C in the storage unit 103.

Further, the master unit 10 has an image memory control unit 115 and an image memory 116, and stores image data and the like captured by the camera 30 in the image memory 116.

Further, the master unit 10 has a wireless LAN control unit 121 and a wireless LAN communication I / F unit 122, and is connected to a smartphone 50, a camera 30, etc. via a wireless router 60 connected by a wireless LAN with image data and audio. Send and receive data.

Further, the master unit 10 has a DECT protocol control unit 108 and a DECT wireless I / F unit 107, and wirelessly connects to the slave unit 20, the sensor 40, and the camera 30 by using the DECT wireless method.

Further, the master unit 10 has a voice bus 117, a voice input / output control unit 104, a speaker 129, and a microphone 128, and inputs / outputs voice to the outside.

Further, the master unit 10 has a fixed telephone line I / F unit 101, and can talk to an external fixed telephone 80 (see FIG. 1) connected to the fixed telephone network 85.

Further, the master unit 10 has a slave unit / mobile terminal charging unit 126, and charges the slave unit 20 or the smartphone 50 inserted into the insertion port 10a.

Further, the master unit 10 has a USB communication I / F unit 127, and transmits / receives data to / from a device, a memory, or the like having a USB (Universal Serial Bus) standard interface.

Further, the master unit 10 associates the pairs of the various sensors 40 with the plurality of cameras 30 and registers them in the storage unit 103. For example, since the motion sensor 40B and the surveillance camera 30B are installed in close proximity to each other outdoors, they are registered in association with each other. Further, as will be described later, the surveillance camera 30B incorporates an infrared sensor 313 (see FIG. 4), which is a motion sensor, as a unit, and is therefore registered in association with the infrared sensor 313. Further, since the motion sensor 40A, the smoke sensor 40C, and the open / close sensor 40D are all installed in the house 8, they are registered in association with either the indoor camera 30A or the baby monitor camera 30C.

FIG. 3 is a block diagram showing an example of the internal configuration of the (cordless) slave unit 20. The slave unit 20 has a configuration including a control unit 247, a storage unit 242, an operation unit 244, and a display unit 245. The slave unit 20 receives various input operations and displays an image and information such as a Lullaby sound source selection screen described later on the display unit 245. Further, the slave unit 20 stores the audio data of one or more Lullaby sound sources that can be output by the baby monitor camera 30C in the storage unit 242.

Further, the slave unit 20 has a DECT protocol control unit 249 and a DECT wireless I / F unit 248, and wirelessly connects to the master unit 10, the sensor 40, and the camera 30 using the DECT wireless system.

Further, the slave unit 20 has a voice bus 255, a voice input / output control unit 243, a speaker 252, and a microphone 251 to input / output voice to the outside.

Further, the slave unit 20 has a secondary battery 250, and when used as a cordless slave unit, the slave unit 20 operates by supplying the electric power supplied from the secondary battery 250 to each part of the slave unit 20.

FIG. 4 is a block diagram showing an example of the internal configuration of the camera 30. The indoor camera 30A, the surveillance camera 30B, and the baby monitor camera 30C, which are examples of the camera 30, all have almost the same configuration. The camera 30 includes a control unit 309, a storage unit 303, and an operation unit 305. The camera 30 performs an operation related to imaging and accepts an input operation. Further, the baby monitor camera 30C stores the audio data of one or more Lullaby sound sources that can be output by the speaker 329 of the baby monitor camera 30C in the storage unit 303.

Further, the camera 30 has a DECT protocol control unit 317 and a DECT wireless I / F unit 318, and wirelessly connects to the master unit 10 using the DECT wireless system.

Further, the camera 30 has a wireless LAN control unit 321 and a wireless LAN communication I / F unit 322, and is connected to the master unit 10 or the smartphone 50 via the wireless router 60 connected by the wireless LAN. Send and receive image data and audio data.

Further, the camera 30 has a voice bus 307, a voice input / output control unit 304, a speaker 329, and a microphone 328, and inputs / outputs voice to the outside. For example, the camera 30 transmits the voice data collected by the microphone 328 to the master unit 10, and outputs the voice data including the selected voice data (see below) transferred from the master unit 10 from the speaker 329.

Further, the camera 30 has an image pickup unit 312, an image memory control unit 316, and an image memory 315, and stores the image data captured by the image pickup unit 312 in the image memory 315. The image pickup unit 312 has a well-known imaging mechanism, and at least has a lens and an image pickup device (an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor)).

In addition, the camera 30 integrally incorporates an infrared sensor 313, which is a PIR (Passive Infra Red) sensor, as a motion sensor. The infrared sensor 313 detects the presence of a person by detecting a change in heat (infrared ray) generated by the person. The camera 30 has a power supply unit 314 that uses commercial alternating current as a power source. However, the baby monitor camera 30C shown in FIG. 1 is not provided with the infrared sensor 313 shown in FIG.

FIG. 5 is a block diagram showing an example of the internal configuration of the sensor 40. The sensor 40 includes a control unit 447, a storage unit 442, and an indicator lamp 445. When the sensor 40 detects a target (for example, an intruder; the same applies hereinafter), the sensor 40 performs a predetermined detection operation such as turning on the indicator lamp 445.

Further, the sensor 40 has a DECT protocol control unit 449 and a DECT wireless I / F unit 448, and wirelessly connects to the master unit 10 using the DECT wireless method, and when a target is detected, sensor detection information is transmitted. Send to base unit 10.

The sensor unit 453 differs depending on the type of the sensor 40. For example, in the case of the motion sensors 40A and 40B, the sensor unit 453 is a PIR sensor that detects a person by a change in infrared rays. In the case of the open / close sensor 40D that detects the opening / closing of the entrance or window, the sensor unit 453 is a reed switch that switches on / off by opening / closing. In the case of the smoke sensor 40C, the sensor unit 453 is a light emitting / receiving unit that senses smoke by blocking the emitted light with smoke. The rechargeable battery 450 is a rechargeable battery and supplies electric power to each part. Further, the sensor unit 453 may be a temperature sensor capable of detecting the ambient temperature.

FIG. 6 is a block diagram showing an example of the internal configuration of the smartphone 50. The smartphone 50 as a mobile phone terminal has a configuration including a control unit 506, a storage unit 504, and a display / operation unit (for example, a touch panel) 503. The smartphone 50 accepts various input operations and displays information such as an image and information such as a lullaby sound source selection screen described later on the display / operation unit 503. As will be described later, the control unit 506 incorporates a monitoring function control unit 514 that can set the functions of the camera 30. The display / operation unit 503 composed of a touch panel is a display input unit in which the display unit and the operation unit are integrated, displays information such as images and icons on the screen, and is a user of the smartphone 50 (hereinafter, simply "" Accepts tap operations (or touch operations) on the screen by (called "user"). Further, the smartphone 50 stores the audio data of one or more lullabies sound sources that can be output by the baby monitor camera 30C in the storage unit 504.

In addition, the smartphone 50 has a 3G protocol control unit 502 and a 3G wireless I / F unit 501, and is a mobile phone 70 connected to the mobile phone network 75 using a 3G (3rd generation) wireless communication method. Make a wireless connection with or other smartphones. The smartphone 50 may have a protocol control unit and a wireless I / F unit that support wireless communication methods other than 3G (for example, HSPA and LTE).

Further, the smartphone 50 has a voice bus 515, a voice input / output control unit 505, a speaker 513, and a microphone 512, and inputs / outputs voice to the outside. For example, the smartphone 50 transmits the voice data of the user picked up by the microphone 512 to the master unit 10, and receives the transfer of the voice data of the other party picked up by the camera 30 (for example, the baby monitor camera 30C) from the master unit 10. , The audio data transferred from the master unit 10 is output from the speaker 329.

Further, the smartphone 50 has a wireless LAN control unit 507 and a wireless LAN communication I / F unit 508, and via a wireless router 60 connected by wireless LAN, the master unit 10 or the camera 30 and the like and image data and Send and receive voice data.

In addition, the smartphone 50 has a USB communication I / F unit 511 and transmits / receives data to / from a device or memory having a USB (Universal Serial Bus) standard interface.

Next, examples of various screens displayed on the smartphone 50 will be described with reference to FIGS. 7 (A), 7 (B), 7 (C), and 8.

First, a lullaby sound source selection screen displaying a lullaby sound source list including a lullaby sound source that can be output by the camera 30 (for example, a baby monitor camera 30C) will be described with reference to FIGS. 7 (A) to 7 (C). FIG. 7A is a diagram showing an example of a Lullaby sound source selection screen in which the Lullaby sound source list BX1 including the selection target Lullaby sound source of the master unit 10 is displayed on the smartphone 50. FIG. 7B is a diagram showing an example of a lullaby sound source selection screen in which the lullaby sound source list BX2 including the selection target lullaby sound source included in the baby monitor camera 30C is displayed on the smartphone 50. FIG. 7C is a diagram showing an example of a Lullaby sound source selection screen in which the Lullaby sound source list BX3 including the selection target Lullaby sound source of the smartphone 50 is displayed on the smartphone 50. Hereinafter, any lullaby sound source selected by the user to be output (reproduced) in the baby monitor camera 30C is referred to as a "selection target lullaby sound source" for convenience.

The display / operation unit 503 of the smartphone 50 shown in FIG. 7 (A) has, for example, the name "Lullaby L1", the name "Lullaby L2", the name "Lullaby L3", the name "Lullaby L4", and the name "Lullaby" as lullaby sound sources. The lullaby sound source selection screen including the lullaby sound source list BX1 that lists a total of 5 songs of "L5" is displayed. On the lullaby sound source selection screen, any lullaby sound source can be selected according to the input operation of the user. Further, on the display / operation unit 503 of the smartphone 50 shown in FIG. 7A, the photo icon IC1, the Video icon IC2, the Voice icon IC3, and the Lullaby icon IC4 are displayed in a non-selectable manner. For example, when the user selects and operates the name "Lullaby L1", the smartphone 50 transmits information about the selected lullaby sound source (for example, the name "Lullaby L1" of the selected lullaby sound source) to the master unit 10. In addition, in FIG. 7 (A), the name "Lullaby" which was the target of the selection operation. The voice data (selected voice data) corresponding to "L1" is stored in the storage unit 103 of the master unit 10.

The display / operation unit 503 of the smartphone 50 shown in FIG. 7 (B) has, for example, the name "Lullaby L6", the name "Lullaby L7", the name "Lullaby L8", the name "Lullaby L9", and the name "Lullaby" as lullaby sound sources. The lullaby sound source selection screen including the lullaby sound source list BX2, which lists a total of 5 songs of "L10", is displayed. On the lullaby sound source selection screen, any lullaby sound source can be selected according to the input operation of the user. In addition, the photo icon IC1, the Video icon IC2, the Voice icon IC3, and the Lullaby icon IC4 are not selectable on the display / operation unit 503 of the smartphone 50 shown in FIG. 7B, as in FIG. 7A. Has been done. For example, when the user selects and operates the name "Lullaby L6", the smartphone 50 transmits information about the selected lullaby sound source (for example, the name "Lullaby L6" of the selected lullaby sound source) to the master unit 10. In addition, in FIG. 7 (B), the name "Lullaby" which was the target of the selection operation. The voice data (selected voice data) corresponding to "L6" is stored in the storage unit 303 of the baby monitor camera 30C.

The display / operation unit 503 of the smartphone 50 shown in FIG. 7 (C) lists a total of 10 songs, for example, the names "Lullaby L11", the name "Lullaby L12", ..., and the name "Lullaby L20" as lullaby sound sources. The lullaby sound source selection screen including the uploaded lullaby sound source list BX3 is displayed. On the lullaby sound source selection screen, any lullaby sound source can be selected according to the input operation of the user. Further, on the display / operation unit 503 of the smartphone 50 shown in FIG. 7 (C), the photo icon IC1, the Video icon IC2, the Voice icon IC3, and the Lullaby icon IC4 are displayed in a non-selectable manner. For example, when the user selects and operates the name "Lullaby L11", the smartphone 50 transmits information about the selected lullaby sound source (for example, the name "Lullaby L11" of the selected lullaby sound source) to the master unit 10. In FIG. 7C, the voice data (selected voice data) corresponding to the name Lullaby L11 that is the target of the selection operation is stored in the storage unit 504 of the smartphone 50.

Next, a live monitor screen in which real-time image data captured by the camera 30 (for example, the baby monitor camera 30C) is displayed on the smartphone 50 will be described with reference to FIG. FIG. 8 is a diagram showing an example of a live monitor screen displayed on the smartphone 50 during recording by the baby monitor camera 30C.

The display / operation unit 503 of the smartphone 50 shown in FIG. 8 displays a real-time image (or video) MV1 recorded (captured) by the baby monitor camera 30C, and the name of the camera 30 that is the main image capture (for example). Baby monitor camera 30C) NM1 is also displayed. Further, the display / operation unit 503 of the smartphone 50 may also display information on the temperature detected by the sensor 40 forming a pair with the camera 30 which is the main body of imaging. In addition, the photo icon IC1, the Video icon IC2, the Voice icon IC3, and the Lullaby icon IC4a are displayed on the display / operation unit 503 of the smartphone 50 so that they can be selected. Furthermore, the camera is currently displayed on the upper part of the Lullaby icon IC4a. The indicator ID 1 of the name of the lullaby sound source output (reproduced) by 30 (for example, baby monitor camera 30C) (for example, the name "Lullaby L1") is displayed. If the Lullaby icon IC4a is selected and operated while the audio data of the Lullaby sound source with the name "Lullaby L1" is being output (played), the smartphone 50 will be given the name "Lullaby". Sends an instruction to stop the output (playback) of the audio data of the Lullaby sound source of "L1" to the master unit 10. When the master unit 10 receives the stop instruction transmitted from the smartphone 50, it transfers the stop instruction for outputting (playing) the audio data of the Lullaby sound source of the name "Lullaby L1" to the camera 30 (for example, the baby monitor camera 30C). As a result, the camera 30 (for example, the baby monitor camera 30C) stops the output (reproduction) of the audio data of the lullaby sound source having the name "Lullaby L1" currently being output (reproduced).

If the camera 30 (for example, the baby monitor camera 30C) does not output (play) the audio data of the lullaby sound source, the smartphone 50 displays the Lullaby icon IC4 with the mark related to the note on the display / operation unit 503. On the other hand, when the audio data of the lullaby sound source is output (played) by the camera 30 (for example, the baby monitor camera 30C), the smartphone 50 displays the Lullaby icon IC4a having a mark related to the stop of playback / operation unit 503. Display on. As a result, the user can easily determine whether or not the audio data of the lullaby sound source is output from the camera 30 (for example, the baby monitor camera 30C) simply by looking at the Lullaby icon displayed on the display / operation unit 503 of the smartphone 50. it can.

In addition, photo icon IC1, Video icon IC2, Voice icon IC3, and Lullaby icon IC4 have various settings according to still image (photo), video (Video), voice (Voice such as call voice), and sound source (Lullaby), respectively. It is a menu icon arranged in advance so that it can be performed. For example, the photo icon IC1 is an icon used when instructing the start of recording of the camera 30 and setting the function of the image recorded by the camera 30. The Video icon IC2 is an icon used when instructing the start of recording of the camera 30 and setting the function of the video recorded by the camera 30. The Voice icon IC3 is an icon used to instruct the start of a two-way call with the camera 30 and set the function of the two-way call with the camera 30.

Further, for example, when the audio data of the lullaby sound source is not output (played) by the camera 30 (for example, the baby monitor camera 30C) and the Lullaby icon IC4 is tapped, the smartphone 50 is displayed in FIGS. Display one of the lullaby sound source selection screens in (C) on the display / operation unit 503.

Next, the operation of the surveillance camera system 5 of the present embodiment will be described with reference to FIGS. 9, 10 and 11. FIG. 9 is a sequence diagram illustrating an example of an operation procedure in which the master unit 10 transfers the recorded image of the baby monitor camera 30C to the smartphone 50 and displays it in the surveillance camera system 5 of the present embodiment. In FIG. 9, the baby monitor camera 30C is used as an example of the camera 30 for the sake of simplicity, but other cameras 30 may be used.

Further, it is assumed that a home security application corresponding to the surveillance camera system 5 of the present embodiment is pre-installed on the smartphone 50, and this application is started by a user input operation.

In FIG. 9, when the master unit 10 acquires the detection information of the predetermined trigger operation (for example, the detection signal output to the master unit 10 when the motion sensor 40B detects a person approaching the crib) ( S1), a wireless communication connection is made with the smartphone 50 using wireless LAN (S2), and when the wireless communication connection with the smartphone 50 is completed, the detection information of the predetermined trigger operation is sent to the smartphone 50 (described above). (See) Transfer (S3).

When the smartphone 50 receives the instruction operation of the image / audio data transfer request by the user (S4), the smartphone 50 transmits the information of the instruction operation of the image / audio data transfer request (S5). When the master unit 10 receives the instruction operation information from the smartphone 50, it requests the baby monitor camera 30C to transfer the image / audio data (S6). The master unit 10 may transfer the detection information of the predetermined trigger operation (see above) to the smartphone 50, and at the same time, request the baby monitor camera 30C to transfer the image / audio data (S6).

When the baby monitor camera 30C receives the image / audio data transfer request from the master unit 10, it makes a wireless communication connection with the master unit 10 using wireless LAN, and the image data captured by the image pickup unit 312 and the image data Acquires the audio data picked up by the microphone 328 and transfers it to the master unit 10 (S7). The master unit 10 transfers the image data and audio data transferred from the baby monitor camera 30C to the smartphone 50 (S8). The smartphone 50 displays the image data transferred from the master unit 10 on the display / operation unit 503, and further outputs the audio data transferred from the master unit 10 from the speaker 513. As a result, the smartphone 50 can display the live monitor screen shown in FIG. 8 (S9).

Next, the operation of outputting (reproducing) the voice data of the lullaby sound source from the baby monitor camera 30C in response to the user's input operation to the smartphone 50 will be described with reference to FIGS. 10 and 11.

FIG. 10 is a sequence diagram illustrating an example of an operation procedure in the surveillance camera system 5 of the present embodiment when the master unit 10 or the baby monitor camera 30C has the selection target lullaby sound source. FIG. 11 is a sequence diagram illustrating an example of an operation procedure in the surveillance camera system 5 of the present embodiment when the smartphone 50 has a selection target lullaby sound source. In FIG. 11, the same step number is assigned to the content that overlaps with the description of FIG. 10, and the description is simplified or omitted, and different contents are described.

In FIG. 10, when the live monitor screen shown in FIG. 8 is displayed on the display / operation unit 503 of the smartphone 50 and the user performs an operation for instructing the lullaby setting (for example, tap operation of the Lullaby icon IC4). (S11), the smartphone 50 sends a lullaby setting request to the master unit 10 (S12).

When the master unit 10 receives the Lullaby setting request transmitted from the smartphone 50, the master unit 10 stores the Lullaby sound source list in order to generate the Lullaby sound source selection screen shown in any of FIGS. 7 (A) to 7 (C). Read from unit 103 (S13). When the lullaby sound source list is not stored in the storage unit 103, the master unit 10 transmits a read instruction of the lullaby sound source list to the baby monitor camera 30C. The baby monitor camera 30C reads the lullaby sound source list (S13') in response to the reading instruction of the lullaby sound source list from the master unit 10, and transmits the lullaby sound source list to the master unit 10.

When the master unit 10 acquires the Lullaby sound source list, it generates the Lullaby sound source selection screen shown in any of FIGS. 7 (A) to 7 (C) using the Lullaby sound source list (S14), and selects the Lullaby sound source. Send the screen to the smartphone 50 (S15). As a result, the Lullaby sound source list selection screen shown in any of the Lullaby sound source lists BX1 to BX3 of FIGS. 7 (A) to 7 (C) is displayed on the display / operation unit 503 of the smartphone 50.

Here, it is assumed that one of the lullaby sound sources is selected for the lullaby sound source list selection screen displayed on the smartphone 50 (S16). In step S16, for example, it is assumed that the audio data of the lullaby sound source stored in the baby monitor camera 30C is selected. However, the smartphone 50 cannot grasp that the voice data of the selected lullaby sound source is stored in the baby monitor camera 30C. The smartphone 50 transmits information about the lullaby sound source selected in step S16 (for example, the name Lullaby L6 shown in FIG. 7B) to the master unit 10 (S17).

When the master unit 10 receives the information about the lullaby sound source transmitted from the smartphone 50 in step S17 (see above), the master unit 10 is selected based on the information about the selected lullaby sound source and the lullaby sound source list acquired in step S14. It is determined that the lullaby sound source (selection target lullaby sound source) is stored by the baby monitor camera 30C (S18). Since the master unit 10 has determined in step S18 that the selection target lullaby sound source is stored by the baby monitor camera 30C, it instructs the baby monitor camera 30C to output (play) the selection target lullaby sound source (S19). ..

The baby monitor camera 30C reads the audio data of the selected lullaby sound source from the storage unit 303 and outputs (reproduces) it from the speaker 329 according to the instruction from the master unit 10 in step S19 (S20). As a premise for the explanation of the processing of steps S16a to S20a and as a premise for the explanation of the processing of steps S16a to S25, the operations of steps S11 to S15 shown in FIG. 10 are performed first, so that they are duplicated. The explanation of the contents will be simplified or omitted, and different contents will be explained.

Further, it is assumed that one of the lullaby sound sources is selected on the lullaby sound source list selection screen displayed on the smartphone 50 (S16a). In step S16a, for example, it is assumed that the audio data of the lullaby sound source stored in the master unit 10 is selected. However, the smartphone 50 cannot grasp that the voice data of the selected lullaby sound source is stored in the master unit 10. The smartphone 50 transmits information about the lullaby sound source selected in step S16a (for example, the name Lullaby L1 shown in FIG. 7A) to the master unit 10 (S17a).

When the master unit 10 receives the information about the Lullaby sound source transmitted from the smartphone 50 in step S17a (see above), the master unit 10 selects the Lullaby sound source (see above) based on the information about the Lullaby sound source and the Lullaby sound source list acquired in step S14. It is determined that the selection target Lullaby sound source) is stored by the master unit 10 itself (S18a). Since the master unit 10 determines in step S18a that the selection target lullaby sound source is stored by the master unit 10, the audio data of the selection target lullaby sound source read from the storage unit 103 and the audio thereof are stored in the baby monitor camera 30C. Data output (reproduction) instruction information and transmission (S19a).

The baby monitor camera 30C transmits the audio data of the selected Lullaby sound source transmitted from the master unit 10 to the speaker 329 according to the instruction information of the output (playback) of the audio data of the selected Lullaby sound source transmitted from the master unit 10 in step S19a. Output (play) from (S20a).

Further, in the present embodiment, the call voice of the user picked up by the smartphone 50 and the call voice of the other party picked up by the baby monitor camera 30C can be bidirectionally communicated via the master unit 10. For example, when the user emits some kind of call voice to the smartphone 50 in parallel with the selection operation of the Lullaby sound source shown in step S16a, the smartphone 50 transmits the user's call voice to the master unit 10 (S21). ..

When the master unit 10 receives the information about the Lullaby sound source transmitted from the smartphone 50 in step S17a (see above) and the user's call voice transmitted from the smartphone 50 in step S21, the information about the selected Lullaby sound source and the step Based on the Lullaby sound source list acquired in S14, it is determined that the selected Lullaby sound source (selection target Lullaby sound source) is stored by the master unit 10 itself (S18b). Further, the master unit 10 synthesizes the voice data of the selected lullaby sound source and the voice of the user's call (S18b).

If the master unit 10 knows in advance that the baby monitor camera 30C is a type that reproduces audio in stereo, for example, the audio data of the selected Lullaby sound source is designated as Lch (channel), and further. The user's call voice is specified as Rch (channel) and synthesized. The specification of audio data for Lch and Rch may be reversed. The master unit 10 transfers the voice data of the composite output generated in step S18b to the baby monitor camera 30C (S19b).

The baby monitor camera 30C outputs (reproduces) the combined output audio data transferred from the master unit 10 in step S19b from the speaker 329 (S20b). The baby monitor camera 30C outputs (reproduces) the audio data of the composite output by 1ch (channel) when the audio is reproduced in monaural, or the composite output when the audio is reproduced in stereo. The voice data corresponding to the specified channel (specifically, Lch or Rch) (specifically, the voice data of the selected Lullaby sound source or the user's voice) is output by the corresponding channel (specifically, the voice data of the selected Lullaby sound source or the user's voice). Reproduce.

When the baby monitor camera 30C picks up the voice of the user's call partner (for example, an infant that the user wants to monitor), the baby monitor camera 30C transmits the voice data of the picked up call voice to the master unit 10 (S23). When the master unit 10 receives the voice data of the call voice transmitted from the baby monitor camera 30C, it transfers it to the smartphone 50 as it is (S24). The smartphone 50 outputs the voice data of the call voice of the other party transferred from the master unit 10 from the speaker 513 (S25).

In FIG. 11, when the master unit 10 receives the Lullaby setting request from the smartphone 50, for example, the Lullaby sound source list stored in the smartphone 50 is stored in the storage unit 103 in advance, or the smartphone 50 is requested each time to request the Lullaby sound source list. Generates the Lullaby sound source selection screen shown in any of FIGS. 7 (A) to 7 (C) (S14c) and sends the Lullaby sound source selection screen to the smartphone 50 (S15). .. As a result, the Lullaby sound source list selection screen shown in any of the Lullaby sound source lists BX1 to BX3 of FIGS. 7 (A) to 7 (C) is displayed on the display / operation unit 503 of the smartphone 50.

Here, it is assumed that one of the lullaby sound sources is selected for the lullaby sound source list selection screen displayed on the smartphone 50 (S16c). In step S16c, for example, it is assumed that the voice data of the lullaby sound source (for example, the name Lullaby L11 shown in FIG. 7B) stored in the smartphone 50 is selected. The smartphone 50 transmits the voice data of the lullaby sound source (selection target lullaby sound source) selected in step S16c to the master unit 10 (S17c).

When the master unit 10 receives the audio data of the selected Lullaby sound source transmitted from the smartphone 50 in step S17c, the selected Lullaby sound source is stored by the smartphone 50 based on the Lullaby sound source list acquired in step S14c. Is determined (S18c). The master unit 10 transmits the audio data of the selected lullaby sound source and the output (reproduction) instruction to the baby monitor camera 30C (S19c).

The baby monitor camera 30C outputs (reproduces) the audio data of the selected lullaby sound source from the speaker 329 according to the instruction from the master unit 10 in step S19c (S20).

Similarly, when the user emits some kind of call voice to the smartphone 50 in parallel with the operation of selecting the Lullaby sound source shown in step S16c, the smartphone 50 transmits the user's call voice to the master unit 10 ( S21).

When the master unit 10 receives the voice data of the selected Lullaby sound source transmitted from the smartphone 50 in step S17c and the user's call voice transmitted from the smartphone 50 in step S21, the base unit 10 selects the Lullaby sound source list acquired in step S14c. Based on this, it is determined that the selected Lullaby sound source (selection target Lullaby sound source) is stored by the smartphone 50 (S18d). Further, the master unit 10 synthesizes the voice data of the selected lullaby sound source and the voice of the user's call (S18d).

If the master unit 10 knows in advance that the baby monitor camera 30C is a type that reproduces audio in stereo, for example, the audio data of the selected Lullaby sound source is designated as Lch (channel), and further. The user's call voice is specified as Rch (channel) and synthesized. The master unit 10 transfers the voice data of the composite output generated in step S18d to the baby monitor camera 30C (S19d).

The baby monitor camera 30C outputs (reproduces) the combined output audio data transferred from the master unit 10 in step S19d from the speaker 329 (S20b). The baby monitor camera 30C outputs (reproduces) the audio data of the composite output by 1ch (channel) when the audio is reproduced in monaural, or the composite output when the audio is reproduced in stereo. The voice data corresponding to the specified channel (specifically, Lch or Rch) (specifically, the voice data of the selected Lullaby sound source or the user's voice) is output by the corresponding channel (specifically, the voice data of the selected Lullaby sound source or the user's voice). Reproduce.

When the baby monitor camera 30C picks up the voice of the user's call partner (for example, an infant that the user wants to monitor), the baby monitor camera 30C transmits the voice data of the picked up call voice to the master unit 10 (S23). When the master unit 10 receives the voice data of the call voice transmitted from the baby monitor camera 30C, it transfers it to the smartphone 50 as it is (S24). The smartphone 50 outputs the voice data of the call voice of the other party transferred from the master unit 10 from the speaker 513 (S25).

As described above, in the surveillance camera system 5 of the present embodiment, the master unit 10 transfers the data of the Lullaby sound source list to the smartphone 50 in response to the input operation of the user's Lullaby setting for the smartphone 50, and the smartphone 50 is the master unit. The data of the Lullaby sound source list transferred from 10 is displayed on the display / operation unit 503, and the information on the selected Lullaby sound source selected is transmitted to the master unit 10 in response to the selection operation of any Lullaby sound source. When the master unit 10 receives information about the selection target lullaby sound source from the smartphone 50, the base unit 10 outputs the audio data of the selection target lullaby sound source from the baby monitor camera 30C.

As a result, the surveillance camera system 5 uses the smartphone 50 and the camera 30 (for example, the baby monitor camera 30C) by using the master unit 10, which is an existing fixed telephone that is connected to the fixed telephone network 85 and can talk to another fixed telephone 80. ) And data input / output can be realized at low cost without impairing user convenience. In addition, the surveillance camera system 5 can freely select the music played from the baby monitor camera 30C in the home 8 from a remote location by a simple operation on the smartphone 50, for example, regardless of whether the user using the smartphone 50 is in the home 8. For example, the infant can be made to listen to music according to the taste of the user or the infant even if he / she is not in the same room as the infant to be monitored.

Further, in the surveillance camera system 5, the master unit 10 enables a two-way voice call between the smartphone 50 and the camera 30 (for example, the baby monitor camera 30C), so that the voice of the user (for example, the guardian of an infant) Can be reassured by letting infants know.

Further, in the surveillance camera system 5, the camera 30 (for example, the baby monitor camera 30C) transmits the audio data picked up by the microphone 328 and the image data obtained by the imaging unit 312 to the master unit 10, and the master unit 10 is a smartphone. In response to the operation of the image and voice transfer request for 50, the voice data and image data transmitted from the camera 30 (for example, the baby monitor camera 30C) are transferred to the smartphone 50. As a result, in the surveillance camera system 5, the user can see and listen to the image (video) and sound displayed on the smartphone 50 even when he / she is in the house 8 but not near the crib or when he / she is out. Since the situation where the baby is crying can be easily grasped, after grasping the situation, the user or the baby can listen to the voice data of the favorite Lullaby sound source or listen to the user's voice by a simple operation on the smartphone 50. Infants can be calmed down by letting them.

Further, in the surveillance camera system 5, the master unit 10 stores the audio data stored in any of the master unit 10, the camera 30 (for example, the baby monitor camera 30C), and the smartphone 50 as the audio data of the selection target Lullaby sound source. Since it can be used, for example, by adding audio data of another Lullaby sound source to the smartphone 50, the number of songs not registered in advance can be easily increased. If there is audio data of the Lullaby sound source that is not necessary for the user or infant, the master unit 10 may perform an operation on the smartphone 50 to delete the audio data of the Lullaby sound source that the user does not need. By sending the list of audio data of the Lullaby sound source after deletion (after update) to the master unit 10, the latest Lullaby sound source list can be updated.

Further, in the surveillance camera system 5, the master unit 10 synthesizes the voice data of the user's call voice transmitted from the smartphone 50 and the voice data of the selected Lullaby sound source registered by the smartphone 50 or the master unit 10. The voice data is transferred to the camera 30 (for example, baby monitor camera 30C), and the camera 30 (for example, baby monitor camera 30C) outputs the synthetic voice data transferred from the master unit 10 from the speaker 329 and collects the sound of the other party. The voice data of the call voice is transmitted to the master unit 10. The base unit 10 transfers the voice data of the call voice of the other party to the smartphone 50, and the smartphone 50 outputs the voice data of the call voice of the other party transferred from the base unit 10.

As a result, in the surveillance camera system 5, regardless of whether the audio data of the selected Lullaby sound source is registered in the smartphone 50, the master unit 10, or the camera 30 (for example, the baby monitor camera 30C), the camera 30 (for example, the baby monitor camera 30C) The 30C) can output the audio data of the selected Lullaby sound source selected by the user's operation on the display / operation unit 503 of the smartphone 50. Further, the surveillance camera system 5 outputs (plays) the sound of the selected Lullaby sound source in the camera 30 (for example, baby monitor camera 30C), and outputs (reproduces) the sound of the selected Lullaby sound source, and the smartphone 50 and the camera 30 (for example, baby monitor camera 30C) via the master unit 10. ) Can make a two-way call.

Although various embodiments have been described above with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications or modifications within the scope of the claims, which naturally belong to the technical scope of the present invention. Understood.

The present invention uses an existing fixed-line telephone that allows a mobile terminal to display image data transferred from a camera and is connected to a fixed-line telephone network to make a call with another fixed-line telephone. It is useful as a monitoring system that realizes input / output at low cost without impairing user convenience.

5 Monitoring system 8 in the house 10 Master unit 10a outlet 20, 20A, 20B (cordless) handset 30, 30A, 30B camera 30C baby monitor camera 40 sensor 40A, 40B motion sensor 40C smoke sensor 50 smartphone 60 wireless router 65 internet 70 mobile phone 75 Mobile network 80 landline 85 Fixed telephone network 101 Fixed telephone line I / F section 103, 242, 303, 442, 504 Memory 104, 243, 304, 505 Audio input / output control unit 105, 244, 305 operation unit 106, 245 Display 107, 248, 448 DECT wireless I / F section 108, 249, 449 DECT protocol control unit 109, 247, 309, 447, 506 Control 110 Call control unit 112 Audio stream processing unit 115 Image memory control unit 116 image memory 117, 255, 307, 515 voice bus 121, 321, 507 Wireless LAN control unit 122, 322, 508 Wireless LAN communication I / F section 126 Handset / mobile terminal charging unit 127 USB communication I / F section 128, 251, 328, 512 microphones 129, 252, 329, 513 speakers 250, 550 rechargeable battery 312 Imaging unit 313 infrared sensor 315 image memory 316 Image memory control unit 445 indicator lamp 450 rechargeable battery 453 Sensor unit 501 3G wireless I / F section 502 3G protocol control unit 503 Display / operation unit 511 USB communication I / F section 514 Monitoring function control unit