Information processing apparatus and method, and program

The present invention relates to information processing devices, methods, and programs, and in particular, information processing devices, methods, and programs that enable viewers to view suitable video and audio regardless of their own location. Regarding.

Conventionally, in order to output video and audio in a wide range such as an event venue, an ultra-large screen monitor or a multi-channel speaker may be arranged. In such a case, the multi-channel audio signal is converted into a relatively small channel audio signal such as 2-channel or 5.1 channel. Then, the voice corresponding to the voice signal of each channel is output from the speaker of the corresponding channel. (See, for example, Patent Document 1).

<p><patcit num="1"><text>Japanese Unexamined Patent Publication No. 2006-108855</text></patcit></p>

<p> However, in a wide range such as an event venue, the viewer may not be able to view suitable video or audio depending on the location of the viewer.</p><p> The present invention has been made in view of such a situation, and is intended to enable a viewer to view suitable video and audio regardless of his / her own position.</p>

<p> The information processing device according to one aspect of the present invention includes a position detecting means for detecting the position of the client unit based on a signal output by the client unit held by the user, and the client unit detected by the position detecting means. Based on the position, a parameter value for converting at least one of the audio signal and the video signal is variably set, and the conversion means for converting the signal using the parameter value and the conversion means after conversion by the conversion means. It is provided with an output means for outputting the signal.</p><p> The conversion means variably sets a parameter value for determining the mixing ratio of the multi-channel audio signal, and converts the audio signal using the parameter value.</p><p> The position detecting means is a client unit among a plurality of divided areas divided from a predetermined area. The conversion means variably sets the parameter value based on the information detected by the position detecting means.</p><p> The conversion means variably sets a parameter value that determines the enlargement ratio of the video itself corresponding to the video signal or the characters related to the video, and converts the video signal using the parameter.</p><p> The position detecting means detects the position of the client unit as a time variable based on the time transition of the signal output by the client unit.</p><p> When the position detecting means detects that the position of the client unit has not changed, the conversion means maintains the setting of the parameter value.</p><p> Each of the information processing method and the program which is one aspect of the present invention is each of the method and the program corresponding to the above-mentioned information processing apparatus of one aspect of the present invention.</p><p> In the information processing device and method and program which are one aspect of the present invention, the information processing device that outputs at least one of the audio signal and the video signal as an output signal, or at least one of the audio signal and the video signal. The position of the client unit is detected based on the signal output by the client unit held by the user by the computer that controls the output device that outputs the above as an output signal, and the position of the client unit is detected based on the detected position of the client unit. A parameter value for converting the signal from which the output signal is generated is variably set, the signal is converted using the parameter value, and the converted signal is output as the output signal.</p>

<p> As described above, according to the present invention, the viewer can view suitable video and audio regardless of his / her own position.</p>

<figref num="1">This is a configuration example of an information processing system to which the present invention is applied.</figref><figref num="2">It is a block diagram which shows the structure of one Embodiment of the information processing system to which this invention is applied.</figref><figref num="3">It is a flowchart explaining audio signal output processing.</figref><figref num="4">It is a figure for demonstrating the audio signal output processing in the audio signal output apparatus to which this invention is applied.</figref><figref num="5">It is a figure which shows the structural example of one Embodiment of the client unit CU of the voice signal output device to which this invention is applied.</figref><figref num="6">It is a block diagram which shows the structural example of the computer included in the voice signal control device to which this invention is applied, or controls the drive thereof.</figref>

Hereinafter, the first embodiment and the second embodiment will be described as embodiments of the information processing system to which the present invention is applied. The explanation will be given in the following order. 1. First embodiment (client unit CU: example consisting of only wireless tags) 2. Second embodiment (client unit CU: an example composed of wirelessly tagged headphones and a wirelessly tagged monitor)

&lt;1. First embodiment&gt; [Structure example of information processing system to which the present invention is applied] FIG. 1 is a diagram showing a configuration example of an information processing system to which the present invention is applied.

The information processing system includes server 1, ultra-large screen monitor 2, speakers 3 to 7, wireless nodes WN1 to WNK (K is an integer value of 1 or more. K = 9 in the example of Fig. 1), and client units CU1 to CUM ( M is an integer value indicating the number of users. In the example of FIG. 1, it is configured to include M = 4).

Information processing systems are built in a wide range of areas such as event venues.

In the example of FIG. 1, the server 1 and the super-large screen monitor 2 are arranged at the upper part in FIG. Hereinafter, the upward direction in FIG. 1, that is, the direction in which the user views the ultra-large screen monitor 2 is referred to as the forward direction. Further, the lower direction in FIG. 1 is referred to as the rear direction, the left direction in FIG. 1 is referred to as the left direction as it is, and the right direction in FIG. 1 is referred to as the right direction as it is. As a matter of course, the arrangement position of the server 1 is not limited to the position of the example of FIG. 1, and may be any position.

For example, the circular region α formed facing the front surface of the ultra-large screen monitor 2 (the display surface of the ultra-large screen monitor 2) is a range in which the user can see the image displayed on the ultra-large screen monitor 2. Is indicated. Hereinafter, such a region α is referred to as a target region. Needless to say, the target area α is a design item that can be freely determined by the builder of the information processing system, and is not limited to the target area α in FIG. Speakers 3 to 7 are arranged on the boundary (circumference) of the target region α, respectively. Specifically, the speaker 3 is arranged in the front left, the speaker 4 is arranged in the front right, the speaker 5 is arranged in the rear right, the speaker 6 is arranged in the rear center, and the speaker 7 is arranged in the rear left facing the super-large screen 2. ing.

The wireless nodes WN1 to WN9 are arranged at equal intervals in three rows vertically and three rows horizontally from the front.

It should be noted that the wireless nodes WN1 to WN9 may be arranged at a plurality of locations in the target area α, and are not limited to the arrangement and the number of the examples in FIG.

The client unit CUK (K is 1 to M; M is the maximum number of viewers) is held by a user (not shown). For example, in the example of Fig. 1, M = 4. That is, in the example of FIG. 1, one client unit CU1 to one CU4 is held by each of the four viewers. As will be described later, when the client unit CUK is located in the target area α, the server 1 detects the position. This detection position indicates the location of the user holding the client unit CUK.

The server 1 outputs the input video signal to the ultra-large screen monitor 2. The ultra-large screen monitor 2 displays an image corresponding to the image signal. The viewer existing in the target α visually recognizes the image displayed on the super-large screen monitor 2.

Further, a multi-channel audio signal is input to the server 1. In the present embodiment, the server 1 converts the input multi-channel audio signal into a 5.1-channel audio signal. In the present embodiment, the 5.1 channel audio signal is composed of a stereo signal LO, a stereo signal R0, a right surround signal Rs, a center channel signal C, and a left surround signal Ls.

In the initial state, the 5.1 channel audio signal is supplied as follows. The stereo signal LO is supplied to the speaker 3, the stereo signal R0 is supplied to the speaker 4, the right surround signal Rs is supplied to the speaker 5, the central channel signal C is supplied to the speaker 6, and the surround signal Ls is supplied to the speaker 7.

That is, in the initial state, the sound corresponding to the stereo signal LO is output from the speaker 3, and the sound corresponding to the stereo signal R0 is output from the speaker 4. Further, the speaker 5 outputs the sound corresponding to the right surround signal Rs, the speaker 6 outputs the sound corresponding to the center channel signal C, and the speaker 7 outputs the sound corresponding to the left surround signal Ls. ..

As described above, in the initial state, the conventional 5.1-channel audio is simply output from the speakers 3 to 7. Therefore, when the viewer is present at the optimum listening point near the center of the target area α, the optimum sound can be heard. Here, "optimal" in the "optimal listening point" means that it is optimal when the conventional 5.1 channel audio is simply output. That is, as will be described later, when the present invention is applied, it should be noted that any position of the target region α becomes the optimum listening point for the user. Therefore, hereinafter, the optimum listening point when the conventional 5.1 channel audio is simply output will be referred to as the conventional optimum listening point.

By the way, since the target area α is a wide area such as an event venue, the viewer is not always located at the conventional optimum listening point. Therefore, if the viewer is not located at the conventional optimum listening point, he / she cannot hear suitable audio as described above in the [Problems to be Solved by the Invention] column.

Therefore, in the present embodiment, the server 1 controls to change the state of each sound output from the speakers 3 to 7 according to the presence position of the viewer. That is, when the user's existing position is other than the conventional optimum listening point position, control is performed to transition the state of each voice output from the speakers 3 to 7 to a state different from the initial state. Then, in order to realize this control, the server 1 must first detect the position of the viewer. Therefore, the server 1 has a function of detecting the position of the client unit CUK, in other words, a function of detecting the existence position of the viewer holding the client unit CUK. Hereinafter, this function will be referred to as a client unit position detection function. Further, the information indicating the detection result of the client unit CUK is referred to as the client unit position information.

In order to realize the client unit position detection function, each of the client units CU1 to CU4 has a wireless tag. Each wireless tag of the client units CU1 to CU4 transmits a signal.

Hereinafter, when it is not necessary to distinguish the client units CU1 to CU4 individually, they are collectively referred to as the client unit CU. Further, the signal transmitted from the client unit CU is referred to as a client unit signal.

The wireless nodes WN1 to WN9 each receive a client unit signal. The wireless nodes WN1 to WN9 each measure the radio field strength and delay characteristics of the client unit signal. The measurement result will be referred to as a client signal measurement result below. The client signal measurement result is output to the server 1.

The server 1 generates client unit position information based on the measurement results of each client signal from the wireless nodes WN1 to WN9. That is, the existence position of the user holding the client unit CU is detected. Then, the server 1 controls to change the state of each voice output from the speakers 3 to 7 according to the presence position of the user. A detailed example of this control will be described later. Further, hereinafter, when it is not necessary to individually distinguish the wireless nodes WN1 to WN9, they are simply referred to as wireless nodes WN.

FIG. 2 is a block diagram showing a detailed configuration example of the server 1.

The server 1 is configured to include a system interface unit 21 to a position detection unit 26.

Further, for example, the tuner 11, the network 12, and the recording device 13 are connected to the server 1. The tuner 11 to the recording device 13 may also be grasped as one component of the information processing system of FIG. Furthermore, each function of the tuner 11 and the recording device 13 may be mounted on the server 1.

The tuner 11 receives a broadcast program from a broadcasting station and supplies it to the system interface unit 21 in the form of a compressed coded video signal and an audio signal.

The video signal and audio signal compressed and encoded by the other device are output from the other device and supplied to the system interface unit 21 via the network 12.

The recording device 13 compresses and encodes the video signal and the audio signal of the content and records the content. The recording device 13 supplies the system interface unit 21 in the form of a compressed coded video signal and an audio signal.

The system interface unit 21 supplies the video signal and the audio signal supplied from the tuner 11, the network 12, or the recording device 13 to the system decoding unit 22.

As described above, the video signal and the audio signal supplied from the system interface unit 21 to the system decoding unit 22 are compressed and encoded in a predetermined format. Therefore, the system decoding unit 22 performs decompression decoding processing on the compressed coded video signal and audio signal. Decoding Out of the video signal and audio signal obtained as a result of the decoding process, the video signal is supplied to the video process unit 23, and the audio signal is supplied to the audio process unit 24, respectively.

The video process unit 23 appropriately performs image processing on the video signal from the system decoding unit 22, and then supplies the video signal to the network interface unit 25.

The audio signal supplied to the audio process unit 24 is a multi-channel audio signal as described above. Therefore, the audio process unit 24 converts the multi-channel audio signal into a 5.1-channel audio signal. Further, the audio process unit 24 uses the client unit position information from the position detection unit 26 and the 5.1 channel audio signal to generate an audio signal for each channel supplied to each of the speakers 3 to 7. Hereinafter, the audio signals of each channel supplied to each of the speakers 3 to 7 are referred to as audio signal S_out3, audio signal S_out4, audio signal S_out5, audio signal S_out6, and audio signal S_out7. A series of processes up to the generation of audio signals S_out3 to S_out7 is referred to as audio signal output processing. The details of the audio signal output processing will be described later with reference to FIG.

The network interface unit 25 outputs the video signal from the video process unit 23 to the ultra-large screen monitor 2. Further, the network interface unit 25 outputs each of the voice signals S_out3 to S_out7 from the voice process unit 24 to each of the speakers 3 to 7.

The position detection unit 26 receives the client signal measurement result of the wireless node WN, and generates client unit position information based on the reception result. As described above, the client unit position information refers to information indicating the existence position of the user holding the client unit CU. The client unit position information is provided from the position detection unit 26 to the voice process unit 24.

[Example of processing method of audio signal output device to which the present invention is applied] FIG. 3 is a flowchart illustrating an example of audio signal output processing.

In step S1, the position detection unit 26 of the server 1 determines whether or not the client unit signal measurement result has been received from the wireless node WN.

In the example of FIG. 1, the case where the client unit signal measurement result is not transmitted from any of the wireless nodes WN1 to WN9 means the case where the client unit CU does not exist in the target area. Therefore, in such a case, it is determined to be NO in step S1, and the process proceeds to step S7. However, the processing after step S7 will be described later.

On the other hand, when the client unit signal measurement result is transmitted from at least one of the wireless nodes WN1 to WN9 and received by the position detection unit 26, it is determined to be YES in step S1 and the process is stepped. Proceed to S2.

In step S2, the position detection unit 26 attempts to receive the client unit signal measurement result from the other radio node WN.

In step S3, the position detection unit 26 determines whether or not a predetermined time has elapsed. If the predetermined time has not yet elapsed, it is determined to be NO in step S3, the process is returned to step S2, and the subsequent processes are repeated. That is, until the predetermined time elapses, each time the client unit signal measurement result from another wireless node WN is transmitted, the position detection unit 26 receives the signal measurement result.

After that, when the predetermined time elapses, it is determined to be YES in step S3, and the process proceeds to step S4.

In step S4, the server 1 generates client unit position information based on the client unit signal measurement results from one or more wireless nodes WN. The client unit position information is supplied from the position detection unit 26 to the voice process unit 24.

Specifically, for example, in the present embodiment, the target region α is divided into a plurality of regions (hereinafter, referred to as group regions). The position detection unit 26 detects in which group area the client unit CU is located based on the client unit signal measurement result received from the wireless node WN. Then, the position detection unit 26 generates information indicating the group area to which the client unit CU belongs as the client unit position information. A specific example of the client unit position information will be described later with reference to FIG.

Further, the number of client unit CUs is not limited to one, and there are as many as the number of viewers existing in the target area α. For example, in the example of FIG. 1, there are four client units CU1 to CU4 in the target region α. In such a case, in the process of step S4, the client unit position information is generated for each of the plurality of client unit CUs.

In step S5, the voice process unit 24 determines whether or not the client unit CU to be detected is located in the same group area.

Here, the client unit CU to be detected refers to the client unit CU in which the position information of the client unit is generated in the process of step S4.

If at least one of the plurality of client unit CUs exists in a different group area in the target area α, it is determined to be NO in step S5, and the process proceeds to step S7. However, the processing after step S7 will be described later.

On the other hand, if only one client unit CU exists in the target area α, or if a plurality of client unit CUs exist in the same group, it is determined to be YES in step S5, and processing is performed. Goes to step S6.

In step S6, the voice process unit 24 sets the output state of the voice signal according to the group area in which the client unit CU is located. That is, the voice process unit 24 generates each voice signal S_out3 to S_out7 according to the group area, and outputs the voice signal S_out3 to S_out7 to each of the speakers 3 to 7 via the network interface unit 25.

On the other hand, if the client unit CU does not exist in the target area α, or if a plurality of client unit CUs exist across two or more group areas, it is determined to be NO in steps S1 or S5. , The process proceeds to step S7. In step S7, the voice process unit 24 sets the output state of the voice signal to the initial state. That is, the audio process unit 24 sends each of the stereo signal LO, the stereo signal R0, the right surround signal Rs, the center channel signal C, and the left surround signal Ls to the speakers 3 to 7 via the network interface unit 25. Output.

When a plurality of client unit CUs exist over two or more group areas, that is, when it is determined to be NO in S5, the voice process unit 24 sets the voice signal output state to the initial state. As another different state, for example, a non-directional state can be set.

The audio signal output process is repeated at regular intervals. That is, the client unit signal measurement results from the plurality of wireless nodes WN arranged at multiple points are transmitted to the position detection unit 26 of the server 1 at regular time intervals. As a result, if the client unit CU does not move, the output state of the audio signal by the processing of each step S6 becomes the same. That is, if the client unit CU does not move, the output state of the audio signal is maintained. On the other hand, if the client unit CU moves, the output state of the audio signal by the processing of each step S6 changes every moment according to the moving position of the client unit CU. In this case, the position detection unit 26 can calculate the position information of each client unit as a time variable and configure the center offset distance table based on the calculation result.

FIG. 4 is a diagram showing an example of client unit position information.

The client unit position information shown in FIG. 4 is shown by the combination of the respective distances between the target client unit CU and each of the speakers 3 to 7.

The first line (initial setting) in FIG. 4 shows a basic example of client unit position information in the initial state. Such client unit position information (initial setting) the position detecting unit 26 or when applied to al voice processing unit 24, the output state of the audio signal is the initial state. That is, each of the stereo signal LO, the stereo signal R0, the right surround signal Rs, the center channel signal, and the left surround signal Ls is output from each of the speakers 3 to 7.

For example, suppose that only the client unit CU1 in FIG. 1 exists in the target region α. In this case, the client unit CU1 is Near to speaker 3, Far to speaker 4, Far to speaker 5, Mid to speaker 6, and It belongs to the group area called Near to the speaker 7. Therefore, the client unit position information No. 1 shown in FIG. 4 is generated by the position detection unit 26 and supplied to the voice process unit 24.

In this case, the voice process unit 24 generates each voice signal S_out3 to S_out7 by calculating the following equations (1) to (5), respectively, and the speaker 3 to 7 via the network interface unit 25. Output to each.

Speaker 3: S_out3 = L0 * CL + R0 * CS + C * CS + Rs * CS + Ls * CM (1) Speaker 4: S_out4 = L0 * CL + R0 * CL + C * CS + Rs * CM + Ls * CS (2) Speaker 5: S_out5 = L0 * CL + R0 * CL + C * CS + Rs * CM + Ls * CS (3) Speaker 6: S_out6 = L0 * CL + R0 * CL + C * CS + Rs * CM + Ls * CS (4) Speaker 7: S_out7 = L0 * CS + R0 * CL + C * CS + Rs * CM + Ls * CS (5)

Here, CL, CM, and CS indicate coefficients for weighting the audio signal (hereinafter referred to as downmix coefficients). The downmix coefficients CS, CM, and CL are larger in that order.

That is, the voice signal S_outM supplied to the speaker M (M is an integer value of any of 3 to 7) is calculated by the following equation (6). That is, a linear combination of each channel signal weighted by multiplying each of the stereo signal LO, the stereo signal R0, the right surround signal Rs, the center channel signal C, and the left surround signal Ls by the downmix coefficients C1 to C5. However, it becomes the audio signal S_outM.

Speaker M: S_outM = L0 * C1 + R0 * C2 + C * C2 + Rs * C4 + Ls * C5 (6)

Each of these downmix coefficients C1 to C5 is variable to one of the downmix coefficients CL, CM, and CS according to the group area in which the client unit M exists.

For example, it is assumed that the combination of the downmix coefficients C1 to C5 is predetermined for each of the speakers 3 to 7 according to the group area indicated by the client unit position information No2. In this case, if only the client unit CU2 shown in FIG. 1 exists in the target area α, the client unit position information No. 2 is acquired. Therefore, the downmix coefficients C1 to C5 determined for the client unit position information No. 2 are obtained. The combination of is adopted for each of the speakers 3 to 7. Then, for each of the speakers 3 to 7, the adopted downmix coefficients C1 to C5 are substituted into the equation (6) for calculation, and as a result, each voice signal S_out3 to S_out7 corresponding to the client unit position information No. 3 is generated. Will be generated.

Further, for example, it is assumed that the combination of the downmix coefficients C1 to C5 is predetermined for each of the speakers 3 to 7 according to the group area indicated by the client unit position information No3. In this case, if only the client unit CU3 shown in FIG. 1 exists in the target area α, the client unit position information No. 3 is acquired. Therefore, the combination of the downmix coefficients C1 to C5 determined for the client unit position information No. 3 is adopted for each of the speakers 3 to 7. Then, for each of the speakers 3 to 7, the adopted downmix coefficients C1 to C5 are substituted into the equation (6) for calculation, and as a result, each voice signal S_out3 to S_out7 corresponding to the client unit position information No. 3 is generated. Will be generated.

Further, for example, it is assumed that the combination of the downmix coefficients C1 to C5 is predetermined for each of the speakers 3 to 7 according to the group area indicated by the client unit position information No4. In this case, if only the client unit CU4 shown in FIG. 1 exists in the target area α, the client unit position information No. 4 is acquired. Therefore, the combination of the downmix coefficients C1 to C5 determined for the client unit position information No. 4 is adopted for each of the speakers 3 to 7. Then, for each of the speakers 3 to 7, the downmix coefficients C1 to C5 adopted respectively are substituted into the equation (6) for calculation, and as a result, each audio signal S_out3 to S_out7 corresponding to the client unit position information No. 4 is generated. Will be generated.

By the above audio signal output processing, regardless of where the viewer holding the client unit CU exists in the target area α, each audio signal S_out3 to S_out7 generated so as to be suitable for the existing position is a speaker. It is supplied to each of 3 to 7. Therefore, the sound of each channel suitable for the position of the viewer is output from the speakers 3 to 7. As a result, the viewer can hear a suitable sound.

The audio signal processing when the client unit position information No. 5 of FIG. 4 is acquired will be described.

Client unit position information No. 5 is Near (close) to speaker 3, Far (far) to speaker 4, Near (close) to speaker 5, Near (close) to speaker 6, and speaker 7. It is a collection of information called Near.

However, in the example of FIG. 1, it is unlikely that the client unit position information No. 5 is acquired while any one of the client units CU1 to CU4 is stationary. Therefore, in the example of FIG. 1, there are two possible possibilities for acquiring the client unit position information No. 5.

The first possibility is that multiple client unit CUs exist in different group areas. For example, in the example of FIG. 1, when the client unit CU1 and the client unit CU3 exist at the same positions shown in FIG. 1, the client unit position information No. 5 is acquired.

The second possibility is that a single client unit CU is moving while the client unit position information acquisition process is continuing. For example, in the example of FIG. 1, when the client unit CU1 moves from the position shown in FIG. 1 to the position shown as the position of the client unit CU2 in FIG. 1, the client unit information No. 5 is acquired.

When such client unit information No. 5 is acquired, the voice process unit 24 can set the output state of the voice signal to a general-purpose state (for example, an initial state) without directivity.

If it is necessary to determine whether it is the first possibility or the second possibility, the center offset distance table configured based on the position information of each client unit as a time variable may be used. .. This is because it is possible to easily determine whether it is the first possibility or the second possibility by looking at the history of the client unit position information acquired before the client unit position information No5.

As described above, the server 1 can naturally set the audio signal parameter (downmix coefficient in the above example) variably based on the client unit position information of the client unit CU. Further, the server 1 can also change various parameters of the video signal based on the client unit position information of the client unit CU. For example, when the location of the client unit CU is far from the super-large screen monitor 2, the server 1 expands and displays the video itself or the character information (subtitles, etc.) related to the video. Parameters can be set. &lt;2. Second embodiment&gt; [Client unit CU configuration example] FIG. 5 is an example of another embodiment of the client unit CU described above with reference to FIGS. 1 and 2.

The client unit CUa shown in FIG. 5 is a mobile monitor with a wireless tag. The client unit CUb is a headphone with a wireless tag.

The client unit CUa receives the video signal and the audio signal from the server 1, displays the video corresponding to the video signal, and outputs the audio corresponding to the audio signal.

In this case, the server 1 can naturally set the above-mentioned voice signal parameters (for example, downmix coefficient) variably based on the client unit position information of the client unit CUa. Further, the server 1 can change various parameters of the video signal based on the client unit position information of the client unit CUa. For example, depending on the location of the client unit CUa, the server 1 displays the image itself displayed on the super-large screen monitor 2 or the character information (subtitles, etc.) related to the image on the client unit CUa. As such, various parameters can be set.

The client unit CUb receives an audio signal from the server 1 and outputs the received audio.

For example, the server 1 can variably set the above-mentioned voice signal parameters (for example, downmix coefficient) based on the client unit position information of the client unit CUb. The audio signals generated by the server 1 after setting the parameters, and in the above example, the audio signals S_out3 to S_out7 are wirelessly transmitted to the client unit CUb.

That is, in the first embodiment, it is premised that the sound of each channel is output from the speakers 3 to 7. Therefore, for example, when a plurality of client unit CUs exist in different group areas, the server 1 sets the parameters of the audio signal as non-directional general-purpose settings (for example, parameter values for initializing the state). I was doing the setting).

On the other hand, in the second embodiment, audio is output from the client unit CUb. Therefore, for example, even when a plurality of client unit CUbs exist in different group areas, the server 1 is individually used as an audio signal parameter for each of the plurality of client unit CUbs according to their respective existence positions. (For example, setting different downmix coefficients) can be set. As a result, each client unit CUb can hear an audio signal suitable for its existing position.

The viewer may hold both the client unit CUa and the client unit CUb, or may hold only one of them.

Further, the method for detecting the client position in the information processing apparatus to which the present invention is applied is not limited to the method described with reference to FIGS. 1 to 4, and may be any method.

In the information processing device to which the present invention is applied, it is possible to output suitable video and audio according to the presence position of the viewer. As a result, when the viewer views the video or audio in a wide range such as an event venue, the viewer can easily view the suitable video or audio regardless of the position of the viewer. ..

Further, in the information processing apparatus to which the present invention is applied, the position information of each client unit can be calculated as a time variable. As a result, the information processing device to which the present invention is applied can prepare a suitable viewing environment according to the position even when the viewer moves in the event venue, for example.

By the way, the series of processes described above can be executed by hardware or by software.

When the series of processes described above is executed by software, the information processing apparatus to which the present invention is applied can be configured to include, for example, the computer shown in FIG. Alternatively, the computer of FIG. 6 may control the robot hand device to which the present invention applies.

In FIG. 6, the CPU (Central Processing Unit) 101 executes various processes according to the program recorded in the ROM (Read Only Memory) 102 or the program loaded from the storage unit 108 into the RAM (Random Access Memory) 103. To do. The RAM 103 also appropriately stores data and the like necessary for the CPU 101 to execute various processes.

The CPU 101, ROM 102, and RAM 103 are connected to each other via the bus 104. An input / output interface 105 is also connected to the bus 104.

The input / output interface 105 includes an input unit 106 consisting of a keyboard, a mouse, etc., an output unit 107 consisting of a display, a storage unit 108 composed of a hard disk, and a communication unit 109 composed of a modem, a terminal adapter, and the like. It is connected. The communication unit 109 controls communication with other devices (not shown) via a network including the Internet.

A drive 110 is also connected to the input / output interface 105 as needed, and a removable media 111 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached, and a computer program read from the removable media 111 is installed. , Installed in storage 108 as needed.

When a series of processes are executed by software, the programs that make up the software execute various functions by installing a computer embedded in dedicated hardware or various programs. It can be installed on a network or recording medium, for example, on a general-purpose personal computer.

As shown in FIG. 6, the recording medium containing such a program is a magnetic disk (including a floppy disk) on which the program is recorded, which is distributed to provide the program to the viewer separately from the main body of the device. ), Optical disk (including CD-ROM (Compact Disk-Read Only Memory), DVD (Digital Versatile Disk)), optical magnetic disk (including MD (Mini-Disk)), or removable media (package) consisting of semiconductor memory, etc. Not only is it composed of the media) 111, but it is also composed of a ROM 102 on which a program is recorded and a hard disk included in the storage unit 108, which are provided to the viewer in a state of being pre-installed in the device main body.

In the present specification, the steps for describing a program recorded on a recording medium are not necessarily processed in chronological order, but also in parallel or individually, even if they are not necessarily processed in chronological order. It also includes the processing to be executed.

Further, in the present specification, the system represents an entire device composed of a plurality of devices and processing units.

1 server, 2 super large screen monitor, 3,4,5,6,7 speaker, CU1, CU2, CU3, CU4, CU5, CUa, CUb client unit, WN1, WN2, WN3, WN4, WN5, WN6, WN7, WN8 , WN9 wireless node, 11 tuner, 12 network, 13 recording device, 21 system interface section, 22 system decoding section, 23 video process section, 24 audio process section, 25 network interface section, 26 position detection section, 101 CPU, 102 ROM , 103 RAM, 104 Bus, 105 I / O Interface, 106 Input, 107 Output, 108 Storage, 109 Communication, 110 Drive, 111 Removable Media