Display and control method, program and recording medium, and display system

The present invention relates to a display device and a control method, a program and a recording medium, and a display system, and in particular, when a large number of display devices are connected and used, the present invention is used alone. With respect to display devices and control methods, programs and recording media, and display systems that enable higher functionality to be achieved.

[0002] For example, in a television receiver, a television broadcast signal is received, an image as a television broadcast program is displayed, and audio accompanying the image is output.

[0003] [Problems to be Solved by the Invention] By the way, the conventional television receiver is premised on operating as a single unit, and therefore, a user newly purchases a television receiver. In that case, the television receiver owned by the user is no longer needed, and even if it is still usable, it is often discarded.

[0004] Therefore, when a large number of television receivers are connected, if higher functionality can be realized than in the case of a single television receiver, the disposal of usable television receivers can be prevented and resources can be effectively used. Can contribute.

[0005] The present invention has been made in view of such a situation, and realizes higher functionality when used by connecting a large number of display devices such as television receivers than when used alone. It allows you to do it.

[Means for Solving the Problems] The display device of the present invention includes a connection detecting means for detecting that another display device is connected and another display device for which the connection is detected by the connection detecting means. It is provided with an authentication means for performing authentication between the display devices and a function change means for changing the function of the display device when the authentication is successful.<u style="single">There are two types of display devices and other display devices: a parent display device that can control the connection device connected to itself, and a child display device that can be controlled from the connection device but cannot control the connection device. Then, the authentication means authenticates whether the other display device is legitimate and whether the other display device is a parent or child display device.</u>It is characterized by that.

[0007] The control method of the present invention includes a connection detection step that detects that another display device is connected, and an authentication step that authenticates between the other display devices whose connection is detected in the connection detection step. , Function change steps that change the function of the display device when authentication is successful<u style="single">The display device and other display devices include a parent display device that can control the connection device connected to itself and a child display device that can be controlled from the connection device but cannot control the connection device. There are different types, and the authentication step is to authenticate whether the other display device is legitimate and whether the other display device is the parent or child display device. Including</u>It is characterized by.

[0008] The program of the present invention includes a connection detection step for detecting that another display device is connected, an authentication step for authenticating between another display device for which a connection is detected in the connection detection step, and an authentication step. With the function change step that changes the function of the display device when the authentication is successful<u style="single">The display device and other display devices include a parent display device that can control the connection device connected to itself and a child display device that can be controlled from the connection device but cannot control the connection device. There are different types, and the authentication step is to authenticate whether the other display device is legitimate and whether the other display device is the parent or child display device. Including</u>It is characterized by.

[0009] The recording medium of the present invention.<u style="single">Program is</u>A connection detection step that detects that another display device is connected, an authentication step that authenticates between the other display devices whose connection was detected in the connection detection step, and a display device when the authentication is successful. With functional change steps that change the function of<u style="single">The display device and other display devices include a parent display device that can control the connection device connected to itself and a child display device that can be controlled from the connection device but cannot control the connection device. There are different types, and the authentication step is to authenticate whether the other display device is legitimate and whether the other display device is the parent or child display device. Including</u>It is characterized by.

[0010] In the display system of the present invention, the parent and child display devices have a connection detecting means for detecting that another display device is connected and another display device for which the connection is detected by the connection detecting means. It has an authentication means that authenticates between the two, and a function change means that changes its own function when the authentication is successful.<u style="single">The authentication means authenticates whether the other display device for which the connection is detected is legitimate, and whether the other display device is a parent or child display device.</u>It is characterized by that.

[0011] In the display device and control method, program and recording medium, and display system of the present invention, it is detected that another display device is connected, and authentication is performed with the detected other display device. Will be done. For more information,<u style="single">Authentication is performed as to whether or not the other detected display device is legitimate, and whether or not the other detected display device is a parent or child display device.</u>Then, when the authentication is successful, the function changes.

[Embodiment of the Invention] FIG. 1 shows a scalable TV (Television) system to which the present invention is applied (a system is a system in which a plurality of devices are logically assembled, and the devices having the same configuration are in the same housing. It is a perspective view which shows the structural example of one Embodiment (whether or not it is in the body).

[0013] In the embodiment of FIG. 1A, the scalable TV system includes nine television receivers 1 and 2.₁₁,2₁₂,2₁₃,2₂₁,2₂₃,2₃₁,2₃₂,2₃₃It is composed of. Further, in the embodiment shown in FIG. 1B, the scalable TV system has 25 television receivers 1 and 2.₁₁,2₁₂,2₁₃,2₁₄,2₁₅,2₂₁,2₂₂,2₂₃,2₂₄,2₂₅,2₃₁,2₃₂,2₃₄,2₃₅,2₄₁,2₄₂,2₄₃,2₄₄,2₄₅,2₅₁,2₅₂,2₅₃,2₅₄,2₅₅It is composed of.

[0014] Here, the number of television receivers constituting the scalable TV system is not limited to 9 or 25. That is, the scalable TV system can be configured by any plurality of television receivers. Further, as shown in FIG. 1, the arrangement of the television receivers constituting the scalable TV system is not limited to 3 × 3 or 5 × 5 in the horizontal × vertical direction. That is, the arrangement of the television receivers constituting the scalable TV system may be, for example, 1 × 2 in width × length, 2 × 1, 2 × 3, or the like. Further, the arrangement shape of the television receivers constituting the scalable TV system is not limited to the grid shape (matrix shape) as shown in FIG. 1, and may be, for example, a pyramid shape.

[0015] As described above, the scalable TV system is said to be a "scalable" system because any plurality of television receivers can be arranged horizontally and vertically in an arbitrary number of units. be able to.

[0016] The television receivers constituting the scalable TV system include a parent television receiver (hereinafter, appropriately referred to as a master unit) capable of controlling another television receiver and another television receiver. There are two types of child television receivers (hereinafter, appropriately referred to as slaves) that can be controlled from the machine but cannot control other television receivers.

[0017] In order for the scalable TV system to perform various processes described later, the television receiver constituting the scalable TV system is compatible with the scalable TV system (hereinafter, appropriately referred to as a scalable TV system). Moreover, it is a condition that at least one of them is a master unit. Therefore, in the embodiment of FIGS. 1A and 1B, among the television receivers constituting the scalable TV system, for example, the television receiver arranged at the center is regarded as the master unit 1.

[0018] From the above, if there is a television receiver that is not a scalable TV receiver among the television receivers that make up the scalable TV system, the function of the scalable TV system can be enjoyed depending on the television receiver. Can not do it. Further, even if the television receivers constituting the scalable TV system are scalable compatible devices, if all of them are slave units, the functions of the scalable TV system cannot be enjoyed.

[0019] Therefore, in order to enjoy the functions of the scalable TV system, the user needs to purchase at least one master unit or one master unit and one or more slave units.

[0020] The master unit also has a function of a slave unit. Therefore, a plurality of master units may exist in the television receivers constituting the scalable TV system.

[0021] In the embodiment of FIG. 1A, among the 3 × 3 television receivers, the television receiver 1 arranged at the center (second from the left and second from the top) is the master unit. And the other 8 television receivers 2₁₁,2₁₂,2₁₃,2₂₁,2₂₃,2₃₁,2₃₂,2₃₃Is a slave unit. Further, in the embodiment shown in FIG. 1B, among the 5 × 5 television receivers, the television receiver 1 arranged in the center (third from the left and third from the top) serves as the master unit. And 2 of the other 24₁₁,2₁₂,2₁₃,2₁₄,2₁₅,2₂₁,2₂₂,2₂₃,2₂₄,2₂₅,2₃₁,2₃₂,2₃₄,2₃₅,2₄₁,2₄₂,2₄₃,2₄₄,2₄₅,2₅₁,2₅₂,2₅₃,2₅₄,2₅₅Is a slave unit.

[0022] Therefore, in the embodiment of FIG. 1, the master unit 1 is arranged at the center of the television receiver constituting the scalable TV system, but the position of the master unit 1 constitutes the scalable TV system. The master unit 1 is not limited to the center of the television receiver, and can be arranged at any position such as the upper left, the lower right, and the like.

[0023] In the scalable TV system, regardless of the position of the master unit 1, the television receiver arranged at the center of the master unit 1 is regarded as the master unit, and each of them will be described later. It is possible to perform processing.

[0024] In the following, for the sake of simplicity, the scalable TV system shall be composed of 3 × 3 television receivers as shown in FIG. 1A, and further, the master unit. 1 shall be placed in the center of the television receivers that make up the scalable TV system.

[0025] Note that the slave unit 2 that constitutes the scalable TV system_ijSuffix ij is its handset 2_ijIndicates that is arranged in the i-th column, the j-th row (i-th row from the top, j-th column from the left) in the scalable TV system.

[0026] In addition, the following, as appropriate, the slave unit 2_ijIs described as slave unit 2 unless it is necessary to distinguish between them.

[0027] Next, FIG. 2 is a perspective view showing a configuration example of the television receiver which is the master unit 1.

[0028] The master unit 1 is a television receiver whose display screen size is, for example, 14 inches (inch) or 15 inches, and a CRT (Cathod Ray Tube) that displays an image in the center portion of the front surface thereof. 11 is provided, and speaker units 12L and 12R for outputting audio are provided at the left end and the right end of the front thereof, respectively.

[0029] Then, an image in the television broadcast signal received by an antenna (not shown) is displayed on the CRT 11, and the L (Left) channel and the R (Right) channel of the audio accompanying the image are the speaker unit. It is output from 12L and 12R respectively.

[0030] The master unit 1 is accompanied by a remote commander (hereinafter, appropriately referred to as a remote controller) 15 that emits infrared IR (Infrared Ray), and the user can operate the remote controller 15 to display a receiving channel or the like. It is possible to change the volume and give various other commands to the master unit 1.

[0031] The remote controller 15 is not limited to the one that performs infrared communication, and for example, it is possible to adopt a remote controller 15 that performs wireless communication such as BlueTooth (trademark).

[0032] Further, the remote controller 15 can control not only the master unit 1 but also the slave unit 2.

Next, FIG. 3 is a six-view view showing a configuration example of the master unit 1 of FIG.

[0034] FIG. 3A is the front surface of the master unit 1, FIG. 3B is the upper surface of the master unit 1, FIG. 3C is the bottom surface of the master unit 1, FIG. 3D is the left side surface of the master unit 1, and FIG. 3E is the master unit 1. The right side of is shown, and Fig. 3F shows the back of the master unit 1.

[0035] A fixing mechanism is provided on the upper surface (FIG. 3B), the bottom surface (FIG. 3C), the left side surface (FIG. 3D), and the right side surface (FIG. 3E) of the master unit 1. As will be described later, similar fixing mechanisms are provided on the top surface, bottom surface, left side surface, and right side surface of the television receiver which is the slave unit 2, and the top surface side, bottom surface side, and left side surface of the master unit 1 are provided. When the slave unit 2 or other master unit is placed on the side or the right side, the fixing mechanism provided on the top surface, bottom surface, left side surface, or right side of the master unit 1 and the slave unit 2 or other A fixing mechanism provided on the opposite surface of the master unit is fitted, for example, and the master unit 1 is fixed so that the slave unit 2 and other master units are not easily separated from each other. This prevents misalignment of the television receivers that make up the scalable TV system.

[0036] The fixing mechanism can be configured by a mechanical mechanism or, for example, a magnet or the like.

As shown in FIG. 3F, a terminal panel 21, an antenna terminal 22, an input terminal 23, and an output terminal 24 are provided on the back surface of the master unit 1.

[0038] The terminal panel 21 includes a master unit 1 and eight slave units 2 constituting the scalable TV system of FIG. 1A.₁₁,2₁₂,2₁₃,2₂₁,2₂₃,2₃₁,2₃₂,2₃₃Eight IEEE (Institute of Electrical and Electronics Engineers) 1394 terminals for electrically connecting to each 21₁₁,21₁₂,21₁₃,21₂₁,21₂₃,21₃₁,21₃₂,21₃₃Is provided.

[0039] Here, in the embodiment of FIG. 3F, the master unit 1 is the slave unit 2 in the scalable TV system of FIG. 1A._ijIn order to grasp the position of the terminal panel 21, when the user views the scalable TV system from the back side of the terminal panel 21, the handset 2 in the scalable TV system shown in FIG. 1A._ijIn the position corresponding to the position of, the slave unit 2_ijIEEE1394 terminal 21 connected to_ijIs provided.

Therefore, in the scalable TV system of FIG. 1A, the slave unit 2₁₁Is an IEEE1394 terminal 21₁₁, Slave unit 2₁₂Is an IEEE1394 terminal 21₁₂, Slave unit 2₁₃Is an IEEE1394 terminal 21₁₃, Slave unit 2₂₁Is an IEEE1394 terminal 21₂₁, Slave unit 2₂₃Is an IEEE1394 terminal 21₂₃, Slave unit 2₃₁Is an IEEE1394 terminal 21₃₁, Slave unit 2₃₂Is an IEEE1394 terminal 21₃₂, Slave unit 2₃₃Is an IEEE1394 terminal 21₃₃To connect to the master unit 1 via each of the above.

[0041] In the scalable TV system of FIG. 1A, the slave unit_ijIs not particularly limited as to which IEEE1394 terminal of the terminal panel 21 is connected. However, the handset_ij, IEEE1394 terminal 21_ijWhen connecting to an IEEE1394 terminal other than the above, the slave unit_ijHowever, it is necessary to set in the master unit 1 that it is located in the i-column, j-row of the scalable TV system in Fig. 1A (it is necessary to have the user set it).

[0042] Further, in the embodiment shown in FIG. 3F, the terminal panel 21 has eight IEEE1394 terminals 21.₁₁~ 21₃₃1 master unit and 2 slave units₁₁~ 2₃₃I tried to connect each in parallel, but the master unit 1 and 8 slave units 2₁₁~ 2₃₃It is also possible to connect serially with. That is, the slave unit 2_ijIs another handset 2_i'j'It is possible to connect to the master unit 1 via. However, in this case as well, the handset_ijHowever, it is necessary to set in the master unit 1 that it is located in the i-th column, the j-th row of the scalable TV system in Fig. 1A. Therefore, the number of IEEE1394 terminals provided on the terminal panel 21 is not limited to eight.

[0043] Further, the electrical connection between the television receivers constituting the scalable TV system is not limited to IEEE1394, and other examples such as LAN (IEEE802) can be adopted. In addition, the electrical connection between the television receivers that make up the scalable TV system can be made wirelessly instead of wired.

[0044] A cable connected to an antenna (not shown) is connected to the antenna terminal 22, whereby the television broadcast signal received by the antenna is input to the master unit 1. For example, image data and audio data output from a VTR (Video Tape Recoder) or the like are input to the input terminal 23. From the output terminal 24, for example, image data and audio data as a television broadcast signal received by the master unit 1 are output.

Next, FIG. 4 is a perspective view showing a configuration example of the television receiver which is the slave unit 2.

[0046] The slave unit 2 is a television receiver having the same display screen size as the master unit 1 in FIG. 2, and a CRT (Cathod Ray Tube) 31 for displaying an image is provided in the center portion of the front surface thereof. In addition, speaker units 32L and 32R that output sound are provided at the left and right ends of the front, respectively. It is also possible to adopt different display screen sizes for the master unit 1 and the slave unit 2.

Then, the image of the television broadcast signal received by the antenna (not shown) is displayed on the CRT31, and the L (Left) channel and the R (Right) channel of the audio accompanying the image are the speaker unit. It is output from 32L and 32R respectively.

[0048] Similar to the master unit 1, the slave unit 2 is also equipped with a remote controller 35 that emits infrared IR, and the user can change the reception channel and volume, and various other things by operating the remote controller 35. Command can be given to the slave unit 2.

The remote controller 35 can control not only the slave unit 2 but also the master unit 1.

[0050] Further, in order to configure the scalable TV system of FIG. 1A, the user has one master unit 1 and eight slave units 2.₁₁~ 2₃₃In this case, the master unit 1 comes with a remote controller 15, and 8 slave units 2₁₁~ 2₃₃If the remote controller 35 is attached to each, the user will own nine remote controllers, and the management will be complicated.

Therefore, the remote controller 35 of the slave unit 2 can be sold separately as an option of the slave unit 2. In addition, the remote controller 15 of the master unit 1 can also be sold separately as an option of the master unit 1.

[0052] Here, as described above, the remote controllers 15 and 35 can control both the master unit 1 and the slave unit 2, and therefore own only one of the remote controllers 15 and 35. It is possible to control all of the master unit 1 and the slave unit 2 even if they are not.

Next, FIG. 5 is a six-view view showing a configuration example of the slave unit 2 of FIG.

5A is the front of the slave unit 2, FIG. 5B is the top surface of the slave unit 2, FIG. 5C is the bottom surface of the slave unit 2, FIG. 5D is the left side surface of the slave unit 2, and FIG. 5E is the slave unit 2. The right side of is shown, and Fig. 5F shows the back of the handset 2.

Fixing mechanisms are provided on the upper surface (FIG. 5B), bottom surface (FIG. 5C), left side surface (FIG. 5D), and right side surface (FIG. 5E) of the slave unit 2, and the upper surface side of the slave unit 2 is provided. When the master unit 1 or another slave unit is placed on the bottom surface side, left side surface side, or right side surface side, the fixing mechanism provided on the top surface, bottom surface, left side surface, or right side surface of the slave unit 2 and The fixing mechanism provided on the opposite surface of the master unit 1 and the other slave units is fitted, and the slave unit 2 and the other slave unit or the master unit 1 are fixed so as not to be easily separated from each other.

As shown in FIG. 5F, a terminal panel 41, an antenna terminal 42, an input terminal 43, and an output terminal 44 are provided on the back surface of the slave unit 2.

[0057] The terminal panel 41 has one IEEE1394 terminal 41 for electrically connecting the master unit 1 and the slave unit 2.₁Is provided. The slave unit 2 is arranged in the scalable TV system shown in FIG. 1A, for example, in the upper left corner.₁₁If, then the IEEE1394 terminal 41 of the terminal panel 41₁Is an IEEE1394 terminal 21 of the terminal panel 21 in FIG. 3F via an IEEE1394 cable (not shown).₁₁Is connected with.

[0058] The number of IEEE1394 terminals provided on the terminal panel 41 is not limited to one.

A cable connected to an antenna (not shown) is connected to the antenna terminal 42, whereby the television broadcast signal received by the antenna is input to the slave unit 2. For example, image data and audio data output from a VTR or the like are input to the input terminal 43. From the output terminal 44, for example, image data and audio data as a television broadcast signal received by the slave unit 2 are output.

[0060] One master unit 1 and eight slave units 2 configured as described above.₁₁~ 2₃₃The scalable TV system shown in Fig. 1A is constructed by arranging a total of nine television receivers, three in each of the horizontal and vertical directions.

[0061] The scalable TV system of FIG. 1A is configured by directly arranging another television receiver on the top, bottom, left, or right of the television receiver as a master unit or a slave unit. For example, it is possible to arrange and configure the television receiver in the rack dedicated to the scalable TV system shown in FIG. When a dedicated rack is used in this way, it is possible to more firmly prevent misalignment of the television receivers constituting the scalable TV system.

[0062] Here, when a scalable TV system is configured by directly arranging another television receiver on the top, bottom, left, or right of the television receiver as a master unit or a slave unit, For example, the master unit 1 is at least the slave unit 2.₃₂Without, it cannot be placed in the second row and second column, as shown in Figure 1A. On the other hand, when using the rack dedicated to the scalable TV system shown in Fig. 6, the slave unit 2₃₂The master unit 1 can be placed in the second row and second column even if is not present.

[0063] Next, FIG. 7 is a plan view showing a configuration example of the remote controller 15.

[0064] The select button switch 51 can be operated (direction operation) in a total of eight directions in four diagonal directions in the middle in addition to the four directions in the vertical and horizontal directions. Further, the select button switch 51 can also be pressed (selected) in the direction perpendicular to the upper surface of the remote controller 15. The menu button switch 54 is set to the CRT 11 of the master unit 1 (or the CRT 31 of the slave unit 2) in various settings (for example, the slave unit described above)._ijIs located in column i, row j of the scalable TV system), or when displaying the menu screen for inputting commands that instruct to perform predetermined processing. Will be done.

[0065] Here, when the menu screen is displayed, a cursor for instructing an item or the like on the menu screen is displayed on the CRT 11. By operating the select button switch 51 in the direction, this cursor moves in the direction corresponding to the operation. Further, when the select button switch 51 is selected while the cursor is at a position on a predetermined item, the selection of the item is confirmed. In the present embodiment, as will be described later, there is an icon among the items displayed in the menu, and the select button switch 51 is also selected when the icon is clicked.

[0066] The exit button switch 55 is operated when returning from the menu screen to the original normal screen.

[0067] The volume button switch 52 is operated when raising or lowering the volume. The channel up / down button switch 53 is operated when the number of the broadcast channel to be received is up or down.

[0068] The number button (numeric keypad) switch 58 on which the numbers 0 to 9 are displayed is operated when the displayed numbers are input. When the operation of the number button switch 58 is completed, the enter button switch 57 is operated thereafter in the sense that the number input is completed. When the channel is switched, the new channel number and the like are displayed on the CRT11 of the master unit 1 (or the CRT31 of the slave unit 2) for a predetermined time on the OSD (On Screen Display). The display button 56 is operated to switch on / off the OSD display such as the number of the currently selected channel and the current volume.

[0069] The TV / video selector button switch 59 inputs the input of the master unit 1 (or the slave unit 2) to the built-in tuner 121 (or the tuner 141 of FIG. 11 described later) or FIG. 3 described later. It is operated when switching to input from terminal 23 (or input terminal 43 in FIG. 5). The TV / DSS selector button switch 60 is operated when the tuner 121 selects a TV mode for receiving terrestrial broadcasts or a DSS (Digital Satellite System (trademark of Hughes Communications)) mode for receiving satellite broadcasts. .. When the number button switch 58 is operated to switch channels, the channel before switching is memorized, and the jump button switch 61 is operated when returning to the original channel before this switching.

[0070] The language button 62 is operated when a predetermined language is selected when broadcasting is performed in two or more languages. The guide button switch 63 is operated when the closed caption data is displayed when the image data displayed on the CRT 11 includes the closed caption data. The favorite button switch 64 is operated to select a preset user's favorite channel.

[0071] The cable button switch 65, the television switch 66, and the DSS button switch 67 are button switches for switching the device category of the command code corresponding to the infrared rays emitted from the remote controller 15. That is, the remote controller 15 (similar to the remote controller 35) can remotely control the television receiver as the master unit 1 and the slave unit 2, as well as the STB and IRD (not shown), and is a cable button switch. The 65 is operated when the STB (Set Top Box) that receives the signal transmitted via the CATV network is controlled by the remote controller 15. After operating the cable button switch 65, the remote controller 15 emits infrared rays corresponding to the command code of the device category assigned to the STB. Similarly, the TV button switch 66 is operated when the master unit 1 (or the slave unit 1) is controlled by the remote controller 15. The DSS button switch 67 is operated when the remote controller 15 controls the IRD (Integrated Receiver and Decorder) that receives the signal transmitted via the satellite.

The LEDs (Light Emitting Diodes) 68, 69, 70 are lit when the cable button switch 65, television button switch 66, or DSS button switch 67 are turned on, respectively, which causes the remote control 15 to now The user is shown which category of device can be controlled. The LEDs 68, 69, and 70 are turned off when the cable button switch 65, the TV button switch 66, or the DSS button switch 67 is turned off, respectively.

[0073] The cable power button switch 71, the TV power button switch 72, and the DSS power button switch 73 are operated when the power of the STB, the master unit 1 (or the slave unit 2), or the IRD is turned on / off.

[0074] The muting button switch 74 is operated when setting or canceling the muting state of the master unit 1 (or the slave unit 2). The sleep button switch 75 is operated to set or cancel the sleep mode that automatically turns off the power at a predetermined time or when a predetermined time has elapsed.

[0075] When the remote controller 15 is operated, the light emitting unit 76 emits infrared rays corresponding to the operation.

Next, FIG. 8 is a plan view showing a configuration example of the remote controller 35 of the slave unit 2.

Since the remote controller 35 is composed of the select button switch 81 to the light emitting unit 106, which are similarly configured as the select button switch 51 to the light emitting unit 76 in the remote controller 15 of FIG. 7, the description thereof will be omitted.

Next, FIG. 9 is a plan view showing another configuration example of the remote controller 15 of the master unit 1.

[0079] In the embodiment of FIG. 9, instead of the select button switch 51 that can be operated in eight directions in FIG. 7, directional button switches 111,112,113,114 in four directions of up, down, left, and right, and a button switch 110 for performing a select operation are used. It is provided. Further, in the embodiment of FIG. 9, the cable button switch 65, the television button switch 66, and the DSS button switch 67 are internally illuminated, and the LEDs 68 to 70 in FIG. 7 are omitted. However, LEDs (not shown) are arranged on the back side of the button switches 65 to 67, and when the button switches 65 to 67 are operated, the LEDs arranged on the back side correspond to the operation. It is designed to turn on or off.

[0080] The other button switches are basically the same as those shown in FIG. 7, although their arrangement positions are different.

[0081] The remote controller 35 of the slave unit 2 can also be configured in the same manner as in the case of FIG.

[0082] Further, the remote controller 15 can have a built-in gyro for detecting the movement. In this case, the remote controller 15 detects the moving direction and the moving amount of the remote controller 15 by the built-in gyro, and moves the cursor displayed on the menu screen according to the moving direction and the moving amount. Is possible. As described above, when the gyro is built in the remote controller 15, in the embodiment of FIG. 7, it is not necessary to configure the select button switch 51 so that it can be moved in eight directions, and the embodiment of FIG. 9 is performed. In this form, it is not necessary to provide the directional button switches 111 to 114. Similarly, the remote controller 35 can also have a built-in gyro.

Next, FIG. 10 shows an example of the electrical configuration of the master unit 1.

[0084] The television broadcast signal received by the antenna (not shown) is supplied to the tuner 121, and is detected and demodulated under the control of the CPU 129. The output of the tuner 121 is supplied to the QPSK (Quadrature Phase Shift Keying) demodulation circuit 122, and is demodulated by QPSK under the control of the CPU 129. The output of the QPSK demodulation circuit 122 is supplied to the error correction circuit 123, the error is detected and corrected under the control of the CPU 129, and the output is supplied to the demultiplexer 124.

[0085] Under the control of the CPU 129, the demultiplexer 124 descrambles the output of the error correction circuit 123 as necessary, and further extracts TS (Transport Stream) packets of a predetermined channel. Then, the demultiplexer 124 supplies the TS packet of image data (video data) to the MPEG (Moving Picture Experts Group) video decoder 125, and supplies the TS packet of audio data (audio data) to the MPEG audio decoder 126. To do. Further, the demultiplexer 124 supplies the TS packet included in the output of the error correction circuit 123 to the CPU 129 as needed. Further, the demultiplexer 124 receives the image data or audio data (including those in the form of TS packets) supplied from the CPU 129 and supplies them to the MPEG video decoder 125 or the MPEG audio decoder 126.

[0086] The MPEG video decoder 125 MPEG-decodes the TS packet of the image data supplied from the demultiplexer 124 and supplies it to the frame memory 127. The MPEG audio decoder 126 MPEG-decodes the TS packet of the audio data supplied from the demultiplexer 124. The L-channel and R-channel audio data obtained by decoding with the MPEG audio decoder 126 are supplied to the speaker units 12L and 12R, respectively.

[0087] The frame memory 127 temporarily stores the image data output by the MPEG video decoder 125 and supplies it to the NTSC (National Television System Committee) encoder 128. The NTSC encoder 128 converts the image data supplied from the frame memory 127 into NTSC system image data, and supplies the image data to the CRT 11 for display.

[0088] The CPU 129 executes various processes according to a program stored in an EEPROM (Electrically Erasable Programable Read Only Memory) 130 or a ROM (Read Only Memory) 131, whereby, for example, a tuner 121 or a QPSK demodulation. It controls circuit 122, error correction circuit 123, EEPROM 124, IEEE1394 interface 133, modem 136, signal processing unit 137, and unit drive unit 138. Further, the CPU 129 supplies the data supplied from the demultiplexer 124 to the IEEE1394 interface 133, and supplies the data supplied from the IEEE1394 interface 133 to the demultiplexer 124 and the signal processing unit 137. Further, the CPU 129 executes the processing corresponding to the command supplied from the front panel 134 and the IR receiver 135. In addition, the CPU 129 controls the modem 136 to access a server (not shown) through a telephone line and acquire an upgraded program and necessary data.

[0089] The EEPROM 130 stores data and programs that are desired to be retained even after the power is turned off. ROM131 stores, for example, an IPL (Initial Program Loader) program. The data and programs stored in the EEPROM 130 can be upgraded by overwriting them.

[0090] The RAM 132 temporarily stores data and programs necessary for the operation of the CPU 129.

[0091] The IEEE1394 interface 133 is a terminal panel 21 (IEEE1394 terminal 21 of the terminal panel 21).₁₁~ 21₃₃It is connected to (Fig. 3)) and functions as an interface for communication conforming to the IEEE1394 standard. As a result, the IEEE1394 interface 133 transmits the data supplied from the CPU 129 to the outside in accordance with the IEEE1394 standard, and receives the data transmitted from the outside in accordance with the IEEE1394 standard to the CPU129. Supply.

[0092] Although not shown in FIGS. 2 and 3, the front panel 134 is provided on a part of the front surface of the master unit 1. The front panel 134 has a part of the button switches provided on the remote controller 15 (FIGS. 7 and 9), and when the button switch of the front panel 134 is operated, it corresponds to the operation. The operation signal is supplied to the CPU 129. In this case, the CPU 129 performs processing corresponding to the operation signal from the front panel 134.

[0093] The IR receiver 135 receives (receives) infrared rays transmitted from the remote controller 15 in response to the operation of the remote controller 15. Further, the IR receiver 135 photoelectrically converts the received infrared rays and supplies the resulting signal to the CPU 129. In this case, the CPU 129 performs processing corresponding to the signal from the IR receiving unit 135, that is, processing corresponding to the operation of the remote controller 15.

[0094] The modem 136 controls communication via a telephone line, thereby transmitting data supplied from the CPU 129 via the telephone line and receiving data transmitted via the telephone line. And supply to CPU129.

[0095] The signal processing unit 137 is composed of DSP (Digital Signal Processor) 137A, EEPROM 137B, RAM 137C, etc., and under the control of the CPU 129, various digital data such as image data stored in the frame memory 127 Perform signal processing.

[0096] That is, the DSP 137A performs various signal processing according to the program stored in the EEPROM 137B, and if necessary, using the data stored in the EEPROM 137B. The EEPROM 137B stores programs and necessary data for the DSP 137A to perform various processes. RAM137C temporarily stores data and programs necessary for DSP137A to perform various processes.

[0097] The data and programs stored in the EEPROM 137B can be upgraded by overwriting them.

[0098] Here, the signal processing performed by the signal processing unit 137 includes, for example, decoding of closed caption data, superimposition of closed caption data on image data stored in frame memory 127, and storage in frame memory 127. Image data enlargement, noise removal, etc. In addition, the signal processing unit 137 also generates OSD data to be displayed on the OSD and superimposes it on the image data stored in the frame memory 127.

[0099] The unit drive unit 138 drives the speaker units 12L and 12R in accordance with the control of the CPU 129, whereby the direction of the directivity spindles of the speakers constituting the speaker units 12L and 12R is directed to a predetermined direction. Let me.

[0100] In the master unit 1 configured as described above, the image and sound as a television broadcast program are output (the image is displayed and the sound is output) as follows.

That is, the transport stream as the television broadcast signal received by the antenna is supplied to the demultiplexer 124 via the tuner 121, the QPSK demodulation circuit 122, and the error correction circuit 123. The demultiplexer 124 extracts the TS packet of a predetermined program from the transport stream, supplies the TS packet of image data to the MPEG video decoder 125, and supplies the TS packet of audio data to the MPEG audio decoder 126. ..

[0102] In the MPEG video data coder 125, the TS packet from the demultiplexer 124 is MPEG-decoded. Then, the resulting image data is supplied from the MPEG video decoder 125 to the CRT 11 via the frame memory 127 and the NTSC encoder 128 and displayed.

On the other hand, in the MPEG audio decoder 126, the TS packet from the demultiplexer 124 is MPEG-decoded. Then, the resulting audio data is supplied from the MPEG audio decoder 126 to the speaker units 12L and 12R and output.

Next, FIG. 11 shows an example of the electrical configuration of the slave unit 2.

[0105] Since the slave unit 2 is composed of the tuner 141 to the unit drive unit 158, which are similarly configured as the tuner 121 to the unit drive unit 138 of FIG. 10, the description thereof will be omitted.

[0106] Since the master unit 1 and the slave unit 2 have antenna terminals 22 and 42 independently as shown in FIGS. 3F and 5F, the televisions constituting the scalable TV system of FIG. 1 are configured. An antenna (cable from) can be connected to each of the master unit 1 and the slave unit 2 as receivers. However, when connecting an antenna to each of the master unit 1 and the slave unit 2, wiring may become complicated. Therefore, in the scalable TV system, an antenna is connected to any one of the television receivers constituting the scalable TV system, and the television broadcast signal received by the television receiver is, for example, IEEE1394. By communication, it is possible to distribute to other television receivers.

Next, in the present embodiment, the IEEE1394 terminal 21 of the terminal panel 21 of the master unit 1_ij(Fig. 3) and handset 2_ijIEEE1394 terminal 41 of terminal panel 41₁(Fig. 5) is electrically connected to the master unit 1 and the slave unit 2 by being connected by an IEEE1394 cable, whereby IEEE1394 communication (FIG. 5) is performed between the master unit 1 and the slave unit 2. (Communication conforming to the IEEE1394 standard) is performed, and various data etc. are exchanged.

Therefore, IEEE1394 communication will be described with reference to FIGS. 12 to 21.

[0109] IEEE1394 is one of the serial bus standards, and since IEEE1394 communication can perform isochronous transfer of data, it is suitable for transfer of data that needs to be reproduced in real time such as images and sounds. There is.

That is, between devices having an IEEE1394 interface (IEEE1394 devices), data is used in a transmission band of up to 100 μs (called a band, although it is time) in a cycle of 125 μs (microseconds). Isochronous transfer can be performed. Further, isochronous transfer can be performed on a plurality of channels as long as it is within the above-mentioned transmission band.

FIG. 12 shows the layer structure of the IEEE1394 communication protocol.

[0112] The IEEE1394 protocol has a three-layer structure consisting of a transaction layer, a link layer, and a physical layer. Each layer communicates with each other, and each layer communicates with Serial Bus Management. Furthermore, the transaction layer and the link layer also communicate with higher-level applications. There are four types of sent and received messages used for this communication: Request, Indication, Response, and Confirmation, and the arrows in FIG. 12 indicate this communication.

[0113] In addition, the communication with ".req" at the end of the name of the arrow represents the request, and ".ind" represents the instruction. Also, ".resp" represents a response and ".conf" represents a confirmation. For example, TR_CONT.req is a request communication sent from serial bus management to the transaction layer.

[0114] The transaction layer provides an asynchronous transmission service for data communication with other IEEE1394 devices (devices having an IEEE1394 interface) at the request of the application, and is a request required by ISO / IEC 13213. Implement a Request Response Protocol. That is, as a data transfer method based on the IEEE1394 standard, there is asynchronous transmission in addition to the isochronous transmission described above, and the transaction layer performs processing of asynchronous transmission. The data transmitted by asynchronous transmission is an IEEE 1394 device by three types of transactions: read transaction, write transaction, and lock transaction, which are the units of processing required for the transaction layer protocol. Is transmitted between.

[0115] The link layer performs processing such as data transmission service using Acknowledge, address processing, data error confirmation, and data framing. One packet transmission performed by the link layer is called a sub-action, and there are two types of sub-actions: Asynchronous Subaction and Isochronous Subaction.

[0116] The asynchronous sub-action is performed by designating a physical ID (Physical Identification) that identifies a node (a unit that can be accessed in IEEE1394) and an address in the node, and the node that receives the data returns an acknowledge. However, in the asynchronous broadcast subaction that sends data to all nodes in the IEEE1394 serial bus, the node that receives the data does not return the acknowledge.

[0117] On the other hand, in the isochronous subaction, data is transmitted by designating a channel number at a fixed cycle (125 μs as described above). In the isochronous sub-action, the acknowledge will not be returned.

The physical layer converts the logical symbols used in the link layer into electrical signals. Furthermore, the physical layer processes the request for arbitration (arbitration when nodes that perform IEEE1394 communication conflict) from the link layer, reconfigures the IEEE1394 serial bus due to bus reset, and performs the physical ID. Perform automatic allocation.

[0119] In serious bus management, realization of basic bus control functions and CSR (Control &amp; Status Register Architecture) of ISO / IEC 13212 are provided. Serious bus management includes Node Controllor, Isochronous Resource Manager, and Bus Manager. It has the function of Manager). The node controller controls the state of the node, the physical ID, and the like, and also controls the transaction layer, the link layer, and the physical layer. The isochronous resource manager provides the usage status of resources used for isochronous communication, and in order to perform isochronous communication, at least one of the devices connected to the IEEE1394 serial bus has an isochronous resource manager function. An IEEE1394 device is required. The bus manager is the most sophisticated of the functions, and aims to optimally use the IEEE1394 serial bus. The existence of the isochronous resource manager and the bus manager is optional.

[0120] IEEE1394 devices can be connected to either a node branch or a node daisy chain, but when an IEEE1394 device is newly connected, a bus reset is performed, and tree identification, root node, physical ID, etc. are performed. Isochronous resource manager, cycle master, bus manager, etc. are determined.

[0121] Here, in the tree identification, the parent-child relationship between the nodes as an IEEE1394 device is determined. In addition, the root node specifies a node that has acquired the right to use the IEEE1394 serial bus by arbitration. The physical ID is determined by forwarding a packet called a self-ID packet to each node. The self-ID packet contains information such as the data transfer rate of the node and whether or not the node can become an isochronous resource manager.

[0122] As described above, the isochronous resource manager is a node that provides a usage status of resources used for isochronous communication, and has a bandwidth register (BANDWIDTH_AVAILABLE register) and a channel number register (CHANNELS_AVAILABLE register), which will be described later. Furthermore, the isochronous resource manager also has a register indicating the physical ID of the node that becomes the bus manager. If the bus manager does not exist in the node as an IEEE1394 device connected by the IEEE1394 serial bus, the isochronous resource manager functions as a simple bus manager.

[0123] The cycle master transmits a cycle start packet on the IEEE1394 serial bus every 125 μs, which is the cycle of isochronous transmission. Therefore, the cycle master has a cycle time register (CYCLE_TIME register) for counting the cycle (125 μs). If the root node becomes the cycle master but the root node does not have the function as the cycle master, the bus manager changes the root node.

[0124] The bus manager manages the electric power on the IEEE1394 serial bus, changes the root node described above, and the like.

[0125] After the bus is reset, if the isochronous resource manager is determined as described above, the data can be transmitted via the IEEE1394 serial bus.

[0126] In isochronous transmission, which is one of the data transmission methods of IEEE1394, a transmission band and a transmission channel are secured, and then a packet in which data is arranged (isochronous packet) is transmitted.

That is, in isochronous transmission, the cycle master broadcasts a cycle start packet on the IEEE1394 serial bus at a cycle of 125 μs. When the cycle start packet is broadcast, the isochronous packet can be transmitted.

[0128] In order to perform isochronous transmission, it is necessary to rewrite the bandwidth register for securing the transmission band provided by the isochronous resource manager and the channel number register for securing the channel to declare the securing of resources for isochronous transmission. is there.

[0129] Here, the bandwidth register and the channel number register are assigned as one of the CSR (Control &amp; Status Register) described later, which has a 64-bit address space defined by ISO / IEC13213.

[0130] The bandwidth register is a 32-bit register, the upper 19 bits are reserved areas, and the lower 13 bits represent the transmission band (bw_remaining) currently available.

That is, the initial value of the bandwidth register is 00000000000000000001001100110011B (B indicates that the value before it is a binary number) (= 4915). This is due to the following reasons. That is, in IEEE1394, the time required for 32-bit transmission at 1572.864 Mbps (bit per second) is defined as 1, and the above-mentioned 125 μs corresponds to 00000000000000000001100000000000B (= 6144). However, IEEE1394 stipulates that the transmission band that can be used for isochronous transmission is 80% of 125 μs, which is one cycle. Therefore, the maximum transmission band that can be used for isochronous transmission is 100 μs, which is 00000000000000000001001100110011B (= 4915) as described above.

[0132] The remaining 25 μs transmission band excluding 100 μs, which is the maximum transmission band used in isochronous transmission, from 125 μs is used in asynchronous transmission. Asynchronous transmission is used when reading the stored values of the bandwidth register and the channel number register.

[0133] In order to start isochronous transmission, it is necessary to secure a transmission band for that purpose. That is, for example, when isochronous transmission is performed using a transmission band of 10 μs out of 125 μs, which is one cycle, it is necessary to secure the transmission band of 10 μs. This transmission band is secured by rewriting the value of the bandwidth register. That is, as described above, when the transmission band of 10 μs is secured, the value 492 corresponding to the 10 μs is subtracted from the value of the bandwidth register, and the subtracted value is set in the bandwidth register. Therefore, for example, when the value of the bandwidth register is now 4915 (when isochronous transmission is not performed at all) and the transmission band of 10 μs is secured, the value of the bandwidth register is the above-mentioned value. It is rewritten from 4915 to 4423 (= 00000000000000000001000101000111B), which is obtained by subtracting 492, which corresponds to 10 μs, from 4915.

[0134] If the value obtained by subtracting the transmission band to be secured (used) from the value of the bandwidth register is smaller than 0, the transmission band cannot be secured, and therefore, the bandwidth register The value cannot be rewritten, and isochronous transmission cannot be performed.

[0135] In order to perform isochronous transmission, in addition to securing the transmission band as described above, it is also necessary to secure a transmission channel. This transmission channel is secured by rewriting the channel number register.

[0136] The channel number register is a 64-bit register, and each bit corresponds to each channel. That is, the nth bit (nth bit from the least significant bit) indicates that the n-1th channel is in an unused state when its value is 1, and when it is 0, it means that the nth bit is n-. 1 Indicates that the channel is in use. Therefore, when no channel is used, the channel number register is 11111111111111111111111111111111111111111111111111111111111111111B. For example, when the first channel is secured, the channel number register is rewritten to 1111111111111111111111111111111111111111111111111111111111111111101B.

Since the channel number register is 64-bit as described above, it is possible to secure 64 channels of channels 0 to 63 at the maximum in isochronous transmission, but channel 63 is isochronous. Used when broadcasting packets.

[0138] As described above, since the isochronous transmission is performed after securing the transmission band and the transmission channel, it is possible to perform the data transmission with the guaranteed transmission rate, and as described above, the image and the sound are described. Especially suitable for data transmission that needs to be played back in real time.

Next, as described above, IEEE1394 communication complies with the CSR architecture having a 64-bit address space defined by ISO / IEC13213.

FIG. 13 shows the address space of the CSR architecture.

[0141] The upper 16 bits of CSR are node IDs indicating each node, and the remaining 48 bits are used to specify the address space given to each node. The upper 16 bits are further divided into 10 bits for the bus ID and 6 bits for the physical ID (node ID in a narrow sense). A value where all bits are 1 is used for a special purpose, so 1023 buses and 63 nodes can be specified.

[0142] The space specified by the upper 20 bits of the 256 terabyte address space specified by the lower 48 bits of the CSR is the initial register used for the 2048-byte CSR-specific register, the IEEE1394-specific register, and the like. It is divided into a space (Initial Register Space), a private space (Private Space), an initial memory space (Initial Memory Space), etc., and the space specified by the lower 28 bits is the space specified by the upper 20 bits. When it is a register space, it is used as a configuration ROM, an initial unit space used for a node-specific purpose, a plug control register (PCRs), and the like.

[0143] Here, FIG. 14 shows the offset addresses, names, and functions of the main CSRs.

[0144] In FIG. 14, the offset column indicates the offset address from the address FFFFF0000000h (h indicates that the value before it is a hexadecimal number) at which the initial register space starts. As described above, the bandwidth register having the offset 220h indicates the bandwidth that can be allocated to the isochronous communication, and only the value of the node operating as the isochronous resource manager is valid. That is, although each node has the CSR in FIG. 13, only the isochronous resource manager is valid for the bandwidth register. Therefore, the bandwidth register is substantially only possessed by the isochronous resource manager.

[0145] As described above, the channel number registers of offsets 224h to 228h correspond to each of the channel numbers 0 to 63, and if the bits are 0, the channel is already assigned. It shows that it is. The channel number register is also valid only for the node operating as the isochronous resource manager.

[0146] Returning to FIG. 13, the configuration ROM based on the general ROM format is arranged at the addresses 400h to 800h in the initial register space.

[0147] Here, FIG. 15 shows the general ROM format.

[0148] A node, which is a unit of access on IEEE1394, can have a plurality of units in the node that operate independently while using the address space in common. The unit directories can indicate the software version and location for this unit. The locations of the bus info block and the root directory are fixed, but the locations of the other blocks are specified by offset addresses.

[0149] Here, FIG. 16 shows the details of the bus info block, the root directory, and the unit directory.

[0150] In the Company ID in the bus info block, an ID number indicating the manufacturer of the device is stored. The Chip ID stores the unique ID of the device in the world that does not overlap with other devices. In addition, according to the IEC1833 standard, 00h is written to the first octet, A0h is written to the second octet, and 2Dh is written to the third octet of the unit spec ID (unit spec id) of the unit directory of the device that meets IEC1883. .. Furthermore, 01h is written to the first octet of the unit switch version, and 1 is written to the LSB (Least Significant Bit) of the third octet.

[0151] The node has a PCR (Plug Control Register) specified in IEC1883 at addresses 900h to 9FFh in the initial register space of FIG. This embodies the concept of a plug in order to logically form a signal path similar to an analog interface.

[0152] Here, FIG. 17 shows the structure of PCR.

[0153] PCR includes an oPCR (output Plug Control Resister) representing an output plug and an iPCR (input Plug Control Register) representing an input plug. In addition, PCR has registers oMPR (output Master Plug Register) and iMPR (input Master Plug Register) that indicate information on output plugs or input plugs unique to each device. The IEEE1394 device does not have a plurality of oMPRs and iMPRs, respectively, but it is possible to have a plurality of oPCRs and iPCRs corresponding to individual plugs depending on the capacity of the IEEE1394 device. The PCR shown in FIG. 17 has 31 oPCRs # 0 to # 30 and iPCR # 0 to # 30, respectively. The flow of isochronous data is controlled by manipulating the registers corresponding to these plugs.

FIG. 18 shows the configuration of oMPR, oPCR, iMPR, and iPCR.

FIG. 18A shows the configuration of oMPR, FIG. 18B shows the configuration of oPCR, FIG. 18C shows the configuration of iMPR, and FIG. 18D shows the configuration of iPCR.

The 2-bit data rate capability on the MSB side of the oMPR and iMPR stores a code indicating the maximum transmission rate of isochronous data that the device can transmit or receive. o MPR's broadcast channel base specifies the number of channels used for broadcast output.

[0157] The 5-bit number of output plugs on the LSB side of the oMPR stores a value indicating the number of output plugs possessed by the device, that is, the number of oPCRs. The 5-bit number of input plugs on the LSB side of the iMPR stores a value indicating the number of input plugs possessed by the device, that is, the number of iPCRs. The non-persistent extension field and persistent extension field are areas defined for future extensions.

MSB on-line for oPCR and iPCR indicates plug usage. That is, if the value is 1, the plug is ON-LINE, and if it is 0, it is OFF-LINE. The values of the broadcast connection counters for oPCR and iPCR represent the presence (1) or absence (0) of broadcast connections. The value of the point-to-point connection counter, which has a 6-bit width of oPCR and iPCR, represents the number of point-to-point connections that the plug has.

The value of the 6-bit wide channel number of oPCR and iPCR indicates the number of the isochronous channel to which the plug is connected. The 2-bit width data rate value of oPCR indicates the actual transmission rate of the isochronous data packet output from the plug. The code stored in the overhead ID, which has a 4-bit width of oPCR, indicates the bandwidth of the isochronous communication over. The value of the 10-bit wide payload of oPCR represents the maximum value of data contained in an isochronous packet that the plug can handle.

Next, for the IEEE1394 device that performs the above-mentioned IEEE1394 communication, an AV / C command set is defined as a command for controlling the IEEE1394 device. Therefore, also in this embodiment, the master unit 1 controls the slave unit 2 by using this AV / C command set. However, when controlling the slave unit 2 from the master unit 1, it is also possible to use a unique command system other than the AV / C command set.

[0161] Here, the AV / C command set will be briefly described.

FIG. 19 shows the data structure of an AV / C command set packet transmitted in asynchronous transfer mode.

The AV / C command set is a command set for controlling an AV (Audio Visual) device, and in a control system using the AV / C command set, AV / C command frames and response frames are provided between nodes. , FCP (Function Control Protocol) is used for communication. In order not to burden the bus and AV equipment, the response to the command is supposed to be done within 100ms.

As shown in FIG. 19, the data of the asynchronous packet is composed of 32 bits (= 1 quadlet) in the horizontal direction. The upper part of the figure shows the packet header part, and the lower part of the figure shows the data block. destination_ID indicates the destination.

[0165] CTS indicates the ID of the command set, and CTS = 0000 in the AV / C command set. ctype / response indicates the function classification of the command when the packet is a command, and indicates the processing result of the command when the packet is a response. Commands are roughly divided into (1) commands that control functions from the outside (CONTROL), (2) commands that inquire about the status from the outside (STATUS), and (3) commands that inquire from the outside whether or not control commands are supported (GENERAL INQUIRY). Four types are defined: (with or without opcode support) and SPECIFIC INQUIRY (with or without opcode and operands support)), and (4) a command (NOTIFY) that requests the outside to be notified of changes in state.

[0166] The response is returned according to the type of command. Responses to the CONTROL command include NOT INPLEMENTED, ACCEPTED, REJECTED, and INTERIM. Responses to the STATUS command include NOT INPLEMENTED, REJECTED, IN TRANSITION, and STABLE. Responses to the GENERAL INQUIRY and SPECIFIC INQUIRY commands include IMPLEMENTED (implemented) and NOT IMPLEMENTED. Responses to NOTIFY commands include NOT IMPLEMENTED, REJECTED, INTERIM, and CHANGED.

[0167] The subunit type is provided to specify the function in the device, and for example, a tape recorder / player, tuner, etc. are assigned. In order to discriminate when there are multiple subunits of the same type, addressing is performed with the subunit id (located after the subunit type) as the discriminant number. opcode represents a command and operand represents a command parameter. Additional operands are fields in which additional operands are placed. padding is a field in which dummy data is placed in order to set the packet length to a predetermined number of bits. In data CRC (Cyclic Redundancy Check), CRC used for error check at the time of data transmission is arranged.

Next, FIG. 20 shows a specific example of the AV / C command.

[0169] FIG. 20A shows a specific example of ctype / response. The upper part of the figure shows the command, and the lower part of the figure shows the response. 0000 is assigned CONTROL, 0001 is assigned STATUS, 0010 is assigned SPECIFIC INQUIRY, 0011 is assigned NOTIFY, and 0100 is assigned GENERAL INQUIRY. 0101 to 0111 are reserved for future specifications. Also, "1000" is NOT INPLEMENTED, "1001" is ACCEPTED, "1010" is REJECTED, "1011" is IN TRANSITION, "1100" is IMPLEMENTED / STABLE, "1101" is CHNGED, and "1111". INTERIM is assigned to. "1110" is reserved for future specifications.

[0170] FIG. 20B shows a specific example of the subunit type. 00000 is Video Monitor, 00011 is Disk recorder / Player, 00100 is Tape recorder / Player, 00101 is Tuner, 00111 is Video Camera, and 11100 is Vendor unique. , "11110" is assigned Subunit type extended to next byte. A unit is assigned to "11111", which is used when it is sent to the device itself, and examples thereof include turning the power on and off.

[0171] FIG. 20C shows a specific example of opcode. There is an opcode table for each subunit type, and here the opcode is shown when the subunit type is Tape recorder / Player. In addition, operand is defined for each opcode. Here, "00h" is VENDOR-DEPENDENT, "50h" is SEACH MODE, "51h" is TIMECODE, "52h" is ATN, "60h" is OPEN MIC, and "61h" is READ MIC. "62h" is assigned WRITE MIC, "C1h" is assigned LOAD MEDIUM, "C2h" is assigned RECORD, "C3h" is assigned PLAY, and "C4h" is assigned WIND.

[0172] FIG. 21 shows a specific example of an AV / C command and a response.

[0173] For example, when a playback instruction is given to a playback device as a target (consumer) (controlled side), the controller (control side) sends a command as shown in FIG. 21A to the target. This command uses the AV / C command set, so CTS = 0000. The ctype is "0000" because it uses a command (CONTROL) that controls the device from the outside (Fig. 20A). The subunit type is "00100" because it is a Tape recorder / Player (Fig. 20B). The id indicates the case of ID # 0, which is 000. The opcode is "C3h" which means playback (Fig. 20C). The operand is "75h" which means FORWARD. Then, when played back, the target returns a response as shown in FIG. 21B to the controller. Here, accepted, which means acceptance, is placed in the response, and the response is 1001 (see Fig. 20A). Except for the response, the rest is the same as in FIG. 21A, so the description is omitted.

[0174] In a scalable TV system, various controls are performed between the master unit 1 and the slave unit 2 using the AV / C command set as described above. However, in the present embodiment, among the controls performed between the master unit 1 and the slave unit 2, new commands and responses are defined for those that cannot be dealt with by the default commands and responses, and the new commands and responses are defined. Various controls are performed using various commands and responses.

The details of the above IEEE1394 communication and AV / C command set are described in "WHITE SERISE No.181 IEEE1394 Multimedia Interface" published by Trikeps Co., Ltd.

Next, in the signal processing unit 137 of the master unit 1 shown in FIG. 10 (the same applies to the signal processing unit 157 of the slave unit 2 shown in FIG. 11), the DSP 137A executes the program as described above. As a result, various types of digital signal processing are performed, and one of them is an image conversion process for converting image data from the first image data to the second image data.

[0177] Here, for example, if the first image data is low-resolution image data and the second image data is high-resolution image data, the image conversion process is a resolution improvement process for improving the resolution. It can be said. Further, for example, if the first image data is low S / N (Siginal / Noise) image data and the second image data is high S / N image data, the image conversion process will generate noise. It can be said that it is a noise removal process for removing. Further, for example, if the first image data is image data of a predetermined size and the second image data is image data in which the size of the first image data is increased or decreased, the image conversion process can be performed. It can be said to be a resizing process that resizes (enlarges or reduces) an image.

[0178] Therefore, according to the image conversion process, various processes can be realized depending on how the first and second image data are defined.

[0179] FIG. 22 shows an example of a functional configuration of the signal processing unit 137 that performs the image conversion processing as described above. The functional configuration of FIG. 22 is realized by the DSP 137A of the signal processing unit 137 executing the program stored in the EEPROM 137B.

In the signal processing unit 137 (FIG. 10), the image data stored in the frame memory 127 or the image data supplied from the CPU 129 is supplied to the tap extraction units 161 and 162 as the first image data. ..

[0181] The tap extraction unit 161 sequentially sets the pixels constituting the second image data as the pixels of interest, and further, the pixels constituting the first image data used for predicting the pixel value of the pixels of interest ( Some of the pixel values) are extracted as predictive taps.

[0182] Specifically, the tap extraction unit 161 may set a plurality of pixels (for example, the pixel of interest) that are spatially or temporally close to the pixel of the first image data corresponding to the pixel of interest. The corresponding first image data pixel and the pixel spatially adjacent to it) are extracted as predictive taps.

[0183] The tap extraction unit 162 uses some of the pixels constituting the first image data used for classifying the pixels of interest into one of several classes as class taps. Extract.

[0184] Here, for the sake of simplicity, it is assumed that the predictive tap and the class tap have the same tap structure. However, the predictive tap and the class tap can have different tap structures.

The prediction tap obtained by the tap extraction unit 161 is supplied to the prediction unit 165, and the class tap obtained by the tap extraction unit 162 is supplied to the class classification unit 163.

[0186] The class classification unit 163 classifies the pixel of interest based on the class tap from the tap extraction unit 162, and supplies the class code corresponding to the class obtained as a result to the coefficient memory 164.

[0187] Here, as a method of classifying, for example, ADRC (Adaptive Dynamic Range Coding) or the like can be adopted.

[0188] In the method using ADRC, the pixel values of the pixels constituting the class tap are subjected to ADRC processing, and the class of the pixel of interest is determined according to the ADRC code obtained as a result.

[0189] In the K-bit ADRC, for example, the maximum value MAX and the minimum value MIN of the pixel values of the pixels constituting the class tap are detected, and DR = MAX-MIN is set as the local dynamic range of the set. Based on this dynamic range DR, the pixel values that make up the class tap are requantized into K bits. That is, the minimum value MIN is subtracted from the pixel value of each pixel constituting the class tap, and the subtracted value is DR / 2.^KIs divided (quantized) by. Then, a bit string in which the pixel values of each pixel of the K bits constituting the class tap obtained as described above are arranged in a predetermined order is output as an ADRC code. Therefore, when the class tap is subjected to, for example, 1-bit ADRC processing, the pixel value of each pixel constituting the class tap is the average of the maximum value MAX and the minimum value MIN after the minimum value MIN is subtracted. It is divided by the value (truncated after the decimal point), which makes the pixel value of each pixel 1 bit (binarized). Then, a bit string in which the pixel values of the 1-bit are arranged in a predetermined order is output as an ADRC code.

[0190] Note that the class classification unit 163 can output, for example, the pattern of the level distribution of the pixel values of the pixels constituting the class tap as it is as a class code. However, in this case, assuming that the class tap is composed of the pixel values of N pixels and K bits are assigned to the pixel values of each pixel, the number in the case of the class code output by the class classification unit 163. Is (2^N)^KThe number is enormous, exponentially proportional to the number of bits K of the pixel value of the pixel.

Therefore, in the class classification unit 163, it is preferable to perform class classification by compressing the amount of information of the class tap by the above-mentioned ADRC processing, vector quantization, or the like.

[0192] The coefficient memory 164 stores the tap coefficient for each class supplied from the coefficient generation unit 166, and further, among the stored tap coefficients, the address corresponding to the class code supplied from the class classification unit 163. The tap coefficient stored in (the tap coefficient of the class represented by the class code supplied from the class classification unit 163) is supplied to the prediction unit 165.

[0193] Here, the tap coefficient corresponds to a coefficient that is multiplied by the input data in the so-called tap in the digital filter.

[0194] The prediction unit 165 acquires a prediction tap output by the tap extraction unit 161 and a tap coefficient output by the coefficient memory 164, and uses the prediction tap and the tap coefficient to predict the true value of the pixel of interest. Performs a predetermined prediction operation to obtain a value. As a result, the prediction unit 165 obtains (predicted value) the pixel value of the pixel of interest, that is, the pixel value of the pixel constituting the second image data and outputs the data.

[0195] The coefficient generation unit 166 generates a tap coefficient for each class based on the coefficient seed data stored in the coefficient seed memory 167 and the parameters stored in the parameter memory 168, and supplies the tap coefficient to the coefficient memory 164. And memorize it in the form of overwriting.

[0196] The coefficient seed memory 167 stores the coefficient seed data for each class obtained by learning the coefficient seed data described later. Here, the coefficient seed data is, so to speak, seed data that generates a tap coefficient.

[0197] The parameter memory 168 stores the parameters supplied from the CPU 129 (FIG. 10) by overwriting the parameters supplied by the user by operating the remote controller 15 or the like.

Next, the image conversion process by the signal processing unit 137 of FIG. 22 will be described with reference to the flowchart of FIG. 23.

[0199] In the tap extracting unit 161, Kakue constituting the second image data for the first image data input thereto containing the sequentially is a pixel of interest. Then, in step S1, the parameter memory 168 determines whether or not the parameter has been supplied from the CPU 129, and if it determines that the parameter has been supplied, the process proceeds to step S2, and the parameter memory 168 overwrites the supplied parameter. Remember and proceed to step S3.

[0200] If it is determined in step S1 that the parameter is not supplied from the CPU 129, step S2 is skipped and the process proceeds to step S3.

Therefore, in the parameter memory 168, when the parameter is supplied from the CPU 129, that is, for example, when the user operates the remote controller 15 and the parameter is input, or when the parameter is set in the CPU 129. Is updated by the input or set parameters.

[0202] In step S3, the coefficient generation unit 166 reads the coefficient type data for each class from the coefficient type memory 167, reads the parameters from the parameter memory 168, and taps each class based on the coefficient type data and the parameters. Find the coefficient. Then, the process proceeds to step S4, and the coefficient generation unit 166 supplies the tap coefficient for each class to the coefficient memory 164, stores it in a form of overwriting, and proceeds to step S5.

[0203] In step S5, the tap extraction units 161 and 162 extract the predicted tap and the class tap for the pixel of interest from the first image data supplied to the tap extraction units 161 and 162, respectively. Then, the prediction tap is supplied from the tap extraction unit 161 to the prediction unit 165, and the class tap is supplied from the tap extraction unit 162 to the classification unit 163.

[0204] The class classification unit 163 receives a class tap for the pixel of interest from the tap extraction unit 162, and in step S6, classifies the pixel of interest based on the class tap. Further, the class classification unit 163 outputs the class code representing the class of the pixel of interest obtained as a result of the class classification to the coefficient memory 164, and proceeds to step S7.

[0205] In step S7, the coefficient memory 164 reads and outputs the tap coefficient stored in the address corresponding to the class code supplied from the class classification unit 163. Further, in step S7, the prediction unit 165 acquires the tap coefficient output by the coefficient memory 164, and proceeds to step S8.

[0206] In step S8, the prediction unit 165 performs a predetermined prediction calculation using the prediction tap output by the tap extraction unit 161 and the tap coefficient acquired from the coefficient memory 164. As a result, the prediction unit 165 obtains the pixel value of the pixel of interest, writes it to the frame memory 127 (FIG. 10), and proceeds to step S9.

[0207] In step S9, the tap extraction unit 161 determines whether or not there is second image data that has not yet been set as the pixel of interest. If it is determined in step S9 that there is a second image data that has not yet been designated as a pixel of interest, one of the pixels of the second image data that has not yet been designated as a pixel of interest is newly designated as a pixel of interest. Then, the process returns to step S1, and the same process is repeated thereafter.

[0208] If it is determined in step S9 that there is no second image data that has not yet been regarded as the pixel of interest, the process ends.

[0209] In FIG. 23, the processes of steps S3 and S4 can be performed when the parameter memory 168 is overwritten with a new parameter, and can be skipped in other cases.

Next, the prediction calculation in the prediction unit 165 of FIG. 22, the generation of the tap coefficient in the coefficient generation unit 166, and the learning of the coefficient type data stored in the coefficient type memory 167 will be described.

[0211] Now, the high-quality image data (high-quality image data) is used as the second image data, and the high-quality image data is filtered by LPF (Low Pass Filter) to determine the image quality (resolution). Using the reduced low-quality image data (low-quality image data) as the first image data, a prediction tap is extracted from the low-quality image data, and the prediction tap and tap coefficient are used to determine the pixel value of the high-quality pixel. , Consider finding (predicting) by a predetermined prediction calculation.

[0212] Now, if, for example, a linear linear prediction calculation is adopted as a predetermined prediction calculation, the pixel value y of the high-quality pixel can be obtained by the following linear linear equation.

[0213] [Number 1]<img file="JP3693246B2_D0001.tif" /><img file="JP3693246B2_D0002.tif" />[0214] However, in equation (1), x_nRepresents the pixel value of the nth low-quality image data pixel (hereinafter, appropriately referred to as a low-quality pixel) that constitutes the prediction tap for the high-quality pixel y, and w_nRepresents the nth tap coefficient that is multiplied by (the pixel value of) the nth low image quality pixel. In equation (1), the prediction tap is N low-quality pixels x.₁, x₂, ..., x_NIt is supposed to be composed of.

[0215] Here, the pixel value y of the high-quality pixel can be obtained not by the linear linear equation shown in the equation (1) but by a higher-order equation of the second order or higher.

[0216] On the other hand, in the embodiment of FIG. 22, in the coefficient generating unit 166, the tap coefficient w_nIs generated from the coefficient seed data stored in the coefficient seed memory 167 and the parameters stored in the parameter memory 168, and the tap coefficient w in the coefficient generation unit 166_nIs generated, for example, by the following equation using coefficient species data and parameters.

[0217] [Number 2]<img file="JP3693246B2_D0003.tif" /><img file="JP3693246B2_D0004.tif" />[0218] However, in equation (2), β_{m, n}Is the nth tap coefficient w_nRepresents the m-th coefficient species data used to obtain, and z represents the parameter. In equation (2), the tap coefficient w_nHowever, M coefficient species data β_{n, 1}, β_{n, 2}, ..., β_{n, M}It has come to be obtained by using.

[0219] Here, the coefficient species data β_{m, n}And from the parameter z, the tap coefficient w_nThe formula for obtaining is not limited to the formula (2).

[0220] Now, the value z determined by the parameter z in the equation (2).^m-1, A new variable t_mIs introduced and defined by the following equation.

[0221] [Number 3]<img file="JP3693246B2_D0005.tif" /><img file="JP3693246B2_D0006.tif" />[0222] By substituting Eq. (3) into Eq. (2), the following equation is obtained.

[0223] [Number 4]<img file="JP3693246B2_D0007.tif" /><img file="JP3693246B2_D0008.tif" />[0224] According to the equation (4), the tap coefficient w_nIs the coefficient species data β_{n, m}And the variable t_mIt will be obtained by the linear linear equation of.

By the way, the true value of the pixel value of the high-quality pixel of the kth sample is now y._kAnd its true value y obtained by Eq. (1)_kPredicted value of y_kWhen expressed as', the prediction error e_kIs expressed by the following equation.

[0226] [Number 5]<img file="JP3693246B2_D0009.tif" /><img file="JP3693246B2_D0010.tif" />[0227] Now, the predicted value y of Eq. (5)_k'Is calculated according to equation (1), so y in equation (5)_kBy substituting'according to equation (1), the following equation is obtained.

[0228] [Number 6]<img file="JP3693246B2_D0011.tif" /><img file="JP3693246B2_D0012.tif" />However, in equation (6), x_{n, k}Represents the nth low-quality pixel constituting the prediction tap for the high-quality pixel of the kth sample.

[0230] w in equation (6)_nBy substituting Eq. (4) into, the following equation is obtained.

[0231] [Number 7]<img file="JP3693246B2_D0013.tif" /><img file="JP3693246B2_D0014.tif" />[0232] Prediction error of Eq. (7) e_kCoefficient species data β with 0_{n, m}Is optimal for predicting high-quality pixels, but for all high-quality pixels, such coefficient type data β_{n, m}Is generally difficult to find.

Therefore, the coefficient species data β_{n, m}As a norm indicating that is optimal, for example, if the least squares method is adopted, the optimal coefficient species data β_{n, m}Can be obtained by minimizing the sum E of the squared errors expressed by the following equation.

[0234] [Number 8]<img file="JP3693246B2_D0015.tif" /><img file="JP3693246B2_D0016.tif" />[0235] However, in the equation (8), K is a high-quality pixel y._kAnd its high quality pixel y_kLow quality pixels x that make up a predictive tap about_1,k, x_2,k, ..., x_{N, k}Represents the number of samples in the set with (the number of samples for learning).

[0236] As shown in Eq. (9), the minimum value (minimum value) of the sum E of the squared errors in Eq. (8) is the coefficient species data β._{n, m}Β with 0 as the partial derivative with_{n, m}Given by.

[0237] [Number 9]<img file="JP3693246B2_D0017.tif" /><img file="JP3693246B2_D0018.tif" />By substituting Eq. (6) into Eq. (9), the following equation is obtained.

[0239] [Number 10]<img file="JP3693246B2_D0019.tif" /><img file="JP3693246B2_D0020.tif" />[0240] Now, X_{i, p, j, q}And Y_{i, p}Is defined as shown in equations (11) and (12).

[0241] [Number 11]<img file="JP3693246B2_D0021.tif" /><img file="JP3693246B2_D0022.tif" />[Number 12]<img file="JP3693246B2_D0023.tif" /><img file="JP3693246B2_D0024.tif" />[0242] In this case, equation (10) is X._{i, p, j, q}And Y_{i, p}It can be expressed by the normal equation shown in Eq. (13) using.

[0243] [Number 13]<img file="JP3693246B2_D0025.tif" /><img file="JP3693246B2_D0026.tif" />[0244] The normal equation of Eq. (13) can be obtained by using, for example, a sweeping method (Gauss-Jordan elimination method), so that the coefficient species data β_{n, m}Can be solved.

[0245] In the signal processing unit 137 of FIG. 22, a large number of high-quality pixels y₁, y₂, ..., y_KIs used as teacher data to be a learning teacher, and each high-quality pixel y_kLow quality pixels x that make up a predictive tap about_1,k, x_2,k, ..., x_{N, k}Coefficient species data β obtained by learning to solve Eq. (13) as student data to be students of learning_{n, m}Is stored in the coefficient seed memory 167, and in the coefficient generation unit 166, the coefficient seed data β_{n, m}And, from the parameter z stored in the parameter memory 168, the tap coefficient w according to the equation (2)._nIs generated. Then, in the prediction unit 165, the tap coefficient w_nAnd low-quality pixels (pixels of the first image data) that make up the prediction tap for the pixel of interest as the high-quality pixel x_nBy calculating Eq. (1) using, the pixel value (predicted value close to) of the pixel of interest as a high-quality pixel can be obtained.

Next, FIG. 24 shows the coefficient species data β by solving the normal equation of Eq. (13)._{n, m}An example of a configuration of a learning device that performs learning to obtain is shown.

[0247] The coefficient type data β is provided in the learning device._{n, m}Image data for learning used for learning of is input. Here, as the learning image data, for example, high-quality image data having a high resolution can be used.

[0248] In the learning device, the learning image data is supplied to the teacher data generation unit 171 and the student data generation unit 173.

[0249] The teacher data generation unit 171 generates teacher data from the learning image data supplied to the teacher data generation unit 171 and supplies the teacher data to the teacher data storage unit 172. That is, here, the teacher data generation unit 171 supplies the high-quality image data as the learning image data to the teacher data storage unit 172 as the teacher data as it is.

[0250] The teacher data storage unit 172 stores high-quality image data as teacher data supplied from the teacher data generation unit 171.

[0251] The student data generation unit 173 generates student data from the learning image data and supplies the student data to the student data storage unit 174. That is, the student data generation unit 173 generates low-quality image data by filtering the high-quality image data as learning image data and lowering the resolution thereof, and uses the low-quality image data as the student data. Is supplied to the student data storage unit 174.

[0252] Here, in addition to the learning image data, some values in the range that the parameter z supplied to the parameter memory 168 of FIG. 22 can take are supplied to the student data generation unit 173 from the parameter generation unit 180. It is supposed to be done. That is, assuming that the value that the parameter z can take is a real number in the range of 0 to Z, for example, z = 0,1,2, ..., Z is generated in the student data generation unit 173. It is supplied from part 180.

[0253] The student data generation unit 173 filters the high-quality image data as the learning image data by the LPF of the cutoff frequency corresponding to the parameter z supplied therein, so that the low-quality image as the student data Generate data.

Therefore, in this case, in the student data generation unit 173, as shown in FIG. 25, with respect to the high-quality image data as the learning image data, Z + 1 types of low-quality images as student data having different resolutions. Data is generated.

[0255] Here, for example, as the value of the parameter z becomes larger, the high-quality image data is filtered by using the LPF having a higher cutoff frequency to generate the low-quality image data as the student data. .. Therefore, here. The lower the image quality image data corresponding to the parameter z with a larger value, the higher the resolution.

[0256] Further, in the present embodiment, in order to simplify the explanation, the student data generation unit 173 reduces the resolution of the high-quality image data in both the horizontal direction and the vertical direction by the amount corresponding to the parameter z. It is assumed that the low-quality image data is generated.

Returning to FIG. 24, the student data storage unit 174 stores the student data supplied from the student data generation unit 173.

[0258] The tap extraction unit 175 sequentially sets the pixels constituting the high-quality image data as the teacher data stored in the teacher data storage unit 172 as the attention teacher pixels, and the attention teacher pixels are referred to the student data storage unit 174. By extracting a predetermined number of low-quality pixels constituting the low-quality image data as student data stored in the data, a predicted tap having the same tap structure as that of the tap extraction unit 161 in FIG. 22 can be obtained. It is configured and supplied to the addition part 178.

[0259] The tap extraction unit 176 extracts a predetermined one of the low image quality pixels constituting the low image quality image data as the student data stored in the student data storage unit 174 with respect to the teacher pixel of interest. A class tap having the same tap structure as that of the tap extraction unit 162 of 22 is configured and supplied to the class classification unit 177.

Note that the tap extraction units 175 and 176 are supplied with the parameter z generated by the parameter generation unit 180, and the tap extraction units 175 and 176 are supplied with the parameters supplied from the parameter generation unit 180. Using the student data generated corresponding to z (here, low-quality image data as student data generated using the LPF of the cutoff frequency corresponding to the parameter z), predictive tap and class tap are performed respectively. Configure.

[0261] The class classification unit 177 performs the same class classification as the class classification unit 163 in FIG. 22 based on the class tap output by the tap extraction unit 176, and adds the class code corresponding to the class obtained as a result. Output to unit 178.

[0262] The addition unit 178 reads out the teacher pixel of interest from the teacher data storage unit 172, and the student data constituting the prediction tap composed of the teacher pixel of interest and the teacher pixel of interest supplied from the tap extraction unit 175. And the addition for the parameter z when the student data is generated is performed for each class code supplied from the class classification unit 177.

That is, in the addition unit 178, the teacher data y stored in the teacher data storage unit 172._k, Predictive tap x output by tap extractor 175_{i, k}(x_{j, k}), And the class code output by the classification unit 177, as well as the parameter z when the student data used to configure the prediction tap is generated are also supplied from the parameter generation unit 180. ..

[0264] Then, the addition unit 178 is a prediction tap (student data) x for each class corresponding to the class code supplied from the classification unit 177._{i, k}(x_{j, k}) And the parameter z, the component X defined in Eq. (11) in the matrix on the left side of Eq. (13)._{i, p, j, q}Multiply student data and parameter z to find_{i, k}t_px_{j, k}t_q) And the operation corresponding to summation (Σ). Note that t in equation (11)_pIs calculated from the parameter z according to equation (3). T in equation (11)_qIs the same.

[0265] Further, the addition unit 178 also has a prediction tap (student data) x for each class corresponding to the class code supplied from the classification unit 177._{i, k}, Teacher data y_k, And the component Y defined in equation (12) in the vector on the right-hand side of equation (13) using the parameter z._{i, p}Student data to find x_{i, k}, Teacher data y_k, And the multiplication of the parameter z (x)_{i, k}t_py_k) And the operation corresponding to summation (Σ). Note that t in equation (12)_pIs calculated from the parameter z according to equation (3).

That is, the addition unit 178 is the component X of the matrix on the left side in the equation (13) obtained for the teacher data that was previously set as the teacher pixel of interest._{i, p, j, q}And the vector component Y on the right side_{i, p}Is stored in its built-in memory (not shown), and the component X of the matrix_{i, p, j, q}Or vector component Y_{i, p}On the other hand, about the teacher data newly designated as the teacher pixel of interest, the teacher data y_k, Student data x_{i, k}(x_{j, k}), And the corresponding component x, calculated using the parameter z_{i, k}t_px_{j, k}t_qOr x_{i, k}t_py_k(Component X of equation (11))_{i, p, j, q}Or component Y of equation (12)_{i, p}Addition represented by the summation in).

[0267] Then, the addition unit 178 adds all the teacher data stored in the teacher data storage unit 172 as the attention teacher pixel for the parameter z of all the values of 0, 1, ..., Z as described above. When the normal equation shown in the equation (13) is established for each class by performing the inclusion, the normal equation is supplied to the coefficient type calculation unit 179.

[0268] The coefficient type calculation unit 179 solves the normal equation for each class supplied from the addition unit 178, so that the coefficient type data β for each class_{m, n}Is calculated and output.

[0269] The parameter generation unit 180 has z = 0,1,2, ... As described above, as some values in the range that the parameter z supplied to the parameter memory 168 of FIG. 22 can take. , Z is generated and supplied to the student data generation unit 173. Further, the parameter generation unit 180 also supplies the generated parameter z to the tap extraction units 175 and 176 and the addition unit 178.

Next, the process (learning process) of the learning device of FIG. 24 will be described with reference to the flowchart of FIG. 26.

[0271] First, in step S21, the teacher data generation unit 171 and the student data generation unit 173 generate and output teacher data and student data from the learning image data, respectively. That is, the teacher data generation unit 171 outputs the learning image data as it is as teacher data. Further, the student data generation unit 171 is supplied with the parameter z having Z + 1 values generated by the parameter generation unit 180, and the student data generation unit 171 supplies the learning image data to the Z from the parameter generation unit 180. By filtering by the LPF of the cutoff frequency corresponding to the parameter z of +1 value (0,1, ..., Z), the Z + 1 frame is used for the teacher data (learning image data) of each frame. Generate and output student data of.

The teacher data output by the teacher data generation unit 171 is supplied to and stored in the teacher data storage unit 172, and the student data output by the student data generation unit 173 is supplied to and stored in the student data storage unit 174. To.

[0273] After that, the process proceeds to step S22, and the parameter generation unit 180 sets the parameter z as an initial value, for example, 0, supplies it to the tap extraction units 175 and 176, and the addition unit 178, and supplies the parameter z to step S23. Proceed to. In step S23, the tap extraction unit 175 sets the teacher data stored in the teacher data storage unit 172 that has not yet been designated as the teacher pixel of interest as the teacher pixel of interest. Further, in step S23, the tap extraction unit 175 sets the student data for the parameter z output by the parameter generation unit 180 stored in the student data storage unit 174 for the teacher pixel of interest (to the teacher data which is the teacher data of interest). A predictive tap is constructed from (student data generated by filtering the corresponding learning image data by the LPF of the cutoff frequency corresponding to the parameter z) and supplied to the addition unit 178, and the tap extraction unit 176 Again, for the teacher pixel of interest, a class tap is constructed from the student data for the parameter z output by the parameter generation unit 180 stored in the student data storage unit 174 and supplied to the class classification unit 177.

Then, in step S24, the class classification unit 177 classifies the attention teacher pixel based on the class tap for the attention teacher pixel, and adds the class code corresponding to the class obtained as a result. Output to 178 and proceed to step S25.

[0275] In step S25, the addition unit 178 reads the attention teacher pixel from the teacher data storage unit 172, the attention teacher pixel, the prediction tap supplied from the tap extraction unit 175, and the parameter z output by the parameter generation unit 180. Is used, and the component x of the matrix on the left side in Eq. (13)_{i, K}t_px_{j, K}t_qAnd the vector component x on the right side_{i, K}t_py_KTo calculate. Further, the addition unit 178 obtains the matrix component and the vector component already obtained corresponding to the class code from the class classification unit 177 from the pixel of interest, the prediction tap, and the parameter z. Matrix component x_{i, K}t_px_{j, K}t_qAnd vector components x_{i, K}t_py_KAnd proceed to step S26.

[0276] In step S26, the parameter generation unit 180 determines whether or not the parameter z output by itself is equal to Z, which is the maximum value that can be taken. If it is determined in step S26 that the parameter z output by the parameter generator 180 is not equal to the maximum value Z (less than the maximum value Z), the process proceeds to step S27, and the parameter generator 180 is set to the parameter z. 1 is added, and the added value is output to the tap extraction units 175 and 176 and the addition unit 178 as a new parameter z. Then, the process returns to step S23, and the same process is repeated thereafter.

Further, if it is determined in step S26 that the parameter z is equal to the maximum value Z, the process proceeds to step S28, and the tap extraction unit 175 has not yet set the teacher data storage unit 172 as the teacher data of interest. Determines if is remembered. In step S28, when it is determined that the teacher data that has not been designated as the teacher pixel of interest is still stored in the teacher data storage unit 172, the tap extraction unit 175 newly adds the teacher data that has not been designated as the teacher pixel of interest. As a teacher pixel of interest, the process returns to step S22, and the same process is repeated thereafter.

[0278] Further, in step S28, when it is determined that the teacher data that is not the attention teacher pixel is not stored in the teacher data storage unit 172, the addition unit 178 is used for each class obtained by the processing so far. The matrix on the left side and the vector on the right side in the equation (13) of (13) are supplied to the coefficient type calculation unit 179, and the process proceeds to step S29.

[0279] In step S29, the coefficient type calculation unit 179 solves the normal equation for each class composed of the matrix on the left side and the vector on the right side in the equation (13) for each class supplied from the addition unit 178. , Coefficient type data β for each class_{m, n}Is output, and the process ends.

[0280] It should be noted that there may be a class in which the number of normal equations required for obtaining the coefficient type data cannot be obtained due to an insufficient number of image data for training or the like. For the class, the coefficient type calculation unit 179 outputs, for example, the default coefficient type data.

By the way, in the learning device of FIG. 24, as shown in FIG. 25, high-quality image data as learning image data is used as teacher data, and the high-quality image data corresponds to the parameter z. Using low-quality image data with degraded resolution as student data, the coefficient type data β is calculated by Eq. (4)._{m, n}And the variable t corresponding to the parameter z_mTap coefficient w represented by_n, And student data x_nFrom, the coefficient species data β that minimizes the sum of the squared errors of the predicted value y of the teacher data predicted by the linear linear equation of Eq. (1)._{m, n}I tried to learn to find directly, but the coefficient species data β_{m, n}Other learning can be performed, for example, as shown in FIG. 27.

That is, in the embodiment of FIG. 27, as in the case of the embodiment of FIG. 25, the high-quality image data as the learning image data is used as the teacher data, and the high-quality image data is used as the parameter. First of all, the tap coefficient w is used as student data for low-quality image data whose horizontal and vertical resolutions are reduced by filtering by LPF with a cutoff frequency corresponding to z._n, And student data x_nTap coefficient w that minimizes the sum of the squared errors of the predicted value y of the teacher data predicted by the linear linear prediction formula of Eq. (1) using_nIs obtained for each value of the parameter z (here, z = 0,1, ..., Z). Further, in the embodiment of FIG. 27, the obtained tap coefficient w_nIs the teacher data, and the parameter z is the student data, and the coefficient species data β is calculated by Eq. (4)._{m, n}, And the variable t corresponding to the parameter z, which is the student data._mTap coefficient w as teacher data predicted from_nCoefficient type data β that minimizes the sum of the squared errors of the predicted values of_{m, n}Learning is done.

[0283] Specifically, the sum E of the squared error of the predicted value y of the teacher data predicted by the linear linear prediction formula of the formula (1) represented by the above formula (8) is minimized (minimum). Tap coefficient w_nTaps its sum E_nThe partial derivative with is set to 0, and therefore the following equation must be satisfied.

[0284] [Number 14]<img file="JP3693246B2_D0027.tif" /><img file="JP3693246B2_D0028.tif" />Therefore, tap the above equation (6) with a coefficient w._nBy partially differentiating with, the following equation is obtained.

[0286] [Number 15]<img file="JP3693246B2_D0029.tif" /><img file="JP3693246B2_D0030.tif" />From equations (14) and (15), the following equation is obtained.

[0288] [Number 16]<img file="JP3693246B2_D0031.tif" /><img file="JP3693246B2_D0032.tif" />[0289] e in equation (16)_kBy substituting Eq. (6) into, Eq. (16) can be expressed by the normal equation shown in Eq. (17).

[0290] [Number 17]<img file="JP3693246B2_D0033.tif" /><img file="JP3693246B2_D0034.tif" />[0291] The normal equation of Eq. (17) has a tap coefficient w by using, for example, a sweeping method (Gauss-Jordan elimination method) as in the case of the normal equation of Eq. (13)._nCan be solved.

By solving the normal equation of Eq. (17), the optimum tap coefficient (here, the tap coefficient that minimizes the sum E of the squared errors) w_nIs calculated for each class and for each value of the parameter z (z = 0,1, ..., Z).

On the other hand, in the present embodiment, the coefficient species data β is calculated by the equation (4)._{m, n}And the variable t corresponding to the parameter z_mFrom, the tap coefficient can be obtained. Now, the tap coefficient obtained by this equation (4) is calculated as w._nIf it is expressed as', the optimum tap coefficient w expressed by the following equation (18)_nAnd the tap coefficient w obtained by equation (4)_n'Error with e_nCoefficient species data β with 0_{n, m}However, the optimum tap coefficient w_nBest for finding, but all tap coefficients w_nFor such coefficient species data β_{n, m}Is generally difficult to find.

[0294] [Number 18]<img file="JP3693246B2_D0035.tif" /><img file="JP3693246B2_D0036.tif" />[0295] The equation (18) can be transformed by the equation (4) as follows.

[0296] [Number 19]<img file="JP3693246B2_D0037.tif" /><img file="JP3693246B2_D0038.tif" />Therefore, the coefficient species data β_{n, m}As a norm indicating that is optimal, for example, if the least squares method is also adopted, the optimal coefficient species data β_{n, m}Can be obtained by minimizing the sum E of the squared errors expressed by the following equation.

[0298] [Number 20]<img file="JP3693246B2_D0039.tif" /><img file="JP3693246B2_D0040.tif" />[0299] As shown in the equation (21), the minimum value (minimum value) of the sum E of the squared errors of the equation (20) is the coefficient species data β._{n, m}Β with 0 as the partial derivative with_{n, m}Given by.

[0300] [Number 21]<img file="JP3693246B2_D0041.tif" /><img file="JP3693246B2_D0042.tif" />By substituting Eq. (19) into Eq. (21), the following equation is obtained.

[0302] [Number 22]<img file="JP3693246B2_D0043.tif" /><img file="JP3693246B2_D0044.tif" />[0303] Now, X_{i, j,}And Y_iIs defined as shown in equations (23) and (24).

[0304] [Number 23]<img file="JP3693246B2_D0045.tif" /><img file="JP3693246B2_D0046.tif" />[Number 24]<img file="JP3693246B2_D0047.tif" /><img file="JP3693246B2_D0048.tif" />[0305] In this case, equation (22) is X._{i, j}And Y_iIt can be expressed by the normal equation shown in Eq. (25) using.

[0306] [Number 25]<img file="JP3693246B2_D0049.tif" /><img file="JP3693246B2_D0050.tif" />[0307] For the normal equation of Eq. (25), for example, by using a sweeping method (Gauss-Jordan elimination method) or the like, the coefficient species data β_{n, m}Can be solved.

Next, FIG. 28 shows the coefficient species data β by solving the normal equation of Eq. (25)._{n, m}An example of a configuration of a learning device that performs learning to obtain is shown. In the drawings, the parts corresponding to the cases in FIG. 24 are designated by the same reference numerals, and the description thereof will be omitted as appropriate below.

[0309] The addition unit 190 is supplied with the class code for the teacher pixel of interest output by the classification unit 177 and the parameter z output by the parameter generation unit 180. Then, the addition unit 190 reads the attention teacher pixel from the teacher data storage unit 172, and the attention teacher pixel and the student data constituting the prediction tap composed of the attention teacher pixel supplied from the tap extraction unit 175. Is added for each class code supplied from the class classification unit 177 and for each value of the parameter z output by the parameter generation unit 180.

That is, in the addition unit 190, the teacher data y stored in the teacher data storage unit 172._k, Predictive tap x output by tap extractor 175_{n, k}, The class code output by the class classification unit 177, and the prediction tap x output by the parameter generation unit 180._{n, k}The parameter z when generating the student data used to construct is provided.

Then, the addition unit 190 predicts taps (student data) x for each class corresponding to the class code supplied from the class classification unit 177 and for each value of the parameter z output by the parameter generation unit 180._{n, k}Multiplying student data in the matrix on the left side of equation (17) using_{n, k}x_{n', k}) And the operation corresponding to summation (Σ).

[0312] Further, the addition unit 190 also predicts taps (student data) for each class corresponding to the class code supplied from the class classification unit 177 and for each value of the parameter z output by the parameter generation unit 180. ) x_{n, k}And teacher data y_kStudent data x in the vector on the right side of equation (17) using_{n, k}And teacher data y_kMultiplication (x_{n, k}y_k) And the operation corresponding to summation (Σ).

That is, the addition unit 190 is a component (Σx) of the matrix on the left side in the equation (17) obtained for the teacher data that was previously set as the teacher pixel of interest._{n, k}x_{n', k}) And the vector component on the right side (Σx)_{n, k}y_k) Is stored in its built-in memory (not shown), and the component of the matrix (Σx)_{n, k}x_{n', k}) Or vector component (Σx_{n, k}y_k), The teacher data y for the teacher data that was newly designated as the teacher pixel of interest._{k + 1}And student data x_{n, k + 1}Corresponding component x calculated using_{n, k + 1}x_{n', k + 1}Or x_{n, k + 1}y_{k + 1}Add (addition represented by the summation of equation (17)).

[0314] Then, the addition unit 190 uses all the teacher data stored in the teacher data storage unit 172 as the teacher pixels of interest, and performs the above addition for each class for each value of the parameter z. When the normal equation shown in equation (17) is established, the normal equation is supplied to the tap coefficient calculation unit 191.

[0315] The tap coefficient calculation unit 191 solves the normal equation for each value of the parameter z for each class supplied from the addition unit 190, thereby solving the optimum tap coefficient for each value of the parameter z for each class. w_nIs obtained and supplied to the addition part 192.

[0316] In the addition unit 192, the parameter z (corresponding to the variable t) is used for each class._m) And the optimum tap coefficient w_nPerform the addition for.

That is, the addition portion 192 is a variable t obtained from the parameter z by Eq. (3)._i(t_j), In the matrix on the left side of equation (25), component X defined by equation (23)_{i, j}Variable t corresponding to the parameter z for finding_i(t_j) Multiplication between each other (t_it_j) And the operation corresponding to summation (Σ) are performed for each class.

[0318] Here, component X_{i, j}Is determined only by the parameter z and has nothing to do with the class, so component X_{i, j}In practice, you don't have to do the calculation for each class, you only have to do it once.

[0319] Further, the addition unit 192 is a variable t obtained from the parameter z by Eq. (3)._iAnd the optimum tap coefficient w_nAnd, in the vector on the right-hand side of equation (25), the component Y defined in equation (24)_iVariable t corresponding to the parameter z for finding_iAnd the optimum tap coefficient w_nMultiplication (t_iw_n) And the operation corresponding to summation (Σ) are performed for each class.

[0320] The addition unit 192 is a component X represented by the equation (23) for each class._{i, j}And the component Y represented by equation (24)_iWhen the normal equation of Eq. (25) is established for each class by finding, the normal equation is supplied to the coefficient type calculation unit 193.

[0321] The coefficient type calculation unit 193 solves the normal equation of the equation (25) for each class supplied from the addition unit 192 to solve the coefficient type data β for each class._{m, n}Is calculated and output.

[0322] In the coefficient seed memory 167 in the signal processing unit 137 of FIG. 22, the coefficient seed data β for each class obtained as described above._{m, n}You can also try to remember.

Here, in the signal processing unit 137 of FIG. 22, for example, the optimum tap coefficient w for each value of the parameter z output by the tap coefficient calculation unit 191 of FIG. 28 without providing the coefficient type memory 167._nIs stored in the memory, and the optimum tap coefficient stored in the memory can be selected according to the parameter z stored in the parameter memory 168 and set in the coefficient memory 164. However, in this case, a large capacity memory is required in proportion to the number of possible values of the parameter z. On the other hand, when the coefficient type memory 167 is provided and the coefficient type data is stored, the storage capacity of the coefficient type memory 167 does not depend on the number of values that the parameter z can take, so that the coefficient type memory 167 As a result, a memory with a small capacity can be adopted. Furthermore, the coefficient species data β_{m, n}If you want to memorize the coefficient type data β_{m, n}And the value of the parameter z, the tap coefficient w by Eq. (2)_nIs generated, so to speak, a continuous tap coefficient w according to the value of the parameter z._nCan be obtained. As a result, the image quality of the high-quality image data output by the prediction unit 165 of FIG. 22 as the second image data can be smoothly adjusted steplessly.

[0324] In the above case, the learning image data is used as the teacher data corresponding to the second image data as it is, and the low-quality image data in which the resolution of the learning image data is deteriorated is used as the second image data. Since the coefficient seed data is learned as the student data corresponding to the image data of 1, the first image data is converted into the second image data whose resolution is improved as the coefficient seed data. It is possible to obtain a data that performs image conversion processing as resolution improvement processing.

[0325] Therefore, the EEPROM 137A of the signal processing unit 137 of the master unit 1 stores the coefficient type data, realizes the functional configuration of FIG. 22, and performs the image conversion process according to the flowchart of FIG. 23. By storing the program to be executed, the signal processing unit 137 can improve the horizontal resolution and the vertical resolution of the image data corresponding to the parameter z.

[0326] Here, various image conversion processes are performed as the coefficient type data depending on the method of selecting the student data corresponding to the first image data and the image data to be the teacher data corresponding to the second image data. You can get what you do.

[0327] That is, for example, high-quality image data is used as teacher data, and image data in which high-quality image data as teacher data is superposed with noise at a level corresponding to parameter z is used as student data for learning. By performing the processing, as the coefficient type data, the image conversion processing as the noise removal processing for converting the first image data into the second image data from which the noise contained therein is removed (reduced) is performed. Obtainable.

[0328] Further, for example, certain image data is used as teacher data, and the number of pixels of the image data as the teacher data is thinned out corresponding to the parameter z, and the image data is used as the student data or corresponds to the parameter z. The image data of the size to be used is used as the student data, and the image data obtained by thinning the pixels of the image data as the student data at a predetermined thinning rate is used as the teacher data, and the learning process is performed. It is possible to obtain a device that performs an image conversion process as a resizing process for converting the image data of 1 to the second image data that has been enlarged or reduced.

[0329] Therefore, by storing the coefficient seed data for noise removal processing and the coefficient seed data for resizing processing in the EEPROM 137A of the signal processing unit 137 of the master unit 1, the signal processing unit 137 has the parameter z. Corresponding to, noise removal and resizing (enlargement or reduction) of image data can be performed.

[0330] In the above case, the tap coefficient w_nAs shown in Eq. (2), β_1,nz⁰+ β_2,nz¹+ + Β_{M, n}z^M-1Defined by, and by this equation (2), the tap coefficient w for improving the horizontal and vertical resolutions corresponding to the parameter z._nI tried to find, but the tap coefficient w_nAs the horizontal resolution and vertical resolution, the independent parameters z_xAnd z_yIt is also possible to seek something that can be improved independently.

That is, the tap coefficient w_nInstead of Eq. (2), for example, the cubic equation β_1,nz_x⁰z_y⁰+ β_2,nz_x¹z_y⁰+ β_{3, n}z_x²z_y⁰+ β_4,nz_x³z_y⁰+ β_5,nz_x⁰z_y¹+ β_6,nz_x⁰z_y²+ β_7,nz_x⁰z_y³+ β_8,nz_x¹z_y¹+ β_9,nz_x²z_y¹+ β_10,nz_x¹z_y²The variable t defined in Eq. (3) as well as in_mInstead of equation (3), t₁= z_x⁰z_y⁰, t₂= z_x¹z_y⁰, t₃= z_x²z_y⁰, t₄= z_x³z_y⁰, t₅= z_x⁰z_y¹, t₆= z_x⁰z_y², t₇= z_x⁰z_y³, t₈= z_x¹z_y¹, t₉= z_x²z_y¹, t₁₀= z_x¹z_y²Defined in. In this case as well, the tap coefficient w_nCan finally be expressed by Eq. (4), and therefore in the learning device (FIGS. 24, 28), the parameter z_xAnd z_yCorresponding to, the image data in which the horizontal resolution and the vertical resolution of the teacher data are deteriorated is used as the student data for learning, and the coefficient type data β_{m, n}By finding the horizontal and vertical resolutions, the independent parameters z_xAnd z_yTap coefficient w to improve independently according to_nCan be sought.

[0332] In addition, for example, the parameter z corresponding to each of the horizontal resolution and the vertical resolution._xAnd z_yIn addition to, in addition, the parameter z corresponding to the resolution in the time direction_tBy introducing the horizontal resolution, vertical resolution, time resolution, independent parameters z_x, z_y, z_tTap coefficient w to improve independently according to_nCan be obtained.

[0333] Also, in the resizing process, as in the case of the resolution improving process, the tap coefficient w for resizing both the horizontal and vertical directions at the enlargement ratio (or reduction ratio) corresponding to the parameter z._nIn addition, the horizontal and vertical directions have parameters z, respectively._xAnd z_yTap coefficient w that resizes independently at the magnification corresponding to_nCan be obtained.

[0334] Further, in the learning device (FIGS. 24 and 28), the parameter z_xDegrading the horizontal and vertical resolutions of the teacher data corresponding to the parameter z_yThe image data with noise added to the teacher data corresponding to the above is used as the student data for learning, and the coefficient type data β_{m, n}By finding the parameter z_xIn addition to improving the horizontal and vertical resolutions corresponding to the parameter z_yTap coefficient w that removes noise corresponding to_nCan be sought.

Next, the function of performing the image conversion process as described above has not only the master unit 1 but also the slave unit 2.

Therefore, FIG. 29 shows a functional configuration example of the signal processing unit 157 of the slave unit 2 (FIG. 11) that performs the above-mentioned image conversion processing. The functional configuration of FIG. 29 is also realized by the DSP157A of the signal processing unit 157 executing the program stored in the EEPROM 157B, as in the case of the signal processing unit 137 of FIG.

[0337] In FIG. 29, the signal processing unit 157 of the slave unit 2 is configured in the same manner as the tap extraction unit 161 to the parameter memory 168 of the signal processing unit 137 (FIG. 22) of the master unit 1, respectively. Since it is composed of the parameter memory 208, the description thereof will be omitted.

It is possible to store the same coefficient type data in the signal processing unit 137 of the master unit 1 and the signal processing unit 157 of the slave unit 2, but in the present embodiment, at least It is assumed that some different coefficient species data are stored.

That is, for example, the signal processing unit 137 of the master unit 1 stores the coefficient seed data for resizing processing and the coefficient seed data for resolution improvement processing, and the signal processing unit 157 of the slave unit 2 stores the coefficient seed data. Supposes that the coefficient type data for the resizing process and the coefficient type data for the noise removal process are stored.

[0340] Alternatively, for example, the signal processing unit 137 of the master unit 1 stores coefficient seed data for resizing processing, and one slave unit 2_ijIn the signal processing unit 157 of the above, the coefficient type data for noise removal processing is stored, and the other one slave unit 2_pqIt is also possible to store the coefficient type data for the resolution improvement processing in the signal processing unit 157 of the above.

[0341] Here, it is possible to store the coefficient seed data for performing various processes in both the signal processing unit 137 of the master unit 1 and the signal processing unit 157 of the slave unit 2. In that case, it is necessary to store the coefficient seed data for performing the various processes in the EEPROM 137B and 157B. Therefore, the EEPROMs 137B and 157B, which have a large storage capacity, are required, and the cost of the master unit 1 and the slave unit 2 becomes large.

On the other hand, in the present embodiment, in the scalable TV system, the master unit 1 and the slave unit 2 are connected so as to enable IEEE1394 communication, so that the master unit 1 or the slave unit 2 is a slave unit. The coefficient type data possessed by 2 or the master unit 1 can be acquired by IEEE1394 communication. Therefore, for example, if the slave unit 2 that stores the coefficient type data for performing noise removal processing is connected to the master unit 1, the master unit 1 does not have the coefficient type data itself (storage). Even if it is not done), it is possible to acquire the coefficient type data from the slave unit 2 and perform the noise removal processing.

As a result, as the number of slave units 2 connected to the master unit 1 (as well as the slave unit 2) increases as the scalable TV system, the processes that can be executed, that is, the functions increase.

[0344] In this case, as the EEPROM 137B and 157B, those having a small storage capacity can be adopted, and the cost of the master unit 1 and the slave unit 2 can be reduced. Further, in this case, as the number of slave units 2 is increased in addition to the master unit 1, the functions of the scalable TV system as a whole increase, so that the user can be motivated to purchase the slave unit. Then, even when the user purchases a new slave unit, the slave unit 2 already owned by the user is necessary for the processing performed using the coefficient type data possessed by the slave unit 2, and the user owns the slave unit 2. It is possible to prevent the handset 2 that is being used from being discarded. As a result, it can contribute to the effective use of resources.

[0345] In the present embodiment, for example, in the slave unit 2, the signal processing unit 157 does not perform processing by the slave unit 2 alone. That is, when the signal processing unit 157 of the slave unit 2 receives a command from the master unit 1 via the CPU 149 (Fig. 11) by IEEE1394 communication, the signal processing unit 157 processes in response to the command. There is.

[0346] Therefore, the slave unit 2 has a function of displaying an image corresponding to the television broadcast signal received by the antenna on the CRT31 and outputting audio from the speaker units 32L and 32R (hereinafter, appropriately). , TV function) and a function provided by processing by the signal processing unit 157 (hereinafter, appropriately referred to as a special function), but only the TV function can be used by itself, and the special function is used. Can't. That is, in order to use the special function of the slave unit 2, the slave unit 2 needs to be connected to the master unit 1 to configure a scalable TV system.

Next, the process of the master unit 1 of FIG. 10 will be described with reference to the flowchart of FIG. 30.

[0348] First, in step S41, did the CPU 129 have an event that some device was connected to the terminal panel 21 or some command was supplied from the IEEE1394 interface 133 or the IR receiver 135? If it is determined whether or not any event has occurred, the process returns to step S41.

If it is determined in step S41 that an event for connecting a device to the terminal panel 21 has occurred, the process proceeds to step S42, and the CPU 129 performs the authentication process of FIG. 31 described later and returns to step S41.

[0350] Here, in order to determine whether or not a device is connected to the terminal panel 21, it is necessary to detect that the device is connected to the terminal panel 21, and this detection is, for example, as follows. Is done.

That is, the IEEE1394 terminal 21 provided on the terminal panel 21 (FIG. 3)._ijWhen a device is connected (via an IEEE1394 cable), its IEEE1394 terminal 21_ijThe terminal voltage of is changed. The IEEE1394 interface 133 reports the change in the terminal voltage to the CPU 129, and the CPU 129 newly connects the device to the terminal panel 21 by receiving the report of the change in the terminal voltage from the IEEE1394 interface 133. Detect that it has been done. The CPU 129 recognizes that the device has been disconnected from the terminal panel 21 by the same method, for example.

On the other hand, if it is determined in step S41 that an event to which some command is supplied from the IEEE1394 interface 133 or the IR receiver 135 has occurred, the process proceeds to step S43, and the master unit 1 processes the corresponding command. Is performed, and the process returns to step S41.

Next, with reference to the flowchart of FIG. 31, the authentication process performed by the master unit 1 in step S42 of FIG. 30 will be described.

[0354] In the authentication process of the master unit 1, the authentication as to whether or not the device newly connected to the terminal panel 21 (hereinafter, appropriately referred to as a connected device) is a legitimate IEEE1394 device and the IEEE1394 device are performed. Two types of authentication are performed, whether it is a master unit or a slave unit, a television receiver (scalable compatible unit).

That is, in the authentication process of the master unit 1, first of all, in step S51, the CPU 129 is an authentication request command that requests the connected devices to perform mutual authentication by controlling the IEEE1394 interface 133. Is sent, and the process proceeds to step S52.

[0356] In step S52, the CPU 129 determines whether or not the response corresponding to the authentication request command is returned from the connected device. If it is determined in step S52 that the response corresponding to the authentication request command has not been returned from the connected device, the process proceeds to step S53, and the CPU 129 determines whether the time has expired, that is, sends the authentication request command. It is determined whether or not a predetermined time has passed from.

[0357] In step S53, when it is determined that the time is over, that is, even if a predetermined time has elapsed since the authentication request command was transmitted to the connected device, the connected device issues the authentication request command. If the corresponding response is not returned, the process proceeds to step S54, assuming that the connected device is not a legitimate IEEE1394 device and authentication fails, and the operation mode is set to exchange any data with the connected device. Set to single mode, which is a mode that does not perform, and return.

[0358] Therefore, the master unit 1 does not subsequently exchange any data with a connected device that is not a legitimate IEEE1394 device, let alone IEEE1394 communication.

On the other hand, if it is determined in step S53 that the time is not over, the process returns to step S52, and the same process is repeated thereafter.

[0360] Then, in step S52, when it is determined that the response corresponding to the authentication request command is returned from the connected device, that is, the response from the connected device is received by the IEEE1394 interface 133 and supplied to the CPU 129. In this case, the process proceeds to step S55, and the CPU 129 generates a random number (pseudo-random number) R1 according to a predetermined algorithm and transmits it to the connected device via the IEEE1394 interface 133.

After that, the process proceeds to step S56, and the CPU 129 applies the random number R1 to the random number R1 transmitted in step S55 by a predetermined encryption algorithm (for example, DES (Data Encryption Standard)) or FEAL (Fast data Encipherment). It is determined whether or not the encrypted random number E'(R1) encrypted by the algorithm), the private key encryption method such as RC5) is transmitted from the connected device.

If it is determined in step S56 that the encrypted random number E'(R1) has not been transmitted from the connected device, the process proceeds to step S57, and the CPU 129 determines whether the time has expired, that is, the random number R1. It is determined whether or not a predetermined time has passed since the transmission.

[0363] When it is determined in step S57 that the time is over, that is, even if a predetermined time has elapsed since the random number R1 was transmitted to the connected device, the encrypted random number E'from the connected device. If (R1) is not transmitted, the process proceeds to step S54, and as described above, the CPU 129 sets the operation mode to the single mode and returns, assuming that the connected device is not a legitimate IEEE1394 device.

On the other hand, if it is determined in step S57 that the time is not over, the process returns to step S56, and the same process is repeated thereafter.

[0365] Then, in step S56, when it is determined that the encrypted random number E'(R1) has been transmitted from the connected device, that is, the encrypted random number E'(R1) from the connected device is transmitted by the IEEE 1394 interface 133. When received and supplied to the CPU 129, the process proceeds to step S58, where the CPU 129 encrypts the random number R1 generated in step S55 with a predetermined encryption algorithm, generates an encrypted random number E (R1), and steps S59. Proceed to.

[0366] In step S59, the CPU 129 determines whether or not the encrypted random number E'(R1) transmitted from the connected device is equal to the encrypted random number E (R1) generated by itself in step S58.

[0367] In step S59, when it is determined that the encrypted random numbers E'(R1) and E (R1) are not equal, that is, the encryption algorithm adopted in the connected device (encryption if necessary). If the encryption algorithm used in CPU129 is different from the encryption algorithm used in CPU129, the process proceeds to step S54, and CPU129 operates assuming that the connected device is not a legitimate IEEE1394 device, as described above. Set the mode to standalone mode and return.

Further, in step S59, when it is determined that the encrypted random numbers E'(R1) and E (R1) are equal, that is, the encryption algorithm adopted in the connected device is adopted in the CPU 129. If it is equal to the encryption algorithm used, the process proceeds to step S60, and the CPU 129 determines whether or not the random number R2 for the connected device to authenticate the master unit 1 has been transmitted from the connected device.

If it is determined in step S60 that the random number R2 has not been transmitted, the process proceeds to step S61, and the CPU 129 determines whether the time has expired, that is, for example, in step S59, the encrypted random number E'(R1). ) And E (R1) are determined to be equal, and then it is determined whether or not a predetermined time has elapsed.

[0370] If it is determined in step S61 that the time is over, that is, if the random number R2 is not transmitted from the connected device even after a considerable amount of time has elapsed, the process proceeds to step S54, and the CPU 129 describes the above. As described above, assuming that the connected device is not a legitimate IEEE1394 device, the operation mode is set to the single mode and the device returns.

On the other hand, if it is determined in step S61 that the time is not over, the process returns to step S60, and the same process is repeated thereafter.

[0372] Then, in step S60, when it is determined that the random number R2 has been transmitted from the connected device, that is, when the random number R2 from the connected device is received by the IEEE1394 interface 133 and supplied to the CPU 129, the step. Proceeding to S62, the CPU 129 encrypts the random number R2 with a predetermined encryption algorithm, generates an encrypted random number E (R1), and transmits the encrypted random number E (R1) to the connected device via the IEEE1394 interface 133.

[0373] Here, in step S60, when the random number R2 is transmitted from the connected device, the authentication that the connected device is a legitimate IEEE1394 device succeeds.

[0374] After that, the process proceeds to step S63, and the CPU 129 controls the IEEE1394 interface 133 to send its own device ID and function information together with the function information request command for requesting the device ID and function information of the connected device. Send to.

[0375] Here, the device ID is a unique ID that identifies the television receiver that serves as the master unit 1 and the slave unit 2.

[0376] Further, the function information is information related to its own function, for example, the type of the coefficient type data possessed by itself (what kind of image conversion processing can be performed by the coefficient type data), and a command received from the outside. Type (for example, which of the commands that control power on / off, volume adjustment, channel, brightness, sharpness, etc. is accepted from the outside), whether tube surface display (OSD display) is possible, and mute state It contains information such as whether it can be, whether it can go to sleep, and so on. Further, the functional information also includes information such as whether the user has a function as a master unit or a slave unit.

[0377] In the master unit 1, the device ID and the function information can be stored in, for example, the EEPROM 130 or the vendor_dependent_information of the configuration ROM shown in FIG.

After that, the process proceeds to step S64, and the CPU 129 waits for the connected device to transmit the device ID and the function information in response to the function information request command transmitted to the connected device in step S63. The device ID and the function information are received via the IEEE1394 interface 133, stored in the EEPROM 130, and the process proceeds to step S65.

[0379] In step S65, the CPU 129 determines whether or not the connected device is a slave unit by referring to the functional information stored in the EEPROM 130. If it is determined in step S65 that the connected device is a slave unit, that is, if the authentication that the connected device is a slave unit is successful, steps S66 and S67 are skipped and the process proceeds to step S68, and the CPU 129 , The operation mode is set to the special function command reception / provision mode for controlling the special function of the slave unit by providing the control command for causing the connected device which is the slave unit to perform the processing by the special function. Return.

On the other hand, if it is determined in step S65 that the connected device is not a slave unit, the process proceeds to step S66, and the CPU 129 refers to the functional information stored in the EEPROM 130 to determine whether the connected device is the master unit. Judge whether or not. If it is determined in step S66 that the connected device is the master unit, that is, if the authentication that the connected device is the master unit is successful, the process proceeds to step S67, and the CPU 129 is connected to the connected device that is the master unit. Perform parent-child adjustment processing between.

[0381] That is, in this case, since another master unit is connected to the master unit 1, there are two television receivers constituting the scalable TV system that function as the master unit. Will be done. In the present embodiment, there must be one master unit in the scalable TV system. Therefore, in step S67, either the master unit 1 or the master unit as a connecting device is used as the master unit. A parent-child adjustment process is performed to determine whether it functions as a television receiver.

[0382] Specifically, for example, the master unit that has configured the scalable TV system earlier, that is, in the present embodiment, the master unit 1 functions as a television receiver as the master unit. Is decided. The other master unit determined not to function as the master unit will function as the slave unit.

[0383] After the parent-child adjustment process is performed in step S67, the process proceeds to step S68, and the CPU 129 sets the operation mode to the special function command reception / provision mode and returns as described above.

On the other hand, when it is determined in step S66 that the connected device is not the master unit, that is, the connected device is neither the master unit nor the slave unit, and therefore the connected device is the master unit or the slave unit. If the authentication fails, the process proceeds to step S69, and the CPU 129 sets the operation mode to a control command for processing by a special function although the default AV / C command set can be exchanged with the connected device. Normal function that cannot be exchanged Set to command reception / provision mode and return.

That is, in this case, since the connected device is neither a master unit nor a slave unit, even if such a connected device is connected to the master unit 1, no special function is provided. However, in this case, since the connected device is a legitimate IEEE1394 device, the exchange of the default AV / C command set between the master unit 1 and the connected device is permitted. Therefore, in this case, the master unit 1 and the connected device can be controlled by the default AV / C command set from the other (or another IEEE1394 device connected to the master unit 1).

Next, the process of the slave unit 2 of FIG. 11 will be described with reference to the flowchart of FIG. 32.

[0387] First, in step S71, did the CPU 149 have an event that some device was connected to the terminal panel 41 or some command was supplied from the IEEE1394 interface 153 or the IR receiver 155? If it is determined whether or not any event has occurred, the process returns to step S71.

If it is determined in step S71 that an event for connecting a device to the terminal panel 41 has occurred, the process proceeds to step S72, and the CPU 149 performs the authentication process of FIG. 33, which will be described later, and returns to step S71.

[0389] Here, in order to determine whether or not a device is connected to the terminal panel 41, it is necessary to detect that the device is connected to the terminal panel 41, and this detection is performed, for example, in the step of FIG. It is performed in the same manner as described in S41.

On the other hand, if it is determined in step S71 that an event to which some command is supplied from the IEEE1394 interface 153 or the IR receiver 155 has occurred, the process proceeds to step S73, and the slave unit 2 processes the corresponding command. Is performed, and the process returns to step S71.

[0391] Next, the authentication process performed by the slave unit 2 in step S72 of FIG. 32 will be described with reference to the flowchart of FIG. 33.

[0392] In the authentication process of the slave unit 2, the authentication as to whether or not the device (connected device) newly connected to the terminal panel 41 is a legitimate IEEE1394 device and whether the IEEE1394 device is the master unit. There are two types of authentication that will be done.

That is, in the authentication process of the slave unit 2, first, in step S81, the CPU 149 determines whether or not an authentication request command requesting mutual authentication has been transmitted from the connected device, and transmits the authentication request command. If it is determined that the command has not been performed, the process proceeds to step S82.

[0394] In step S82, the CPU 149 determines whether or not the time has expired, that is, whether or not a predetermined time has elapsed since the start of the authentication process.

[0395] In step S82, when it is determined that the time is over, that is, when the authentication request command is not transmitted from the connected device even after a predetermined time has elapsed since the authentication process was started, the authentication request command is not transmitted. Proceeding to step S83, the CPU 149 changes the operation mode to the stand-alone mode, which is a mode in which no data is exchanged with the connected device, assuming that the connected device is not a legitimate IEEE1394 device and authentication fails. Set and return.

[0396] Therefore, like the master unit 1, the slave unit 2 does not exchange any data with a connected device that is not a legitimate IEEE1394 device, let alone IEEE1394 communication.

On the other hand, if it is determined in step S82 that the time is not over, the process returns to step S81, and the same processing is repeated thereafter.

[0398] Then, when it is determined in step S81 that the authentication request command has been transmitted from the connected device, that is, the authentication request command transmitted from the master unit 1 as the connected device in step S51 of FIG. 31 , When received by the IEEE1394 interface 153 and supplied to the CPU149, the process proceeds to step S84, and the CPU149 controls the IEEE1394 interface 153 to send a response to the authentication request command to the connected device.

[0399] Here, in the present embodiment, the processing of steps S51 to S53 in FIG. 31 is performed by the master unit 1, and the processing of steps S81, S82, and S84 in FIG. 33 is performed by the slave unit 2, respectively. However, it is also possible to have the slave unit 2 perform the processing of steps S51 to S53 in FIG. 31, and the master unit 1 perform the processing of steps S81, S82, and S84 in FIG. 33, respectively.

[0400] After that, the process proceeds to step S85, and the CPU 149 determines whether or not the random number R1 has been transmitted from the connected device, and if it determines that the random number R1 has not been transmitted, proceeds to step S86.

[0401] In step S86, the CPU 149 determines whether or not the time has expired, that is, whether or not a predetermined time has elapsed since the response to the authentication request command was transmitted in step S84.

[0402] In step S86, when it is determined that the time is over, that is, the random number R1 is not transmitted from the connected device even after a predetermined time has elapsed since the response to the authentication command was transmitted. , Step S83, as described above, the CPU149 sets the operation mode to the standalone mode, which is a mode in which no data is exchanged with the connected device, assuming that the connected device is not a legitimate IEEE1394 device. Set and return.

On the other hand, if it is determined in step S86 that the time is not over, the process returns to step S85, and the same processing is repeated thereafter.

[0404] Then, when it is determined in step S85 that the random number R1 has been transmitted from the connected device, that is, the random number R1 transmitted from the master unit 1 as the connected device in step S55 of FIG. 31 is the IEEE1394 interface. If it is received by 153 and supplied to CPU149, the process proceeds to step S87, and CPU149 encrypts the random number R1 with a predetermined encryption algorithm to generate an encrypted random number E'(R1). Further, in step S87, the CPU 149 transmits the encrypted random number E'(R1) to the connected device by controlling the IEEE1394 interface 153, and proceeds to step S89.

[0405] In step S89, the CPU 149 generates a random number (pseudo-random number) R2, controls the IEEE1394 interface 153 to transmit the random number R2 to the connected device, and proceeds to step S90.

[0406] In step S90, the CPU 149 determines whether or not the encrypted random number E (R2) obtained by encrypting the random number R2 generated by the master unit 1 as the connected device in step S62 of FIG. 31 has been transmitted from the connected device. To judge.

If it is determined in step S90 that the encrypted random number E (R2) has not been transmitted from the connected device, the process proceeds to step S91, and the CPU 149 determines whether the time has expired, that is, transmits the random number R2. Then, it is determined whether or not a predetermined time has passed.

[0408] When it is determined in step S91 that the time is over, that is, even if a predetermined time has elapsed since the random number R2 was transmitted to the connected device, the encrypted random number E ( If R2) is not transmitted, the process proceeds to step S83, and as described above, the CPU 149 sets the operation mode to the stand-alone mode and returns, assuming that the connected device is not a legitimate IEEE1394 device.

On the other hand, if it is determined in step S91 that the time is not over, the process returns to step S90, and the same processing is repeated thereafter.

[0410] Then, in step S90, when it is determined that the encrypted random number E (R2) has been transmitted from the connected device, that is, the encrypted random number E (R2) from the connected device is received by the IEEE1394 interface 153. , When supplied to CPU149, the process proceeds to step S92, where CPU149 encrypts the random number R2 generated in step S89 with a predetermined encryption algorithm, generates an encrypted random number E'(R2), and proceeds to step S93. move on.

[0411] In step S93, the CPU 149 determines whether or not the encrypted random number E (R2) transmitted from the connected device is equal to the encrypted random number E'(R2) generated by itself in step S92.

[0412] In step S93, when it is determined that the encrypted random numbers E (R2) and E'(R2) are not equal, that is, the encryption algorithm adopted in the connected device (encryption if necessary). If the encryption algorithm used in CPU149 is different from the encryption algorithm used in CPU149, proceed to step S83, and CPU149 operates assuming that the connected device is not a legitimate IEEE1394 device, as described above. Set the mode to standalone mode and return.

[0413] Further, in step S93, when it is determined that the encrypted random numbers E (R2) and E'(R2) are equal, that is, the encryption algorithm adopted in the connected device is adopted in the CPU 149. If the connection device is successfully authenticated as a legitimate IEEE1394 device, the process proceeds to step S94, and the CPU 149 has the master unit 1 as the connection device in FIG. 31. The device ID and the function information transmitted together with the function information request command in step S63 are received via the IEEE1394 interface 153 and stored in the EEPROM 150.

Then, in step S95, the CPU 149 connects its own device ID and function information in response to the function information request command from the connected device received in step S94 by controlling the IEEE1394 interface 153. Have the device transmit and proceed to step S96.

[0415] Here, in the slave unit 2, the function ID and the function information are stored in the EEPROM 150, the vendor_dependent_information of the configuration ROM shown in FIG. 15, and the like, as in the case of the master unit 1 described with reference to FIG. Can be kept.

[0416] In step S96, the CPU 149 determines whether or not the connected device is the master unit by referring to the functional information stored in the EEPROM 150. If it is determined in step S96 that the connected device is the master unit, that is, if the authentication that the connected device is the master unit is successful, the process proceeds to step S97, and the CPU 149 sets the operation mode to the master unit. It accepts a control command from a connected device and performs processing by a special function corresponding to the control command, that is, sets a special function command accept / provide mode for accepting a control command for controlling a special function, and returns.

[0417] Here, when the slave unit 2 is in the special function command reception / provision mode, it basically ignores the commands supplied from its own front panel 154 and IR receiver 155, and is received by the IEEE1394 interface 153. Various processes are performed according to the command from the master unit 1. That is, the slave unit 2 is in a state in which, for example, the channel, the volume, and the like are set only in response to the command from the master unit 1. Therefore, it can be said that the scalable TV system is a centralized control type system in which the master unit 1 controls all the slave units 2 constituting the scalable TV system.

[0418] The command can be transmitted from the master unit 1 (FIG. 10) to the slave unit 2 based on the input from the front panel 134 or the IR receiver 135, or the front panel of the slave unit 2. It is also possible to transfer the input to the 154 or the IR receiver 155 to the master unit 1 via the IEEE1394 interface 153, and to perform the input based on the input transferred from the slave unit 2 to the master unit 1 in this way.

On the other hand, if it is determined in step S96 that the connected device is not the master unit, that is, if the authentication that the connected device is the master unit fails, the process proceeds to step S98, and the CPU 149 sets the operation mode. The default AV / C command set can be exchanged with the connected device, but control commands for processing by special functions cannot be exchanged. Set to the normal function command reception / provision mode and return. ..

That is, in this case, since the connected device is not the master unit, even if such a connected device is connected to the slave unit 2, no special function is provided. Therefore, the special function is not provided only by connecting another handset to the handset 2. However, in this case, since the connected device is a legitimate IEEE1394 device, the exchange of the default AV / C command set between the slave unit 2 and the connected device is permitted. Therefore, in this case, the slave unit 2 and the connected devices (including other slave units) can be controlled from the other side by the default AV / C command set.

[0421] Next, in the master unit 1 and the slave unit 2, the authentication processes described with reference to FIGS. 31 and 33 are successful, respectively, and the master unit 1 and the slave unit 2 receive / provide the operation mode of the operation mode. A detailed example of the processing performed by the master unit 1 and the slave unit 2 in step S43 of FIG. 30 and step S73 of FIG. 32, respectively, will be described in order for the scalable TV system to provide a special function after the mode is set.

[0422] First, as described with reference to FIG. 10, the master unit 1 outputs an image and sound as a television broadcast program (the image is displayed and the sound is output), but the master unit 1 outputs the image and sound. In this way, when the image and sound are output, the user can turn on the guide button switch 63 (or the guide button switch 93 of the remote control 35 (Fig. 8)) of the remote control 15 (Fig. 7). When operated, the remote controller 15 emits infrared rays corresponding to the user's operation. This infrared ray is received by the IR receiver 135 of the master unit 1 (FIG. 10), and a command corresponding to the operation of the guide button switch 63 (hereinafter, appropriately referred to as a caption display command) is supplied to the CPU 129.

[0423] The infrared rays from the remote controller 15 are also received by the IR receiver 155 of the slave unit 2 (FIG. 11), but the infrared rays are ignored by the slave unit 2.

[0424] When the CPU 129 of the master unit 1 (FIG. 10) receives the caption display command as described above, the CPU 129 of the master unit 1 (FIG. 10) performs the closed caption processing of the master unit according to the flowchart of FIG. 34.

That is, the CPU 129 first determines in step S101 whether the transport stream supplied to the demultiplexer 124 contains closed caption data.

[0426] Here, when the closed caption data is included in the MPEG video stream, the closed caption data is arranged as, for example, MPEG user data (MPEG-2 user data) in the sequence layer. In this case, in step S101, the CPU 129 refers to the transport stream supplied to the demultiplexer 124 to determine whether the transport stream contains closed caption data.

[0427] In step S101, when it is determined that the closed caption data is not included in the transport stream, the subsequent processing is skipped and the closed caption processing is terminated.

[0428] If it is determined in step S101 that the transport stream contains closed caption data, the process proceeds to step S102, and the CPU 129 is stored in the EEPROM 130 of the slave unit constituting the scalable TV system. By referring to the function information and its own function information, the television receivers constituting the scalable TV system are searched for those having the coefficient type data for the closed caption. That is, as described above, the functional information includes the types of coefficient type data possessed by each television receiver constituting the scalable TV system, and in step S102, by referring to such functional information. , A television receiver with coefficient species data for closed captions is searched.

[0429] Here, the coefficient seed data for the closed caption is, for example, the image data of the closed caption displayed by the closed caption data as the teacher data, and the image data in which the resolution of the teacher data is deteriorated. Image data obtained by adding noise to the teacher data, or image data obtained by reducing the teacher data, etc., as student data, is coefficient type data obtained by learning, and the resolution of closed caption images is improved. , Means coefficient species data that is particularly suitable for removing or enlarging noise.

[0430] After that, the process proceeds to step S103, and the CPU 129 determines whether or not there is a television receiver having the coefficient type data dedicated to the closed caption based on the search result in step S102.

[0431] If it is determined in step S103 that there is no television receiver having coefficient seed data dedicated to the closed caption, the process proceeds to step S104, and the CPU 129 processes the signal so as to start the normal closed caption display. Controls part 137.

That is, the signal processing unit 137 also has a function as a so-called closed caption decoder, and the CPU 129 requests the demultiplexer 124 for the closed caption data in the transport stream, and in response to the request, The closed caption data supplied from the demultiplexer 124 is supplied to the signal processing unit 137. The signal processing unit 137 decodes the closed caption data from the CPU 129, and superimposes the closed caption obtained as a result on a predetermined position of the image data stored in the frame memory 127. As a result, the CRT 11 displays the image data in which the closed caption is superimposed on the image data decoded by the MPEG video decoder 125.

Therefore, in this case, in the CRT 11 of the master unit 1, the corresponding closed caption is superimposed on the image as the content, as in the case of a general television receiver having a built-in closed caption decoder. Is displayed.

[0434] When the display of the closed caption is started as described above, the process proceeds to step S105, and the CPU 129 is still in the transport stream supplied to the demultiplexer 124 as in the case of step S101. Determine if it contains closed captioning data to display.

[0435] If it is determined in step S105 that there is no closed caption data, step S106 is skipped and the process proceeds to step S107, and the CPU 129 controls the signal processing unit 137 to perform decoding processing of the closed caption data. Terminate and end the closed captioning process.

On the other hand, if it is determined in step S105 that the transport stream supplied to the demultiplexer 124 still contains closed caption data to be displayed, the process proceeds to step S106, and the CPU 129 is closed. It is determined whether or not a command for ending the caption display (hereinafter, appropriately referred to as a closed caption display off command) has been transmitted.

[0437] If it is determined in step S106 that the closed caption display off command has not been transmitted, the process returns to step S105, and the same process is repeated thereafter. That is, in this case, the display of the closed caption continues.

Further, in step S106, when it is determined that the closed caption display off command has been transmitted, that is, for example, the user uses the guide button switch 63 (or the remote controller 35 (FIG. 8)) of the remote controller 15 (FIG. 7). By operating to turn off the guide button switch 93) of, the remote controller 15 emits infrared rays corresponding to the closed caption display off command, and if it is received by the IR receiver 135, the process proceeds to step S107 and the CPU 129 Ends the closed caption data decoding process and ends the closed captioning process by controlling the signal processing unit 137 as described above.

On the other hand, if it is determined in step S103 that there is a slave unit as a television receiver having coefficient seed data dedicated to the closed caption (hereinafter, appropriately referred to as a slave unit having caption coefficient seed data), step S108. The CPU 129 selects a slave unit as a television receiver that constitutes a scalable TV system to display a closed caption.

That is, the CPU 129 is, for example, the slave unit 2 arranged to the left of the master unit 1.₂₃And the handset 2 placed below₃₂Etc. are selected as a slave unit for displaying closed captions (hereinafter, appropriately referred to as a slave unit for displaying captions). The master unit 1 is the slave unit 2._ijAs described above, the placement position of the master unit 1 as seen from the master unit 1 is recognized in advance, and as a result, the slave unit 2 arranged to the left of the master unit 1 is recognized.₂₃And the handset 2 placed below₃₂Handsets in each placement position such as_ijTo identify.

[0441] After that, the process proceeds to step S109, and the CPU 129 sends a command to the caption coefficient seed data holding slave unit via the IEEE1394 interface 133, thereby requesting the coefficient seed data dedicated to the closed caption.

[0442] Here, the CPU 129 identifies the slave unit that holds the caption coefficient type data by the device ID stored in the EEPROM 130 together with the function information, and requests the coefficient type data dedicated to the closed caption. (Hereinafter, appropriately referred to as a coefficient type data request command) is transmitted to the device ID. For commands other than the coefficient type data request command, the CPU 129 identifies the slave unit to which the command should be sent by the device ID, and sends the command to the device ID.

[0443] In step S109, the CPU 129 further waits for the coefficient seed data dedicated to the closed caption to be transmitted from the caption coefficient seed data holding slave unit that has received the coefficient seed data request command, and then waits for the coefficient seed data dedicated to the closed caption to be transmitted. The coefficient seed data is received via the IEEE1394 interface 133, thereby acquiring the coefficient seed data dedicated to the closed caption.

[0444] Here, when the coefficient seed data dedicated to the closed caption is stored in the EEPROM 137B of its own signal processing unit 137, the CPU 129 transfers the coefficient seed data dedicated to the closed caption from the EEPROM 137B in step S109. Obtained by reading.

[0445] Further, even when the coefficient seed data dedicated to the closed caption is not stored in any of the television receivers constituting the scalable TV system, for example, in a server for providing coefficient seed data (not shown). When the coefficient type data dedicated to the closed caption is provided, the CPU 129 controls the modem 136 to access the coefficient type data providing server, and the coefficient type data providing server controls the closed caption-dedicated coefficient. It is possible to get seed data.

[0446] The provision of the coefficient seed data by the coefficient seed data providing server is not limited to the coefficient seed data dedicated to the closed caption, but the coefficient seed data used for various processes (image conversion processing) described later. Can be done in the same way.

[0447] Further, the coefficient type data can be provided by the coefficient type data providing server either free of charge or for a fee.

[0448] When the CPU 129 acquires the coefficient type data dedicated to the closed caption in step S109, the CPU 129 proceeds to step S110 and commands the caption display slave unit to display the closed caption by controlling the IEEE1394 interface 133. Along with the closed caption display command, the coefficient type data dedicated to the closed caption is transmitted, and the process proceeds to step S111.

[0449] In step S111, the CPU 129 controls the IEEE1394 interface 133 to select the input to the IEEE1394 interface 153 (FIG. 11) for the caption display slave unit and display it on the CRT31. The external input selection command is transmitted, and the process proceeds to step S112.

[0450] In step S112, the CPU 129 starts transferring the closed caption data to the caption display slave unit.

That is, the CPU 129 requests the demultiplexer 124 for the closed caption data in the transport stream, and receives the closed caption data supplied from the demultiplexer 124 in response to the request. Further, the CPU 129 controls the IEEE1394 interface 133 to transfer the closed caption data received from the demultiplexer 124 to the caption display slave unit.

[0452] When the transfer of the closed caption data to the caption display slave unit is started as described above, the process proceeds to step S113, and the CPU 129 is supplied to the demultiplexer 124 as in the case of step S101. Determines if the transport stream you are using still contains closed captioning data to display.

[0453] If it is determined in step S113 that there is no closed caption data, step S114 is skipped and the process proceeds to step S115, and the CPU 129 ends the closed caption data transfer process by controlling the IEEE1394 interface 133. And end the closed captioning process.

On the other hand, if it is determined in step S113 that the transport stream supplied to the demultiplexer 124 still contains closed caption data to be displayed, the process proceeds to step S114, and the CPU 129 is closed. Determines if a command to end the caption display (closed caption display off command) has been sent.

[0455] If it is determined in step S114 that the closed caption display off command has not been transmitted, the process returns to step S113, and the same process is repeated thereafter. That is, in this case, the transfer of the closed caption data to the caption display slave unit is continued.

Further, in step S114, when it is determined that the closed caption display off command has been transmitted, that is, for example, the user uses the guide button switch 63 (or the remote controller 35 (FIG. 8)) of the remote controller 15 (FIG. 7). When the remote controller 15 emits infrared rays corresponding to the closed caption display off command and is received by the IR receiver 135, the process proceeds to step S115 and the CPU 129 By controlling the IEEE1394 interface 133, the closed caption data transfer process is terminated, and the closed caption process is terminated.

[0457] In the master unit 1, the closed caption processing shown in FIG. 34 is performed, whereby in step S110, the closed caption display command is transmitted, and the closed caption display command is the slave unit as the caption display slave unit. When it is received by 2 (when it is received by IEEE1394 interface 153 of slave unit 2 (Fig. 11) and supplied to CPU149), the slave unit 2 performs closed caption processing of the slave unit according to the flowchart of Fig. 35. It is said.

That is, in the slave unit 2 (FIG. 11) as the slave unit for caption display, first, in step S121, in step S110 of FIG. 34, the closed caption display command is transmitted from the master unit 1 together with the closed caption display command. The coefficient type data dedicated to the caption is received by the IEEE1394 interface 153, supplied to the CPU 149, and proceeds to step S122.

[0459] In step S122, the CPU 149 transfers the coefficient seed data dedicated to the closed caption to the signal processing unit 157, and sets (stores) it in the coefficient seed memory 207 (FIG. 29). At that time, the signal processing unit 157 saves the coefficient type data originally stored in the coefficient type memory 207 in the free area of the EEPROM 157B in advance.

[0460] Here, when the slave unit 2 as the caption display slave unit is also a slave unit having caption coefficient type data, that is, the coefficient memory 207 constituting the signal processing unit 157 of the slave unit 2 is originally closed. When the coefficient type data dedicated to the caption is stored, the processing of steps S121 and S122 described above and the processing of step S128 described later can be skipped.

After that, the process proceeds to step S123, and the CPU 149 determines whether or not the master unit 1 has received the external input selection command transmitted in step S111 of FIG. 34, and if it is determined that the command has not been received, the step S. Return to S123.

[0462] Further, when it is determined in step S123 that the external input selection command from the master unit 1 has been received, that is, in the IEEE1394 interface 153, the external input selection command from the master unit 1 is received and supplied to the CPU 149. If so, the process proceeds to step S124, the CPU 149 selects the closed caption data received by the IEEE1394 interface 153 and supplies the closed caption data to the signal processing unit 157, and the process proceeds to step S125.

[0463] In step S125, the CPU 149 determines whether or not the closed caption data that the master unit 1 starts transferring in step S112 of FIG. 34 has been transmitted.

[0464] In step S125, when it is determined that the closed caption data from the master unit 1 has been transmitted, that is, when the closed caption data from the master unit 1 is received and supplied to the CPU 149 in the IEEE1394 interface 153. , Step S126, the CPU 149 supplies the closed caption data to the signal processing unit 157, targets the closed caption data, and the closed caption set in the coefficient seed memory 207 (FIG. 29) in step S122. The image conversion process using the dedicated coefficient type data is performed.

That is, in this case, the signal processing unit 157 decodes the closed caption data from the CPU 149, and the image data of the closed caption obtained as a result is the coefficient seed data dedicated to the closed caption stored in the coefficient seed memory 207. By performing image conversion processing using the tap coefficient generated from, it is converted into high-quality closed caption image data.

[0466] The image data of this high-quality closed caption is supplied to and displayed on the CRT 31 via the frame memory 147 and the NTSC encoder 148 in step S127. Then, the process returns to step S125, and in step S125, the processes of steps S125 to S127 are repeated until it is determined that the closed caption data is not transmitted from the master unit 1.

[0467] Then, in step S125, when it is determined that the closed caption data is not transmitted from the master unit 1, that is, when the IEEE1394 interface 153 cannot receive the closed caption data, step S128 is performed. Proceeding, the signal processing unit 157 resets (overwrites) the original coefficient seed data saved in the EEPROM 157B in the coefficient seed memory 207 (FIG. 29), and ends the closed captioning process.

[0468] According to the closed caption processing of the master unit of FIG. 34 and the closed caption processing of the slave unit of FIG. 35, the television receivers constituting the scalable TV system have the coefficient species data dedicated to the closed caption. If there is no such thing, in the master unit 1, the closed caption image data is superimposed on the image data as a television broadcast program, as in the case of the conventional television receiver with a built-in closed caption decoder, and the CRT11 Is displayed in.

[0469] On the other hand, if some of the television receivers constituting the scalable TV system have coefficient seed data dedicated to the closed caption, the CRT 11 of the master unit 1 has an image as a television broadcast program. Only the data is displayed. Furthermore, in the CRT31 of the slave unit 2 as the slave unit for caption display, the closed caption image data corresponding to the image data displayed on the CRT11 of the master unit 1 is converted into high-quality image data. Is displayed.

[0470] Therefore, the user can view the image data as a television broadcast program without being disturbed by the image data of the closed caption. Further, the user can see the image data of high-quality closed captions.

[0471] Even if none of the television receivers constituting the scalable TV system has the coefficient type data dedicated to the closed caption, the image data of the closed caption is the image data of the television broadcast program. Separately from the image data, it is possible to display it on the CRT31 of the slave unit 2 as the slave unit for caption display. In this case, the user cannot see the image data of the high-quality closed caption, but can still see the image data as a television broadcast program without being hindered by the image data of the closed caption. ..

[0472] Further, in the above case, the image data of the closed caption is displayed only on one slave unit 2 as the slave unit for displaying the caption, but the image data of the closed caption is otherwise scalable. It is also possible to display on two or more slave units that make up the TV system. That is, for example, when closed caption data of a plurality of languages exists, it is possible to display the image data of the closed captions of each language on different slave units.

Next, the scalable TV system has, for example, a special function for enlarging a part of image data, and this special function is partially enlarged in the master unit 1 and the slave unit 2. It is realized by.

[0474] The instruction to perform the partial enlargement processing can be given from, for example, the menu screen.

That is, as described above, when the user operates the menu button switch 54 of the remote controller 15 (FIG. 7) (or the menu button switch 84 of the remote controller 35 (FIG. 8)), the CRT 11 (or the master unit 1) A menu screen is displayed on the CRT31) of the slave unit 2, and for example, an icon representing a partial enlargement process (hereinafter, appropriately referred to as a partial enlargement icon) is displayed on this menu screen. When the user clicks the partially enlarged icon by operating the remote controller 15, the partial enlargement process is started in each of the master unit 1 and the slave unit 2.

[0476] Therefore, first, a partial enlargement process of the master unit will be described with reference to the flowchart of FIG.

[0477] For example, suppose that a part of the enlargement icon is clicked while image data as a television broadcast program (hereinafter, appropriately referred to as program image data) is currently displayed on CRT11 of the master unit 1. First, in step S131, the CPU 129 is a slave unit that displays the entire program image data displayed on the CRT 11 of the master unit 1 instead of the master unit 1 (hereinafter, appropriately referred to as a slave unit for overall display). Is selected from the television receivers that make up the scalable TV system, and the process proceeds to step S132.

[0478] Here, it is possible to select only one of the slave units constituting the scalable TV system as the slave unit for overall display, or two or more (including all) slave units. It is also possible to make a choice.

[0479] In step S132, the CPU 129 communicates with the overall display slave unit by controlling the IEEE1394 interface 133, thereby determining whether or not the power of the overall display slave unit is turned on.

[0480] If it is determined in step S132 that the power of the overall display slave unit is not turned on, the process proceeds to step S133, and the CPU 129 controls the IEEE1394 interface 133 to become the overall display slave unit. On the other hand, a command for instructing the power to be turned on is transmitted, whereby the whole display slave unit is put into the power on state, and the process proceeds to step S134.

[0481] Further, in step S132, when it is determined that the power of the general display slave unit is turned on, step S133 is skipped and the process proceeds to step S134, and the CPU 129 controls the signal processing unit 137. By doing so, in the image displayed on the CRT11, a message requesting that the position to be enlarged (enlarged position) be specified (hereinafter referred to as an enlarged position specification request message) is displayed on the CRT11, for example, by OSD.

That is, in this case, the signal processing unit 137 generates OSD data of the enlarged position designation request message according to the control from the CPU 129, and superimposes the OSD data on the program image data stored in the frame memory 127. The program image data on which the OSD data of the enlarged position designation request message is superimposed is supplied from the frame memory 127 to the CRT 11 via the NTSC encoder 128, whereby the enlarged position designation is performed together with the program image data in the CRT 11. The request message is displayed on the OSD.

After that, the process proceeds to step S135, and the CPU 129 determines whether or not the user has specified the enlarged position in response to the enlarged position designation request message displayed in step S134, and has not specified the enlarged position. If it is determined, the process returns to step S135.

[0484] Further, in step S135, when it is determined that the user has specified the enlarged position, that is, the user operates the remote controller 15 (or the remote controller 35) to specify the position on the display screen of the CRT 11. As a result, when infrared rays corresponding to the position are received by the IR receiving unit 135 and supplied to the CPU 129, the CPU 129 recognizes the designated position as an enlarged position and proceeds to step S136.

[0485] In step S136, the CPU 129 controls the IEEE1394 interface 133 to select the input to the IEEE1394 interface 153 (FIG. 11) for the whole display slave unit and display it on the CRT31. Is sent as an external input selection command, and the process proceeds to step S137.

[0486] In step S137, the CPU 129 starts transferring the program image data to the entire display slave unit.

That is, the CPU 129 requests the demultiplexer 124 for the TS packet supplied to the MPEG video decoder 125 in the transport stream, and in response to the request, the CPU 129 requests the TS packet supplied from the demultiplexer 124. Receive. Further, the CPU 129 controls the IEEE1394 interface 133 to transfer the TS packet received from the demultiplexer 124 to the whole display slave unit. Therefore, the TS packet corresponding to the program image data displayed by the CRT 11 of the master unit 1 is transferred to the overall display slave unit, and the overall display slave unit is one of the slave units shown in FIG. 37, which will be described later. By performing the partial enlargement processing, the program image data corresponding to the TS packet is displayed. That is, the entire display slave unit displays the entire program image data displayed on the master unit 1.

[0488] In the CPU 129, the slave unit for overall display receives the program image data stored in the frame memory 127, that is, the image data after MPEG decoding, via the signal processing unit 137, instead of the TS packet. It is also possible to read and transfer. In this case, the program image data can be displayed on the whole display slave unit without MPEG decoding.

[0489] When the transfer of the TS packet to the slave unit for overall display is started as described above, the process proceeds to step S138, and the CPU 129 stores the TS packet in the frame memory 127 by controlling the signal processing unit 137. The expansion range is set to a predetermined range centered on the expansion position of the program image data, and the coefficient seed data for resizing processing set in the coefficient seed memory 167 (FIG. 22) is used. Have the image conversion process performed.

That is, in the present embodiment, at least the coefficient seed data for resizing processing is stored in the coefficient seed memory 167 constituting the signal processing unit 137 (FIG. 22) of the master unit 1, and the signal processing is performed. The unit 137 taps the expansion range as a predetermined range centered on the expansion position of the program image data stored in the frame memory 127, and is generated from the coefficient seed data for resizing processing stored in the coefficient seed memory 167. By performing image conversion processing using the coefficient, the program image data in the enlarged range is converted into image data enlarged (resized) at a predetermined enlargement ratio (hereinafter, appropriately referred to as partially enlarged image data).

[0491] In step S139, the partially enlarged image data is supplied to and displayed on the CRT 11 via the frame memory 127 and the NTSC encoder 128.

[0492] Therefore, in this case, the CRT 11 of the master unit 1 displays partially enlarged image data of the program image data in which a predetermined range (enlarged range) centered on the enlarged position specified by the user is enlarged.

[0493] Here, what kind of size range the enlargement range is to be set corresponds to, for example, the enlargement ratio.

That is, in performing the partial enlargement processing, for example, a default enlargement ratio (default enlargement ratio) is set in advance, and the CPU 129 sets a parameter corresponding to the default enlargement ratio to the signal processing unit 137 ( Set in the parameter memory 168 in Fig. 22). Therefore, the signal processing unit 137 performs resizing processing in which the program image data is enlarged by the default enlargement ratio.

[0495] On the other hand, the size of the image data that can be displayed on the CRT 11, that is, the size of the display screen is predetermined.

[0496] Therefore, the CPU 129 sets a range centered on the enlarged position, which is the size of the display screen of the CRT 11 when enlarged by the default enlargement ratio, as the enlarged range.

[0497] The enlargement ratio when performing the image conversion process in step S138 can be set by the user.

That is, for example, in the CPU 129, by controlling the signal processing unit 137, a lever (hereinafter, appropriately, appropriately) that can be operated by the remote controller 15 (or the remote controller 35) can specify the enlargement ratio in the CRT 11. It is possible to display (referred to as a lever for specifying the enlargement ratio) and specify the enlargement ratio according to the position of the lever for specifying the enlargement ratio.

[0499] In this case, when the user operates the remote controller 15 to move the position of the enlargement ratio designation lever, the parameter of the enlargement ratio corresponding to the position after the movement is set in the CPU 129 by the signal processing unit 137 (FIG. FIG. It is set in the parameter memory 168 of 22). Further, the CPU 129 sets the enlargement range centered on the enlargement position in the same manner as in the case of the default enlargement ratio described above in accordance with the enlargement ratio corresponding to the position of the lever for specifying the enlargement ratio, and targets the enlargement range. The signal processing unit 137 is instructed to perform the image conversion process (resizing process).

[0500] As described above, the CRT 11 will display partially enlarged image data obtained by enlarging the program image data in the enlarged range centered on the enlarged position by the enlargement ratio according to the operation of the remote controller 15 by the user. ..

[0501] The enlargement ratio designation lever can be displayed on the CRT 11 of the master unit 1 as an OSD, or can be displayed on a television receiver other than the master unit 1 that constitutes the scalable TV system. ..

[0502] After that, the process proceeds to step S140, and the CPU 129 determines whether or not a command for ending the display of the partially enlarged image data (hereinafter, appropriately referred to as a partially enlarged image data) has been transmitted.

[0503] If it is determined in step S140 that the partial expansion end command has not been transmitted, the process returns to step S133, and the same process is repeated thereafter.

[0504] Further, in step S140, when it is determined that the partial enlargement end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT 11. Furthermore, by re-clicking the partial enlargement icon on the menu screen, infrared rays of the partial enlargement end command, which is a command corresponding to the operation of the remote controller 15, are emitted from the remote controller 15 and are emitted from the IR receiver 135. When it is received and supplied to the CPU 129, the process proceeds to step S141, and the CPU 129 ends the transfer of the program image data to the entire display slave unit by controlling the IEEE1394 interface 133.

[0505] Then, the process proceeds to step S142, and the CPU 129 controls the signal processing unit 137 to stop the execution of the resizing process and end the partial enlargement process. As a result, the image will be displayed in normal size on CRT11.

Next, with reference to the flowchart of FIG. 37, a partial enlargement processing of the slave unit as the slave unit for overall display will be described.

[0507] In the slave unit 2 as the slave unit for overall display, first, in step S151, the CPU 149 determines whether or not the master unit 1 has received the external input selection command transmitted in step S136 of FIG. If it is determined and it is determined that the signal has not been received, the process returns to step S151.

[0508] Further, when it is determined in step S151 that the external input selection command from the master unit 1 has been received, that is, the external input selection command from the master unit 1 is received by the IEEE1394 interface 153 and supplied to the CPU 149. If so, the process proceeds to step S152, the CPU 149 selects the program image data received by the IEEE1394 interface 153, supplies the program image data to the MPEG video decoder 145 via the demultiplexer 144, and proceeds to step S153.

[0509] In step S153, the CPU 149 determines whether or not the program image data that the master unit 1 starts transferring in step S137 of FIG. 36 has been transmitted.

[0510] In step S153, when it is determined that the program image data from the master unit 1 has been transmitted, that is, when the program image data from the master unit 1 is received and supplied to the CPU 149 in the IEEE1394 interface 153. , Step S154 proceeds, and the CPU 149 displays the program image data on the CRT 31.

That is, in the present embodiment, in step S137 of FIG. 36, the transmission of the TS packet as the program image data is started from the master unit 1 to the slave unit 2 as the overall display slave unit. In this case, the CPU 149 supplies the TS packet from the master unit 1 received via the IEEE1394 interface 153 to the MPEG video decoder 145 via the demultiplexer 144. The MPEG video decoder 145 MPEG-decodes the TS packet, obtains program image data, and writes it to the frame memory 147. Then, the program image data written in the frame memory 147 is supplied to the CRT 31 and displayed via the NTSC encoder 148.

[0512] After that, the process returns to step S153, and in step S153, the processes of steps S153 and S154 are repeated until it is determined that the program image data is not transmitted from the master unit 1.

[0513] Further, in step S153, when it is determined that the program image data is not transmitted from the master unit 1 , that is, when the IEEE1394 interface 153 cannot receive the program image data, a part of the cases. End the enlargement process.

According to the partial enlargement processing of the master unit of FIG. 36 and the partial enlargement processing of the slave unit of FIG. 37, for example, as shown in FIG. 38A, the second row and the second column constituting the scalable TV system. When the program image data is displayed on the master unit 1 located at, and a certain position P in the program image data is specified as the enlarged position, a predetermined rectangle centered on the enlarged position P (center of gravity). (The range indicated by the dotted line in FIG. 38A) is set as the enlargement range, and as shown in FIG. 38B, the partially enlarged image data obtained by enlarging the program image data in the enlarged range is replaced with the program image data and the parent. Displayed on machine 1.

[0515] Further, for example, the slave unit 2 on the left side of the master unit 1₂₁However, when it is selected as the whole display handset, as shown in FIG. 38B, the handset 2 which is the whole display handset 2₂₁The entire program image data displayed on the master unit 1 is displayed.

[0516] Therefore, the user can see in detail the part of the program image data that he / she wants to see in the master unit 1. Further, the user can also see the entire program image data on the slave unit 2. Further, in the present embodiment, as described above, the user can set the enlargement ratio of the partially enlarged image data by operating the remote controller 15, so that the user can set the enlargement ratio of the partially enlarged image data in more detail. You can freely magnify the part you want to see to the extent you need it.

[0517] Here, in the signal processing unit 137 (FIG. 22) of the master unit 1 (FIG. 10), the tap coefficient w generated from the coefficient type data._nAccording to Eq. (1), the enlarged range of the program image data is partially converted to enlarged image data, but if you pay attention only to Eq. (1), this image conversion is seemingly just interpolation processing. Looks like. However, the tap coefficient w used in Eq. (1)_nThe coefficient seed data used to generate the is obtained by learning with the teacher data and the student data, as described with reference to FIGS. 24 to 28, and such coefficient seed data. Tap coefficient w generated from_nBy converting the image using, the components included in the teacher data can be reproduced. That is, regarding the coefficient seed data for resizing processing, the tap coefficient w in which the coefficient seed data is generated_nAccording to this, it is possible to reproduce the details that do not appear in the original image and enlarge the image. Therefore, the resizing process as the image conversion process by the equation (1) generated from the coefficient seed data obtained by learning is completely different from the image enlargement process by simple interpolation process.

[0518] In addition to using the tap coefficient obtained from the coefficient type data, the enlargement processing of the enlarged range of the program image data to the partially enlarged image data can also be performed by simple interpolation processing. However, in the case of simple interpolation processing, it is not possible to reproduce the details that the original program image data does not have, so the larger the enlargement ratio, the more the block-shaped angular part becomes conspicuous and the blurred image is obtained. Will be.

[0519] Further, in the present embodiment, the partially enlarged image data is displayed on the master unit 1 and the entire program image data is displayed on the slave unit 2, but the program image data is displayed on the master unit 1. It is also possible to display a partially enlarged image data on the slave unit 2 while keeping it.

[0520] Further, in the present embodiment, the partially enlarged image data is displayed on the master unit 1, and the entire program image data is displayed on the slave unit 2 as the slave unit for overall display. In addition to the display, it is also possible to display a partly enlarged image data or the entire program image data on another television receiver constituting the scalable TV system.

[0521] Further, the master unit 1 constituting the scalable TV system displays the entire program image data and is a slave unit 2 as another television receiver.₁₁~ 2₃₃It is possible to display partially enlarged image data having different enlargement ratios for each. In this case, all the partially enlarged image data having different enlargement ratios are generated by the signal processing unit 137 of the master unit 1, and the slave unit 2 as another television receiver 2₁₁~ 2₃₃It can be supplied to each, or a slave unit as another television receiver 2₁₁~ 2₃₃It is also possible for each signal processing unit 157 to generate partially enlarged image data of each enlargement ratio.

[0522] Further, in the present embodiment, it is assumed that the coefficient seed data for the resizing process is stored in the master unit 1, but the coefficient seed data for the resizing process is not stored in the master unit 1. In some cases, when another television receiver constituting the scalable TV system stores the coefficient seed data for resizing processing, the master unit 1 stores the coefficient seed data for resizing processing from the television receiver. It is possible to get it. In addition, as described above, the coefficient type data for the resizing process can also be acquired from the coefficient type data providing server.

[0523] In the above case, the resize process for enlarging the program image data is performed, but the resize process can also reduce the program image data.

[0524] Further, in the above case, the image data (program image data) as a television broadcast program is enlarged, but in the partial enlargement processing, an external device (optical disk device or magneto-optical device) is used. Image data input from a disk device, VTR, etc.) can be processed.

[0525] Further, in the partial enlargement processing, not only the horizontal and vertical directions of a part of the program image data are enlarged by the same enlargement ratio, but also the horizontal and vertical directions are enlarged by different enlargement ratios. It is also possible to expand.

[0526] Further, in the present embodiment, the partial enlargement processing is performed only for the enlargement range that can be displayed on the display screen of the CRT 11 in the program image data, but the partial enlargement processing is the program image. It is also possible to target the entire data. In this case, since it is not possible to display the entire enlarged image of the program image data on the CRT11, only a part of the enlarged image is displayed. For example, it is possible to change according to the operation of the remote controller 15.

[0527] Next, as described above, the scalable TV system has a special function of enlarging a part of the image data and enlarging the whole, and this special function is the master unit 1 and the slave unit. In 2, it is realized by performing the whole enlargement processing.

[0528] The instruction to perform the entire enlargement process can also be given from the menu screen in the same manner as the instruction to perform the partial enlargement process, for example.

That is, as described above, when the user operates the menu button switch 54 (or the menu button switch 84 of the remote controller 35 (FIG. 8)) of the remote controller 15 (FIG. 7), the CRT 11 (or or) of the master unit 1 is operated. A menu screen is displayed on the CRT31) of the slave unit 2, and for example, an icon indicating the overall enlargement process (hereinafter, appropriately referred to as an overall enlargement icon) is displayed on this menu screen. , When the user clicks the overall enlargement icon by operating the remote controller 15, the overall enlargement process is started in each of the master unit 1 and the slave unit 2.

[0530] Therefore, first, the overall enlargement processing of the master unit will be described with reference to the flowchart of FIG. 39.

[0531] For example, if the overall enlargement icon is clicked while the image data (program image data) as a television broadcast program is currently displayed on the CRT 11 of the master unit 1, first, step S161. In, the CPU 129 of the master unit 1 (FIG. 10) transmits the coefficient seed data for resizing processing to all the slave units constituting the scalable TV system by controlling the IEEE1394 interface 133.

[0532] Here, in the present embodiment, it is assumed that the coefficient seed memory 167 of the signal processing unit 137 (FIG. 22) of the master unit 1 stores the coefficient seed data for resizing processing, and the CPU 129 uses the CPU 129. In step S161, the coefficient seed data for the resizing process is read from the signal processing unit 137 and transmitted.

[0533] When the master unit 1 does not have the coefficient seed data for the resizing process, other television receivers constituting the scalable TV system, as in the case of the partial enlargement process described above. Among them, it is possible to acquire the coefficient seed data for resizing processing from the one that stores the coefficient seed data for resizing processing or the coefficient seed data providing server.

[0534] Then, in step S162, the CPU 129 is a slave unit 2 that constitutes a scalable TV system via the IEEE1394 interface 133.₁₁To₃₃The handset is turned off by communicating with 2_ijDetermine if there is.

[0535] In step S162, the handset 2 whose power is turned off._ijIf it is determined that there is, the process proceeds to step S163, and the CPU 129 sends a command instructing the power to be turned on via the IEEE1394 interface 133, whereby the handset 2 whose power is turned off 2_ijTurn on the power of and proceed to step S164.

[0536] Further, in step S162, the handset 2 whose power is turned off_ijIf it is determined that there is no such device, step S163 is skipped and the process proceeds to step S164, and the CPU 129 controls the IEEE1394 interface 133 to control all the slave units 2.₁₁~ 2₃₃The input to the IEEE1394 interface 153 (FIG. 11) is selected, an external input selection command instructing the CRT31 to display the command is transmitted, and the process proceeds to step S165.

[0537] In step S165, the CPU 129 initializes the enlargement ratio N for enlarging the program image data to 1 time, and further, the maximum enlargement ratio N._maxAnd set the expansion pitch α.

That is, in the overall enlargement processing, for example, in the scalable TV system composed of the 3 × 3 television receivers shown in FIG. 1A, the entire program image data displayed on the master unit 1 (full screen). ) Is centered on the master unit 1 and other television receivers, the slave unit 2₁₁~ 2₃₃Eventually, image data (hereinafter, appropriately referred to as overall enlarged image data) obtained by enlarging the entire program image data is applied to the entire 3 × 3 television receivers. Is displayed.

[0539] Therefore, the entire program image data displayed on the master unit 1 is finally enlarged to the overall enlarged image data having a size that can be displayed on the entire television receiver constituting the scalable TV system. However, the ratio of this final overall enlarged image data to the original program image data (program image data displayed on the master unit 1) is the maximum enlargement ratio N._maxIs set as. That is, in the present embodiment, the program image data displayed on the master unit 1 is enlarged to the overall enlarged image data displayed on the 3 × 3 television receivers. Therefore, for example, considering the diagonal line. , Since it will simply be magnified 3 times, the maximum magnification N_maxIs set to 3 times.

Further, in the overall enlargement processing, as described above, the entire program image data displayed on the master unit 1 is gradually enlarged. For example, this means that the program image data is gradually enlarged. Expand at rate N, and finally maximum expansion rate N_maxIt can be realized by expanding with. Therefore, in this case, the enlargement ratio N is changed from 1 time to the maximum enlargement ratio N._maxThe pitch that changes this enlargement ratio N is the expansion pitch α, for example, the maximum enlargement ratio N._maxA value is set by dividing -1 by a predetermined value of 1 or more (hereinafter, appropriately referred to as an enlargement count value).

[0541] Here, the enlargement count value can be set in advance in the master unit 1, or can be set by the user by operating the remote controller 15 (or the remote controller 35). When the enlargement count value is set to a small value, the program image data displayed on the master unit 1 is immediately enlarged to a large overall enlarged image data, and when the enlargement count value is set to a large value, the program image data is immediately enlarged. The program image data displayed on the master unit 1 is gradually enlarged into a large overall enlarged image data.

[0542] In step S165, as described above, the initialization of the enlargement ratio N and the maximum enlargement ratio N are performed._maxAfter the setting of the expansion pitch α is performed, the process proceeds to step S166, and the CPU 129 newly sets the enlargement ratio N to N + α times and proceeds to step S167.

[0543] The enlargement ratio N newly set in step S166 is the maximum enlargement ratio N._maxIf it exceeds, the CPU 129 will increase the magnification N to the maximum magnification N._maxSet to.

[0544] In step S167, the CPU 129 has an expansion range as a range to be expanded by the signal processing unit 137 in the program image data displayed on the master unit 1, and each slave unit 2._ijThe signal processing unit 157 of FIG. 11 finds the expansion range as the range to be expanded based on the enlargement ratio N set in step S165, and proceeds to step S168. In step S168, CPU129 is the CRT11 of the master unit 1 and each slave unit 2._ijIn each of the CRT 31s in (Fig. 11), the display range as the range for displaying the image data in which the enlarged range of the program image data is expanded (hereinafter, also referred to as a partially enlarged image data as appropriate) is set in step S165. Find it based on the magnification N and proceed to step S169.

[0545] Here, referring to FIG. 40, the expansion range of the master unit 1 (the range of program image data to be expanded by the signal processing unit 137 of the master unit 1), and the slave unit 2_ijExpansion range of (slave unit 2_ijThe range of program image data to be expanded by the signal processing unit 157 of_ijDisplay range of (slave unit 2_ijIn CRT31, slave unit 2_ijA calculation method for calculating a partially enlarged image data obtained by enlarging the program image data in the enlarged range) based on the enlargement ratio N will be described.

[0546] FIG. 40A shows the display screen of a scalable TV system composed of 3 × 3 television receivers.

That is, the display screens of the scalable TV system are the display screen of one master unit 1 by CRT11 and the display screens of eight slave units 2.₁₁~ 2₃₃It consists of a total of 9 CRT display screens, including the display screens of each CRT31. As mentioned above, the master unit 1 and the slave unit 2_ijThe display screen size of is the same.

[0548] In the overall enlargement processing, as described above, the entire program image data displayed on the master unit 1 is gradually enlarged. Now, the program image data displayed on the master unit 1 is image data Q. At the same time, the overall enlarged image data obtained by enlarging the image data Q at a predetermined enlargement ratio N is referred to as image data Q'.

[0549] In this case, if the vertical and horizontal lengths of the display screen size of the master unit 1 are represented by a and b, respectively, the vertical and horizontal lengths of the program image data Q are also a and b, respectively.

Further, since the overall enlarged image data Q'is obtained by multiplying the vertical and horizontal lengths of the program image data Q by N, the vertical and horizontal lengths are Na and Nb, respectively.

[0551] In the overall enlargement processing, as described above, the entire program image data Q displayed on the master unit 1 is enlarged with the master unit 1 as the center, and the overall enlarged image data Q'is displayed. 1 and handset 2₁₁~ 2₃₃When the entire enlarged image data Q'is displayed centering on the master unit 1, the master unit 1 has R in FIG. 40A on the display screen.₁It is necessary to display a part of the enlarged image data in the range indicated by, and the slave unit 2_ijNow, in Figure 40A, R_ijIt is necessary to display partially enlarged image data in the range indicated by.

Therefore, in step S168 of FIG. 39, the range R₁Is calculated as the display range of the master unit 1, and the range R_ijIs a handset 2_ijIt is calculated as the display range of.

[0553] That is, for the master unit 1, the entire display screen is the display range R.₁Is required as. In addition, the slave unit 2 on the upper left of the master unit 1₁₁The display range R is the range of ((Nb-b) / 2) x ((Na-a) / 2) on the lower right side of the display screen.₁₁Asked as, the slave unit 2 on the master unit 1₁₂The display range R is the range of horizontal x vertical b x ((Na-a) / 2) at the bottom of the display screen.₁₂Is required as. In addition, the slave unit 2 on the upper right of the master unit 1₁₃The display range R is the range of ((Nb-b) / 2) x ((Na-a) / 2) on the lower left side of the display screen.₁₃The left slave unit 2 of the master unit 1₂₁For, the range of horizontal x vertical on the right side of the display screen is ((Nb-b) / 2) x a is the display range R₂₁Is required as. Also, the slave unit to the right of the master unit 2₂₃For, the range of horizontal x vertical on the left side of the display screen is ((Nb-b) / 2) x a is the display screen R₂₃It is requested as, and the slave unit 2 at the lower left of the master unit 1₃₁The display range R is the range of ((Nb-b) / 2) x ((Na-a) / 2) on the upper right side of the display screen.₃₁Is required as. In addition, the slave unit 2 under the master unit 1₃₂The display range R is the range of horizontal x vertical b x ((Na-a) / 2) on the upper side of the display screen.₃₂Asked as, the slave unit at the bottom right of the master unit 2₃₃The display range R is the range of ((Nb-b) / 2) x ((Na-a) / 2) on the upper left side of the display screen.₃₃Is required as.

On the other hand, the display range R of the master unit 1 shown in FIG. 40A is now shown.₁And handset 2_ijDisplay range R_ijIs regarded as the range of the overall enlarged image data Q', the range R in the overall enlarged image data Q'₁And R_ijSince the image data of is partially enlarged image data obtained by enlarging a part of the original program image data Q, the display range R of the master unit 1₁And handset 2_ijDisplay range R_ijIt is necessary to obtain the enlarged range as the range of the program image data Q to be enlarged to the partially enlarged image data to be displayed in.

Therefore, in step S167, as shown in FIG. 40B, the range R of the entire enlarged image data Q'is shown.₁And R_ijThe range r of the original program image data Q corresponding to₁And r_ijHowever, the expansion range of the master unit 1 and the slave unit 2_ijEach is required as an expansion range of.

That is, in the present case, the overall enlarged image data Q'of the size of Nb × Na is the program image data Q of the size of b × a enlarged at a magnification of N times, and therefore the whole. Enlarged image data Q'range R₁And R_ijThe range r of the program image data Q, which corresponds to the range reduced to 1 / N₁And r_ijHowever, the expansion range of the master unit 1 and the slave unit 2_ijEach is required as an expansion range of.

[0557] Specifically, for the master unit 1, the range of horizontal × vertical of the central portion of the program image data Q is b / N × a / N is the expansion range r.₁Is required as. In addition, the slave unit 2 on the upper left of the master unit 1₁₁For, the range of horizontal x vertical on the upper left side of the program image data Q is ((bb / N) / 2) x ((aa / N) / 2) is the expansion range r₁₁Asked as, the slave unit 2 on the master unit 1₁₂The range of (b / N) x ((aa / N) / 2) on the upper side of the program image data Q is the expansion range r.₁₂Is required as. In addition, the slave unit 2 on the upper right of the master unit 1₁₃For, the range of horizontal x vertical on the upper right side of the program image data Q is ((bb / N) / 2) x ((aa / N) / 2) is the expansion range r₁₃The left slave unit 2 of the master unit 1₂₁For, the range of ((bb / N) / 2) x (a / N) on the left side of the program image data Q is the expansion range r.₂₁Is required as. Also, the slave unit to the right of the master unit 2₂₃For, the range of ((bb / N) / 2) x (a / N) on the right side of the program image data Q is the display screen R.₂₃It is requested as, and the slave unit 2 at the lower left of the master unit 1₃₁For, the range of horizontal x vertical on the lower left side of the program image data Q is ((bb / N) / 2) x ((aa / N) / 2) is the expansion range r₃₁Is required as. In addition, the slave unit 2 under the master unit 1₃₂For, the range of (b / N) x ((aa / N) / 2) below the program image data Q is the expansion range r.₃₂Asked as, the slave unit at the bottom right of the master unit 2₃₃For, the range of horizontal x vertical on the lower right side of the program image data Q is ((bb / N) / 2) x ((aa / N) / 2) is the expansion range r₃₃Is required as.

Returning to FIG. 39, in step S169, the CPU 129 controls the IEEE1394 interface 133 to perform a resizing process for enlarging the image data using the coefficient type data for the resizing process transmitted in step S161. Enlarged display command to instruct to display, along with program image data, enlargement factor N, enlargement range, and display range, each slave unit 2_ijSend to.

[0559] Here, the CPU 129 requests the demultiplexer 124 for the TS packet supplied to the MPEG video decoder 125 in the transport stream for the program image data, and in response to the request, the demultiplexer 124 Each slave unit 2 receives the TS packet supplied from_ijSend to.

[0560] In addition, the CPU 129 is a slave unit 2 for the enlarged range and the display range._ijThe enlarged range and display range required for the handset 2_ijSend to.

[0561] In CPU129, each slave unit 2_ijIt is also possible to read and transmit the program image data stored in the frame memory 127, that is, the image data after MPEG decoding, via the signal processing unit 137, instead of the TS packet. In this case, each slave unit 2_ijThen, it is not necessary to MPEG decode the program image data.

[0562] Further, in this way, the program image data after MPEG decoding is transferred to the slave unit 2_ijWhen sending to, not the entire program image data, but the slave unit 2 of the program image data_ijIt is possible to send only the required expansion range for.

After that, the process proceeds to step S170, and the CPU 129 sets the parameter z corresponding to the enlargement ratio N set in step S166 in the parameter memory 168 of the signal processing unit 137 (FIG. 22), and proceeds to step S171.

[0564] In step S171, the CPU 129 controls the signal processing unit 137 (FIG. 22), and is stored in the frame memory 127. In step S169, each slave unit 2_ijThe expansion range r obtained for the master unit 1 of the same program image data that was sent to₁Perform image conversion processing for (Fig. 40B).

That is, in the present embodiment, the coefficient seed memory 167 constituting the signal processing unit 137 (FIG. 22) of the master unit 1 stores the coefficient seed data for resizing processing, and the signal processing unit 137. Is the expansion range r of the program image data stored in the frame memory 127.₁Is image-converted using the coefficient seed data for resizing processing stored in the coefficient seed memory 167 and the tap coefficient generated from the parameter z stored in the parameter memory 168, thereby expanding the range r.₁Converts the program image data of the above into partially enlarged image data as image data enlarged (resized) at an enlargement ratio N.

[0566] Further, at this time, the CPU 129 has a display range R in which the partially enlarged image data is obtained for the master unit 1 in the display screen of the CRT 11.₁The signal processing unit 137 is controlled so that it is displayed at the position (FIG. 40A). That is, as a result, in the signal processing unit 137, the partially enlarged image data is displayed in the display range R obtained for the master unit 1 in the display screen of the CRT 11.₁The display position is adjusted so that it is displayed at the position (Fig. 40A).

[0567] Since the master unit 1 has been described with reference to FIG. 40, the display range R₁Since it matches the display screen size of CRT11, it is not actually necessary to adjust the display position of the partially enlarged image data.

[0568] In step S172, the signal processing unit 137 supplies the partially enlarged image data obtained in step S171 to the CRT 11 via the frame memory 127 and the NTSC encoder 128 for display.

Therefore, in this case, in the CRT 11 of the master unit 1, the expansion range r of the program image data is displayed on the entire display screen.₁Partially enlarged image data that is enlarged by the magnification N is displayed.

[0570] After that, the process proceeds to step S173, and the CPU 129 has an enlargement ratio N and a maximum enlargement ratio N._maxDetermine if it is less than. In step S173, the magnification N is the maximum magnification N._maxIf it is determined to be less than, the process proceeds to step S166, and the same process is repeated thereafter.

[0571] Further, in step S173, the enlargement ratio N is the maximum enlargement ratio N._maxIf it is determined that it is not less than, that is, in step S166, the enlargement ratio N is the maximum enlargement ratio N._maxIf set to, the process proceeds to step S174, where the CPU 129 controls the IEEE1394 interface 133 to issue a magnified display command, program image data, magnified ratio N, magnified range, and display range, as in step S169. , Each slave unit 2_ijAnd proceed to step S175.

[0572] In step S175, the CPU 129 controls the signal processing unit 137 (FIG. 22), and is stored in the frame memory 127. In step S174, each slave unit 2_ijThe expansion range r obtained for the master unit 1 of the same program image data that was sent to₁Perform image conversion processing for (Fig. 40B).

That is, in step S175, the signal processing unit 137 increases the range r of the program image data stored in the frame memory 127, as in the case of step S169.₁Is image-converted using the coefficient seed data for resizing processing stored in the coefficient seed memory 167 and the tap coefficient generated from the parameter z stored in the parameter memory 168, thereby expanding the range r.₁Converts the program image data of the above into partially enlarged image data as image data enlarged (resized) at an enlargement ratio N.

[0574] In step S176, the partially enlarged image data is supplied to and displayed on the CRT 11 via the frame memory 127 and the NTSC encoder 128, as in the case of step S172.

[0575] Here, in step S174, each slave unit 2_ijSince the enlargement ratio N, the enlargement range, and the display range transmitted to are obtained in the last steps S166 to S168, the enlargement ratio N is the maximum enlargement ratio N._maxIt has become. In addition, the magnifying range and display range have a maximum magnification of N._maxIt is the one required for the expansion rate N that is.

Therefore, in this case, the enlargement range and the display range of the master unit 1 are also the maximum enlargement ratio N._maxIt is the one required for the expansion rate N that is.

[0577] When the image conversion process of step S175 is performed, the maximum enlargement ratio N is stored in the parameter memory 168 of the signal processing unit 137 (FIG. 22) due to the process of step S170 that was finally performed._maxThe parameter z corresponding to is set.

[0578] From the above, in step S176, the maximum magnification N_maxThe expansion range r obtained for the expansion ratio N₁Program image data, maximum magnification N_maxThe partially enlarged image data obtained by enlarging with is the maximum enlargement ratio N._maxDisplay range R obtained for the magnification N₁(As described above, the master unit 1 is equivalent to the display screen of CRT11).

[0579] After that, the process proceeds to step S177, and the CPU 129 determines whether or not a command for ending the display of the overall enlarged image data (hereinafter, appropriately referred to as an overall enlarged image data) has been transmitted.

[0580] If it is determined in step S177 that the overall expansion end command has not been transmitted, the process returns to step S174, and the same process is repeated thereafter. Therefore, in this case, in the master unit 1, the maximum enlargement ratio N_maxThe display of the partially enlarged image data enlarged by is continued.

Further, in step S177, when it is determined that the overall enlargement end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT11. Further, by re-clicking the whole enlargement icon on the menu screen, infrared rays of the whole enlargement end command, which is a command corresponding to the operation of the remote controller 15, are emitted from the remote controller 15 and received by the IR receiver 135. When supplied to the CPU 129, the process proceeds to step S178, the image conversion process in the signal processing unit 137 ends, and the overall enlargement process of the master unit 1 ends. As a result, the program image data stored in the frame memory 127 is supplied to the CRT 11 as it is via the NTSC encoder 128, and the program image data is displayed in a normal size on the CRT 11.

Next, referring to the flowchart of FIG. 41, each slave unit 2 constituting the scalable TV system 2_ijThis section describes the overall enlargement processing of the slave unit performed in.

[0583] Handset 2_ijIn (FIG. 11), first, in step S181, the CPU 149 waits for the coefficient seed data for resizing processing to be transmitted from the master unit 1 in step S161 of FIG. Receive via IEEE1394 interface 153. Further, in step S181, the CPU 149 transfers the received coefficient seed data for resizing processing to the signal processing unit 157 (FIG. 29) and sets it in the coefficient seed memory 207. At that time, the signal processing unit 157 saves the coefficient type data originally stored in the coefficient type memory 207 in the free area of the EEPROM 157B in advance.

[0584] Here, the slave unit 2_ijWhen the coefficient type data for resizing processing is stored in the coefficient memory 207 constituting the signal processing unit 157 of the above, the processing of step S181 described above and step S188 described later can be skipped.

[0585] After that, the process proceeds to step S182, and the CPU 149 determines whether or not the master unit 1 has received the external input selection command transmitted in step S164 of FIG. 39, and if it is determined that the command has not been received, the step S. Return to S182.

[0586] Further, when it is determined in step S182 that the external input selection command from the master unit 1 has been received, that is, the external input selection command from the master unit 1 is received by the IEEE1394 interface 153 and supplied to the CPU 149. If so, the process proceeds to step S183, the CPU 149 selects the program image data received by the IEEE1394 interface 153, supplies the program image data to the MPEG video decoder 145 via the demultiplexer 144, and proceeds to step S184.

[0587] In step S184, the CPU 149 is subjected to the program image data, the enlargement ratio N, and the enlargement range r together with the enlargement display command from the master unit 1._ij, And display range R_ijDetermines if has been sent.

[0588] In step S184, from the master unit 1, along with the enlargement display command, the program image data, the enlargement ratio N, and the enlargement range r._ij, And display range R_ijIs determined to have been transmitted, that is, on the IEEE1394 interface 153, the enlarged display command from the master unit 1, the program image data, the enlargement ratio N, and the enlargement range r._ij, And display range R_ijIs received and supplied to the CPU 149, the CPU 149 follows the enlarged display command, and the enlarged range r of the program image data transmitted together with the enlarged display command r._ij, And the resulting partially enlarged image data is displayed in the display range R in the display screen of CRT31._ijPerforms the process of displaying on.

That is, in this case, the process proceeds from step S184 to S185, and the CPU 149 transfers the parameter z corresponding to the enlargement ratio N received by the CPU 149 together with the enlargement display command to the parameter memory 208 of the signal processing unit 157 (FIG. 29). Set and proceed to step S186.

[0590] In step S186, the CPU 149 controls the signal processing unit 157 (FIG. 29) to control the slave unit 2 of the program image data stored in the frame memory 147 together with the enlarged display command._ijDemanded expansion range r_ijPerform image conversion processing for (Fig. 40B).

That is, in the present embodiment, in steps S169 and S174 of FIG. 39, the master unit 1 to the slave unit 2_ijIn response to this, a TS packet as program image data is transmitted together with the enlarged display command. In this case, the CPU 149 sends the TS packet from the master unit 1 received via the IEEE1394 interface 153 via the demultiplexer 144. And supplies it to the MPEG video decoder 145. The MPEG video decoder 145 MPEG-decodes the TS packet, obtains program image data, and writes it to the frame memory 147.

[0592] On the other hand, the handset 2_ijThe coefficient type memory 207 constituting the signal processing unit 157 (FIG. 29) of the above is set with the coefficient type data for resizing processing in step S181, and the signal processing unit 157 is a program image stored in the frame memory 147. Data expansion range r_ijIs image-converted using the coefficient seed data for resizing processing stored in the coefficient seed memory 207 and the tap coefficient generated from the parameter z stored in the parameter memory 208, thereby expanding the range r._ijConverts the program image data of the above into partially enlarged image data as image data enlarged (resized) at an enlargement ratio N.

[0593] Further, at this time, the CPU149 is a slave unit in which the partially enlarged image data is displayed on the display screen of the CRT31._ijDemanded display range R_ijThe signal processing unit 157 is controlled so that it is displayed at the position (FIG. 40A). That is, as a result, in the signal processing unit 157, the partially enlarged image data is transferred to the slave unit 2 in the display screen of the CRT 31._ijDemanded display range R_ijThe display position is adjusted so that it is displayed at the position (Fig. 40A).

[0594] Specifically, for example, the slave unit 2₁₁Then, as shown in Fig. 40A, the partially enlarged image data is displayed in the lower right display range R of the CRT31 display screen.₁₁The display position of the partially enlarged image data is adjusted so that it is displayed in.

[0595] In this case, the slave unit 2₁₁Then, the display range R in the display screen of CRT31₁₁Image data in a range other than the above is set to, for example, a black level. Other handset 2_ijThe same applies to.

[0596] In step S187, the signal processing unit 157 supplies the partially enlarged image data obtained in step S186 to the CRT 31 via the frame memory 147 and the NTSC encoder 148 for display.

[0597] After that, the process returns to step S184, and the processes of steps S184 to S187 are repeated thereafter.

On the other hand, in step S184, from the master unit 1, the program image data, the enlargement ratio N, and the enlargement range r are performed together with the enlargement display command._ij, And display range R_ijIs not transmitted, that is, in the IEEE1394 interface 153, the enlarged display command, the program image data, the enlarged ratio N, and the enlarged range r._ij, And display range R_ijIf it becomes impossible to receive the data, the process proceeds to step S188, and the signal processing unit 157 resets the original coefficient seed data saved in the EEPROM 157B into the coefficient seed memory 207 (FIG. 29), and sets the slave unit. Ends the entire enlargement process of.

According to the overall enlargement processing of the master unit of FIG. 39 and the overall enlargement processing of the slave unit of FIG. 41, for example, as shown in FIG. 42A, the positions are located in the second row and the second column constituting the scalable TV system. When the program image data is displayed on the master unit 1, the entire program image data displayed on the master unit 1 is centered on the master unit 1 as shown in FIG. 42B.₁₁~ 2₃₃Finally, as shown in Fig. 42C, 3 × 3 master unit 1 and slave unit 2₁₁~ 2₃₃The entire enlarged image data, which is an enlarged version of the entire program image data, is displayed in the entire area.

[0600] Therefore, the user can see the entire enlarged image data obtained by enlarging the entire program image data in detail.

[0601] However, in the scalable TV system, since there is actually a housing of the television receivers constituting the scalable TV system, the adjacent portion of the adjacent television receivers is a housing. Yes, no image is displayed in that part. That is, in FIG. 42, in order to simplify the figure, the housing portion existing between the adjacent television receivers is omitted. However, in reality, there is a housing between adjacent television receivers, and therefore, the overall enlarged image data is not displayed in the housing portion of the television receiver, although it is small. There is a problem that it is separated, so to speak.

[0602] However, in human vision, even if a part of the image has a minute width line that hinders the viewing, the part of the image hidden by the line is interpolated from the surrounding image. Since there is an action, the above-mentioned problem does not become a big problem in viewing the whole enlarged image data.

[0603] In the whole enlargement processing as well, as in the case described in the partial enlargement processing, the image conversion processing is performed using the coefficient seed data for the resizing processing to obtain the whole enlarged image data, and the mere interpolation is performed. By the processing, it is possible to obtain the entire enlarged image data obtained by enlarging the program image data.

[0604] However, it is possible to see the entire enlarged image data obtained by enlarging the entire program image data in detail by using the coefficient type data for resizing processing in the signal processing units 137 and 157. This is a case where processing is performed, and when the program image data is enlarged by mere interpolation processing, the entire enlarged image data can be viewed, but the details are not reproduced. That is, in the case of simple interpolation processing, only the overall enlarged image data whose image quality is significantly deteriorated can be seen as compared with the case of image conversion processing using the coefficient seed data for resizing processing.

[0605] Here, in the present embodiment, the special function is provided only when the authentication described with reference to FIGS. 31 and 33 is successful, but even if the authentication fails, the special function is provided. Can be provided with restrictions, so to speak.

[0606] That is, for example, when the authentication is successful, the entire enlarged image data is provided by the image conversion process using the coefficient seed data for the resizing process, and when the authentication fails, the simple interpolation process is performed. It is possible to provide the entire enlarged image data.

[0607] In this case, a user who configures the scalable TV system by using a television receiver that is not a master unit or a slave unit can see the overall enlarged image data, but the overall enlarged image data is merely. Since it is due to the interpolation processing, the image quality is considerably deteriorated as compared with the case of the image conversion processing using the coefficient seed data for the resizing processing.

[0608] On the other hand, a user who configures a scalable TV system by using a television receiver which is a master unit or a slave unit has high image quality by image conversion processing using coefficient seed data for resizing processing. You can see the whole enlarged image data of.

[0609] As a result, in the user who configures the scalable TV system by using the television receiver which is not the master unit or the slave unit, the master unit or the slave unit can see the high-quality overall enlarged image data. There will be an incentive to buy a television receiver.

[0610] In the present embodiment, the entire program image data displayed on the master unit 1 is expanded to the overall enlarged image data having a size that can be displayed on the entire television receiver constituting the scalable TV system. Maximum magnification N_maxI tried to set it as, but the maximum magnification N_maxCan be set to an arbitrary value by the user by operating the remote controller 15 (or the remote controller 35).

[0611] In this case, the maximum magnification N_maxHowever, a value for enlarging the program image data to image data larger than the overall enlarged image data of a size that can be displayed on the entire television receiver constituting the scalable TV system (hereinafter, appropriately referred to as an unspecified maximum enlargement ratio). ) May be set, and the entire enlarged image data enlarged at the maximum magnification other than the specified value cannot be displayed on the scalable TV system. That is, only a part of the entire enlarged image data enlarged at the maximum unspecified enlargement ratio can be displayed. In this case, it is possible to enable the user to set, for example, by operating the remote controller 15 (or the remote controller 35), which part of the overall enlarged image data enlarged at the maximum magnification other than the specified value is displayed. it can.

[0612] Further, in the above case, each television receiver constituting the scalable TV system is designed to generate partially enlarged image data to be displayed on the television receiver, but the scalable TV system is used. The partially enlarged image data to be displayed on each of the constituent television receivers can be generated by, for example, one or a plurality of television receivers such as the master unit 1. That is, for example, the master unit 1 generates overall enlarged image data, and the partially enlarged image data, which is a part of the overall enlarged image data, is transmitted to each slave unit 2 via the IEEE1394 interface 133._ijIt is possible to send to. However, in this case, the master unit 1 is the slave unit 2 which is another television receiver, in addition to the partially enlarged image data to be displayed by itself._ijSince it is necessary to generate partially enlarged image data to be displayed in, the processing load becomes large.

[0613] Further, in the above case, the image data (program image data) as the television broadcast program is enlarged, but even in the whole enlargement processing, as in the case of the partial enlargement processing, an external device is used. It is possible to process the image data input from.

[0614] Further, in the entire enlargement processing, as in the case of the partial enlargement processing, both the horizontal direction and the vertical direction of a part of the program image data are not only enlarged by the same enlargement ratio, but also in the horizontal direction. It is also possible to magnify each of the vertical directions by different magnifications.

[0615] Further, in the above case, in the scalable TV system composed of 3 × 3 television receivers, the image data displayed on the master unit 1 arranged at the center thereof is arranged around the scalable TV system. Each handset that was made 2_ijThe entire enlarged image data that is enlarged in each of the directions (upper left, left, lower left, upper, lower, upper right, right, lower right) is displayed, but other, for example, it is placed in the lower left. Handset 2₃₁The image data displayed in is the slave unit 2 placed on it.₂₁, Master unit 1 located on the upper right, Slave unit 2 located on the right₃₂It is also possible to display the overall enlarged image data that is enlarged in each of the directions of.

[0616] Further, in the above case, the master unit 1 and each slave unit 2_ijIn the above, the user operates the remote controller 15 to generate the whole enlarged image data (partially enlarged image data constituting the main unit) after receiving a command to perform the whole enlargement processing. And each handset 2_ijThen, the magnification N is always 1 + α, 1 + 2α, 1 + 3α, ..., N_maxWhen there is a command to generate double-wide magnified image data and perform full-scale enlargement processing, the enlargement ratio N is immediately 1 + α, 1 + 2α, 1 + 3α, ..., N_maxIt is also possible to sequentially display the double-wide enlarged image data.

[0617] Next, the scalable TV system has a special function of displaying image data on the entire television receiver constituting the scalable TV system, that is, a so-called multi-screen display, and this special function is This is achieved by performing multi-screen display processing on the master unit 1 and slave unit 2.

[0618] The instruction to perform the multi-screen display process can also be given from the menu screen in the same manner as the instruction to perform the partial enlargement process or the entire enlargement process, for example.

That is, as described above, when the user operates the menu button switch 54 (or the menu button switch 84 of the remote controller 35 (FIG. 8)) of the remote controller 15 (FIG. 7), the CRT 11 (or or) of the master unit 1 is operated. A menu screen is displayed on the CRT31) of the slave unit 2, and for example, an icon representing a multi-screen display process (hereinafter, appropriately referred to as a multi-screen display icon) is displayed on this menu screen. When the user clicks the multi-screen display icon by operating the remote controller 15, the multi-screen display process is started in each of the master unit 1 and the slave unit 2.

Therefore, the multi-screen display process of the master unit will be described with reference to the flowchart of FIG. 43.

[0621] Here, in the multi-screen display process, as shown in FIG. 42C, the program image data is displayed on the entire television receiver constituting the scalable TV system. Therefore, in the multi-screen display processing of the master unit 1, the enlargement ratio N is substantially set to the maximum enlargement ratio N._maxIt is equivalent to the whole enlargement processing of FIG. 39, which is fixed to and ignores the enlargement pitch α.

Therefore, in the multi-screen display processing of the master unit 1, the same processing as in steps S161 to S164 of FIG. 39 is performed in steps S191 to S194, respectively.

[0623] Then, the process proceeds to step S195, and the maximum enlargement ratio N is the same as in step S165 of FIG._maxIs set, and the process proceeds to step S196. In step S196, the CPU 129 of the master unit 1 (Fig. 10) has an enlargement ratio N and a maximum enlargement ratio N._maxSet to and proceed to step S197.

[0624] In step S197, the CPU 129 has a maximum magnification of N._maxBased on the enlargement ratio N in which is set, the enlargement range r of the program image data in the master unit 1₁And each slave unit 2_ijExpansion range r of program image data in (Fig. 11)_ijIs obtained in the same manner as in step S167 of FIG. 39, and the process proceeds to step S198.

[0625] Here, in the overall enlargement processing of FIG. 39, in addition to obtaining the enlargement range in step S167, the display range is also obtained in step S168, but the enlargement ratio N is the maximum enlargement ratio N._maxIf, the display range R of the master unit 1₁Is the entire display screen of the CRT11, and the handset 2_ijDisplay range R_ijHowever, since it is the entire display screen of the CRT31, it is known in advance and does not need to be sought (or can be considered to be sought in advance). Therefore, in the multi-screen display processing, the display range R of the master unit 1 is again used.₁And handset 2_ijDisplay range R_ijIs not designed to ask for.

[0626] In step S198, the CPU 129 has a maximum magnification N as in step S170 of FIG._maxThe parameter z corresponding to the enlargement ratio N in which is set is set in the parameter memory 168 of the signal processing unit 137 (FIG. 22).

Then, the process proceeds sequentially to steps S199 to S201, and processing is performed in the same manner as in steps S174 to S176 of FIG. 39, whereby the maximum enlargement ratio N is performed in the master unit 1._maxThe partially enlarged image data enlarged by is displayed.

After that, the process proceeds to step S202, and the CPU 129 determines whether or not a command for ending the multi-screen display (hereinafter, appropriately referred to as a multi-screen display end command) has been transmitted.

[0629] If it is determined in step S202 that the multi-screen display end command has not been transmitted, the process returns to step S199, and the same process is repeated thereafter. Therefore, in this case, in the master unit 1, the maximum enlargement ratio N_maxThe display of the partially enlarged image data enlarged by is continued.

Further, in step S202, when it is determined that the multi-screen display end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT 11. Furthermore, by re-clicking the multi-screen display icon on the menu screen, infrared rays of the multi-screen display end command, which is a command corresponding to the operation of the remote controller 15, are emitted from the remote controller 15 and are emitted from the IR receiver 135. When it is received and supplied to the CPU 129, the process proceeds to step S203, the image conversion process in the signal processing unit 137 ends, and the multi-screen display process of the master unit 1 ends. As a result, the program image data stored in the frame memory 127 is supplied to the CRT 11 as it is via the NTSC encoder 128, and the program image data is displayed in a normal size on the CRT 11.

[0631] In addition, slave unit 2_ijMulti-screen display processing (slave unit 2_ij(Multi-screen display processing performed by) is the handset 2 described in Fig. 41._ijSince it is the same as the whole enlargement processing of, the description thereof will be omitted.

Next, the scalable TV system has a special function of causing each of the television receivers constituting the scalable TV system to perform the same processing, and this special function is simultaneously performed in the master unit 1. It is realized by performing control processing.

[0633] The instruction to perform the batch simultaneous control process can also be given from the menu screen in the same manner as the instruction to perform the partial enlargement process or the like, for example.

That is, as described above, when the user operates the menu button switch 54 (or the menu button switch 84 of the remote controller 35 (FIG. 8)) of the remote controller 15 (FIG. 7), the CRT 11 (or or) of the master unit 1 is operated. A menu screen is displayed on the CRT31) of the slave unit 2, and for example, an icon representing the batch simultaneous control process (hereinafter, appropriately referred to as a batch simultaneous control icon) is displayed on this menu screen. When the user clicks the batch simultaneous control icon by operating the remote controller 15, the batch simultaneous control process is started in the master unit 1.

Therefore, the batch simultaneous control process of the master unit will be described with reference to the flowchart of FIG. 44.

[0636] In the batch simultaneous control process, the CPU 129 of the master unit 1 (FIG. 10) waits for a command to command a predetermined process to be input by operating the remote controller 15 (or the remote controller 25). That is, the IR receiving unit 15 waits for infrared rays corresponding to a predetermined command from the remote controller 15 to be received and supplied to the CPU 129, and then receives the command in step S211. Further, in step S211 the CPU 129 performs a process corresponding to the command and proceeds to step S212.

[0637] In step S212, the CPU 129 can perform processing corresponding to the command corresponding to the operation of the remote controller 15 (hereinafter, appropriately referred to as a remote controller command) received in step S211._ijIs present in the television receivers that make up the scalable TV system.

[0638] In the determination process of step S212, each slave unit 2 in which the CPU 129 is stored in the EEPROM 130_ijIt is done by referring to the function information of.

[0639] In step S212, a slave unit 2 capable of performing processing corresponding to a remote control command._ijIf it is determined that is present, the process proceeds to step S213, and the CPU 129 can perform processing corresponding to the remote control command by controlling the IEEE1394 interface 133._ijSend remote control commands to all.

Therefore, for example, the slave unit 2 that now constitutes the scalable TV system._ijIf all can perform the processing corresponding to the remote control command, the slave unit 2_ijRemote control commands are sent to all, and each slave unit 2_ijThen, the process corresponding to the remote control command, that is, the same process as that performed on the master unit 1 in step S211 is performed.

[0641] On the other hand, in step S212, the slave unit 2 capable of performing the process corresponding to the remote control command._ijIf it is determined that does not exist, step S213 is skipped and the process proceeds to step S214. Whether or not the CPU 129 has sent a command to end the batch simultaneous control process (hereinafter, appropriately referred to as a batch simultaneous control end command). To judge.

[0642] If it is determined in step S212 that the batch simultaneous control end command has not been transmitted, the remote control 15 is operated to input a command (remote control command) for instructing a predetermined process. After waiting, the process returns to step S211, and the same process is repeated thereafter.

Further, in step S212, when it is determined that the batch simultaneous control end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT 11. Furthermore, by re-clicking the batch simultaneous control icon on the menu screen, infrared rays of the batch simultaneous control end command, which is a command corresponding to the operation of the remote controller 15, are emitted from the remote controller 15 and are emitted from the IR receiver 135. When it is received and supplied to CPU129, the batch simultaneous control process is terminated.

According to the batch simultaneous control process, for example, the slave unit 2 that now constitutes the scalable TV system_ijAssuming that all can perform the processing corresponding to the remote control command, when the user is instructed to select a certain channel by operating the remote control 15, for example, as shown in FIG. 45A. The image data broadcast on that channel is displayed on all of the master unit 1 and the slave unit 2 that make up the scalable TV system. Further, when the user commands the switching to another channel by operating the remote controller 15, as shown in FIG. 45B, the channel switching is performed in all of the master unit 1 and the slave unit 2 constituting the scalable TV system. Is done.

[0645] Therefore, the user can simultaneously and similarly control all the television receivers constituting the scalable TV system by one remote control 15.

Next, as described above, the master unit 1 is accompanied by the remote controller 15, and each slave unit 2 is attached._ijIt is also possible to attach a remote controller 35 to each of them. Further, as described above, the master unit 1 also has the slave unit 2 by the remote controller 15._ijIt can also be controlled by the remote control 35 of the slave unit 2_ijHowever, it can be controlled by the remote controller 35 or the remote controller 15 of the master unit 1.

[0647] Therefore, all of the television receivers constituting the scalable TV system can be controlled by only one remote controller 15 (or 35).

[0648] However, in order to control each of the plurality of television receivers separately with only one remote controller 15, for example, the device ID of each of the plurality of television receivers is set in the remote controller 15. Before performing the operation of inputting the desired command, it is necessary to perform an operation of specifying the television receiver to be controlled, such as an operation of inputting the device ID of the television receiver to be controlled, which is troublesome. Is.

Therefore, in order to control the master unit 1, the remote controller 15 accompanying the master unit 1 is used, and each slave unit 2_ijAfter all, for the control of, each slave unit 2_ijThere is a method of using each of the remote controls 35 attached to the above.

[0650] However, this method requires as many as nine remote controls to control each of the television receivers constituting the scalable TV system of FIG. 1A separately. Further, in this case, it may not be possible to tell at a glance which remote controller controls which television receiver.

[0651] Therefore, the master unit 1 and each slave unit 2 constituting the scalable TV system_ijOf these, the television receivers that the user is controlling are the remote controller 15 of the master unit 1 and each slave unit 2._ijIt would be convenient if the user could control the television receiver to be controlled by any of the remote controllers 35 without performing an operation of specifying the television receiver to be controlled.

[0652] Therefore, the scalable TV system has a special function that enables the user to recognize the television receiver to be controlled and control the television receiver to be controlled by the remote controller 15 (or the remote controller 35). It has, and this special function is realized by performing individual processing in the master unit 1 and the slave unit 2.

[0653] For example, an instruction to perform individual processing can be given from a menu screen.

That is, as described above, when the user operates the menu button switch 54 of the remote controller 15 (FIG. 7) (or the menu button switch 84 of the remote controller 35 (FIG. 8)), the CRT 11 (or the master unit 1) A menu screen is displayed on the CRT31) of the slave unit 2, and for example, an icon representing individual processing (hereinafter, appropriately referred to as an individual processing icon) is displayed on this menu screen. When the user clicks the individual processing icon by operating the remote controller 15, individual processing is started in each of the master unit 1 and the slave unit 2.

Therefore, first, the individual processing of the master unit 1 will be described with reference to the flowchart of FIG. 46.

In the individual processing of the master unit 1 (FIG. 10), the CPU 129 waits for the IR receiver 135 to receive infrared rays from the remote controller 15 (or the remote controller 35), and in step S221, the IR receiver. Detects the infrared reception intensity at 135. That is, when a user operates a remote controller 15 to control a certain television receiver that constitutes a scalable TV system and controls the controlled object, the remote controller 15 emits infrared rays corresponding to the operation. .. This infrared ray is transmitted to the IR receiver 135 of the master unit 1 and each slave unit 2_ijThe light is received by the IR receiver 155 of FIG. 11 (FIG. 11), but in step S221, the CPU 129 causes the IR receiver 135 to detect the infrared reception intensity and receive the infrared ray reception intensity.

[0657] Then, the process proceeds to step S222, and the CPU 129 uses the IEEE1394 interface 133 for each slave unit 2._ijIn addition, each slave unit 2_ijRequests the intensity of infrared rays received from the remote controller 15 in the remote controller 15 and, in response to the request, each slave unit 2_ijThe infrared reception intensity transmitted from is acquired (received) via the IEEE1394 interface 133.

That is, as described above, when the user operates the remote controller 15, the infrared rays emitted by the remote controller 15 are emitted not only by the master unit 1 but also by each slave unit 2._ijHowever, in step S222, each slave unit 2 of the infrared ray is received._ijThe reception strength at is acquired.

After that, the process proceeds to step S223, and the CPU 129 determines the infrared reception intensity of the master unit 1 detected in step S221 and each slave unit 2 acquired in step S222._ijThe maximum reception intensity (maximum reception intensity) is detected from the infrared reception intensity in, and the process proceeds to step S224.

[0660] In step S224, the CPU 129 determines whether the television receiver (hereinafter, appropriately referred to as the maximum reception strength device) from which the maximum reception strength has been obtained is either the master unit 1 or the slave unit 2.

[0661] If it is determined in step S224 that the maximum reception strength device is the master unit 1, the process proceeds to step S225, and the CPU 129 issues a command to the master unit 1 represented by the infrared rays received by the IR receiver 135. Assuming that, the process corresponding to the command is executed.

On the other hand, if it is determined in step S224 that the maximum reception strength device is the slave unit 2, the process proceeds to step S226, and the CPU 129 receives light from the IR receiver 135 by controlling the IEEE1394 interface 133. The command represented by infrared rays is the slave unit 2 which is the maximum reception strength device._ijThe command is given to the slave unit 2 which is the maximum reception strength device._ijSend to.

[0663] Therefore, in this case, the slave unit 2 which is the maximum reception strength device 2_ijThen, as will be described later with reference to FIG. 47, processing corresponding to the command represented by the infrared rays from the remote controller 15 will be performed.

[0664] Here, when the user controls a certain television receiver that constitutes a scalable TV system by operating the remote controller 15 (or the remote controller 35), the remote controller 15 is generally used. , Operate toward the television receiver that is the control target.

[0665] In this case, for example, assuming that the infrared rays emitted by the remote controller 15 (or the remote controller 35) have strong directivity, the remote controller 15 emits the television receiver that the user intends to control. It means that the device is in the direction of the main axis of infrared rays, that is, the maximum reception intensity device having the highest infrared reception intensity.

[0666] Therefore, as described above, by executing the process corresponding to the command represented by the infrared rays from the remote controller 15 in the maximum reception intensity device, the television receiver controlled by the user, that is, the maximum reception intensity device. In, the process corresponding to the operation of the remote controller 15 by the user is performed.

[0667] Specifically, for example, when the user points the remote controller 15 toward the master unit 1 to perform channel operation or volume operation, the master unit 1 becomes the maximum reception strength device, and as a result, the maximum reception strength is obtained. In the master unit 1 which is a device, the channel and volume are changed according to the operation. Also, for example, the user can use the remote controller 15 and the handset 2_ijIf you operate the channel or volume toward, the slave unit 2_ijBecomes the maximum reception strength device, and as a result, the slave unit 2 which is the maximum reception strength device_ijIn, the channel and volume are changed according to the operation.

[0668] After the processing of steps S225 and S226, the process proceeds to step S227, and the CPU 129 determines whether or not a command for terminating the individual processing (hereinafter, appropriately referred to as an individual processing end command) has been transmitted.

[0669] If it is determined in step S227 that the individual processing end command has not been transmitted, the infrared rays emitted by operating the remote controller 15 are waited to be received by the IR receiver 135, and then Returning to step S221, the same process is repeated thereafter.

Further, in step S227, when it is determined that the individual processing end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT11. Further, by re-clicking the individual processing icon on the menu screen, infrared rays of the individual processing end command, which is a command corresponding to the operation of the remote controller 15, are emitted from the remote controller 15 and received by the IR receiver 135. When supplied to the CPU 129, the process proceeds to step S228, and the CPU 129 issues an individual processing end command to each slave unit 2 by controlling the IEEE1394 interface 133._ijAnd ends the individual processing of the master unit 1.

[0671] Next, the individual processing of the slave unit will be described with reference to the flowchart of FIG. 47.

In the individual processing of the slave unit 2 (FIG. 11), the CPU 149 waits for the IR receiver 155 to receive infrared rays from the remote controller 15 (or the remote controller 35), and in step S231, the IR receiver. Detects the infrared reception intensity at 155. That is, when a user operates a remote controller 15 to control a certain television receiver that constitutes a scalable TV system and controls the controlled object, the remote controller 15 emits infrared rays corresponding to the operation. However, as described above, this infrared ray is received by the IR receiver 155 of the slave unit 2. In step S231, the CPU 149 causes the IR receiver 155 to detect the infrared reception intensity thereof and receive the supply thereof.

[0673] Then, the process proceeds to step S232, and the CPU 149 waits for the infrared reception intensity request to be transmitted from the master unit 1 and detects it in the master unit 1 via the IEEE1394 interface 153 in step S231. Transmits the infrared reception intensity. In this step S232, the reception intensity of the infrared rays transmitted from the slave unit 2 is acquired (received) in step S222 of FIG. 46 described above, which is performed by the master unit 1.

After that, the process proceeds to step S233, and the CPU 149 determines whether or not a command has been transmitted from the master unit 1. That is, the master unit 1 transmits a command to the slave unit 2 in steps S226 and S228 of FIG. 46 described above, but in step S233, whether or not the command is transmitted from the master unit 1 in this way. Is determined.

[0675] If it is determined in step S233 that no command has been transmitted from the master unit 1, the process returns to step S233.

[0676] Further, in step S233, when it is determined that the command is transmitted from the master unit 1, that is, when the command transmitted from the master unit 1 is received and supplied to the CPU 149 in the IEEE1394 interface 153. , Step S234, CPU149 determines whether the command is an individual processing end command.

If it is determined in step S234 that the command transmitted from the master unit 1 is not an individual processing end command, the process proceeds to step S235, and the CPU 149 performs processing corresponding to the command transmitted from the master unit 1. To return to step S233.

[0678] As a result, as described with reference to FIG. 46, when the user operates the remote controller 15, the slave unit 2 to which the remote controller 15 is directed has a process (for example, a channel or volume) corresponding to the operation of the remote controller 15. Change) is performed.

On the other hand, if it is determined in step S234 that the command transmitted from the master unit 1 is an individual processing end command, the individual processing of the slave unit 2 is terminated.

[0680] As described above, the remote controller 15 (or the remote controller 35) has a strong infrared directivity, and the television receiver constituting the scalable TV system has an infrared reception intensity from the remote controller 15. By detecting the largest maximum reception strength device, the television receiver that the user is trying to control can be identified (recognized), so that the master unit 1 and each slave unit 2 that make up the scalable TV system can be identified (recognized)._ijOf these, the television receivers that the user is controlling are the remote controller 15 of the master unit 1 and each slave unit 2._ijThe remote controller 35 of the above can be used for control without performing an operation of specifying the television receiver to be controlled by the user.

Next, according to the individual processing, for example, a certain user A uses a remote controller 15 to perform a certain slave unit 2._ijOperate the channel of a certain program PGM_AAnother user B can use the remote control 35 to watch the other handset 2_pqOperate the channel of other programs PGM_BA plurality of users can individually watch different programs, such as watching a program.

[0682] In this case, the slave unit 2_ijAnd 2_pqImage data of different programs will be displayed on CRT31 in (Fig. 11)._ijAnd 2_pqEven if and are placed next to each other, the handset 2_ijAnd 2_pqDisplaying image data of different programs on the screen is not a big problem.

[0683] That is, in this case, the slave unit 2_ijTo the show PGM_AImage data of is displayed, and the handset 2_pqTo the show PGM_BSince the image data of is displayed, both image data are in the field of view of users A and B.

[0684] However, the user A is the slave unit 2_ijProgram PGM displayed in_AUser B tries to view the image data of the handset 2_pqProgram PGM displayed in_BSince the user A is trying to watch the image data of the program PGM, the program PGM is not trying to watch._BThe image data of is masked, so to speak, and even user B is not trying to watch the program PGM._AThe image data of is masked.

Therefore, for User A, another handset 2_pqProgram PGM displayed in_BThe image data of is the handset 2_ijProgram PGM displayed in_AIt does not hinder the viewing of the image data of the user B, and the other handset 2_ijProgram PGM displayed in_AThe image data of is the handset 2_pqProgram PGM displayed in_BIt does not hinder the viewing of image data.

[0686] However, in this case, different audio data accompanying each of the different image data is output, that is, the slave unit._ijProgram PGM from speaker units 32L and 32R_AAudio data is output, and the handset 2_pqProgram PGM from speaker units 32L and 32R_BThere are some problems with the output of the audio data of.

[0687] That is, a so-called cocktail party effect is recognized in human hearing, and it is possible to distinguish desired voice data from a mixture of a large number of voice data, but still, voice data having low power is not available. , The presence of audio data other than the desired audio data, that is, audio data that becomes noise, such as being masked by high-power audio data, hinders viewing of the desired audio data.

[0688] Therefore, the scalable TV system is directed toward the user who is watching the program on the master unit 1 or the slave unit 2, the speaker units 12L and 12R of the master unit 1 and the speaker units 32L and 32R of the slave unit 2. It has a special function that directs the direction of the main axis of directivity of (the speakers that make up), thereby making it easier for the user to hear the audio data of the program that the user is watching. This is achieved by performing speaker control processing in the master unit 1 and the slave unit 2.

That is, here, for example, the directivity of the speaker units 12L and 12R of the master unit 1 (FIG. 10) is very strong, and the unit drive unit 138 drives the speaker units 12L and 12R. However, by changing the direction mechanically (mechanically), the direction of the main axis of directivity can be directed to a predetermined direction. Similarly, the speaker units 32L and 32R of the slave unit 2 have strong directivity, and by being driven by the unit drive unit 158, the direction of the main axis of directivity can be directed to a predetermined direction. ing.

[0690] The speaker control process is performed in parallel with the individual process, for example, when the individual process described with reference to FIGS. 46 and 47 is performed.

Therefore, the speaker control process of the master unit will be described with reference to the flowchart of FIG. 48.

[0692] In the speaker control process of the master unit, the CPU 129 waits for the IR receiver 135 to receive the infrared rays from the remote controller 15 (or the remote controller 35), and in step S241, the infrared rays of the IR receiver 135 are received. Detect reception strength. That is, when a user operates a remote controller 15 to control a certain television receiver that constitutes a scalable TV system and controls the controlled object, the remote controller 15 emits infrared rays corresponding to the operation. .. This infrared ray is transmitted to the IR receiver 135 of the master unit 1 and each slave unit 2_ijThe light is received by the IR receiver 155 of FIG. 11 (FIG. 11), but in step S241, the CPU 129 causes the IR receiver 135 to detect the infrared reception intensity and receive the infrared ray reception intensity.

[0693] Then, the process proceeds to step S242, and the CPU 129 is connected to each slave unit 2 via the IEEE1394 interface 133._ijIn addition, each slave unit 2_ijRequests the intensity of infrared rays received from the remote controller 15 in the remote controller 15 and, in response to the request, each slave unit 2_ijThe infrared reception intensity transmitted from is acquired (received) via the IEEE1394 interface 133.

That is, as described above, when the user operates the remote controller 15, the infrared rays emitted by the remote controller 15 are emitted not only by the master unit 1 but also by each slave unit 2._ijHowever, in step S242, each handset 2 of the infrared ray_ijThe reception strength at is acquired.

[0695] Here, in steps S241 and S242 in the speaker control process of the master unit 1, the same processes as in steps S221 and S222 in the individual process of the master unit 1 in FIG. 46 are performed, respectively. Therefore, in the speaker control processing of the master unit 1, the processing of steps S241 and S242 is not performed, and the reception strength obtained in steps S221 and S222 in the individual processing of the master unit 1 can be adopted as it is.

After that, the process proceeds to step S243, and the CPU 129 determines the infrared reception intensity of the master unit 1 detected in step S241 and each slave unit 2 acquired in step S242._ijFrom the infrared reception intensities in the above, any three reception intensities, that is, for example, the reception intensities from the first to the third in descending order of the reception intensities are selected, and the process proceeds to step S244.

[0697] In step S244, the CPU 129 detects the distance corresponding to each of the three reception intensities from the first to third positions selected in step S243, and proceeds to step S245.

That is, the reception intensity of the infrared rays emitted from the remote control 15 in the television receiver corresponds to, for example, the distance between the remote control 15 and the television receiver (IR receiver 135 or 155). There is.

Therefore, the EEPROM 150 of the master unit 1 (FIG. 10) has, for example, the reception intensity of infrared rays emitted from the remote controller 15 in the television receiver and the television image received from the remote controller 15 as shown in FIG. 49. An intensity-to-distance table showing the correspondence with the distance to the machine is stored, and in step S244, the CPU 129 receives from the first to the third place by referring to this intensity-to-distance table, for example. Detect the distance corresponding to each intensity.

[0700] The intensity vs. distance table is created, for example, by operating the remote controller 15 at each of a plurality of distances away from the television receiver and measuring the reception intensity received by the television receiver. It is possible to do.

Returning to FIG. 48, in step S245, the CPU 129 detects the position of the remote controller 15 that emits infrared rays of those reception intensities from the distances corresponding to the reception intensities of the first to third places.

[0702] Here, with reference to FIG. 50, a method of detecting the position of the remote controller 15 that emits infrared rays of those reception intensities from the distances corresponding to the reception intensities of the first to third places will be described. .. Here, for the sake of simplicity, only the two reception strengths, the first and the second, are considered.

[0703] For example, the reception strength of the master unit 1 and the slave unit 2 to the right of it (when viewed from the front of the scalable TV system)₂₃The reception strength in is the first and second reception strength, and the distance corresponding to the reception strength in the master unit 1 is r.₁And handset 2₂₃The distance corresponding to the reception strength in₂₃And, respectively.

[0704] In this case, considering a certain two-dimensional plane, as shown in FIG. 50, the remote controller 15 receives infrared rays from the IR receiver 135 of the master unit 1.₁Radius r centered on₁Circle c₁It exists on the circumference of the handset 2₂₃Point P where infrared rays were received by the IR receiver 155 of₂₃Radius r centered on₂₃Circle c₂₃It will exist on the circumference of.

[0705] Therefore, the remote control 15 is a circle c.₁And c₂₃Intersection P of the circumference of_UIt will be present in the remote control 15 position P_UWill be able to be detected.

[0706] In the above case, since the position of the remote control 15 is obtained from the two reception strengths, the position on the two-dimensional plane is detected, but the position of the remote control 15 on the three-dimensional space is Similar to the case described with reference to FIG. 50, it can be detected by finding the intersection of the spherical surfaces of the spheres whose radius is the distance corresponding to each of the three reception intensities.

[0707] Returning to FIG. 48 again, after the position of the remote controller 15 is detected in step S245, the process proceeds to step S246, and the CPU 129 determines the infrared reception intensity of the master unit 1 detected in step S241 and step S242. Each slave unit acquired in 2_ijThe maximum reception intensity is detected from the infrared reception intensity in. It is possible to omit the detection of the maximum reception intensity in step S246 and instead use the maximum reception intensity detected in step S223 in FIG. 46 described above.

[0708] In step S246, the CPU 129 further determines whether the television receiver (maximum reception strength device) from which the maximum reception strength has been obtained is the master unit 1 or the slave unit 2.

[0709] If it is determined in step S246 that the maximum reception strength device is the master unit 1, the process proceeds to step S247, and the CPU 129 determines the directivity of the speaker units 12L and 12R of the master unit 1 which is the maximum reception strength device. The unit drive unit 138 is controlled so that the direction of the main axis of the unit is directed to the position of the remote controller 15 detected in step S245 (hereinafter, appropriately referred to as a user position), and the process returns to step S241.

[0710] In this case, the unit drive unit 138 rotationally drives the speaker units 12L and 12R in the pan direction or the tilt direction, for example, in accordance with the control of the CPU 129, whereby the direction of the main axis of the directivity is set to the user position. Turn in the direction of.

On the other hand, if it is determined in step S246 that the maximum reception strength device is the slave unit 2, the process proceeds to step S248, and the CPU 129 controls the IEEE1394 interface 133 to control the directivity of the speaker units 32L and 32R. The speaker control command that commands the direction of the main axis of the unit to be directed to the user position is issued to the slave unit 2 which is the maximum reception strength device._ijAnd return to step S241.

[0712] Therefore, in this case, the slave unit 2 which is the maximum reception strength device 2_ijThen, as will be described later with reference to FIG. 51, the speaker units 32L and 32R are rotationally driven in the pan direction or the tilt direction so that the direction of the main axis of the directivity is directed toward the user position.

[0713] As described above, when a user operates a remote controller 15 (or a remote controller 35) to control a television receiver that constitutes a scalable TV system, the user generally controls the remote controller. Operate 15 toward the television receiver to be controlled.

[0714] In this case, for example, assuming that the infrared rays emitted by the remote controller 15 (or the remote controller 35) have strong directivity, the remote controller 15 emits the television receiver that the user intends to control. It means that the device is in the direction of the main axis of infrared rays, that is, the maximum reception intensity device having the highest infrared reception intensity.

[0715] Therefore, the maximum reception strength device is a television receiver that outputs image data and audio data of the program being viewed by the user who operates the remote controller 15, and is a master unit that is the maximum reception strength device. By directing the direction of the directional spindle of the speaker units 12L and 12R of 1 or the speaker units 32L and 32R of the slave unit 2 toward the user who operates the remote controller 15, the user can use the audio data of the desired program. Can be heard clearly.

Next, the speaker control process of the slave unit 2 will be described with reference to the flowchart of FIG. 51.

In the speaker control process of the slave unit 2 (FIG. 11), the CPU 149 waits for the IR receiver 155 to receive infrared rays from the remote controller 15 (or the remote controller 35), and in step S251, receives the IR. The infrared reception intensity of the unit 155 is detected. That is, when a user operates a remote controller 15 to control a certain television receiver that constitutes a scalable TV system and controls the controlled object, the remote controller 15 emits infrared rays corresponding to the operation. However, as described above, this infrared ray is received by the IR receiver 155 of the slave unit 2. In step S251, the CPU 129 causes the IR receiver 155 to detect the infrared reception intensity thereof and receive the supply thereof.

[0718] Then, the process proceeds to step S252, and the CPU 149 waits for the infrared reception intensity request to be transmitted from the master unit 1 and detects it in the master unit 1 via the IEEE1394 interface 153 in step S251. Transmits the infrared reception intensity. In this step S252, the reception intensity of the infrared rays transmitted from the slave unit 2 is acquired (received) in step S242 of FIG. 48 described above, which is performed by the master unit 1.

[0719] Here, in steps S251 and S252 in the speaker control process of the slave unit 2, the same processes as in steps S231 and S232 in the individual process of the slave unit 2 of FIG. 47 are performed, respectively. Therefore, in the speaker control processing of the slave unit 2, the processing of steps S251 and S252 is not performed, and the reception strength obtained in steps S231 and S232 in the individual processing of the slave unit 2 can be adopted as it is.

[0720] After that, the process proceeds to step S253, and the CPU 149 determines whether or not the speaker control command has been transmitted from the master unit 1. That is, the master unit 1 transmits the speaker control command to the slave unit 2 in step S248 of FIG. 48 described above, but in step S253, the speaker control command is transmitted from the master unit 1 in this way. It is determined whether or not it was.

[0721] If it is determined in step S253 that the speaker control command has not been transmitted from the master unit 1, the process returns to step S251.

Further, in step S253, when it is determined that the speaker control command has been transmitted from the master unit 1, that is, the speaker control command transmitted from the master unit 1 is received by the IEEE1394 interface 153, and the CPU 149 receives the speaker control command. If supplied, the process proceeds to step S254, where the CPU 149 determines the direction of the directional spindles of the speaker units 32L and 32R of the slave unit 2 according to the speaker control command, and the position of the remote control 15 detected in step S245 of FIG. The unit drive unit 158 is controlled so as to face the (user position) direction, and the process returns to step S251.

[0723] In this case, the unit drive unit 158 rotationally drives the speaker units 32L and 32R in the pan direction or the tilt direction, for example, in accordance with the control of the CPU 149, whereby the direction of the main axis of the directivity is set to the user position. Turn in the direction of.

Therefore, in this case, in the slave unit 2, the user who operates the remote controller 15, that is, the slave unit 2 watches the program as image data and audio data output to the slave unit 2. The direction of the main axis of directivity of the speaker units 32L and 32R is directed toward the user, and the user can clearly hear the audio data of the desired program.

[0725] The speaker control process of FIGS. 48 and 51 ends, for example, when the individual processes of FIGS. 46 and 47 are completed.

[0726] Further, in the above case, only the direction of the directional spindle of the speaker units 12L and 12R (or the speaker units 32L and 32R) is controlled according to the user position, but other than that. For example, it is possible to control the volume of the speaker units 12L and 12R. That is, for example, it is possible to increase the volume of the speaker units 12L and 12R as the television receiver on which the user is watching the program is farther from the user position.

[0727] Further, in the above case, the position (user position) of the remote controller 15 is detected based on the intensity of infrared rays received from the remote controller 15 in the television receiver, but the position of the remote controller 15 is In addition, for example, it is possible to detect by using GPS (Global Positioning System), emitting ultrasonic waves from each television receiver, receiving the ultrasonic waves with the remote controller 15 and sending them back. is there.

Next, in the above-mentioned speaker control process, directional speakers are used as the speaker units 12L and 12R (and speaker units 32L and 32R), and the direction of the main axis of the directivity is set to the unit drive unit 138. (And the unit drive unit 158) rotationally drives it in the pan or tilt direction to direct it in a predetermined direction (direction of the user position), but the control of the direction of the main axis of such directivity is It can also be done electronically.

That is, FIG. 52 shows a configuration example of the speaker unit 12L that electronically controls the direction of the main axis of directivity. Since the other speaker units 12R, 32L, and 32R are also configured in the same manner as the speaker unit 12L, the description thereof will be omitted.

[0730] In the embodiment of FIG. 52, the audio data output by the MPEG audio decoder 126 (FIG. 10) is the digital filter 211.₁And 211₂Is supplied to. Digital filter 211₁And 211₂The unit drive unit 138 (Fig. 10) sets a predetermined tap coefficient to the digital filter 211.₁And 211₂Filters the same audio data supplied there based on the tap coefficient set by the unit drive unit 138, so that each frequency component contained in the audio data is delayed by a predetermined value for each frequency component. Obtaining audio data delayed by the time, speaker 212₁And 212₂To supply each.

[0731] Speaker 212₁And 212₂Are omnidirectional speakers, digital filters 211₁And 211₂Outputs (sounds) the audio data supplied from.

[0732] Now, in the speaker unit 12L, two speakers 212₁And 212₂If the main axes of are expressed as Y1 and Y2, respectively, the speaker 212₁And 212₂Is arranged so that its main axes Y1 and Y2 are parallel in a two-dimensional plane (here, in a paper surface). In addition, speaker 212₁And 212₂Are arranged so that their respective cones (diaphragms) are at equal positions in the directions of the spindles Y1 and Y2.

[0733] Here, the distance between the main axes Y1 and Y2 (hereinafter, appropriately referred to as the distance between the main axes) is represented by a, and in the two-dimensional plane, in the counterclockwise direction with respect to the main axis Y1 or Y2. The angle (radiation angle) is expressed by θ.

[0734] When a sine wave signal having a single frequency component as audio data is input to the speaker unit 12L configured as described above, for example, the sine wave signal as the audio data is a digital filter. 211₁And 211₂Filtered by, for example, delay times D1 and D2, respectively, and speaker 212.₁And 212₂It is supplied to and output to.

[0735] In this case, the speaker 212₁And 212₂The sound waves output from each interfere with each other. Furthermore, for example, if the delay times D1 and D2 are in a relationship of D2 D1, the speaker 212₁And 212₂There is a time difference of only D2-D1 (hereinafter, appropriately referred to as a delay time difference) between the sound waves output from each. Also, speaker 212₁And 212₂There is a path difference between the sound waves on the axes Y11 and Y12 that form an angle θ with the main axes Y1 and Y2, respectively.

As a result, the speaker 212₁And 212₂The phase relationship between the two sound waves at the time of interference is different for each observation point (listening position) of the two sound waves output from, for example, at a certain observation point, the two sound waves are added in phase. Speaker 212₁And 212₂The sound wave is twice as loud as when there is only one of them. At other observation points, the two sound waves are added (offset) in opposite phases, and the volume becomes 0. Therefore, speaker 212₁And 212₂The overall volume characteristics of will have directivity.

[0737] FIGS. 53 and 54 show the speaker 212 obtained as described above.₁And 212₂An example of the directivity of the overall volume characteristics of is shown. In the embodiment of FIGS. 53 and 54, the maximum volume is normalized to 0 dB.

FIG. 53 shows the directivity of the volume characteristics when a sine wave having a frequency of 1000 Hz is input, where the distance a between the spindles is 10 cm and the delay time difference D2-D1 is a / C. Note that C represents the speed of sound, and here, it is 340 m / s.

[0739] In the embodiment of FIG. 53, the maximum volume is obtained in the range where the angle θ is 30 degrees or more. In addition, the volume is almost 0 (null) at the position where the angle θ is 45 degrees.

[0740] FIG. 54 shows the directivity of the volume characteristic when the input is replaced with a sine wave having a frequency of 5000 Hz, among the conditions described with reference to FIG. 53.

[0741] In the embodiment of FIG. 54, the main beam appears in a range where the angle θ is 45 degrees or more. In addition, a secondary beam (grating beam) having the same size as the main beam is generated in the range where the angle θ is 0 to 45 degrees. Such a large sub-beam is generated because in the range of the sub-beam in FIG. 54, the phase difference between the two sound waves is an integral multiple of the wavelength of the sine wave of 5000 Hz, and the two sound waves are added in phase. Is.

This also applies to the other sub-beams, speaker 212.₁And 212₂When the distance from each to the observation point is sufficiently larger than the distance between the spindles a, in general, when the following equation holds, the speaker 212₁And 212₂The two sound waves output by are in phase with each other to generate a sub-beam of the same magnitude as the main beam.

【0743】<img file="JP3693246B2_D0051.tif" />[0744] However, in the equation (26), f represents the frequency of the input, and n is an integer value of 0 or more.

[0745] In Eq. (26), when n is 0, it represents the main beam.

[0746] For example, when the frequency f is 1000 Hz, Eq. (26) is satisfied only when n is 0, and therefore, in this case, a secondary beam of the same magnitude is generated in addition to the main beam. There is no such thing.

Here, for example, when n is 1, the frequency f that satisfies Eq. (26), that is, the frequency f that produces the secondary beam is expressed by f = C / (a (1-cosθ)). Can be done. Under the conditions described in the embodiment of FIG. 53, this frequency f is about 1700 Hz, which is the frequency when the distance a between the spindles is equal to the half wavelength of the sound wave.

[0748] From the above, according to the speaker unit 12L of FIG. 52, the digital filter 211₁And 211₂In the speaker 212, each frequency component of the audio data supplied thereby is delayed for each frequency component, thereby giving a predetermined delay time difference D2-D1 for each frequency component.₁And 212₂By supplying and outputting to the speaker 212₁And 212₂The overall volume characteristic of is directional. Then, the direction of the main beam and the null direction for each frequency component can be changed by the delay time difference given to the frequency component.

That is, the direction of the directivity spindle of the speaker unit 12L is the digital filter 211.₁And 211₂It can be changed by the tap coefficient set to.

Therefore, in the unit drive unit 138, the digital filter 211.₁And 211₂By giving a predetermined tap coefficient to the speaker unit, the direction of the directivity spindle of the speaker unit 12L can be directed to a desired direction.

[0751] In the above case, the speaker unit 12L has two speakers 212.₁And 212₂And its two speakers 212₁And 212₂The direction of the main axis of directivity is controlled by using the interference between the two sound waves output from the speaker. For example, the speaker units 12L and 12R are each composed of one speaker, and the speaker. It is also possible to control the direction of the main axis of directivity by utilizing the interference between the speaker of the unit 12L and the two sound waves output from the speaker of the speaker unit 12R.

[0752] Further, the speaker unit 12L can be configured by a so-called speaker array consisting of a number of speakers larger than two. When the speaker unit 12L is composed of a large number of speakers, steeper directivity can be realized.

[0753] Next, in the above case, the position (user position) of the remote controller 15 is detected based on the reception intensity of infrared rays from the remote controller 15 in the master unit 1 or the slave unit 2, and the position of the remote controller 15 is detected. The direction of the directional spindle of the speaker units 12L and 12R or the speaker units 32L and 32R was set to the direction of, but the direction of the directional spindle of the speaker units 12L and 12R or the speaker units 32L and 32R was changed. , If you only point in the direction of the position of the remote controller 15, it is not necessary to detect the position of the remote controller 15, and it is sufficient to know the direction of the remote controller 15 from the master unit 1 or the slave unit 2.

Therefore, a method of detecting the direction of the remote controller 15 from the master unit 1 (or the slave unit 2) will be described with reference to FIGS. 55 and 56.

[0755] As shown in FIG. 55, the direction of the remote controller 15 from the master unit 1 is such that the IR receiver 135 of the master unit 1 (FIG. 10) is provided with two light receiving units 135A and 135B separated by a predetermined distance D. It can be detected by providing it.

Assuming that the distance from the master unit 1 to the remote controller 15 is sufficiently larger than the distance D between the light receiving units 135A and 135B, the infrared rays incident on the light receiving unit 135A from the remote controller 15 and the remote controller 15 It can be regarded as parallel to the infrared rays incident on the light receiving unit 135B.

[0757] Then, as shown in FIG. 55, assuming that the angle formed by the infrared rays incident on the light receiving units 135A and 135B from the remote control 15 and the straight line connecting the light receiving units 135A and 135B is φ, the remote control 15 becomes the light receiving unit 135A. The path difference d between the incident infrared rays and the infrared rays incident on the light receiving unit 135B from the remote controller 15 can be represented by Dcosφ.

[0758] Further, if the speed of light is represented by c and the time difference in the timing at which infrared rays from the remote controller 15 are received by the light receiving units 135A and 135B is represented by τ, the path difference d can be represented by cτ.

Therefore, the angle φ, that is, the direction φ of the remote controller 15, is represented by arccos (τc / D). That is, the direction φ of the remote controller 15 can be obtained by measuring the time difference τ of the timing at which the infrared rays from the remote controller 15 are received by the light receiving units 135A and 135B.

Next, the direction of the remote controller 15 from the master unit 1 (or slave unit 2) can also be detected by configuring the IR receiver 135 (or IR receiver 155) as shown in FIG. It is possible.

That is, in the embodiment of FIG. 56, the IR receiver 135 is from an infrared line sensor 221 having pixels as a plurality of infrared receivers and a lens 222 that collects infrared rays on the infrared line sensor 221. It is configured.

[0762] The infrared line sensor 221 is arranged on the optical axis of the lens 222, for example.

[0763] In the IR receiver 135 configured as described above, the infrared rays emitted from the remote controller 15 enter the infrared line sensor 221 via the lens 222, and the pixels at a predetermined position on the infrared line sensor Is received by.

[0764] In this case, when the incident angle α of infrared rays with respect to the infrared line sensor 221 changes, the pixels that receive the infrared rays, that is, the light receiving positions also change accordingly.

[0765] Now, the distance between this light receiving position and the intersection of the optical axis of the lens 222 on the infrared line sensor 221 is represented by r, and the distance between the infrared line sensor 221 and the lens 222 is represented by S. Expressed, the incident angle α, that is, the direction α of the remote controller 15, is represented by arctan (S / r).

Therefore, the direction α of the remote controller 15 can be obtained by measuring the distance r between the intersection of the lens 222 on the infrared line sensor 221 with the optical axis and the position of the pixel that receives infrared rays. ..

Next, FIG. 57 shows another configuration example of the master unit 1. In the drawings, the parts corresponding to the cases in FIG. 10 are designated by the same reference numerals, and the description thereof will be omitted as appropriate below. That is, the master unit 1 of FIG. 57 is configured in the same manner as in the case of FIG. 10, except that the connection detection unit 139 is newly provided.

[0768] The connection detection unit 139 electrically or mechanically detects that another television receiver is connected and supplies it to the CPU 129.

[0769] Therefore, in the embodiment of FIG. 57, the IEEE1394 terminal 21 on the terminal panel 21_ijInstead of the change in the terminal voltage in (Fig. 3F), the connection detection unit 139 detects the connection with another television receiver.

Next, FIG. 58 shows another configuration example of the slave unit 2. In the drawings, the parts corresponding to the cases in FIG. 11 are designated by the same reference numerals, and the description thereof will be omitted as appropriate below. That is, the slave unit 2 of FIG. 58 has the same configuration as that of FIG. 11 except that the connection detection unit 159 is newly provided.

[0771] The connection detection unit 159 electrically or mechanically detects that another television receiver is connected and supplies it to the CPU 149.

[0772] Therefore, in the embodiment of FIG. 58, the IEEE1394 terminal 41 on the terminal panel 41 is similar to the case of the embodiment of FIG. 57.₁Instead of the change in the terminal voltage in (Fig. 5F), the connection detection unit 159 detects the connection with another television receiver.

[0773] Next, the series of processes described above can be performed by hardware or software. When a series of processes is performed by software, the programs constituting the software are installed on a general-purpose computer or the like.

[0774] Therefore, FIG. 59 shows a configuration example of an embodiment of a computer in which a program for executing the above-mentioned series of processes is installed.

[0775] The program can be recorded in advance on the hard disk 305 or ROM 303 as a recording medium built in the computer.

Alternatively, the program can be used on a removable recording medium 311 such as a flexible disc, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disc, a DVD (Digital Versatile Disc), a magnetic disc, or a semiconductor memory. It can be temporarily or permanently stored (recorded). Such a removable recording medium 311 can be provided as so-called package software.

[0777] In addition to installing the program on the computer from the removable recording medium 311 as described above, the program can be wirelessly transferred from the download site to the computer via an artificial satellite for digital satellite broadcasting, or LAN (Local Area). It is transferred to a computer by wire via a network such as Network) or the Internet, and the computer can receive the program transferred in this way by the communication unit 308 and install it on the built-in hard disk 305.

[0778] The computer has a built-in CPU (Central Processing Unit) 302. The input / output interface 310 is connected to the CPU 302 via the bus 301, and the CPU 302 is operated by the user via the input / output interface 310 by the input unit 307 composed of a keyboard, a mouse, a microphone, and the like. When a command is input by equalizing, the program stored in ROM (Read Only Memory) 303 is executed accordingly. Alternatively, the CPU 302 is also transferred from a program stored in the hard disk 305, a satellite or a network, received by the communication unit 308 and installed in the hard disk 305, or from a removable recording medium 311 mounted in the drive 309. The program that was read and installed on the hard disk 305 is stored in RAM (Random Access). Load it into Memory) 304 and execute it. As a result, the CPU 302 performs processing according to the above-mentioned flowchart or processing performed according to the above-mentioned block diagram configuration. Then, the CPU 302 outputs the processing result from the output unit 306 composed of an LCD (Liquid CryStal Display), a speaker, or the like, or from the communication unit 308, if necessary, via the input / output interface 310, for example. Send it, and record it on the hard disk 305.

[0779] Here, in the present specification, the processing steps for describing a program for causing a computer to perform various processes do not necessarily have to be processed in chronological order in the order described as a flowchart, and are parallel. Alternatively, it also includes processes executed individually (for example, parallel processes or processes by objects).

[0780] Further, the program may be processed by one computer or may be distributed processed by a plurality of computers. Further, the program may be transferred to a distant computer and executed.

[0781] The scalable TV system described above can be configured by either a digital or analog television receiver.

[0782] Further, the television receiver constituting the scalable TV system is, for example, whether the television receiver is a master unit or a slave unit, and if it is a slave unit, the number of slave units. Depending on whether or not there is, it is possible to make a difference in the selling price.

That is, in the scalable TV system, as described above, if the master unit does not exist, the special function is not provided, so that the value of the master unit is high, and therefore the selling price can be set high. it can.

[0784] Further, it is expected that the user will purchase additional slave units at any time after purchasing the master unit, but for the first few slave units, for example, the price is lower than that of the master unit. However, it is possible to set a higher selling price than a general television receiver. Then, for the slave unit purchased after that, a lower selling price can be set.

[0785] The television receiver, which is a master unit constituting the scalable TV system, is, for example, a signal processing unit 137 added to a general digital television receiver and a program to be executed by the CPU 129 is changed. It is possible to configure by doing. Therefore, the television receiver, which is the master unit constituting the scalable TV system, can be relatively easily manufactured by using a general digital television receiver, and thus the above-mentioned mentioned above provided by the scalable TV system. Considering such special functions, it can be said that its cost merit (cost performance) is high. The same applies to the television receiver as a slave unit.

[0786] Further, the present invention can be applied not only to a television receiver which is a display device having a built-in tuner, but also to a display device which outputs images and sounds from the outside without having a built-in tuner.

[Effect of the Invention] As described above, according to the present invention, when a large number of display devices are connected and used, higher functionality can be realized as compared with the case where a large number of display devices are used alone.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a perspective view showing a configuration example of an embodiment of a scalable TV system to which the present invention is applied.

FIG. 2 is a perspective view showing an example of an external configuration of the master unit 1.

FIG. 3 is a six-view view showing an example of an external configuration of the master unit 1.

FIG. 4 is a perspective view showing an example of an external configuration of the slave unit 2.

FIG. 5 is a six-view view showing an example of an external configuration of the slave unit 2.

FIG. 6 is a perspective view showing an example of an external configuration of a dedicated rack for accommodating a master unit 1 and a slave unit 2 constituting a scalable TV system.

FIG. 7 is a plan view showing an example of an external configuration of the remote controller 15.

FIG. 8 is a plan view showing an example of an external configuration of the remote controller 35.

FIG. 9 is a plan view showing another external configuration example of the remote controller 15.

FIG. 10 is a block diagram showing an example of an electrical configuration of the master unit 1.

FIG. 11 is a block diagram showing an example of an electrical configuration of the slave unit 2.

FIG. 12 is a diagram showing a layer structure of an IEEE1394 communication protocol.

FIG. 13 is a diagram showing an address space of a CSR architecture.

FIG. 14 is a diagram showing the offset address, name, and function of the CSR.

FIG. 15 is a diagram showing a general ROM format.

FIG. 16 is a diagram showing details of a bus info block, a root directory, and a unit directory.

FIG. 17 is a diagram showing the configuration of PCR.

FIG. 18 is a diagram showing the configurations of oMPR, oPCR, iMPR, and iPCR.

FIG. 19 is a diagram showing a data structure of a packet transmitted in an asynchronous transfer mode of an AV / C command.

FIG. 20 is a diagram showing a specific example of an AV / C command.

FIG. 21 is a diagram showing a specific example of an AV / C command and a response.

FIG. 22 is a block diagram showing a detailed configuration example of the signal processing unit 137.

FIG. 23 is a flowchart illustrating an image conversion process by the signal processing unit 137.

FIG. 24 is a block diagram showing a configuration example of a learning device.

FIG. 25 is a diagram for explaining the processing of the student data generation unit 173.

FIG. 26 is a flowchart illustrating a learning process of coefficient type data by a learning device.

FIG. 27 is a diagram for explaining a learning method of coefficient type data.

FIG. 28 is a block diagram showing another configuration example of the learning device.

FIG. 29 is a block diagram showing a configuration example of the signal processing unit 157.

FIG. 30 is a flowchart illustrating processing of the master unit 1.

FIG. 31 is a flowchart illustrating an authentication process by the master unit 1.

FIG. 32 is a flowchart illustrating processing of the slave unit 2.

FIG. 33 is a flowchart illustrating an authentication process by the slave unit 2.

FIG. 34 is a flowchart illustrating a closed caption process by the master unit 1.

FIG. 35 is a flowchart illustrating a closed caption process by the slave unit 2.

FIG. 36 is a flowchart illustrating a partial enlargement process by the master unit 1.

FIG. 37 is a flowchart illustrating a partial enlargement process by the slave unit 2.

FIG. 38 is a diagram showing a display example of a scalable TV system when a partial enlargement process is performed.

FIG. 39 is a flowchart illustrating an overall enlargement process by the master unit 1.

FIG. 40 is a diagram for explaining how to obtain a display range and an enlarged range.

FIG. 41 is a flowchart illustrating an overall enlargement process by the slave unit 2.

FIG. 42 is a diagram showing a display example of a scalable TV system when the entire enlargement process is performed.

FIG. 43 is a flowchart illustrating a multi-screen display process by the master unit 1.

FIG. 44 is a flowchart illustrating a batch simultaneous control process by the master unit 1.

FIG. 45 is a diagram showing a display example of a scalable TV system when batch simultaneous control processing is performed.

FIG. 46 is a flowchart illustrating individual processing by the master unit 1.

FIG. 47 is a flowchart illustrating individual processing by the slave unit 2.

FIG. 48 is a flowchart illustrating a speaker control process by the master unit 1.

FIG. 49 is a diagram showing an intensity vs. distance table.

FIG. 50 is a diagram for explaining a method of calculating the distance to the remote controller 15.

FIG. 51 is a flowchart illustrating a speaker control process by the slave unit 2.

FIG. 52 is a block diagram showing a configuration example of a speaker unit 12L.

FIG. 53 is a diagram showing directivity.

FIG. 54 is a diagram showing directivity.

FIG. 55 is a diagram for explaining a method of detecting the direction of the remote controller 15.

FIG. 56 is a diagram showing a configuration example of an IR receiver 135.

FIG. 57 is a block diagram showing another electrical configuration example of the master unit 1.

FIG. 58 is a block diagram showing another electrical configuration example of the slave unit 2.

FIG. 59 is a block diagram showing a configuration example of an embodiment of a computer to which the present invention is applied.

[Explanation of symbols] 1 Master unit, 2, 2₁₁,2₁₂,2₁₃,2₁₄,2₁₅,2₂₁,2₂₂,2₂₃,2₂₄,2₂₅,2₃₁,2₃₂,2₃₃,2₃₄,2₃₅,2₄₁,2₄₂,2₄₃,2₄₄,2₄₅,2₅₁,2₅₂,2₅₃,2₅₄,2₅₅ Slave unit, 11 CRT, 12L, 12R speaker unit, 15 remote control, 21 terminal panel, 21₁₁,21₁₂,21₁₃,21₂₁,21₂₃,21₃₁,21₃₂,21₃₃ IEEE1394 terminal, 22 antenna terminal, 23 input terminal, 24 output terminal, 31 CRT, 32L, 32R speaker unit, 35 remote control, 41 terminal panel, 41₁ IEEE1394 terminal, 42 antenna terminal, 43 input terminal, 44 output terminal, 51 select button switch, 52 volume button switch, 53 channel up / down button switch, 54 menu button switch, 55 exit button switch, 56 display button, 57 enter button switch , 58 Number button (ten key) switch, 59 TV / video selector button switch, 60 TV / DSS selector button switch, 61 jump button switch, 62 language button, 63 guide button switch, 64 favorite button switch, 65 cable button switch, 66 TV switch, 67 DSS button switch, 68-70 LED, 71 cable power button switch, 72 TV power button switch, 73 DSS power button switch, 74 muting button switch, 75 sleep button switch, 76 light emitting part, 81 Select Button Switch, 82 Volume Button Switch, 83 Channel Up / Down Button Switch, 84 Menu Button Switch, 85 Exit Button Switch, 86 Display Button, 87 Enter Button Switch, 88 Number Button (Ten Key) Switch, 89 TV / Video Selector Button Switch, 90 TV / DSS selector button switch, 91 jump button switch, 92 language button, 93 guide button switch, 94 favorite button switch, 95 cable button switch, 96 TV switch, 97 DSS button switch, 98-100LED, 101 cable power supply Button Switch, 102 TV Power Button Switch, 103 DSS Power Button Switch, 104 Muting Button Switch, 105 Sleep Button Switch, 106 Light Emitting Unit, 110 Button Switch, 111-114 Directional Button Switch, 121 Tuner, 122 QPSK demodulation circuit, 123 error correction circuit, 124 demultiplexer, 125 MPEG video decoder, 126 MPEG audio decoder, 127 frame memory, 128 NTSC encoder, 129 CPU, 130 EEPROM, 131 ROM, 132RAM, 133 IEEE1394 interface, 134 front panel , 135 IR receiver, 135A, 135B receiver, 136 modem, 137 signal processing unit, 137A DSP, 137B EEPROM, 137C RAM, 138 unit drive unit, 139 connection detector, 141 tuner, 142 QPSK demodulation circuit, 143 error correction Circuit, 144 Demultiplexer, 145 MPEG Video Decoder, 146 MPEG Audio Decoder, 147 Frame Memory, 148 NTSC Encoder, 149 CPU, 150 EEPROM, 151 ROM, 152 RAM, 153 IEEE1394 interface, 154 front panel, 155 IR receiver, 156 modem, 157 signal processing unit, 157A DSP, 157B EEPROM, 157C RAM, 158 unit drive unit, 159 connection detection unit, 161,162 tap extraction unit, 163 class classification unit, 164 Coefficient memory, 165 Prediction unit, 166 Coefficient generation unit, 167 Coefficient seed memory, 168 Parameter memory, 171 Teacher data generation unit, 172 Teacher data storage unit, 173 Student data generation unit, 174 Student data storage unit, 175, 176 Tap extraction unit , 177 Class classification part, 178 Addition part, 179 Coefficient type calculation part, 180 Parameter generation part, 190 Addition part, 191 Tap coefficient calculation part, 192 Addition part, 193 Coefficient type calculation part, 201,202 Tap extraction part, 203 Classification section, 204 Coefficient memory, 205 Prediction section, 206 Coefficient generator, 207 Coefficient seed memory, 208 Parameter memory, 211₁,211₂ Digital filter, 212₁,212₂ Speaker, 221 Infrared line sensor, 222 lens, 301 bus, 302 CPU, 303 ROM, 304 RAM, 305 hard disk, 306 output, 307 input, 308 communication, 309 drive, 310 input / output interface, 311 removable recording medium