Peripheral control system, display device, and peripheral

TECHNICAL FIELD

The present invention relates to a peripheral control system, a display device, and a peripheral, and to a peripheral control system enabling a display device to operate a peripheral connected to the display device, a display device making up the system, and a peripheral.

BACKGROUND ART

Up until now, it has been performed to operate peripherals such as a recorder, a player, an STB (Set Top Box), and an AV amplifier through a television apparatus (TV) by connecting the peripherals to the television. For example, Patent Document 1 describes a television set capable of displaying, on its screen, operation panels for operating the peripherals. In the case of the television set described in Patent Document 1, when a menu display key of a remote control is depressed, there appear selectably on the screen a VTR, a VHD, a BS tuner, a teletext receiver, etc., as peripherals connected to the television set. Then, when the user operates the remote control to selectively specify one of the peripherals, an operation panel corresponding to the specified one appears on the television screen.

PRIOR ART DOCUMENTS

Patent Document

<ul><li id="ul0001-0001" num="0003">Patent Document 1: Japanese Laid-Open Patent Publication No. 62-21379</li></ul>

SUMMARY OF THE INVENTION

Problem to be Solved by the Invention

In the method described in Patent Document 1, however, the television prepares in advance the operation panels for the peripherals and changes over the operation panels in response to a specification from the user, and therefore, the television is merely allowed to connect to only the predetermined peripherals at all times. That is, the television retains in advance operation panels for specified peripherals, and hence, if the specified peripherals are connected, the television can display operation panels corresponding thereto, but if a peripheral other than the specified ones is connected, the television cannot display any operation panel since it retains no corresponding operation panel.

In this manner, when operating peripherals through the television, the operation has hitherto been limited to peripherals corresponding to operation panels retained in advance by the television, as a result of which even if the user tries connecting a new peripheral to the television, the operation through the television may be difficult to perform, leading to a problem of lacking in the expandability in the operation of the peripherals.

The present invention was conceived in view of the above circumstances, and it is an object thereof to provide a peripheral control system, a display device making up the system, and a peripheral, the peripheral control system capable of enhancing the expandability in the operation of peripherals, by enabling the customization and display of operation panels for each of the peripherals irrespective of whether the display device retains the operation panels.

Means for Solving the Problem

In order to solve the above problem, a first technical means of the present invention is a peripheral control system having at least one peripheral and a display device capable of displaying an operation panel of the peripheral connected thereto, wherein the display device comprises a first memory portion that stores operation panel information containing array information for arraying on a screen image data for operation buttons making up the operation panel of the peripheral, the peripheral comprises a second memory portion that stores the image data for operation buttons and an image data sending portion that sends the image data for operation buttons stored in the second memory portion to the display device in correspondence with the array information depending on the operation panel information acquired from the display device, and the display device disposes and displays the image data for operation buttons sent from the peripheral at a position corresponding to the array information when displaying the operation panel of the peripheral.

A second technical means is the peripheral control system as defined in the first technical means, wherein when one of the image data for operation buttons is selectively specified by a user, the display device sends the array information of the selectively specified image data to the peripheral, and wherein the peripheral comprises a data table that correlates the array information sent to the display device with functions allocated to each of the image data for operation buttons, specifies from the data table a function corresponding to the array information of the image data sent from the display device, and executes the specified function.

A third technical means is the peripheral control system as defined in the first technical means, wherein the display device scales an input video signal such that a display region of the input video signal does not overlap with a display region of the operation panel of the peripheral.

A fourth technical means is the peripheral control system as defined in the first technical means, wherein when sending the image data for operation buttons correlating to the array information to the display device, the peripheral sends attribute information indicative of an attribute of each of the image data for operation buttons to the display device.

A fifth technical means is the peripheral information display system as defined in the fourth technical means, wherein the attribute information is information indicative of whether the image data for operation buttons have a function as an operation button or have a function of a display only.

A sixth technical means is the peripheral information display system as defined in the first technical means, wherein the operation panel information includes display size information indicative of a display region size and a display position of the operation panel, and a display size of the image data for operation buttons, the array information containing arrayable positions and number of the image data for operation buttons.

A seventh technical means is the peripheral information display system as defined in the sixth technical means, wherein the array information indicates in a form of a matrix pattern the arrayable positions and number of the image data for operation buttons.

An eighth technical means is the peripheral information display system as defined in the seventh technical means, wherein the peripheral, stores and has plural types of array patterns of the image data for operation buttons, determines whether one of the plural types of array patterns coincides with a matrix pattern indicated by the array information sent from the display device, selects the coincident array pattern, if coincides, and, if not, selects a maximum array pattern accommodated within the matrix pattern indicated by the array information.

A ninth technical means is the peripheral information display system as defined in the sixth technical means, the peripheral has a first display size of the image data for operation buttons, and wherein if the first display size does not coincide with a second display size indicated by the display size information sent from the display device, then the peripheral sends, to the display device, offset information for adjusting a position to array the image data of the first display size so as to fit the second display size when sending the image data for operation buttons in correspondence with the array information to the display device.

A tenth technical means is the peripheral information display system as defined in the sixth technical means, wherein the peripheral has a first display size of the image data for operation buttons, and wherein if the first display size does not coincide with a second display size indicated by the display size information sent from the display device, then the peripheral resizes the image data of the first display size so as to fit the second display size when sending the image data for operation buttons in correspondence with the array information to the display device.

An eleventh technical means is the peripheral information display system as defined in the sixth technical means, wherein the peripheral sends, to the display device, combination information for combining a plurality of array positions indicated by the array information when sending to the display device the image data for operation buttons by correlating to the array information.

A twelfth technical means is the peripheral information display system as defined in the first technical means, wherein the display device stores and has the image data for operation buttons sent from the peripheral together with identification information of the peripheral by correlating to the array information, and wherein at the time of next connection with the peripheral, the display device specifies the image data for operation buttons stored in the display device, based on the identification information of the peripheral, the display device disposing and displaying the specified image data at a position corresponding to the array information.

A thirteenth technical means is the peripheral information display system as defined in the first technical means, wherein the peripheral sends to the display device a plurality of image data differing for each operation status for one operation button, and wherein the display device changes over and displays the plurality of image data of the operation button sent from the peripheral, depending on the operation status of the operation button.

A fourteenth technical means is the peripheral information display system as defined in the first technical means, wherein the display device determines whether the peripheral supports operation panel display function provided by the peripheral control system, if supports, sends the operation panel information to the peripheral, and, if not, displays a default operation panel corresponding to the peripheral held by the display device.

A fifteenth technical means is the peripheral information display system as defined in the first technical means, wherein the peripheral notifies the display device of substituting some of the operation buttons making up the operation panel of the peripheral with operation buttons of a default operation panel corresponding to the peripheral held by the display device, depending on the operation panel information sent from the display device, and simultaneously sends to the display device remaining image data for operation buttons making up the operation panel of the peripheral by correlating to the array information.

A sixteenth technical means is the peripheral information display system as defined in the fifteenth technical means, wherein when, based on a notice from the peripheral, substituting some of the operation buttons making up the operation panel of the peripheral with operation buttons of a default operation panel corresponding to the peripheral held by the display device, if the substituted operation button is selectively specified by the user, then the display device sends an operation command corresponding to the selectively specified operation button to the peripheral.

A seventeenth technical means is a display device making up the peripheral control system as defined in the first technical means.

An eighteenth technical means is a peripheral the peripheral control system as defined in the first technical means.

Effect of the Invention

According to the present invention, the operation panel can be customized and displayed on a peripheral-by-peripheral basis irrespective of whether the display device retains the operation panel, to thereby enable the expandability to be enhanced in the operations of the peripherals. This enables domestic peripherals to be linked to the television, allowing more peripherals to be operated through the television.

BRIEF DESCRIPTION OF DRAWINGS

<figref idrefs="DRAWINGS">FIG. 1</figref> is a diagram depicting an exemplary configuration of a peripheral control system according to the present invention.

<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram for explaining the exemplary configuration of the peripheral control system depicted in <figref idrefs="DRAWINGS">FIG. 1</figref>.

<figref idrefs="DRAWINGS">FIG. 3</figref> is a diagram for explaining an example of setting of an operation panel display region of a recorder on a display screen of a TV.

<figref idrefs="DRAWINGS">FIG. 4</figref> is a diagram depicting an example of a method of the recorder acquiring operation panel information from the TV.

<figref idrefs="DRAWINGS">FIG. 5</figref> is a diagram depicting an example of a data table stored in the recorder.

<figref idrefs="DRAWINGS">FIG. 6</figref> is a diagram depicting an example of a display size of image data for operation buttons depicted in <figref idrefs="DRAWINGS">FIG. 5</figref>.

<figref idrefs="DRAWINGS">FIG. 7</figref> is a diagram depicting an example of array patterns of the image data for operation buttons retained by the recorder.

<figref idrefs="DRAWINGS">FIG. 8</figref> is a diagram depicting an example of the array patterns of the image data for operation buttons retained by the recorder.

<figref idrefs="DRAWINGS">FIG. 9</figref> is a diagram for explaining an example of operation panel optimization processing effected by the recorder.

<figref idrefs="DRAWINGS">FIG. 10</figref> is a diagram for explaining offset processing of image data for operation buttons.

<figref idrefs="DRAWINGS">FIG. 11</figref> is a diagram for explaining combination processing that combines a plurality of regions.

<figref idrefs="DRAWINGS">FIG. 12</figref> is a diagram for explaining an example of processing performed when arraying a power button at a coordinate A<b>1</b>.

<figref idrefs="DRAWINGS">FIG. 13</figref> is a diagram for explaining an example of processing performed when blanking a region of a coordinate C<b>1</b>.

<figref idrefs="DRAWINGS">FIG. 14</figref> is a diagram for explaining an example of processing performed when combining a region of a coordinate A<b>5</b> and a region of a coordinate B<b>5</b> to array a record button thereon.

<figref idrefs="DRAWINGS">FIG. 15</figref> is a diagram depicting an action example when displaying a default operation panel.

<figref idrefs="DRAWINGS">FIG. 16</figref> is a diagram depicting an example of a startup procedure of the operation panel in the case of connecting a plurality of peripherals.

<figref idrefs="DRAWINGS">FIG. 17</figref> is a diagram depicting a display example of the default operation panel.

<figref idrefs="DRAWINGS">FIG. 18</figref> is a diagram depicting a screen transition example of the default operation panel.

<figref idrefs="DRAWINGS">FIG. 19</figref> is a diagram for explaining an action example when displaying a custom operation panel according to the present invention.

<figref idrefs="DRAWINGS">FIG. 20</figref> is a diagram for explaining an action example when displaying the custom operation panel according to the present invention.

<figref idrefs="DRAWINGS">FIG. 21</figref> is a diagram for explaining a display example of the custom operation panel according to the present invention.

<figref idrefs="DRAWINGS">FIG. 22</figref> is a diagram for explaining another display example of the custom operation panel according to the present invention.

<figref idrefs="DRAWINGS">FIG. 23</figref> is a diagram for explaining a further display example of the custom operation panel according to the present invention.

<figref idrefs="DRAWINGS">FIG. 24</figref> is a diagram for explaining an action example when image data for operation buttons are stored and reused in the TV.

MODES FOR CARRYING OUT THE INVENTION

Referring to the accompanying drawings, preferred embodiments will now be described of a peripheral control system, a display device configuring the system, and a peripheral, according to the present invention. The embodiments of the present invention will describe a case where the display device and the peripherals are connected to each other via an HDMI (High Definition Multimedia Interface).

More specifically, a function of HDMI Ethernet (registered trademark) Channel (hereinafter, referred to as HDMI HEC) in which two-way communications of Ethernet (registered trademark) signals are carried out through an HDMI cable is added in HDMI standard (version 1.4) published on May 28, 2009. This HDMI HEC-enabled HDMI is utilized. Naturally, the other communication means may be utilized such as HDMI CEC (Consumer Electronics Control), IEEE1394, LAN (Local Area Network), PLC (Power Line Communications), radio communication, and optical communication.

<figref idrefs="DRAWINGS">FIG. 1</figref> is a diagram depicting an exemplary configuration of a peripheral control system according to the present invention, in which 10 denotes a picture recording device (recorder) that is an example of the peripheral, <b>20</b> denotes a display device (TV), and <b>40</b> denotes an HDMI HEC-enabled HDMI cable. The recorder <b>10</b> and the TV <b>20</b> are connected to each other via the HDMI cable <b>40</b>, enabling through the signal cable a transmission of video/audio signals, a transmission of Ethernet (registered trademark) signals, and a transmission of commands for device-to-device controls.

The HDMI will now be simply described. The HDMI is a digital interface for digitally connecting the TV and the peripherals and is adapted for the AV device by adding an audio transmission function and a copyright protection function to DVI that is connection standard specifications for the PC and the display. Until now, a plurality of cables for respective signals for video, audio, and control have been used for connecting the TV and the peripherals, but the HDMI merely requires a single cable so that wiring between the TV and the peripherals can be simplified.

Basic specifications as the standard for HDMI were formulated (HDMI standard version 1.0) in December, 2002 by HDMI Licensing, LLC that is a standardization organization, and thereafter the provision of CEC (Consumer Electronics Control) was added thereto as a control protocol for performing the control between AV devices in December, 2005 (HDMI standard version 1.2a).

Terms on CEC are defined in HDMI standard “2.2. Glossary of Terms”, “CEC 2.2 Glossary of Terms”, etc., in which a Sink device is defined as one having an HDMI input terminal to display output an AV stream, with a Source device defined as one having an HDMI output terminal to output the AV stream, and with a Repeater device defined as one having both the HDMI input terminal and the HDMI output terminal to input and output (transfer) the AV stream.

The HDMI standard defines a device-to-device control using the CEC. This CEC enables various controls based on proper physical addresses and logical addresses allocated to peripherals existing on an HDMI network. For example, if a DVD player connected via the HDMI is reproduced when the user views digital broadcasting, the television automatically performs a switch to the input to which the DVD player is connected. The remote control of the television may be used to operate a menu displayed on the DVD player or the power on/off thereof.

<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram for explaining the exemplary configuration of the peripheral control system depicted in <figref idrefs="DRAWINGS">FIG. 1</figref>, the block diagram depicting the configuration where the recorder <b>10</b> and the TV <b>20</b> are connected via the HDMI cable <b>40</b>.

The HDMI cable <b>40</b> includes a TMDS (Transition Minimized Differential Signaling) line <b>41</b> that transmits a video/audio stream as digital signals in a differential mode, a CEC line <b>42</b> that is a bidirectional bus for transmitting a control signal (CEC message) common to the peripherals, and an HEC line <b>43</b> that performs a two-way communication of the Ethernet (registered trademark) signal. The HDMI cable <b>40</b> further includes an I2C line that is used e.g., for sending EDID (Extended Display Identification Data) or for HDCP (High-bandwidth Digital Content Protection System) authentication.

The recorder <b>10</b> is provided with an HDMI transmitter <b>11</b>, a main microcomputer <b>12</b>, a front microcomputer <b>13</b>, a CEC I/F <b>14</b>, a communication I/F <b>15</b>, a remote control light receiving portion <b>16</b>, an HDMI connector <b>17</b>, a LAN I/F <b>18</b>, and a memory portion <b>19</b>.

The HDMI transmitter <b>11</b> is connected via the HDMI connector <b>17</b> to the TMDS line <b>41</b> inside the HDMI cable <b>40</b>, and reads out video data and audio data recorded in a recording medium such as a BD or a DVD for example to convert into an HDMI format stream consisting of video signals and audio signals interposed in blanking periods of the video signals. The stream obtained by the conversion is transmitted through the TMDS line <b>41</b> to the TV <b>20</b>.

The main microcomputer <b>12</b> is a main CPU that controls the entire device and includes an HDMI controller to control the actions of the HDMI transmitter <b>11</b> and the LAN I/F <b>18</b>.

The CEC I/F <b>14</b> is connected via the HDMI connector <b>17</b> to the CEC line <b>42</b> inside the HDMI cable <b>40</b> and enables a two-way communication of the CEC message with the TV <b>20</b>. The action of the CEC I/F <b>14</b> is controlled by the front microcomputer <b>13</b> that includes a CEC controller, enabling the HDMI connected devices to be controlled by the CEC message. In the case of the CEC, the logical address (the device type) and the physical address (the device position) of each of the HDMI connected devices are acquired so that the CEC message can be sent to a desired device by specifying these logical address and physical address.

The front microcomputer <b>13</b> works with a low electric power and monitors at all times the CEC message transferred from the CEC line <b>42</b>. The front microcomputer <b>13</b> is a sub-CPU that controls the remote control light receiving portion <b>16</b> receiving a remote control signal from a remote control device not depicted. Then, even when the main microcomputer <b>12</b> is powered off during the device standby mode, etc., the front microcomputer <b>13</b> operates and keeps enabling the sending/reception of the CEC message and the reception of the remote control signal.

The communication I/F <b>15</b> serves to perform a communication with the TV <b>20</b> via other means than the HDMI, allowing a connection with the TV <b>20</b> through communication means such as IEEE1394, LAN, PLC, radio communication, and optical communication, for example.

The LAN I/F <b>18</b> is connected via the HDMI connector <b>17</b> to the HEC line <b>43</b> inside the HDMI cable <b>40</b>, to enable a two-way communication of the Ethernet (registered trademark) signals with the TV <b>20</b>. The LAN I/F <b>18</b> may be incorporated within the HDMI transmitter <b>11</b>.

The memory portion <b>19</b> is a nonvolatile memory such as an EEPROM (Electrically Erasable and Programmable Read Only Memory) that stores the logical addresses and the physical addresses in the HDMI and stores image data for operation buttons which will be described later. The memory portion <b>19</b> is accessed as needed by the front microcomputer <b>13</b> or the main microcomputer <b>12</b> for the execution of data reading or writing. The memory portion <b>19</b> is not limited to the EEPROM, but instead it may be for example an HD (hard disc), a flash memory, etc.

The TV <b>20</b> is provided with a main microcomputer <b>21</b>, an HDMI receiver <b>22</b>, a monitor microcomputer <b>23</b>, a CEC I/F <b>24</b>, a communication I/F <b>25</b>, a remote control light receiving portion <b>26</b>, an HDMI connector <b>27</b>, a LAN I/F <b>28</b>, a memory portion <b>29</b>, and a display portion <b>30</b>. A tuner is not depicted.

The HDMI receiver <b>22</b> is connected via the HDMI connector <b>27</b> to the TMDS line <b>41</b> inside the HDMI cable <b>40</b> and receives a stream transferred from the recorder <b>10</b>. The HDMI receiver <b>22</b> may be incorporated within the main microcomputer <b>21</b>.

The main microcomputer <b>21</b> is a main CPU that controls the entire device and includes an HDMI controller to control the actions of the HDMI receiver <b>22</b> and the LAN I/F <b>28</b>.

The CEC I/F <b>24</b> is connected via the HDMI connector <b>27</b> to the CEC line <b>42</b> inside the HDMI cable <b>40</b> and enables a two-way communication of the CEC message with the recorder <b>10</b>. The action of the CEC I/F <b>24</b> is controlled by the monitor microcomputer <b>23</b> that includes the CEC controller, enabling the HDMI connected devices to be controlled by the CEC message.

The monitor microcomputer <b>23</b> works with a low electric power and monitors at all times the CEC message transferred from the CEC line <b>42</b>. The monitor microcomputer <b>23</b> is a sub-CPU that controls the remote control light receiving portion <b>26</b> receiving a remote control signal from a remote control device R. Then, even when the main microcomputer <b>21</b> is powered off during the device standby mode, etc., the monitor microcomputer <b>23</b> operates and keeps enabling the sending/reception of the CEC message and the reception of the remote control signal.

The communication I/F <b>25</b> is intended to perform a communication with the recorder <b>10</b> via other means than the HDMI, allowing a connection with the recorder <b>10</b> through communication means such as IEEE1394, LAN, PLC, radio communication, and optical communication, for example.

The LAN I/F <b>28</b> is connected via the HDMI connector <b>27</b> to the HEC line <b>43</b> in the HDMI cable <b>40</b> and enables a two-way communication of the Ethernet (registered trademark) signals with the recorder <b>10</b>. The LAN I/F <b>28</b> may be incorporated within the HDMI receiver <b>22</b>.

The memory portion <b>29</b> is a nonvolatile memory such as the EEPROM that stores the logical addresses and the physical addresses in the HDMI and that stores operation panel information which will be described later. The memory portion <b>29</b> is accessed when necessary by the monitor microcomputer <b>23</b> or the main microcomputer <b>21</b> for the execution of data reading or writing. The memory portion <b>29</b> is not limited to the EEPROM, but instead it may be for example the HD (hard disc), the flash memory, etc.

The display portion <b>30</b> is configured from a display such as an LCD (Liquid Crystal Display). In the TV <b>20</b>, video/audio of the stream is separated by the HDMI receiver <b>22</b> and, if required, predetermined video signal processing and audio signal processing are performed to display a video on the display portion <b>30</b> and a sound is output from a loudspeaker (not depicted).

A main feature of the present invention lies in that the expandability in the operation of peripherals can be enhanced by making it possible to customize and display the operation panels on a peripheral-by-peripheral basis irrespective of whether the display device retains the operation panel. In the above example, the display device and the peripheral correspond respectively to the TV <b>20</b> and recorder <b>10</b>.

The TV <b>20</b> has the memory portion <b>29</b> corresponding to a first memory portion that operation panel information including array information for arranging, on the screen, image data for operation buttons making up the operation panel of the recorder <b>10</b>. The recorder <b>10</b> is provided with the memory portion <b>19</b> corresponding to a second memory portion that stores image data for operation buttons and the LAN I/F <b>18</b> corresponding to an image data sending portion that sends the image data for operation buttons stored in the memory portion <b>19</b> in correspondence with the array information to the TV <b>20</b>, depending on the operation panel information acquired from the TV <b>20</b>. When displaying the operation panel of the recorder <b>10</b>, the TV <b>20</b> arranges and displays the image data for operation buttons sent from the recorder <b>10</b> at positions corresponding to the array information.

Then, when any image data for operation buttons is selectively specified by the user, the TV <b>20</b> sends the array information on the selectively specified image data to the recorder <b>10</b>. The recorder <b>10</b> is provided with a data table that correlates the array information sent to the TV <b>20</b> with functions allocated respectively to the image data for operation buttons, and the recorder <b>10</b> is controlled to identify from the data table a function corresponding to the array information on the image data sent from the recorder <b>10</b>, to execute the identified function. The data table is intended to be stored in the memory portion <b>19</b>.

The operation panel information is intended to contain, specifically, in addition to the above array information, the display region size, the display position, the number of the display colors, and the display size of the image data for operation buttons, of the operation panel. The array information represents arrayable position and number of image data for operation buttons in the form of a matrix pattern of e.g., 3 columns (A, B, and C)×5 rows (1, 2, 3, 4, and 5), the number of image data arrayable being 15 in this case.

In the above, the image data for operation buttons include image data functioning as the operation buttons themselves and used as the real operation buttons, and image data used only for the representation such as operation guidance (operational explanation). The image data format may be any format as long as it can handle images of bitmap, JPEG (Joint Photographic Experts Group), etc.

The recorder <b>10</b> may send to the TV <b>20</b> attribute information together with image data of operation buttons and/or operation guidance and array information thereof (see <figref idrefs="DRAWINGS">FIG. 22</figref> described later). This attribute information is information indicative of whether the image data for operation buttons have functions as operation buttons or has a function of only the display. Then, the TV <b>20</b> can display the operation guidance button on the operation panel similar to the operation buttons, but since the attribute of the guidance button is only the display, control is provided such that even if the user acts on the remote control device R to depress the operation guidance button, the array information thereof is not sent to the recorder <b>10</b>. Control may also be provided such that the operation guidance button cannot be selected by preventing a cursor from moving thereto.

When the recorder <b>10</b> acquires 3 columns×5 rows as the array information from the TV <b>20</b>, it allocates the image data for operation buttons, for example, image data of “power button” to column A, row 1, and image data of “play button” to column A, row 2, and sends the image data for operation buttons in correspondence with the array information to the TV <b>20</b>. The recorder <b>10</b> stores the correspondence relationships (image data, array, and function) at that time as the data table in the memory portion <b>19</b>. Then, the TV <b>20</b> arrays and displays the image data for operation buttons sent form the recorder <b>10</b> in compliance with the positions (hereinafter, also called coordinates) indicated by the array information.

Although the TV <b>20</b> can display the operation panel containing the image data for operation buttons of the recorder <b>10</b> in this manner, the TV <b>20</b> has merely to provide the display region of the operation panel and the recorder <b>10</b> determines which one of operation button image data is to be disposed at which position, whereupon as long as supporting the operation panel expansion display function according to the present invention, any peripherals can display the operation panel.

When one of the image data for operation buttons on the screen is selectively specified by the user acting on the remote control device R, the TV <b>20</b> has only to send the coordinate of the image data for the operation button, not the operation command of that operation button, to the recorder <b>10</b>. Based on the coordinate sent from the TV <b>20</b>, the recorder <b>10</b> can specify a corresponding function and execute the function. For example, if the coordinate is “column A, row 2 (A<b>2</b>)”, “play button” is allocated thereto allowing the recorder <b>10</b> to execute a play.

In this manner, according to the present invention, the operation panel can be customized and displayed on a peripheral-by-peripheral basis irrespective of whether the display device retains the operation panel, thereby achieving enhanced expandability in the operation of the peripherals.

Although the recorder <b>10</b> acquires the operation panel information from the TV <b>20</b> at this time, two methods are conceivable in the case of the HDMI connection, i.e., a first method of utilizing the EDID and a second method of utilizing a vendor command of the CEC message.

The Sink device (TV <b>20</b> in this case) in conformity with the HDMI standard has the EDID in its internal memory. The EDID is an ID proper to the TV for transmitting the TV model name and set values (resolution, etc.) to the Source device (recorder <b>10</b> in this case) connected to the TV, and an HDMI control signal line (<b>12</b>C) is used for the interchange of the EDID. For example, when the recorder <b>10</b> is connected to the TV <b>20</b> via the HDMI, the recorder <b>20</b> accesses the TV <b>20</b> to read the EDID so that it can output videos at a resolution adapted to the TV <b>20</b>.

In the first method, the operation panel information is written in advance into the EDID. This allows the recorder <b>10</b> when accessing the TV <b>20</b> to read in and acquire the operation panel information contained in the EDID.

In the second method, the CEC message is sent together with the operation panel information added thereto from the TV <b>20</b> to the recorder <b>10</b>. Available as the CEC message may there be e.g., the vendor command that the maker can define on its own terms.

At this time, the TV <b>20</b> performs a scaling of the input video signal, which will be described below, so as to prevent the display region of the input video signal from overlapping the display region of the operation panel of the recorder <b>10</b>.

<figref idrefs="DRAWINGS">FIG. 3</figref> is a diagram for explaining an example of setting of the operation panel display region of the recorder <b>10</b> on the display screen of the TV <b>20</b>. <figref idrefs="DRAWINGS">FIG. 3(A)</figref> depicts an example of setting of the operation panel display region in which the operation panel of the recorder <b>10</b> is displayed, and <figref idrefs="DRAWINGS">FIG. 3(B)</figref> depicts a matrix information (array information) for arraying image data for operation buttons making up the operation panel.

In the example of <figref idrefs="DRAWINGS">FIG. 3(A)</figref>, the screen specifications of the display portion <b>30</b> of the TV <b>20</b> are such that the effective pixel count per line (horizontal direction) is 1920 pixels and that the effective pixel count in the vertical direction is 1080 pixels. The size of the video signal display region is 1536×1080, the size of the display region of the operation panel of the recorder <b>10</b> is 384×810, and the display position of the operation panel is (1536, 270). In this manner, the TV <b>20</b> sets in advance the display region of the operation panel of the recorder <b>10</b>. Then, the TV <b>20</b> scales and displays the input video signal so as to fit the display region size (1536×1080) of the video signal. The display region size of the operation panel may properly be determined depending on the inch size of the TV <b>20</b>.

For example, in the case where the user allows a display of the operation panel of the recorder <b>10</b> by the operation of the remote control device R during viewing a program on the TV <b>20</b>, the video signal of the program is subjected to the scaling so that the video in the program does not overlap with the operation panel.

This prevents the video in the program from being hidden by the operation panel during watching, and the visual recognizability is not impaired.

The example of <figref idrefs="DRAWINGS">FIG. 3(B)</figref> depicts a matrix pattern for arraying the image data for operation buttons making up the operation panel, in which example the display size of the image data for one operation button is set to 128×128, with these image data being arrayed in a matrix form of 3 columns (A, B, and C)×5 rows (1, 2, 3, 4, and 5). This case allows the array of 15 image data for operation buttons. Then, the TV <b>20</b> manages coordinates (in this case, column A, row 1; column A, row 2; . . . ) in 3 columns×5 rows, and, when receiving image data for an operation button and a corresponding coordinate from the recorder <b>10</b>, disposes the image data for the operation button at a position corresponding to the corresponding coordinate.

As set forth hereinabove, the operation panel information is composed of five pieces of information, i.e., the display region size, the display position, and the number of display colors of the operation panel as well as the display size of the image data for operation buttons and array information (matrix pattern) indicating, in a matrix form, the arrayable position and number of image data for operation buttons, and in this example, those being set to 384×810, (1536, 270), 256 colors, 128×128, and 3 columns, 5 rows in the mentioned order. Then, this operation panel information is acquired by the recorder <b>10</b>, by being sent to the recorder <b>10</b> from the TV <b>20</b> using the CEC message or by reading the EDID of the TV <b>20</b> by the recorder <b>10</b>.

<figref idrefs="DRAWINGS">FIG. 4</figref> is a diagram for explaining an example of a method of the recorder <b>19</b> acquiring the operation panel information from the TV <b>20</b>. In this case, the recorder <b>10</b> connected to the TV <b>20</b> does not necessarily support an operation panel display function of the present invention (i.e., an operation panel display function provided by the peripheral control system of the present invention). Accordingly, this example is configured such that, when the TV <b>20</b> and the recorder <b>10</b> are connected via the HDMI, the TV <b>20</b> inquires the support level of the recorder <b>10</b> and, depending on the result, sends the operation panel information to the recorder <b>10</b>.

First, the TV <b>20</b> inquires of the recorder <b>10</b> a support level for determining whether it supports the operation panel expansion display function according to the present invention (S<b>1</b>), and the recorder <b>10</b> returns (notifies) its own support level to the TV <b>20</b> (S<b>2</b>). The recorder <b>10</b> retains in advance its own support level in the internal memory and retains “level 1” if not supported and “level 2” if supported.

Then, the TV <b>20</b> determines whether recorder <b>10</b> supports the operation panel expansion display function, based on the support level returned from the recorder <b>10</b> (S<b>3</b>). At that time, if the return from the recorder <b>10</b> is “level 2”, then the TV <b>20</b> determines that the recorder <b>10</b> is a supporting peripheral (case of YES) and sends the operation panel information to the recorder <b>10</b> (S<b>4</b>). If the return from the recorder <b>10</b> is “level 1” at S<b>3</b>, then the TV <b>20</b> determines it as being an unsupporting peripheral (case of NO) and displays an operation panel for the default of the recorder <b>10</b> that the TV <b>20</b> has (S<b>5</b>). In the absence of any return to the inquiry at S<b>1</b>, the TV <b>20</b> may determine the recorder <b>10</b> as being unsupporting.

The operation panel for the default (hereinafter, referred to as default operation panel) of the recorder <b>10</b> at S<b>5</b> means an operation panel corresponding to the recorder <b>10</b> that the TV <b>20</b> has in advance, and it differs from the operation panel according to the present invention (hereinafter, it is often referred to as a custom operation panel). This default operation panel is intended, similar to the prior art, to allow the user to operate the remote control device R to send an operation command of an operation button selectively specified. In case that the peripheral connected to the TV <b>20</b> is an unsupporting peripheral and that the TV <b>20</b> has no default operation panel, the TV <b>20</b> desirably makes an error display, etc., since it cannot display the operation panel.

Although this example may use the vendor command of the CEC message for example for the communication between the TV <b>20</b> and the recorder <b>10</b>, the communication means is not limited to the CEC.

<figref idrefs="DRAWINGS">FIG. 5</figref> is a diagram depicting an example of a data table stored in the recorder <b>10</b>. The data table containing image data for operation buttons shown in this example shall be stored in the memory portion <b>19</b>. In this manner, the recorder <b>10</b> manages, in the form of the data table, a name, image data, and a function (remote control function corresponding to an operation button) for each of the operation buttons. Then, when determining a coordinate of the image data for the operation button in accordance with the operation panel information from the TV <b>20</b>, it adds the coordinate to the data table. This allows the coordinates of the image data for operation buttons to be correlated with the function of each of the operation buttons, so that, based on the data table, the recorder <b>10</b> can specify and execute a function corresponding to the coordinate sent from the TV <b>20</b>.

<figref idrefs="DRAWINGS">FIG. 6</figref> is a diagram depicting an example of the display size of the image data for operation buttons depicted in <figref idrefs="DRAWINGS">FIG. 5</figref>. In this example, the image data for operation buttons are each defined as having a display size of 100×80. Information on this display size shall be retained in the memory portion <b>19</b> of the recorder <b>10</b>. Although the display size of the image data for operation buttons is properly optimized based on the operation panel information acquired from the TV <b>20</b>, this will hereinafter be described referring to <figref idrefs="DRAWINGS">FIG. 9</figref>.

<figref idrefs="DRAWINGS">FIGS. 7 and 8</figref> are diagrams depicting an example of array patterns of the image data for operation buttons retained by the recorder <b>10</b>. In this manner, the recorder <b>10</b> may store a plurality of different array patterns of the image data for operation buttons in the memory portion <b>19</b>. <figref idrefs="DRAWINGS">FIG. 7(A)</figref> depicts an example of the array pattern of 2×2, <figref idrefs="DRAWINGS">FIG. 7(B)</figref> depicts an example of the array pattern of 2×3, and <figref idrefs="DRAWINGS">FIG. 7(C)</figref> depicts an example of the array pattern of 2×4. <figref idrefs="DRAWINGS">FIG. 8(A)</figref> depicts an example of the array pattern of 3×3, <figref idrefs="DRAWINGS">FIG. 8(B)</figref> depicts an example of the array pattern of 3×4, and <figref idrefs="DRAWINGS">FIG. 8(C)</figref> depicts an example of the array pattern of 3×5. The array pattern of 3×5 depicted in <figref idrefs="DRAWINGS">FIG. 8(C)</figref> coincides with the matrix pattern (3×5) depicted in <figref idrefs="DRAWINGS">FIG. 3(B)</figref> described earlier.

The 2×2 array pattern depicted in <figref idrefs="DRAWINGS">FIG. 7(A)</figref> is defined as pos_—2×2. This allocates a play button, a stop button, a fast rewind button, and a fast forward button to coordinates A<b>1</b>, B<b>1</b>, A<b>2</b>, and B<b>2</b>, respectively. The same rule is applied to the definition of the other array patterns. In <figref idrefs="DRAWINGS">FIG. 8(B)</figref>, a record button (btn_REC) is defined so as to extend over two coordinates (A<b>4</b> and B<b>4</b>). Specifically, a rule may be determined in advance that if the same button (e.g., record button (btn_REC) is allocated to both the coordinates A<b>4</b> and B<b>4</b>, then A<b>4</b> and B<b>4</b> are combined to display a single operation button by two coordinates.

<figref idrefs="DRAWINGS">FIG. 9</figref> is a diagram for explaining an example of operation panel optimization processing effected by the recorder <b>10</b>. In this example, the recorder <b>10</b> shall retain six different array patterns depicted in <figref idrefs="DRAWINGS">FIGS. 7 and 8</figref>, i.e., pos_—2×2, pos_—2×3, pos_—2×4, pos_—3×3, pos_—3×4, and pos_—3×5.

First, as set forth above referring to <figref idrefs="DRAWINGS">FIG. 4</figref>, the TV <b>20</b> sends operation panel information to the recorder <b>10</b> if it confirms that the recorder <b>10</b> supports the operation panel expansion display function (S<b>11</b>). In this example, the operation panel information sent includes the display region size of the operation panel: 384×810, the display position thereof: (1536, 270), the number of display colors thereof: 256 colors, the display size of the image data for operation buttons: 128×128, the matrix pattern of the image data for operation panels: 3 columns, 5 rows.

Next, the recorder <b>10</b> performs optimization processing of the operation panel depending on the operation panel information sent from the TV <b>20</b> (S<b>12</b>). As first optimization processing, the recorder <b>10</b> determines whether among a plurality of different array patterns held by the recorder <b>10</b> there is one coinciding with the matrix pattern sent from the TV <b>20</b>, and, if there is one coinciding therewith, selects the coinciding array pattern, and, if there is no one coinciding therewith, selects the maximum array pattern accommodated within the matrix pattern.

Since the matrix pattern from the TV <b>20</b> is 3×5 in this example, the array pattern of pos_—3×5 is determined to coincide therewith among the plurality of array patterns stored in the recorder <b>10</b>. In a case for example where the matrix pattern from the TV <b>20</b> is 2×5 without any array pattern coinciding therewith, the maximum array pattern accommodated within the 2×5 matrix pattern is determined to be 2×4. In this case, one row is blank.

It is determined as second optimization processing whether the image data for operation buttons coincide in display size. Here, a first display size of the image data for operation buttons held by the recorder <b>10</b> is 100×80 (<figref idrefs="DRAWINGS">FIG. 6</figref>) while a second display size of the image data for operation buttons sent from the TV is 128×128 (<figref idrefs="DRAWINGS">FIG. 3(B)</figref>). Since in this case the first display size held by the recorder <b>10</b> does not coincide with the second display size sent from the TV <b>20</b>, the recorder <b>10</b> performs an offset calculation for adjusting the position to array the image data of the first display size so as to fit the second display size.

The recorder <b>10</b> may retain image data for operation buttons of a plurality of display sizes corresponding to the custom operation panel so that any one is selected from among these image data for operation buttons. If, for example, there exists image data for operation buttons coinciding with the second display size sent from the TV <b>20</b>, the recorder <b>10</b> selects this image data for operation buttons, whereas if there exists no image data for operation buttons coinciding with the second display size, it selects image data for operation buttons smaller than the second display size. Then, similar to the above, if the display sizes do not coincide, the recorder <b>10</b> performs offset/resizing processing.

As depicted in <figref idrefs="DRAWINGS">FIG. 10</figref>, since the second display size of the TV <b>20</b> is Wt×Ht (128×128) and the first display size of the recorder <b>10</b> is Wr×Hr (100×80), the second display size of the TV <b>10</b> is greater than the first display size of the recorder <b>10</b>. In such a case, the recorder <b>10</b> performs for example an offset calculation for centering and displaying the image data for operation buttons. Specifically, the calculation results in <br /><i>x</i>=(<i>Wt−Wr</i>)/2=14<i>,y</i>=(<i>Ht−Hr</i>)/2=24<br /> to consequently obtain the offset amount (x=14, y=24). Then, when sending the image data for operation buttons to the TV <b>20</b>, the recorder <b>10</b> sends the obtained offset amount as the offset information thereto.

If the first display size retained by the recorder <b>10</b> does not coincide with the second display size sent from the TV <b>20</b>, the recorder <b>10</b> may resize the image data of the first display size so as to fit the second display size. If, for example, the first display size of the recorder <b>10</b>&lt; the second display size of the TV <b>20</b> as described above, it may expand the image data of the first display size so as to be of the same size as the second display size. On the contrary, if the first display size of the recorder <b>10</b>&gt; the second display size of the TV <b>20</b>, it may reduce the image data of the first display size to be of the same size as the second display size.

As depicted in <figref idrefs="DRAWINGS">FIG. 11</figref>, when sending image data for operation buttons to the TV <b>20</b>, the recorder <b>10</b> may send thereto combination information for allowing combination processing through which are combined a plurality of array positions indicated by the matrix pattern from the TV <b>20</b>. In this example, it allocates the record button to both the regions of coordinates A<b>5</b> and B<b>5</b> and then calculates an offset amount of the display position to adjust the display position. The offset amount in this case is calculated as x=78 and y=24.

In <figref idrefs="DRAWINGS">FIG. 9</figref>, after the execution of the operation panel optimization processing as described above, the recorder <b>10</b> sends operation button data to the TV <b>20</b> (S<b>13</b>). The operation button data include, in addition to the image data for operation buttons and coordinates indicative of their array positions, offset information (e.g., x=14, y=24) of the image data for operation buttons, attributes (e.g., operation button, either only display or blank) of the image data for operation buttons, and combination information (e.g., combining A<b>5</b> and B<b>5</b>) used when combining a plurality of array positions. Then, the recorder <b>10</b> notifies the TV <b>20</b> of the completion of sending of operation button data (S<b>14</b>), while the TV <b>20</b> performs operation panel display processing based on the operation button data sent from the recorder <b>10</b> (S<b>15</b>).

Since image data are sent in the processing of data sending from the recorder <b>10</b> to the TV <b>20</b>, a more high-speed data sending becomes feasible by using the HDMI HEC line <b>43</b> higher in the communication speed than the HDMI CEC line <b>42</b>.

<figref idrefs="DRAWINGS">FIG. 12</figref> is a diagram for explaining an example of processing performed when arraying the power button at the coordinate A<b>1</b>. The recorder <b>10</b> notifies the TV <b>20</b> of the start of sending thereto the operation button data on the coordinate A<b>1</b> (S<b>21</b>). Then, the recorder <b>10</b> sends image data (btn_POWER) for operation buttons to the TV <b>20</b> (S<b>22</b>), sends thereto the offset information (x=14 and y=24 in this case) depicted in <figref idrefs="DRAWINGS">FIG. 10</figref> (S<b>23</b>), and notifies it of the attributes (“button” in this case) of the operation buttons (S<b>24</b>). Finally, the recorder <b>10</b> notifies the TV <b>20</b> of the completion of sending thereto the operation button data on the coordinate A<b>1</b> (S<b>25</b>).

<figref idrefs="DRAWINGS">FIG. 13</figref> is a diagram for explaining an example of processing performed when blanking the region of the coordinate C<b>1</b>. The recorder <b>10</b> notifies the TV <b>20</b> of the start of sending thereto the operation button data on the coordinate C<b>1</b> (S<b>31</b>). Then, the recorder <b>10</b> notifies the TV <b>20</b> of the attribute “blank” of the operation button (S<b>32</b>). Finally, the recorder <b>10</b> notifies the TV <b>20</b> of the completion of sending thereto the operation button data on the coordinate C<b>1</b> (S<b>33</b>).

<figref idrefs="DRAWINGS">FIG. 14</figref> is a diagram for explaining an example of processing performed when combining the region of the coordinate A<b>5</b> and the region of the coordinate B<b>5</b> to array the record button thereon. The recorder <b>10</b> notifies the TV <b>20</b> of the start of sending the operation button data on the coordinate A<b>5</b> (S<b>41</b>) and notifies it of combining the regions of the coordinates A<b>5</b> and B<b>5</b> (S<b>42</b>). Then, the recorder sends image data (btn_REC) for operation buttons to the TV <b>20</b> (S<b>43</b>), sends thereto the offset information (x=78, y=24 in this case) depicted in <figref idrefs="DRAWINGS">FIG. 11</figref> (S<b>44</b>), and notifies it of the attribute (“button” in this case) of the operation button (S<b>45</b>). At the end, the recorder <b>10</b> notifies the TV <b>20</b> of the completion of sending the operation button data on the coordinate A<b>5</b> (S<b>46</b>).

Here, the TV <b>20</b> may store the image data for operation buttons sent from the recorder <b>10</b>, together with the identification information of the recorder <b>10</b>, in correspondence with the coordinate. In this case, at the time of next connection with the recorder <b>10</b>, the TV <b>20</b> specifies image data for operation buttons stored in the TV <b>20</b>, based on the identification information of the recorder <b>10</b>, and disposes and displays the specified image data at a position corresponding to the coordinate. This eliminates the necessity of sending image data for operation buttons each time of power on/off or detachment/attachment of the HDMI cable, thereby reducing the communication load.

Use may be made of a part of a default operation panel held by the TV <b>20</b>. In this case, the recorder <b>10</b> notifies the TV <b>20</b> of substituting, in accordance with the operation panel information sent from the TV <b>20</b>, some of the operation buttons making up the operation panel of the recorder <b>10</b> with operation buttons of the default operation panel corresponding to the recorder <b>10</b> held by the TV <b>20</b>. Then, the recorder <b>10</b> is configured to send to the TV <b>20</b> image data for the remaining operation buttons making up the operation panel of the recorder <b>10</b>, in correspondence with the coordinate.

The TV <b>20</b> substitutes, based on the notice from the recorder <b>10</b>, the some of the operation buttons making up the operation panel of the recorder <b>10</b> with the operation buttons of the default operation panel. Then, when the user acts on the remote control device R to selectively specify the substituted operation button, the TV <b>20</b> sends to the recorder <b>10</b> an operation command corresponding to the selectively specified operation button. That is, the operation command is sent for the operation buttons substituted by the default operation panel, whereas the coordinate is sent for the operation buttons of the custom operation panel. As a result, the recorder <b>10</b> need not send image data for all the operation buttons making up the operation panel, contributing to a reduction in the communication load.

The recorder <b>10</b> may retain in advance a plurality of image data that defer for each operation status for one operation button and send them to the TV <b>20</b>. In this case, the TV <b>20</b> is configured to change over and display the plurality of image data of the operation button sent from the recorder <b>10</b>, depending on the operation status of that operation button. The TV <b>20</b> changes over, for each operation button, the plurality of image data depending on the operation status of the recorder <b>10</b> such as for example valid, invalid (inoperable), selection, and determination. Specifically, the recorder <b>10</b> may notify the TV <b>20</b> of the operation status of the operation button, while in response to the notice, the TV may change over the plurality of image data depending on the operation status notified of.

For example, if the recorder <b>10</b> determines the stop button to be inoperable, then it notifies the TV <b>20</b> of the fact. When receiving the notice, the TV <b>20</b> changes over the image data of the stop button to image data indicative of being inoperable for the display. If the stop button in inoperable status is depressed and selectively specified, then control is provided such that the TV <b>20</b> does not send the coordinate of the stop button to the recorder <b>10</b>. Alternatively, the TV <b>20</b> may gray out the stop button so that the button cannot be selected or may prohibit the cursor from moving to the position of the stop button so that the button cannot be selected.

Exemplary actions of the peripheral control system according to the present invention will now be described based on the screen transition of the TV <b>20</b> depicted in <figref idrefs="DRAWINGS">FIGS. 15 to 24</figref>.

<figref idrefs="DRAWINGS">FIG. 15</figref> is a diagram depicting an example of actions performed when displaying a default operation panel. First, when the TV <b>20</b> and the recorder <b>10</b> are connected via the HDMI (S<b>51</b>), the TV <b>20</b> makes an inquiry for confirming the support level to the recorder <b>10</b> (S<b>52</b>), and if the recorder <b>10</b> is unsupporting, then displays a default operation panel <b>201</b> (S<b>53</b>). Here, the TV <b>20</b> can automatically select and display a default operation panel corresponding to a peripheral connected thereto from among a plurality of default operation panels that the TV <b>20</b> hold. At that time, the TV <b>20</b> scales and displays an input video signal so that the input video signal and the default operation panel are not displayed in an overlapping manner.

<figref idrefs="DRAWINGS">FIG. 16</figref> is a diagram depicting an example of a startup procedure of the operation panel executed when connecting a plurality of peripherals to the TV <b>20</b>. Here, a case is depicted where one AV amplifier <b>50</b> is connected to the TV <b>20</b>, with three recorders <b>10</b>₁, <b>10</b>₂, and <b>10</b>₃being connected to the AV amplifier <b>50</b>. It is assumed that the TV <b>20</b>, the AV amplifier <b>50</b>, and the recorder <b>10</b>₃are powered on whereas the recorders <b>10</b>₁and <b>10</b>₃are powered off.

First, the user turns on the power of the recorder <b>10</b>₂(S<b>61</b>) and thereafter acts on the remote control R to display a peripheral list <b>202</b> of peripherals connected to the TV <b>20</b> (S<b>62</b>). The peripheral list <b>202</b> carries names of peripherals being currently connected to the TV <b>20</b>. The recorder <b>10</b>₁, the recorder <b>10</b>₂, the recorder <b>10</b>₃, and the AV amplifier <b>50</b> correspond respectively to recorder <b>1</b>, recorder <b>2</b>, recorder <b>3</b>, and AV amplifier. At that time, the display of the recorder <b>1</b> being off is grayed out.

In the peripheral list <b>202</b>, most recently powered-on recorder <b>2</b> is recognized as an active peripheral and is displayed in an emphasized manner by a bold frame on the peripheral list <b>202</b> so that it can be distinguished from the other peripherals. By selecting the recorder <b>1</b> being power-off, the recorder <b>1</b> may be powered on and operated. In this case, the display of the recorder <b>1</b> is emphasized.

Then, when the user acts on the remote control device R to select a peripheral whose operation panel is desired to be displayed from the peripheral list <b>202</b>, there appears the default operation panel <b>201</b> corresponding to the peripheral. In a display example of the default operation panel <b>201</b>, it is displayed as depicted in <figref idrefs="DRAWINGS">FIG. 15</figref>. As another display example of the default operation panel <b>201</b>, as depicted in <figref idrefs="DRAWINGS">FIG. 17</figref>, the default operation panel <b>201</b> of a peripheral selected by the user may be displayed under the peripheral list <b>202</b>. In this example, the recorder <b>2</b> is selected and the default operation panel <b>201</b> of this recorder <b>2</b> is displayed.

Although the example of <figref idrefs="DRAWINGS">FIG. 16</figref> depicts the startup procedure of the default operation panel in the case of connecting a plurality of peripherals, the startup of the custom operation panel is also basically executed by the similar procedure.

<figref idrefs="DRAWINGS">FIG. 18</figref> is a diagram depicting a screen transition example of the default operation panel <b>201</b>. In <figref idrefs="DRAWINGS">FIG. 18(A)</figref>, when the user acts on the remote control device R to play the recorder <b>10</b>, it returns a status of on-play to the TV <b>20</b>. Then, the TV <b>20</b> grays out the play button since the play button does not act in spite of depression thereof if the recorder <b>10</b> is playing (S<b>71</b>). In <figref idrefs="DRAWINGS">FIG. 18(B)</figref>, if a disc such as BD or DVD is loaded, the recorder <b>10</b> notifies the TV <b>20</b> of the type of the disc. If the disc is a BDROM, etc., that cannot be recorded, the record button and the record stop button do not function, and therefore the TV <b>20</b> grays out these buttons (S<b>72</b>).

<figref idrefs="DRAWINGS">FIGS. 19 and 20</figref> are diagrams for explaining action examples when displaying a custom operation panel according to the present invention. As depicted in <figref idrefs="DRAWINGS">FIG. 19(A)</figref>, the TV <b>20</b> determines in advance e.g., a region to display the operation panel, and stores it as operation panel information. As already described in <figref idrefs="DRAWINGS">FIG. 3</figref>, the operation panel information is composed of five pieces of information, i.e., the display region size, the display position, and the number of display colors of the operation panel as well as the display size of the image data for operation buttons and array information (matrix pattern) indicating, in a matrix form, the arrayable position and number of the image data for operation buttons.

As depicted in <figref idrefs="DRAWINGS">FIG. 19(B)</figref>, the recorder <b>10</b> correlates the image data for operation buttons with coordinates at which the image data are disposed and correlates the coordinates with functions of the operation buttons, for the retention thereof. For example, although in the case of the play button, the coordinate for array is “B<b>2</b>” and the function is “play”, the other operation buttons also have the similar correlations.

In <figref idrefs="DRAWINGS">FIG. 20</figref>, as set forth above referring to <figref idrefs="DRAWINGS">FIG. 4</figref>, the TV <b>20</b> sends operation panel information to the recorder <b>10</b> if it confirms that the recorder <b>10</b> supports the operation panel expansion display function (S<b>81</b>). Upon receiving it, the recorder <b>10</b> sends the image data for operation buttons and the coordinate thereof to the TV <b>20</b> (S<b>82</b>). Then, the TV <b>20</b> disposes the image data for operation buttons sent from the recorder <b>10</b> at the position corresponding to the coordinate and displays a custom operation panel <b>203</b> (S<b>83</b>).

Then, when the user operates the remote control R to depress the play button, the TV <b>20</b> recognizes that the coordinate corresponding to the play button is B<b>2</b> and notifies the recorder <b>10</b> of the depression of the coordinate B<b>2</b> (S<b>84</b>). In response to this notice, the recorder <b>10</b> specifies a function (PLAY in this case) corresponding to the coordinate B<b>2</b> and executes the play function (S<b>85</b>). In this manner, although the TV displays the operation buttons for operating the peripherals connected thereto, the TV need not grasp what functions the operation buttons have and has simply to send the coordinates of the operation buttons. For this reason, the load on the TV can be reduced to a large extent.

<figref idrefs="DRAWINGS">FIG. 21</figref> is a diagram for explaining a display example of the custom operation panel according to the present invention. The custom operation panel <b>203</b> of this example is provided with an information display region <b>204</b> displaying information such as the status of the peripherals (hereinafter referred to as display information) in addition to the display of the image data for operation buttons. The display information means, in the case of the recorder <b>10</b>, information such as for example the title, chapter, play time, hours, and channel of the program content being currently played.

In this case, it is considered that the TV <b>20</b> determines in advance the array position and size of the information display region to be arrayed on the screen so as to impart thereto region identification information (for example, identification number 1, 2, . . . , etc.) for identifying the information display region. Then, the TV <b>20</b> retains the operation panel information containing the array position and the size of the information display region and the region identification information. When the operation panel information is sent from the TV <b>20</b> to the recorder <b>10</b>, the recorder <b>10</b> determines a region to array the display information and sends the region identification information of this region together with the display information to the TV <b>20</b>. The TV <b>20</b> displays the display information sent from the recorder <b>10</b> in the information display region corresponding to the region identification information.

In <figref idrefs="DRAWINGS">FIG. 21</figref>, as already described in <figref idrefs="DRAWINGS">FIG. 4</figref>, first, if the TV <b>20</b> confirms that the recorder <b>10</b> supports the operation panel expansion display function, the TV <b>20</b> sends the operation panel information to the recorder <b>10</b> (S<b>91</b>). In response to this, the recorder <b>10</b> sends to the TV <b>20</b> the display information and the region identification information for identifying a region to display the display information. Then, the TV <b>20</b> disposes the display information sent from the recorder <b>10</b> in the information display region <b>204</b> corresponding to the region identification information and displays the custom operation panel <b>203</b> (S<b>92</b>).

<figref idrefs="DRAWINGS">FIG. 22</figref> is a diagram for explaining another display example of the custom operation panel according to the present invention. As depicted in <figref idrefs="DRAWINGS">FIG. 22(A)</figref>, the recorder <b>10</b> retains the image data for operation buttons, the coordinates to array the image data, and the attributes of the image data in a corresponding relationship. For example, in the case of “−10 sec” button, the array coordinate is “A<b>4</b>” and the attribute is “button”, and in the case of “guidance <b>1</b>” button, the array coordinate is “A<b>5</b>” and the attribute is “only display”. Similarly, the attribute “only display” is imparted to the “guidance <b>2</b>” button and the “guidance <b>3</b>” button. These guidance buttons are buttons for explaining the operations of the operation buttons, the guidance buttons merely providing a display of the operation guidance and having no operation functions.

In <figref idrefs="DRAWINGS">FIG. 22(B)</figref>, the recorder <b>10</b> sends to the TV <b>20</b> the image data, the coordinates, and the attributes of the operation button and of the operation guidance buttons. Although the TV <b>20</b> displays the operation guidance buttons on the operation panel similarly to the operation button, the TV <b>20</b> is controlled so as not send, even if the operation guidance button is depressed, the coordinate thereof to the recorder <b>10</b> since the attributes of the operation guidance buttons are only display. Control may be provided such that the operation guidance buttons cannot be selected by prohibiting the cursor from moving thereto.

Although in the example of <figref idrefs="DRAWINGS">FIG. 22</figref> the operation guidance buttons <b>1</b> to <b>3</b> with the attributes of only display are arrayed on the operation panel, the corresponding regions of this operation panel (which corresponds to the coordinates A<b>5</b> to C<b>5</b> in this example) may be used as the information display region <b>204</b> depicted in <figref idrefs="DRAWINGS">FIG. 21</figref>. In this case, the recorder <b>10</b> specifies the display regions (the coordinates A<b>5</b> to C<b>5</b>) and sends the display information (the attributes of only display). Naturally, it is also feasible to combine a plurality of coordinate regions, and in this example, the regions of the coordinates A<b>5</b> to C<b>5</b> are combined to configure an information display region similar to the information display region <b>204</b> depicted in <figref idrefs="DRAWINGS">FIG. 21</figref>. It's possible to arrange and display, for example, the display information (playing, title 1, chapter 10, play time 001:23:45) of the device depicted in <figref idrefs="DRAWINGS">FIG. 21</figref> in the information display region configured in this way.

<figref idrefs="DRAWINGS">FIG. 23</figref> is a diagram for explaining a further display example of the custom operation panel according to the present invention. In this example, the recorder <b>10</b> retains a plurality of image data for each operation status for one operation button as depicted in <figref idrefs="DRAWINGS">FIG. 23(A)</figref>. In this case, for the stop button, different images are retained for each operation status, that is, “button is valid”, “button is invalid”, “button is selected”, or “button is determined”.

Then, as depicted in <figref idrefs="DRAWINGS">FIG. 23(B)</figref>, the recorder <b>10</b> sends to the TV <b>20</b> the image data for operation buttons containing the image data of the stop button and the coordinates thereof (S<b>101</b>), while the TV <b>20</b> disposes the image data for operation buttons sent from the recorder <b>10</b> at the positions corresponding to the coordinates to display the custom operation panel <b>203</b> (S<b>102</b>). At that time, the TV <b>20</b> receives a notice of the operation status from the recorder <b>10</b> and, depending on the content of the notice, changes over and displays the plurality of image data for each of the operation buttons. In the example of the stop button, the images are changed over depending on four operation statuses, i.e., the button valid, button invalid, button select, and button determine.

<figref idrefs="DRAWINGS">FIG. 24</figref> is a diagram for explaining an action example when the image data for operation buttons are stored and reused in the TV. When first receiving image data for operation buttons from the recorder <b>10</b>, the TV <b>20</b> stores in a corresponding relationship the image data, the corresponding coordinates, and the identification information for identifying the recorder <b>10</b> (S<b>111</b>). Then, when there occurs the power on/off or the cable detachment/attachment (S<b>112</b>), the TV <b>20</b> acquires the identification information from the recorder <b>10</b> and determines whether image data for operation buttons corresponding to the identification information are stored. Then, if the image data for operation buttons are stored, it reads out the image data and disposes them at positions in accordance with the corresponding coordinates (S<b>113</b>).

Although in the above embodiments, the HDMI, HDMI CEC, and HDMI HEC have exemplarily been described as communication means, these are not intended to be limitative, and instead, IEEE1394, LAN, power line communication, radio communication, optical communication, etc., may be utilized. Although the recorder has been described as a typical peripheral, it is natural not to be limited thereto. Examples will be shown below of adaptable peripherals, the contents of operation thereof, and the contents of display thereof.

(1) The recorder and a player can perform operations such as channel selecting operation, playing operation, and recording operation and can display information such as name of a program on play, play time, chapter, track, and recording timer.

(2) Audio equipment can perform operations such as volume operation, input mode change, and sound mode change and can display information such as volume, input mode, and sound mode.

(3) A washing machine can perform operations such as action mode change, start of selecting action, pause, and stop and can display information such as the status of washing (wash/rinse/spin-dry/dry).

(4) A refrigerator can perform operations such as regulation of the interior temperature and setting of additional functions and can display information such as the temperature of the interior (cold compartment/freezing compartment/temperature holding compartment) and ion generation concentration (when having an ion generator). <br /> (5) An air conditioner can perform operations such as change of the set temperature, change of action mode, timer setting, start of action, pause, and stop and can display information such as the room temperature, air direction, air amount, functions (air-conditioning/heating/dehumidifying/air-sending), timer, and ion generation concentration (when having an ion generator). <br /> (6) A vacuum cleaner can perform operations such as change of action mode, start of action, pause, and stop and can display information such as notice of dust disposal time and filter clogging. <br /> (7) An air cleaner, a humidifier, and a dehumidifier can perform operations such as change of action mode, start of action, pause, and stop and can display information such as the temperature, humidity, state of air (clean/dirty). <br /> (8) The ion generator can perform operations such as change of action mode, start of action, pause, and stop and can display information such as ion generation concentration. <br /> (10) A solar power generation device can perform operations such as change of action mode, start of action, pause, and stop and can display information such as power generation amount, consumption corresponding to the power generation amount, and weather. <br /> (11) A cell phone can perform operations such as change of action mode, change of various settings, and outgoing and incoming calls and can display information such as incoming call and arrival of mail. <br /> (12) A telephone, facsimile, and a telephone with liquid crystal display can perform operations such as change of action mode, change of various settings, and outgoing and incoming calls and can display information such as notice of incoming call and name and photograph of the other party. <br /> (13) A photo player can perform operations such as change of action mode, start of action, pause, and stop and can display information such as photograph, thumbnail, and list. <br /> (14) A projector can perform operations such as change of action mode, start of action, pause, and stop and can display information such as picture quality mode. <br /> (15) A microwave oven, a multifunctional microwave oven, and a toaster oven can perform operations such as change of action mode, start of action, pause, and stop and can display information such as cooking time, notice of completion of cooking, and intra-oven temperature. <br /> (16) A rice cooker can perform operations such as change of action mode, start of action, pause, and stop and can display information such as cooking time and notice of completion of cooking. <br /> (17) A multifunctional machine or a copying machine can perform operations such as change of action mode, start of action, pause, and stop and can display information such as the remainder of paper and the remainder of ink. <br /> (18) A wireless camera system (living door scope) can perform operations such as change of action mode and response and can display information such as a notice of intercom and a face of a visitor.

REFERENCE SIGNS LIST

<b>10</b> . . . recorder, <b>11</b> . . . HDMI transmitter, <b>12</b>,<b>21</b> . . . main microcomputer, <b>13</b> . . . front microcomputer, <b>14</b>,<b>24</b> . . . CEC I/F, <b>15</b>,<b>25</b> . . . communication I/F, <b>16</b>,<b>26</b> . . . remote control light receiving portion, <b>17</b>,<b>27</b> . . . HDMI connector, <b>18</b>, <b>28</b> . . . LAN I/F, <b>19</b>,<b>29</b> . . . memory portion, <b>20</b> . . . TV, <b>22</b> . . . HDMI receiver, <b>23</b> . . . monitor microcomputer, <b>30</b> . . . display portion, <b>40</b> . . . HDMI cable, <b>41</b> . . . TMDS line, <b>42</b> . . . CEC line, <b>43</b> . . . HEC line