Information broadcasting method, information broadcasting system, and receiving apparatus for transmitting data other than program through digital broadcasting

CROSS-REFERENCE TO RELATED APPLICATIONS

0001The present application is a divisional of U.S. application Ser. No. 09/066,758, filed Apr. 28, 1998, now abandoned, which claims priority from Japanese Application Nos. 09-112846, filed Apr. 30, 1997, 09-171744, filed Jun. 27, 1997, and 09-174990, filed Jun. 30, 1997, the disclosures of which are hereby incorporated by reference herein.

BACKGROUND OF THE INVENTION

00021. Field of the Invention

0003The invention relates to information broadcasting method, information broadcasting system, and receiving apparatus for transmitting advertising and publicity information by using a digital broadcasting and, further, transmitting data other than programs through a digital broadcasting which can electronically exchange personal data such as a face image.

00042. Description of the Related Art

0005In recent years, a digital broadcasting for transmitting multimedia data such as image signal, audio signal, etc. by using a communicating satellite has being put into practical use. The invention intends to multiplex advertising information to program information in the digital broadcasting. First, an outline of a typical digital broadcasting system will now be described with reference to <figref idref="DRAWINGS">FIG. 1</figref>. The side of transmitting programs is constructed by an up-link station <b>2</b>, a program provider <b>1</b>, and management systems <b>6</b>, <b>7</b>, and <b>8</b>.

0006Video/audio data from the program provider <b>1</b> is supplied to an encoder multiplexer <b>3</b> of MPEG (Moving Picture Experts Group) 2 of the up-link station <b>2</b>. In the MPEG2 encoder multiplexer <b>3</b>, the video/audio data is compressed and the compressed video/audio data is packaged into a packet of a length of 188 bytes. Packets of video/audio data corresponding to a plurality of programs are multiplexed and a transport packet of MPEG2 is formed. A transport stream is formed by a series of transport packets. The number of transport streams corresponds to the number of transponders installed in the communicating satellite.

0007The MPEG2 transport stream is supplied to a transmitting system <b>4</b>. In the transmitting system <b>4</b>, processes such as scrambling process of each packet, error correction encoding of each packet, and modulation, and the like are executed and a modulation output is supplied to a transmitting antenna <b>5</b>. The scrambling process is necessary to realize a conditional access which is used to control permission or inhibition of a monitor of each viewer. For example, it is possible to make a contract of PPV (Pay Per View) such that only a certain program is monitored each time in a toll. A key to descramble the scramble is supplied from the key management system <b>6</b> to the MPEG2 encoder multiplexer <b>3</b> and is inserted as one of the packets into the transport stream in a manner similar to video/audio information.

0008A systematizing management of the MPEG2 packets is performed by the program management system <b>7</b>. The program management system <b>7</b> and key management system <b>6</b> are unified and encipher the key to descramble the scramble. Further, the customer management system <b>8</b> is provided and items regarding a viewer contract or the like are managed. Viewer information is transmitted to'the viewer through a telephone line <b>9</b>.

0009A broadcasting radio wave is transmitted from the transmitting antenna <b>5</b> and is received by a receiving antenna of each home through a communicating satellite <b>10</b>. A receiver <b>12</b> is connected to the receiving antenna <b>11</b>. The receiver <b>12</b> is constructed by: a tuner for designating a receiving transponder; a demodulating unit; a descrambling unit for descrambling the scramble; a demultiplexer for designating a packet to be separated; a video decoding unit; an audio decoding unit; and the like. The decoded video/audio signals are supplied to a television receiver <b>13</b>.

0010The key to descramble the scramble is enciphered and transmitted as related information together with video and audio data. The key to decipher the encryption has been stored in an IC card <b>14</b> inserted in the receiver <b>12</b>. The scramble of which program can be descrambled can be controlled from the transmitting side on the basis of contract information of each reception system. The receiver having the conditional accessing function is usually called an IRD (Integrated Receiver/Decoder).

0011The foregoing digital satellite broadcasting system is not limited to only the monitor of a television broadcasting but can be also used as a transmitting system of a large quantity of digital data due to many channels. That is, the receiver of the digital satellite broadcasting has a function serving as an acceptor of digital data such that contract information or the like concerning the program or viewer, data for a personal computer, or the like other than the video audio data is multiplexed thereto and the resultant data is transmitted.

0012For example, in one broadcasting in the present satellite broadcasting system, a content description EIT (Event Information Table) of programs which are at present being broadcasted or will be broadcasted in future, an EPG (Electric Program Guides), contract information (Entitlement Control Message) including a monitor fee and a monitor age limitation, and the like are transmitted together with the video/audio data. Specifically speaking, the information such as monitor fee, monitor age limitation, and the like is broadcasted together with program information as common information (ECM: Entitlement Control Message) that is common to receiving terminals.

0013An ID which is peculiar to a receiving terminal is allocated and individual information (EMM: Entitlement Management Message) that is formed on the transmitting side for the viewer and is individual to the terminal is sent. At the terminal, on the receiving side, the EMM of the same ID as the own ID is decoded and a work key is loaded into the IC card. A key to decode the EMM has previously been stored in the IC card of each receiving terminal. When the program is monitored, the ECM annexed to the program is loaded into the IC card. If the work key corresponding to the program has preliminarily been stored, the descramble is performed and the program can be monitored. As mentioned above, the PPV is enabled. By instructing an up-loading of a monitor history of PPV programs from the individual terminal or providing a modem into the terminal, a purchase request for a shopping program or an answer to a questionnaire can be performed.

0014In the conventional digital satellite broadcasting system as mentioned above, however, by multiplexing the information concerning the program and broadcasting, an additional value of the program can be further raised or the operation can be simplified, but video/audio data of advertising/publicity information which is so called a CM (Commercial Message) that is inserted in the program is merely transmitted as a part of the program. There is, consequently, a problem such that advertising and publicity information is transmitted to the viewer irrespective of goods or services as targets of the advertising and publicity information or goods are forcedly advertised irrespective of a will of each viewer as a receiver.

0015In the case where the viewer has an interest in goods by watching a CM and wants to get further detailed information or the like, since there is only a method of accessing to the telephone number displayed on the screen through a telephone line, there is a problem such that the detailed information of the goods cannot be easily and promptly obtained.

0016Further, as an enterprise serving as a side of providing a CM, even in the case where the enterprise wants to know a monitor history, audience ratings, and the like of each CM or the like, there is a problem such that the enterprise can know the information as only monitor history and audience ratings as one program which is collected on the broadcasting station side.

0017A photographing/outputting apparatus which can print a face image photographed by a camera as a seal has appeared and is becoming popular. A terminology of “print club” is also popular. More specifically explaining, an image obtained by photographing one or a few persons is printed onto one seal paper as divisional images (for example, size of 3 cm×2 cm). The photographs obtained as mentioned above are not limited to a personal use but are provided as an application such that they are handed to friends or exchanged.

0018According to the existing photographing/outputting apparatus, the number of seals which are obtained by one photographing is limited and the seals are used as an application such that they are handed to the friends or are mailed. Therefore, a range where the seals are exchanged is limited.

OBJECTS AND SUMMARY OF THE INVENTION

0019An object of the invention is to provide information broadcasting method, information broadcasting system, and receiving apparatus for transmitting data other than programs through a digital broadcasting which enables a viewer serving as a receiver of information to selectively monitor an advertising and enables an advertising providing enterprise to efficiently make the viewer monitor the advertising.

0020Another object of the invention is to provide information broadcasting method, information broadcasting system, and receiving apparatus for transmitting data other than programs through a digital broadcasting which enables a viewer to selectively monitor detailed information concerning an advertising.

0021Still another object of the invention is to provide information broadcasting method, information broadcasting system, and receiving apparatus for transmitting data other than programs through a digital broadcasting which enables an enterprise which provides an advertising to easily collect a monitor history, audience ratings, and the like on an advertising unit basis.

0022Further another object of the invention is to provide information broadcasting method, information broadcasting system, and receiving apparatus for transmitting data other than programs through a digital broadcasting which can further widen a range of a partner who exchanges personal data by electronically exchanging personal data such as a face image or the like by using the digital broadcasting.

0023Further another object of the invention is to provide information broadcasting method, information broadcasting system, and receiving apparatus for transmitting data other than programs through a digital broadcasting which can transmit a large quantity of personal data to a number of subscribers at a high speed by using the digital broadcasting and can improve an operability for exchange of the personal data at a terminal.

0024Further another object of the invention is to provide information broadcasting method, information broadcasting system, and receiving apparatus for transmitting data other than programs through a digital broadcasting which makes it possible to easily manage terminals and can reduce a scale of hardware of the terminal by providing a gateway to collect a number of terminals by using the digital broadcasting.

0025According to the invention, there is provided an information broadcasting method using a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, wherein advertising information is multiplexed to a broadcasting signal and a target ID to identify a viewer class as a target of goods or services which are advertised by advertising information is added to the advertising information.

0026According to the invention, there is provided an information broadcasting system using a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, comprising: a transmitting side apparatus for multiplexing advertising information added with a target ID to identify a viewer class as a target of goods or services which are are advertized to a broadcasting signal and transmitting the multiplexed signal to a viewer; and a receiving apparatus for receiving the broadcasting signal to which the advertising information including the target ID has been multiplexed, collating a viewer attribute which has previously been registered with the target ID, and selecting advertising information in which both of them coincide.

0027According to the invention, there is provided a receiving apparatus of a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, wherein when receiving a broadcasting signal in which advertising information added with a target ID to identify a viewer class as a target of goods or services which are advertised has been multiplexed, a viewer attribute which has previously been registered is collated with the target ID, and advertising information in which both of them coincide is selected.

0028According to the invention, there is provided an information broadcasting method using a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, wherein advertising information added with link information indicative of a linking method of the advertising information and detailed information regarding an advertising and the detailed information are multiplexed to a broadcasting signal.

0029According to the invention, there is provided an information broadcasting system using a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, comprising a transmitting side apparatus for multiplexing advertising information added with link information indicative of a linking method of the advertising information and detailed information regarding an advertising and the detailed information to a broadcasting signal and transmitting the multiplexed information to a viewer; and a receiving apparatus for receiving the broadcasting signal and, when a viewer requests the detailed information, obtaining the requested detailed information from the broadcasting signal by using the link information.

0030According to the invention, there is provided a receiving apparatus of a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, wherein a broadcasting signal in which advertising information added with link information indicative of a linking method of the advertising information and detailed information regarding an advertising and the detailed information have been multiplexed is received, and when a viewer requests the detailed information, the requested detailed information is obtained from the broadcasting signal by using the link information.

0031According to the invention, there is provided an information broadcasting method using a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, wherein advertising information added with link information indicative of a linking method of the advertising information and detailed information regarding an advertising is multiplexed to a broadcasting signal and the detailed information is obtained from an information providing station other than the broadcasting signal on the basis of the link information.

0032According to the invention, there is provided an information broadcasting system using a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, comprising: a transmitting side apparatus for multiplexing advertising information added with link information indicative of a linking method of the advertising information and detailed information regarding an advertising to a broadcasting signal and transmitting the multiplexed signal to a viewer; and a receiving apparatus for receiving the broadcasting signal and, when the viewer requests the detailed information, obtaining the requested detailed information from an information providing station other than the broadcasting signal by using the link information.

0033According to the invention, there is provided a receiving apparatus of a digital broadcasting which can multiplex data of programs and data other than the programs and transmit the multiplexed data, wherein a broadcasting signal in which advertising information added with link information indicative of a linking method of the advertising information and detailed information regarding an advertising has been multiplexed is received, and when a viewer requests the detailed information, the requested detailed information obtained from an information providing station other than the broadcasting signal by using the link information.

0034According to the invention, there is provided an information broadcasting system comprising: a receiving apparatus constructed by image input means for inputting an image of a person who makes personal data, output means for outputting the personal data, input means, communicating means, and receiving means of a digital broadcasting; a server for receiving the personal data from the receiving apparatus, transmitting the personal data to the receiving apparatus, and managing the personal data; and two-way communicating means for coupling a plurality of receiving apparatuses and the server, wherein the personal data can be electronically exchanged among the receiving apparatuses by using the server and the two-way communicating means.

0035According to the invention, there is provided a receiving apparatus comprising: image input means for inputting an image of a person who makes personal data; output means for outputting the personal data; input means; communicating means; and receiving means of a digital broadcasting, wherein the personal data is electronically exchanged by using the communicating means, server, and two-way communicating means.

0036According to the invention, there is provided an information broadcasting system comprising: a receiving apparatus constructed by image input means for inputting an image of a person who makes personal data, output means for outputting the personal data, input means, and receiving means of a digital broadcasting; a gateway which includes a storing device and communicating means, is connected to a plurality of receiving apparatuses, receives the personal data from those plurality of receiving apparatuses, and sends the personal data to the plurality of receiving apparatuses; a server for receiving the personal data from the gateway, transmitting the personal data to the gateway, and managing the personal data; and two-way communicating means for coupling a plurality of gateways and the server, wherein the personal data can be electronically exchanged among the receiving apparatuses through the gateway by using the server and the two-way communicating means.

0037According to the invention, there is further provided a receiving apparatus system comprising: a receiving apparatus constructed by image input means for inputting an image of a person who makes personal data, output means for outputting the personal data, input means, and receiving means of a digital broadcasting; and a gateway which includes a storing device and communicating means, is connected to a plurality of receiving apparatuses, receives personal data from those plurality of receiving apparatuses, and sends the personal data to those plurality of receiving apparatuses, wherein the personal data is electronically exchanged by using the communicating means, a server, and two-way communicating means.

0038The above and other objects and features of the present invention will become apparent from the following detailed description and the appended claims with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

0039<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram for use in explanation of an example of a conventional digital broadcasting system;

0040<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram showing a system construction of an embodiment of the invention;

0041<figref idref="DRAWINGS">FIG. 3</figref> is a block diagram of an example of a construction on the transmitting side in the embodiment of the invention;

0042<figref idref="DRAWINGS">FIG. 4</figref> is a block diagram of an example of a construction on the receiving side in the embodiment of the invention;

0043<figref idref="DRAWINGS">FIGS. 5A to 5C</figref> are flowcharts for use in explanation of the operation of the embodiment of the invention;

0044<figref idref="DRAWINGS">FIG. 6</figref> is an external view of a display picture plane for use in explanation of the embodiment of the invention;

0045<figref idref="DRAWINGS">FIG. 7</figref> is a block diagram showing an outline of a whole system in the embodiment of the invention;

0046<figref idref="DRAWINGS">FIG. 8</figref> is a block diagram showing an outline of a terminal in the embodiment of the invention;

0047<figref idref="DRAWINGS">FIG. 9</figref> is a block diagram showing an outline of a terminal system having a gateway in the embodiment of the invention;

0048<figref idref="DRAWINGS">FIG. 10</figref> is a block diagram showing an example of a construction of a terminal in the embodiment of the invention;

0049<figref idref="DRAWINGS">FIG. 11</figref> is a block diagram showing an example of a construction of a gateway in the embodiment of the invention;

0050<figref idref="DRAWINGS">FIG. 12</figref> is a flowchart for explaining processes in the embodiment of the invention;

0051<figref idref="DRAWINGS">FIG. 13</figref> is a flowchart for explaining processes in the embodiment of the invention;

0052<figref idref="DRAWINGS">FIG. 14</figref> is a flowchart for explaining processes in the embodiment of the invention;

0053<figref idref="DRAWINGS">FIG. 15</figref> is a flowchart for explaining processes in the embodiment of the invention;

0054<figref idref="DRAWINGS">FIG. 16</figref> is a flowchart for explaining processes in the embodiment of the invention;

0055<figref idref="DRAWINGS">FIG. 17</figref> is a flowchart for explaining processes in the embodiment of the invention;

0056<figref idref="DRAWINGS">FIG. 18</figref> is a schematic diagram showing a construction of personal data in the embodiment of the invention;

0057<figref idref="DRAWINGS">FIG. 19</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0058<figref idref="DRAWINGS">FIG. 20</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0059<figref idref="DRAWINGS">FIG. 21</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0060<figref idref="DRAWINGS">FIG. 22</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0061<figref idref="DRAWINGS">FIG. 23</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0062<figref idref="DRAWINGS">FIG. 24</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0063<figref idref="DRAWINGS">FIG. 25</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0064<figref idref="DRAWINGS">FIG. 26</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0065<figref idref="DRAWINGS">FIG. 27</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0066<figref idref="DRAWINGS">FIG. 28</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0067<figref idref="DRAWINGS">FIG. 29</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0068<figref idref="DRAWINGS">FIG. 30</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0069<figref idref="DRAWINGS">FIG. 31</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0070<figref idref="DRAWINGS">FIG. 32</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0071<figref idref="DRAWINGS">FIG. 33</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0072<figref idref="DRAWINGS">FIG. 34</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0073<figref idref="DRAWINGS">FIG. 35</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0074<figref idref="DRAWINGS">FIG. 36</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0075<figref idref="DRAWINGS">FIG. 37</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0076<figref idref="DRAWINGS">FIG. 38</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0077<figref idref="DRAWINGS">FIG. 39</figref> is a schematic diagram showing a specific example of a print output at a terminal in the embodiment of the invention;

0078<figref idref="DRAWINGS">FIG. 40</figref> is a schematic diagram partially largely showing a specific example of a print output at a terminal in the embodiment of the invention;

0079<figref idref="DRAWINGS">FIG. 41</figref> is a schematic diagram showing specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0080<figref idref="DRAWINGS">FIG. 42</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0081<figref idref="DRAWINGS">FIG. 43</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0082<figref idref="DRAWINGS">FIG. 44</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0083<figref idref="DRAWINGS">FIG. 45</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0084<figref idref="DRAWINGS">FIG. 46</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0085<figref idref="DRAWINGS">FIG. 47</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0086<figref idref="DRAWINGS">FIG. 48</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0087<figref idref="DRAWINGS">FIG. 49</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0088<figref idref="DRAWINGS">FIG. 50</figref> is a schematic diagram showing a specific example of a screen display of a monitor provided at a terminal in the embodiment of the invention;

0089<figref idref="DRAWINGS">FIG. 51</figref> is a flowchart for explaining processes in the embodiment of the invention;

0090<figref idref="DRAWINGS">FIG. 52</figref> is a flowchart for explaining processes in the embodiment of the invention;

0091<figref idref="DRAWINGS">FIG. 53</figref> is a flowchart for explaining processes in the embodiment of the invention;

0092<figref idref="DRAWINGS">FIG. 54</figref> is a flowchart for explaining processes in the embodiment of the invention;

0093<figref idref="DRAWINGS">FIG. 55</figref> is a flowchart for explaining processes in the embodiment of the invention;

0094<figref idref="DRAWINGS">FIG. 56</figref> is a flowchart for explaining processes in the embodiment of the invention;

0095<figref idref="DRAWINGS">FIG. 57</figref> is a schematic diagram showing an example of a monitor display for use in explanation of the invention;

0096<figref idref="DRAWINGS">FIG. 58</figref> is a flowchart for explaining processes in the embodiment of the invention;

0097<figref idref="DRAWINGS">FIG. 59</figref> is a flowchart for explaining processes in the embodiment of the invention;

0098<figref idref="DRAWINGS">FIG. 60</figref> is a flowchart for explaining processes in the embodiment of the invention;

0099<figref idref="DRAWINGS">FIG. 61</figref> is a flowchart for explaining processes in the embodiment of the invention;

0100<figref idref="DRAWINGS">FIG. 62</figref> is a flowchart for explaining processes in the embodiment of the invention;

0101<figref idref="DRAWINGS">FIG. 63</figref> is a flowchart for explaining processes in the embodiment of the invention;

0102<figref idref="DRAWINGS">FIG. 64</figref> is a flowchart for explaining processes in the embodiment of the invention;

0103<figref idref="DRAWINGS">FIG. 65</figref> is a flowchart for explaining processes in the embodiment of the invention; and

0104<figref idref="DRAWINGS">FIG. 66</figref> is a flowchart for explaining processes in the embodiment of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

0105An embodiment of the invention will now be described hereinbelow with reference to the drawings. <figref idref="DRAWINGS">FIG. 2</figref> shows a whole system of an embodiment of the invention. As shown in <figref idref="DRAWINGS">FIG. 2</figref>, the system on the transmitting side is constructed by a broadcasting station <b>21</b> for producing programs; an up-link system <b>22</b>; a transmission antenna <b>23</b>, and a contracted customer management center <b>30</b>.

0106In <figref idref="DRAWINGS">FIG. 2</figref>, reference numeral <b>24</b> denotes, for example, a communicating satellite (CS). Transponders of the number corresponding to the number of transport streams are installed in the communicating satellite <b>24</b>. A radion wave signal transmitted from the ground through the up-link system <b>22</b> and transmitting antenna <b>23</b> is received, is frequency converted, is amplified, and is again transmitted to the ground. Programs, data for control (ECM, EEM, etc.), EPG, and the like are multiplexed to a broadcasting signal in a manner similar to an ordinary digital broadcasting. In the invention, advertising information and advertising detailed information are further multiplexed to the broadcasting signal as data different from program data.

0107The receiving terminal is constructed by a receiving antenna <b>25</b>, an IRD <b>26</b>, a video display apparatus <b>28</b>, and an external control apparatus <b>27</b>. The IRD <b>26</b> and contracted customer management center <b>30</b> are constructed so as to be properly connected by a public line network <b>29</b>. The IRD <b>26</b> is connected to an advertising detailed information homepage <b>33</b> through the public network <b>29</b>, an access point (relay connecting point) <b>31</b>, a network such as an internet <b>32</b>, and software such as WWW (World Wide Web) or the like. The homepage <b>33</b> is formed by an enterprise <b>34</b> which provides an advertising.

0108The advertising detailed information is associated to advertising information which is transmitted by the digital broadcasting and is more detailed information regarding goods and services which are advertised by the advertising information. As for the detailed information, a route for multiplexing it to a broadcasting signal and transmitting and a route for transmitting it via the internet <b>32</b> are prepared. In the invention, the advertising detailed information is not indispensable but only the advertising information added with the target ID can be also transmitted.

0109As shown in <figref idref="DRAWINGS">FIG. 3</figref>, the up-link system <b>22</b> is constructed: by servers <b>41</b>, <b>42</b>, <b>43</b>, and <b>44</b>; n packetizers <b>45</b>₁to <b>45</b>_n; a chain controller <b>46</b>; a multiplexer <b>48</b>; a modulating apparatus <b>49</b>; and the like. The servers <b>41</b> to <b>44</b>, n packetizers <b>45</b>₁to <b>45</b>_n, chain controller <b>46</b>, and multiplexer <b>48</b> are connected by an LAN (Local Area Network) <b>47</b>, respectively.

0110In the broadcasting station <b>21</b>, a program is produced and video/audio signals corresponding to the program are compressed and encoded by, for example, MPEG2, so that they are digitized and this program material is accumulated in the server <b>41</b> of the up-link system <b>22</b>. The advertising information added with a target ID for specifying a viewer class as a target of goods and services regarding the advertising and the advertising detailed information as more detailed information regarding the goods and services are accumulated in the server <b>42</b>. The advertising information and the advertising detailed information are data of any one or more of a video image, audio, animation, a still image, an icon, a text, and the like.

0111The target ID is specified in a manner similar to the viewer attribute information registered in an IC card unit of each receiving terminal. That is, the target ID is used to specify a range of consumer or purchase layer to which the enterprise wants to provide the goods and services concerning the advertising. Specifically speaking, the target ID has information such as sex, age, district, hobby, and the like. In the broadcasting signal, the target ID is added to the head of a series of advertising data. For example, a viewer attribute is registered in an IC card which is handed to the subscriber after he made a contract of the digital broadcasting.

0112The advertising detailed information is video and/or audio information of the contents to describe in more detail goods and services which are provided to the viewer. As a method of providing the advertising detailed information, as shown in the construction of <figref idref="DRAWINGS">FIG. 3</figref>, a method of multiplexing it to a digital broadcasting signal and a method of providing it from an information providing station other than the broadcasting signal are prepared. In this example, the detailed information is provided from the detailed information homepage <b>33</b> as an information providing station through the access point <b>31</b> and internet <b>32</b> as shown in <figref idref="DRAWINGS">FIG. 2</figref> and as mentioned above. When the advertising detailed information is transmitted by the broadcasting signal, an accessing method of the detailed information in the broadcasting signal associated to the advertising information is specified by the link information included in the advertising information. For instance, a packet ID including the advertising detailed information is designated.

0113In case of obtaining the detailed information through the internet <b>32</b>, the accessing method of the detailed information associated to the advertising information is specified by the link information included in the advertising information. For example, the link information includes the address information of a client such as URL (Uniform Resource Locator) of the detailed information homepage <b>33</b> of the internet <b>32</b>.

0114The advertising information with the target ID which is not accompanied with the detailed information is also multiplexed into the broadcasting signal. In case of the advertising information accompanied with the detailed information, for example, an icon such that the advertising information is provided at a predetermined position in the program for a predetermined time is set. The advertising detailed information provided by clicking the icon by the viewer of the program.

0115An EMM that is peculiar to each receiving terminal is accumulated in the server <b>43</b> shown in <figref idref="DRAWINGS">FIG. 3</figref>. Further, an EPG is accumulated in the server <b>43</b>. Moreover, although not shown, another server is provided and, for example, an ECM which is used as common information upon reception is accumulated in the other server.

0116The chain controller <b>46</b> forms control signals for the servers <b>41</b> to <b>44</b>, n packetizers <b>45</b>₁to <b>45</b>_n, and multiplexer <b>48</b> and controls them in accordance with a schedule designated by a PMS (Program Management System) and executes a systematic transmission control due to the time designation, respectively.

0117The video data from the server <b>41</b> is supplied to the packetizer <b>45</b>₁. The audio data from the server <b>41</b> is supplied to the packetizer <b>45</b>₂. Advertising information data from the server <b>42</b> is supplied to the packetizer <b>45</b>₁. The advertising detailed information data from the server <b>42</b> is supplied to the packetizer <b>45</b>₄. The advertising detailed information data from the server <b>42</b> is supplied to the packetizer <b>45</b>₅. With respect to the packetizers after the packetizer <b>45</b>₆, various data such as EMM, EPG, ECM, and the like are also similarly supplied.

0118Each of the packetizers <b>45</b>₁to <b>45</b>_ndivides a data train which is supplied into blocks, adds predetermined control information, and converts into a predetermined transmission unit format (namely, packet). In the packetizers <b>45</b>₁and <b>45</b>₂, each of the video/audio data is packed into a packet of a length of, for example, 188 bytes and is subjected to a pre-process for multiplexing and the processed data is supplied to the multiplexer <b>48</b>. In the packetizers <b>45</b>₃, <b>45</b>₄, and <b>45</b>₅, each of the advertising information data added with the target ID and the advertising detailed information data is packed into the packet and the data of the packet format is supplied to the multiplexer <b>48</b>. Even in the packetizers after the packetizer <b>45</b>₆as well, a converting process to the packet is likewise executed and the processed data is supplied to the multiplexer <b>48</b>.

0119In the multiplexer <b>48</b>, the data from the packetizers <b>45</b>₁to <b>45</b>₂is time-divisionally multiplexed, so that a transport stream is formed. This multiplexed output is supplied to a modulating apparatus <b>49</b>. The modulating apparatus first executes a scrambling process of every packet and an error correction encoding of every packet and executes, for instance, a QPSK (Quadrature Phase Shift Keying) modulation to the transport stream. A modulation output formed by the modulating apparatus <b>49</b> is transmitted to the communicating satellite <b>24</b> through a transmitting apparatus <b>50</b> and the transmitting antenna <b>23</b>. The scrambling process is a process for realizing the conditional access which is used to control the permission or inhibition of the monitoring every viewer. A key to descramble the scramble is included in the EMM and ECM and is inserted as one of the packets into the transport stream in a manner similar to the video/audio information and the advertising information.

0120<figref idref="DRAWINGS">FIG. 4</figref> shows a construction of an example of the receiving terminal. A broadcasting radio wave is transmitted from the transmitting antenna <b>23</b> and is received by the receiving antenna <b>25</b> through the communicating satellite <b>24</b>. The IRD is connected to the receiving antenna <b>25</b>. The receiving antenna <b>25</b> has an LNB (Low Noise Block down converter). The received radio wave signal is frequency converted and its output is supplied to the IRD.

0121The IRD <b>26</b> comprises: a tuner unit <b>61</b> for designating a receiving transponder; a demodulating unit <b>62</b>; an error correcting unit <b>63</b>; a descrambling unit <b>64</b> for descrambling a scramble; a demultiplexing unit <b>67</b> for designating a packet to be separated; a video decoding unit <b>69</b>; an audio decoding unit <b>68</b>; an OSD (On Screen Display) control unit <b>70</b> for controlling a display picture plane; and the like.

0122In <figref idref="DRAWINGS">FIG. 4</figref>, reference numeral <b>65</b> denotes a main control unit. The main control unit <b>65</b> controls the whole IRD <b>26</b> and is constructed by, for instance, a microcomputer or the like. An IC card unit <b>66</b>, the demultiplexing unit <b>67</b>, the OSD control unit <b>70</b>, a storing device <b>71</b>, and a modem unit <b>72</b> are connected to the main control unit <b>65</b> through a data bus, respectively.

0123In the tuner unit <b>61</b>, a signal of a frequency which is designated on the basis of the control signal from the main control unit <b>65</b> is extracted from the received radio wave signal. The QPSK modulated signal is demodulated by the demodulating unit <b>62</b>. A demodulation output is supplied to the error correcting unit <b>63</b>. In the error correcting unit <b>63</b>, errors in the reception data are corrected and a decoding output is supplied to the descrambling unit <b>64</b>. In the error correcting unit <b>63</b>, a decoding process of a Viterbi decoding and a Peed solomon code is executed.

0124The key which was previously transmitted by the EMM or the like and was recorded in the IC card unit <b>66</b> is read out and a descramble performed in the descrambling unit <b>64</b>. The transport stream obtained from the scrambling unit <b>64</b> is supplied to the demultiplexing unit <b>67</b>. In addition to the key for descrambling, a viewer attribute, a program monitor history, an advertising information monitor history, and a link information use history are recorded in the IC card unit <b>66</b>.

0125In the demultiplexing unit <b>67</b>, the packets in the transport stream are classified in accordance with an instruction of the main control unit <b>65</b>. That is, the audio packet of a service channel selected at present is supplied to the audio decoding unit <b>68</b> and the video packet is supplied to the video decoding unit <b>69</b>. In the audio decoding unit <b>68</b>, the audio data is decoded and is further D/A converted, so that a reception audio signal is formed. The reception audio signal is generated as a sound by a speaker. In the video decoding unit <b>69</b>, the video data is decoded and is further D/A converted and a reception video signal is formed. The reception video signal is supplied to the OSD control unit <b>70</b>.

0126The packet of the data (ECM, EEM, or the like) for control in the broadcasting signal and the packet of the advertising information are separated by the demultiplexing unit <b>67</b> and supplied to the main control unit <b>65</b>. The packet of the advertising information added with the target ID is temporarily stored in the storing device <b>71</b> under control of the main control unit <b>65</b>. The advertising detailed information designated by the link information in the advertising information is separated by the demultiplexing unit <b>67</b>. By controlling the OSD control unit <b>70</b> or by being decoded by the decoding units <b>68</b> and <b>69</b>, the advertising detailed information is outputted in a real-time manner.

0127In the embodiment, although the advertising information is temporarily stored in the storing device <b>71</b>, it is also possible to separate the packet of the advertising information having the target ID which coincides with the viewer attribute information by the demultiplexing unit <b>67</b> and to output it in a real-time manner.

0128The OSD control unit <b>70</b> is controlled by the main control unit <b>65</b>. In the OSD control unit <b>70</b>, an image such as a menu picture plane or the like is superimposed. The processed video signal is displayed as a picture plane. For example, in case of using an advertising icon as advertising information, the main control unit <b>65</b> controls the OSD control unit <b>70</b> and displays the advertising icon into the picture plane for a predetermined time.

0129As mentioned above, the received advertising information is temporarily stored into the storing device <b>71</b> under the control of the main control unit <b>65</b>. The main control unit <b>65</b> collates the target ID of the stored advertising information with the viewer attributes showing the sex, age, monitor district, hobby, and the like of the viewer which have previously been registered in the IC card unit <b>66</b>, extracts only the advertising information in the case where they coincide, and supplies the extracted advertising information data to the OSD control unit <b>70</b>.

0130A remote control signal from the remote control commander (external control apparatus) <b>27</b> is received by a receiving unit <b>73</b>. Input information which is transmitted by a remote control signal is supplied to the main control unit <b>65</b>. The main control unit <b>65</b> executes a process according to the remote control signal. For example, the operation to click the advertising icon, the operation to finish the display of the advertising detailed information, and the like can be performed by the operation of the commander <b>27</b>. As an input device, a keyboard, a mouse, or the like other than the remote control can be used.

0131The modem unit <b>72</b> is connected to the main control unit <b>65</b>. The modem unit <b>72</b> is connected to the public line network <b>29</b>. Thus, the receiving terminal (IRD <b>26</b>) and the contracted customer management center <b>30</b> are connected. The viewer information such as program monitor history, advertising information monitor history, link information use history, and the like recorded in the IC card unit <b>66</b> can be up-loaded by the contracted customer management center <b>30</b>. To obtain the detailed information for advertising and publicity from the homepage <b>33</b>, browser software of WWW is also installed in the main control unit <b>65</b>.

0132<figref idref="DRAWINGS">FIGS. 5A to 5C</figref> are flowcharts showing processes on the terminal side according to the embodiment of the invention mentioned above. First, a predetermined channel is received and the presence or absence of the packet of the advertising information data is determined in parallel with the receiving process (step S<b>1</b>). If there is no advertising information, the processing routine is finished. When the advertising information is received, the advertising information is temporarily stored in the storing device <b>71</b> (step S<b>2</b>).

0133The target ID of the preserved and received advertising information is collated with the viewer attributes (sex, age, district, etc.) which have previously been recorded in the IC card unit <b>66</b> and the advertising information in which both of them coincide is selectively read out from the storing device <b>71</b> (step S<b>3</b>). The extracted advertising information data is supplied the OSD control unit <b>70</b> and the advertising icon is displayed in the picture plane. For example, as shown at the top stage in <figref idref="DRAWINGS">FIG. 6</figref>, an advertising icon <b>81</b> is displayed in a part of a picture plane <b>80</b> which is displaying the program (step S<b>4</b>).

0134When the advertising icon <b>81</b> is displayed, if the viewer who watches the program wants to know more detailed information, he operates the commander <b>27</b> and clicks the advertising icon <b>81</b>. Whether the icon <b>81</b> has been clicked or not, namely, the presence or absence of the operation to request the display of the advertising detailed information is determined (step S<b>5</b>). When there is no display request of the advertising detailed information, the processing routine advances to step S<b>7</b>. In step S<b>7</b>, a check is made to see if a display end time of the advertising icon <b>81</b> has come. When the display end time comes, the display of the advertising icon <b>81</b> is turned off in step S<b>8</b> and the processing routine is finished. A display time of the advertising icon is controlled by, for example, a timer.

0135In step S<b>5</b>, when the presence of the operation to request the display of the advertising detailed information is decided, the presence or absence of the link information added in the advertising information data is determined (step S<b>6</b>). When there is not the link information showing an obtaining route of the advertising detailed information, the processing routine advances to step S<b>7</b> and the advertising icon is erased after the elapse of a predetermined time.

0136In step S<b>6</b>, the presence of the link information is determined, the advertising icon <b>81</b> is erased in step S<b>9</b>. In step S<b>10</b>, the obtaining route of the advertising information is discriminated. In step S<b>10</b>, when the obtaining route of the advertising detailed information is determined to be the broadcasting wave shown by the link information, the detailed information is received from the broadcasting wave in step S<b>11</b>. For example, it is now assumed that the link information shows the packet ID (PID) and the packet having such a packet ID is received.

0137In step S<b>12</b>, the picture plane showing the advertising detailed information based on the received advertising detailed information data is displayed by the OSD and the audio signal of the advertising detailed information is outputted. That is, the advertising detailed information is outputted in a real-time manner. A picture plane <b>82</b> at the middle stage in <figref idref="DRAWINGS">FIG. 6</figref> shows a display example of the advertising detailed information. In the example of the diagram, although the picture plane <b>82</b> of the advertising detailed information is displayed in place of the picture plane of the program, various display forms are possible. For example, the advertising detailed information can be also displayed by a PinP (master picture plane and slave picture plane) format, PandP (right and left divisional picture planes), or the like. Further, a plurality of picture planes of the advertising detailed information can be simultaneously displayed by divisional picture planes or a plurality of picture planes can be also displayed while sequentially transmitting one picture plane by one. Furthermore, the advertising detailed information can be also displaced in another display picture plane different from the display picture plane of the program. When the detailed information is displayed (outputted), the detailed information monitor history is recorded in the IC card unit <b>66</b>. In this case, the number of times of the requesting operation of the detailed information can be also recorded in the IC card unit <b>66</b>.

0138When the picture plane <b>82</b> of the advertising detailed information is displayed, the presence or absence of the display finishing operation using the remote control is determined (step S<b>13</b>). When the display finishing operation is performed, the picture plane <b>82</b> of the advertising detailed information is erased in step S<b>14</b>. The display is returned to the former program picture plane in step S<b>15</b>. In step S<b>16</b>, an advertising icon shown at <b>83</b> is again displayed in <figref idref="DRAWINGS">FIG. 6</figref>. The processing routine is returned to step S<b>7</b> of deciding the end of the display time.

0139In step S<b>10</b>, when it is determined that the obtaining route of the advertising detailed information shown by the link information is located on the network side, the modem unit <b>72</b> is controlled and dial-up connected to the provider (access point <b>31</b> in <figref idref="DRAWINGS">FIG. 2</figref>) of the internet in step S<b>17</b> by using the link information (for instance, a telephone number of the provider of the internet, a password, and a URL of the homepage).

0140In step S<b>18</b>, a picture plane of the advertising detailed information similar to that shown in <figref idref="DRAWINGS">FIG. 6</figref> is displaced. For example, a homepage designated by the URL is read out, fetched, and displayed by software to read the homepage which is called a “browser”. When it is displayed, the detailed information monitor history is recorded in the IC card unit <b>66</b>. The advertising detailed information can be also made differ depending on the obtaining route.

0141Subsequently, the presence or absence of the display finishing operation is determined in step S<b>19</b> in a manner similar to step S<b>13</b>. When the display finishing operation is performed, the display of the picture plane <b>82</b> of the advertising detailed information is finished (step S<b>20</b>). Further, the connection to the internet <b>32</b> is released and it is disconnected from the homepage <b>33</b> of the detailed information for advertisement and publicity (step S<b>21</b>). Specifically speaking, the browser is finished and the connection to the access point <b>31</b> is shut off. The processing routine is returned to the display of the advertising icon in step S<b>16</b>.

0142As mentioned above, when there is a detailed information request during the display of the advertising icon, the detailed information is obtained and displayed. In the above process, when a toll program monitor history such as a monitor history or the like of the PPV is periodically or irregularly up-loaded, the detailed information monitor history recorded in the IC card unit <b>66</b> is notified to the contracted customer management center together with them.

0143As mentioned above, when the advertising detailed information is obtained via the internet, an access log can be performed in the homepage <b>33</b>. Since the browser software name can be known in the homepage, the monitor history of the advertising detailed information can be also formed from the software name and the number of accessing times. For example, in case of the internet, as for the number of accesses, it can be counted by a CGI (Common Gateway Interface) and an SSI (Server Side Includes). At the same time, when and from which access point <b>31</b> and which link information and browser were used can be time-sequentially recorded as a history of the accesses.

0144In the embodiment of the invention, after the received advertising information was stored, the target ID and viewer attribute information are collated. However, it is also possible to construct such that when a broadcasting wave is received, the collation is performed and only the advertising information in which both of them coincide is stored in the storing device. Although the description up to the providing of the advertising detailed information has been made above, as a stage after providing, the operation to buy the advertised goods and services can be also performed. Further, although the embodiment of the invention has been described with respect to the construction using the internet, the other network can be also used. Moreover, the invention can be also applied to a digital broadcasting of a cable television or a digital broadcasting system of a ground wave.

0145In the example, it is assumed that the Karaoke terminal of the existing communication Karaoke or the existing IRD for CS digital broadcasting is commonly used and Karaoke data, personal data, or the like using a data broadcasting is received. That is, a function for exchange of personal data is newly added to the communicating Karaoke system which has already been established. The terminal, therefore, has the functions of the Karaoke terminal and the seal exchanging terminal.

0146<figref idref="DRAWINGS">FIG. 7</figref> shows an embodiment of a Karaoke terminal of the communicating Karaoke using the IRD for CS digital broadcasting. In <figref idref="DRAWINGS">FIG. 7</figref>, reference numeral <b>101</b> denotes a data transmission center. The data transmission center <b>101</b> transmits Karaoke data (MIDI data, song music additional data, control data, and the like), personal data (seal data, additional information, detailed information, etc.), advertising and various information data, and the like. MIDI (Musical Instrument Digital Interface) is a code for musical instrument control.

0147The data from the data transmission center <b>101</b> is sent to a broadcasting (up-link) center <b>102</b>. The broadcasting center <b>102</b> is a transmission center of a digital broadcasting. The broadcasting center <b>102</b> multiplexes and modulates the data sent from the data transmission center <b>101</b> and transmits to a communicating (or broadcasting) satellite <b>103</b>. A radio wave from the satellite <b>103</b> is received by a receiving antenna <b>104</b> of the terminal.

0148An IRD <b>105</b> is connected to the receiving antenna <b>104</b>. A seal exchange terminal <b>106</b> and a Karaoke terminal <b>107</b> are connected to the IRD <b>105</b>. The terminal side is constructed by the receiving antenna <b>104</b>, IRD <b>105</b>, seal exchange terminal <b>106</b>, and Karaoke terminal <b>107</b>. Reference numeral <b>108</b> denotes a public line network and <b>109</b> indicates an internet provider. The internet provider <b>109</b> has a function as a server in a personal data exchange system.

0149The IPD <b>105</b> is a tuner for receiving a digital broadcasting and receives the data transmitted from the broadcasting center <b>102</b> through the satellite <b>103</b>. In the system, a channel is set so as to always receive the present services (transmission and reception of Karaoke data and personal data). The IRD <b>105</b> transmits the data in which only the MPEG2 transport stream packet of the present services was descrambled to the seal exchange terminal <b>106</b>. With regard to the digital broadcasting reception, accounting information is communicated to the broadcasting center <b>102</b> through the public line network <b>108</b>.

0150The seal exchange terminal <b>106</b> is a terminal to provide services which are executed in the seal data exchange system to the user. Only the data of the present service is separated from the data received from the IRD <b>105</b>, further, the Karaoke data and the other data are separated, and only the Karaoke data is transmitted to the Karaoke terminal <b>107</b>. By a request or the like by the user of the seal exchange terminal, a transmitting request regarding various data such as personal data and the like is issued to the internet provider <b>109</b> through the public line network <b>108</b>.

0151The Karaoke terminal <b>107</b> is a conventional communication Karaoke terminal and executes a reproduction of MIDI data, a display control of words, an acoustic special effect, and the like. A transmitting request of the Karaoke data is issued to the data transmission center <b>101</b> through the public line network <b>108</b>. The data transmitted from the data transmission center <b>101</b> is transmitted from the seal exchange terminal <b>106</b> to the Karaoke terminal <b>107</b>.

0152The public line network <b>108</b> is an analog/digital telephone line network of NTT or the like. The internet provider <b>109</b> receives the personal data formed by the seal exchange terminal <b>106</b> through the public line network <b>108</b> and preserves it. A personal data transmitting request is issued by a similar route.

0153As mentioned above, the transmitting request of the Karaoke data is performed by the Karaoke terminal <b>107</b> and the request of the personal data is performed by the seal exchange terminal <b>106</b>. The Karaoke data exists in the data transmission center <b>101</b> and is transmitted through the broadcasting center <b>102</b> and satellite <b>103</b> in a manner similar to the digital broadcasting. The personal data such as seal data or the like is also similarly transmitted. The personal data is transmitted from the internet provider (server) <b>109</b> through the data transmission center <b>101</b>. With regard to the use of each data, the seal exchange terminal <b>106</b> and Karaoke terminal <b>107</b> are connected to the data transmission center <b>101</b> by the public line network <b>108</b>, thereby communicating the accounting information. Further, the IRD <b>105</b> and broadcasting center <b>102</b> are connected through the public line network <b>108</b>, thereby communicating the accounting information concerning the data (digital broadcasting) reception.

0154<figref idref="DRAWINGS">FIG. 8</figref> shows one constructional example of the terminal. The receiving antenna <b>104</b> is, for example, an antenna for receiving a CS digital broadcasting. The IRD <b>105</b> is an IRD for receiving a CS digital broadcasting. The IRD <b>105</b> always receives the present services, descrambles only the packet of the present services in the received MPEG2 transport stream packet, and outputs the transport stream from a data port. As shown in <figref idref="DRAWINGS">FIG. 7</figref>, the IRD <b>105</b> is connected to the public line network <b>108</b>.

0155The seal exchange terminal <b>106</b> is connected to the IRD <b>105</b>. A printer <b>118</b>, a camera <b>119</b>, a monitor <b>110</b> for displaying words of a song, a speaker <b>111</b>, an input device <b>113</b> such as keys, mouse, and the like, a monitor <b>114</b>, and headphones <b>115</b> are connected to the seal exchange terminal <b>106</b>. A microphone <b>112</b> is connected to the Karaoke terminal <b>107</b> connected to the seal exchange terminal <b>106</b>. The terminal <b>107</b> can be operated by a remote control commander <b>116</b>.

0156The printer <b>118</b> prints seal data formed by the seal exchange terminal <b>106</b> and seal data exchanged to that of the other person. The seal data denotes image data (typically, face image data) included in the personal data. The printer <b>118</b> is connected to a serial output terminal of the seal exchange terminal <b>106</b>.

0157The camera <b>119</b> is used to form the seal data by the seal exchange terminal <b>106</b> and is connected to a serial output terminal of the seal exchange terminal <b>106</b>. The monitor <b>110</b> for displaying the words is used for displaying words and background video image at the time of the Karaoke and for displaying an image monitor and additional information input picture plane at the time of the formation of the seal data. The monitor <b>110</b> is connected to a video output terminal of the seal exchange terminal <b>106</b> so that it can be switched in accordance with the Karaoke mode or the seal data forming mode. That is, the video output to the monitor <b>110</b> is switched by a selector in the seal exchange terminal <b>106</b>. The speaker <b>111</b> generates musical pieces and an audio message of the personal data and is connected to an audio output terminal of the seal exchange terminal <b>106</b>.

0158The microphone <b>112</b> is used to sing Karaoke songs and to input the audio message of the personal data. An audio signal is outputted from an audio output terminal of the Karaoke terminal <b>107</b> to the speaker <b>111</b> through the seal exchange terminal <b>106</b>. When audio additional information is inputted, the audio additional information is sampled and compressed in the seal exchange terminal <b>106</b>.

0159The seal exchange terminal <b>106</b> executes processes of all of the services other than Karaoke among the present services. As shown in <figref idref="DRAWINGS">FIG. 7</figref>, in order to request the data transmission, the seal exchange terminal <b>106</b> is connected to the internet provider (server; through the public line network <b>108</b> so that a two-way communication can be performed.

0160As for the Karaoke service, only the Karaoke data is extracted from the packet of the transport stream received from the IRD <b>105</b> and is outputted to the Karaoke terminal <b>107</b> and, at the same time, the video/audio signals are received and outputted to the monitor <b>110</b> for displaying the words and the speaker <b>111</b>.

0161With respect to the formation of the seal data, seal data and auxiliary information are formed from the seal data related data received from the IRD <b>105</b>, video input from the camera <b>119</b>, command input of the user from the input device <b>113</b>, and the like and are connected to the public line network <b>108</b> and are preserved in the server.

0162With regard to the display of the seal data, the seal data, auxiliary information, and the like which are transmitted by the digital broadcasting and received from the IRD <b>105</b> can be monitored by the monitor <b>114</b> for displaying the personal data and headphones <b>115</b>. In this instance, commands from the user are inputted by using the input device <b>113</b>. The input device <b>113</b> have charge of all of the command inputs from the user except for Karaoke among the present services and is connected to a serial input terminal of the seal exchange terminal <b>106</b>.

0163The monitor <b>114</b> for displaying the personal data is used for persons other than the singer to refer to the seal data during the Karaoke and is connected to a video/audio output terminal of the seal exchange terminal <b>106</b>. The input of the commands from the user at the time of referring to the seal data or the like is performed by using the input device <b>113</b>.

0164When the persons other than the singer refer to the seal data during the Karaoke, the headphones <b>115</b> are used in order to reproduce and listen to the audio message of the additional information. The headphones <b>115</b> are connected to a headphone terminal of the monitor <b>114</b> for displaying the personal data.

0165As for the Karaoke terminal <b>107</b>, an existing Karaoke terminal is used as it is. The Karaoke data is received from the seal exchange terminal <b>106</b> and the video/audio signals are outputted. As shown in <figref idref="DRAWINGS">FIG. 7</figref>, the Karaoke terminal <b>107</b> is connected to the public line network <b>108</b> in order to request the transmission of data such as song data for communication Karaoke or the like. As a remote control commander <b>116</b> for Karaoke, an existing music selecting remote control for Karaoke is used. The remote control <b>116</b> transmits an infrared signal to the Karaoke terminal <b>107</b>.

0166As mentioned above, at the terminal, as the monitor <b>110</b> for displaying the words, speaker <b>111</b>, microphone <b>112</b>, and remote control <b>116</b>, those equipped for the existing Karaoke terminal can be commonly used.

0167In case of the terminal shown in <figref idref="DRAWINGS">FIG. 8</figref>, one IRD <b>105</b>, one seal exchange terminal <b>106</b>, and one Karaoke terminal <b>107</b> are provided. Actually, there are a plurality of rooms in a Karaoke shop and in many cases, the terminal is installed in each room. In such a case, in <figref idref="DRAWINGS">FIG. 9</figref>, it is proper to collectively control a plurality of seal exchange terminals <b>106</b><i>a</i>, <b>106</b><i>b</i>, and <b>106</b><i>c </i>and Karaoke terminals <b>107</b><i>a</i>, <b>107</b><i>b</i>, and <b>107</b><i>c </i>by a control unit (called a gateway) <b>150</b>. The gateway <b>150</b> and seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>are connected by a network. The Karaoke terminals <b>107</b><i>a </i>to <b>107</b><i>c </i>are connected to the seal exchange terminals, respectively.

0168As mentioned above, processes such as reception from the IRD, call generation to the internet provider, and the like which are executed by the seal exchange terminal are collected by the gateway <b>150</b>, so that the simplification of the system, reduction of a communication fee, and the like can be realized. In <figref idref="DRAWINGS">FIG. 9</figref>, the printer, camera, monitor for displaying the words, speaker, microphone, input device, monitor for displaying the personal data, headphones, and remote control for the Karaoke terminal which are connected to the seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>and Karaoke terminals <b>107</b><i>a </i>to <b>107</b><i>c </i>as shown in <figref idref="DRAWINGS">FIG. 8</figref> are not shown.

0169The gateway <b>150</b> transmits the Karaoke data and personal data in the packet received from the IRD <b>105</b> to the seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>through the network. Although not shown in <figref idref="DRAWINGS">FIG. 9</figref>, the gateway <b>150</b> is connected to the public line network in order to register the personal data into the server and to request the data transmission of the personal data exchange service and executes processes in response to the request from each seal exchange terminal.

0170The seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>execute processes of all of the services except for Karaoke among the present services. With respect to the Karaoke service, only the Karaoke data is extracted from the data received from the gateway <b>150</b> and outputted to the Karaoke terminals <b>107</b><i>a </i>to <b>107</b><i>c </i>and, at the same time, the video/audio signals are received and outputted to the monitor/speaker for displaying the words.

0171With respect to the formation of the personal data, only the personal data is extracted from the data received from the gateway <b>150</b>, the seal data and additional information are formed from the personal data related data, video input from the camera, command inputs of the user from the input device, and the like, a data preservation is requested to the gateway <b>150</b>, and the data is transferred.

0172With regard to the display of the seal data, the seal data, additional information, and the like received from the gateway <b>150</b> can be monitored by the monitor for displaying the personal data and the headphones. The command input from the user at that time is executed by using the input device.

0173The Karaoke terminals <b>107</b><i>a </i>to <b>107</b><i>d </i>are existing communication Karaoke terminals. The Karaoke data is received from the seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>and the video/audio signals are outputted. A request to transmit data such as song data for communication Karaoke or the like is transmitted through the gateway <b>150</b> and public line network <b>108</b>.

0174The seal exchange terminal <b>106</b> shown in <figref idref="DRAWINGS">FIG. 8</figref> and the seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>shown in <figref idref="DRAWINGS">FIG. 9</figref> have a construction shown in, for example, <figref idref="DRAWINGS">FIG. 10</figref>. In <figref idref="DRAWINGS">FIG. 10</figref>, the MPEG2 transport stream is supplied from the IRD <b>105</b> or gateway <b>150</b> to an input terminal (port) <b>121</b>. This stream is supplied to a data converter <b>122</b>. The data converter <b>122</b> transfers the input data to a programmable DSP <b>127</b> through a bus <b>123</b>.

0175Since the data converter <b>122</b>, a printer controller <b>24</b>, a hare disk <b>126</b>, and the programmable DSP <b>127</b> are connected on the same bus <b>123</b>, they have a buffer function so as to transfer the data only in the case where the bus <b>123</b> is free. The printer controller controls the external printer and outputs the data transferred from the programmable DSP <b>127</b> to the printer. The hard disk <b>126</b> executes a buffering of the transport stream, a storage of the data, and the like.

0176The programmable DSP <b>127</b> executes processes such as demultiplexing of the MPEG2 transport stream, decoding, system control, and the like. For example, the programmable DSP <b>127</b> comprises an RISC CPU and a DSP and programs of the CPU unit and DSP control unit can be changed from the outside.

0177A serial controller <b>129</b> connected to the programmable DSP <b>127</b> has terminals <b>130</b> and <b>131</b>. A modem <b>132</b> is connected to the serial controller <b>129</b>. The modem <b>132</b> is connected to the public line network <b>108</b> through a terminal <b>133</b>. The input device <b>113</b> which is used by the user is connected through the terminal <b>130</b>. The camera <b>119</b> is connected through the terminal <b>131</b>. The serial controller <b>129</b> controls the modem <b>132</b> and camera <b>119</b> and outputs data from the modem <b>132</b> and data from the camera <b>119</b> to the programmable DSP <b>127</b>. Transmission data from the programmable DSP <b>127</b> is outputted from the terminal <b>132</b> to the public line network <b>108</b> through the serial controller <b>129</b> and modem <b>132</b>.

0178The Karaoke data is transmitted from the programmable DSP <b>127</b> to the Karaoke terminal through a terminal <b>134</b>. An RAM <b>128</b> connected to the programmable DSP <b>127</b> is used for buffering of the transport stream, buffering upon decoding of the transport stream, storage of the display data, or the like.

0179The image data decoded by the programmable DSP <b>127</b> is supplied to a video encoder <b>135</b>. The video encoder <b>135</b> D/A converts the image data outputted from the programmable DSP <b>127</b> and outputs to a switcher <b>136</b>. An audio AD/DA unit <b>138</b> connected to the programmable DSP <b>127</b> D/A converts the audio data from the programmable DSP <b>127</b> and outputs to the switcher <b>136</b>. The audio AD/DA unit <b>138</b> A/D converts the audio signal from the switcher <b>136</b> and outputs to the programmable DSP <b>127</b>.

0180The switcher <b>136</b> is switched by a control signal from the programmable DSP <b>127</b>. The switcher <b>136</b> has an output terminal <b>137</b> of the analog video/audio signals, an output terminal <b>139</b> of the analog video/audio signals, and an audio signal input terminal <b>140</b> from the Karaoke terminal. The video/audio signals from the output terminal <b>137</b> are supplied to the monitor for displaying the words and the speaker. The video/audio signals from the other output terminal <b>139</b> are supplied to the monitor for displaying the personal data.

0181The gateway <b>150</b> has a construction shown in <figref idref="DRAWINGS">FIG. 11</figref> as an example. The transport stream from the IRD <b>105</b> is supplied to a data converter <b>152</b> through an input terminal <b>151</b>. A CPU <b>155</b> is provided to control the whole gateway <b>150</b>. By an instruction of the CPU <b>155</b>, the data converter <b>152</b> transfers the transport stream to a hard disk <b>154</b> or an RAM <b>156</b> via the CPU <b>155</b>. The RAM <b>156</b> is used by the CPU <b>155</b> and is used for storage of programs and data or the like. The hard disk <b>154</b> executes a buffering of the transport stream, a storage of the data, and the like.

0182A modem <b>159</b> is connected to the CPU <b>155</b>. The modem <b>159</b> is connected to an external public line network through a terminal <b>160</b> and the CPU <b>155</b> executes a communication to the outside. A network I/F (interface) <b>157</b> is connected to a network through a terminal <b>158</b>. A plurality of seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>are connected to the network as shown in <figref idref="DRAWINGS">FIG. 9</figref>. The network I/F <b>157</b> communicates with an external seal exchange terminal by an instruction of the CPU <b>155</b>. Since the data converter <b>152</b>, hard disk <b>154</b>, CPU <b>155</b>, and network I/F <b>157</b> are connected onto a same bus <b>153</b>, they have a buffer function to transfer the data only in the case where the bus is free.

0183The seal exchange terminals <b>106</b><i>a </i>to <b>106</b><i>c </i>connected to the gateway <b>150</b> have a construction similar to that shown in <figref idref="DRAWINGS">FIG. 10</figref>. The transport stream from the gateway <b>150</b> is supplied to the data input terminal <b>121</b> through the network.

0184Processes of the foregoing seal data exchange system will now be described with reference to flowcharts and a picture plane display. The picture plane display is displayed on the monitor <b>114</b> for displaying the personal data with the construction of the terminal of <figref idref="DRAWINGS">FIG. 8</figref>. The input of the user at the terminal is executed by using the input device <b>113</b>. <figref idref="DRAWINGS">FIGS. 12</figref>, <b>13</b>, and <b>14</b> are flowcharts showing processes for an input, a search, and the like of the personal data. Although those diagrams relate to a series of processes, they are divisionally shown because of limitation of a drawing region.

0185In the embodiment of the invention, the personal data is made up of seal data, auxiliary information, and detailed information as shown in <figref idref="DRAWINGS">FIG. 18</figref>. The seal data is mainly image data like a face image. The auxiliary information is information such as name concerning the seal data, character message, audio message, and the like. Although not shown, the moving picture data can be also annexed to the personal data as auxillary information. The detailed information is more detailed information. An input of the detailed information is not performed in a terminal apparatus but is performed by another input method as will be explained hereinlater.

0186In step S<b>31</b> in <figref idref="DRAWINGS">FIG. 12</figref>, the programmable DSP <b>127</b> of the terminal forms a log in picture plane image into the RAM <b>128</b> and allows the log in picture plane image to be displayed on the monitor <b>114</b> through the video encoder <b>135</b>, thereby promoting the user to input a data ID of the personal data and a password. The user operates the input device <b>113</b> and inputs the issued data ID and password and records into the RAM <b>128</b> through the serial controller <b>129</b>.

0187The user who has already possessed the data ID is allowed to input a data ID and a password from the input device. However, the user as a beginner can be also allowed to depress (click, select) a confirmation button without an input of a data ID and a password and the processing routine can be also progressed to step S<b>32</b>. If none of the data ID and the password is inputted, the personal data is formed and if none of the data ID and the password is issued to the user, the function such as a transmission of the message or the like cannot be used.

0188The inputted data ID and password are stored into the RAM <b>128</b> and, at the same time, they are transmitted and notified to the internet provider <b>109</b> (hereinafter, simply referred to as a server) as an ID of a person who uses the terminal at present through the serial controller <b>129</b>, modem <b>132</b>, and public line network <b>108</b> together with a unique ID of the terminal. Thus, in the case where a message is sent to a person who uses the terminal at present from the other user, a notification of the arrival of the message can be displayed during the use.

0189When the data ID and password are not authorized in the center <b>101</b>, namely, when the input password is a wrong or illegal password, an error message is displayed on the picture plane, thereby promoting the user to again input.

0190In step S<b>32</b>, an initial picture plane P<b>1</b> is displayed and the operation of the terminal is selected. The programmable DSP <b>127</b> forms an image of the initial picture plane P<b>1</b> shown in <figref idref="DRAWINGS">FIG. 19</figref> into the RAM <b>128</b> and allows it to be displayed on the monitor <b>114</b> through the video encoder <b>135</b>, thereby promoting the user to select either one of the Karaoke function and the seal exchanging function. In <figref idref="DRAWINGS">FIG. 19</figref>, reference numeral <b>201</b> denotes a button which is depressed in case of selecting the Karaoke function and <b>202</b> indicates a button which is depressed in case of selecting the seal exchanging function.

0191In step S<b>33</b>, when the Karaoke function is selected by using the input device <b>113</b> by the user, the operating mode advances to the Karaoke mode. Since processes of Karaoke are similar to those at the existing communication Karaoke terminal, their descriptions are omitted here. When the seal exchanging function is selected, the processes for displaying and selecting a picture plane P<b>2</b> are executed (step S<b>34</b>). The programmable DSP <b>127</b> forms the image of the picture plane P<b>2</b> for formation and display as shown in <figref idref="DRAWINGS">FIG. 20</figref> into the RAM <b>128</b> and allows the image to be displayed on the monitor <b>114</b> through the video encoder <b>135</b>.

0192On the picture plane P<b>1</b>, a button <b>203</b> is depressed in case of forming or updating the own personal data. A button <b>204</b> is depressed in case of confirming the message for the own data. A button <b>205</b> is depressed in case of displaying personal data of the other persons registered in the seal exchange service.

0193When the button <b>204</b> or <b>205</b> is depressed by the input device <b>113</b>, namely, when a confirmation of the message for the own data or a display of the seal data of the other persons is selected, the processing routine advances to a process for referring to the other personal data, which will be explained hereinlater. In the log in picture plane in step S<b>31</b>, however, if the own data ID or password is not inputted yet, a confirmation of a termination message to the own data cannot be selected.

0194In step S<b>35</b>, when the formation/updating (button <b>203</b>) of the own personal data is selected, the seal data in the personal data is first inputted. After that, audio data, name, constellation, blood group, school year (occupation), regular message, additional data, and the like are inputted as auxiliary information. When the seal data is inputted, a picture plane P<b>3</b> is displayed and a frame is selected. A frame selection picture plane image of the picture plane P<b>3</b> shown in <figref idref="DRAWINGS">FIG. 21</figref> is formed and displayed.

0195In <figref idref="DRAWINGS">FIG. 21</figref>, three kinds of frames <b>206</b>, <b>207</b>, and <b>208</b> are displayed on the picture plane P<b>3</b>. By the picture plane P<b>3</b>, it is promoted that the selection of a frame to be added to the seal among those frames is performed by the input device <b>113</b>. The frame image shown in <figref idref="DRAWINGS">FIG. 21</figref> is an example. In the embodiment, by transmitting it by using the digital satellite broadcasting, not only the season and fashion but also a frame image which is useful for only the day can be selected.

0196The processing routine advances to step S<b>37</b> in <figref idref="DRAWINGS">FIG. 13</figref>. A selection picture plane P<b>4</b> of a shutter mode shown in <figref idref="DRAWINGS">FIG. 22</figref> is displayed, thereby promoting the selection of the shutter mode. On the picture plane P<b>4</b>, a button <b>209</b> is depressed in case of fetching the image just after the shutter button was depressed. A button <b>210</b> is depressed in case of fetching the image (in case of a timer mode) after the elapse of a predetermined time for example, 5 seconds) after the shutter button was depressed.

0197In step S<b>38</b>, a check is made to see if the button <b>209</b> to photograph at once has been selected. When the button <b>209</b> is selected, the processing routine advances to step <b>242</b>. On the other hand, when the button <b>210</b> of the timer is selected, step S<b>39</b> follows. In step S<b>32</b>, a picture plane P<b>5</b> (<figref idref="DRAWINGS">FIG. 23</figref>) is displayed. The picture plane P<b>5</b> is obtained by synthesizing the image photographed by the camera <b>119</b> and the selected frame. That is, a still image photographed by using the camera <b>119</b> is fetched into the RAM <b>128</b> from the serial port through the serial controller <b>129</b>. The frame and message are overlaid to the still image fetched in the RAM <b>128</b>, the picture plane P<b>5</b> shown in <figref idref="DRAWINGS">FIG. 23</figref> is formed and is outputted through the video encoder <b>135</b> and is displayed on the monitor <b>114</b>.

0198A photographing pose is determined while confirming the picture plane on the monitor <b>114</b> and the shutter button is depressed at an arbitrary timing. In step S<b>43</b>, a notification of the depression of the shutter button which is issued from the input device <b>113</b> is waited. When the button is pressed, step S<b>44</b> follows. In step S<b>44</b>, the still image photographed by the camera <b>119</b> is fetched from the serial port into the RAM <b>128</b> by using the serial controller <b>129</b>. An overlay display of the picture plane P<b>5</b> in <figref idref="DRAWINGS">FIG. 23</figref> is finished.

0199In step S<b>38</b>, when the timer mode is selected, a timer image <b>211</b> of a picture plane P<b>6</b> shown in <figref idref="DRAWINGS">FIG. 24</figref> is displayed. In this case, a display method such that a scale display is reduced so that a time (in this example, 5 seconds) set by the timer can be visually known or the like is used. It is also possible to generate an electronic sound such as a beep sound every second at which a timing can be set. In step S<b>40</b>, while producing and displaying the timer image <b>211</b>, the system waits for five seconds with reference to a built-in timer. When five seconds elapse, in step S<b>41</b>, the still image photographed by using the camera <b>119</b> is fetched into the RAM <b>128</b> from the serial port by using the serial controller <b>129</b>.

0200A frame image is overlaid onto the still image fetched in the RAM <b>128</b> and a confirmation message is also overlaid. A picture plane P<b>7</b> of <figref idref="DRAWINGS">FIG. 25</figref> is displayed on the monitor <b>114</b> through the video encoder <b>135</b>. The user confirms or cancels with reference to the picture plane P<b>7</b>. In step S<b>46</b>, whether the confirmation button has been depressed or not is determined. When the confirmation button is depressed, the processing routine advances to step S<b>47</b> shown in <figref idref="DRAWINGS">FIG. 14</figref>. When the cancel button is depressed, the processing routine is returned to step S<b>37</b> and the object is again photographed. As mentioned above, if the user does not like the photographed image, he can again photograph.

0201In step S<b>47</b>, an audio message as one of the auxiliary information of the personal data is inputted. In this case, an audio message input picture plane P<b>8</b> shown in <figref idref="DRAWINGS">FIG. 26</figref> is displayed by the monitor <b>114</b> and an audio inputting operation is executed. To make the inputting process easy, a display <b>212</b> to clarify a volume level and a display <b>213</b> to clarify a recording starting timing are presented on the picture plane P<b>8</b>. By those displays, the timing is matched with the recording time and an audio sound is inputted by using the microphone <b>112</b> of the terminal while confirming the recording level. The inputted audio message is stored as personal data constructing elements into the RAM <b>128</b> together with the frame image and still image data.

0202A name as one of the auxiliary information of the personal data is inputted (step S<b>48</b>). A name data input picture plane P<b>9</b> shown in <figref idref="DRAWINGS">FIG. 27</figref> is displayed and the name is inputted. By selecting the inputting method, for example, in case of the input by a software keyboard, the picture plane P<b>9</b> of <figref idref="DRAWINGS">FIG. 27</figref> is used. When the name is inputted, a software keyboard <b>214</b> is displayed on the picture plane and up to about 8 to 10 characters are inputted. As characters which can be used, there are Hiragana, Katakana, numerals, alphabets, several symbols, and the like.

0203As another inputting method, a method of inputting characters by numerals like a message input of a pocket bell can be also used. According to another method, input picture plane P<b>10</b> shown in <figref idref="DRAWINGS">FIG. 28</figref> is displayed and a table <b>215</b> showing a correspondence between numerals and characters is displayed on the picture plane. Keys “0” to “9” and several alphabet keys are used in this case. A numeral and a character of two digits among them are used and are allocated to the above character. A text character train inputted as mentioned above is stored as personal data constructing elements into the RAM <b>128</b> in a manner similar to the audio message.

0204When the input of the name is confirmed, the processing routine advances to step S<b>49</b>. Step S<b>49</b> relates to a process for inputting a profile of a person who made the personal data as auxiliary information. In step S<b>49</b>, an input picture plane P<b>11</b> shown in <figref idref="DRAWINGS">FIG. 29</figref> is displayed. As will be understood from the picture plane P<b>11</b>, with respect to each list of constellation, blood group, and occupation (school year), by selectively inputting them by using a list box displayed on the picture plane, the profile is inputted.

0205That is, as shown in the picture plane P<b>11</b>, with respect to each item, a list box is opened like a picture plane P<b>12</b> shown in <figref idref="DRAWINGS">FIG. 30</figref> and a desired item is selected from prepared selection items. The inputted profile data is stored as personal data constructing elements into the RAM <b>128</b>. After the input of the profile was confirmed, the processing routine advances to step S<b>50</b>.

0206In steps S<b>50</b> and S<b>51</b>, a regular message as one of the auxiliary information is inputted. The input of the regular message is used for an input of conditions of a partner whom the user wants to exchange the seal data or the like. In case of inputting desired conditions, a regular message selection picture plane P<b>13</b> shown in <figref idref="DRAWINGS">FIG. 31</figref> is first displayed, thereby promoting the selection of a genre and allowing it to be selected by the operation of the input device <b>113</b> (step S<b>50</b>).

0207In step S<b>51</b>, a picture plane P<b>14</b> shown in <figref idref="DRAWINGS">FIG. 32</figref>, a picture plane P<b>15</b> shown in <figref idref="DRAWINGS">FIG. 33</figref>, and a picture plane P<b>16</b> shown in <figref idref="DRAWINGS">FIG. 34</figref> are displayed and information of the partner whom the user wants to exchange the seal is selected and set by using those picture planes. In the example shown in the diagram, a type, area, occupation (school year), hobby, and the like are selected by using the list box. As mentioned above, a regular message of the personal data is decided. The regular message which was selected and set is stored as personal data constructing elements into the RAM <b>108</b>.

0208In step S<b>52</b>, additional data is inputted. The additional data is used to input PR information of the person who made the seal data. The PR information is inputted by using the software keyboard. The number of characters is set to, for example, about 40 characters and Hiragana, Katakana, numerals, alphabets, icon, several symbols, and the like can be used as characters in a manner similar to the case of the name. It is also possible to use a system for converting input numerals into a character like a table displayed on a picture plane P<b>17</b> shown in <figref idref="DRAWINGS">FIG. 35</figref> instead of the software keyboard.

0209In step S<b>53</b>, an inputting process of an animation icon is performed. A picture plane P<b>18</b> shown in <figref idref="DRAWINGS">FIG. 36</figref> shows a selecting picture plane of the animation icon. In this example, one of three animation icons <b>216</b>, <b>217</b>, and <b>218</b> is selected. The animation icon shows the number of elapsed days from the date when the personal data has been formed. An image of the animation icon increases everyday or the number of images increases in association with the elapse of day from the making date. By seeing the animation icons, the number of valid days of the personal data and the number of days until a validity term of the personal data can be known. If the personal data is updated, by increasing the number of icons, how many times the data was updated can be clearly shown.

0210In step S<b>54</b>, a layout is selected by using a layout selecting picture plane P<b>19</b> in <figref idref="DRAWINGS">FIG. 37</figref> and the personal data formed is confirmed by using a confirming picture plane P<b>20</b> shown in <figref idref="DRAWINGS">FIG. 38</figref>. The “layout” is a layout to display the seal data and auxiliary information. In <figref idref="DRAWINGS">FIG. 37</figref>, three kinds of layouts <b>219</b>, <b>221</b>, and <b>222</b> are prepared and one of them can be selected with an L/R key. After the layout was selected, it is confirmed by the picture plane P<b>20</b> and is decided.

0211The seal data and auxiliary information (audio message, name, profile, regular message, partner information, PR information, animation icon, layout, etc.) which was set and stored in the RAM <b>128</b> by foregoing steps S<b>31</b> to S<b>54</b> is transmitted to the server through the public line network <b>108</b> by using the serial controller <b>129</b> and modem <b>132</b> by the control of the programmable DSP <b>127</b> (step S<b>55</b>).

0212In step S<b>56</b>, the server receives the data of the constructing elements of the personal data mentioned above. When the data is decided to be valid, the server issues a unique data ID for the received personal data constructing elements and also generates a password. Further, the data of the personal data constructing elements is registered into a database together with the data ID and password. The data ID and password are transmitted to the terminal. In step S<b>57</b>, the terminal receives the ID and password through the modem <b>132</b> and serial controller <b>129</b> and stores into the RAM <b>128</b>.

0213The personal data is processed to an image with 16 divided frames in the RAM <b>128</b> by the control of the programmable DSP <b>127</b>. Among the divided images, the text image of the data ID and password received in step S<b>56</b> is overlaid to only the seal existing at the right lower corner position. The image transmitted to the printer by using the serial controller <b>129</b> is printed as shown by a print output PP<b>1</b> shown in <figref idref="DRAWINGS">FIG. 39</figref> and a print output PP<b>1</b> of <figref idref="DRAWINGS">FIG. 40</figref> as an enlarged diagram thereof. As shown in <figref idref="DRAWINGS">FIG. 40</figref>, the data ID and password are overlaid to the seal existing at the right lower corner position.

0214The data ID which is issued for each personal data can be known by all of the users of the present system and is used for retrieval, display, or the like of the personal data. The password can be known by only the person who makes the personal data and is used for registration of the detailed information, transmission of the message, display of the message, and the like.

0215In addition to the auxiliary information, the detailed information can be added to the personal data. The detailed information is a free message, an illustration, or the like. As a method of adding the detailed information to the personal data, the user writes it onto a designated paper with a pen or the like and it is read by a facsimile, a scanner, or the like. In case of using the facsimile, the server concentrated receives it and adds it to the seal data by the operator or automatically. In case of using the scanner, the operator of a shop in which the terminal is installed operates and adds it to the seal data. When the detailed information is added to the personal data, the data ID is used to designate the personal data to be added and the password is used to show that the user is the person who made the personal data and whom the detailed information can be added.

0216An exchanging process of the seal data will now be described. The exchanging process comprises: a retrieving process for selecting a target person (person who made the personal data) whom a person who desires to exchange the personal data exchanges the personal data; a process for transmitting a message to the selected personal data making person; a process for issuing a print permission by watching a plurality of messages received by the personal data making person; and other processes. The permission or inhibition of the printing of the seal data is managed every data ID. To use services of the messages, it is necessary to input the password. Further, even in case of displaying the messages transmitted to the user himself, it is necessary to input the data ID and password.

0217First, the retrieving, monitoring, and printing processes of the personal data of the other persons which are executed by the person who wants to exchange the personal data will be described with reference to the flowcharts of <figref idref="DRAWINGS">FIGS. 15 and 16</figref> and the drawing of the display picture plane. In first step S<b>31</b> in <figref idref="DRAWINGS">FIG. 15</figref>, an image of a picture plane P<b>31</b> in <figref idref="DRAWINGS">FIG. 41</figref> is formed in the RAM <b>128</b> and the picture plane P<b>31</b> is displayed on the monitor <b>114</b> through the video encoder <b>135</b>, thereby promoting the person who desires to exchange the personal data to select by which target genre he refers to the information. Although not shown in the flowcharts, if “return” is instructed by the input device <b>113</b>, the screen is again returned to the previous picture plane.

0218When the target genre is selected in step S<b>61</b>, in next step S<b>62</b>, an image of a picture plane P<b>32</b> in <figref idref="DRAWINGS">FIG. 42</figref> is formed and displayed, thereby promoting the person who wants to exchange the personal data to input the retrieving conditions by using the display using the list box. In this stage as well, if “return” is instructed by the input device <b>113</b>, the processing routine is returned to the genre selection in step S<b>61</b>.

0219When the target genre and the retrieving conditions are selected, the retrieving conditions are transmitted to the server through the serial port, modem <b>132</b>, and public line network <b>108</b>. As a retrieval result, a group of personal data constructing elements with the relevant data ID are received from the server through the public line network <b>108</b>, modem <b>132</b>, and serial port. On the basis of the received data group, an image of a list picture plane P<b>33</b> shown in <figref idref="DRAWINGS">FIG. 43</figref> is formed by the designated list display format or by a default value if the display format is not designated and the image is displayed on the monitor <b>114</b> through the video encoder <b>135</b>, thereby promoting the user to perform the selecting operation. If “return” is also selected by the input device <b>113</b>, the processing routine is returned to the input of the retrieving conditions (S<b>62</b>).

0220In step S<b>64</b>, the presence or absence of the operating request to change the set display format is decided. When the request to change the display format is generated by the input device <b>113</b>, the processing routine advances to step S<b>65</b>. If NO, step S<b>66</b> follows.

0221In step S<b>65</b>, an image of a picture plane P<b>34</b> shown in <figref idref="DRAWINGS">FIG. 44</figref> is formed and the picture plane P<b>34</b> is displayed on the monitor <b>114</b>. The user is allowed to select displays items by the operation from the input device <b>113</b> and a display format comprising a list of selected items is set. When the selection and setting of the display format are finished, the processing routine is returned to step S<b>63</b>.

0222A button <b>227</b> which is selected when the audio message is listened and a button <b>228</b> which is selected when the page is seen are included in the list picture plane P<b>33</b> in <figref idref="DRAWINGS">FIG. 43</figref>. In step S<b>66</b>, the presence or absence of the selection of the button <b>227</b> to listen to the message is decided. When the button <b>227</b> is selected, audio message data of the relevant data ID is generated as sound from the speaker <b>111</b> in step S<b>67</b>.

0223When the button <b>227</b> is not selected, the presence or absence of the selection of the button <b>228</b> to see the page is determined in step S<b>68</b>. When the button <b>228</b> is not selected, the processing routine advances to other processes in step S<b>69</b>. In the other processes, a scrolling process, an invalid key process, and the like are executed.

0224In step S<b>68</b>, when the button <b>228</b> to see the page is selected, the processing routine advances to step S<b>70</b> in a flowchart of <figref idref="DRAWINGS">FIG. 16</figref>. In step S<b>70</b>, images of picture planes P<b>39</b> and P<b>40</b> as shown in <figref idref="DRAWINGS">FIGS. 49 and 50</figref> are formed in the RAM <b>128</b> in accordance with the layout data by using the personal data selected by the button <b>228</b> to see the page and are displayed by the monitor <b>114</b>.

0225The picture planes P<b>39</b> and P<b>40</b> are display examples of the personal data selected by the person who wants to exchange the personal data. As will be understood by comparing the picture planes P<b>39</b> and P<b>40</b>, a print button <b>229</b> is displayed on the picture plane P<b>40</b> at the position (left upper corner position) designated by the layout on the picture plane image. The display of the print button <b>229</b> denotes that the personal data selected by the person who desires to exchange the personal data can be printed.

0226That, is, if the data ID inputted by the personal data exchange desiring person who is operating at present at the time of the log-in exists in the ID as a print permission target added into the selected personal data, an image of the print button <b>229</b> is formed. If NO, the image of the print button <b>229</b> is not formed. When the print button <b>229</b> doesn't exist, although the personal data can be monitored, the selected personal data cannot be printed. An auxiliary button for monitoring is included in each of the picture planes P<b>39</b> and P<b>40</b>. That is, a button to listen to a voice, a button to see largely, a button to send messages, and a button of the detailed information are prepared.

0227Whether the button to listen to the voice has been selected by the input device <b>113</b> or not is determined in step S<b>71</b>. When this button is selected, in step S<b>72</b>, if the listening button is depressed by the input device, he audio message in the selected personal data is generated as sound from the speaker <b>111</b>. The processing routine is returned to step S<b>70</b>.

0228When the button to listen to the voice is not selected in step S<b>71</b>, a check is made in step S<b>73</b> to see if the button to see largely has been selected by the input device <b>113</b>. When this button is selected by the input device, in step S<b>74</b>, a still image in the personal data is enlarged and displayed on the screen.

0229If the button to see largely is not selected in step S<b>73</b>, a check is made in step S<b>75</b> to see if the button to send the messages has been selected by the input device <b>113</b>. When this button is selected by the input device, the messages are inputted in step S<b>76</b>. The inputted messages are transmitted to the server in step S<b>77</b>. The processing routine is returned to step S<b>70</b>.

0230In step S<b>76</b>, character messages for the selected personal data making person are inputted. In case of inputting the character messages, an input table of a picture plane P<b>35</b> shown in <figref idref="DRAWINGS">FIG. 45</figref> is displayed. The character messages can be also inputted by using the software keyboard. Audio messages except for the character messages can be also inputted.

0231After completion of the inputting process of the message, a message input confirmation picture plane P<b>36</b> shown in <figref idref="DRAWINGS">FIG. 46</figref> is displayed by the monitor <b>114</b>. Buttons <b>223</b> and <b>224</b> to select whether a print permission of the own (person who wants to exchange the personal data) personal data is issued or not for a transmission partner (person who made the personal data) of the messages are included in the picture plane P<b>36</b>. In case of permitting the printing, the button <b>223</b> is selected. If NO, the button <b>224</b> is selected. By issuing the print permission as mentioned above, the print permission of the personal data can be given to only the personal data making person having a specific data ID.

0232Upon transmission of the message in step S<b>77</b>, the inputted message data is transmitted to the server through the serial port, modem <b>132</b>, and public line network <b>108</b> together with the data ID of the selected personal data making person and the own data ID and password. The server transmits the message data with the ID of a message inputting person (person who wants to exchange the personal data) and, at the same time, transmits a print permission selection result for the partner. Further, when the print permission is issued, a data ID of the partner is added as print permission target ID to the personal data of the person who wants to exchange the personal data. After completion of the processes, the processing routine is returned to step S<b>70</b>.

0233In step S<b>78</b>, whether the button of the detailed information has been selected or not is determined. When this button is selected, the detailed information associated to the personal data is displayed in step S<b>79</b>. That is, a part of the local display layout data in the RAM <b>128</b> is changed and the setting of the layout is changed so as to display the additional information (profile, PR data, etc.). The processing routine is returned to step S<b>70</b>.

0234When the button of the detailed information is not selected, a check is made in step S<b>80</b> to see if the print button <b>229</b> has been selected. When the print button <b>229</b> is selected, in step S<b>81</b>, <b>16</b> divided seal images are developed in the RAM <b>128</b> and the seals are printed by the printer through the serial port by using the serial controller <b>129</b>. The processing routine is returned to step S<b>70</b>.

0235When the print button is not selected, a check is made in step S<b>82</b> to see if the key to return has been depressed. When the return key is depressed, in step S<b>83</b>, other processes, a process of an invalid key, and the like are executed. The processing routine is returned to step S<b>70</b>.

0236A case of executing a process to refer to the own seal or the seals of the other persons instead of forming/updating the own seal in step S<b>35</b> in <figref idref="DRAWINGS">FIG. 12</figref> will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 17</figref>. In first step S<b>91</b> in <figref idref="DRAWINGS">FIG. 17</figref>, a check is made to see if the user sees the own seal. In case of seeing the seals of the other persons, the processes as already described with reference to <figref idref="DRAWINGS">FIGS. 15 and 16</figref> are executed.

0237In step S<b>91</b>, when it is decided that the viewer sees the own seal, in step S<b>92</b>, an image of a list picture plane of reception messages is formed in the RAM <b>128</b> by a format of a picture plane P<b>37</b> shown in <figref idref="DRAWINGS">FIG. 47</figref> and is displayed on the monitor <b>114</b>. The own data ID is designated for the server through the modem <b>132</b> and public line network <b>108</b> and a request to transmit the reception messages to which the password was added is sent. The messages transmitted to the data ID to which the transmission was requested and the data ID of the partner (person who wants to exchange the personal data) who transmitted the messages are transmitted from the server. The picture plane P<b>37</b> is displayed by the data from the server. When the list picture plane P<b>37</b> of the messages is displayed, a play button <b>241</b> of audio messages, a monitor button <b>242</b> of the personal data of the partner, and a button <b>243</b> of the personal data print permission of the partner for myself are also displayed.

0238In step S<b>93</b>, a check is made to see if the play button <b>241</b> of audio messages has been depressed. When the play button is selected, the audio messages are reproduced in step S<b>94</b>. The processing routine is returned to step S<b>92</b>. If NO in step S<b>93</b>, a check is made in step S<b>95</b> to see if the monitor button <b>242</b> of the partner's personal data has been selected. When the monitor button <b>242</b> is selected, the monitoring process of the partner's personal data is executed in step S<b>96</b>.

0239That is, the personal data of the selected partner in which the monitor is demanded is requested to the server through the serial port, modem <b>132</b>, and public line network <b>108</b>. When the partner's personal data is transmitted from the server, a screen image is formed in the RAM <b>128</b> in accordance with the designated layout. The screen image is displayed on the monitor <b>114</b> through the video encoder <b>135</b>. <figref idref="DRAWINGS">FIGS. 49 and 50</figref> also show examples of the display picture planes of the partner data. When the print button <b>229</b> is displayed, this means that when the partner transmits the messages, the print permission has already been issued. Therefore, this partner's personal data can be printed. When the partner's data is monitored in step S<b>96</b>, the processing routine is returned to step S<b>92</b>.

0240In step S<b>97</b>, a check is made to see if the print permission button <b>243</b> has been selected. As mentioned above, when the print permission button <b>243</b> is selected, a print permission is transmitted to the server in step S<b>98</b>. The server adds the data ID of the partner to the print permission target ID of the own data ID so as to permit the printing for the data ID of the partner who transmitted the messages. The processing routine is returned to step S<b>92</b>.

0241In step S<b>97</b>, when the print button <b>243</b> is not depressed, step S<b>99</b> follows and whether the scrolling button has been selected or not is discriminated. When the scrolling button is selected, a scrolling process is executed in step S<b>100</b>. Thus, the list picture plane of the reception messages is scrolled. The processing routine is returned to step S<b>92</b>. When the scroll button is not selected as well, the processing routine is returned to step S<b>92</b>.

0242According to the embodiment of the invention, while the terminal is used, for example, even when it is used as a Karaoke terminal, the arrival of the messages is notified to the user in a real-time manner. As shown in <figref idref="DRAWINGS">FIG. 48</figref>, a notification icon and messages are displayed on the monitor screen for Karaoke (<b>225</b>).

0243As mentioned above, the personal data can be inputted and the personal data can be exchanged. Some of the processes of such a system or terminal will now be described in detail.

0244First, processes when the audio messages as auxiliary information of the personal data are inputted at each terminal or when audio messages which the person who wants to exchange the personal data intends to transmit the messages to the personal data making person are inputter will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 51</figref>. Although the above processes have already been described with reference to the display picture plane P<b>8</b> on the monitor <b>114</b> in <figref idref="DRAWINGS">FIG. 26</figref>, a more detailed control will now be described. That is, a method of registering audio data as auxiliary information by the user, a method of displaying the timing at the start of the recording, and a method of displaying the present recording level at the time of the audio recording of the user and paying attention to the user in the case where the recording level is out of a specified level will now be described.

0245The programmable DSP <b>127</b> of the terminal with the construction shown in <figref idref="DRAWINGS">FIG. 10</figref> allows the description and display of the audio message input to be developed in the RAM <b>128</b> by using the data in the hard disk <b>126</b>. The picture plane data is sent to the video encoder <b>135</b>. The programmable DSP <b>127</b> allows the input from the video encoder <b>135</b> to be outputted to the external monitor <b>114</b> by using the switcher <b>136</b> (step S<b>101</b>). In step S<b>102</b>, the depression of the decision key is monitored.

0246When the user detects the code corresponding to the decision key on the commander connected to the serial controller <b>129</b> from the serial controller <b>129</b>, the programmable DSP <b>127</b> progresses the processes to step S<b>103</b>. If no code is detected or the input code is other than the code of the decision button, the processing routine is returned to step S<b>102</b>. In step S<b>103</b>, a message indicating that the system is in a spare time is displayed.

0247The programmable DSP <b>127</b> forms an internal variable into the RAM <b>128</b> by using a timer of a predetermined interval and increases the variable by “1” every count of the timer. By using the internal variable and the icon image data of the microphone in the hard disk <b>126</b>, the animation picture plane <b>213</b> indicating that the recording process is at present preparing and is shown in <figref idref="DRAWINGS">FIG. 26</figref> is developed in the RAM <b>128</b>. In this instance, the animation data is developed at the display position corresponding to the internal variable. The picture plane data is sent to the video encoder <b>135</b> and is outputted to the external monitor <b>114</b>.

0248In step S<b>104</b>, the programmable DSP <b>127</b> designates the start of the A/D conversion for the AD/DA converter <b>138</b>. In the display of the recording start in step S<b>104</b>, the programmable DSP <b>127</b> allows the recording start picture plane P<b>8</b> shown in <figref idref="DRAWINGS">FIG. 26</figref> to be developed in the RAM <b>128</b> by using the data in the hard disk <b>126</b>. The picture plane data is sent to the video encoder <b>135</b>. The programmable DSP <b>127</b> receives the signals obtained by converting the audio signals which are successively sent from the switcher <b>136</b> through the microphone <b>112</b> into the digital signals by the AD/DA converter <b>138</b> and sequentially stores onto the hard disk <b>126</b>.

0249In step S<b>105</b>, the programmable DSP <b>127</b> reads the value of the present recording level from the AD/DA converter <b>138</b> and allows the display picture plane of the present recording level shown in <figref idref="DRAWINGS">FIG. 26</figref> to be developed into the RAM <b>128</b> by using such a value and the data for screen display in the hard disk <b>126</b>. In this instance, the level indicator <b>212</b> corresponding to the value of the recording level is developed and the picture plane data is sent to the video encoder <b>135</b>.

0250In step S<b>106</b>, a check is made to see if the recording time has finished. The programmable DSP <b>127</b> counts by using the internal timer while using the sum of the recording time as a variable. By using such an internal variable and the icon image data of the microphone in the hard disk <b>126</b>, the programmable DSP <b>127</b> allows the animation picture plane <b>213</b> of the microphone which is at present recording and shown in <figref idref="DRAWINGS">FIG. 26</figref> to be developed in the RAM <b>128</b>. In this instance, the animation data is developed at the display position corresponding to the internal variable and the picture plane data is sent to the video encoder <b>135</b> and is outputted to the external monitor <b>114</b>. If the variable or the recording time exceeds a specific counter value, the processing routine advances to step S<b>111</b>.

0251When it is decided in step S<b>106</b> that the variable of the recording time lies within the recording time, a check is made in step S<b>107</b> to see if the recording level is larger than a specific level. If it is not larger, a check is made in step S<b>108</b> to see if the recording level is smaller than the specific level. That is, the programmable DSP <b>127</b> reads out the present recording level from the AD/DA converter <b>138</b>. When it is larger than the specific level, a message to pay attention such as “reduce your voice” or the like is formed by using the data in the hard disk <b>126</b>, the picture plane data is developed in the RAM <b>128</b>, and the picture plane data is sent to the video encoder <b>135</b> (step S<b>109</b>). The processing routine is returned to step S<b>105</b>.

0252In step S<b>108</b>, the programmable DSP <b>127</b> reads out the present recording level from the AD/DA converter <b>138</b>. When it is smaller than the specific level, a message to pay attention such as “increase your voice” or the like is formed by using the data in the hard disk <b>126</b>, the picture plane data is developed in the RAM <b>128</b>, and the picture plane data is sent to the video encoder <b>135</b> (step S<b>110</b>). The processing routine is returned to step S<b>105</b>.

0253In step S<b>106</b>, when it is determined that the recording time has been finished, the end of recording is displayed in step S<b>111</b>. The programmable DSP <b>127</b> sends the set data of the end of A/D converting process to the AD/DA converter <b>138</b>. Picture plane data to notify of the end of recording such as “the recording is finished” or the like is formed by using the data in the hard disk <b>126</b>. The picture plane data is developed in the RAM <b>128</b> and the picture plane data is sent to the video encoder <b>135</b>.

0254According to the embodiment of the invention, as described with reference to the display picture plane P<b>10</b> shown in <figref idref="DRAWINGS">FIG. 28</figref> mentioned above, the character data can be inputted by numerals of two digits. Such an inputting method is similar to the character inputting method in case of the pocket bell. Processes at the time of the character input will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 52</figref>.

0255In step S<b>121</b>, the display picture plane P<b>10</b> in <figref idref="DRAWINGS">FIG. 28</figref> is displayed. This display is a table (key input picture plane) showing the corresponding relation between the numerals of two digits and the characters. The programmable DSP <b>127</b> forms a screen image into the RAM <b>128</b> and its data is outputted to the video encoder <b>135</b>. The programmable DSP <b>127</b> switches the switcher <b>136</b>, thereby allowing the input from the video encoder <b>135</b> to be outputted to the external monitor <b>114</b>.

0256In step S<b>122</b>, the system waits for a key input. The programmable DSP <b>127</b> waits for a key input from the user via the serial controller <b>129</b>. When there is a key input, the DSP <b>127</b> receives the key code. The serial controller <b>129</b> is connected to the external input device <b>113</b>. In step S<b>123</b>, a check is made to see if the input key is a “numeral key”. When it is determined that the input key is the numeral key, the programmable DSP <b>127</b> discriminates from the received key code whether the input key indicates the “first character” (step S<b>124</b>).

0257In step S<b>125</b> (character is displayed), if the received key code indicates the second character of the numerals, the programmable DSP <b>127</b> forms a screen image into the RAM <b>128</b> by making the key code and the character correspond to each other. Its data is outputted to the video encoder <b>135</b>. The programmable DSP <b>127</b> switches the switcher <b>136</b>, thereby allowing the input from the video encoder <b>135</b> to be outputted to the external monitor <b>114</b>.

0258In step S<b>123</b>, when the received key code does not indicate the “numeral key”, the programmable DSP <b>127</b> discriminates whether the received key code indicates an “end key” or not. In case of the “end key”, the processes are finished. When the received key code is other than the “numeral key” and “end key”, the programmable DSP <b>127</b> executes a process according to the received key code (step S<b>127</b>).

0259The personal data exchanging process in the embodiment of the invention will now be described in detail. As mentioned above, according to the embodiment of the invention, when the messages are informed to the person who makes the personal data, the person who wants to exchange the personal data adds the data ID of the personal data of the person himself who wants to exchange the personal data in addition to the messages and transmits the resultant data. This process will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 53</figref>. <figref idref="DRAWINGS">FIG. 53</figref> is an operation flow of the terminal on the user (person who desires to exchange the personal data) side who intends to exchange the personal data.

0260In step S<b>131</b>, a target person who intends to exchange the personal data is specified by the monitor <b>114</b> for displaying the personal data from the personal data making persons of the personal data which have previously been registered while looking at the message display picture plane P<b>33</b> in <figref idref="DRAWINGS">FIG. 43</figref>.

0261In step S<b>132</b>, in order to exchange the personal data, the user performs a key input from the input device <b>113</b> to a target person specified by using the message input picture plane P<b>35</b> shown in <figref idref="DRAWINGS">FIG. 45</figref> and forms messages in the RAM <b>128</b> by the programmable DSP <b>127</b>.

0262In step S<b>133</b>, the user ID is automatically added to the messages formed in the RAM <b>128</b> by the programmable DSP <b>127</b> by the key input of the end of input from the input device <b>113</b> by using the message confirmation picture plane P<b>36</b> as shown in <figref idref="DRAWINGS">FIG. 46</figref>.

0263In step S<b>134</b>, the programmable DSP <b>127</b> controls the serial controller <b>129</b> and the formed messages to which the user ID was added are sent to the server through the public line network <b>108</b> by the modem <b>132</b>. The messages are transmitted from the server through the data transmission center <b>101</b>.

0264At the terminal of the personal data making person who receives the messages formed as mentioned above, processes according to a flowchart shown in <figref idref="DRAWINGS">FIG. 54</figref> are executed. The data received by the receiving antenna <b>104</b> and IRD <b>105</b> of the terminal is decoded by the data converter <b>122</b> and is stored into the hard disk <b>126</b>. At the same time, the programmable DSP <b>127</b> confirms that the messages are messages from the user who wants to exchange the personal data (step S<b>136</b>).

0265The programmable DSP <b>127</b> forms a display image of the contents of the messages into the RAM <b>128</b> from the data stored in the hard disk <b>126</b>. Further, it is displayed on the personal data display monitor <b>114</b> on the outside through the video encoder <b>135</b> and switcher <b>136</b> (step S<b>137</b>).

0266In step S<b>138</b>, the user discriminates by the key input from the input device <b>113</b> whether the information of a transmitter who desires to exchange the personal data is seen or not. If NO, the processing routine is finished. If YES in step S<b>138</b>, the programmable DSP <b>127</b> confirms that the key input indicates a display request, retrieves the data of the transmitter from the hard disk <b>126</b> on the basis of the user ID, forms a screen image for display into the RAM <b>128</b>, and outputs to the video encoder <b>135</b>. Further, it is displayed on the external personal data display monitor <b>114</b> by the switcher <b>136</b>.

0267According to the embodiment of the invention, as described with reference to <figref idref="DRAWINGS">FIG. 48</figref>, when the personal data making person is operating the terminal, for example, when the terminal is used as a Karaoke terminal, if the messages to the personal data making person are preserved in the server, a fact that the messages were preserved is informed to the personal data making person in a real-time manner. Processes in this case will now be described with reference to <figref idref="DRAWINGS">FIG. 54</figref>.

0268In step S<b>140</b> in <figref idref="DRAWINGS">FIG. 54</figref>, the messages inputted by the person who wants to exchange the seals reach the database server provided in the data transmission center <b>101</b> through the public line network <b>108</b>. In step S<b>141</b>, the updated information is transmitted from the data transmission center <b>101</b> by using the up-link center <b>102</b> and satellite <b>103</b>.

0269In step S<b>142</b>, the updated data transmitted by the receiving antenna <b>104</b> and IRD <b>105</b> is received and stored into the hard disk <b>126</b> through the data converter <b>122</b>. In step S<b>143</b>, the programmable DSP <b>127</b> retrieves whether the messages to the user who uses the terminal exist in the data stored in the hard disk <b>126</b> or not.

0270When there are the messages to the user, the programmable DSP <b>127</b> forms a display image <b>225</b> of a message arrival picture plane in <figref idref="DRAWINGS">FIG. 48</figref> into the RAM <b>128</b>. Further, the display image is displayed on the personal data display monitor <b>114</b> through the video encoder <b>135</b> and switcher <b>136</b> (step S<b>144</b>).

0271According to the foregoing embodiment of the invention, when the person who wants to exchange the personal data allows the messages transmitted to the personal data making person to be displayed to the terminal of the personal data making person, it is necessary to input the data ID and password. Processes in this case will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 56</figref>.

0272In first step S<b>151</b>, a display as shown at <b>231</b> in <figref idref="DRAWINGS">FIG. 57</figref> occurs on the monitor <b>114</b> and when the viewer wants to see the messages, the data ID and password are inputted. In step S<b>152</b>, whether the data ID and password are correct or not is asked to the server and is determined.

0273The programmable DSP <b>127</b> discriminates in step S<b>153</b> to see the messages have been received. When there is no message received, the processing routine is finished. That is, the data is received by the receiving antenna <b>104</b> and IRD <b>105</b> and is stored into the hard disk <b>126</b> through the data converter <b>122</b>. Further, whether the messages to the user who uses the terminal exist in the data stored in the hard disk <b>126</b> or not is retrieved by the programmable DSP <b>127</b>. If YES, this fact is displayed. In step S<b>155</b>, a display shown at <b>232</b> in <figref idref="DRAWINGS">FIG. 57</figref> is performed. A fact that there are the received messages is displayed and the user is promoted to select whether he wants to see the messages or not.

0274When it is determined that the user wants to see the messages, in step S<b>156</b>, the messages are displayed. A display <b>233</b> in <figref idref="DRAWINGS">FIG. 57</figref> is an example of a display of messages.

0275According to the embodiment of the invention, when the user who intends to exchange the personal data (personal data exchange desiring person) searches the target person from the personal data making persons, a display format of the information can be selected. For example, as a display format, any one of a format of only the regular messages in the auxiliary information, a format of the regular messages and additional information in the auxiliary information, a format of only the seal data, a format of the seal data and auxiliary information, and the like can be used. The selection of the display format will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 58</figref>. The flowchart relates to an operation flow on the terminal side which receives messages.

0276In step S<b>161</b>, the presence or absence of a display request of the user is determined. To see or retrieve information of the other users which has previously been registered, the user operates a button for a display request or performs a key input by the input device. The input of the display request is transferred to the programmable DSP <b>127</b> via the serial controller. The programmable DSP <b>127</b> confirms that it is the display request, and forms a screen image for displaying a default into the RAM <b>128</b>. It is outputted to the video encoder <b>135</b>. Further, an information display picture plane of the users which has already been registered as shown by P<b>33</b> in <figref idref="DRAWINGS">FIG. 43</figref> is displayed on the personal data display monitor <b>114</b> by the video switcher <b>136</b> (step S<b>162</b>).

0277When the user wants to see the information by a format other than the default display, he selects a change in display by operating a button or performing a key input by the input device. In the other cases, since the user sees the information by the original format, the processing routine is finished. When the change in display format is selected, the programmable DSP <b>127</b> confirms that the selection input indicates a changing request of the display picture plane, forms a screen image for default display into the RAM <b>128</b>, and outputs to the video encoder <b>135</b>. Further, the item selection picture plane P<b>32</b> as shown in <figref idref="DRAWINGS">FIG. 42</figref> is displayed on the personal data display monitor <b>114</b> by the video switcher <b>136</b>. The user sees the picture plane P<b>32</b> and selects by which format he wants to see the information by a button operation or a key input by the input device (step S<b>164</b>).

0278In step S<b>165</b>, the selection input is transferred to the programmable DSP <b>127</b> via the serial controller <b>129</b>. The programmable DSP <b>127</b> forms a screen image for display by the designated items into the RAM <b>128</b> on the basis of the selected item of the displaying request and the information of the selected format is displayed on the monitor <b>114</b> (step S<b>165</b>).

0279According to the embodiment of the invention, as described with reference to the display picture plane P<b>18</b> shown in <figref idref="DRAWINGS">FIG. 36</figref>, the animation icon which changes depending on the number of elapsed days from the date of making the personal data is used. That is, when the user reads the personal data including the face image by the animation icon, the time when the original data of the personal data is formed and the animation icon which changes depending on the time of the reading are displayed together with the face image. Processes in this case will now be described with reference to <figref idref="DRAWINGS">FIG. 59</figref>.

0280When there is a displaying request from the user in step S<b>171</b>, the programmable DSP <b>127</b> develops a face image data read selection picture plane into the RAM <b>128</b> by using the data in the hard disk <b>126</b> and the picture plane data is sent to the video encoder <b>135</b>. When the user detects the code corresponding to a read selection button on the commander <b>116</b> connected to the serial controller <b>129</b> from the serial controller <b>129</b>, the programmable DSP <b>127</b> progresses the process to step S<b>172</b>. If there is no code or the code is other than the code of the decision button, the processing routine is returned to step S<b>171</b>.

0281In step S<b>172</b>, the data of the relevant data ID is obtained. On the basis of the data ID corresponding to the face image data selected by the user in step S<b>171</b>, the programmable DSP <b>127</b> retrieves a logic position, for example, a file name where the face image data exists in the hard disk <b>126</b>. After the retrieval, the found face image data is read out from the hard disk <b>126</b> and developed and held in the RAM <b>128</b>.

0282In step S<b>173</b>, an animation pattern is obtained. The programmable DSP <b>127</b> obtains a pattern ID indicative of a plurality of animation patterns which are used together with the face image data from the data structure in the face image data obtained in step S<b>172</b> and stores the pattern ID as a variable into the RAM <b>128</b>.

0283In step S<b>174</b>, the date of making the personal data is obtained. The programmable DSP <b>127</b> obtains the information of the date of making the original data which is used together with the face image data from the face image data obtained in step S<b>172</b>, and holds the making date as a variable into the RAM <b>128</b>.

0284In step S<b>175</b>, the present date and time are obtained. The programmable DSP <b>127</b> designates so as to transmit MPEG2/TS (transport stream) in which the present time information is included to the data converter, obtains the present time from the information in the TS, and stores in the RAM <b>128</b>.

0285In step S<b>176</b>, display animation data is determined. The programmable DSP <b>127</b> obtains differential information of date and time from the date making date and the present time obtained in steps S<b>174</b> and S<b>175</b> and determines display animation data from the animations obtained in step S<b>173</b>. The animation data is developed in the RAM <b>128</b>.

0286In step S<b>177</b>, the animation is displayed. The programmable DSP <b>127</b> transmits the face image data developed in the RAM <b>128</b> in step S<b>172</b> to the video encoder <b>135</b> and allows the face image data to be displayed on the external monitor <b>114</b>. Further, the animation data obtained in step S<b>173</b> is periodically transmitted to the video encoder <b>135</b> and the animation is displayed onto the monitor <b>114</b>.

0287A method whereby the time when the original data of the seal data is made and the animation icon which changes depending on the time of reading are inputted together with the face image (seal data) when the user forms the seal data including the face image from the example of the animation selecting process like a display picture plane P<b>18</b> as shown in <figref idref="DRAWINGS">FIG. 36</figref> will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 60</figref>.

0288In step S<b>181</b>, a selecting request is issued from the user. The programmable DSP <b>127</b> develops the animation icon selection picture plane P<b>18</b> shown in <figref idref="DRAWINGS">FIG. 36</figref> into the RAM <b>128</b> by using the data in the hard disk <b>126</b> and the picture plane data is sent to the video encoder <b>135</b>. When the user detects the code corresponding to the animation icon selection button on the commander connected to the serial controller <b>129</b> from the serial controller <b>129</b>, the programmable DSP <b>127</b> progresses the process to step S<b>182</b>. If there is no code or the code is other than the code of the decision button, the processing routine is returned to step S<b>181</b>.

0289In step S<b>182</b>, the ID of the animation pattern is obtained. The ID of the corresponding pattern is obtained from the animation pattern selected in step S<b>181</b> and is stored in the RAM <b>128</b>.

0290The present date and time are obtained in step S<b>183</b>. The programmable DSP <b>127</b> designates so as to transmit MPEG2/TS in which the present time information is included to the data converter <b>122</b> while using the ID obtained in step S<b>182</b> as information to decide the method of displaying the animation when the face image data is read later, obtains the present time from the information in the TS, and stores it as a variable into the RAM <b>128</b>.

0291In step S<b>184</b>, the ID is reserved. The programmable DSP <b>127</b> transfers each ID obtained in steps S<b>182</b> and S<b>183</b> to the hard disk <b>126</b> and records.

0292According to the embodiment of the invention, a plurality of terminals are collected by the gateway <b>150</b> as described with reference to <figref idref="DRAWINGS">FIGS. 9 and 11</figref>. The personal data, auxiliary information, messages, and the like from the terminal are collectively transmitted to the server by the gateway every period. The above operation will now be described. First, the operation and function on the gateway side will be described with reference to <figref idref="DRAWINGS">FIG. 61</figref>.

0293In first step S<b>191</b>, the data input from the terminal is received. The CPU <b>155</b> receives the data from the terminal via the network I/F <b>157</b> and stores into the RAM <b>156</b>.

0294The data is preserved in step S<b>192</b>. The CPU <b>155</b> writes the data in the RAM <b>156</b> into the hard disk <b>154</b> and updates an index of the data stored in the hard disk <b>154</b>.

0295The data ID and password are outputted in step S<b>193</b>. The CPU <b>155</b> confirms that the data has correctly been written into the hard disk, allocates the data ID and password which are not used among the data IDs and passwords managed, and outputs them to the terminal via the network I/F <b>157</b>.

0296In step S<b>194</b>, the elapsed time of the data is discriminated. The CPU <b>155</b> retrieves the index and examines the oldest elapsed time in the data which has already been preserved in the hard disk <b>154</b> and is not transmitted to the server yet, thereby discriminating whether a predetermined time or more has elapsed or not.

0297A data amount is discriminated in step S<b>195</b>. The CPU <b>155</b> retrieves the index and examines an amount of data which has already been preserved in the hard disk <b>154</b> and is not transmitted to the server yet, thereby discriminating whether the data amount has reached a predetermined amount or more or not.

0298In step S<b>195</b>, when it is decided that the data amount has reached the predetermined amount, the data is transmitted to the server (step S<b>196</b>). The CPU <b>155</b> connects to the server through the public line network <b>108</b> by using the modem <b>159</b> and transmits data which is not transmitted to the server yet in the data stored in the hard disk <b>154</b> to the server.

0299<figref idref="DRAWINGS">FIG. 62</figref> is a flowchart showing the operation on the terminal side corresponding to the operation on the foregoing gateway side. In first step S<b>201</b>, the data input from the user is received. The programmable DSP <b>127</b> waits for the key input from the user via the serial controller <b>129</b>. When there is the key input, a key code is received. The received data is preserved in the RAM <b>128</b>.

0300In step S<b>202</b>, the data is outputted to the gateway <b>150</b>. The programmable DSP <b>127</b> outputs the data in the RAM <b>128</b> to the gateway <b>150</b> via the network I/F.

0301In step S<b>203</b>, the data ID and password are received from the gateway. The programmable DSP <b>127</b> receives the data ID and password via the network I/F and, when the seal is outputted to the printer <b>118</b> through the printer controller <b>134</b>, it is printed while including the data ID and password.

0302In the forgoing embodiment of the invention, the latest data preserved in the server can be preliminarily transmitted to the gateway. The operation on the server side in case of performing such processes will now be described with reference to a flowchart of <figref idref="DRAWINGS">FIG. 63</figref>. The operation on the terminal side corresponding to it is shown in a flowchart of <figref idref="DRAWINGS">FIG. 64</figref>. This process does not always need the gateway and the same shall also similarly apply to the processes between the terminal and the server.

0303In step S<b>211</b>, the data input from the terminal or gateway is executed. As shown in <figref idref="DRAWINGS">FIG. 7</figref>, the data outputted from the seal exchange terminal <b>106</b> is received by the personal data server in the internet provider <b>109</b> via the public line network <b>108</b>.

0304In step S<b>212</b>, the personal data server in the internet provider <b>109</b> checks the received data and preserves into the storage. In step S<b>213</b>, it is outputted to the up-link center <b>102</b>. The personal data server in the internet provider <b>109</b> transmits the data to the data transmission center <b>101</b> through a dedicated line. The data transmission center <b>101</b> transmits the data to the broadcasting (up-link) center <b>102</b> through a dedicated line. The broadcasting (up-link) center <b>102</b> transmits the data to the terminal side through the satellite <b>103</b>.

0305On the terminal side, as shown in a flowchart of <figref idref="DRAWINGS">FIG. 64</figref>, the data is received from the IRD <b>105</b> in step S<b>221</b>. The programmable DSP <b>127</b> of the terminal receives the TS of MPEG2 via the data converter.

0306In step S<b>222</b>, the received data is preserved. The programmable DSP <b>127</b> discriminates whether the personal data to be Preserved is included in the received data. When the personal data is included, it is stored into the hard disk <b>126</b>.

0307A residual amount of the hard disk <b>126</b> is discriminated in step S<b>223</b>. The programmable DSP <b>127</b> checks a residual amount of the hard disk <b>126</b> and discriminates whether a capacity of an unused area is a predetermined amount or more or not.

0308In step S<b>223</b>, when it is determined that the residual storage capacity of the hard disk is small, the most unnecessary data is deleted in step S<b>224</b>. The programmable DSP <b>127</b> determines the most unnecessary data from the data making date and time, the number of accessing times, and the like in the data in the hard disk <b>126</b> and deletes the data so that a capacity of the unused area of the hard disk is equal to or larger than a predetermined amount.

0309As mentioned above, as a method of preserving the latest information into the hard disk of the terminal or gateway, it is preferable to weight the information every terminal or gateway and to add the priority order. A flowchart for the operation on the terminal side upon data reception is shown in <figref idref="DRAWINGS">FIG. 65</figref>. A flowchart for the operation on the terminal side at the time of a data request is shown in <figref idref="DRAWINGS">FIG. 66</figref>.

0310In first step S<b>231</b> in <figref idref="DRAWINGS">FIG. 65</figref>, the data is received. The programmable DSP <b>127</b> receives MPEG2/TS via the data converter. In step S<b>232</b>, a check is made to see if a district code coincides. The programmable DSP <b>127</b> discriminates whether the codes of districts to be preserved such as same district as the terminal, neighboring district, and the like are included in the received data or not.

0311When the district code coincides, a check is made in step S<b>233</b> to see if it is matched with a data requesting trend of the terminal. The programmable DSP <b>127</b> discriminates whether the received data corresponds to the data requesting trend of the terminal to be preserved such as an age class of the users or the like or not.

0312In step S<b>234</b>, the data which is matched with the district code and the requesting trend is preserved. The programmable DSP <b>127</b> stores the personal data into the hard disk <b>126</b>.

0313In step S<b>235</b>, a residual amount of the hard disk <b>126</b> is discriminated. The programmable DSP <b>127</b> examines the residual amount of the hard disk <b>126</b> and discriminates whether a capacity of an unused area is equal to or larger than a predetermined amount or not. If the disk residual amount is small, the most unnecessary data is deleted in step S<b>236</b>. That is, the programmable DSP <b>127</b> determines the most unnecessary data from the data making date and time, the number of accessing times, and the like from the data in the hard disk <b>126</b> and deletes the data so that a capacity of the unused area of the hard disk <b>126</b> is equal to or larger than a predetermined amount.

0314Processes upon data requesting will now be described with reference to <figref idref="DRAWINGS">FIG. 66</figref>. In step S<b>241</b>, a data request from the user is received. The programmable DSP <b>127</b> waits for a key input from the user via the serial controller <b>129</b>. When there is a key input, a key code is received. The data of each field is received and preserved in the RAM <b>128</b>.

0315In step S<b>242</b>, data requesting conditions are preserved in a requesting trend list of the data. The programmable DSP <b>127</b> preserves data requesting conditions from the user into the data requesting trend list. In step S<b>243</b>, the presence or absence of the relevant data in the hard disk <b>126</b> is discriminated.

0316When there is no relevant data, the programmable DSP <b>127</b> is connected to the server in step S<b>244</b>. The programmable DSP <b>127</b> is connected to the server through the public line network by using the modem. The programmable DSP <b>127</b> requests the data to the server through the modem and the public line network (step S<b>245</b>). In step S<b>246</b>, the programmable DSP <b>127</b> receives the data from the server via the modem and the public line network.

0317In step S<b>243</b>, when there is the relevant data in the data preserved in the hard disk <b>126</b>, the programmable DSP <b>127</b> reads out the requested data stored in the hard desk <b>126</b> (step S<b>247</b>).

0318The invention is not limited to a satellite digital broadcasting but the data can be also transmitted by using the digital broadcasting of the ground wave. It is not always necessary to compound the seal exchange terminal and the Karaoke terminal.

0319According to the invention, the advertising information to which the target ID was added is multiplexed and transmitted in addition to the video/audio data of the program, the target ID is collated with the viewer attributes which have previously been registered, and only when they coincide, the advertising information is extracted. According to the invention, the advertising information regarding the goods or services having a possibility such that the viewer himself has an interest when they are seen from the viewer can be selectively monitored. On the contrary, it is possible to prevent that an advertising in which a possibility that the viewer has an interest is small or an advertising in which the parent doesn't want to allow it to be seen by children is monitored. It is possible to reduce the time in which the monitor of the program is interrupted by advertising information. Further, by superimposing an advertising display by the OSD, it is possible to construct in a manner such that no advertising display appears in the signal of the program which is recorded by a recording apparatus such as a VTR or the like. On the other hand, the enterprise which provides an advertising can efficiently provide advertising information to the class (target users) who has an interest in the goods and services. Such an advantage of the invention is further effected by accompanying the advertising detailed information.

0320In addition, since the monitor history of the advertising information can be collected, the number of viewers who monitored the advertising, the viewer class, and the like can be known on an advertising unit basis and the advertising can be efficiently performed. Further, since the monitor history of the advertising detailed information can be collected, the number of viewers who monitored the details of the advertising, the viewer class, and the like can be known on an advertising unit basis and the advertising can be efficiently performed. In the case where a homepage is used to provide the detailed information, there is an advantage such that the monitor history of the detailed information can be easily and promptly collected.

0321According to the invention, the personal data such as face image data can be electronically mutually exchanged. As compared with the existing method of handing the printed seals, the personal data such as seal images or the like can be rapidly exchanged in a fairly wide range. By using the digital broadcasting for the transmission of the personal data, a large amount of personal data can be transmitted to a wide range at a high speed.

0322According to the invention, by using the data ID and password, only the subscribers of the services can monitor the personal data and the printing of the personal data (seal data) can be permitted to only a specific partner.

0323Further, there is an advantage such that by providing the gateway and collecting a plurality of terminals, a scale of hardware of each terminal can be reduced.

0324The present invention is not limited to the foregoing embodiments but many modifications and variations are possible within the spirit and scope of the appended claims of the invention.