Data transmitting apparatus, contents distribution apparatus, contents distribution system, digital contents distribution method and data storage apparatus

BACKGROUND OF THE INVENTION

P-0001[0001] The present invention relates to a technique for visually supplementing digital contents including digital video data and digital audio data with additional information, such as information concerning copyright protection, so as to distribute or output such contents for the purpose of protecting copyrights to images and preventing their unauthorized alteration.

DESCRIPTION OF THE PRIOR ART

P-0002[0002] Generally in digital image technology handling images as digital data, as compared with analog image technology, it is easier to copy images using a computer or the like without deteriorating the image quality and electronically transmit them through a network. For this reason, digital images involve a greater risk of being easily copied and redistributed illegally. Techniques according to the prior art for avoiding such a risk include what is known as electronic watermarking. There are two types of electronic watermarks: an invisible type in which watermarked information including copyright information and user information is invisibly embedded and a visible type in which the logo or the like of the copyright holding company is visibly formed in the image.

P-0003[0003] If an invisible type electronic watermark is used, the hidden presence of the watermarked information cannot be recognized merely by looking at the watermarked image. This features make the invisible type more difficult than the visible type to be deleted but less effective in preventing illegal copying and illegal distribution. However, it has the advantage of permitting, if a digital image is illegally copied or distributed, the illegal user can be identified by the user ID or the like embedded as watermarked information because the watermarked information remains in the digital image. An invisible type electronic watermark is disclosed in, for instance, U.S. Pat. No. 5,636,292.

P-0004[0004] On the other hand, a visible type electronic watermark, which is visibly written on a digital image, makes the image uncomfortable to use as it is, and therefore has the effect of deterring a potentially infringing user from illegally copying or distributing the digital image. According to the prior art, in many cases a visible type electronic watermark is used in such a way that image representing copyright information, such as the logo or the like of the copyright owner, is superimposed into the original image by superimposing the copyright information over part of the original image. However, this superimposing often impairs that part of the original image. Moreover, by a relatively easy method such as overwriting only the watermark part with some other image, the copyrighted image may be illegally copied or distributed with the illegality of the use thereby concealed.

P-0005[0005] Techniques to compensate for this shortcoming include one disclosed in the Japanese Patent Laid-open No. 2001-177816. This patent application describes a technique by which the pertinent copyright is protected by holding digital images and information on the attributes of the digital images and embedding the attribute information into any given digital image using both an invisible watermark and a visible watermark. This technique is supposed to enable a legitimate user to restore the full original image by superimposing copyright information and the like in a visible form with the visible watermark and embedding the part of image information lost by the superposition of the visible watermark into the invisible watermark.

P-0006[0006]FIG. 2 illustrates an example of the prior art. This example is an image server capable of holding digital images and attribute information on digital images, and embedding into any desired digital image corresponding attribute information.

P-0007[0007] In FIG. 2, reference numeral <b>7</b> denotes an image server apparatus, configured of a control port <b>101</b>, a stream output port <b>102</b>, a stream input port <b>103</b>, a meta information input port <b>104</b>, a visible watermark superimposing means <b>112</b>, an image server managing means <b>113</b>, an image memory means <b>115</b> and a meta information memory means <b>117</b>. In such a configuration, when an image is to be stored into the image server apparatus <b>7</b>, a data acceptance instruction is given to the image server managing means <b>113</b> via the control port <b>101</b>. Then, under the control of the image server managing means <b>113</b>, video data are stored into the image memory means <b>115</b> via the stream port <b>103</b>, and additional information regarding the image is stored into the meta information memory means <b>117</b> via the meta information input port <b>104</b>. The meta information may include, for instance, information used for copyright protection, such as right owner information, information on restricted distribution and logo image information in addition to basic attribute information such as the name and size of the image. When an image stored in the image server apparatus <b>7</b> is to be taken out, a data extracting instruction is given to the image server managing means <b>113</b> via the control port <b>101</b>. On the basis of this instruction, the image server managing means <b>113</b> causes the image memory means <b>115</b> to supply the pertinent video data. Further, the image server managing means <b>113</b> selects meta information data corresponding the aforementioned video data out of the group of meta information stored in the meta information memory means <b>117</b>, and causes them to be outputted. Then, the visible watermark superimposing means <b>112</b> superimposes the meta information data either in part or in whole over the aforementioned video data, and outputs them through the output port <b>102</b>. The actions so far described cause the image server apparatus <b>7</b> to process storing and reading of video data and meta information data incidental thereto, inputted from outside.

P-0008[0008] In the above-described example of the prior art, if the copyright information is embedded into the digital image merely with an invisible electronic watermark, the psychological deterrent effect against unauthorized copying and other illegal acts is insufficient as explained above. Or if a visible electronic watermark merely for stating copyright information is embedded into the digital image, there is a greater risk of allowing unauthorized copying or distribution easily, and no deterrent effect can be expected either. Furthermore, according to the technique described in the Japanese patent laid-open cited above, additional information regarding the copyright and other matters to be watermarked in the image needs independent management from the original image, necessitating complicated management of consistency between the original image and the corresponding copyright information. The complicatedness would be especially great where frequent updating of the image is anticipated, such as in the quotation of live news images by a broadcaster. Moreover, in the above-cited example of the prior art, an internal database for managing meta information (additional information) is needed independent of the video data, and accordingly implementation as a single storage system is impossible. Therefore, in the case of this example of the prior art, the function is implemented not as a storage system but as an image server apparatus. This example also requires independent management and storage of video data and additional information corresponding the video data, such as right owner information. For this reason, when storing the video data, for instance, there will be required a sequence of processing including, first opening a file for storing the video data in the write mode, followed by writing of the video data, closing of the file after writing the whole video data and, separately from this sequence, another sequence of opening a file for storing additional information, writing the additional information and then closing this file. In this case, since video data and additional information corresponding the video data are stored in different files, some means to associate them is needed when reading them out. However, as the file system of any usual operating system has no such function to individually record associations between a plurality of files, a superior interface can be realized not as a file system interface but only as a still superior server program interface. Thus, there will be needed an arrangement providing that, for instance, if in the same directory of the file storing video data there is a file whose name has a specific additional characters at the end, that file will contain right owner information on that image file, and such an arrangement would be beyond the manageable scope of the file system. Therefore, this example of the prior art requires a server program for understanding and executing such an arrangement. Furthermore, in storing video data, for instance, in this example of the prior art, a file for storing the video data is opened in the write mode, the video data are then written in, and the file is closed after writing the whole video data. Further, separately from this sequence, right owner information is stored into a special area associated with the file descriptor of the video data. In this way, when reading out video data, the associated right owner information can be taken out by opening the video data in a single file. In order to realize this arrangement, the aforementioned special area is needed in the file system, and therefore any existing file system of a usual operating system cannot be used, but a special file system will have to be developed for each operating system.

P-0009[0009] Problems to be solved by the present invention include, in view of the limitations of the prior art described above, enabling a distribution technique or a data storage technique for digital contents, such as digital images, (1) to output digital image information into which a visible electronic watermark is embedded, (2) to eliminate the need to manage copyright-related information and additional information embedded as a watermark separately from the original image, (3) to obtain by simple manipulation digital image information into which a visible electronic watermark is embedded, and (4) to make the information difficult to alter and thereby to effectively prevent illegal use by, for instance, making the picture being readily deteriorated by any altering attempt that may be made.

SUMMARY OF THE INVENTION

P-0010[0010] An object of the present invention is to provide a technique that can solve these problems.

P-0011[0011] In order to solve the problems, the invention provides a distribution technique or a data storage technique for data, such as digital contents, having a basic configuration in which additional information including copyright-related information is embedded in advance as an invisible electronic watermark into the digital contents on the sending side (a data transmitting apparatus), and on the receiving side (a contents distribution apparatus and a data storage apparatus) the embedded invisible electronic watermark information is decoded and extracted as visible watermark information, the extracted visible watermark information is embedded again into the digital contents, and the additional information is distributed or outputted as visible information together with the digital contents. More specifically, (1) a data transmitting apparatus as the sending side apparatus is configured of a means for inputting digital contents, a means for encoding additional information as invisible electronic watermark information and embedding the encoded information into the digital contents, and a means for outputting the digital contents into which the invisible electronic watermark information is embedded. A contents distributing apparatus for visibly arranging additional information on digital contents and distributing the contents is configured of (2) a receiver means for receiving a first information signal consisting of the digital contents in which additional information is embedded as invisible electronic watermark information, a decoding means for decoding the additional information as invisible electronic watermark information embedded into the received information and extracting it as visible watermark information, and a visible watermark information superimposing means for superimposing the extracted visible watermark information into the digital contents to form a second information signal, and distributes the additional information as visible information together with the digital contents. (3) A contents distributing apparatus for visibly arranging additional information on digital contents and distributing the contents is configured of a receiver means for receiving a first information signal consisting of the digital contents in which additional information is embedded as invisible electronic watermark information, a decoding means for decoding the additional information as invisible electronic watermark information embedded into the received first information signal and extracting it as visible watermark information, a visible watermark information superimposing means for superimposing the extracted visible watermark information into the digital contents to form a second information signal, and a selector means for selecting and outputting the first information signal or second information signal, and distributes the additional information as visible information together with the digital contents. (4) A contents distributing apparatus for visibly arranging additional information on digital contents and distributing the contents is configured of a receiver means for receiving a first information signal consisting of the digital contents in which additional information is embedded as invisible electronic watermark information, a memory means for storing digital contents in the received information signal, a decoding means for decoding the additional information as invisible electronic watermark information embedded into the received information signal and extracting it as visible watermark information, a visible watermark information superimposing means for superimposing the extracted visible watermark information into the digital contents read out of the memory means to form a second information signal, and a means for outputting the second information signal, and distributes the additional information as visible information together with the digital contents. (5) The contents distribution apparatus, as stated in (2), (3) or (4) above, so configured that the additional information be either right owner information or information on viewing/listening restriction. (6) A contents distribution system for distributing digital contents is configured of a transmitting means for encoding additional information as invisible electronic watermark information, embedding the encoded information into the digital contents, and transmitting the digital contents with the additional information to a network as a first information signal, and a distributing means for receiving the first information signal from the network, decoding the additional information as the embedded invisible electronic watermark information, extracting it as visible watermark information, superimposing it again into the digital contents to form a second information signal, and transmitting the signal, and distributes the digital contents with the additional information visibly arranged thereon. (7) A data storage apparatus capable of visibly arranging additional information on digital contents and outputting the digital contents of this arrangement is provided with an input means for receiving a first information signal consisting of digital contents in which additional information is embedded as invisible electronic watermark information, a memory means for storing the digital contents in the received information signal, a decoding means for decoding the additional information as invisible electronic watermark information embedded in the received information signal and extracting it as visible watermark information, a visible watermark information superimposing means for superimposing the extracted visible watermark information into the digital contents read out of the memory means to form a second information signal, and an output means for outputting the second information signal, wherein the input means and the output means are configured as an interface of a file system, and are capable of outputting the additional information as visible information together with the digital contents. (8) By a digital contents distribution method of visibly arranging additional information on digital contents and distributing the digital contents of this arrangement, the additional information is distributed as visible information together with the digital contents through a step of receiving a first information signal consisting of the digital contents in which the additional information is embedded as invisible electronic watermark information, a step of decoding the additional information as invisible electronic watermark information embedded in the received information signal and extracting it as visible watermark information, and a step of superimposing the extracted visible watermark information into the digital contents to form a second information signal. (9) By a digital contents distribution method, the additional information is distributed as visible information together with the digital contents through a step of receiving a first information signal consisting of the digital contents in which the additional information is embedded as invisible electronic watermark information, a step of decoding the additional information as invisible electronic watermark information embedded in the received first information signal and extracting it as visible watermark information, a step of superimposing the extracted visible watermark information into the digital contents to form a second information signal, and a step of selecting and outputting the first information signal or second information signal. (10) By a digital contents distribution method, the additional information is distributed as visible information together with the digital contents through a step of receiving a first information signal consisting of the digital contents in which the additional information is embedded as invisible electronic watermark information, a step of storing the digital contents in the received information signal, a step of decoding the additional information as invisible electronic watermark information embedded in the received information signal and extracting it as visible watermark information, a step of superimposing the extracted visible watermark information into the digital contents readout of the memory means to form a second information signal, and a step of outputting the second information signal.

BRIEF DESCRIPTION OF THE DRAWINGS

P-0012[0012]FIG. 1 illustrates a first preferred embodiment of the present invention.

P-0013[0013]FIG. 2 illustrates an example of the prior art.

P-0014[0014]FIG. 3 illustrates a second preferred embodiment of the invention.

P-0015[0015]FIG. 4 illustrates a third preferred embodiment of the invention.

P-0016[0016]FIG. 5 illustrates a fourth preferred embodiment of the invention.

P-0017[0017]FIG. 6 illustrates a fifth preferred embodiment of the invention.

P-0018[0018]FIG. 7 illustrates a sixth preferred embodiment of the invention.

P-0019[0019]FIG. 8 illustrates a seventh preferred embodiment of the invention.

P-0020[0020]FIG. 9 illustrates an eighth preferred embodiment of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

P-0021[0021] Preferred embodiments of the present invention will be described below with reference to accompanying drawings.

P-0022[0022]FIG. 1 illustrates a first preferred embodiment of the invention.

P-0023[0023] This example is a case in which copyright owner information is distributed as additional information together with digital contents.

P-0024[0024] In FIG. 1, reference numeral <b>1</b> denotes a video storage as a contents distribution apparatus for receiving and distributing video data as digital contents; <b>2</b>, a network; <b>3</b>, a contents holder having a data transmitting apparatus for transmitting the digital contents to the video storage <b>1</b> via the network <b>2</b>; <b>101</b>, a control port; <b>102</b>, an output port; <b>103</b>, an input port; <b>111</b>, an invisible watermark decoding means, <b>112</b>, a visible watermark superimposing means; <b>113</b>, a file system control means; and <b>115</b>, an image memory means. The contents holder <b>3</b> is provided with an invisible watermark encoding means <b>311</b> for encoding an invisible watermark and embedding it into original video data, an original image input means <b>312</b> for inputting original video data, and a right holder information holding means <b>313</b> for memorizing (storing) right owner information as additional information.

P-0025[0025] This first embodiment operates as described below.

P-0026[0026] In the contents holder <b>3</b>, right owner information from the right holder information holding means <b>313</b> and original video data from the original image input means <b>312</b> are inputted into the invisible watermark encoding means <b>311</b>, in which the right owner information is encoded as an invisible watermark, embedded into the video data, and the video data in which the invisible watermark is embedded are outputted to the network <b>2</b>. The original video data maybe either directly inputted from the input means, or once stored into an internal memory means and inputted from there. The right owner information may also be either stored in advance or, for instance, inputted in parallel with the original video data. The video data in which the invisible watermark is embedded may be outputted as they are on a real time basis, or temporarily stored in the memory means and outputted as appropriate. The video data outputted from the contents holder <b>3</b> are transmitted to the video storage <b>1</b> via the network <b>2</b>. The network <b>2</b> may be, for instance, LAN connection by network cable, data connection via ordinary public telephone line, digital satellite broadcasting, path connection between components in the apparatus, or even virtual connection having no physical substance on a single computer. Further, between the contents holder <b>3</b> and the video storage <b>1</b>, data may be transferred on a real time basis or, instead of the network <b>2</b>, a means for temporary storage of video data, for instance a large capacity data storage means such as DVD, may be provided, in which the video data outputted from the contents holder <b>3</b> and later read into the video storage <b>1</b>. If the video data are to be temporarily stored in the contents holder <b>3</b>, the video storage <b>1</b> receives the video data from the network <b>2</b> via the input port <b>103</b>, and stores the video data, into which the invisible watermark is embedded, into the image memory means <b>115</b>. In this process, as required, the file system control means can appropriately update file system management information.

P-0027[0027] The above-described data storing operation will be explained below by analogy with the operation of writing into the file system of a usual operating system. In the case of a program on a usual operating system, for instance, a path name and an access mode are given as the parameters to open a file, and a file descriptor is thereby obtained. Then, with the file descriptor as the parameter, data are read, written or sought as required, and the file is closed at the end. In this first embodiment of the invention, a program intending to store video data into the video storage <b>1</b> requests the video storage <b>1</b> to open a file. As the parameter for use then, a descriptor for identifying the needed video data, i.e. the path name in the file system is given. The file system control means <b>113</b> allocates a storage area for the video data in the image memory means <b>115</b>, and performs preparatory processing for accessing the area. It also allocates information for locating the position of the data storage area to the given path name. Upon completion of the preparatory processing, the file system control means <b>113</b> generates a file descriptor corresponding each set of file open processing, and hands it over to the program requesting the opening of the file. This completes the processing of file opening. Next, the program requests writing of the video data, and sequentially delivers the substantial parts of the video data. The file system control means <b>113</b> receives these requests and data, stores the data into the image memory means <b>115</b> and, as required, processes allocation of an additional data storage area. When the program has finished delivering all the video data, a file close request is made. Upon receiving the file close request, the file system control means <b>113</b> releases the file descriptor assigned at the time of opening the file. The operation to store data into the file system is accomplished as described so far.

P-0028[0028] The operation that takes place when the video storage <b>1</b> has received an image read request from outside will be described below.

P-0029[0029] The video storage <b>1</b> receives the read request from outside via the control port <b>110</b>. The read request received by the video storage <b>1</b> is interpreted by the file system control means <b>113</b>, which takes out the requested video data from the image memory means <b>115</b>. The video data that have been taken out are sent to the invisible watermark decoding means <b>111</b>, which extracts right owner information as additional information, embedded in advance in the video data, and sends it to the visible watermark superimposing means <b>112</b>. The visible watermark superimposing means <b>112</b>, on the basis of the extracted right owner information, superimposes a visible watermark over the video data, and outputs to the output port <b>102</b> the video data over which the visible watermark has been superimposed. This read operation will be described below by analogy with the operation to read out of a file system in a usual operating system as was the write operation above.

P-0030[0030] A program intending to read out of the video storage <b>1</b> video data stored therein requests the video storage <b>1</b> to open a file. As the parameter for use then, a descriptor for identifying the needed video data, i.e. the path name in the file system is given. The file system control means <b>113</b>, on the basis of the path name that has been given, locates the area in the image memory means <b>115</b> in which the specified video data are stored, and performs preparatory processing for accessing the area. Upon completion of the preparatory processing, the file system control means <b>113</b> generates a file descriptor corresponding each set of file open processing, and hands it over to the program requesting the opening of the file. This completes the processing of file opening.

P-0031[0031] Next, the program makes a request to seek for the position in the specified video data from which data are to be read out, followed by a request to read the video data. As these requests are made, the file system control means <b>113</b> seeks for the storage position of the specified data, and reads the desired data out of the image memory means <b>115</b>. The video data that have been read out are sent to the invisible watermark decoding means <b>111</b>, which extracts the right owner information embedded in the video data. The right owner information is superimposed over the video data already read out by the visible watermark superimposing means <b>112</b>, outputted as read data from the file system, and handed over to the program. Since the above-described processing in this read operation takes place within the file system, the program using the video data is not aware of the presence of the invisible watermark decoding or the visible watermark embedding for the video data. Upon completion of the reading of required video data, the program makes a file close request. Upon receipt of the file close request, the file system control means <b>113</b> releases the file descriptor assigned at the time of opening the file, and the operation to read the video data is completed. The processing to read, in a state in which the visible watermark is superposed, the video data stored in the image memory means <b>115</b> in the video storage <b>1</b> is accomplished in the procedure described so far. The video storage <b>1</b> is configured as, for instance, a file system in a storage system.

P-0032[0032] This first embodiment of the invention, because it combines an invisible watermark with a visible watermark, can effectively protect the rights of the copyright owner. Since an interface as a storage apparatus can be provided to an apparatus having a watermark processing function, watermark processing can be made possible merely by replacing the existing storage apparatus. As the configuration is such that watermark processing, especially invisible watermark decoding, is performed on the part of the storage apparatus, the load on the server itself handling the video data can be reduced. As the video data themselves have, in the form of an invisible watermark embedded into them, the right owner information corresponding the video data, the two elements necessarily constitute a single file. As a result, the file system of an existing operating system can be used as it is. Since the configuration is such that information on the copyright owner and the like are obtained from the video data themselves, there is no need for dual management involving the storage of information for embedding the visible watermark, resulting in a saving in the file system management cost.

P-0033[0033]FIG. 3 illustrates a second preferred embodiment of the present invention.

P-0034[0034] This second embodiment has a configuration to superpose right owner information in a visible watermark over inputted video data and outputting as they are the video data so marked on a real time basis.

P-0035[0035] In FIG. 3, reference numeral <b>10</b> denotes a visible watermark embedding apparatus; <b>2</b>, a network; and <b>3</b>, a contents holder. The visible watermark embedding apparatus <b>10</b> comprises a control port <b>101</b>, an output port <b>102</b>, an input port <b>103</b>, an invisible watermark decoding means <b>111</b> and a visible watermark superimposing means <b>112</b>. The contents holder <b>3</b> comprises an invisible watermark encoding means <b>311</b>, an original image input means <b>312</b> and a right holder information holding means <b>313</b>. In the visible watermark embedding apparatus <b>10</b>, right owner information is superimposed in a visible watermark over inputted video data, and the video data so marked are outputted as they are on a real time basis. The configurations and operations of the contents holder <b>3</b> and the network <b>2</b> are the same as those of their respective counterparts in the first embodiment. The visible watermark embedding apparatus <b>10</b> receives the video data from the network <b>2</b> via the input port <b>103</b>. The inputted video data are sent to the invisible watermark decoding means <b>111</b>, which extracts right owner information embedded into the video data in advance and sends it to the visible watermark superimposing means <b>112</b>. The visible watermark superimposing means <b>112</b>, on the basis of the extracted right owner information, superimposes a visible watermark over the video data, and outputs as they are the video data so marked to the output port <b>102</b> on a real time basis.

P-0036[0036] Since this second embodiment, like the first embodiment described above, combines an invisible watermark with a visible watermark, can effectively protect the rights of the copyright owner.

P-0037[0037]FIG. 4 illustrates a third preferred embodiment of the present invention.

P-0038[0038] This is a case of a data storage apparatus.

P-0039[0039] In FIG. 4, reference numeral <b>6</b> denotes a data storage apparatus provided with a plurality of access ports. The storage apparatus <b>6</b> comprises a dedicated output port <b>105</b>, an input/output port <b>106</b>, an invisible watermark decoding means <b>111</b>, a visible watermark superimposing means <b>112</b> and an image memory means <b>115</b>. Image data to be stored into the data storage apparatus <b>6</b> entered through the input/output port <b>106</b>, and stored into the image memory means <b>115</b>. At this time, like the data storage apparatus, a file system control means (not shown) or the like appropriately updates file system management information. Two methods are available for reading out the video data stored in the image memory means <b>115</b>: one of reading through the input/output port <b>106</b> and the other of reading through the dedicated output port <b>105</b>. By the method of reading the video data through the input/output port <b>106</b>, as in reading out of a usual data storage apparatus, at a request from outside the data are sent to the input/output port <b>106</b> from the image memory means <b>115</b>. By the method of reading the video data through the dedicated output port <b>105</b>, the video data taken out of the image memory means <b>115</b> are sent to the invisible watermark decoding means <b>111</b>, which extracts right owner information embedded in advance in the video data and sends it to the visible watermark superimposing means <b>112</b>. The visible watermark superimposing means <b>112</b>, on the basis of the extracted right owner information, superimposes a visible watermark over the video data, and outputs the video data so marked via the dedicated output port <b>105</b>. This third embodiment has a configuration in which the input/output port is employed as a port for local use and the dedicated output port employed as a port for public use. For instance, an interface supporting the network file system is made available on the part of the input/output port, and connected to the local environment, such as the inside of the organization, for use therein. On the part of the dedicated output port, an interface suppporting Web (HTTP) is made available, and data outputted from this interface are made usable from outside the organization. The network file system and the HTTP interface may be configured either inside this third embodiment or of another server apparatus connected to the third embodiment from outside. In the latter case, this embodiment would like an ordinary data storage apparatus as viewed from the server apparatus, and accordingly can be easily connected.

P-0040[0040] This third embodiment of the invention can be operated as a usual data storage apparatus when accessed from inside the organization or as a data storage apparatus provided with a visible watermark embedding function when accessed from outside the organization. In other respects, it can provide basically the same effects and advantages as the first embodiment described above.

P-0041[0041]FIG. 5 illustrates a fourth preferred embodiment of the present invention.

P-0042[0042] Referring to FIG. 5, the video storage <b>1</b> is provided with a control port <b>101</b>, an output port <b>102</b>, an input port <b>103</b>, an invisible watermark decoding means <b>111</b>, a visible watermark superimposing means <b>112</b>, a file system control means <b>113</b>, an output selector means <b>114</b>, an image memory means <b>115</b> and a visible-watermarked image memory means <b>116</b>. In this configuration, video data inputted through the input port <b>103</b> are stored into the image memory means <b>115</b>. In parallel with this processing, the video data are also sent to the invisible watermark decoding means <b>111</b>. The invisible watermark decoding means <b>111</b> extracts right owner information embedded in the video data in advance, and sends it to the visible watermark superimposing means <b>112</b>. The visible watermark superimposing means <b>112</b>, on the basis of the extracted right owner information, superimposes a visible watermark over the video data and stores it into the visible-watermarked memory means <b>116</b>. To read out video data stored in the image memory means <b>115</b> or the visible-watermarked memory means <b>116</b>, a read request is sent to the file system control means <b>113</b> via the control port <b>101</b>. The file system control means <b>113</b> determines the type of the received read request, and manipulates the output selector means <b>114</b> accordingly. Out of the video data taken out of the image memory means <b>115</b> and the visible-watermarked memory means <b>116</b>, only those taken out of the former or the latter are selected by the output selector means <b>114</b> and outputted through the output port <b>102</b>.

P-0043[0043] This fourth embodiment can distinguish and selectively output video data over which a visible watermark is superposed or video data over which no visible watermark is superposed according to the type of the read request. For instance, it is made possible to output video data over which no visible watermark is superimposed only when video data having information on a specific file access right are to be read out with a special user permission. Alternatively, it may be so arranged that outputting of video data having no visible watermark superimposed on them can be permitted only by making a read request in a state in which a specific keyword is added to the end of the file name, for instance in a state in which a additional extension is added. Since whichever arrangement can be implemented within the scope of any existing file system, connection to outside involves no difficulty.

P-0044[0044]FIG. 6 illustrates a fifth preferred embodiment of the present invention.

P-0045[0045] Referring to FIG. 6, the video storage <b>1</b> is provided with a control port <b>101</b>, an output port <b>102</b>, an input port <b>103</b>, an invisible watermark decoding means <b>111</b>, a visible watermark superimposing means <b>112</b>, a file system control means <b>113</b>, an output selector means <b>114</b> and an image memory means <b>115</b>. Image data inputted through the input port <b>103</b> is stored into the image memory means <b>115</b> under the control of the file system control means <b>113</b>. To read out video data stored in the image memory means <b>115</b>, a read request is sent to the file system control means <b>113</b> via the control port <b>101</b>. The file system control means <b>113</b> determines the type of the received read request, and manipulates the output selector means <b>114</b> accordingly. The video data taken out of the image memory means <b>115</b> are sent to the output selector means <b>114</b> and the invisible watermark decoding means <b>111</b>. The invisible watermark decoding means <b>111</b> extracts right owner information embedded in the video data in advance, and sends it to the visible watermark superimposing means <b>112</b>. The visible watermark superimposing means <b>112</b>, on the basis of the extracted right owner information, superimposes a visible watermark over the video data. The output selector means <b>114</b> selects either the video data received from the image memory means <b>115</b> or video data over which the visible watermark is superimposed, and outputs them through the output port <b>102</b>.

P-0046[0046] This fifth embodiment can selectively output video data over which a visible watermark is superimposed or video data over which no visible watermark is superimposed according to the type of the read request. It is efficient because the capacity of the memory area for storing video data need not be very great. In other respects, it can provide basically the same effects and advantages as the first embodiment described above.

P-0047[0047]FIG. 7 illustrates a sixth preferred embodiment of the present invention.

P-0048[0048] In FIG. 7, reference numeral <b>8</b> denotes a data storage apparatus and <b>11</b>, an image server apparatus. The storage apparatus <b>8</b> is provided with a file system control means <b>113</b> and a memory means <b>115</b>. The image server apparatus <b>11</b> comprises a control port <b>101</b>, an output port <b>102</b>, an input port <b>103</b>, an invisible watermark decoding means <b>111</b>, a visible watermark superimposing means <b>112</b> and a control means <b>118</b>. In this configuration, the image server apparatus <b>11</b> hands over video data inputted from the input port <b>103</b> to the data storage apparatus <b>8</b>, and commands storage of the video data through the control means <b>118</b>. When the data storage apparatus <b>8</b> receives the video data and the instruction to store them, the file system control means <b>113</b> controls the memory means <b>115</b> to have the received video data stored into the memory means <b>115</b>. Next, the image server apparatus <b>11</b>, upon receiving a read request for video data from outside, commands the data storage apparatus <b>8</b> to read out the video data. The data storage apparatus <b>8</b> takes out the specified video data from the memory means <b>115</b>, and hands them over to the image server apparatus <b>11</b>. The video data received by the image server apparatus <b>11</b> are sent to the invisible watermark decoding means <b>111</b>. The invisible watermark decoding means <b>111</b> extracts right owner embedded in the video data in advance, and sends it to the visible watermark superimposing means <b>112</b>. The visible watermark superimposing means <b>112</b>, on the basis of the extracted right owner information, superimposes a visible watermark over the video data, and outputs the marked video data through the output port <b>102</b>.

P-0049[0049] Since the sixth embodiment of the invention has a configuration in which a data storage apparatus for actually storing video data and an image server apparatus for watermark processing are separated from each other, an ordinary data storage apparatus can be used as it is for the data storage apparatus <b>8</b>. This feature permits flexible hardware configuration. In other respects, it can provide basically the same effects and advantages as the third embodiment described above.

P-0050[0050]FIG. 8 illustrates a seventh preferred embodiment of the present invention.

P-0051[0051] In FIG. 8, reference numeral <b>1</b> denotes a video storage; <b>2</b>, a network; <b>3</b>, a contents holder; and <b>9</b>, an image display apparatus. The video storage <b>1</b> is provided with an invisible watermark decoding means <b>111</b>, a visible watermark superimposing means <b>112</b> and an image memory means <b>115</b>. The contents holder <b>3</b> comprises an invisible watermark encoding means <b>311</b>, an original image input means <b>312</b>, a right holder information holding means <b>313</b> and a temporary image memory means <b>314</b>. The image display apparatus <b>9</b> is provided with an image watching means <b>911</b>. A file system control means and so forth are arranged within the video storage <b>1</b>. The contents holder <b>3</b> hands over an original image obtained from the original image input means <b>312</b> and the right owner information stored in the right holder information holding means <b>313</b> in advance to the invisible watermark encoding means <b>311</b>, stores video data consisting of the original image in which right owner information is embedded as an invisible watermark into the temporary image memory means <b>314</b>, and outputs them as required. The video data outputted from the contents holder <b>3</b> are handed over to the video storage <b>1</b> via the network <b>2</b>. The video storage <b>1</b> receives the video data from the network <b>2</b> via the input port, and stores them into the image memory means <b>115</b>. On this occasion, the file system control means appropriately updates the file system management information as required. Next, the image display apparatus <b>9</b> makes a video data read request to the video storage <b>1</b> via the network <b>2</b>. The video storage <b>1</b> receives the read request via the control port, and takes out the request video data from the image memory means <b>115</b>. The video -data that have been taken out are sent to the invisible watermark decoding means <b>111</b>. The invisible watermark decoding means <b>111</b> extracts right owner information embedded in the video data in advance, and sends it to the visible watermark superimposing means <b>112</b>. The visible watermark superimposing means <b>112</b>, on the basis of the extracted right owner information, superimposes a visible watermark over the video data, and sends the marked video data to the image display apparatus <b>9</b> via the network <b>2</b>. The image display apparatus <b>9</b>, upon receiving the video data via the network <b>2</b>, hands them over to the image watching means <b>911</b> to cause image displaying or the like to be done.

P-0052[0052] This seventh embodiment of the invention can integrate all the functions into a single system by, for instance, having the contents holder <b>3</b> serve the copyright owner of the video data, the video storage <b>1</b> serve an intermediate distributor of the video data, and the image display apparatus <b>9</b> serve the end user of the video data. In other respects, it can provide basically the same effects and advantages as the first embodiment described above.

P-0053[0053]FIG. 9 illustrates an eighth preferred embodiment of the present invention.

P-0054[0054] In FIG. 9, reference numeral <b>12</b> denotes an image display apparatus with a video storage. Other constituents are the same as their respective counterparts in the seventh embodiment described above. This embodiment is an example of a single constituent element into which, like a set-top box with a video storage function for instance, an invisible watermark decoding means <b>111</b>, a visible watermark superimposing means <b>112</b>, an image memory means <b>115</b> and an image watching means <b>911</b> are incorporated.

P-0055[0055] This eighth embodiment can provide basically the same effects and advantages as the seventh embodiment described above.

P-0056[0056] Although it is supposed for every one of the embodiments of the present invention described so far that rights information and the like are embedded in video data, the invention is not limited to this, but the rights information and the like can as well be embedded in audio data for instance. In place of embedding an invisible watermark as described above, for instance rights information can be embedded indistinguishably into audio information, or instead of a visible watermark a message concerning rights information can be inserted at regular intervals. Information extracted from an invisible watermark can well be indirectly indicated instead of directly superposing it as a visible watermark. Where, for instance, information extracted from an invisible watermark includes information on the type of visible watermark to be superposed, it can be made switchable on the basis of this information between the display of only a logo image of the copyright owner and that of a text representing the name of the copyright owner together with the logo image. In this arrangement, the logo image itself and the text representing the name of the copyright owner need not be extracted from the invisible watermark, but only numerical codes representing the logo and the copyright owner, for instance, can be extracted to obtain the logo and the text representing the name of the copyright owner on the basis of these codes. Although it is supposed in the embodiments of the invention described above that the information embedded in the invisible watermark is right owner information and that the image to be superimposed as a visible watermark is supposed to represent copyright owner information taken out of the invisible watermark, the invention is not confined to this, but any desired information can be embedded in video data as an invisible watermark and any desired visible watermark may be superimposed on the basis of the information extracted from these video data. For instance, information on the days during which the video data can be lawfully played can be embedded in advance as an invisible watermark, and no visible watermark would be superimposed if the image is played within those days, or copyright owner information may be superimposed in only a small size during the specified days, after which the copyright owner information would be superimposed in a more conspicuous way. Or where a system in which a certain quantity of advertising is to be displayed in played given video data for instance, information on the attributes of advertising to be superimposed in the video data may be embedded in an invisible watermark and, at the time of playing the image, the advertising image and the like could be selected on the basis of this information extracted from the invisible watermark.

P-0057[0057] Inventions related to those set forth in the claims of this patent application and described as preferred embodiments above include: (1) a configuration in which the digital contents are digital video contents or digital audio contents; and (2) a data storage apparatus provided with a plurality of file system interfaces, wherein each of some or all of the plurality of file system interfaces has an input means for receiving a first information signal comprising additional information embedded in digital contents as invisible electronic watermark information, a memory means in which digital contents in the received information signal are to be stored, a decoding means for decoding invisible electronic watermark information embedded in the received information signal and converting it into visible watermark information, a visible watermark information superimposing means for embedding the visible watermark information into the digital contents read out of the memory means to form a second information signal, and an output means for outputting the second information signal, the input means and the output means being configured to constitute a file system interface and permitting the additional information to be outputted as visible information together with the digital contents.

P-0058[0058] According to the present invention, copyrights and the like can be effectively protected with additional information, and the management cost of file systems can be reduced, too.