Metadata record generation
Abstract
This record has no abstract on file.
Term
No projected expiry on record.
- Priority
- Filed
- Published
- Today
13 claims: 7 independent, 6 dependent
- 1Patent claims Zastrzeżenia patentowe 1. A computer-implemented method for analyzing a media design defined by an editing tool (50), the method comprising:1. Sposób realizowany komputerowo do analizowania projektu mediów zdefiniowanego przez narzędzie edycyjne (50), przy czym sposób obejmuje: odbiór pierwszego pliku (68) dla projektu mediów, zdefiniowanego przez narzędzie edycyjne, przy czym narzędzie edycyjne jest narzędziem realizowanym komputerowo dla edycji audio i/lub wizualnej, a projekt mediów zawiera wiele elementów mediów w co najmniej jednej z wielu ścieżek i pojemników projektu oraz pierwszy plik zawiera treść mediów, ekstrahowaną z elementów mediów projektu mediów i metadane ekstrahowane z elementów mediów projektu mediów;i generowanie drugiego pliku (70) zawierającego wyznaczone metadane, przy czym wyznaczone metadane zawierają metadane do identyfikacji elementów mediów dla raportowania do co najmniej jednego systemu agencyjnego (14) dla właścicieli praw, przy czym generowanie drugiego pliku obejmuje porównanie reprezentacji generowanej z treści mediów, ekstrahowanej z określonego jednego z wielu elementów mediów do reprezentacji referencyjnych w bazie danych (20) elementów referencyjnych dla zidentyfikowania dopasowania, przy czym elementy referencyjne referencyjnej bazie danych zawierają powiązane metadane referencyjne, i jeżeli zostanie zidentyfikowany odpowiedni element referencyjny w referencyjnej bazie danych, dla którego reprezentacja generowana z treści ekstrahowanej z określonego elementu mediów pasuje do reprezentacji referencyjnej dla odpowiedniego elementu referencyjnego, wykorzystanie, dla wyznaczonych metadanych dla określonego elementu mediów, powiązanych metadanych referencyjnych dla dopasowanego elementu referencyjnego, w innym przypadku wykorzystanie, dla wyznaczonych metadanych dla określonego elementu mediów, metadanych dla określonego elementu mediów, ekstrahowanego z elementów mediów projektu mediów;i wytwarzanie drugiego pliku. receiving the first file (68) for a media project, defined by an editing tool, the editing tool being a computer-implemented tool for audio and / or visual editing, and the media design contains many media elements in at least one of the project's many paths and containers, and the first the file contains media content extracted from the media design media elements and metadata extracted from the media design media elements;and generating a second file (70) containing the designated metadata, wherein the designated metadata contains metadata for identifying media elements for reporting to at least one agency system (14) for rights owners, wherein the generation of the second file involves comparing the representation generated from media content, extracted from one of many media elements for reference representations in the database (20) of reference elements to identify a match, wherein the reference elements of the reference database contain associated reference metadata, and if the corresponding reference element is identified in the reference database, for which the representation generated from content extracted from a specific media element matches the reference representation for the corresponding reference element, use, for designated metadata for a specific media element, related reference metadata for the matched reference element, otherwise use, for designated metadata for a specific media element , metadata for a specific media item, media project extracted from media elements;and creating a second file.
- 45. The method of any one of the preceding claims, wherein producing the second file comprises at least one of:encrypting the second file prior to transmission;5. Sposób według dowolnego z poprzednich zastrzeżeń, przy czym wytwarzanie drugiego pliku obejmuje co najmniej jedno spośród: szyfrowania drugiego pliku przed przesłaniem;przesłanie drugiego pliku do systemu agencyjnego, przy czym system agencyjny zawiera jeden lub więcej serwerów komputerowych;sending a second file d about the agency system, the agency system comprising one or more computer servers;przesłanie drugiego pliku do systemu agencyjnego, przy czym system agencyjny zawiera jeden lub kilka serwerów komputerowych, obsługiwanych przez realizację społeczności praw. sending a second file to the agency system, the agency system containing one or more computer servers operated by the rights community.
- 56. The method according to any one of the preceding claims, wherein comparing the representation generated from data content extracted from a specific media element of the media design with reference representations in the reference element database for identifying the match includes performing pattern recognition between the representation generated from the media content, extracted from a specific media element of a media project with reference representations in the reference element database to identify a match. 6. Sposób według dowolnego z poprzednich zastrzeżeń, przy czym porównanie reprezentacji generowanej z treści danych, ekstrahowanej z określonego elementu mediów projektu mediów, z reprezentacjami referencyjnymi w bazie danych elementów referencyjnych dla zidentyfikowania dopasowania obejmuje przeprowadzenie rozpoznania wzoru pomiędzy reprezentacją generowaną z treści mediów, ekstrahowanej z określonego elementu mediów projektu mediów z reprezentacjami referencyjnymi w bazie danych elementów referencyjnych dla zidentyfikowania dopasowania.
- 89. The method according to any one of the preceding claims, wherein:9. Sposób według dowolnego z poprzednich zastrzeżeń, przy czym: reprezentacja generowana z treści mediów, ekstrahowanej z określonego elementu mediów projektu mediów stanowi odcisk palca, generowany z treści mediów, ekstrahowanej z określonego elementu mediów projektu mediów;i odpowiedni element referencyjny zawiera reprezentację w postaci odcisku palca, generowanego z pracy referencyjnej i powiązanych metadanych identyfikujących pracę referencyjną. the representation generated from media content extracted from a specific media element of the media project is a fingerprint generated from media content extracted from a specific media element of the media project;and the respective reference element comprises a fingerprint representation generated from the reference work and associated metadata identifying the reference work.
- 1012. The method of any of the preceding claims, comprising:12. Sposób według dowolnego z poprzednich zastrzeżeń, obejmujący: adding a reference element to a reference database when no element is identified in the reference database that has a reference representation that matches the representation generated from the content extracted from a specific media element, where the added reference element contains a representation generated from the media content, extracted from a specific media element and metadata extracted from at least one project sequence and associated with the media content extracted from the specified media element. dodanie elementu referencyjnego do referencyjnej bazy danych, gdy nie zostanie zidentyfikowany żaden z elementów w referencyjnej bazie danych, który miałby reprezentację referencyjną, która pasuje do reprezentacji generowanej z treści ekstrahowanej z określonego elementu mediów, przy czym dodany element referencyjny zawiera reprezentację generowaną z treści mediów, ekstrahowanej z określonego elementu mediów i metadanych ekstrahowanych z co najmniej jednej sekwencji projektu i powiązanych z treścią mediów, ekstrahowaną z określonego elementu mediów.
- 1113. The method according to any of claims 1 to 11, also including:13. Sposób według dowolnego z zastrz. 1 do 11, obejmujący ponadto: if the appropriate reference element is identified in the reference database for which the representation generated from the content extracted from a specific media element matches the reference representation for the respective reference element, comparison of related reference metadata for the matched reference representation with metadata for the specific media element from the media design media elements and if the metadata for a specific media item, extracted from the media elements of the media project, contain new data not included in the related reference metadata for the matched reference, adding new metadata to the associated reference metadata for the matched reference in the database. jeżeli zostanie zidentyfikowany odpowiedni element referencyjny w referencyjnej bazie danych, dla którego reprezentacja generowana z treści ekstrahowanej z określonego elementu mediów pasuje do reprezentacji referencyjnej dla odpowiedniego elementu referencyjnego, porównanie powiązanych metadanych referencyjnych dla dopasowanej reprezentacji referencyjnej z metadanymi dla określonego elementu mediów z elementów mediów projektu mediów i jeżeli metadane dla określonego elementu mediów, ekstrahowanego z elementów mediów projektu mediów, zawierają nowe dane nieujęte w powiązanych metadanych referencyjnych dla dopasowanej referencji, dodanie nowych metadanych do powiązanych metadanych referencyjnych dla dopasowanej referencji w bazie danych.
- 1214. A computer program product comprising program code executable for carrying out the steps of the method according to any of the preceding claims. 14. Produkt programu komputerowego, zawierający kod programowy, wykonywalny dla realizacji etapów sposobu według dowolnego z poprzednich zastrzeżeń.
Independent claims7
137 paragraphs, as filed
Technical field [0001] The invention relates to methods and apparatus for automatically identifying and selecting meta data from multimedia editing tools.
Background [0002] As used herein, the term "editing tool" means a computer-implemented audio and / or video editing tool. The editing tool can be used for broadcasting purposes. Exemplary editing tools include, for example, editing software used for editing audio and / or video production (projects), e.g., for editing movies, for editing programs. Other examples of editing tools include so-called sequencers that are normally used to produce audio only. Other examples of editing tools include broadcast automation tools that allow you to enter and play audio and video directions by scheme or by signal from the control panel.
[0003] As used herein, the term "design" refers to audio or audiovisual production, for example, a specific cut of a movie or episode of a TV program, or a mixture of songs, or broadcast production. The project file in the editing tool is a central file in which all information about a given audio or audiovisual production is stored, and which points to multimedia files that are used in the project.
[0004] As used herein, the term "sequence", typically used in the terminology of editing tools, refers to a particular edition in a project. For example, if the project is a movie, examples of the sequence (editing) may be the pre-watershed version (intended for broadcasting before a specific time), the trailer version, the director's version, etc.
[0005] As used herein, the term "meta data" refers to any information, in any form, regarding a project or project sequence. Examples of meta data include: project name; creator name; names of multimedia files used in the project; technical information about multimedia files used in the project, such as depth in bits, sampling frequency, location in the GPS system (global positioning system), exposure, etc .; time data about places and how to cut and edit each multimedia file in the program; processing data; information about settings about how audio or video sections have been processed (e.g. visual effects); free text or individualized fields in which the editor makes entries or which he imports into the project; map and / or GPS data; data on audio levels; graphic data; color data; rights data.
[0006] As used herein, the term "content" refers to multimedia content stored in a media file. The media file can have content in the form of raw audio, video images, images, graphics, etc. The content in the multimedia files is loaded into the editing tool by an editor operating the editing tool to create the project.
[0007] The editor could use a music track in his production. The editor is normally required to make a list of all the music used, with start and end times and a list of all other related fields that indicate the identity of the ownership rights of the parties concerned in each piece of music; composer; publisher, arrangement etc. Such a music list with all related meta data is commonly known as a directive sheet. This is a significant burden for the editor to identify a fragment of the music used, then find and attach meta data for that music, and then organize the meta data in the format of the directive sheet.
[0008] Most editing tools can export a standard edit decision list (EDL file), which can then be automatically searched to find the file name of each music file used and the times at which it was used in production. There is automated software for converting EDL to directive sheet that uses file names to search the music title database and their associated meta data, thus avoiding the editor having to find this information. WO 2006/028600 describes an automatic method for generating an EDL directive sheet by parsing EDL data.
[0009] However, this approach, where such automated EDL conversion software to the directive sheet is used, is based on the fact that the file name of the music track used by the editor in the project is exactly the same as the file name in the review database. This is a problem because the editor may use abbreviations or may not be aware of what name exists in the database. For example, the editor may refer to Madonna's path as Madi1, while the meta database may use a completely different name.
[0010] Also, before an editor can create an EDL file from a project, he must perform a lot of time-consuming and error-prone organizing activities in the editing tool, so that the EDL contains all the information that is relevant to the directive sheet (e.g. overlay voice and other music tracks must be cleaned of unwanted elements and audio tracks must be arranged in a special way for the EDL export function to work).
[0011] US 2005/038819 discloses a music recommendation system that receives the user selection of the desired music, acquires analysis data associated with the selected music, and generates a song playlist based on the analysis data. Analysis data is generated based on one or more processed audio signals associated with the selected music. Analysis data can be downloaded from the central server. If the analysis data is not
-3 available on the central server, they are generated locally on the user's side and uploaded to the central server. There are many user-selectable scheduling mechanisms that allow you to prioritize songs according to the selected sorting mechanism. US2001 / 041050 discloses a video data storage unit in which video data fragments are stored. The edit information generation unit generates editing information sets. The copyright information storage unit stores a standard copyright fee for each piece of video data. The author's fee calculation unit calculates the total author's fee using the editing information sets and the standard author's fee. The upper limit assessment unit assesses whether the total royalties exceed the upper limit. If the total royalties exceed the upper limit, the re-editing unit removes part of the clip to reduce the total royalties to a level not exceeding the upper limit. US2002 / 082731 discloses a method of monitoring audio content during video broadcasting. According to the method, the audio bit stream from the video broadcast is received and the audio identification information is generated for the audio content in the audio data stream. It is determined whether the audio identification information generated for the received audio content corresponds to the audio identification information in the audio content database.
Summary [0012] The object claimed herein is set out in the claims.
[0013] An embodiment provides a computer implemented method for analyzing a media design defined by an editing tool. The method includes receiving the first file for a media project, defined by an editing tool, wherein the editing tool is a computer-implemented tool for carrying out audio and / or visual editing, and the media design includes multiple media elements in at least one of the many paths and project containers, and the first the file contains media content extracted from the media design media elements and metadata extracted from the media design media elements. The method further includes generating a second file containing the specified metadata, the specified metadata comprising metadata for identifying media elements for reporting to at least one agency system of rights holders. Generating a second file involves comparing the representation generated from media content, extracted from a particular one of many media elements, to compare the representations in a reference database to find a matching element, the reference elements in the database containing reference metadata. The method further includes, when the respective reference element in the reference database is identified, for which the representation generated from the content extracted from the specific media element matches the reference representation for the respective reference element, using, for specific metadata for a specific media element, associated reference metadata for the matched reference element and using for specific metadata for a specific media item, metadata for
- a specific media element extracted from the media design media elements. The method further includes outputting a second file.
[0014] The computer program product may include program code used to carry out the steps of such methods. The computer program product may include at least one computer readable medium, the computer readable medium comprising the program code. A system comprising one or several computer systems may be programmed to implement such methods.
Brief Description of the Drawings [0015] Embodiments of the invention are described below by way of example only with reference to the accompanying drawings.
Figure 1 is a schematic overview of the system in which an embodiment of the invention may be implemented.
Figure 2A is a block diagram of a client system;
Figure 2B is a block diagram representing the functional components of the client system.
Figure 3 is a schematic representation of the graphical interface of the editing tool.
Figure 4 is a block diagram representing the functional components of a data extraction module.
Figure 5 is a flowchart showing an exemplary flowchart of a data extraction module.
Figure 6A is a block diagram of a host system;
Figure 6B is a block diagram representing the functional components of a host system.
Figure 7 is a flowchart showing an exemplary flowchart of a host system.
Detailed description [0016] An embodiment of the invention allows the automatic selection and extraction of meta data and multimedia content from projects in an editing tool. An embodiment of the invention may provide for the automatic extraction of such data to identify, classify and manage such meta data and content, using automatic identification techniques, including, e.g., recognition of content patterns, e.g., audio and video content. An embodiment of the invention may facilitate the automatic tracking and centralized storage of meta data and content to meet legal requirements and for other purposes, and may also allow searching of organized meta data stored in a central database. Example
- the invention makes it possible to automatically extract meta data and multimedia content from the project in an editing tool in the client system and transfer them to the host system for processing, including, for example, creating a directive sheet containing times for multimedia files from measurements of meta data times in a file project to create times in the directive sheet.
[0017] As used herein, the term "data extraction module" refers to an application that is provided for an editing tool. Different versions of the data extraction module can be configured to gain access to meta data and content in a project created by the editor in a given editing tool. Each individual version of the data extraction module provides the same set of functions, although the respective versions are adapted to the meta data structure and content for each editing tool and platform on which the editing tool is implemented, for example OS X, Windows, Linux etc.
[0018] The data extraction module can be configured as an independent application (i.e. for use as an independent program) or it can be configured as a plug-in integrated with the menu structure of the editing tool in such a way that it can be run from the menu in the editing tool.
[0019] An embodiment of a system comprising a data extraction module may use pattern recognition to determine meta data and content from the design.
[0020] An embodiment of the invention is not based solely on file names and other meta data in the project in the editing tool, but can also work automatically to perform content analysis in the project, to automatically generate and / or automatically verify meta data. In an embodiment, pattern recognition is used to analyze the content. In one embodiment, for example, pattern recognition is used to enable automatic generation of the directive sheet as follows:
[0021] The data extraction module works to identify the content, e.g. audio content, in respective project multimedia files and to generate a data digest of the content of each multimedia file. The data extraction module generates an export file that contains a data abbreviation and meta data extracted from the project. The export file is then delivered to the host server. The host server works to compare the data hash (s) in the export file with the reference data hash stored in the source path database and related meta data using conventional and / or proprietary pattern recognition techniques to identify the meta data corresponding to the extracted content from the project. Meta data identified by comparing data abbreviations can be compared with meta data extracted from the project to verify meta data extracted from the project and can be added to the meta data extracted from the project to create a directive sheet that can be imported into the directive sheet view in reporting purpose to the copyright organization.
[0022] The current approach differs from conventional audio recognition systems, which listen to the soundtrack of the finished program (typically during its broadcasting), in which audio recognition for the purpose of reporting music is adapted to recognize music with superimposed layers and special effects, etc. imposed on her. The limitations of conventional techniques due to the need to take into account such additional "noise" affect the performance and accuracy of such audio recognition systems, and may exclude the use of such systems to accurately identify times of musical fragments with voice, muted, etc. In contrast, because the embodiment of the invention works on individual multimedia files in individual paths in the design, audio recognition can be more efficient and accurate. Also, the combination of audio recognition and project meta data on the times of multimedia content files in project paths allows more accurate determination of project times. The benefits provided by the embodiment of the invention apply to all types of multimedia, not just audio.
[0023] The embodiment is described in more detail, by way of example only, with reference to the drawings.
[0024] Figure 1 is a schematic representation of the overall system outline.
[0025] The system shown in Figure 1 comprises a host system 10 connected to a network 12, for example the Internet. The host system can be implemented by one or more computer system servers. The host system 10 is configured to access the reference database 20. The reference database 20 may be integrated with or separated from the host system 10. When the reference database 20 is separated from the host system 10, the reference database can be implemented by the computer database system and the host system 10 can be configured to access the reference database 20 directly or via the network 12. Figure 1 shows many client systems 30A and 30B. The client's system can be implemented by one or more computer systems. The client systems 30A are connected to network 12, and the client system 30B is a stand-alone system. The client system 30 includes an editing tool and a data extraction module that can operate to identify content in the respective project multimedia files, to generate abbreviations of the content content of each multimedia file and to create an export file to the host system 10. Figure 1 also shows many agency systems 14 that are connected to the network 12. The agency system 14 may be implemented by one or more computer servers and may be used by a copyright organization. Host 10 system works to receive and process files exported from client 30 systems. Processing involves comparing data hashes in the exported file with reference data hashes stored in the source path database and related meta data to identify the meta data corresponding to the extracted content from the project and
- 7 generating directive sheets to be presented in one or more agency systems 14.
[0026] Figure 2A is a block diagram of an exemplary configuration of client system 30. The client system may be implemented using one or more computer systems 300, each of which may contain conventional computer components including, for example, one or more 302 processors, 304 memory and 306 media, one or more 308 input devices, one or more displays 310, one or more communication interfaces 312, etc.
[0027] Figure 2B is a schematic representation of the functional components of the client system 30. As shown in Figure 2B, the client system 30 includes an editing tool 50. As previously mentioned, the editing tool 50 can be implemented as a computer tool for audio and / or video editing and / or for broadcasting purposes. The editing tool 50 may include computer program code stored in memory 304 and / or on media 306 in the client system 30. The computer editing program code of the tool 50 may operate when executed on one or more processors 302 to perform tasks defined by the editing tool program code. The term editing tool may include editing software for editing audio and / or video production (projects).
[0028] The client system 30 may also include a data extraction module 40. The data extraction module 40 may be implemented as a computer software product, for example as an application separate from the editing tool, or as a plug-in for the editing tool 50. The data extraction module 40 may include computer program code stored in memory 304 and / or on media 306 in the client system 30. The computer code for the data extraction module 40 may operate when it is executed on one or more processors 302 to perform the tasks defined by the data extraction code. The data extraction module 40 is configured to interact with the editing tool 50 to access the meta data and content stored in files in the project defined by the editing tool 50, taking into account the meta data structure and content for the editing tool and the platform on which the editing tool is implemented , for example OS X, Windows, Linux, etc.
[0029] The data extraction module 40 provides many different functions schematically represented by the control module 42, the analysis module 44, the file module 46 and the communication module 48. The control module 42 operates to control the operation of the data extraction module 40 and to access the meta data and content from the editing tool 50. In various embodiments, the data extraction module 40 may operate to access meta data and content from the editing tool 50, either directly or through one or more separation layers, for example, through the API provided by the editing tool 50. Control module 42 , analysis module 44, file module 46 and communication module 48 can be implemented as computer software (computer program code) stored in memory or on a carrier in
- a client system that can operate to control the client system processor (s) 300 to implement the process described with reference to Figure 5.
[0030] Figure 3 is a schematic representation of an example of a graphical display interface 60 whose display on the display 310 of the client system 30 may be caused by the computer program code of the example editing tool 50. The graphical display interface 60 may be used by the editor as a control interface to control editing tool 50. As shown at the top of Figure 3, the first and second boxes 62 are used to display video information during editing. Control field 61 is used to select projects for which the editor will work, and project field 63 displays project details. Project details are represented as a set of multimedia items in the form of tracks 64 containing content, for example video content 66 and audio content 67. Multimedia items can be stored as files or records in the memory 304 and / or on the 306 media of the client system 30. The project field 63 displays the content times in relation to the time line and a specific point in time can be identified by the time cursor 68. The editor has various available controls (e.g. via control buttons 69) to enter and view metadata about the content displayed in the project field 63.
[0031] Figure 4 is a block diagram of the functional components of the example of the editing tool 50. The editing tool includes a processing module 51 that includes a computer program code that designates the structure of files 53 stored in memory 304 and / or on the client system's 306 medium. Rendering module 52 includes computer program code that can operate to generate the graphical representation shown in Figure 3 based on a 53 file structure. As shown in Figure 4, the file structure includes one or more project items defining one or more projects. Each project item 54 identifies the project content. In the example shown, project position 54 identifies or indicates one or more sequence positions 55 relating to each project 54. In the example shown, each sequence position 55 identifies a plurality of tracks 56 with which multimedia positions are associated. In the example shown, each sequence position 55 identifies one or more multimedia positions 57 associated with the sequence and with respective tracks 56. The multimedia content of each multimedia position 57 may be video, image, text, audio. Each multimedia item 57 can be associated with one or more times in one or more tracks 56. In the example, the meta time data is stored at sequence position 55 together with pointers to content position 57. Figure 4 also shows a multimedia container 58 that contains multimedia position 57, e.g. multimedia content positions that have been deleted by the editor. It should be noted that the file structure shown in Figure 4 is only a schematic representation and that different editing tools implement the file structure in different ways.
[0032] File structure 53 may be implemented using appropriate files for identified items, using an object-oriented structure, using language
-9 tags, such as XML, or any other appropriate means. In fact, different editing tools implement the file structure in different ways.
[0033] The editing tool 50 may also include a communication module 59, which is configured to provide an interface to access the file structure 53. The communication module 59 may be in the form of a computer program code defining an application programming interface (API) .
[0034] As indicated, the processing module 51, rendering module 52 and communication module 58 may be implemented as computer software stored in memory 304 and / or on the client system carrier 306, computer software operating to control the client's processor (s). The file structure 53 may be stored in memory 304 and / or on client system media 306.
[0035] Figure 5 is a flowchart showing an example of operation 410 of the data extraction module 400.
[0036] Data extraction module 40 may be initiated in step 412 by the editor. If the data extraction module is configured as a plug-in for the editing tool 50, the data extraction module 40 can be initiated using the menu item in the editing tool 50. Alternatively, if it is implemented as a separate application, then the application can be initialized. The data extraction module 40 can alternatively be initiated automatically, e.g. by reaching a specific stage of the editing tool's operation. After initialization, the operation of the data extraction module is automatic.
[0037] In step 414, module 46 creates a project file for the project sequence.
[0038] The control module 42 then processes multimedia positions 57. In the example, as shown in Figure 5, the control module 42 performs loop 416 for each track 56 and within each track, extracts 418 each multimedia position 57.
[0039] If the control module 42 recognizes 420 that the data item 57 contains meta data, the file module 46 adds 422 meta data to the project file created in step 414.
[0040] If the control module 42 recognizes 424 that the data item 57 contains content, the analysis module 44 processes 426 the content to create a representation (e.g., a data hash) of the content, and the file module 46 adds 428 processed content to the file created in step 414. In one example, the analysis module 44 can operate to create a Fourier transform of the content as a representation of the content, and the Fourier transformation is then stored as a representation of the content in the export file. In other examples, other forms of processing may be used, e.g. processing may consist of directly generating meta data from the multimedia position. Content extracted from project 54 can also be stored in the project file instead of, or in addition to, the processed content. If the content is associated with meta data in project 57, the meta data can be associated with content and / or processed content in the project file.
[0041] The export file may be created using a markup language, for example XML.
[0042] If 430, there are more positions for the path, the method returns in a loop to step 420.
[0043] Otherwise, if 432 there are more paths for the project, the method returns in a loop to step 418.
[0044] Otherwise, in step 434, the communication module 48 exports the project file. The communication module 48 can operate digitally to encrypt the project file before export. Conventional encryption techniques can be used to encrypt a project file in such a way that the confidential information contained in it is kept confidential and counteracts the possibility of damage to the project file. The project file can be exported directly to the host system 10 if the client system (e.g. 30A client system) is connected to network 14. Alternatively, if the client system (e.g. 30B client system) is not connected to network 14, the export file can be converted (e.g. using a disk, USB stick, wired or wireless connection, or otherwise) to the client system 30A in such a way that it is connected to a network from which it can be forwarded to the host system 10 via network 14.
[0045] Figure 6A is a block diagram of an example of a host system configuration 10. The host system may be implemented as one or more computer servers 100, each of which may contain conventional computer components, including, for example, one or more processors 102, memory 104 and media 106, with one or more input devices 108, one or more displays 110, one or more communication interfaces 112, etc.
[0046] Figure 6B is a schematic representation of the functional components of the host system 10. The communication interface 62 provides a connection to the network 14, the processing module 64 provides processing of export files received from the client system 30, and the data structure 66 includes received client export files 68 and generated sheets Directives 70. Reference database 20 contains a file structure, including entries 210, defining content 214 and related meta data 212, as well as content representations 216 (e.g., content Fourier transforms). Processing module 64 may be implemented as computer software that can operate to control processors 102 of host system 10 to implement the methods described with reference to Figure 7. Data structure 66 can be stored in memory 104 and / or on media 106 on host system 10, or on media available on host system 10. Figure 6 also shows different versions of data extraction module 65 that can be stored in memory and / or on in the host system 10, so that the corresponding data extraction module for the client system 30 can be downloaded to the client system 30 on demand.
[0047] Figure 7 is a flowchart showing an example of the operation of the host system 10.
[0048] In step 72, the exported file 68 for the project or project sequence (hereinafter referred to as the project file with reference to Figure 7) is received by the processing module 64 from the client system and can be stored in memory or on the host system media 10.
-11 Processing module 64 can operate to decrypt a project file encrypted on the client system 30.
[0049] Processing module 64 then passes through loops 74 through entries in the project file 68.
[0050] Processing module 64 searches 78 database 20 using pattern recognition to determine if a match can be found to represent the content for a given item.
[0051] If the processing module 64 finds 80 equivalent, the meta data associated with the matching entry 210 in the database 20 can be compared with any meta data of the processed item (current item).
[0052] If the processing module 64 finds 82 that the current position in the project file does not contain any meta data, i.e. meta data that is no longer present in database 20, the processing module 64 uses 84 meta data 212 associated with the matching item in database 20 to create and / or update the directive 70 sheet for the project.
[0053] If the processing module 64 finds 82 meta data for the current position in the project file that is not found in database 20, the processing module adds new meta data to meta data 212, potentially by creating an additional meta data field or history field associated with matching entry in the database 20. Then, the processing module 64 uses new meta data and any existing meta data 212 for the matching item 210 in the database 20 to create and / or update the directive sheet 70 for the project.
[0054] If the processing module 78 did not find any match for the current position of the project file in database 20, the processing module 64 adds 90 content to the content representation and content, and any related meta data from the current position to the database as a new database entry . Processing module 64 uses 92 meta data from the current position of the project file to create and / or update the directive 70 sheet for the project.
[0055] If, after steps 84, 88 or 92, the processing module 64 finds 94 that there are more entries in the project file, the method returns to step 76 for the next entry. Otherwise, the method ends in step 96 and the directive sheet can be sent to the agency system 14.
[0056] In the above method, which refers to finding a match, the match may relate to the identification of the entire identity of the content, for example the identity of a particular recording, or may relate to the identification of details in the content. For example, pattern recognition can be used to identify the actor's face in a movie and identify the times in the movie where the actor appears. For example, the data abbreviation (representation) of the actor image can be stored in a reference database along with the actor's meta data. Similarly, the data summary (representation) of the project image can be stored in the reference database along with the meta
- 12 product identification data. In another example, the music data abbreviation (representation) can be stored in a reference database along with the music identification meta data. Other aspects of the design or project sequence can also be captured by the techniques described above. For example, information that identifies moods (e.g. colors, types of music or sound effects, expressions etc.) and aspects that may lead to the identification of product placement (e.g. themes, themes, etc.). The text corresponding to spoken words or images in the content can also be identified, music scores etc. can be generated. In this way, an embodiment of the invention can be used to identify details in a content item. Using the times and / or other meta data in the exported file from the client system, the processing module 64 of the host 10 system is then not only able to generate directive sheets, for example for copyright organizations, it can also be used, for example, to determine the value of receivables etc., potential product placement options, etc.
[0057] In summary, using an embodiment of the invention, the user launches the data extraction module application and browses the data extraction module dialog to find one or more project files created by the editing tool that stores essential information about the structure of a particular editing project. A project can contain multiple sequences, i.e. different editions of the same movie.
[0058] Different versions of the data extraction module may be provided, because different editing tools have different project file structures: from XML to FIAT files, from open to proprietary formats, XMP, binary, audio, video etc. Also, different editing tools have different organizations how the project-related multimedia files and content are stored, so that the right version of the data extraction module can select different meta data structures and multimedia files for each editing tool.
[0059] An example of a data extraction module may be configured to allow the user to choose to view, listen to multimedia files and meta data, and using a network of data extraction module operations to decide which parts of the meta data to export and how to export them.
[0060] For example, to create a music directive sheet, the user can listen to the music files used in the project, decide which files contain music, remove the superimposed voice and special effects tracks that are not musical and export one or more created files export to host system. In the example for an image: the user can go to details to view all still images used in the production and export of image data in one or more export files to the host system. In the example for GPS: you may want to create a list of GPS coordinates for all video clips used in production.
[0061] In one embodiment, the data extraction module creates a digital abbreviation of the audio track data in the project as described above and exports the resulting files, which are then exported, then matched and converted into a directive sheet. In other examples, other automated techniques may be included to recognize faces, images, voices, moods, product placement capabilities, etc.
[0062] Also, in the above description, data abbreviations (representations) of individual multimedia files provided in individual paths are generated. However, data shortcuts that are representative of multiple paths can also be generated and contained in exported files. In fact, a data summary of the complete project can be generated to represent the project, for example in the form to be broadcast. Such a summary of the data of part or all of the project or program can then be used to identify cases where the project or program is being broadcast.
[0063] An embodiment of the invention allows the extraction of information at a detailed and more specific level than is possible by means of the interfaces provided in conventional editing tools.
[0064] An embodiment facilitates the translation, organization and modification of meta data and content to various standards to provide information and content.
[0065] An embodiment of the invention allows for the automation of the identification method at the design editing stage, e.g. using pattern recognition technology on multimedia files in editing rather than in ready editing.
[0066] Aspects of the subject matter described herein are set out in the following numbered paragraphs:
1. A computer-implemented method of generating a metadata record representative of media content from at least one sequence of at least one project from at least one editing tool, and the editing tool defines the project by saving the media content of the project sequence on multiple paths and / or project containers and saving metadata about project sequence, the method comprising in the first system:
extracting saved metadata from the project sequence;
extracting saved media content from at least one track and / or project container project sequence;
processing the extracted media content to generate a representation of the extracted media content; and producing an output signal comprising the extracted metadata and a representation of the extracted media content.
2. The method of item 1, comprising realizing the pattern recognition of the stored reference data using the extracted representation
-14 media content for determining metadata identifying extracted media content.
3. The method of item 2, wherein the representation of the extracted media content is a Fourier transform of the extracted media content and wherein the processing comprises generating a Fourier transform of the extracted media content.
4. The method according to item 2 or item 3, wherein the recorded reference data contain representations of relevant reference works, each of which is associated with metadata identifying reference works.
5. The method according to item 4, wherein the recorded reference data contain Fourier transforms of respective reference works, each of which is associated with metadata identifying reference works.
6. The method of any of items 3 to 5, wherein generating the output comprises generating a file containing extracted metadata and specific metadata identifying media content.
7. The method of item 1, wherein producing the output signal comprises generating a file containing the extracted metadata and representation of the extracted media content.
8. The method of item 7, wherein the output signal comprises transmitting the extracted metadata and representing the extracted media content to a second computer system.
9. The method of item 8, wherein the output signal comprises encrypting the extracted metadata and representation of the extracted media content before sending to a second computer system.
10. The method according to item 8 or item 9, comprising performing pattern recognition in a second computer system regarding stored reference data using a representation of the extracted media content to determine metadata identifying the extracted media content.
11. The method of item 10, wherein the representation of the extracted media content is a Fourier transform of the extracted media content and wherein the processing comprises generating a Fourier transform from the extracted media content.
12. The method according to item 10 or item 11, wherein the recorded reference data contain representations of respective reference works, each of which is associated with metadata identifying reference works.
13. The method according to item 12, wherein the recorded reference data contain Fourier transforms of respective reference works, each of which is associated with metadata identifying reference works.
-1514. The method of any of items 11 to 13, wherein generating the output comprises generating a metadata record file containing extracted metadata and specific metadata identifying media content.
15. The method of any of the preceding points, wherein the recorded media content comprises at least one of audio, text, image and video.
16. The method according to any of the preceding points, wherein the metadata contains metadata identifying the owner of the rights to the saved media content.
17. The method according to any of the previous points, wherein the representation of the extracted media content includes a representation of one or more faces, images, voices, moods, product placement options, multiple project paths, complete project.
18. The method according to item 8 or item 9, comprising realizing pattern recognition in a second computer system regarding stored reference data using a representation of the extracted media content, and in the absence of matching, updating the stored reference data.
19. The method according to any of the previous points, wherein the metadata record includes a directive sheet.
twenty. A directive sheet, generated using any of the previous points.
21. A computer program product containing a program code that is executable for carrying out the method steps according to any one of items 1 to 19.
22. The computer program product of item 21 comprising at least one computer readable medium, the computer readable medium implementing the program code.
23. The data extraction module for the first computer system, which contains a processor and memory, and is configured to implement an editing tool, and the editing tool is implemented to define the project using the saved media content of at least one sequence of at least one project on multiple paths and / or project containers and saved metadata about the project sequence, with the data extraction module being configured to:
extracting saved metadata from the project sequence;
extracting stored media content from at least one track and / or project container project sequence;
processing extracted media content to generate a representation of the extracted media content; and producing an output signal comprising the extracted metadata and a representation of the extracted media content.
-1624. The data extraction module according to item 23, wherein the representation of the extracted media content is a Fourier transform of the extracted media content and wherein the data extraction module comprises a processing module configured to process the extracted media content by generating a Fourier transform of the extracted media content.
25. The data extraction module according to item 23 or item 24, comprising an output module configured to produce an output signal by generating a file containing the extracted metadata and a representation of the extracted media content.
26. The data extraction module according to any one of items 23 to 25, comprising an output module configured to produce an output signal by transmitting the extracted metadata and representing the extracted media content to a second computer system.
27. The data extraction module according to any one of items 23 to 26, wherein the recorded media content comprises at least one of audio, text, image and video.
28. The data extraction module according to item 26 or item 27, wherein the output module is configured to encrypt the extracted metadata and represent the extracted media content before being sent to the second computer system.
29. The data extraction module according to any of points 23 to 28, where the representation of the extracted media content includes a representation of one or more faces, images, voices, moods, product placement options, multiple project paths, a complete project.
thirty. A system comprising a first computer system comprising a processor and memory, the first computer system implementing an editing tool and the editing tool being executable to define the project using the saved media content of at least one sequence of at least one project on multiple paths and / or project containers, and saved metadata about the project sequence, the first computer system further includes at least one data extraction module, configured to:
extracting saved metadata from the project sequence;
extracting saved media content from at least one project path and / or project container;
processing extracted media content to generate a representation of the extracted media content; and producing an output signal comprising the extracted metadata and a representation of the extracted media content.
-1731. The system of item 30, wherein the data extraction module is configured to produce an output signal by sending the extracted metadata and representation of the extracted media content to a second computer system.
32. The system of item 31, wherein the data extraction module is configured to produce an output signal by generating a file containing the extracted metadata and representation of the extracted media content, and transferring the file to a second computer system.
33. The system according to item 32, wherein the data extraction module is configured to encrypt the file before sending to the second computer system.
34. The system according to any of items 31 to 33, further comprising a second computer system, wherein the second computer system is configured to perform pattern recognition regarding the stored reference data using a representation of the extracted media content to determine metadata identifying the extracted media content.
35. The system of item 34, wherein the second computer system is executable if pattern recognition in the second computer system regarding the stored reference data using a representation of the extracted media content does not identify a match for updating the stored reference data.
36. The system according to any of items 30 to 35, wherein the representation of the extracted media content is a Fourier transform of the extracted media content and wherein the data extraction module is configured to process the extracted media content, including generating a Fourier transform of the extracted media content.
37. The system according to any of items 34 to 36, whereby the recorded reference data contain representations of relevant reference works, each of which is associated with metadata identifying reference works.
38. The system according to item 37, wherein the recorded reference data contain Fourier transforms of respective reference works, each of which is associated with metadata identifying reference works.
39. The system according to any of items 30 to 38, wherein generating the output comprises generating a metadata record file containing extracted metadata and specific metadata identifying media content.
40. The system according to any of items 30 to 39, wherein the recorded media content comprises at least one of audio, text, image and video.
41. The system according to any of items 30 to 40, wherein the metadata contains metadata identifying the owner of the rights to the saved media content.
-1842. The data extraction module according to any of the points 30 to 41, where the representation of the extracted media content includes a representation of one or more faces, images, voices, moods, product placement options, multiple project paths, complete project.
43. The system according to any of items 30 to 44, wherein the system is executable for generating a metadata record in the form of a directive sheet.
[0067] Although particular embodiments and implementations have been described, it should be noted that they are provided by way of example, and that other embodiments and implementations within the scope of the claims can be envisaged.
15 members in 4 offices
Priority claims6
| Document | Office | Kind | Date |
|---|---|---|---|
| 25022709 | United States of America | P | |
| 10186994 | European Patent Office (EPO) | A | |
| 14162490 | European Patent Office (EPO) | A | |
| EP20100186994 | – | – | – |
| EP20140162490 | – | – | – |
| US20090250227P | – | – | – |
Members15
| Document | Office | Kind | |
|---|---|---|---|
| EP2317517A1 | European Patent Office (EPO) | A1 | |
| US2012089643A1 | United States of America | A1 | |
| US2013024476A9 | United States of America | A9 | |
| US8521779B2 | United States of America | B2 | |
| US2013311512A1 | United States of America | A1 | |
| US2013311522A1 | United States of America | A1 | |
| EP2317517B1 | European Patent Office (EPO) | B1 | |
| EP2750135A2 | European Patent Office (EPO) | A2 | |
| EP2750135A3 | European Patent Office (EPO) | A3 | |
| PL2317517T3 | Poland | T3 | |
| US8924423B2 | United States of America | B2 | |
| US8924424B2 | United States of America | B2 | |
| EP2750135B1 | European Patent Office (EPO) | B1 | |
| DK2750135T3 | Denmark | T3 | |
| PL2750135T3This record | Poland | T3 |
Numbers
- Publication, DOCDB
- 2750135
- Publication, EPODOC
- PL2750135T
- Application
- 20140162490
- Application, DOCDB
- 14162490
- Application, EPODOC
- PL20140162490T
Titles2
- English
- Metadata record generation
- Polish
- Generowanie zapisu meta danych