Automatic digital music library builder
Abstract
A digital music library builder including an analog-to-digital converter for converting analog audio into digital audio, an optical character processor for recognizing characters within an image, a meta-data extractor for identifying meta-data for a song within the recognized characters, an audio parser for marking the start and end of a song within the digital audio, and a database manager for associating the identified meta-data with the marked song, within a digital music library. A method is also described and claimed.

Term
Term ended
Expired 29 December 2023, 2.7 years ago.
- Priority
- Filed
- Granted
- Expired
- Today
66 claims: 6 independent, 60 dependent
- 1A digital music library builder (710) comprising:an analog-to-digital converter (325) for converting analog audio for a current song, received from a broadcast source (305, 320, 720, 770), into digital audio for the current song;an optical character processor (350) for recognizing characters within a video frame related to and received simultaneously with the current song;a meta-data extractor (355), coupled with said optical character processor, for identifying meta-data for the current song within the recognized characters;an audio parser (335), coupled with said analog-to-digital converter, for filtering out non-musical portions from the digital audio, and for marking the beginning and the ending of the current song within the digital audio;a database manager, coupled with said meta-data extractor and with said audio parser, (i) for selectively storing the filtered song within a digital music library (340), (ii) for associating the identified meta-data with the filtered song, within the digital music library (340), (iii) for maintaining a counter indicating the number of times the same song is received from the broadcast source, and (iv) for associating the counter with the filtered song, within the digital music library (340);and a digital rights manager for restricting access to the filtered song from the digital music library by digital music players, based on the counter associated with the filtered song.
- 26A method for building a digital music library, comprising:converting analog audio (410) for a current song, received from a broadcast source (405), into digital audio for the current song;recognizing characters (430) within a video frame related to and received simultaneously with the current song;identifying meta-data (435) for the current song within the recognized characters;filtering out non-musical portions from the digital audio;marking the beginning and the ending (445) of the current song within the digital audio;selectively storing (455) the filtered song within a digital music library;associating (460) the identified meta-data with the filtered song, within the digital music library;maintaining a counter indicating the number of times the same song is received from the broadcast source;associating the counter with the filtered song, within the digital music library;and restricting access to the filtered song from the digital music library by digital music players, based on the counter associated with the filtered song.
- 49A computer readable medium containing executable computer program instructions which, when executed on a processing system, cause the processing system to perform a method comprising:converting analog audio (410) for a current song, received from a broadcast source (405), into digital audio for the current song;recognizing characters (430) within a video frame related to and received simultaneously with the current song;identifying meta-data (435) for the current song within the recognized characters;filtering out non-musical portions from the digital audio;marking the beginning and the ending (445) of the current song within the digital audio;selectively storing (455) the filtered song within a digital music library;associating (460) the identified meta-data with the filtered song, within the digital music library;maintaining a counter indicating the number of times the same song is received from the broadcast source;associating the counter with the filtered song, within the digital music library;and restricting access to the filtered song from the digital music library by digital music players, based on the counter associated with the filtered song.
- 50A digital music library builder comprising:an optical character processor (350) for recognizing characters within a video frame related to and received simultaneously with a digital audio signal;a meta-data extractor (355), coupled with said optical character processor, for identifying meta-data for the current digital audio signal within the recognized characters;an audio parser (335) for filtering out non-musical portions from the digital audio signal, and for marking the beginning and the ending of a current song within the digital audio signal;and a database manager, coupled with said metadata extractor and said audio parser, for selectively storing the filtered song within a digital music library (340), and for associating the identified meta-data with the filtered song, within the digital music library (340);for maintaining a counter indicating the number of times the same song is received from the broadcast source, and for associating the counter with the filtered song, within the digital music library (340);and a digital rights manager for restricting access to the filtered song from the digital music library by digital music players, based on the counter associated with the filtered song.
- 58A method for building a digital music library, comprising:recognizing characters (430) within a video frame related to and received simultaneously with a digital audio signal;identifying meta-data (435) for the current digital audio signal within the recognized characters;filtering out non-musical portions from the digital audio signal;marking the beginning and the ending (445) of a current song within the digital audio signal;selectively storing (455) the filtered song within a digital music library;and associating (460) the identified meta-data with the filtered song, within the digital music library;maintaining a counter indicating the number of times the same song is received from the broadcast source;associating the counter with the filtered song, within the digital music library (340);and restricting access to the filtered song from the digital music library by digital music players, based on the counter associated with the filtered song.
- 66A computer readable medium containing executable computer program instructions which, when executed on a processing system, cause the processing system to perform a method comprising:recognizing characters (430) within a video frame related to and received simultaneously with a digital audio signal;identifying meta-data (435) for the current digital audio signal;within the recognized characters;filtering out non-musical portions from the digital audio signal;segmenting marking the beginning and the end (445) of a current song within the digital audio signal;selectively storing (455) the filtered song within a digital music library;and associating (460) the identified meta-data with the filtered song, within the digital music library;maintaining a counter indicating the number of times the same song is received from the broadcast source;associating the counter with the filtered song, within the digital music library (340);and restricting access to the filtered song from the digital music library by digital music players, based on the counter associated with the filtered song.
Independent claims6
70 paragraphs in 5 sections, as filed
FIELD OF THE INVENTION
0001The present invention relates to automatic generation of digital music libraries, such as MP3 libraries.
BACKGROUND OF THE INVENTION
0002Digital music players are proliferating as standalone consumer electronic devices, such as MP3 players, as bundled components within portable devices such as personal data assistants (PDAs) and cell-phones, and as home network appliances. Listeners typically build up their own personal libraries of digital songs, which are stored on memory units such as hard disk drives and removable memory cards. Digital songs are typically acquired through the Internet via subscription services and peer-to-peer exchanges, or by converting songs from a compact disc (CD) into a library.
0003Digital songs typically include audio data and peripheral data, referred to as meta-data, used to index the songs within the listener's library. For example, within an MP3 file meta-data is accessed through an ID3Tag. By indexing the songs, a listener can search his library and access individual songs therein. Typically audio players provide a user interface through which users view meta-data.
0004Reference is now made to <figref idref="f0001">FIG. 1</figref>, which is a prior art illustration of a user interface for a Windows media player, indicating meta-data displayed within a window frame 110, and an index for accessing individual songs, displayed within a window frame 120.
0005Building up a digital music library requires a lot of work. Typically, the listener first searches the Internet for one or more songs of interest, identifies locations of the songs, and downloads them into a database associated with a media player. Songs are typically stored as digital files, formatted in compliance with a standard format, such as MP3 or WMA. Once the songs are downloaded, the listener typically uses software such as Windows Media player (WMP) or Winamp to play the songs on a computer, or alternatively he uses a hardware device, such as an Ipod or MPEG player, to play the songs. WMA files embed meta-data within the files, and also within the filenames themselves.
0006Often individuals spend nights on end downloading their favorite songs and building their own personal music libraries. Downloading music files from the Internet may infringe copyrights, unless the files are obtained through a service that pays royalties to the recording industry.
0007A shortcoming in the digital music world is the large effort required to build custom music libraries. An alternative is to either purchase libraries that have been prepared by others, but often someone else's library does not match a listener's taste, and he prefers to collect his own favorite songs.
0008A popular source for a listener to hear his favorite songs is on music stations. Cable, satellite broadcast and the Internet provide music channels for almost every genre of music-classical music, rock and roll, jazz, music of the 80's, etc. A listener can enjoy music according to his taste by subscribing to such broadcast services.
0009Ideally, a listener building up his personal digital music library would like to be able to record his favorite songs from such broadcast services. However, raw audio recording from a music station does not contain the meta-data necessary to incorporate such songs into a digital music library. Using today's technology, a listener has no choice but to painstakingly label each such song recorded from a music station with appropriate meta-data-a process that can last hours in order to build even a modest library with a few hundred songs.
0010<patcit id="pcit0001" dnum="EP1016991A2"><text>EP 1016991 (A2</text></patcit>) discloses that by moving image analysis, acoustic/speech analysis, or text analysis of multimedia information in a database, feature data representing the type of information is acquired, and the feature data is stored into a database added to the multimedia information. A search engine extracts partial images of user's interest from the multimedia information on the basis of the feature data and a user profile data. A link section associates the representative images of the partial images with multimedia images and displays the list of representative images and feature data. Thus, only a portion of the user's concern is extracted from an enormous amount of multimedia information, and individual information is selectively provided in units of users.
0011<patcit id="pcit0002" dnum="WO0007310A"><text>WO 00/07310</text></patcit> discloses a system that automatically captures one or more local news program broadcasts and separates the broadcasts into the individual news stories or segments. The system then compares the stories to historical data concerning the competitive characteristics of the stories for each station and determines the topic (local, national, crime, etc.), talent (newscaster 1, newscaster 2, etc.) and production (live, studio, voice-over-tape, etc.) characteristics of the stories. Other characteristics that affect the popularity and therefore the competitive characteristics of the broadcasts can also be displayed, such as pacing, average story length, news-to-advertisement ratio, broadcast ordering (news then weather then news then sports, etc.), etc.; The characteristics are displayed in a visual format, such as a graph, with other historical data, such as show ratings that can be divided into increments such as 1/4 hour, and optionally with the actual video/audio broadcast allowing assessment of competitors local news broadcasts.
0012<patcit id="pcit0003" dnum="WO0045291A"><text>WO 00/45291</text></patcit> discloses that for use in video text analysis system, a video processing device for searching video streams for one or more user-selected image text attributes. The video processing device comprises an image processor capable of detecting and extracting image text from video frames, determining attributes of the extracted image text, comparing the extracted image text attributes and the user-selected image text attributes, and, if a match occurs, modifying, transferring, and labelling at least a portion of the video stream in accordance with user commands. The invention uses the user-selected image text attributes to search through an archive of video clips to locate particular types of events, such as news programs or sports events, locate programs featuring particular persons or groups, locate programs by name, save or remove all or some commercials, and to otherwise sort, edit, and save all of, or portions of, video clips according to image text that appears in the frames of the video clips.
SUMMARY OF THE INVENTION
0013The present invention enables a listener to easily build a digital library of music, which is cataloged and easily accessible for personal playback. The present invention provides a solution for the tens of millions of households in the U.S. and around the world that receive, either through digital cable or over Direct Broadcast Satellite (DBS) transmissions, music channels such as Music Choice, DMX and other commercial free music services. Such music channels are currently broadcast as video and audio channels in which the audio feed includes a song being played, and typically the simultaneous video feed has information about the song, its artists, and the label whose song is being broadcast.
0014In a preferred embodiment, a device utilizing the present invention, referred to hereinafter as a "Family Music Center," is connected to a digital cable box or digital satellite receiver, in the same fashion that a video cassette recorder (VCR) or personal video recorder (PVR) is connected; namely, by connecting the left and right audio and video outputs of the receiver to the device. Preferably, the Family Music Center has the ability to record and to playback by category, much like a PVR. Whereas a PVR relies on data received through an electronic program guide to identify what it is recording, and to name the recorded shows, the Family Music Center utilizes information in the video portion of the broadcast to identify what is being recorded.
0015In a preferred embodiment, the Family Music Center allows a listener to record in either "record all" mode or "selective mode". In "record all" mode the listener sets his receiver to a music channel broadcasting a genre of music that he enjoys, and then he presses a record button on the Family music Center. The Family music Center then records and categorizes all songs played during the recording period, until the listener either stops the recording process by pressing stop on the Family music Center, or changes the channel on his receiver.
0016In a preferred embodiment of the present invention, the Family music Center records each song once, and, if a song is broadcast more than once, the Family music Center marks the song as being virtually recorded an additional time, for each time the song is re-broadcast. It may thus be appreciated that in this fashion the Family music Center builds a personal digital music library for the listener. Assuming that an average song lasts approximately three minutes and assuming a 25% re-broadcast rate, it may be appreciated that the Family music Center records approximately 360 songs during a typical 24 hour day of operation. Thus in approximately a one week period of recording day and night, the Family Music Center builds a library of over 2,500 songs, if left on one specific genre channel. In many cases a listener records only at night when he is asleep, since the recording process requires the receiver to be set to a music channel while recording, and if the listener wants to watch television he will inherently change the viewing channel from the music channel. Thus in a household with average daily television viewing, a library of over 2,500 songs for a specific genre is built by the Family Music Center within two weeks.
0017In "selective mode" the Family Music Center is set to record a specific artist or song, and then when that artist or song is broadcast the Family Music Center records the music. The "selective mode" is most useful if the desired song or artist is played frequently on one of the genre channels. If the desired song or artist is less frequently played there is no guarantee that the Family Music Center will record the music.
0018Songs recorded on the Family Music Center can be heard in a number of different fashions. A convenient way to listen to songs on the Family Music Center in a listener's living room is to connect audio out of the Family Music Center to an amplifier and stereo system, and to connect video out to a television. The listener can then choose, either through a front panel interface, or by remote control through a television interface, songs that he would like to listen to. The listener can create play lists, or choose to listen to songs in the order they were played by the broadcast music channel.
0019In addition to listening to the songs on the Family Music Center, in a preferred embodiment of the present invention, the listener can "check out" a set of songs to a hand-held digital music player, referred to as a "Music Capsule," which can be plugged into one or more docking ports on the Family Music Center. When the listener has finished listening to songs on his Music capsule, he preferably sets his Music Capsule back into a cradle on the Family Music Center. in order to check-in songs that are no longer being listened to on that specific player, and check out new songs for new listening.
0020According to the invention, the Family Music Center incorporates digital rights management with songs recorded, thereby preventing a listener from freely making unlimited copies of the recorded songs. Preferably, a listener is limited to check out of a specific song to the total number of times that that song was broadcast to the Family Music Center.
0021In a preferred embodiment of the present invention, the Family Music Center includes a unit having a hard disk for storage of songs, an audio/video encoding and decoding platform, an on screen display component, front panel navigation buttons and scroll wheel, an LCD panel, and various eternal interfaces including audio/video jacks, USB, Firewire, and power jacks. In addition the main Family Music Center unit preferably includes four sockets that comprise a docking station for four Music Capsules. Preferably, the sockets have leads to both re-charge the Music Capsules and to transfer songs to and from the Music Capsules. The Family Music Center preferably receives analog audio and video from the listener's receiver, and encodes both the audio and video signal in real-time. The video portion of the signal is analyzed in order to extract artist name, song name, and label and year from the video broadcast, for categorization purposes. The analog audio is preferably encoded separately from the video.
0022There is thus provided a digital music library builder including an analog-to-digital converter for converting analog audio into digital audio, an optical character processor for recognizing characters within an image, a meta-data extractor for identifying meta-data for a song within the recognized characters, an audio parser for marking the start and end of a song within the digital audio, and a database manager for associating the identified meta-data with the marked song, within a digital music library.
0023There is further provided a method for building a digital music library, including converting analog audio into digital audio, recognizing characters within an image, identifying meta-data for a song within the recognized characters, marking the start and end of a song within the digital audio, and associating the identified meta-data with the marked song, within a digital music library.
0024There is further provided a computer readable medium containing executable computer program instructions which, when executed on a processing system, cause the processing system to perform a method including converting analog audio into digital audio, recognizing characters within an image, identifying meta-data for a song within the recognized characters, marking the start and end of a song within the digital audio, and associating the identified meta-data with the marked song, within a digital music library.
0025There is additionally provided in accordance with a preferred embodiment of the present invention an automatic music library builder including a housing including a USB port for transferring data to and from a computer, audio connectors for receiving analog audio, video connectors for receiving a video frame, video frame capture circuitry located within the housing, for capturing a video frame received by the video connecters, an analog to digital audio converter located within the housing, for converting the analog audio to digital audio, an audio digital signal processor located within the housing, for converting the digital audio into a digital music format, and a processor located within the housing, for extracting meta-data for a song from the captured video frame.
0026There is moreover provided in accordance with of the present invention a digital music library builder including an optical character processor for recognizing characters within an image, a meta-data extractor for identifying meta-data for a song within the recognized characters, an audio parser for marking the start and end of a song within a digital audio signal, and a database manager for associating the identified meta-data with the marked song, within a digital music library.
0027There is further provided in accordance with the present invention a method for building a digital music library, including recognizing characters within an image, identifying meta-data for a song within the recognized characters, marking the start and end of a song within a digital audio signal, and associating the identified meta-data with the marked song, within a digital music library.
0028There is yet further provided in accordance with the present invention a computer readable medium containing executable computer program instructions which, when executed on a processing system, cause the processing system to perform a method including recognizing characters within an image, identifying meta-data for a song within the recognized characters, marking the start and end of a song within a digital audio signal, and associating the identified meta-data with the marked song, within a digital music library.
0029There is additionally provided in accordance with the present invention an automatic music library builder including a housing including audio connectors for receiving digital audio, video connectors for receiving a video frame, video frame capture circuitry located within the housing, for capturing a video frame received by the video connectors, an audio digital signal processor located within the housing, for converting the digital audio into a digital music format, and a processor located within the housing, for extracting meta-data for a song from the captured video frame.
0030There is moreover provided in accordance with a preferred embodiment of the present invention an automatic music library builder including a housing including audio connectors for receiving digital audio, a camera interface for receiving an image from a camera, an audio digital signal processor located within the housing, for converting the digital audio into a digital music format, and a processor located within the housing, for extracting meta-data for a song from the image.
BRIEF DESCRIPTION OF THE DRAWINGS
0031The present invention will be more fully understood and appreciated from the following detailed description, taken in conjunction with the drawings in which: <ul id="ul0001" list-style="none" compact="compact"><li><figref idref="f0001">FIG. 1</figref> is a prior art illustration of a user interface for a Windows media player, indicating meta data and an index for accessing individual songs displayed;</li><li><figref idref="f0002">FIG. 2</figref> is a sample video frame displaying meta-data for a song, for processing in accordance with a preferred embodiment of the present invention.</li><li><figref idref="f0003">FIG. 3</figref> is a simplified block diagram of a digital music library builder, in accordance with a preferred embodiment of the present invention;</li><li><figref idref="f0004">FIG. 4</figref> is a simplified operational flow chart for building a digital music library, in accordance with a preferred embodiment of the present invention;</li><li><figref idref="f0005">FIG 5</figref> is a simplified perspective view of a Music Capsule, in accordance with a preferred embodiment of the present invention;</li><li><figref idref="f0006 f0007 f0008 f0009 f0010 f0011 f0012">FIGS. 6A - 6G</figref> are simplified perspective views of a Family Music Center, in accordance with a preferred embodiment of the present invention; and</li><li><figref idref="f0013">FIG. 7</figref> is a simplified block diagram illustrating interconnectivity of an automatic music library builder with other devices, in accordance with a preferred embodiment of the present invention.</li></ul>
DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT
0032The present invention enables a listener to automatically import songs recorded from a broadcast music station into his digital music library, along with the songs' meta-data required for indexing his library. Using the present invention a listener, with practically no effort, can automatically build a large digital music library with tens of thousands of his choice of songs, all properly indexed for search and retrieval.
0033Moreover, an additional feature of the present invention enables the listener to select which songs from among those broadcast on the music stations are to be imported into his library, based on one or more of genre, song title, artist, album, length of song, and other criteria.
0034The present invention concerns a method and system for automatically building digital music libraries, from music channels broadcast through cable and satellite stations. In a preferred embodiment of the present invention, broadcast songs are recorded into a digital music library along with meta-data necessary for indexing and accessing each individual song, and for display while playing the songs. Using the present invention, the digital music library generated from the broadcast music serves as a large library of individual songs, with full search capability.
0035Reference is now made to <figref idref="f0002">FIG. 2</figref>, which is a sample video frame 210 displaying meta-data for a song, for processing in accordance with a preferred embodiment of the present invention. Video frame 210 is broadcast by satellite to listeners of the "Music Choice" station. Video frame 210 is typically displayed on a listener's television while live music is being broadcast. As shown in <figref idref="f0002">FIG. 2</figref>, the listener has selected a genre for songs of the 80's, and is currently listening to a song entitled "Like a Virgin" by the artist "Madonna," from an album entitled "Like a Virgin." The various descriptive data associated with a song is referred to as "meta-data;" i.e., descriptive data about the digital audio data itself.
0036The present invention provides a system that enables the listener to automatically digitally record each broadcast song into a digital music library, and index each song according to genre, song title, artist and album title, as described hereinbelow. Additionally, the present invention enables the listener to pre-select songs to be automatically recorded, by specifying inter alia a genre, song tile or artist, instead of recording all of the broadcast songs. The listener need not be present while the system of the present invention is in operation. It may thus be appreciated that the present invention enables automatic generation of large libraries of songs.
0037Reference is now made to <figref idref="f0003">FIG. 3</figref>, which is a simplified block diagram of a digital music library builder, in accordance with a preferred embodiment of the present invention. Shown in <figref idref="f0003">FIG. 3</figref> is a broadcast station 305, broadcasting cable or satellite entertainment to a home 310. The broadcast entertainment is received within home 310 by a satellite or cable receiver 315, and played to a home viewer though his television 320, or other display device.
0038In accordance with a preferred embodiment of the present invention, the audio output of television 320 is converted from analog to digital by an A/D converter 325. The converted digital audio is written to a memory buffer 330. A song extractor 335 analyzes the digital audio and marks the beginnings and ends of individual songs. Preferably, song extractor 335 filters out non-musical portions from the digital audio, such as pure speech. Each such song marked by song extractor 335 is written to a digital music library 340, which is a storage device such as a hard drive, and subsequently flushed from memory buffer 330.
0039In accordance with the present invention, a video frame grabber 345 captures a video frame being displayed on television 320, such as video frame 210 illustrated in <figref idref="f0002">FIG. 2</figref>. An optical character recognizer 350 extracts characters from the video frame, such as the characters in video frame 210. A meta-data generator 355 identifies meta-data associated with a current song, within the extracted characters, such as a genre, song title, artist name and album title within video frame 210. The meta-data identified by meta-data generator 355 is then written to digital music library 340, and linked to the corresponding song.
0040In a preferred embodiment of the present invention, the overall process through which meta-data is extracted from the video portion of the audio/video broadcast is as follows. A number of frames are captured from the video broadcast by station 305, preferably between 10 and 20 frames per song. The captured frames are processed using image processing algorithms, so as to create a clear image of a desired region of the screen. The clarified image is cropped according to a pre-determined template, so as to specify the location of relevant data on the screen. Preferably, such template is generated by analyzing screens from multiple songs, so as to establish a pattern. The resulting cropped image is preferably transformed into a two-tone black and white image. The black and white image is processed through optical character recognizer 350 and relevant meta-data is extracted by meta-data extractor 355.
0041In a preferred embodiment of the present invention, extracted meta-data is verified with an internal CD database, such as the Gracenote database, to ensure accuracy.
0042It may be appreciated by those skilled in the art, as indicated in <figref idref="f0003">FIG. 3</figref> by use of dashed lines, that the audio signal and video frame may be extracted from cable or satellite receiver 315, instead of from television 320. Furthermore, when cable or satellite receiver 315 includes an optical or coaxial connection for audio out, then digital audio can be extracted directly, without the need for A/D converter 325.
0043In accordance with a preferred embodiment of the present invention, songs broadcast by station 305 can be selectively imported into digital music library 340, filtered according to meta-data. Criteria based on one or more meta-data including inter-alia genre, song title, artist name, album title and length of song, can be used to filter songs to be imported from among all of the broadcast songs. Preferably, a memory buffer is used to record a song while a determination is being made whether or not to filter the song.
0044In accordance with a preferred embodiment of the present invention, songs already included within digital music library 340 are not overwritten, unless the listener expressly instructs the system to overwrite.
0045Reference is now made to <figref idref="f0004">FIG. 4</figref>, which is a simplified operational flow chart for building a digital music library, in accordance with a preferred embodiment of the present invention. At step 405 an analog audio signal is received from a television. At step 410 the analog signal is converted to digital audio, the digital audio being stored in a memory buffer at step 415.
0046At step 420 the start of a song is determined, and used to trigger capture of a video frame from a television, or from a cable receiver or from a satellite receiver, at step 425. At step 430 character recognition is applied to recognize characters in the captured video frame, and at step 435 meta-data is identified from the recognized characters. Preferably, a template for the captured video frame is used as an aid in steps 430 and 435. For example, a template corresponding to video frame 210 from <figref idref="f0002">FIG. 2</figref> may indicate an area of the image in which relevant meta-data appears. At step 440 the identified meta-data is written to a digital music library.
0047At step 445 the digital audio stored in the memory buffer is analyzed to mark the beginnings and ends of individual songs. At step 450 the end of a song is determined, which is used to trigger copying the song into the digital music library and subsequently flushing the memory buffer at step 455.
0048At step 460 the corresponding song and meta-data are linked to one another, so as to index the songs in the digital music library.
0049Due to interlacing on the television screen, it may be necessary to capture more than one video frame at step 425 in order to be able to extract the meta-data for the song being broadcast. Multiple frames can be averaged in order to enhance the appearance of characters prior to recognition step 430.
0050Alternatively, to enhance characters prior to recognition step 430. the luminance component of the one or more color video frames can be extracted. Extraction of luminance serves to remove color burst noise that degrades performance of optical character recognition.
0051It may be appreciated by those skilled in the art that the steps in <figref idref="f0004">FIG. 4</figref> may be performed in a different order than as numbered in <figref idref="f0004">FIG. 4</figref>. Thus steps 405, 410 and 415 for the audio processing may be performed before or after or simultaneous with steps 420, 425, 430, 435 and 440 for the video processing.
0052The present invention is preferably embodied in a programmable device that can interface with computers, with MP3 players and other digital music players, and with other electronic devices that include MP3 players therewithin including inter alia cell phones, PDAs, home network appliances and Internet appliances. In a first embodiment, the device of the present invention interfaces with satellite / cable receiver 315 (<figref idref="f0003">FIG. 3</figref>). In a second embodiment, the device of the present invention interfaces with television 320. In a third embodiment, the device of the present invention interfaces with various external components via a USB and a Firewire connection.
0053In both embodiments, the memory storing digital music library 340 can be either a large hard disk situated within the device itself; or one or more smaller removable memory units such as compact disks and memory cards; or a combination of hard disk and removable memory. The advantage of a large hard disk is that the listener's music library is consolidated into a single library that can be searched and accessed in its entirety. The advantage of removable memory units such as compact disks, is that the listener can insert the disks into portable players such as MP3 players. Assuming that 30 songs on average require 128 MB of data and include one hour's worth of listening, a large 512 GB hard disk can hold a library of approximately 120,000 songs; and a 640 MB compact disk can hold approximately 150 songs, or about 7½ hours worth of listening.
0054In an alternative embodiment, a device embodying the present invention includes one or more exchange ports, also referred to as "cradles," through which one or more hand-held digital music players can be connected to the device, for loading songs from a digital music library stored on the device thereto. Such exchange ports may be circular ports into which hand-held players in the shape of film canisters are inserted. Thus it may be appreciated that hand-held digital music players, referred to as "Music Capsules" may be "charged up" with songs while they are "plugged into" the device.
0055Reference is now made to <figref idref="f0005">FIG 5</figref>, which is a simplified perspective view of a Music Capsule, in accordance with a preferred embodiment of the present invention. Shown in <figref idref="f0005">FIG. 5</figref> is a hand-held Music Capsule 500 including a user interface 510 displaying meta-data for a song being played. Music Capsule is loaded with songs from Family Music Center, and has serves as a player.
0056A typical usage scenario for a device embodying the present invention, referred to as a Family Music Center, is as follows. A listener sets his cable or satellite receiver box to a specific radio station, and activates the device to capture songs from one or more music channels. The Family Music Center automatically creates a digital music library and imports the broadcast songs therein. Thereafter, the listener plugs a Music Capsule into the Family Music Center, and loads selected songs from the music library onto the Music Capsule. If the Family Music Center is connected to the listener's home network, then the listener may also pipe music from the Family Music Center into speakers in various rooms.
0057Reference is now made to <figref idref="f0006 f0007 f0008 f0009 f0010 f0011 f0012">FIGS. 6A - 6G</figref>, which are simplified perspective views of a Family Music Center, in accordance with a preferred embodiment of the present invention. <figref idref="f0006">FIG. 6A</figref> is a front view of a Family Music Center 600, including a user interface display 605 with buttons 610 and scroll wheel 615 for navigation, and including slots for four Music Capsules 620. <figref idref="f0007">FIGS. 6B</figref>, <figref idref="f0008">6C</figref> and <figref idref="f0009">6D</figref> are side views of Family Music Center 600. <figref idref="f0008">FIG. 6C</figref> shows a side of Family Music Center 600 having slots 625 for memory cards. <figref idref="f0009">FIG. 6D</figref> shows the back of family Music Center 600 with a slot 630 for a DC power supply, slots 635 for audio and video in, and slots 640 for audio and video out. <figref idref="f0010">FIG. 6E</figref> is a view from the right of Family Music Center 600, indicating a base support 645 for the Family Music Center. <figref idref="f0011">FIGS. 6F</figref> and <figref idref="f0012">6G</figref> are views from the top of Family Music Center 600, with and without Music Capsules 620 inserted into slots 650, respectively.
0058Preferably, Family Music Center 600 includes one or more of the following components: <ol id="ol0001" compact="compact"><li>1. A USB port, for connecting to a computer;</li><li>2. An IEEE 1394 port for connecting to various hardware devices;</li><li>3. Slots for removable memory units, such as MF cards, SD cards, memory sticks, compact flash cards and PCMCIA cards;</li><li>4. E2PROM to store programming instructions;</li><li>5. RAM for capture and processing of digital data;</li><li>6. Video capture board with memory for storage;</li><li>7. Audio and video connectors in and out;</li><li>8. Remote control interface for an infra-red (IR) or radio-frequency (RF) control unit;</li><li>9. Analog to digital audio converter;</li><li>10. Digital signal processor for converting audio to MP3 format;</li><li>11. Connection to power supply, or battery casing; and</li><li>12. A display driver for screen display and navigation.</li></ol>
0059Reference is now made to <figref idref="f0013">FIG. 7</figref>, which is a simplified block diagram illustrating interconnectivity of an automatic music library builder with other devices, in accordance with a preferred embodiment of the present invention. Shown in <figref idref="f0013">FIG. 7</figref> is an automatic music library builder 710, receiving audio and video feed from a cable or satellite receiver 720, receiving broadcast music channels. Music library builder 710 generates an MP3 music database in accordance with a preferred embodiment of the present invention, preferably filtering broadcast songs according to pre-defined listener settings and preferences.
0060Preferably, music library builder 710 interconnects with a computer 730 and a personal data assistant (PDA) 740. Listener settings and preferences can be set on computer 730 or PDA 740, and loaded therefrom onto music library builder 710. Music library builder 710 can be programmed and controlled using computer 730 or PDA 740. Preferably, music library builder can also be controlled using a remote control unit 750, using an infra-red (IR) or radio frequency (RF) signal.
0061After automatic music library builder 710 generates a digital music database such as an MP3 database, the database can be transferred to computer 730 or PDA 740 for playback. Alternatively, the database can be transferred to a portable device 760 with MP3 player capability through a removable memory unit such as a compact disk or memory card.
0062Preferably automatic music library builder 710 includes a user interface, albeit a limited user interface, that enables a listener to select and categorize songs that are automatically imported into his digital music library. In an alternative embodiment of the present invention, a listener can specify his settings on his computer or PDA, and then load them into the device of the present invention using a USB cable or memory medium.
0063Preferably, the user interface displays the current song, a yes/no indicator, and the cumulative number of songs already recorded. Preferably, the user interface also enables a user to view an index of all songs recorded on the current memory unit, and to view an index of all songs recorded on all memory units.
0064In an alternate embodiment of the present invention, automatic music library builder 710 uses a television 770 to display a user interface. Preferably automatic library builder 710 includes a video out connector that can be used to connect into television 770. Selections from menu screens displayed on television 770 are preferably made using a control device, such as remote control unit 750, the control device preferably having directional buttons for left-right-up-down and a button for select.
0065The present invention incorporates digital rights management. Specifically, meta-data for a song can also include the number of times the song was played on the broadcast music channel. Such number is used to limit the number of times a listener can access the song from his music library by another digital music player.
0066In reading the above description, persons skilled in the art will realize that there are many apparent variations that can be applied to the methods and systems described. Thus it may be appreciated that the analog audio and the video frame containing meta-data may be captured from different sources, instead of from a single television. Meta-data for broadcast songs may be available, for example, at a broadcaster's Internet site.
0067Alternatively, meta-data for broadcast songs may be extracted from a video or still image camera that photographs a display screen of a radio that includes meta-data. For example, XM and Sirius satellite radios display meta-data on their screens. Often broadcasters transmit meta-data in an encrypted form, and thus use of a camera enables determination of meta-data without the need to decrypt an encrypted data stream.
0068In an alternate embodiment of the present invention, meta-data may be included within a video broadcast, for example, as data within a vertical blanking (VB) channel. For such an embodiment, the present invention obtains meta-data by extraction from the VB channel.
0069It may be appreciated that the Music Capsules of the present invention may receive digital music from other devices, in addition to the Family Music Center. Thus the Music Capsules may be compatible with kiosks, such as music kiosks located in music distribution stores used for listening to songs prior to purchase.
0070In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made to the specific exemplary embodiments without departing from the invention as set forth in the appended claims.
Contents5
13 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| EP1016991A | Cites | European Patent Office (EPO) |
| EP1074926A | Cites | European Patent Office (EPO) |
| WO0007310A | Cites | World Intellectual Property Organization (WIPO) |
| WO0045291A | Cites | World Intellectual Property Organization (WIPO) |
| US4230990A | Cites | United States of America |
| US5892536A | Cites | United States of America |
| US6092080A | Cites | United States of America |
| US2002116277A1 | Cites | United States of America |
| US2003163823A1 | Cites | United States of America |
| US2003233929A1 | Cites | United States of America |
| US6608930B1 | Cites | United States of America |
| ALVEAR J.: 'Gotuit Media Secures $2.1 Million in First-Round Angel Funding Led by Topol Group' PR NEWSWIRE 15 August 2000, XP002903934 | Non-patent | – |
168 members in 10 offices
Priority claims3
| Document | Office | Kind | Date |
|---|---|---|---|
| 336443 | United States of America | – | |
| 33644303 | United States of America | A | |
| 0301109 | Israel | W |
Members168
| Document | Office | Kind | |
|---|---|---|---|
| US2004131255A1 | United States of America | A1 | |
| CA2508326A1 | Canada | A1 | |
| CA2749116A1 | Canada | A1 | |
| WO2004061547A2 | World Intellectual Property Organization (WIPO) | A2 | |
| AU2003288521A1 | Australia | A1 | |
| AU2003288521A8 | Australia | A8 | |
| WO2004061547A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2004267390A1 | United States of America | A1 | |
| US2005065624A1 | United States of America | A1 | |
| US2005125087A1 | United States of America | A1 | |
| EP1579346A2 | European Patent Office (EPO) | A2 | |
| CA2557895A1 | Canada | A1 | |
| CA2699563A1 | Canada | A1 | |
| WO2005106876A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2005106876A3 | World Intellectual Property Organization (WIPO) | A3 | |
| AU2005275431A1 | Australia | A1 | |
| CA2573239A1 | Canada | A1 | |
| CA2784880A1 | Canada | A1 | |
| CA2847420A1 | Canada | A1 | |
| CA2847424A1 | Canada | A1 | |
| WO2006019608A1 | World Intellectual Property Organization (WIPO) | A1 | |
| JP2006515099A | Japan | A | |
| US2006107330A1 | United States of America | A1 | |
| AU2005309595A1 | Australia | A1 | |
| CA2587893A1 | Canada | A1 | |
| WO2006058149A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO2006058149A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO2005106876A8 | World Intellectual Property Organization (WIPO) | A8 | |
| IL177630A0 | Israel | A0 | |
| EP1745554A2 | European Patent Office (EPO) | A2 | |
| US7191193B2 | United States of America | B2 | |
| EP1774450A1 | European Patent Office (EPO) | A1 | |
| AU2006312167A1 | Australia | A1 | |
| CA2626314A1 | Canada | A1 | |
| CA2784879A1 | Canada | A1 | |
| WO2007055845A2 | World Intellectual Property Organization (WIPO) | A2 | |
| IL180559A0 | Israel | A0 | |
| IL169472A0 | Israel | A0 | |
| IL169472D0 | Israel | D0 | |
| US2007156762A1 | United States of America | A1 | |
| US2007162395A1 | United States of America | A1 | |
| EP1825399A2 | European Patent Office (EPO) | A2 | |
| IL183282A0 | Israel | A0 | |
| JP2007534030A | Japan | A | |
| JP2008507036A | Japan | A | |
| EP1898323A1 | European Patent Office (EPO) | A1 | |
| EP1579346A4 | European Patent Office (EPO) | A4 | |
| AU2007328241A1 | Australia | A1 | |
| CA2670748A1 | Canada | A1 | |
| CA2868690A1 | Canada | A1 | |
| WO2008070062A2 | World Intellectual Property Organization (WIPO) | A2 | |
| EP1946237A2 | European Patent Office (EPO) | A2 | |
| WO2007055845A3 | World Intellectual Property Organization (WIPO) | A3 | |
| IL190797A0 | Israel | A0 | |
| WO2008070062A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US2008320598A1 | United States of America | A1 | |
| US2008320605A1 | United States of America | A1 | |
| US2009043412A1 | United States of America | A1 | |
| US2009044285A1 | United States of America | A1 | |
| JP2009514094A | Japan | A | |
| US2009093899A1 | United States of America | A1 | |
| US2009094663A1 | United States of America | A1 | |
| EP1825399A4 | European Patent Office (EPO) | A4 | |
| EP2090060A2 | European Patent Office (EPO) | A2 | |
| EP2096599A1 | European Patent Office (EPO) | A1 | |
| EP2098973A1 | European Patent Office (EPO) | A1 | |
| US2010036759A1 | United States of America | A1 | |
| IL198913A0 | Israel | A0 | |
| JP2010511935A | Japan | A | |
| US7756915B2 | United States of America | B2 | |
| US7761176B2 | United States of America | B2 | |
| AU2005275431B2 | Australia | B2 | |
| AU2005309595B2 | Australia | B2 | |
| AU2006312167B2 | Australia | B2 | |
| US2010325022A9 | United States of America | A9 | |
| AU2010257286A1 | Australia | A1 | |
| AU2010257287A1 | Australia | A1 | |
| CA2753525A1 | Canada | A1 | |
| WO2011008418A2 | World Intellectual Property Organization (WIPO) | A2 | |
| IL169472A | Israel | A | |
| AU2005275431C1 | Australia | C1 | |
| JP2011054176A | Japan | A | |
| AU2006312167B9 | Australia | B9 | |
| JP2011103139A | Japan | A | |
| WO2011008418A3 | World Intellectual Property Organization (WIPO) | A3 | |
| AU2011203040A1 | Australia | A1 | |
| AU2007328241B2 | Australia | B2 | |
| EP1579346B1This record | European Patent Office (EPO) | B1 | |
| JP4753445B2 | Japan | B2 | |
| AT521945T | Austria | T | |
| ATE521945T1 | Austria | T1 | |
| JP4801065B2 | Japan | B2 | |
| IL214792A0 | Israel | A0 | |
| AU2010273920A1 | Australia | A1 | |
| ES2369981T3 | Spain | T3 | |
| AU2010257286B2 | Australia | B2 | |
| US2012109727A1 | United States of America | A1 | |
| EP2449498A2 | European Patent Office (EPO) | A2 | |
| AU2006312167C1 | Australia | C1 | |
| KR20120052932A | Republic of Korea | A |
64 legal events, as 9 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Announcement of lapse in spainLapsedFD2A | FD2A | ES | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Amendment of ipc main classPREVIOUS MAIN CLASS: G06F0017300000R079 | R079 | DE | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| Fee paymentPLFP | PLFP | FR | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Change of representativeR082 | R082 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent lapsedLapsedMM4A | MM4A | IE | |
| No opposition filed against granted patent, or epo opposition proceedings concluded without decisionGrantedR097 | R097 | DE | |
| No opposition filedOpposition26N | 26N | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Deletion acc. to par. 5 (withdrawal of the translation of the ep patent)MK05 | MK05 | AT | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Discontinued in the netherlands as no translation has been filedVDEP | VDEP | NL | |
| Definitive protectionFG2A | FG2A | ES | |
| Dpma publication of mentioned ep patent grantGrantedR096 | R096 | DE | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Supplementary search report drawn up and despatchedA4 | A4 | EP | |
| Request for extension of the european patent (deleted)DAX | DAX | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1579346
- Application
- 37805967
Titles3
- German
- AUTOMATISCHE ERSTELLUNG EINER DIGITALMUSIKBIBLIOTHEK
- English
- AUTOMATIC DIGITAL MUSIC LIBRARY BUILDER
- French
- GENERATEUR DE MUSICOTHEQUE NUMERIQUE AUTOMATIQUE
Classification
- CPC, 12
- G11B33/025
- G06F16/68
- G11B27/034
- G11B27/28
- G11B31/006
- G11B31/02
- G06F16/634
- G06F16/433
- Y10S707/915
- Y10S707/914
- Y10S707/916
- Y10S707/99945
- IPC, 10
- G06F17 30
- A63H5 00
- G04B13 00
- G06F
- G06F7 00
- G06F17 00
- G10H7 00
- G11B17 30
- H04R1 02
- H04R9 06
Designated states27
- Contracting states, 27
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Hungary
- Ireland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Portugal
- Romania
- Sweden
and 3 moreShow fewer
- Slovenia
- Slovakia
- Türkiye