Method for synchronizing and exchanging mobile terminal with media

A mobile terminal and method for media synchronous and exchange

technical field

[0001] The invention relates to the technical field of the communication specifcially, referring to a mobile terminal and method for media synchronous and exchange.

background technology

[0002] Along the mobile phone, Pda of the mobile terminal and the development of popularization and mobile communication device technology, the mobile terminal is instant messenger tool for with the amount maximum, wherein all sorts of application is provided with a fine market foreground. Touch as a mobile terminal and media synchronous and interactive panel or interactive between of the users media side and base for user terminal, for global communication device manufacturer part urgently awaits is solved the problems.

[0003]The utility model claims a mobile terminal and media the universal path of the exchange technology is a user terminal is watching the program, and transmitting short information of the medium side, setting forwards to the information of a mobile communication device supplier the side media. And the method and information processing and relay speed of mobile communication device supplier force and with very strong delay, are arranged for real-timely interaction. Wherein the medium are able to audience's information perform real-timely feeding back, the audience further and is able to be audience community unilaterally, are arranged for interaction.

[0004] The mobile terminal and video-audio media and public-address exchange device; the connecting the solve mobile terminal and media synchronous problems, the synchronous core of the video-audio signal and media side of video-audio signal perform head recognizing in mobile terminal and is at. The utility model, static does not with prior art attempt perform video signal recognizing matching, each video signal information content is huge, wherein recognizing match's speed and validity and the entrance computer processing speed limit. With the audio identify match's technology, the diameter algorithm based on music is a melody, melody to perform labelling, music for labelling while audio spectral line, finding with the information perform type of music database, according to spectral line perform matching. The method facing to the existing music song, a high to the database requirement, image video-audio media and play of the content according to the lower, are further comprises a database of a head, the existing audio matching method is a achieve real-timely, the defect of a are able to overcome.

invention content

[0005] The aimed to providing mobile terminal and a method for media of synchronous and exchange the invention, a mobile terminal and providing user the new exchange platform, and further enriched the pixel pattern of mobile terminal.

[0006] The invention's device is a method for providing a view of counting.

[0007] The invention configured with a algorithm, optimizing the audio information recognizing matching program, simultaneously for processing system of speech recognition matching.

[0008]for the upper device, the invention of mobile terminal and information collecting module, for collecting audio information, and audio information via a processing module perform feature extraction, and generating the value sequence. A processing module is arranged on the mobile terminal further provided with a on the arranged between the server terminal background server. Service of the background server the information collecting module, media flow information for collecting media side, and server media flow cell information of the sound encoding perform, a processing, the extracted audio characteristic, and arranged in inverted command according to the medium class's comprehensive test instrument for perform the characteristic of the bow |, generating search indexed table, a database for real-timely point media audio information. Which is reddish a binary tree algorithm emitter the mobile terminal acquire's audio information and a media database's audio information perform is matched; one a synchronous determining the mobile terminal for collecting the audio information with, and connected with the program signal feeding back the mobile terminal.

[0009] Recognizing media play's information key is connected to the audio information perform feature extraction and matching. A feature method of audio information the invention is the audio information energy spectrum and frequency spectrum or phase spectrum adjacent two data variation perform encoding. By a signal energy spectrum and frequency spectrum or a phase spectrum each section one end of the values and is in corresponding of the variation perform compression coding in a meter of a plurality of lightning, lenses is used 1, decreases 0, obtained a two-dimensional matrix, the is a eigen matrix. Is or lists unit and a perform serializing to the wire, the obtained by a sequence. The calculation method in the following:

[0010] The mobile terminal for collecting the audio information and shown the digital 2, wherein the extracted a first connecting wherein perform discrete short-time Fourier transform,

<img id="idf0001" file="CN103123787AD00051.tif" img-content="drawing" img-format="tif" />

[0012] , X-RAY (η), η is 0,1,2 thanIs a signal, g is a window function, and is USED, t is time, y (x, wherein t) is t twelfth branch ij, X-RAY (η] the short-time Fourier transform, according to time are to the short-time Fourier transformation's result, wherein the result 3 said chart

ο /Jn

[0013] Then, and y shaft as object, is divided into L-SHAPED map averaging (1,2,3 L=, than), A frequency spectrum energy summation to each, obtained function

[0014]

<img id="idf0002" file="CN103123787AD00052.tif" img-content="drawing" img-format="tif" />

[0015] (N, t) and (f, n t+1) of the processing to set

[0016]

<img id="idf0003" file="CN103123787AD00053.tif" img-content="drawing" img-format="tif" />

[0017] The invention audoi obtained signal characteristic map, and shown the digital 4.

[0018] Set (N, T) is matrix is:

<img id="idf0004" file="CN103123787AD00054.tif" img-content="drawing" img-format="tif" />

[0020] According to listing and unit, 10 at the system for binary system convert or 16 at the system, and form the value sequence (f1; f 2, than 0;

[0021] , Hence process in a.

[0022] At the same time, and end of the conversion of the medium audoi signal extracting, and according to the upper a algorithm, media audio a perform the direction, a data storage indexed table is dozens point shown as a digital 5.

[0023] PID and is each PID the corresponding indexed list's, protocol is a feature, the frame is the edge a frame with serial numbers, a are frequency of the presentation.

[0024] , And the information identify matching module of a feature sequence of client and other end of each indexed table perform lookup, lookup algorithm is reddish a binary tree.

[0025] And obtaining the lookup result, and matching of horizontal is greater than the threshold value with the matching numbers' differential value, finding of matching of horizontal for matching result; And the horizontal is not greater than the threshold value with the values' differential value, the differential value the frame perform two confirmations the threshold value, the two confirmations and error rate, a

[0026]

<img id="idf0005" file="CN103123787AD00061.tif" img-content="drawing" img-format="tif" />

[0027] And bitError, less than the threshold value side, and input bitError is minimum claim the matching the result, and without the less than side, and input end of the matching is a matching failed.

[0028] And the information identify matching module in audio information the matching, and mobile terminal the matching result feeding back, comprising a interactive alternating-current module in the mobile terminal secondary. The interactive alternating-current module, and the communication between media side and user for the user, the user can ferrule alignment the matching program and medium side is instant messenger channels perform alternating-current, the second the users instant messenger circuit of the matching program one, the perform interaction and alternating-current.

[0029] And the information identify matching module in audio information the matching, matching information to an ratio counting module, the signal of TV information perform statistical analysis user, and generating an of calculating and reports. By the invention perform an of checking, the large reducing costs, the problems device and digital solve machine and a video playing unreadable and synchronous signal of TV investigate.

[0030] The invention is a processing of audio information, optimizing the recognizing matching program, with algorithm is simple, a measuring small feature, a mobile terminal and media synchronous, and a synchronous base is user's interaction alternating-current the media side and user, for exchanging television and public relation television's providing development base, simultaneously is an of checking and new and application shape of media advertisement development.

Brief composed fo the drawings

[0031]Digital 1 is on mobile terminal and media synchronous and exchanging method system a drawing leds the invention claims.

[0032] Digital 2 is a mobile terminal mm the first frequency 彳 the one of a graph.

[0033] Digital 3 to audio information perform short-time Fourier transform result graph.

[0034] Digital 4 is audoi signal characteristic map.

[0035] Digital 5 is a media audio information data storage indexed table.

[0036] Digital 6 is a service terminal the information collecting, the information characteristic and a database index flow chart.

[0037] Digital 7 and PID and meter is database index flow chart.

[0038] Digital 8 is at Least Famous Spy in the audio of locking mechanisms.

[0039] Digital 9 is the 250ms audio information and map.

[0040] Digital 10 and a window after processing the perform Fourier transform result chart of the audio information perform harming window.

[0041] Digital 11 to audio information Fourier transform result of graph segmentation result frequency band perform energy summation.

[0042] Digital 12 to audio information of 125ms audio data Fourier transform result of graph segmentation result frequency band perform energy summation.

[0043] Digital 13 is an audio information identify matching flow chart.

Specifcially a groove

[0044] The digital and specifcially of embodiment the invention device, in the transparent and intact rendering to the invention's technical solution, pay attention, the embodiment of the invention is a part of embodiments of invention, and are all the embodiment. The invention is based on embodiment, the field diameter of the claims with a made the other groove of the lower creative two side obtaining, belonging to invention protection range of protecting.

[0045] First compromised the deployment of server terminal.

[0046] The server terminal is connected with media side of the data terminal; the information collecting module, media side TS flow information collecting to the server.

[0047] The media as television and example, a signal source of television is a set-top box, a server and set top box the is connected with, wherein the information collecting card, arrived at the data collecting of set-top box the server, wherein flow shown as a digital 6.

[0048] The comprehensive information of obtained by instrument and PID of the groove, and data mapping of the program and information and TS of obtaining content to 11, wherein the indexed table, wherein flow shown as a digital 7.

[0049] At Least Famous Spy for example, wherein part of said sections shown as a digital 8.

[0050] Television play at the same time, the server real-timely extracting of the step is the following:

[0051] The first step, obtaining and recording, and recording the long and each 250ms data, and then recording the data to the second step. The threshold value of the regulating, and electric characteristic value, and the value reducing; and value is thinner, the noise) is, jumps more than congress to make the value, a hard to the reflecting a tendency. The invention, a experience, wherein the IOOms-1s. Shown the digital 9 is a first 250ms recording data.

[0052] Second step, and window to process the 250ms data perform hanning window, and perform Fourier transform, the result and shown the digital 10.

[0053] The third step, according to 16 frequency band plate is Fourier transformation's result, energy summation of each frequency band; the result and shown the digital 11.

[0054] And said that the invention 250ms front 125ms a recording data, wherein the rear 125ms and recording data in turban loyal 250ms data, is the second 250ms recording data frame; the repeat second and third with, the obtained result and shown the digital 12.

[0055] The step; according to the fixed with the two result

[0056]

<img id="idf0006" file="CN103123787AD00071.tif" img-content="drawing" img-format="tif" />

[0057] The computing obtained result is:

[0058] (O O O) O) O)) O 10))))

[0059] The is the first and rear 16bit data, converts the decimal of 2775.

[0060] Can see of the upper line,|set (n, t) |_|set (n, t+1) |Is energy the reducing device of two same data frequency the image. And a major part field, environment energy marine approximate the time, therefore the method can the eliminating major part noise environment.

[0061] To the step, a server and client piezoelectric, a feature sequence of each 5 seconds is a, wherein the intrinsic a sequence of judging. The value is the perform head inclination adjusting, further revolts the value output end of the is needed to a centre according to engineering experience each time is 20-100, the comprises at least one restriction for making the miscarriage of justice improve, comprises multiple words and a which is oversized. The sound recording long and range is IOOms-1s, therefore generating a sequence and a stable ls-10s. The invention layer according to sound recording the long 250ms is a, and Is capable of generating 8 the scales; and invention according to 40 said value computations, which 5s. a feature sequence of the invention is composed of a 1-40 40 th the scales is:

[0062]

<img id="idf0007" file="CN103123787AD00081.tif" img-content="drawing" img-format="tif" />

[0063] Which a step, to further avoid in a characteristic sequence of preventing the same value of the different position, we using the 6bit position adding of the value; the front end of the the first value, 6bit is a (000001) and decimal base is); the front end of the second the value, 6bit is a (000010) and 10 at the system is 2, wherein a signal analog, the 5s eigen matrix is:

[0064]000001000101011010111 “-

OOOOlOOllOOOlOOOllOOl

000011010110011100101

000100101010100001010

000101110100011110100

000110101010100101000

000111100101001010110

001000001001011001011

001001110110100100100

001010101110110110010

001011010101011010101

001100001010100101011

001101011001011011001

001110100011001001110

001111110100110010100

010000001010011101011

010001110101101010100

010010001110011100101

010011110010100101100

010100001101001010011

010101110011011001100

010110111001110011000

010111010100101110101

011000110010001101100

011001001100011110011

011010011110100100001

011011010000110111101

011100100011011001110

011101101000100111010

011110000100100110111

011111010001110011101

100000101101110010110

100001101110001100010

100010001011001101011

100011110101001010100

100100011001001011001

100101110010011101100

100110101101100010010

100111101110110100010

101000110000110111100

[0065] The cell is a decimal is a sequence is:

[0066] (35543,78105,109797,152842,190708,218408,248406,266955,322852,351666,371413,398635,439001,476750,518548,529643,584532,597221,648492,662099,714444,750488,764277,812140,825587,867617,893373,935630,971066,985399,1024925,1072022,1104994,1119851,1174100,1192537,1238252,1268498,1301922,1335740)

[0067] Seventh step, an to are in inverted unit and an index storage unit and a sequence the indexed table.

[0068] The eighth step, the 2-41 st the value mechanism and a sequence, and second direction unit, storage to arranging in inverted turn table indexed. The inverted in the indexed table according to the path energy arranged on a.

[0069] Ninth step, less of the server deployment the positioning, and a delay network, a feature sequence of client reported the time service with a delay, a data time recorder invention claims a server and retained needed override time delay data platform, therefore we retained 5 minutes program a sequence of the server the arranging in inverted turn table indexed. A more than 5 minutes data and closing, for holding efficiency of server. The threshold value of the head inclination adjusting, a determining the network condition and geographic distribution of arrangement.

[0070] Introduced the client program, the mobile terminal with the television sound perform and recording the environment, each mobile phone processing is concave to the server is the real-time time requirement, the invention can is connected to the processing mode on the mobile phone.

[0071] First step, client to the sound recording, and recording and 5s, a data transmission of 5s to feature extraction thread. And the start to connection to record.

[0072] Of pay attention, wherein a session value is the perform head inclination adjusting, wherein the value output it needs according to engineering experience and each time and is 20-100, the comprises at least one restriction for making the miscarriage of justice improve, comprises multiple words and a which is oversized. The sound recording long and range is IOOms-1s, therefore for optimizing and recording of generating a sequence bus and a stable Is-1Os0 wherein each invention is 250ms is a according to sound recording, and Is capable of generating 8 the scales; and when the defining 40 characteristic value computations, the embodiment electric bus is 5s.

[0073] The second step; the 2-6 th step the client to the transparent-plate server terminal, said obtaining the value is sequence:

[0074] (17589,78105,109797,152842,190708,218408,248406,266955,322852,351666,371413,398635,439001,476750,518548,529643,45683,597221,648492,662099,714444,750488,764277,812140,78105,867617,50926,935630,971066,985399,1024925,1072022,1104994,1119851,1174100,1192537,75643,1268498,439001,1335740)

[0075] The third step; the client and a sequence, made of a user customer's ID, time and information an intact data packet, the transmitted to the information identify matching module; and secondary module and server.

[0076] The introducing matching and post-processing process, wherein by the data and server is recognizing matching module, a server is to perform identify matching, utilized to the client the matching result feeding back the synchronous, and recognizing result CPU is an ratio counting module perform an ratio counting. And the matching process shown as a digital 13.

[0077] Audio information feature data of first step; a server and client transmission

[0078] Second step, and searching algorithm, obtaining the matching a number of sequence device. We obtain the result, the first matching number is 35, the number 2nd is 15, the third frame is 10 mm, and is 10, the is 9, 10, 7th is 12, the 8th hardwood 11, ninth is 9 than

[0079] A step, each first is higher than the is multiple and only, therefore first surface is a recognizing result. Matter judging is a threshold value, and matching of horizontal is greater than the second large value, and difference is greater than 3; and judging in the highest frame is a recognizing result, the difference a positioning according to the actual is head inclination adjusting, and upper oversized.

[0080] The fourth step, recognizing result transmitting to an ratio count server.

[0081] The step, a on recognizing result, a count server the count the surface of each time, and program an ratio of generating, an of report. Is with the way's an of checking costs, and data robust ness is high.

[0082] To the step; the can realize a client form social network) according to palship outside, the invention is watching the same program user friend table at the same time, the transmitted to the client.

[0083] Seventh, client prompting friend, a current with your friend XX and XXX, simultaneously is watching the program, greet of a. When of the user confirmed that the tool of bus relation client, for controlling relation interaction.