Apparatus and method for synchronizing e-book content with video content and system thereof
Claim Score by NHIP
Abstract
A method of synchronizing a first device capable of displaying video content and including the video content, and a second device capable of displaying E-book content associated with the video content and including the E-book content. The first device is connected to the second device according to a specific protocol. In response to a specific event for the video content or the E-book content occurring in one of the first and second devices, the device in which the specific event occurs generates event information about the specific event and transmits it to the other of the first and second devices, and performs the specific event according to the event information. Upon receiving the event information, the other of the first and second devices performs the specific event according to the received event information in synchronization with the device in which the specific event occurred, using synchronization information between the video content and the E-book content.

Term
Projected expiry 27 April 2031.
- Priority
- Filed
- Published
- Today
- Projected expiry
22 claims: 7 independent, 15 dependent
- 1A method of synchronizing a first device capable of displaying video content and including the video content, and a second device capable of displaying E-book content associated with the video content and including the E-book content, the method comprising:connecting the first device to the second device according to a specific protocol;in response to a specific event for the video content or the E-book content occurring in one of the first and second devices, generating event information about the specific event and transmitting the event information to the other one of the first and second devices by the device in which the specific event occurred;performing the specific event according to the generated event information by the device in which the specific event occurred;and performing, by the other device that received the event information, the specific event according to the received event information in synchronization with the device in which the specific event occurred, using synchronization information between the video content and the E-book content;wherein the first and second devices have the synchronization information.
- 6A method of synchronizing E-book content and video content in an E-book device including the E-book content associated with the video content included in a first device, the method comprising:connecting the E-book device to the first device according to a specific protocol;in response to a specific event for the video content occurring in the first device, receiving event information about the specific event from the first device by the E-book device;and performing the specific event by the E-book device according to the received event information in synchronization with the first device using synchronization information between the video content and the E-book content.
- 10A method of synchronizing E-book content and video content in an E-book device including the E-book content associated with the video content included in a first device, the method comprising:connecting the E-book device to the first device according to a specific protocol;in response to a specific event for the E-book content occurring in the E-book device, generating event information about the specific event, and transmitting the event information to the first device;and performing the specific event by the E-book device according to the event information in synchronization with the first device using synchronization information between the video content and the E-book content.
- 11Broadest claimClaim Score 93, very broad(NHIP)The method of clam 10 , wherein if the specific event is a search event for a specific part of the E-book content, the event information includes information about the specific part of the E-book content.
- 12A system for synchronizing a first device capable of displaying video content and including the video content, and a second device capable of displaying E-book content associated with the video content and including the E-book content, the system comprising:the first and second devices being connected to each other according to a specific protocol, wherein in response to a specific event for the video content or the E-book content occurring in one of the first and second devices, the device in which the specific event occurs generates event information about the specific event, transmits the event information to the other one of the first and second devices, and performs the specific event according to the event information;and the other device performs the specific event according to the received event information in synchronization with the device in which the specific event occurred, using synchronization information between the video content and the E-book content;wherein the first and second devices have the synchronization information.
- 17An E-book device for synchronizing E-book content with video content that is included in a first device and associated with the E-book content, the E-book device comprising:a transceiver which receives event information about a specific event for the video content, which is generated by the first device in response to the specific event occurring in the first device;a storage which stores the E-book content and synchronization information between the video content and the E-book content;and a controller which connects the E-book device to the first device through the transceiver according to a specific protocol, and performs the specific event according to the received event information in synchronization with the first device using the synchronization information.
- 21An E-book device for synchronizing E-book content with video content that is included in a first device and associated with the E-book content, the E-book device comprising:a storage which stores the E-book content and synchronization information between the video content and the E-book content;a controller which connects the E-book device to the first device according to a specific protocol, and in response to a specific event for the E-book content occurring in the E-book device, generates event information about the specific event, and performs the specific event according to the event information in synchronization with the first device using synchronization information;and a transceiver which transmits the event information to the first device.
Independent claims7
80 paragraphs in 5 sections, as filed
CROSS-REFERENCE TO RELATED APPLICATIONS
0001This application claims priority from Korean Patent Application No. 10-2009-0104534 filed on Oct. 30, 2009, in the Korean Intellectual Property Office, the entire disclosure of which is hereby incorporated by reference.
BACKGROUND
00021. Field of the Invention
0003Apparatuses and methods consistent with the exemplary embodiments relate to an E-book, and more particularly, to synchronizing video content and E-book content.
00042. Description of the Related Art
0005With the development of the Internet and digital technologies, E-book has been developed as a new alternative replacing the existing printed books. E-book technology enables a user to store texts in electronic form on a terminal, and read them on the terminal when desired. In other words, E-book may generally refer to publications made by processing content of books into information in digital form and storing the digital content information in recording media. E-book is called by many different names such as E-book, E-text, Online Book, and File Book.
0006E-book is expected to steadily grow in its use, replacing existing paper books, due to its portability and convenience that the user can read a variety of books on a portable E-book terminal without carrying the large and heavy books with him or her. In addition, compared with the existing printed books, E-book may contribute to simplification of distribution, reduction of inventory, output of various content, and efficient storage/management of content, etc.
0007In addition, if linked to multimedia content, E-book may contain more diverse types of information compared with existing text-oriented paper books. Therefore, in order to enable the use of E-book, convergence technology is required that can link text-oriented E-book content to multimedia content. In the field of E-book, the convergence technology requires synchronization technology for displaying E-book content in conjunction with, for example, video content, which is a typical example of multimedia content.
SUMMARY
0008One or more exemplary embodiments provide a synchronization method and apparatus for synchronizing multimedia content and E-book content.
0009One or more exemplary embodiments also provide a method and apparatus for synchronizing a device for displaying video content and a device for displaying E-book content.
0010One or more exemplary embodiments also provide a method and apparatus for synchronizing video content and E-book content in a device capable of displaying the video content and the E-book content together.
0011One or more exemplary embodiments also provide a method and apparatus capable of searching video content and E-book content in synchronization with each other in a device capable of displaying the video content and the E-book content together.
0012In accordance with an aspect of an exemplary embodiment, there is provided a method of synchronizing a first device capable of displaying video content and including the video content, and a second device capable of displaying E-book content associated with the video content and including the E-book content. In the synchronization method, the first device is connected to the second device according to a specific protocol. If a specific event for the video content or the E-book content occurs in any one of the first and second devices, the device in which the specific event occurs generates event information about the specific event, transmits the event information to the other device, and then performs the specific event according to the generated event information. Upon receiving the event information, the other device performs the specific event according to the received event information in synchronization with the device in which the specific event has occurred using synchronization information between the video content and the E-book content. The first and second devices both have the synchronization information.
0013In accordance with an aspect of another exemplary embodiment, there is provided a method of synchronizing E-book content and video content in an E-book device including the E-book content associated with the video content included in a first device. In the synchronization method, the E-book device is connected to the first device according to a specific protocol. If a specific event for the video content occurs in the first device, the E-book device receives event information about the specific event from the first device, and performs the specific event according to the received event information in synchronization with the first device using synchronization information between the video content and the E-book content.
0014In accordance with and aspect of another exemplary embodiment, there is provided a method of synchronizing E-book content and video content in an E-book device including the E-book content associated with the video content included in a first device. In the synchronization method, the E-book device is connected to the first device according to a specific protocol. If a specific event for the E-book content occurs in the E-book device, the E-book device generates event information about the specific event, transmits the event information to the first device, and performs the specific event according to the event information in synchronization with the first device using synchronization information between the video content and the E-book content.
0015In accordance with an aspect of another exemplary embodiment, there is provided a system of synchronizing a first device capable of displaying video content and including the video content, and a second device capable of displaying E-book content associated with the video content and including the E-book content. The first and second devices are connected to each other according to a specific protocol. If a specific event for the video content or the E-book content occurs in any one of the first and second devices, the device in which the specific event occurs generates event information about the specific event, transmits the event information to the other device, and performs the specific event according to the event information. The other device performs the specific event according to the received event information in synchronization with the device in which the specific event occurred, using synchronization information between the video content and the E-book content. The first and second devices both have the synchronization information.
0016In accordance with an aspect of another exemplary embodiment, there is provided an E-book device for synchronizing E-book content with video content that is included in a first device and associated with the E-book content. In the E-book device, if a specific event occurs in the first device, a transceiver receives event information about the specific event for the video content, which is generated by the first device. A storage element stores the E-book content and synchronization information between the video content and the E-book content. A controller connects the E-book device to the first device through the transceiver according to a specific protocol, and performs the specific event according to the received event information in synchronization with the first device using the synchronization information.
0017In accordance with an aspect of another exemplary embodiment, there is provided an E-book device for synchronizing E-book content with video content that is included in a first device and associated with the E-book content. In the E-book device, a storage element stores the E-book content and synchronization information between the video content and the E-book content, and a controller connects the E-book device to the first device according to a specific protocol. If a specific event for the E-book content occurs in the E-book device, the controller generates event information about the specific event, and performs the specific event according to the event information in synchronization with the first device using synchronization information. A transceiver transmits the event information to the first device.
BRIEF DESCRIPTION OF THE DRAWINGS
0018The above and other aspects will be more apparent from the following description of exemplary embodiments taken in conjunction with the accompanying drawings, in which:
0019<figref idrefs="DRAWINGS">FIG. 1</figref> is a diagram illustrating a system according to a first exemplary embodiment;
0020<figref idrefs="DRAWINGS">FIG. 2</figref> is a diagram illustrating a method of synchronizing video content and E-book content according to the first exemplary embodiment;
0021<figref idrefs="DRAWINGS">FIG. 3</figref> is a diagram illustrating an operation of the first device in <figref idrefs="DRAWINGS">FIG. 2</figref> according to the first exemplary embodiment;
0022<figref idrefs="DRAWINGS">FIG. 4</figref> is a diagram illustrating an operation of the second device in <figref idrefs="DRAWINGS">FIG. 2</figref> according to the first exemplary embodiment;
0023<figref idrefs="DRAWINGS">FIG. 5</figref> is a diagram illustrating a structure of the second device in <figref idrefs="DRAWINGS">FIG. 2</figref> according to the first exemplary embodiment;
0024<figref idrefs="DRAWINGS">FIG. 6</figref> is a diagram illustrating a system according to a second exemplary embodiment;
0025<figref idrefs="DRAWINGS">FIG. 7</figref> is a diagram illustrating a structure of an E-book device according to the second exemplary embodiment; and
0026<figref idrefs="DRAWINGS">FIG. 8</figref> is a diagram illustrating a method of synchronizing video content and E-book content in an E-book device according to the second exemplary embodiment.
DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS
0027Exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. In the following description, specific details such as detailed configuration and components are merely provided to assist the overall understanding of exemplary embodiments of the present invention. Therefore, it should be apparent to those skilled in the art that various changes and modifications of the exemplary embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions are omitted for clarity and conciseness.
0028Throughout the drawings, the same drawing reference numerals will be understood to refer to the same elements, features and structures.
0029Prior to a detailed description of the exemplary embodiments, the basic concept of the exemplary embodiments will be described.
0030A first exemplary embodiment is directed to a technology for connecting, over a wired and/or wireless communication network, a first device for displaying video content to a second device spaced apart from the first device and displaying E-book content associated with the video content, and synchronizing playback and/or search for the video content and the E-book content.
0031Information needed for an operation of the first exemplary embodiment of the present invention includes synchronization information between video content and E-book content, and event information about the video content or E-book content. The synchronization information refers to information indicating a mapping relationship between frames of video content and associated page and/or line information of E-book content. The event information refers to information needed to perform a specific event such as playback or search for video content or E-book content. For example, in the case of playback event for a specific frame of the video content, the event information may include a specific frame number of the video content.
0032In the first exemplary embodiment, if an event such as playback or search for video content or E-book content occurs in any one of the first and second devices, the device in which the event occurs transmits event information to the other device and performs the event. Upon receiving the event information, the other device may perform the event in a synchronized manner using the synchronization information and the event information.
0033The event information may be different according to the type of the event that occurs. For example, if the event that has occurred in the first device is a playback event for a specific frame of video content, the event information may include information about the specific frame and information about a playback time of the specific frame. If the event that has occurred in the first device is a search event for a specific frame of video content, the event information may include information indicating the specific frame. As another example, if an event that has occurred in the second device is a search event for a specific part of E-book content, the event information may include information about the specific part of the E-book content.
0034A second exemplary embodiment enables a device including a first display unit for displaying video content and a second display unit for displaying E-book content to play or search the video content and the E-book content in a synchronized manner. In addition, the second exemplary embodiment may separately provide a search bar capable of searching the entire video content fast and another search bar capable of fine searching a short period of the video content, thereby improving search performance for both fast search and fine search.
0035Now, exemplary embodiments will be described in detail.
0036<figref idrefs="DRAWINGS">FIG. 1</figref> illustrates a system according to a first exemplary embodiment.
0037Referring to <figref idrefs="DRAWINGS">FIG. 1</figref>, a first device <b>103</b> is a multimedia device capable of displaying multimedia content such as video content. A second device <b>105</b> is an E-book device capable of displaying E-book content. A server <b>101</b> is connected to the first and second devices <b>103</b> and <b>105</b> in a wired and or wireless manner, and provides video content and E-book content thereto, respectively. For example, the server <b>101</b> may be a server for providing educational broadcast content, the first device <b>103</b> may be a TV or a Personal Computer (PC) for receiving the educational broadcast, and the second device <b>105</b> may be an E-book terminal.
0038In a case where real-time service is provided to the user, the first and second devices <b>103</b> and <b>105</b> may be connected to the server <b>101</b>, and receive content from the server <b>101</b> in real time. In another case where non-real-time service is provided to the user, the first and second devices <b>103</b> and <b>105</b> may be adapted to store content provided in advance from the server <b>101</b> in their devices, respectively, and to display multimedia content and E-book content in association with each other even while disconnected from the server <b>101</b>. The first and second devices <b>103</b> and <b>105</b> may not necessarily receive their content from the server <b>101</b>. So, if the first and second devices <b>103</b> and <b>105</b> can acquire their content through other routes, the server <b>101</b> may not be included in the first exemplary embodiment of the present invention.
0039<figref idrefs="DRAWINGS">FIG. 2</figref> illustrates a method of synchronizing video content and E-book content according to the first exemplary embodiment.
0040Referring to <figref idrefs="DRAWINGS">FIG. 2</figref>, the server <b>101</b> provides video content and synchronization information between the video content and its associated E-book content to the first device <b>103</b> capable of playing video content (operation <b>201</b>). The synchronization information may include information indicating a mapping relationship between frames of the video content and associated page and/or line information of the E-book content.
0041The server <b>101</b> provides E-book content associated with the video content to the second device <b>105</b> capable of displaying the E-book content (operation <b>203</b>). Then, the first and second devices <b>103</b> and <b>105</b> establish a connection using a specific communication protocol to communicate with each other in a wired and/or wireless manner (operation <b>205</b>). The connection may be established in many different ways known to one of ordinary skill in the art and therefore a detailed description thereof is not provided. Thereafter, the first device <b>103</b> transmits the synchronization information to the second device <b>105</b> through the established connection (operation <b>207</b>).
0042If a specific event has occurred in the first device <b>103</b>, the first device <b>103</b> generates event information about the specific event (operation <b>209</b>) and transmits it to the second device <b>105</b> (operation <b>211</b>), and then performs an event operation based on the specific event information (operation <b>213</b>). Upon receiving the event information from the first device <b>103</b>, the second device <b>105</b> performs the event in synchronization with the first device <b>103</b> using the synchronization information and the event information (operation <b>215</b>).
0043In the example of <figref idrefs="DRAWINGS">FIG. 2</figref>, the synchronization information may be provided in video content in the form of metadata (e.g., a caption of foreign language video content). In this case, along with the operation being performed in the E-book terminal, the video content may be handled on a video player in the form of Picture-In-Picture (PIP). As a result, the user can view both video and text information on the video player, and even the E-book terminal may display the E-book content in a synchronized manner.
0044Now, possible modifications of <figref idrefs="DRAWINGS">FIG. 2</figref> will be described.
0045While it is assumed in <figref idrefs="DRAWINGS">FIG. 2</figref> that a playback or search event for video content has occurred in the first device <b>103</b> for displaying the video content, the same operation may be possible even when a playback or search event for E-book content has occurred in the second device <b>105</b>. For example, if the second device <b>105</b> receives synchronization information from the server <b>101</b> and transmits it to the first device <b>103</b> and an event of searching for a specific page or word of E-book content has occurred in the second device <b>105</b>, then the second device <b>105</b> transmits the relevant event information to the first device <b>103</b> and the first device <b>103</b> may display video content corresponding to the specific page or word of the E-book content according to the received event information in a synchronized manner.
0046Also, it is assumed in <figref idrefs="DRAWINGS">FIG. 2</figref> that the first device <b>103</b> transmits the synchronization information to the second device <b>105</b>. However, as an example of another modification, the server <b>101</b> may directly transmit the synchronization information to the second device <b>105</b> without passing it through the first device <b>103</b>. In this case, operation <b>207</b>, in which the first device <b>103</b> transmits the synchronization information to the second device <b>105</b>, may be optional.
0047In addition, while it is assumed in <figref idrefs="DRAWINGS">FIG. 2</figref> that both of the first and second devices <b>103</b> and <b>105</b> have the synchronization information, only the first device <b>103</b> may have the synchronization information. In this case, if a specific event has occurred in the first device <b>103</b>, the first device <b>103</b> should generate and transmit event information allowing the second device <b>105</b> to perform the specific event in synchronization with the first device <b>103</b>. For example, if a playback event for a specific frame of video content has occurred in the first device <b>103</b>, the first device <b>103</b> generates event information including E-book content's page information corresponding to the specific frame of the video content using its synchronization information, and transmits it to the second device <b>105</b>. The second device <b>105</b> displays the relevant page using the E-book content's page information included in the event information. The same operation is possible even when the event has occurred in the second device <b>105</b>.
0048Now, examples of the event in <figref idrefs="DRAWINGS">FIG. 2</figref> will be described.
0049As an example of the event, if no operation is requested within a predetermined time after the connection establishment in operation <b>205</b>, this event may be defined as a default event. If the default event occurs, the first device <b>103</b> transmits event information including playback time information of video content to the second device <b>105</b> in operation <b>211</b>, and starts playing the video content at the playback time in operation <b>213</b>. Meanwhile, the second device <b>105</b> displays E-book content in synchronization with the video content being played on the first device <b>103</b> using the video content's playback time information and the synchronization information. In the case where the default event is not defined, if no event occurs within a predetermined time, the first and second devices <b>103</b> and <b>105</b> may perform no operation.
0050As another example of the event, if an event of requesting to play a specific frame of video content, or requesting to play the video content beginning from a specific frame, has occurred in the first device <b>103</b>, then the first device <b>103</b> transmits event information including the play-requested frame information and playback time information to the second device <b>105</b>, and starts playing the play-requested frame at the playback time. The second device <b>105</b> displays E-book content corresponding to the play-requested frame information at the playback time in synchronization with the first device <b>103</b> using the synchronization information.
0051As a further example of the event, if an event of requesting to search for a specific frame of video content has occurred in the first device <b>103</b>, the first device <b>103</b> transmits event information including the search-requested frame information to the second device <b>105</b>, and displays the search-requested frame. The second device <b>105</b> displays E-book content in synchronization with the frame being displayed on the first device <b>103</b>, using the search-requested frame information and the synchronization information.
0052An event performed in the second device <b>105</b> may automatically turn over a page or highlight a specific part in a certain page of the E-book content corresponding to a video content being played on the first device <b>103</b>.
0053If it is assumed that a specific event occurs in the second device <b>105</b> rather than in the first device <b>103</b> as shown in <figref idrefs="DRAWINGS">FIG. 2</figref>, the second device <b>105</b> generates event information corresponding to the specific event and transmits it to the first device <b>103</b>, and performs the specific event for the E-book content on a display according to the generated event information, and the first device <b>103</b> may perform an event for video content in synchronization with the specific event for the E-book content according to the synchronization information and the event information received from the second device <b>105</b>.
0054<figref idrefs="DRAWINGS">FIG. 3</figref> illustrates an operation of the first device in <figref idrefs="DRAWINGS">FIG. 2</figref> according to the first exemplary embodiment.
0055The first device <b>103</b> receives at least one of video content and synchronization information from the server <b>101</b> (operation <b>301</b>), establishes a connection to the second device <b>105</b> (operation <b>303</b>), and transmits the synchronization information to the second device <b>105</b> (operation <b>305</b>). If an event has occurred in the first device <b>103</b> (operation <b>307</b>), the first device <b>103</b> generates event information regarding the event and transmits it to the second device <b>105</b> (operation <b>309</b>) so that the second device <b>105</b> may perform the event in synchronization with the first device <b>103</b>. After transmitting the event information to the second device <b>105</b>, the first device <b>103</b> performs the event in synchronization with the second device <b>105</b> according to the event information (operation <b>311</b>).
0056<figref idrefs="DRAWINGS">FIG. 4</figref> illustrates an operation of the second device in <figref idrefs="DRAWINGS">FIG. 2</figref> according to the first exemplary embodiment of the present invention.
0057The second device <b>105</b> receives E-book content associated with video content from the server <b>101</b> (operation <b>401</b>), establishes a connection to the first device <b>103</b> (operation <b>403</b>), and receives synchronization information between the video content and the E-book content from the first device <b>103</b> (operation <b>405</b>). Upon receiving event information from the first device <b>103</b> (operation <b>407</b>), the second device <b>105</b> performs an operation corresponding to the event in synchronization with the first device <b>103</b> according to the event information and the synchronization information (operation <b>409</b>) received in operation <b>405</b>.
0058<figref idrefs="DRAWINGS">FIG. 5</figref> illustrates a structure of the second device in <figref idrefs="DRAWINGS">FIG. 2</figref> according to the first exemplary embodiment.
0059Referring to <figref idrefs="DRAWINGS">FIG. 5</figref>, the second device <b>105</b> is an E-book device capable of displaying E-book content. The controller <b>503</b> receives E-book content from the server <b>101</b> through a transceiver <b>505</b> and stores it in a storage element <b>507</b>. The controller <b>503</b> establishes a connection to the first device <b>103</b> via the transceiver <b>505</b> according to a specific protocol, receives synchronization information from the first device <b>103</b>, and stores it in the storage element <b>507</b>. Upon receiving event information from the first device <b>103</b> via the transceiver <b>505</b>, the controller <b>503</b> displays E-book content corresponding to the event, for example, a specific frame of video content, on a display <b>501</b> in synchronization with the first device <b>103</b> according to the event information and the synchronization information.
0060However, if a specific event has occurred in the second device <b>105</b> or an E-book device, the controller <b>503</b> receives information indicating the occurrence of the specific event through an interface <b>509</b>, generates event information corresponding to the specific event, transmits it to the first device <b>103</b> via the transceiver <b>505</b>, and performs the specific event for the E-book content on the display <b>501</b> according to the generated event information.
0061The second exemplary embodiment of the present invention is directed to an E-book device capable of displaying video content and E-book content together.
0062<figref idrefs="DRAWINGS">FIG. 6</figref> illustrates a system according to the second exemplary embodiment.
0063Referring to <figref idrefs="DRAWINGS">FIG. 6</figref>, an E-book device <b>601</b> is connected to the server <b>101</b> in a wired and/or wireless manner, can receive video content and E-book content therefrom, and includes a first display unit <b>603</b> capable of displaying the video content and a second display unit <b>605</b> capable of displaying the E-book content. A detailed structure of the E-book device <b>601</b> is described below with reference to <figref idrefs="DRAWINGS">FIG. 7</figref>.
0064<figref idrefs="DRAWINGS">FIG. 7</figref> illustrates a structure of an E-book device according to the second exemplary embodiment.
0065A transceiver <b>701</b> receives from the server <b>101</b> at least one of video content, E-book content, and synchronization information between the video content and the E-book content, and transfers the received information to a controller <b>703</b>. The controller <b>703</b> stores the video content, E-book content and synchronization information in a storage element <b>713</b>.
0066An interface <b>711</b> refers to means for delivering an event input by a user to the controller <b>703</b>, and its most typical example may be a keypad. If a display <b>705</b> is a touch screen, the touch screen may also be a component of the interface <b>711</b>.
0067The controller <b>703</b> displays the video content and E-book content stored in the storage element <b>713</b> on the display <b>705</b> in a synchronized manner using the synchronization information according to the event information received through the interface <b>711</b>.
0068The display <b>705</b> includes the first display unit <b>603</b> for displaying the video content under the control of the controller <b>703</b> and the second display unit <b>605</b> for displaying the E-book content. The first display unit <b>603</b> includes at least one of a video search bar <b>707</b> and a text/video search bar <b>709</b>.
0069The video search bar <b>707</b> may be set to search the entire video content fast, and the text/video search bar <b>709</b> may be set to fine search the video content within the range of the E-book content presently displayed on the second display unit <b>605</b>.
0070For example, assume an English conversation video content with a total length of 50 minutes is displayed on the first display unit <b>603</b> and script content for the video content is displayed on the second display unit <b>605</b> in a synchronized manner. The user may fast search the entire 50-minute English conversation video content, and may also fine search a specific part with a short length of, for example, two minutes of the total of 50 minutes. The user may use the video search bar <b>707</b> when fast searching the entire video content as in the former case, and may use the text/video search bar <b>709</b> when fine searching the video content as in the latter case.
0071If the user fast searches the entire video content using the video search bar <b>707</b>, shifted-position information of the video search bar <b>707</b> is transferred to the controller <b>703</b>, and the controller <b>703</b> displays video of the frame corresponding to the shifted position of the video search bar <b>707</b> on the first display unit <b>603</b>. At the same time, the controller <b>703</b> displays E-book content corresponding to the frame being displayed on the first display unit <b>603</b>, on the second display unit <b>605</b> in a synchronized manner using the synchronization information.
0072In order to search video content within the range of the E-book content displayed on the second display unit <b>605</b>, the user may fine search the video content using the text/video search bar <b>709</b>. In this case, a method of displaying the E-book content on the second display unit <b>605</b> in a synchronized manner may include highlighting a text line corresponding to the fine-searched video content, to distinguish it from other text presently being displayed on the second display unit <b>605</b>.
0073<figref idrefs="DRAWINGS">FIG. 8</figref> illustrates a method of synchronizing video content and E-book content in an E-book device according to the second exemplary embodiment.
0074The E-book device receives at least one of video content, E-book content associated with the video content, and synchronization information between the video content and the E-book content from the server <b>101</b> through the transceiver <b>701</b>, and stores it in the storage element <b>713</b> through the controller <b>703</b> (operation <b>801</b>).
0075The controller <b>703</b> monitors whether a specific event for the E-book content associated with the video content has occurred (operation <b>803</b>) through the interface <b>711</b>. If so, the controller <b>703</b> performs the specific event for the video content and the E-book content using the synchronization information in a synchronized manner (operation <b>805</b>).
0076As an example of the event, if no operation is requested by the user after the contents and the synchronization information are stored in the storage element <b>713</b>, this event may be defined as a default event. Upon occurrence of the default event, the controller <b>703</b> starts playing the video content on the first display unit <b>603</b>, and displays the E-book content and the video content on the second display unit <b>605</b> using the synchronization information in a synchronized manner. If no event has occurred within a predetermined time with the default event undefined, the controller <b>703</b> may perform no operation.
0077As another example of the event, if an event of requesting to play a specific part of the video content has occurred through the interface <b>711</b>, the controller <b>703</b> displays the play-requested video frame on the first display unit <b>603</b> and the E-book content synchronized with the play-requested video frame on the second display unit <b>605</b>, using video frame information corresponding to the specific part and the synchronization information.
0078As a further example of the event, if an event of searching video content using the video search bar <b>707</b> has occurred, the controller <b>703</b> detects the search-requested video frame information using shifted-position information of the video search bar <b>707</b>, and displays the detected frame on the first display unit <b>603</b>. In addition, the controller <b>703</b> displays E-book content corresponding to the frame being displayed on the first display unit <b>603</b>, on the second display unit <b>605</b> in a synchronized manner using the search-requested frame information and the synchronization information. By searching the video content using the video search bar <b>707</b> in this way, the E-book device may fast search the user-desired part of the entire video content.
0079Also, if an event of searching video content using the text/video search bar <b>709</b> has occurred, the controller <b>703</b> displays the video content within the range of the E-book content presently being displayed on the second display unit <b>605</b>, on the first display unit <b>603</b> using shifted-position information of the text/video search bar <b>709</b>. At the same time, the controller <b>703</b> displays the E-book content corresponding to the video content being displayed on the first display unit <b>603</b>, on the second display unit <b>605</b> in a synchronized manner using the synchronization information. In this case, a method of displaying the E-book content on the second display unit <b>605</b> in a synchronized manner may include highlighting a text line corresponding to the fine-searched video content, to distinguish it from the other texts presently being displayed on the second display unit <b>605</b>. By searching the video content within the range of the E-book content being displayed on the second display unit <b>605</b> using the text/video search bar <b>709</b> in this way, the user may fine search his or her desired video content.
0080While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the inventive concept as defined by the appended claims and their equivalents.
Contents5
8 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| WO2013122796A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| WO2014039286A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US9678634B2 | Cited by | United States of America | Applicant |
| US2018157657A1 | Cited by | United States of America | Search report |
| WO2015046724A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| USD842332S | Cited by | United States of America | Applicant |
| US9069732B2 | Cited by | United States of America | Applicant |
| US2016105707A1 | Cited by | United States of America | Search report |
| US9459773B2 | Cited by | United States of America | Search report |
| US10775877B2 | Cited by | United States of America | Applicant |
| US2014047320A1 | Cited by | United States of America | Search report |
| US9858695B2 | Cited by | United States of America | Search report |
| US10192341B2 | Cited by | United States of America | Applicant |
| US10008018B2 | Cited by | United States of America | Applicant |
| US11393146B2 | Cited by | United States of America | Applicant |
| CN103123626A | Cited by | China | Search report |
| US2014068408A1 | Cited by | United States of America | Pre-grant |
| US2018067902A1 | Cited by | United States of America | Search report |
| US9883230B1 | Cited by | United States of America | Search report |
| US2014089796A1 | Cited by | United States of America | Pre-grant |
| US9063641B2 | Cited by | United States of America | Applicant |
| US2014068408A1 | Cited by | United States of America | Search report |
| US10585546B2 | Cited by | United States of America | Applicant |
| US2016004397A1 | Cited by | United States of America | Pre-grant |
| US2015348300A1 | Cited by | United States of America | Pre-grant |
| WO2013004890A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US10649612B2 | Cited by | United States of America | Search report |
| US10861207B2 | Cited by | United States of America | Applicant |
| US2014047320A1 | Cited by | United States of America | Pre-grant |
| US10506295B2 | Cited by | United States of America | Search report |
| US9047356B2 | Cited by | United States of America | Applicant |
| US9836442B1 | Cited by | United States of America | Search report |
| US2014272859A1 | Cited by | United States of America | Pre-grant |
| US2014143650A1 | Cited by | United States of America | Pre-grant |
| CN106331878A | Cited by | China | Search report |
| US2010184485A1 | Cited by | United States of America | Pre-grant |
| US8233863B2 | Cited by | United States of America | Search report |
| US9542538B2 | Cited by | United States of America | Applicant |
| US2008177822A1 | Cites | United States of America | Pre-grant |
| US2009204663A1 | Cites | United States of America | Pre-grant |
| US2010225809A1 | Cites | United States of America | Pre-grant |
| US2011044601A1 | Cites | United States of America | Pre-grant |
| US2011047498A1 | Cites | United States of America | Pre-grant |
| US2012197998A1 | Cites | United States of America | Pre-grant |
| US6260011B1 | Cites | United States of America | Pre-grant |
22 members in 8 offices
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 20090104534 | Republic of Korea | A | |
| 20090104534 | Republic of Korea | A | |
| 1020090104534 | – | – | – |
| KR20090104534 | – | – | – |
Members22
| Document | Office | Kind | |
|---|---|---|---|
| US2011106970A1 | United States of America | A1 | |
| WO2011053010A2 | World Intellectual Property Organization (WIPO) | A2 | |
| KR20110047775A | Republic of Korea | A | |
| WO2011053010A3 | World Intellectual Property Organization (WIPO) | A3 | |
| AU2010313957A1 | Australia | A1 | |
| EP2471002A2 | European Patent Office (EPO) | A2 | |
| CN102597984A | China | A | |
| JP2013509131A | Japan | A | |
| US8527581B2 | United States of America | B2 | |
| US2013326016A1 | United States of America | A1 | |
| RU2012122179A | Russian Federation | A | |
| AU2010313957B2 | Australia | B2 | |
| JP5688092B2 | Japan | B2 | |
| US9009224B2 | United States of America | B2 | |
| RU2550522C2 | Russian Federation | C2 | |
| JP2015100128A | Japan | A | |
| US2015195332A1 | United States of America | A1 | |
| CN102597984B | China | B | |
| EP2471002A4 | European Patent Office (EPO) | A4 | |
| US9467496B2 | United States of America | B2 | |
| KR101702659B1 | Republic of Korea | B1 | |
| EP2471002B1 | European Patent Office (EPO) | B1 |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Lapse for failure to pay maintenance feesLapsedPATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYLAPS | LAPS | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Fee paymentFPAY | FPAY | |
| Fee payment procedurePAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS |
Numbers
- Publication
- 20110106970
- Publication, DOCDB
- 2011106970
- Publication, EPODOC
- US2011106970
- Application
- 12915450
- Application, DOCDB
- 91545010
- Application, EPODOC
- US20100915450
Titles
- English
- APPARATUS AND METHOD FOR SYNCHRONIZING E-BOOK CONTENT WITH VIDEO CONTENT AND SYSTEM THEREOF
Classification
- CPC, 11
- G06F3/1431
- G06F15/16
- H04L67/02
- G06F3/147
- G09G2370/027
- G09G2380/14
- H04L65/4015
- H04L67/14
- H04N21/43074
- H04L65/1094
- G06F15/0291
- IPC, 1
- G06F15 16
- USPC, 1
- 709236000