System and method for cyber training of martial art on network

CLAIM FOR PRIORITY

0001This application claims priority to Korean Patent Application No. 10-2010-0082129 filed on Aug. 24, 2010, the entirety of which is incorporated herein by reference.

BACKGROUND

00021. Technical Field

0003Embodiments of the present invention relate in general to a system and method for virtual martial arts training using a network, and more specifically, to a system and method for virtual martial arts training using a network in which each of a plurality of terminals senses each motion of a user, compares the motion with a reference motion, displays the results as images, and exchanges the images with a server via the network, so that a trainee can effectively train in martial arts alone by having his or her motions corrected and can undertake an examination procedure without temporal and spatial constraints.

00042. Related Art

0005In the present invention, the term “martial arts” denotes various martial arts, such as taekwondo, kung fu, karate, qigong and kendo, various combative sports, such as boxing, wrestling and judo, and the like.

0006To train in a martial art, a trainee should normally attend a gym or academy. However, it is difficult for the busy people of today to train in martial arts due to temporal and spatial constraints.

0007As a conventional art for solving these problems, a method of receiving educational video data to train in martial arts or sports practiced daily and informing a user of the degree of training progress by remote online examination has been disclosed in Korean Patent Publication No. 2002-0041688 entitled “Method for Educating and Examining Accomplishment Levels of Martial Arts and Living Athletics Online.”

0008However, the conventional art provides only a one-way explanation-oriented educational function of simply playing an educational video. Since information is not exchanged in real time between a trainee and an apparatus, the trainee's posture cannot be corrected, and the trainee cannot effectively undertake an examination procedure alone.

SUMMARY

0009Accordingly, embodiments of the present invention are provided to substantially overcome one or more of the problems resulting from the constraints and disadvantages of the related art.

0010Embodiments of the present invention provide a system and method for virtual martial arts training using a network in which each of a plurality of terminals senses each motion of a user, compares the motion with a reference motion, displays the results as images, and exchanges the images with a server via the network to enable real-time information exchange and interaction between a trainee and the server in a house, a gym, or an academy without temporal and spatial constraints, so that the trainee can effectively train in martial arts alone by having his or her motions corrected and can undertake an examination procedure.

0011In some embodiments, a system for virtual martial arts training using a network includes: a user terminal configured to access the Internet to exchange user information with a network server, select a training discipline and grade or an examination discipline and grade to receive training progress information according to the selected training discipline and grade or examination progress information according to the selected examination discipline and grade and to execute a training program or an examination program, and transmit a difference value and a correction value together with a user motion image to perform training and examination functions; a network server configured to comprise user information management means configured to receive the user information from the user terminal, and compare the user information with previously stored information to allow a user to log in, training information management means configured to transmit the training progress information according to the training discipline and grade transmitted from the user terminal, receive the training results, perform updates using the training results, and manage the training results, examination information management means configured to transmit the examination progress information according to the examination discipline and grade transmitted from the user terminal, receive the examination results, perform updates using the examination results, and manage the examination results, examination and determination management means configured to determine the pass or failure of an examination based on the difference value transmitted from the user terminal, more specifically, determine pass or failure and a grade by relative evaluation within the corresponding category according to area-, age-, and sex-specific rankings, image information management means configured to receive the user motion image transmitted from the user terminal, perform updates using the user motion image, and manage the user motion image, and communication means configured to exchange information with the user terminal; data management means configured to comprise a user information database (DB) for storing the user information, a training information DB for storing the training progress information, an examination information DB for storing the examination progress information, an examination and determination DB for storing examination and determination information, and an image information DB for storing the user motion image, and configured to input and output the respective pieces of information in response to a request from the network server; and a network administrator terminal configured to access the network server to exchange network administrator information and manage the system.

0012The training information management means and the examination information management means may obtain the area-, age-, and sex-specific rankings based on the difference value and the correction value transmitted from the user terminal, and update the respective pieces of training and examination progress information, and the examination and determination management means may determine the pass or failure based on the difference value, more specifically, determine pass or failure and a grade by relative evaluation within the corresponding category according to the area-, age-, and sex-specific rankings.

0013The area in which the user terminal is located may be checked based on an Internet protocol (IP) address of the user allocated by an Internet service provider (ISP).

0014The user terminal may include: an input unit configured to receive the user information to allow the user to log in, and select a grade-specific training process or examination process; a motion recognition unit configured to detect a movement speed, a distance, a position, and an angle of the user to recognize the user motion; a position detector configured to detect a position of the user's feet on a plane; a data storage unit configured to previously store a movement speed, a distance, a position, and an angle of the reference motion, and store the user information, the determination result, and a grade-specific training process program and examination process program corresponding to the selection of the input unit; a controller configured to execute the training process program or the examination process program stored in the data storage unit according to the selection of the input unit, determine a user motion in three-dimensional (3D) space with reference to the user motion recognized by the motion recognition unit and the position of the user's feet detected by the position detector, compare the user motion with the reference motion previously stored in the data storage unit to calculate the difference value, generate the correction value for instructing the user to perform a correct motion based on the difference value, generate the user motion image using a previously stored virtual character, and generate a correction image and an explanatory phrase for the correction value; a main image display unit configured to merge the correction image and the explanatory phrase with the user motion image generated by the controller and display the merged image; and a communication unit configured to exchange the user information, the training progress information, the examination progress information, and the user motion image with the communication means of the network server to transfer the pieces of information and the user motion image to the controller.

0015The input unit may include: a login key configured to receive the user information and allow the user to log in; a training process selection key configured to select one training process to be performed from among a plurality of previously stored grade-specific training processes; and an examination process selection key configured to select one examination process to be performed from among a plurality of previously stored grade-specific examination processes.

0016The motion recognition unit may include a plurality of motion capture cameras configured to detect movement of a plurality of markers attached to the user's body using infrared photography to recognize the user motion.

0017The motion recognition unit may include one or a combination of a geomagnetic sensor configured to sense a direction of terrestrial magnetism, an acceleration sensor configured to sense acceleration by accelerating a piezoelectric material, and a gyro sensor configured to sense an angular acceleration based on a vertical force of a rotating angle. Here, the one or the combination of the sensors may be attached to the user's body or clothing.

0018The position detector may include a resistive touchpad configured to have a predetermined area and measure the position of coordinates pressed by the user's feet and formed of two panels stacked to generate resistance at a pressed portion.

0019The controller may include: a program execution module configured to execute the training process program or the examination process program stored in the data storage unit according to the selection of the training process selection key or the examination process selection key; a motion determination module configured to determine the user motion in 3D space with reference to the user motion recognized by the motion recognition unit and the position of the user's feet detected by the position detector; a comparison and determination module configured to calculate the difference value by comparing data of the user motion determined by the motion determination module with data of the reference motion previously stored in the data storage unit, and generate the correction value for instructing the user to perform the correct motion based on the difference value; and an image generation module configured to generate the user motion image using the previously stored virtual character, and generate the correction image using the difference value and the correction value of the comparison and determination module, and generate the explanatory phrase.

0020The image generation module may further generate an effect image and a background image according to the user motion image of the main image display unit, and include a background image display unit configured to display the effect image and the background image on a flat panel display (FPD) module.

0021The controller may further include: a sound generation module configured to generate sound effects and background music according to the main image, the effect image, and the background image generated by the image generation module; and a sound output unit configured to output the sound effects and the background music generated by the sound generation module through a speaker.

0022The main image display unit may include: 3D glasses worn by the user; and a 3D image display module configured to display a 3D image, to be viewed in three dimensions through the 3D glasses, on a screen.

0023The main image display unit may include a hologram image display module configured to display successive 3D images by generating interference fringe patterns using the principle of holography.

0024The main image display unit may include a head mounted display (HMD) module put on the user's head, and configured to display a realized image on an HMD screen.

0025The system may further include a user image capturing unit configured to capture an image of the user. Here, the controller may generate the user motion image using the image captured by the user image capturing unit.

0026In other embodiments, a method of virtually training in martial arts using a network includes: receiving, at user information management means of a network server accessing the Internet, user information transmitted from a user terminal, and comparing the user information with information previously stored in a user information DB to allow a user to log in; selecting and transmitting, at the user terminal, a training discipline and grade, reading, at training information management means, training progress information according to the training discipline and grade from a training information DB and transmitting the training progress information to the user terminal, and executing, at the user terminal, a training program according to the training progress information; selecting and transmitting, at the user terminal, an examination discipline and grade, reading, at examination information management means, examination progress information according to the examination discipline and grade from an examination information DB and transmitting the examination progress information to the user terminal, and executing, at the user terminal, an examination program according to the examination progress information; detecting at a motion recognition unit of the user terminal, a movement speed, a distance, a position, and an angle of the user to recognize a user motion, detecting, at a position detector, a position of the user's feet on a plane, and determining, at a controller, a user motion in <b>3</b>D space with reference to the user motion recognized by the motion recognition unit and the position of the user's feet detected by the position detector; comparing, at the controller of the user terminal, the user motion with a reference motion previously stored in a data storage unit to generate a difference value and a correction value, generating a user motion image using a previously stored virtual character, generating a correction image and an explanatory phrase for the correction value, merging the correction image and the explanatory phrase with the user motion image to display the merged image on a main image display unit, and outputting sound; transmitting, at the user terminal, the correction value and the user motion image, receiving and storing, at image information management means, the user motion image in an image information DB, obtaining, at the training information management means, area-, age-, and sex-specific training rankings according to the correction value, updating the training information DB with the training progress information, and transmitting the training progress information to the user terminal, and receiving and displaying, at the user terminal, the training results on a screen; and transmitting, at the user terminal, the difference value and the user motion image, receiving and storing, at the image information management means, the user motion image in the image information DB, obtaining, at the examination information management means, area-, age-, and sex-specific examination rankings based on the difference value, determining, at examination and determination management means, the pass or failure based on the difference value, more specifically, determining pass or failure and a grade by relative evaluation within the corresponding category according to the area-, age-, and sex-specific examination rankings, updating the examination information DB with the examination progress information, and transmitting the examination progress information to the user terminal, and receiving and displaying, at the user terminal, the examination results on the screen.

0027The area in which the user terminal is located may be checked based on the IP of the user allocated by an ISP.

0028The recognizing the user motion may include attaching a plurality of markers to the user's body and detecting movement of the markers using infrared photography and using a plurality of motion capture cameras to recognize the user motion.

0029The recognizing the user motion may include sensing a direction of terrestrial magnetism using a geomagnetic sensor attached to the user's body or clothing, accelerating a piezoelectric material and sensing an acceleration using an acceleration sensor, or sensing an angular acceleration based on a vertical force of a rotating angle using a gyro sensor, to recognize the user motion.

0030The displaying the merged image may include further generating, at the controller, an effect image and a background image, and displaying, at a background image display unit, the effect image and the background image on the screen.

0031The outputting the sound may include generating, at the controller, a voice explanation corresponding to the correction value and sound effects and background music according to the voice explanation, and outputting, at a sound output unit, the voice explanation, the sound effects, and the background music through a speaker.

0032The displaying the merged image may include displaying a 3D image to be viewed through 3D glasses worn by the user on the screen using a 3D image display module, displaying successive 3D images by generating interference fringe patterns based on the principle of holography using a hologram image display module, or displaying a realized image on an HMD screen of an HMD module put on the user's head.

BRIEF DESCRIPTION OF DRAWINGS

0033Embodiments of the present invention will become more apparent by describing in detail embodiments of the present invention with reference to the accompanying drawings, in which:

0034<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram of a system for virtual martial arts training using a network according to embodiments of the present invention;

0035<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram of the user terminal of <figref idrefs="DRAWINGS">FIG. 1</figref>;

0036<figref idrefs="DRAWINGS">FIG. 3</figref> is a perspective view illustrating a system for virtual martial arts training implemented using a hologram according to an embodiment of the present invention;

0037<figref idrefs="DRAWINGS">FIG. 4</figref> is a plan view of <figref idrefs="DRAWINGS">FIG. 3</figref>;

0038<figref idrefs="DRAWINGS">FIG. 5</figref> is a conceptual diagram showing an example in which an image is implemented using a hologram display module;

0039<figref idrefs="DRAWINGS">FIG. 6</figref> is a conceptual diagram showing an example in which an image is implemented using a three-dimensional (3D) image display module;

0040<figref idrefs="DRAWINGS">FIG. 7</figref> illustrates the 3D glasses of <figref idrefs="DRAWINGS">FIG. 6</figref> according to an embodiment of the present invention;

0041<figref idrefs="DRAWINGS">FIG. 8</figref> is a conceptual diagram showing an example in which a head mounted display (HMD) module is used;

0042<figref idrefs="DRAWINGS">FIG. 9</figref> illustrates the HMD module of <figref idrefs="DRAWINGS">FIG. 8</figref> according to an embodiment of the present invention;

0043<figref idrefs="DRAWINGS">FIG. 10</figref> shows a screen in which a user motion and correction values are displayed according to embodiments of the present invention; and

0044<figref idrefs="DRAWINGS">FIGS. 11A to 11C</figref> are flowcharts illustrating a method of virtually training in martial arts according to embodiments of the present invention.

DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION

0045Embodiments of the present invention are disclosed herein. However, specific structural and functional details disclosed herein are merely representative for purposes of describing embodiments of the present invention, but embodiments of the present invention may be embodied in many alternative forms and should not be construed as being limited to embodiments of the present invention set forth herein.

0046Accordingly, while the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that there is no intent to limit the invention to the particular forms disclosed, but on the contrary, the invention should include all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like numbers refer to like elements throughout the description of the figures.

0047<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram of a system for virtual martial arts training using a network according to embodiments of the present invention.

0048As shown in the drawing, the system includes a network administrator terminal <b>10</b>, a network server <b>20</b>, user information management means <b>21</b>, training information management means <b>22</b>, examination information management means <b>23</b>, examination and determination management means <b>24</b>, image information management means <b>25</b>, communication means <b>26</b>, data management means <b>30</b>, a user information database (DB) <b>31</b>, a training information DB <b>32</b>, an examination information DB <b>33</b>, an examination and determination DB <b>34</b>, an image information DB <b>35</b>, the Internet <b>40</b>, and a user terminal <b>50</b>.

0049The user terminal <b>50</b> may be installed in a house, a gym, or an academy and used without temporal and spatial constraints.

0050The user terminal <b>50</b> accesses the Internet <b>40</b> to exchange user information with the network server <b>20</b>, selects a training discipline and grade to receive training progress information according to the selected training discipline and grade, or an examination discipline and grade to receive examination progress information according to the selected examination discipline and grade, executes a training program or an examination program, and performs training and examination functions while transmitting a difference value and a correction value together with a user motion image. A detailed constitution of the user terminal will be described later with reference to appended <figref idrefs="DRAWINGS">FIGS. 2 to 4</figref>.

0051The network server <b>20</b> includes the user information management means <b>21</b>, the training information management means <b>22</b>, the examination information management means <b>23</b>, the examination and determination management means <b>24</b>, the image information management means <b>25</b>, and the communication means <b>26</b>.

0052The user information management means <b>21</b> receives the user information from the user terminal <b>50</b>, compares the received user information with previously stored information, and allows a user to log in.

0053The training information management means <b>22</b> transmits the training progress information according to the training discipline and grade transmitted from the user terminal <b>50</b>, and receives the training results to perform updates and manage the training result.

0054The training progress information may include information such as the number of times of training, a date, an access time, and a cumulative time, for respective disciplines and grades.

0055The examination information management means <b>23</b> transmits the examination progress information according to the examination discipline and grade transmitted from the user terminal <b>50</b>, and receives the examination results to perform updates and manage the examination results.

0056The examination and determination management means <b>24</b> determines the pass or failure of the examination based on the difference value transmitted from the user terminal <b>50</b>. More specifically, the examination and determination management means <b>24</b> determines a pass or a failure and a grade using relative evaluation within the corresponding category according to area-, age-, and sex-specific rankings.

0057The image information management means <b>25</b> receives the user motion image from the user terminal <b>50</b> to perform updates and manage the received user motion image.

0058The communication means <b>26</b> exchanges information with the user terminal <b>50</b>.

0059The data management means <b>30</b> inputs and outputs the respective pieces of information in response to a request from the network server <b>20</b>. To this end, the data management means <b>30</b> includes the user information DB <b>31</b> for storing the user information, the training information DB <b>32</b> for storing the training progress information, the examination information DB <b>33</b> for storing the examination progress information, the examination and determination DB <b>34</b> for storing examination and determination information, and the image information DB <b>35</b> for storing the user motion image.

0060The network administrator terminal <b>10</b> accesses the network server <b>20</b> to exchange network administrator information.

0061The training information management means <b>22</b> and the examination information management means <b>23</b> obtain the area-, age-, and sex-specific rankings based on the difference value and the correction value, and update the respective pieces of training and examination progress information.

0062The area in which the user terminal <b>50</b> is located may be checked based on an Internet protocol (IP) address of the user allocated by an Internet service provider (ISP).

0063<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram of the user terminal of <figref idrefs="DRAWINGS">FIG. 1</figref>. <figref idrefs="DRAWINGS">FIG. 3</figref> is a perspective view illustrating a system for virtual martial arts training implemented using a hologram according to an embodiment of the present invention, and <figref idrefs="DRAWINGS">FIG. 4</figref> is a plan view of <figref idrefs="DRAWINGS">FIG. 3</figref>.

0064As shown in the drawings, the user terminal <b>50</b> according to embodiments of the present invention includes an input unit <b>100</b>, a login key <b>110</b>, a training process selection key <b>120</b>, an examination process selection key <b>130</b>, a motion recognition unit <b>200</b>, motion capture cameras <b>210</b>, a geomagnetic sensor <b>220</b>, an acceleration sensor <b>230</b>, a gyro sensor <b>240</b>, a position detector <b>300</b>, a resistive touchpad <b>310</b>, a controller <b>400</b>, a program execution module <b>410</b>, a motion determination module <b>420</b>, a comparison and determination module <b>430</b>, an image generation module <b>450</b>, a sound generation module <b>460</b>, a data storage unit <b>500</b>, a main image display unit <b>600</b>, a three-dimensional (3D) image display module <b>610</b>, a hologram image display module <b>620</b>, a head mounted display (HMD) module <b>630</b>, a background image display unit <b>700</b>, a flat panel display (FPD) module <b>710</b>, a sound output unit <b>800</b>, speakers <b>810</b>, and a communication unit <b>1100</b>.

0065The input unit <b>100</b> receives the user information to allow the user to log in, and selects a grade-specific training process or examination process.

0066To this end, the input unit <b>100</b> includes the login key <b>110</b>, the training process selection key <b>120</b>, and the examination process selection key <b>130</b>.

0067The login key <b>110</b> identifies the user based on the user information, for example, a name, an address, a birth date and a resident registration number, input by the user, and allows the user to log in. The user may log in by inputting numbers, characters, etc. using the login key <b>110</b> or using a card or an electronic chip.

0068The training process selection key <b>120</b> selects one training process to be performed from among a plurality of the previously stored grade-specific training processes, and the examination process selection key <b>130</b> selects the corresponding grade-specific examination process.

0069The motion recognition unit <b>200</b> recognizes a user motion. To this end, the motion recognition unit <b>200</b> may include the plurality of motion capture cameras <b>210</b> as shown in <figref idrefs="DRAWINGS">FIG. 3</figref>.

0070The plurality of motion capture cameras <b>210</b> are disposed to take pictures of the user from various angles, and recognize a motion of the user by detecting motions of a plurality of markers attached to the user's body using infrared photography. Here, the markers may be attached to the user's head, torso, wrists, and ankles, and the user's body may be thought of as a set of articular models having a link structure.

0071As generally known, motion capture denotes an operation of digitally recording a motion of a human body using sensors attached to the body. This technology is used to cause a virtual character to perform the same motion using position values of sensors attached to several parts of an actual body. In other words, motion capture may refer to a process of storing a motion of an actual object as numerical data and transferring the motion data to a virtual object generated by a computer. In this specification, “motion capture” refers to an operation of inputting a motion of an actual object to a computer and storing the motion as numerical data in the computer. In brief, the process includes attaching a sensor capable of sensing a motion to an object and storing numerical data of a motion of the object at regular intervals. Images processed by computer graphics (CG) technology using motion capture show a soft curve, that is, a realistic motion, and thus have high quality. To this end, special markers (sensors) are attached to a person's joints. Then, position and rotational data of the markers is recognized by a special device in real time to generate a motion data set or a motion curve. In an infrared reflector scheme, six to eight cameras two-dimensionally detect markers at the joints of a motion actor and three-dimensionally track and capture a motion.

0072Alternatively, the motion recognition unit <b>200</b> may include one or a combination of the geomagnetic sensor <b>220</b>, the acceleration sensor <b>230</b>, and the gyro sensor <b>240</b> attached to the user's body.

0073The geomagnetic sensor <b>220</b> senses a direction of terrestrial magnetism. The geomagnetic sensor <b>220</b> senses the magnetic field of the earth to obtain direction information, such as north, south, east and west, like a compass.

0074The acceleration sensor <b>230</b> senses acceleration by accelerating a piezoelectric material. The acceleration sensor <b>230</b> makes use of a principle whereby an electric charge is generated when a general piezoelectric material accelerates.

0075The gyro sensor <b>240</b> senses an angular acceleration based on a vertical force of a rotating angle. A Coriolis force is generated in the vertical direction of a rotating angle, and the gyro sensor <b>240</b> senses the vertical force using the same principle as the acceleration sensor.

0076The position detector <b>300</b> may detect a position of the user and a shift of the user's weight, etc. by detecting a position and the pressure of the user's feet on a support surface. The resistive touchpad <b>310</b> disposed in the form of a footboard on a bottom surface may be employed by the position detector <b>300</b>.

0077The resistive touchpad <b>310</b> has a predetermined area and is formed of two panels stacked to generate resistance at a pressed portion, thus measuring a position and pressure of the coordinates pressed by the user's feet.

0078The data storage unit <b>500</b> previously stores a movement speed, a distance, a position, and an angle of a reference motion, and stores a grade-specific training process program and examination process program corresponding to the selection of the input unit <b>100</b>, the user information, and the determination result.

0079The data storage unit <b>500</b> may be various data storage means such as a hard disk drive (HDD) and random-access memory (RAM).

0080The controller <b>400</b> may execute the training process program or the examination process program stored in the data storage unit <b>500</b> according to the selection of the input unit <b>100</b>, recognize the user motion using the motion recognition unit <b>200</b>, determine an accurate motion of the user in 3D space according to the position of the user detected by the position detector <b>300</b>, compare a movement speed, a distance, a position, and an angle of the determined user motion with those of the reference motion stored in the data storage unit <b>500</b> to calculate the difference value, generate the correction value for instructing the user to perform a correct motion based on the difference value so that the generated correction value can be stored in the data storage unit <b>500</b>, generate the user motion image using a previously stored virtual character, and generate a correction image and an explanatory phrase for the correction value.

0081To this end, the controller <b>400</b> includes the program execution module <b>410</b>, the motion determination module <b>420</b>, the comparison and determination module <b>430</b>, the image generation module <b>450</b>, and the sound generation module <b>460</b>.

0082The program execution module <b>410</b> executes the training process program or the examination process program stored in the data storage unit <b>500</b> according to the selection of the training process selection key <b>120</b> or the examination process selection key <b>130</b>.

0083The motion determination module <b>420</b> recognizes the user motion using the motion recognition unit <b>200</b>, and determines the accurate motion of the user in the 3D space according to the position of the user detected by the position detector <b>300</b>.

0084The comparison and determination module <b>430</b> may compare the movement speed, the distance, the position, and the angle of the user motion determined by the motion determination module <b>420</b> with those of the reference motion stored in the data storage unit <b>500</b> to calculate the difference value, and generate the correction value for the user based on the difference value.

0085The comparison and determination module <b>430</b> generates the correction value for instructing the user to perform the correct motion according to the calculated difference value. More specifically, the correction value has a predetermined range. The number of times the user has trained may be counted, and the range of the correction value may be gradually reduced as the number of times of training increases, so that the accuracy of the correction value increases. Thus, the user can naturally develop and improve skills in the range within the ability of the user's body.

0086The image generation module <b>450</b> generates the user motion image using the previously stored virtual character, and generates the correction image and the explanatory phrase based on the difference value and the correction value calculated by the comparison and determination module <b>430</b>. For example, the correction image may be a figure expressing the correction value in the form of a vector, and the explanatory phrase may be an equation or sentence in which the correction value is recorded.

0087The main image display unit <b>600</b> merges the correction image and the explanatory phrase with the user motion image generated by the controller <b>400</b> and displays the merged image.

0088The communication unit <b>1100</b> exchanges information with the communication means <b>26</b> of the network server <b>20</b>.

0089Embodiments of the present invention may further include a user image capturing unit <b>900</b> which captures an image of the user. At this time, the controller <b>400</b> may generate the user motion image using the image actually captured by the user image capturing unit <b>900</b>.

0090The sound generation module <b>460</b> generates a voice explanation corresponding to the user motion image and the correction image. Also, the sound generation module <b>460</b> may generate sound effects and background music according to the voice explanation.

0091One of the 3D image display module <b>610</b>, the hologram image display module <b>620</b>, and the HMD module <b>630</b> may be employed by the main image display unit <b>600</b>.

0092Also, embodiments of the present invention may further include the background image display unit <b>700</b> displaying an effect image and a background image on the FPD module <b>710</b>. The effect image and the background image are generated by the image generation module <b>450</b>. Here, the effect image and the background image may be generated according to the user motion image displayed by the main image display unit <b>600</b>.

0093For example, a blue star may be displayed as an effect image of a kick motion, and a red circle may be displayed as an effect image of a punch motion. Otherwise, while an image of fireworks is displayed as a background image, the respective effect images may be displayed to overlay the background image.

0094As shown in <figref idrefs="DRAWINGS">FIG. 5</figref>, the hologram image display module <b>620</b> generates interference fringe patterns using the principle of holography, thereby displaying successive 3D images.

0095<figref idrefs="DRAWINGS">FIG. 5</figref> is a conceptual diagram showing an example in which an image is implemented using a hologram display module. As is generally known, a hologram denotes a 3D image generated using the principle of holography and seen to be the same as an actual object, and also a medium in which interference fringe patterns showing a 3D figure are recorded. The principle of holography is that a laser directly emits one beam of output light to a screen and emits another beam of output light to an object that the user wants to see. Here, the beam directly illuminating the screen is referred to as a reference beam, and the other beam illuminating the object is referred to as an object beam. Since the object beam is light that has been reflected from respective surfaces of the object, phase differences (distances from the respective surfaces of the object to the screen) differ from each other depending on the surfaces of the object. Here, the reference beam that has not been modified interferes with the object beam, and the corresponding interference fringe patterns are shown on a screen. A film in which such interference fringe patterns are stored is referred to as a hologram. To display the stored image again, the beams used for recording should be projected to the screen again. Since only a wave having the same frequency as a wave for the recording is three-dimensionally displayed and waves not having the same wavelength and phase as the wave for the recording pass through the stored hologram with no effect, the beams used for replay should be exactly the same as the reference beam used for the recording.

0096As shown in <figref idrefs="DRAWINGS">FIGS. 6 and 7</figref>, the 3D image display module <b>610</b> displays a 3D image, which is viewed in three dimensions through 3D glasses <b>611</b> worn by the user, on the screen. The main image display unit <b>600</b> may be a general FPD, such as a liquid crystal display (LCD), a light emitting diode (LED) display, or a plasma display panel (PDP), and used with the 3D glasses <b>611</b> worn by the user, so that a 3D image can be displayed on the screen.

0097<figref idrefs="DRAWINGS">FIG. 6</figref> is a conceptual diagram showing an example in which an image is implemented using a 3D image display module, and <figref idrefs="DRAWINGS">FIG. 7</figref> illustrates the 3D glasses of <figref idrefs="DRAWINGS">FIG. 6</figref> according to an embodiment of the present invention. The 3D glasses <b>611</b> may be polarized glasses or liquid crystal shutter glasses. The polarized glasses allow images captured by two cameras to be separately viewed according to vertical and horizontal light information, thereby giving the impression of 3D.

0098The liquid crystal shutter glasses enable the user to see with both of his or her eyes in alternation by alternately closing the glasses, thereby giving the impression of 3D. The liquid crystal shutter glasses require electric power, and may be implemented to have a battery and to be rechargeable in embodiments of the present invention.

0099The 3D glasses <b>611</b> according to embodiments of the present invention have temples, but the temples may be formed as a band to improve the feeling of wearing them.

0100<figref idrefs="DRAWINGS">FIGS. 8 and 9</figref> illustrate an example in which the HMD module <b>630</b> is employed by the main image display unit <b>600</b>.

0101<figref idrefs="DRAWINGS">FIG. 8</figref> is a conceptual diagram showing an example in which an HMD module is used, and <figref idrefs="DRAWINGS">FIG. 9</figref> illustrates the HMD module of <figref idrefs="DRAWINGS">FIG. 8</figref> according to an embodiment of the present invention. The HMD module <b>630</b> is a display device put on the user's head, and displays an image generated by the image generation module <b>450</b> on an HMD screen.

0102The HMD module <b>630</b> is classified as a mono or stereo type, and an open or closed type according to the shape. Like in a theater, the HMD module <b>630</b> limits the user's vision, thereby enabling immersion in an image. As a screen of the HMD module <b>630</b>, a cathode ray tube (CRT) or LCD is used. In embodiments of the present invention, the LCD may be used to reduce power consumption and improve the feeling of wearing them.

0103Meanwhile, as illustrated in <figref idrefs="DRAWINGS">FIG. 2</figref>, the background image display unit <b>700</b> displays the effect image and the background image generated by the image generation module <b>450</b>.

0104To this end, the general FPD module <b>710</b> may be employed by the background image display unit <b>700</b>. The FPD module <b>710</b> refers to any FPD such as an LCD, an LED display, or a PDP.

0105The sound output unit <b>800</b> outputs the voice explanation generated to correspond to the correction image by the sound generation module <b>460</b> through the speakers <b>810</b>. Together with the voice explanation, the sound output unit <b>800</b> may output sound effects and background music for the main image, the effect image, and the background image.

0106Although two speakers are shown in the drawings of the present invention, five or more speakers may be disposed to implement 3D sounds such as 5.1 CH sounds.

0107<figref idrefs="DRAWINGS">FIG. 10</figref> shows a screen in which a user motion and correction values are displayed according to embodiments of the present invention. The image generation module <b>450</b> according to embodiments of the present invention may generate the user motion image using the previously stored virtual character or a user image, generate the correction image using the difference value and the correction value calculated by the comparison and determination module <b>430</b>, and output the correction image overlaid with the corresponding explanatory phrase. In other words, as shown in the drawing, data of an angle, a speed, a power, etc. is represented by characters at respective parts of the user's body shown in the main image, so that the user can check the accuracy of a motion by him or herself.

0108<figref idrefs="DRAWINGS">FIGS. 11A to 11C</figref> are flowcharts illustrating a method of virtually training in martial arts using a network according to embodiments of the present invention. Operation of embodiments of the present invention constituted as described above will be described with reference to the appended drawings.

0109First, the user information management means <b>21</b> of the network server <b>20</b> accessing the Internet <b>40</b> receives user information transmitted from the user terminal <b>50</b>, compares the user information with information previously stored in the user information DB <b>31</b>, and allows a user to log in (S<b>101</b> to <b>5103</b>)

0110At this time, using the login key <b>110</b> of the input unit <b>100</b> of the user terminal <b>50</b>, the user inputs the user information with numerals, characters, etc., thereby logging in to the network server <b>20</b>. Alternatively, the user may log in using an integrated circuit (IC) card or electronic chip to which the user information has been input.

0111When logging in has completed, one training process to be performed may be selected from among a plurality of previously stored grade-specific training processes using the training process selection key <b>120</b> (S<b>104</b>). On the other hand, one examination process to be performed may be selected from among a plurality of previously stored grade-specific examination processes using the examination process selection key <b>130</b> (S<b>104</b>).

0112When a training process is selected, the user terminal <b>50</b> transmits a selected training discipline and grade to the network server <b>20</b>, the training information management means <b>22</b> reads training progress information according to the training discipline and grade from the training information DB <b>32</b> and transmits the training progress information to the user terminal <b>50</b>, and the user terminal <b>50</b> executes a training program according to the training progress information (S<b>105</b> to S<b>107</b>).

0113On the other hand, when an examination process is selected, the user terminal <b>50</b> transmits a selected examination discipline and grade to the network server <b>20</b>, the examination information management means <b>23</b> reads examination progress information according to the examination discipline and grade from the examination information DB <b>33</b> and transmits the examination progress information to the user terminal <b>50</b>, and the user terminal <b>50</b> executes an examination program according to the examination progress information (S<b>108</b> to S<b>110</b>).

0114When the training or examination program is executed, the motion recognition unit <b>200</b> of the user terminal <b>50</b> detects a movement speed, a distance, a position, and an angle of the user, thereby recognizing a user motion (S<b>111</b>).

0115Also, the position detector <b>300</b> detects a position of the user's feet on a plane, and the controller <b>400</b> determines an accurate user motion in 3D space with reference to the user motion recognized by the motion recognition unit <b>200</b> and the position of the user's feet detected by the position detector <b>300</b> (S<b>112</b> and S<b>113</b>).

0116Also, the comparison and determination module <b>430</b> of the controller <b>400</b> of the user terminal <b>50</b> compares the user motion with a reference motion previously stored in the data storage unit <b>500</b>, thereby generating a difference value and a correction value (S<b>114</b>).

0117The image generation module <b>450</b> generates a user motion image using a previously stored virtual character, and also generates a correction image and an explanatory phrase for the correction value (S<b>115</b>).

0118Also, the main image display unit <b>600</b> merges the correction image and the explanatory phrase with the user motion image generated by the image generation module <b>450</b> and displays the merged image, and the sound output unit <b>800</b> outputs sound generated by the sound generation module <b>460</b> (S<b>116</b> and S<b>117</b>).

0119Recognizing the user motion (S<b>111</b>) may include attaching a plurality of markers to the user's body and detecting movement of the markers using infrared photography and using the plurality of motion capture cameras <b>210</b> to recognize the user motion.

0120Also, recognizing the user motion (S<b>111</b>) may include sensing a direction of terrestrial magnetism using the geomagnetic sensor <b>220</b> attached to the user's body or clothing, accelerating a piezoelectric material and sensing an acceleration using the acceleration sensor <b>230</b>, or sensing an angular acceleration based on a vertical force of a rotating angle using the gyro sensor <b>240</b>, to recognize the user motion.

0121Displaying the main image (S<b>116</b>) includes further generating, at the image generation module <b>450</b> of the controller <b>400</b>, an effect image and a background image, and displaying, at the background image display unit <b>700</b>, the effect image and the background image on a screen.

0122Displaying the main image (S<b>116</b>) includes displaying a 3D image viewed through 3D glasses worn by the user on the screen using the 3D image display module <b>610</b>, displaying successive 3D images by generating interference fringe patterns based on the principle of holography using the hologram image display module <b>620</b>, or displaying a realized image on an HMD screen of the HDM module <b>630</b> put on the user's head.

0123Outputting the sound (S<b>117</b>) includes generating, at the sound generation module <b>460</b> of the controller <b>400</b>, a voice explanation corresponding to the correction value and sound effects and background music according to the voice explanation, and outputting, at the sound output unit <b>800</b>, the voice explanation, the sound effects, and the background music through the plurality of speakers <b>810</b>.

0124The detailed constitution of the user terminal <b>50</b> operating in this way has been described above with reference to <figref idrefs="DRAWINGS">FIGS. 2 to 10</figref>, and will not be reiterated.

0125After this, the user terminal <b>50</b> executing the training program transmits the correction value and the user motion image to the network server <b>20</b>, and the image information management means <b>25</b> of the network server <b>20</b> receives and stores the user motion image in the image information DB <b>35</b> (S<b>118</b> to S<b>120</b>).

0126Also, the training information management means <b>22</b> obtains area-, age-, and sex-specific training rankings according to the correction value, updates the training information DB <b>32</b> with the training progress information, and transmits the training progress information to the user terminal <b>50</b>, and the user terminal <b>50</b> receives and displays the training result on the screen (S<b>121</b> to S<b>123</b>).

0127On the other hand, the user terminal <b>50</b> executing the examination program transmits the difference value of the user motion and the user motion image to the network server <b>20</b>, and the image information management means <b>25</b> receives and stores the user motion image in the image information DB <b>35</b> (S<b>124</b> to S<b>126</b>).

0128Also, the training information management means <b>23</b> obtains area-, age-, and sex-specific examination rankings based on the difference value, and determines the pass or failure based on the difference value transmitted from the examination and determination management means <b>24</b> (S<b>127</b> and S<b>128</b>). At this time, the examination and determination management means <b>24</b> determines a pass or a failure and a grade by relative evaluation within the corresponding category according to the area-, age-, and sex-specific rankings.

0129The area in which the user terminal <b>50</b> is located may be checked based on an IP of the user allocated by an ISP.

0130After this, the examination information DB <b>33</b> is updated with the examination progress information, the examination progress information is transmitted to the user terminal <b>50</b>, and the user terminal <b>50</b> receives and displays the examination results on the screen (S<b>129</b> and S<b>130</b>).

0131In embodiments of the present invention configured as described above, many difference values of a motion, such as an angle of an upper body, an angle of a knee, the rotatability of a body and a portion of a foot used, based on a body type, height, weight or the like of the user can be detected depending on the accuracy of detection. Also, a standard motion of a model who is the most similar to the trainee may be set as a reference by classifying respective persons according to body type, height, weight, etc., so that a difference value can be calculated.

0132For example, a motion of a cyber master may be shown in advance on a video screen. Although a front kick can be performed while a body is moving back, force can be accurately applied by moving the weight forward in order to attack a front counterpart.

0133While making a preparatory posture, the cyber master outputs a voice instructing the user to kick the cyber master him or herself. Various words may be output depending on the circumstances. As an example, the voice “You must come forward to kick me. I'm ready. Kick me while coming forward. Here!” may be output.

0134The cyber master may explain the evaluation of a motion and strength of a kick as follows: “Very good. Attack my face this time. Here!”, “Your knee was too low for that attack. Pull your knee up a bit more before you kick. Face kick again. Here!,” and “Excellent attack.”

0135In the case of a correct attack, the cyber master in the screen may be knocked down, etc. to show a reaction to the strength. Alternatively, a color effect may be used for a correct attack. For example, blue light may be displayed.

0136When such a training process or examination process has completed, the user terminal <b>50</b> accessing the network server <b>20</b> logs out, and the system is finished (S<b>131</b> and S<b>132</b>).

0137In the above-described system and method for virtual martial arts training using a network according to embodiments of the present invention, each of a plurality of terminals senses each motion of a user, compares the motion with a reference motion, displays the results as images, and exchanges the images with a server via the network. Thus, real-time information exchange and interaction is enabled between a trainee and the server in a house, a gym, or an academy without temporal and spatial constraints, and the trainee alone can effectively train in martial arts by having his or her motions corrected and can effectively undertake an examination procedure.

0138In addition to the field of martial arts, embodiments of the present invention can be applied to various fields in which it is possible to learn standardized motions, for example, dance, gymnastics, and sports.

0139While the embodiments of the present invention and their advantages have been described in detail, it should be understood that various changes, substitutions and alterations may be made herein without departing from the scope of the invention.