Systems and methods for time-based athletic activity measurement and display
20 claims: 3 independent, 17 dependent
- 1スポーツ選手と関連付けられたアスレチックパラメータ測定装置であって、 ディスプレイと、 プロセッサと、 少なくとも一つのアスレチックパラメータ測定センサと、を備え、 前記アスレチックパラメータ測定装置は、 アスレチック活動セッション中の前記スポーツ選手のアスレチックデータを検出し、 前記プロセッサによって、前記アスレチック活動セッション中の前記スポーツ選手の映像データを受信し、 前記プロセッサによって、前記検出されたアスレチックデータと前記受信された映像データを用いて、前記スポーツ選手の少なくとも一つのメトリックを算出し、ここで、前記少なくとも一つのメトリックは前記スポーツ選手のジャンプ高さメトリック と前記スポーツ選手の衝撃メトリックとの少なくとも一方 を含み、 前記プロセッサによって前記ディスプレイ上に、前記アスレチック活動セッション中に、前記少なくとも一つのメトリックの表現を表示し、ここで、前記少なくとも一つのメトリックは、 ジャンプ中の前記スポーツ選手の 前記映像データの再生中に表示されるオーバーレイ表示として、前記映像データとともに記録される、ように構成されている、アスレチックパラメータ測定装置。
- 2前記オーバーレイ表示は、前記ジャンプ中の前記スポーツ選手の衝撃の大きさの指標を有する矢印を含む 、請求項1に記載のアスレチックパラメータ測定装置。
- 3前記少なくとも一つのアスレチックパラメータ測定センサは、加速度計を含む、請求項1に記載のアスレチックパラメータ測定装置。
- 4前記加速度計は、圧電加速度計を含む、請求項3に記載のアスレチックパラメータ測定装置。
- 5前記アスレチックパラメータ測定装置は、 前記スポーツ選手の識別を前記アスレチックパラメータ測定装置に関連付け、 前記少なくとも一つのメトリックおよび前記識別を、前記アスレチックパラメータ測定装置とは離隔して配置されているコンピューティング装置へ送信する、ようにさらに構成されている、請求項1に記載のアスレチックパラメータ測定装置。
- 6前記アスレチックパラメータ測定装置は、前記少なくとも一つのメトリックおよび前記識別を、2400MHzおよび2483.5MHzの周波数信号を介して前記コンピューティング装置へ送信するようにさらに構成されている、請求項5に記載のアスレチックパラメータ測定装置。
- 7前記アスレチックパラメータ測定装置は、前記少なくとも一つのメトリックおよび前記識別を、前記コンピューティング装置へ実時間で送信するようにさらに構成されている、請求項5に記載のアスレチックパラメータ測定装置。
- 8前記オーバーレイ表示は、 前記アスレチック活動セッションの別の部分の映像データ、あるいは、前記スポーツ選手または他のスポーツ選手の他の前記アスレチック活動セッションの映像データを含む 、請求項1に記載のアスレチックパラメータ測定装置。
- 9スポーツ選手が少なくとも一つのアスレチックパラメータ測定センサを装着している間のアスレチック活動セッション中に、前記センサによって、前記スポーツ選手のアスレチックデータを検出し、 アスレチックパラメータ測定装置のプロセッサによって、前記アスレチック活動セッション中の前記スポーツ選手の映像データを受信し、ここで、前記映像データの記録は前記センサの出力に基づいて開始され、 前記プロセッサによって、前記検出されたアスレチックデータと前記受信された映像データを用いて、前記スポーツ選手の少なくとも一つのメトリックを算出し、ここで、前記少なくとも一つのメトリックは前記スポーツ選手のジャンプ高さメトリック と前記スポーツ選手の衝撃メトリックとの少なくとも一方 を含み、 前記プロセッサによって前記アスレチックパラメータ測定装置のディスプレイ上に、前記アスレチック活動セッション中に、前記少なくとも一つのメトリックの表現を表示し、ここで、前記少なくとも一つのメトリックは、 ジャンプ中の前記スポーツ選手の 前記映像データの再生中に表示されるオーバーレイ表示として、前記映像データとともに記録される、ことを含む方法。
- 10前記アスレチックパラメータ測定センサは、力センサを含む、請求項9に記載の方法。
- 11前記アスレチックパラメータ測定センサは、加速度計を含む、請求項9に記載の方法。
- 12前記オーバーレイ表示は、前記ジャンプ中の前記スポーツ選手の衝撃の大きさの指標を有する矢印を含む 、請求項9に記載の方法。
- 13前記スポーツ選手の識別を、前記アスレチックパラメータ測定装置に関連付け、 前記少なくとも一つのメトリックおよび前記識別を、前記アスレチックパラメータ測定装置とは離隔して配置されているコンピューティング装置へ送信する、ことをさらに含む、請求項9に記載の方法。
- 14前記アスレチックパラメータ測定装置は、前記少なくとも一つのメトリックおよび前記識別を、前記コンピューティング装置へ実時間で送信するように構成されている、請求項13に記載の方法。
- 15前記オーバーレイ表示は、 前記アスレチック活動セッションの別の部分の映像データ、あるいは、前記スポーツ選手または他のスポーツ選手の他の前記アスレチック活動セッションの映像データを含む 、請求項9に記載の方法。
- 16スポーツ選手が少なくとも一つのアスレチックパラメータ測定センサを装着している間のアスレチック活動セッション中に、前記センサによって、前記スポーツ選手のアスレチックデータを検出し、 アスレチックパラメータ測定装置のプロセッサによって、前記アスレチック活動セッション中の前記スポーツ選手の映像データを受信し、 前記プロセッサによって、前記検出されたアスレチックデータと前記受信された映像データを用いて、前記スポーツ選手の少なくとも一つのメトリックを算出し、ここで、前記少なくとも一つのメトリックは前記スポーツ選手のジャンプ高さメトリック と前記スポーツ選手の衝撃メトリックとの少なくとも一方 を含み、 前記プロセッサによって前記アスレチックパラメータ測定装置のディスプレイ上に、前記アスレチック活動セッション中に、前記少なくとも一つのメトリックの表現を表示し、ここで、前記少なくとも一つのメトリックは、 ジャンプ中の前記スポーツ選手の 前記映像データの再生中に表示されるオーバーレイ表示として、前記映像データとともに記録される、ことを含む方法。
- 17前記アスレチックパラメータ測定センサは、力センサを含む、請求項16に記載の方法。
- 18前記アスレチックパラメータ測定センサは、加速度計を含む、請求項16に記載の方法。
- 19前記オーバーレイ表示は、前記ジャンプ中の前記スポーツ選手の衝撃の大きさの指標を有する矢印を含む 、請求項16に記載の方法。
- 20前記オーバーレイ表示は、 前記アスレチック活動セッションの別の部分の映像データ、あるいは、前記スポーツ選手または他のスポーツ選手の他の前記アスレチック活動セッションの映像データを含む 、請求項16に記載の方法。
Independent claims20
74 paragraphs, as filed
The present invention generally relates to the recording and visualization of athletic activity. In particular, the embodiments described herein relate to time-based recording and consideration of athletic activity and related time-specific metrics.
Exercise and fitness are becoming more and more common, and the benefits of such activities are well known. Various types of techniques have been incorporated into fitness and other athletic activities. For example, for fitness activities, various portable electronic devices such as MP3s or other audio players, radios, portable TVs, DVD players and other video players, clocks, GPS systems, pedometers, mobile phones, pagers, pagers, etc. The device is available. Many fitness enthusiasts or athletes use one or more of these devices when exercising or training, for example, to have fun, provide performance data, or interact with others. Such users are also interested in recording their athletic activity and related metrics. Therefore, various sensors can be used to detect, store and / or transmit athletic performance information.
<p> However, athletic performance information is often presented alone or based on overall athletic activity. Athletic performance data is not readily available during specific periods or moments during an athletic activity session. Therefore, the user may not be able to identify a particular time or time within the scope of training or other athletic activity for which a particular metric or performance statistic has been achieved.</p><p> A detailed description of the features and advantages of the present invention will be made in the following description with reference to the accompanying drawings.</p><p> The following description is an overview of aspects of the invention and provides an understanding of at least some of the embodiments. This overview is not a comprehensive overview of the present invention. It is not intended to identify elements that are important or essential to the invention or to define the scope of the invention. The following outline presents some concepts of the invention in general form as a prelude to the detailed description below.</p>
<p> According to one or more aspects of the invention, a system and method for tracking athletic activity metrics based on a timeline will be described. Metrics may be recorded continuously or may be based on a defined timeline. In either case, multiple values may be recorded for the same metric and associated with the particular time the value was detected. For example, athletic performance data can be detected and recorded on a minimum time basis. The minimum time unit can correspond to 1 second, 2 seconds, 1 millisecond, 10 seconds, and the like. By using such time-based recordings, the user considers instantaneous and specific metric values to determine how the user was exercising at a particular point in time during the athletic activity. can do.</p><p> According to another aspect, the user can simultaneously display multiple metrics on the interface while considering an athletic activity session. For example, the user displays the image in the main visualization area with one or more overlays of the desired metric. In addition to or instead, a toolbar may be displayed to provide other metrics that are not currently displayed within the main visualization area.</p><p> According to yet another aspect, a plurality of metrics may be recorded using a plurality of different applications or widgets. The user may select the metric and / or widget to use before the athletic activity session or before the start of recording. The user can also modify the selected metric or application during session recording.</p><p> According to yet another aspect, the user edits the collected data before or after the metrics and other data are accumulated in a single athletic activity session file for electronic content items (eg, high performance video). You may. For example, the user can remove a metric from an athletic activity session file even if the metric has already been recorded. In addition to or instead, the user can crop the video or other metric at a desired time (eg, less than the total duration of the athletic activity session).</p><p> Other aspects and features are described throughout the disclosure.</p>
Next, in order to understand the present invention, it will be described as an example with reference to the following accompanying drawings.<figref num="1">It is a figure which shows the example of the calculation processing environment which uses one or more aspects described in this specification.</figref><figref num="2">It is a figure which shows the example of the calculation processing apparatus which can be used according to one or more aspects described in this specification.</figref><figref num="3A">It is a figure which shows the example of the sensor and monitor device communication environment by one or more aspects described in this specification.</figref><figref num="3B">It is a figure which shows the example of the sensor and monitor device communication environment by one or more aspects described in this specification.</figref><figref num="3C">It is a figure which shows the example of the shoe sensor system which has the force detection function by one or more aspects described in this specification.</figref><figref num="4">It is a flow chart which shows the feature of the time-based athletic performance monitoring system by one or more aspects described in this specification.</figref><figref num="5">It is a figure which shows the example of the metric / application selection interface by one or more aspects described herein.</figref><figref num="6">It is a figure which shows the exemplary activity selection interface by one or more aspects described herein.</figref><figref num="7">It is a figure which shows the example of the recording start interface by one or more aspects described in this specification.</figref><figref num="8">It is a figure which shows the example of the interface which displays the user's recorded activity path and additional metric by one or more aspects described herein.</figref><figref num="9">It is a figure which shows the example of another activity selection interface by one or more aspects described herein.</figref><figref num="10">It is a diagram showing an example of an interface for displaying a video, a timeline, and other metrics of a user's recording activity on a weighing toolbar in one or more aspects described herein.</figref><figref num="11">FIG. 5 illustrates an example of another interface that displays user activity metrics in one or more aspects described herein.</figref><figref num="12">It is a figure which shows the example of the landscape display of the activity metric of a user in which the metric information by one or more aspects described in this specification is superposed.</figref><figref num="13">It is a figure which shows the example of the interface which a user can cut a recording activity session by one or more aspects described herein.</figref><figref num="14">It is a figure which shows the example of the interface which can share a recorded activity session by one or more aspects described herein.</figref><figref num="15">FIG. 5 illustrates an example of a community website where recorded activity metrics can be shared, according to one or more aspects described herein.</figref><figref num="16A">FIG. 5 illustrates an example of a display overlay for conveying activity metrics, according to one or more aspects described herein.</figref><figref num="16B">FIG. 5 illustrates an example of a display overlay for conveying activity metrics, according to one or more aspects described herein.</figref><figref num="17A">FIG. 5 illustrates an example of an interface configured to display a comparison between two activity sessions and / or between athletes, according to one or more aspects described herein.</figref><figref num="17B">FIG. 5 illustrates an example of an interface configured to display a comparison between two activity sessions and / or between athletes, according to one or more aspects described herein.</figref><figref num="17C">FIG. 5 illustrates an example of an interface configured to display a comparison between two activity sessions and / or between athletes, according to one or more aspects described herein.</figref><figref num="17D">FIG. 5 illustrates an example of an interface configured to display a comparison between two activity sessions and / or between athletes, according to one or more aspects described herein.</figref><figref num="18A">It is a figure which shows the example of the interface which can be adjusted by using the intersection between display areas by one or more aspects described herein .</figref><figref num="18B">It is a figure which shows the example of the interface which can be adjusted by using the intersection between display areas by one or more aspects described herein.</figref><figref num="19">It is a figure which shows the editing of the metric data at the time of accumulating an activity session file by one or more aspects described herein.</figref><figref num="20">It is a figure which shows the example of the environment which can use a plurality of video or data acquisition sources by one or more aspects described in this specification.</figref><figref num="21">It is a figure which shows the example of the environment which can use a plurality of video or data acquisition sources by one or more aspects described in this specification.</figref>
In the following description relating to examples of various embodiments of the invention, the accompanying drawings are referred to. These reference drawings exemplify various devices, systems and environments that form part of the present invention and are capable of carrying out aspects of the invention. It should be understood that configurations such as other specific parts, devices, systems and environments are available and structural and functional modifications are possible without departing from the scope of the invention. Also, herein, terms such as "top," "bottom," "front," "back," and "horizontal" are used to describe various exemplary features and elements of the invention. These terms are used herein for convenience, eg, based on the exemplary orientation shown in the figure. Within the scope of the invention, the description in the specification is not construed as requiring a particular three-dimensional orientation of the structure.
Various examples of the present invention can be realized using electronic circuits configured to perform one or more functions. For example, in some embodiments of the invention, an athletic information monitor, collector, display, or any combination thereof, may be implemented using one or more application specific integrated circuits (ASICs). .. However, more typically, examples of the various components of the invention are performed using a programmable compute processor that executes firmware or software instructions, or on a dedicated electronic circuit and programmable compute processor. It is realized by some combination with the firmware or software instructions.
(Example of Hardware Device) FIG. 1 shows an example of a computer 101 capable of realizing various embodiments of the present invention. As can be seen in this figure, the computer 101 has a computing unit 103. The computing unit 103 typically includes a processor unit 105 and system memory 107. The processor unit 105 may be any type of processing device that executes software instructions, and is customarily a microprocessor device. The system memory 107 may include both read-only memory (ROM) 109 and random access memory (RAM) 111. As will be appreciated by those skilled in the art, both read-only memory (ROM) 109 and random access memory (RAM) 111 may store software instructions for the processor unit 105 to execute.
The processor unit 105 and system memory 107 are directly or indirectly connected to one or more peripherals via bus 113 or an alternative communication structure. For example, the processor unit 105 or system memory 107 may be directly or indirectly connected to additional memory storage devices such as a hard disk drive 117, a removable magnetic disk drive 119, an optical disk drive, or a flash memory card. Further, the processor unit 105 and the system memory 107 may be directly or indirectly connected to one or more input devices 121 and one or more output devices 123. Input devices 121 include, for example, keyboards, touch screens, remote control pads, pointing devices (mouse, touch pad, stylus, trackball, joystick, etc.), scanners, cameras, or microphones. The output device 123 includes, for example, a monitor display device, a television, a printer, a stereo or a speaker.
In addition, the computing unit 103 is directly or indirectly connected to one or more network interfaces 115 to communicate with the network. This type of network interface 115, sometimes referred to as a network adapter or network interface card (NIC), transfers data and control signals from the compute unit 103 to transmission control protocol (TCP), internet protocol (IP), and user diagram. Converts to network messages that comply with one or more communication protocols, such as Protocol (UDP). Since these protocols are well known in the art, detailed description thereof will be omitted. Interface 115 may use any connectivity agent suitable for connecting to networks, including, for example, wireless transceivers, power line adapters, modems or Ethernet connections.
In addition to the input, output and storage peripherals specifically described above, the compute processing device is connected to a variety of other peripherals, including those capable of performing input, output and storage functions, or a combination thereof. Please understand that it is also good. For example, the computer 101 may be connected to a digital music player such as an IPOD® available from Apple, Inc. in Cupertino, CA. This type of digital music player can act as both an output device for a computer (eg, outputting music from an audio file or a photo from an image file) and a storage device, as is known in the art. In addition, this type of digital music player can also act as an input device for inputting recorded athletic information, as will be described in more detail later.
In addition to the digital music player, the computer 101 may be connected to or otherwise include one or more other peripherals, such as a telephone. The telephone may be, for example, a wireless "smartphone". As is known in the art, this type of telephone communicates over a wireless network using radio frequency transmission. In addition to simple communication functions, a "smartphone" can send, receive, or display electronic messages (eg, email messages, SMS text messages, etc.), record or play audio files, image files (eg, still images or It can provide users with one or more data management features such as recording or playing video files) and viewing and editing files containing text (eg Microsoft Word or Excel files, or Adobe Acrobat files). The data management capabilities of this type of telephone may allow the user to connect the telephone to the computer 101 so that its maintenance data is synchronized.
Of course, as is well known in the art, additional peripherals may be included that are otherwise connected to the computer 101 of the type shown in FIG. In some cases, the peripheral may be permanently or semi-permanently connected to the computing unit 103. For example, in many computers, a computing unit 103, a hard disk drive 117, a removable optical disk drive 119, and a display device are semi-permanently housed in a single housing. However, in addition, other peripherals may be detachably connected to the computer 101. Computer 101 includes, for example, one or more communication ports that connect peripherals to computing unit 103 (either directly or indirectly via bus 113). Therefore, these communication ports may be parallel bus ports or serial bus ports, such as serial bus ports that use the general purpose serial bus (USB) standard or the IEEE1394 high speed serial bus standard (eg, Firewire port). It may be included. Alternatively or additionally, the computer 101 may include wireless data "ports" such as a Bluetooth interface, a Wi-Fi interface, and an infrared data port.
The computing devices used in the various examples of the present invention include more components than computer 101, fewer components than computer 101, or a combination of components different from computer 101, as shown in FIG. Please understand that you can. Some embodiments of the present invention may use one or more computational processing devices designed to have very specific functions, such as digital music players and server computers. Therefore, these computing devices may omit unnecessary peripheral devices such as the network interface 115, the removable optical disk drive 119, the printer, the scanner, and the external hard disk. In some embodiments of the present invention, alternative or in addition to this, a computing device intended to perform a variety of functions, such as a desktop or laptop computer, may be used. These computing devices may optionally have any combination of peripherals or additional components.
FIG. 2 shows an example of an athletic information monitoring device 201 that can be used in various examples of the present invention to measure athletic information corresponding to a user's athletic activity. As shown in this figure, the athletic information monitoring device 201 includes a digital music player 203, an electronic interface device 205, and an athletic parameter measuring device 207. As described in more detail, in one embodiment, the digital music player 203 may be (removably) connected to the electronic interface device 205. The combination of the digital music player 203 and the electronic interface device 205 is worn or otherwise carried by the user while the user is performing athletic activities such as running or walking. While the user is performing an athletic activity, the athletic parameter measuring device 207 measures one or more athletic parameters for the athletic performance being worn or carried by the user and performed by the user. The athletic parameter measuring device 207 transmits a signal corresponding to the measured athletic parameter to the electronic interface device 205. The electronic interface device 205 receives a signal from the athletic parameter measuring device 207 and provides the received information to the digital music player 203. If the digital music player 203 or another electronic device can directly interface with the measuring device 207, it is not necessary to use the electronic interface device 205. For example, the athletic parameter measuring device 207 is configured to communicate using a Bluetooth wireless communication protocol and, as a result, can be used with a Bluetooth mobile phone, personal digital assistant, watch or personal computer.
As shown in more detail in FIG. 3A, the athletic parameter measuring device 207 is one or more for measuring athletic parameters associated with a person who is wearing or otherwise using the athletic parameter measuring device 207. Includes sensor 301. In the illustrated embodiment, for example, sensors 301A and 301B are accelerometers (such as a piezoelectric accelerometer) for measuring the acceleration of the athletic parameter measuring device 207 in two perpendicular directions. The athletic parameter measuring device 207 is carried or otherwise worn by the user to measure the desired athletic parameter while the user is exercising. For example, as shown in FIG. 3B, the athletic parameter measuring device 207 may be placed on the bottom of the user's shoe 401 while the user is walking or running. With this configuration, the sensor 301 generates an electrical signal corresponding to the movement of the user's foot. As is known in the art, these signals can be used to generate athletic data representing the athletic activity performed by the user.
The athletic parameter measuring device 207 also includes a processor 303 for processing an electric signal output from the sensor 301. In an embodiment of the invention, processor 303 is a programmable microprocessor. However, in yet another embodiment of the invention, the processor 303 may be a dedicated circuit device such as an ASIC. The processor 303 may perform desired processing such as curve smoothing, noise filtering, outlier removal, amplification, addition, and integration on the signal output from the sensor 301. Processor 303 provides the processed signal to transmitter 307. The athletic parameter measuring device 207 also includes a power supply 307 that powers the sensor 301, the processor 303, and the transmitter 305 as needed. The power supply 307 is, for example, a battery.
The athletic parameter measuring device 207 transmits the processing signal to the electronic interface device 205, as can be seen in FIG. 3B. Then returning to FIG. 3A, the electronic interface device 205 includes a receiver 309 that receives the processing signal sent by the transmitter 305 in the athletic parameter measuring device 207. The receiver 309 relays the processing signal to the second processor 311 and the second processor 311 further processes the signal. Like processor 303, processor 311 may perform desired processing on the processed signal, such as curve smoothing, noise filtering, outlier removal, amplification, addition, and integration.
Processor 303 provides the processed signal to the digital music player 203. Then, with reference back to FIG. 2, the electronic interface device 205 has a connector system 209 that is physically plugged or connected to the conventional input port 211 provided in the digital music player 203. The input port 211 to which the connector system 209 of the electronic interface device 205 is connected may be any desired type of input port for transferring data such as a parallel data port, a serial data port, an earphone, and a microphone terminal. The connector system 209 is an electrical connection to the corresponding element provided in the input port 211 of the digital music player 203 (eg, enabling electronic and / or data communication between the interface device 205 and the electronic interface device 205). And any other suitable connection device such as wires, pins, electrical connectors, etc. may be included to make the proper connection. Additional fixing elements such as straps, hooks, buckles, clips, clamps, clasps, retaining elements, mechanical connectors, etc. are provided to securely connect the interface device 205 to the digital music player 203, if required or required. May be done.
Then returning to FIG. 3A, processor 311 provides the processing signal to computing unit 313. The computing unit 313 may first store the processing signal in memory 315. Further, in some embodiments of the invention, the computing unit 313 processes a processing signal provided by the athletic information monitoring device 201 to produce a set of athletic data corresponding to the athletic activity performed by the user. Can be generated. For example, if the athletic information monitor device 201 includes an accelerometer for measuring the movement of the user's foot, the computing unit 313 analyzes the processing signal from the athletic information monitor device 201 to perform the user's athletic activity. It is possible to generate a set of athletic data representing the speed of the user at a particular moment and the total distance traveled by the user at each such particular moment. Various techniques for determining the user's speed from the accelerometer signal are, for example, entitled "Monitoring Activity Of A User In Locomotion On" published on May 24, 2005 by Blackadar et al. US Pat. No. 6,898,550 entitled "Foot", US Pat. No. 6,882,955 entitled "Monitoring Activity Of A User In Locomotion On Foot" issued on April 19, 2005, granted rights to Ohlenbusch et al., Rights to Darley et al. U.S. Pat. No. 6,876,947 entitled "Monitoring Activity Of A User In Locomotion On Foot" issued on April 5, 2005, granted to Ohlenbusch et al., Issued on December 10, 2002. US Pat. No. 6,493,652 entitled "Monitoring Activity Of A User In Locomotion On Foot", "Detecting The Starting And Stopping Of Movement Of A Person On" issued on October 2, 2001, granted rights to Blackadar et al. US Pat. No. 6,298,314 entitled "Foot", US Pat. No. 6,052,654 entitled "Measuring Foot Contact Time And Foot Loft Time Of A Person In Locomotion" issued on April 18, 2000, granted to Gaudet et al. And Gaudet et al. Granted to US Pat. No. 6,018,705, entitled "Measuring Foot Contact Time And Foot Loft Time Of A Person In Locomotion," issued January 25, 2000. Each is incorporated herein by reference in its entirety.
The athletic dataset can also include time values associated with each velocity value and / or distance value. When the athletic information monitoring device 201 is used to collect athletic information from various users, the athletic data computing unit 313 may further encourage the users to identify themselves in some way. This identification information may then be included with the athletic data set generated from the information provided by the athletic information monitoring device 201. After the computing unit 313 has generated a set of athletic data from the information provided by the athletic information monitoring device 201, the computing unit 313 may store the athletic data set in memory 315. As will be described in more detail later, when the digital music player 203 is connected to a computing device that implements an athletic information gathering tool, the computing unit 313 becomes a display configuration tool hosted on the remote computing device. Download athletic data.
In the embodiments shown in FIGS. 2 to 3B, wireless communication between the athletic parameter measuring device 207 and the interface device 205 is described, but the athletic parameter measuring device 207 and the interface device are described without departing from the present invention. Any method may be used that involves a wired connection to communicate with the 205. Also, without departing from the present invention, the data obtained from the physical or physiological data from the athletic parameter measuring device 207 may be in a form suitable for displaying on the electronic device 210 or outputting from the electronic device 210. The desired method of formatting is provided.
If desired, at least according to some examples of the invention, the electronic interface device 205 may further include one or more rotary input devices, switches, buttons (as illustrated in FIG. 2), a mouse or Display devices 220 and / or user input systems 222 such as trackball elements, touch screens or similar, or combinations thereof may be included. The display device 220 indicates, for example, information about music played by the digital music player 203, information about the athletic information signal received by the digital music player 203, athletic data generated by the digital music player 203 from the received athletic information signal, and the like. Can be used for The user input system 222 controls, for example, one or more aspects of processing input data received via interface device 205, receives input data (eg, timing, type of information received, on-demand data request, etc.). It can be used for controlling the data output to and from the electronic device 203, controlling the athletic parameter measuring device 207, and the like. In addition to or instead, if necessary, use the input system of the digital music player 203 (eg, button 222, touch screen, digitizer / stylus input, rotary input device, trackball or rollball, mouse, etc.). The user input data can be provided to the interface device 205 and / or the athletic parameter measuring device 207. Yet another example, if desired, the interface device 205 and / or the digital music player 203 and the like may include a voice input device to allow user input by voice command. Any other desired type of user input system may be provided for the control of any system element and / or for any purpose without departing from the present invention.
The digital music player 203 has additional inputs and inputs, such as ports 224 and 226 shown in FIG. 2, for example for headphones (or other audio outputs), power supplies, wireless communications, infrared inputs, microphone inputs or other devices. / Or may include output elements and the like. If desired, and if these ports 224 and / or 226 are covered when interface device 205 is attached to electronics 203, interface device 205 is equipped with an external port similar to port 224 and / or 226. You may. Within the interface device 205, the user plugs into the interface device 205 the same additional device that plugs into the digital music player 203 and further utilizes the same functions (eg, thereby required data, signals, power, and An internal circuit may be provided that allows / or information to pass through the interface device 205 to the user, another output, and / or the digital music player 203).
Although some embodiments of the present invention described above relate to the digital music player 203, it should be understood that as an alternative example of the present invention, it can be realized by using an arbitrary portable electronic device. For example, in some embodiments of the invention, the athletic parameter measuring device 207 is a mobile phone, watch, personal digital assistant, another type of music player (such as a compact disc or satellite radio music player), a portable computer, or any of them. It can be used with other desired electronic devices.
Also, although an example of the athletic parameter measuring device 207 has been described for ease of understanding, it should be understood that any type of desired athletic parameter measuring device 207 can be used with various embodiments of the present invention. For example, in some embodiments of the invention, the athletic parameter measuring device 207 can monitor the heart rate monitor, blood oxygen monitor, satellite positioning device (eg, Earth Positioning Satellite (GPS) navigation device), electrical activity of the user. A device that measures (eg, an EKG monitor), or another device that measures one or more physical parameters of a user. In addition, the athletic parameter measuring device 207 is a bicycle speed and / or distance, tread mill, rowing machine, elliptical machine, speed and / or work performed by an exercise bike, user-worn skis (water or snow), One or more operating parameters of the device operated by the user may be measured, such as speed and / or distance moved by skates (rollers or ice), or snowshoes. Other types of sensors include strain gauges, temperature sensors, heart rate monitors and the like. In one or more configurations, the user may equip multiple sensors and, in some examples, may equip multiple positions with sensors of the same type. For example, the user may have the system individually for each foot or other body part (eg, legs, hands, arms, personal fingers or toes, human feet or legs, waist, chest, shoulders, head, eye areas). Shoes may be worn, each equipped with an accelerometer, weight sensor, etc., so that the movement and metric can be determined. An example of a multi-sensor garment that monitors athletic activity and the use of multiple sensors is published as US Patent Publication No. 2010/0063778 A1 and is referred to as "FOOTWEAR HAVING SENSOR SYSTEM" US Patent Application No. 12/483, It is described in US Patent Application No. 824 and US Patent Application No. 12 / 483,828, published as US Patent Publication No. 2010/0063779 A1 and called "FOOTWEAR HAVING SENSOR SYSTEM". The contents of the above reference application are incorporated herein by reference in their entirety. In certain examples, athletes may have and wear one or more force detection systems that utilize, for example, a pressure sensitive resistance (FSR) sensor. The shoe may include multiple FSR sensors that detect force on various parts of the user's foot (eg, heel, insole, toe, etc.). This helps determine the balance between the user's feet or the user's two feet. As an example of the embodiment, the FSR sensor array may adopt the embodiment as shown in FIG. 3C.
Also, the athletic parameter measuring device 207 has been shown to be a device different from the digital music player 203 and other portable electronic devices that receive signals from the athletic parameter measuring device 207, but in some embodiments of the present invention. The athletic parameter measuring device 207 may be integrated or integrated with the digital music player 203 or other portable electronic device. For example, some embodiments of the present invention may use music players, cell phones, watches or personal digital assistants incorporating accelerometers, satellite positioning devices, or other desired devices for measuring athletic activity. Further, various embodiments of the present invention include a digital music player 203, other portable electronic devices, or a plurality of athletic parameter measuring devices 207 incorporated in a digital music player 203 or other portable electronic devices separate from the combination thereof. Please understand that you may use.
(Time-based data collection) Athletic performance monitoring systems such as the digital music player 203 and interface 205 of FIG. 2 may be used to collect, edit, store, and share athletic performance data measured by one or more external or internal sensors. This athletic performance data may be collected over the duration of the user's activity. To provide data specificity and flexibility in data usage, the monitoring system can collect data multiple times during athletic activity. As an example, a monitor system collects and stores athletic data in minimum time units. For example, the minimum time unit corresponds to every second the user is involved in athletic activity. As another example, the monitor system may collect and store athletic data every 0.5 seconds, 5 seconds, 10 seconds, 30 seconds, 1 minute, for example. The collected data may then be mapped, associated and / or stored in other ways at the corresponding moment or time when the data was acquired. The minimum time unit may be defined by the user or system, or may be defined based on the minimum time unit used to record the video or audio of the activity session. For example, if the video provides a half second level of playback subdivision, the system may record performance data every half second. As another example, if the video is recorded at 30 frames per second, the system may record performance data (eg, metrics) every 1/30 of a second to match each frame of the video.
Figure 4 shows the general process by which a user can collect user athletic performance data. For example, the user first gets the desired metric data. For example, the user selects or otherwise specifies the type of metric that the user wants to record during an athletic activity session. As an example, the user selects a metric by selecting or deselecting a personal type metric from the user interface. As another example, the user may select a metric by identifying a previously recorded athletic performance dataset and indicating that the user wants to record the same metric as the previously recorded athletic performance dataset. Metric data includes video, audio, speed, pace, reaction time, jump height, position (eg, using GPS sensor or cell trigonometry), sweating, body temperature, reach, lifting weight, strength, etc. Be done. After acquisition, the user edits the data (eg, by attempting to overcome one or more metrics of previously recorded activity sessions), shares the data, and inspires himself and / or others. be able to.
Various types of metrics can be measured and recorded in relation to the time the metric was detected. Figure 5 shows an exemplary user interface that allows the user to select various time-specific metrics to record. Other metrics for athletic activity may be recorded even if not selected, but such other metrics (eg, the same level of granularity as the selected metric (eg, 1 second, 2 seconds)). ) Can simply be recorded as an average of the entire training (rather than storing metric information). Therefore, the selected metric is detected, recorded and / or at the first level of subdivision (eg, first velocity-every second, every two seconds, every 30 seconds, every millisecond, etc.). Metrics that may or may not be selected may be detected, recorded and / or stored at a second level of subdivision (eg, every 2 minutes, every 10 minutes, every 15 minutes). In this case, the first level of subdivision is greater than the second level of subdivision. For some time-corresponding metrics (eg, pace), the metric is recorded for a specific time (eg, 2 seconds) and associated with the time unit for that period (eg, over 2 seconds 7. A pace of 8 mi / hour is recorded and associated with each second of the 2 seconds). Therefore, other metrics may not (or may be) specific to any particular time during training (eg, less than the overall training / activity duration, minimum time unit, etc.). It does not have to be recorded). Each selectable metric displayed in Figure 5 corresponds to an application or applet (eg, a widget) and can be recorded by them. In one configuration, each metric widget or application may be configured to measure and record a particular set of one or more metrics along the timeline. For example, each metric widget or application may be specific to the corresponding metric that the widget or application is configured to record. Timelines of multiple metric widgets or applications may then be merged to integrate metric data into a single activity session based on those timelines. In general, the timelines of various widgets or applications match each other because recordings are likely to start at the same time.
Metric applications or widgets can be created by athletes and other users. As an example, metric applications are available through marketplaces or communities where users can download new and / or updated metric applications. An application may include algorithms, instructions, visual features, and functional elements that are specific to a particular metric and application. Thus, in one or more configurations, the metric selection interface can include multiple different applications or applets for the same type of metric. As an example, users define praise, messages, and interface features for various types of metrics. In certain examples, the vertical (eg, jump height) widget contains praise after the user has achieved a jump height of 2 feet, and the pace widget is provided after the user has achieved a 7 minute mile pace. May include praise.
As shown in Figure 5, the metrics include recovery time, pace, vertical jump, court map, walking line, running line, heart rate, balance, distance, calories, reaction time, hustle points, pedometer, flight time, Trials, ollies, impact and balance centers can be mentioned. For example, recovery time may be a measure of the length of time the user is stationary or at a level below a certain threshold of activity or movement. This time is considered to be the time the user spends recovering or resting. The court map, on the other hand, may plot the user's position relative to an athletic activity court or field, or other predetermined space. For example, when the user is playing basketball, a virtual representation of the basketball court is generated and displayed along with the movement of the user around the virtual court. As another example, a football player may be illustrated around a virtual football field. Reaction time, on the other hand, may be a measure of the length of time between two events, such as the ball bouncing off the rim or the user jumping and grabbing the ball (eg, bouncing reaction time). As another example, the reaction time of a basketball player to a pass is measured by the time the ball is released from another player's hand and the moment the user moves towards the ball (eg, hip movement or directional movement of the hand or body). It may be measured with. Hustle points are the speed at which an athlete achieves his or her goals, the speed at which an object (eg, a ball) is reached, the speed at which a player travels a given length of distance, the speed at which an athlete moves from one designated point to another, etc. It is given in various ways including. As an example, hustle points may be awarded every second when the user is moving at a speed above the threshold (eg 0.5 points / second above 10 mph).
The athletic monitoring system may determine flight time or flight time by measuring the time between the user's foot off the floor and the user's foot touching the ground. Flight time or flight time may be measured based on other body parts or devices that include a skateboard (eg, skateboard flight time), or between the hands and feet (eg, back somersault). The flight or flight time of a particular activity may have its own metric, such as the number of skateboard ollies. Ollymetric can use various parameters to measure the flight time of skateboarding tricks. As yet another example, the flight time of a ring exercise in gymnastics may be measured based on when the user's hand leaves the ring and when the user's hand returns to the ring or the user's foot touches the ground. Good. Various other flight times or flight times can be defined based on various body and device sensors.
Impact represents the amount of force exerted by the user. As an example, boxing activity can be measured with respect to the impact of the fist as the user punches. As another example, in basketball, the impact of the user landing may be measured. Yet another example, the impact of a user hitting or tackling another user may be measured to determine effectiveness or strength in football. The walking line and the running line can measure the direction or pattern of the user's foot movement during walking or running, respectively. Alternatively, patterns or directions of movement of other body parts may be measured and analyzed. According to one or more configurations, the running line metric can identify the route the user takes while running. The route can be determined using a positioning system such as an Earth positioning satellite.
Both balance and center of balance relate to the amount of weight placed on each foot. As an example, balance can indicate the difference in weight placed on each foot, and balance center can provide an indicator of the location of the center of balance relative to the position of the user's foot.
Alternatively or additionally, the system may provide trial metrics configured to measure a user's performance per hour. In trials, users are typically competing for time and trying to achieve it as soon as possible. Therefore, the system may measure the user's trial and provide time information associated with the trial.
One or more sets of metrics may be predefined to simplify the use of the performance monitoring system and the selection of metrics. For example, one or more sets of metrics may be preselected and / or defined for each of running, basketball, training and skateboarding, as shown in FIG. Therefore, when the user selects one of the activity options or types, the corresponding set of metrics may be automatically selected. In some configurations, the corresponding metric may be automatically selected with the selected metric and an activity type specific widget or application configured to record that type of activity.
Users may be offered the opportunity to customize automatic selection after selecting an activity. Alternatively or additionally, the user may create a given custom set, manually selecting the metric they want to use for their current activity (eg, using the "Create your own options" option). You may. As mentioned above, the user may be asked to select a previously performed training and record the same metric as the previously performed training. Therefore, the system can automatically retrieve the recorded metrics for previously performed training from the athletic performance dataset associated with the previously performed training. If the user customizes his or her own metric set, the user can choose to remember and label the customized set. In that case, the customized set will appear in the menu for a given activity the next time the user starts an activity session (eg, as shown in Figure 6). Figure 6 lists only basketball, running, training and skateboarding as activities, but many other activities have a given metric or widget set and can be displayed in such an interface as well. .. In fact, according to the features described herein, dance, swimming, skipping rope, wrestling, speech (eg, tracking the amount of user's hand movements or eye contact), travel (steps during travel, travel). Any movement can be tracked, including changes in elevation inside).
In addition, users may share customized metrics or widget sets with other users. For example, a marketplace or share space may be created where users can exchange, purchase and / or download metrics and widget sets from other users, services, coaches, etc. In one or more configurations, metrics and widget sets may be shared among users with specific interests (eg, skateboarding or swimming), or more generally. To specify whether the general public is allowed to download and view metric sets, or whether only specified groups (eg friends, community groups, etc.) are allowed to view and download. Other privacy and security parameters may be defined, including. In one or more aspects, the user can define his own metric. In one example, the user may define a metric called "one-leg vertical height" that records the height at which the user can jump with one leg or foot. The user may define a metric that specifies the type of sensor used, the conditions under which the sensor is activated or deactivated, and the sensor output detected. Therefore, the above user said that the metric is measured only when the sensor of one shoe touches the surface, the metric detects the loss of contact between one shoe and the surface, and then with the same shoe. It may be shown that it corresponds to half the length of time it takes to detect contact with the surface.
FIG. 7 shows an exemplary interface in which the user begins recording an activity session as he or she selects the desired set of metrics to be tracked. The interface may include a timeline at the bottom of the screen to show the length of time elapsed since the start of the activity. The user can start recording activity metrics and / or footage by selecting the Start / Record running option displayed in the center of the screen. As an example, video may be recorded by a metric recorder (eg, a mobile communication device or a video camera on a laptop). When data is recorded, the data (video and metrics) may be stored in relation to a particular moment or time during the activity session in which the data was acquired. As mentioned above, the data may be collected substantially continuously (eg, every 0.1 or 0.5 seconds, every 1 second). Other recording intervals (eg, every 2 seconds, 5 seconds, 10 seconds, 15 seconds, every 5 minutes) may be defined. The interface may also display the currently selected base metric. The basic metric may be displayed in the visualization area of the interface. For example, in Figure 7, the running line is displayed in the visualization area (partially covered by the recording options). The user can pause or stop recording using the corresponding choices displayed in the header bar (eg, on one side of the base metric name).
Figure 8 shows the athletic performance monitor interface that users may see when they start an athletic activity session. The icon in the header bar can indicate that the current activity and its metrics are recorded. In the illustrated example, the main visualization area may display a particular metric, such as a running path or running line. In one configuration, the current position of the user on the map may be identified by an indicator. Other metrics may be displayed in the metric bar. The metric may be updated continuously while the activity is taking place, or it may be updated based on a specified schedule. For example, a user's pace (eg, 7:46 miles) can be updated in real time as the user speeds up or slows down. Similarly, the user's balance (currently showing 46% of the user's weight on the left foot and 54% on the right foot) can be updated in real time. The data shown may be momentary data and the data may include an average of the amount of data so far (eg, all previous data recorded in the session, or an appropriate subset recorded in the session). You may.
Other metrics may be displayed by selecting one of the directional arrow options along the metric bar (as described and illustrated in more detail below). Selecting one of the metrics in the metric bar allows the main visualization area to change to display the selected metric. The previously displayed metric may be returned to the metric bar (for example, replacing the newly selected metric / widget). In addition, the current elapsed time may be displayed on the timeline. In addition, the length of elapsed time may be represented on the timeline by different colors or appearances (eg, red, polka dots, stripes, blue, green, etc.).
Figure 9 shows an example of another activity selection interface that emphasizes basketball activity in the selected process. As shown here, various activities can correspond to different sets of metrics. As an example, a basketball metric can include video and / or audio recording. Therefore, selecting a basketball activity can activate the recording function.
Figure 10 shows an example of a metric monitor interface with video recording of basketball activity. Basketball activities may include activities related to basketball-related training or skill improvement, and are not necessarily limited to basketball games. Similar training or evaluation-type activities may be monitored for other sports and activities. When video is being recorded, other metrics shown in the metric bar may be recorded at the same time and associated with the time the data was acquired. The metric or metric widget displayed in the main visualization area may be modified by selecting a different metric than the metric toolbar. The footage may continue to be recorded and displayed in the metric widget on the metric toolbar. The metric toolbar can include metric widgets such as pace metric widgets, vertical jump widgets, and impact widgets. The vertical jump widget measures the user's vertical ground height at a particular point in time, and the impact widget is the amount of force exerted by the user's feet (eg, when landing) or hands (eg, blocking the shoot). , Or the magnitude of the force at which the ball was shot or thrown can be measured. Pace metrics for basketball activities may measure vertical or horizontal acceleration (eg, instead of measuring mile pace). The metric shown may be specific to the moment identified on the timeline (ie, 4 minutes 58 seconds of the athletic activity session). Alternatively or additionally, one or more of the illustrated metrics may be the average of the metrics up to the moment identified on the timeline (eg, the average over the first 4 minutes 58 seconds).
Data collection can also be facilitated by including the identifier in one or more sensors or other wearable devices (eg, shoes, gloves, headgear, etc.). A metric acquisition device such as a video camera or a speed camera may automatically adjust the direction and focus based on the discovery of a suitable object using an identifier and the determination of its position. In other configurations, identifiers and wearable identifier tags may not be needed. The camera or other sensor device may automatically determine the desired location of the target based on image recognition (eg, face recognition or body recognition). Using the identifier, the data may be displayed as an overlay near the corresponding sensor, individual or individual body part. For example, by detecting the position of the user's foot by the identifier, the pace information is displayed near the user's foot during video reproduction. As another example, a plurality of sets of metrics regarding a plurality of individuals displayed in the video may be displayed. Therefore, identifiers can be used to place metrics close to the appropriate individual.
Video collection is facilitated by combining video from a plurality of different video sources as shown in FIG. For example, multiple individuals may use their video cameras to record the same event (eg, a soccer game or a dance competition). The processing system can detect that each of the plurality of images corresponds to the same event and can join the images to fill the gap between the individual images. In addition, the system can ensure that the video maximizes the image of the desired object. Again, body or face recognition may be used to identify a particular object and combine parts containing the desired object into a single image. Each portion may have a duration corresponding to a portion of the duration of the source video or content item or the entire duration thereof. Also, by using multiple cameras or video streams, an individual can see an object (eg, himself, a child, a player, etc.) from multiple angles, at several moments, in three dimensions.
According to another aspect, video recording by a camera at a particular location and other recording equipment may be automatically triggered based on the detection of an identifier or other electronic tag. FIG. 21 shows, for example, a location such as an athletic hall or park with a camera 2 that belongs to or is otherwise associated with the location. Therefore, if the connected camera or system detects a player or individual in the location, the camera may automatically start recording. As an example, detection of athletes and other individuals may be done using shoes with RFID tags. Upon detecting the RFID tag, the video camera may be automatically triggered to start recording an event or athletic activity session. These cameras may be fixed or movable cameras located in public facilities, semi-individual or private athletic facilities (eg, athletic halls, grounds, pools, courts, etc.). The location camera data may then be combined with data collected by the user's personal recording device (eg, camera-equipped mobile phones or portable video cameras) during the editing of the athletic activity session file. In some configurations, data from various sources may be automatically synchronized when uploaded to a server or other monitoring system.
(Data Visualization and Modification) Figure 11 shows an interface that displays recorded activity sessions and an extended metric toolbar and display of vertical jump metrics in the main visualization area. As mentioned earlier, you can scroll the metric toolbar to see other metric widgets by selecting one of the direction arrows. If there are no more metric widgets in that direction, the arrow will not be displayed. Scrolling may be done using gestures such as swiping left or right.
When you select a new metric, such as a vertical jump, the metric or interface that was previously displayed in the main visualization area is reduced to the widget or toolbar size and placed in the toolbar for display in the main visualization area. .. For example, previously displayed footage within the main visualization area is scaled down to a smaller size suitable for the metric widget toolbar. When expanded or placed in the main visualization area, the metric widget may display additional or extended information than what is displayed within the metric widget toolbar. For example, within the main visualization area, the vertical jump metric widget graphically displays the current vertical jump value as well as the historical vertical jump value of the activity session. This allows users to better understand their progress and improvements during the activity session. A 49.5 inch current value (ie, the selected value in the timeline or the value associated with the current value) may be displayed. Each widget metric may include an animation as it receives new metric data and advances in time. For example, with respect to vertical jumps, the line extends slightly to the next vertical jump value detected after the timeline has advanced to a later point in time. As another example, the line recedes if the user decides to rewind to a previous point in time. The metric widget may display the actual moving information in the main visualization area as well as in the metric toolbar.
FIG. 12 shows another interface example that displays a video of an athletic activity session with a timeline showing the duration of the session. In this example interface, the footage may be displayed in landscape format and the metric widget toolbar may be hidden or otherwise hidden to save space. However, the timeline may also be displayed to allow the user to jump back and forth, fast forward or rewind in time as needed. The timeline and / or metric widget toolbar may be visible and / or hidden based on the user's interaction with the device on which the interface is displayed. For example, the user can make a first gesture along the touch screen interface that displays the metric widget toolbar and a second gesture that hides the toolbar. Similarly, the hiding and display of the timeline may be controlled.
According to one aspect, various metrics can be displayed as overlays in the main visualization area. That is, the information displayed in the main visualization area is visible below the metric overlay. The user can select the desired metric that overlaps the main visualization area. Overlapping metrics may be hidden if desired. The user can also customize the number of metrics displayed above the main visualization area, as well as the appearance including color, font, size, typical symbols, units of measure, and so on. As an example, the best or best metrics are called using highlighting, colors, blinks, patterns, and so on. In other configurations, the superimposed information may be displayed along with information about the personal best record to show how much the user is equal to or exceeds his personal best record. In addition to or instead, comments, words of encouragement, etc. may appear as overlays on the interface toolbar or information bar.
16A and 16B show examples of metric overlays. In FIG. 16A, for example, the user's speed is displayed as a translucent running recorder overlaid on the user's skateboarding activity session video.
In FIG. 16B, the user's impact is displayed as an arrow with an index of impact magnitude on the image of the user jumping.
The superimposed metric information may include footage of other parts of the activity session (eg, the current user or another user) or other activity sessions. As an example, the user may overlay footage from an activity session of a professional athlete to compare exercises.
FIG. 17A shows an example of a side-by-side video comparison between a user and a well-known athlete or other user. In particular, the comparison shows the difference in flight time or flight time. The footage may be tuned to similar points in time, such as when the user leaves the ground to dunk. This time can be identified based on the indicators stored associated with each video, or preprocessed or ongoing image analysis. The comparison between the two users may include synchronizing the timeline of the athletic activity performance of the two users. For example, if two users run for 20 minutes, the system may temporarily or otherwise synchronize the two timelines to compare paces at various points during the 20-minute run. Good. Synchronization can include aligning two timelines and comparing elapsed times. The system may also allow the user to view video, listen to audio, or view video data as they cross the timeline.
FIG. 17B shows another video comparison example between a skateboard user and a professional or competing skateboarder. In the illustrated example, the comparison uses a typical symbol, such as a skateboard, to display the metric. That is, the skateboard may display some ollies performed.
Figures 17C and 17D show wireframe representations of the interfaces that can be used to compare the performance of different users. For example, Figure 17C shows a comparison of athlete performance with athlete coach performance. The widget application displayed on the toolbar may be displayed in a split screen format, along with both the athlete's performance metric and the coach's performance metric. Similarly, images of athletes and coaches may be displayed as split screens in the main visualization area.
Figure 17D shows the comparison interface displayed in landscape format. Instead of displaying the widget toolbar, the interface can display X metrics. In this example, the number of metrics may be 4 (picture, jump height, impact, and balance). The footage may be displayed in split screen, with two columns displayed next to the footage, one column representing the athlete's metric and the other column displaying the coach's metric. .. The interface configurations of FIGS. 17C and 17D may be used to compare the athletic performance of any number of athletes (eg, 2, 3, 5, 10, etc.), where athletes are optional. You may have a type of relationship (eg, friends, competitors, coach players / trainees, etc.).
The video overlay may be triggered automatically based on the detection of various events such as pitch release, slam dunk execution and / or football throwing. For example, a professional pitcher's pitching footage can be overlaid on top of the user's pitching footage to facilitate visual comparison between the two footage. In addition to or instead, the superimposed video and user video metrics may be displayed in relation to each other for comparison. The two sets of metrics may be visually distinguished from each other. For example, the first set of metrics may be displayed in one color and the other set of metrics may be displayed in another color. Font sizes, fonts, font styles (eg, bold, italic, underlined), patterns, etc. may be used as visual distinctions. At the same time, the displayed images (eg, overlapping) may be magnified so that the objects of the images are displayed in a sufficiently large size. For example, if the user is far away in one video, the video may zoom in or out on a portion that includes the user.
In addition to or instead, users may use thresholds to customize the appearance of timelines and / or metric overlays. For example, the appearance of the timeline (eg, color, pattern, shape, size, etc.) may change when the timeline is 75% complete. As another example, the metric information may have a color or other appearance change if the metric exceeds or falls below a specified threshold (for example, red text if the pace is below 6 minutes miles). ..
FIG. 13 shows an interface that allows the user to cut or select a portion (eg, less than all) of the total duration of a recorded activity session. Therefore, the selected portion may have a time or duration that represents a portion of the total duration. The user may then cut out the selected portion and further process, analyze and / or share the other portion. For example, a clipped portion or the entire recorded session, along with associated metrics, may be uploaded to a social network site, stored on an athletic performance monitoring service site, or emailed to a friend. Good. In one or more configurations, if the average metric for the entire activity session is provided, the system automatically corrects and selects or cuts the average when the user selects or cuts a portion of the activity session. The average of the parts may be reflected. The save option allows the user to save the selected portion. In addition to or instead, the monitoring system may automatically save the clipped portion and the rest as separate files or data items. This prevents the user from accidentally deleting part of the active session.
The user is also allowed to select a specific metric value, and the system automatically cuts a portion of the content file (eg, video or audio file) for the time of the athletic activity session in which the specific metric value was recorded. It may be identified and displayed. Alternatively or additionally, the user may select a portion of the content file (eg, a range or a specific time) and may display one or more metric values specific to the selected portion. ..
The timeline may further include one or more indicators that identify a particular event in the user's activity session. For example, the timeline may be marked with the number of times corresponding to the user's highest or best value for one or more metrics. Therefore, if the user achieves his best vertical jump at time 2:03, the indicator may be placed at a point 2:03 in the timeline. Indicators may be color coded and / or labeled to provide some information about what is marked. According to one aspect, if the user selects a part of the timeline (rather than the entire timeline), the metric is the best (eg, highest or lowest) metric value measured for the user during the selected part. May be modified to reflect and identify. For example, the system may automatically determine the best metric value for the selected portion of the active session. Alternatively, the metric does not have to be modified so that the user can see his or her metric throughout the activity session. Further, instead of this, other indicators may be added in addition to the existing indicators. For example, additional indicators may identify the best times and / or other metrics for the selected portion of the activity session. The user may also name the portion that was cut off during storage. The saved name may be displayed in the title bar. Indicators may be used to identify other events that do not correspond to the best metric. For example, indicators include substantial changes in pace (eg, from a 12-minute mile pace to a 7-minute mile pace within a given time, such as 1 minute), slam dunk, tennis ace, dancing, tackle, football over 20 yards. Identifies the path etc. The metric may specify the lowest metric or point in the activity session that the user needs improvement (eg, guidance or advice).
Selection or cropping of a portion of the video may be done by the user sliding his finger along the timeline (eg, using a touch screen interface) to the desired start and end times of the desired portion. .. The indicators described above allow the user to more easily select a portion or parts of the video for his highlight (eg, highest performance time). Alternatively, the user may use a cursor or a time input field to specify start and end times. In one or more configurations, the user may have the monitor system automatically select a portion. For example, a user may view the monitor system to retain only the time or duration during which the user's best dunk for a particular metric (eg, highest flight time, highest rating by the user and / or other users) was achieved. Request to cut out. In certain examples, the system may automatically hold the event with a given length of time around the event (eg, 2 minutes, 1 minute, 30 seconds, 15 seconds). Only the metric data for the rest of the active session may be retained. In addition, a new average of the retained portion may be calculated when the unselected portion is cut out. On the other hand, the metric data of the non-retained part of the active session may be discarded or saved in another file (for example, the file of the cut part). Alternatively or additionally, in one or more examples, the average of the non-holding portion may be automatically generated for comparison.
The clipped footage can also be automatically stored as a separate content file that is rendered (eg, displayed, auditory, and visually reproduced) independently of other content files or athletic datasets. The separate content file may correspond to an audio file (eg, with or without video), or an application file that animates a sequence of recorded athletic data. The user may select multiple parts of the recorded athletic activity session, and each selected part may be stored as a separate content file. This allows the user to create multiple content files at once by selecting multiple parts of the active session.
FIG. 14 shows a video / metric sharing interface that can be displayed after the user has selected a save option (eg, as shown in FIG. 13). The sharing interface may include one or more prescribed sharing options (eg, Youtube, FACEBOOK, etc.). The interface may also allow users to customize or define their shared sites (eg, by entering a website or network address).
FIG. 15 shows a community website displaying a shared video containing metrics associated with the user displayed in the shared video. On the community website, various individuals can comment on video and / or the user's athletic performance. As an example, the coach makes comments that help the user improve or further encourage the user. Comments may be associated with a particular time as well as metric information. This allows the comment to be triggered or displayed only when a certain time of the video is reached. The user can specify who can comment on the video and / or record the video. For example, a user may only comment or rate video / metrics for a particular group of people, a particular individual, or an individual who meets user-defined criteria (eg, age, location, relationships, etc.). Indicates that it is permitted. The user may specify separate permissions for video and metric. This allows some users to see both the video and the metric, while others can see only the video or only the metric in secret.
Individuals accessing this video may suggest viewing other videos. Other footage is similar to the type of athletic activity, age, gender or location of the subject, school or athletic hall of the subject, exercise of the subject and exercise of the subject within other criteria and / or other criteria. It may be selected based on gender.
Figures 18A and 18B show a set of interfaces in which metrics can be displayed in different areas of the motion visualization area. In this case, the user can adjust the size of the area by moving the intersections between the various areas. The size of each region may be automatically adjusted depending on the position of the intersection. For example, in Figure 18A, the intersections are displayed in the middle of the visualization area, which provides a display area equal to each metric. The user can then decide to move the intersection to another location as shown in Figure 18B (eg, by selecting and dragging the intersection using the touch screen). When the user moves the intersection to the position shown in FIG. 18B, the size of the various regions can automatically change to compensate for the new intersection. For example, the impact and balance metric display areas are narrower, while the visual / visual and jump height metric display areas are wider. In addition, the height of the visual / visual / metric and impact metric areas is high, while the height of the balance and jump height areas is low.
In one or more configurations, the user is allowed to edit the parameters or aspects of the recorded activity session before all recorded metrics are incorporated into a single activity session file or content item. sell. In addition, the session may be clipped before it accumulates in a single file or content item. FIG. 19 shows, for example, the process by which metrics can be selected or deselected to be embedded and stored in the file corresponding to the athletic activity session. Therefore, even if various widget applications record eight different metrics, the user can select only five of the eight metrics and store them in the activity session file. Alternatively or additionally, the user may define the placement of various metric and widget applications within the display area so that the system can assemble the video and other data in the desired way. In addition, the user may add comments, audio (eg, soundtracks, narration, sound effects, etc.), interactive buttons (eg, email athletes, download footage, etc.).
Video, audio or other athletic exercise content data may also be associated with location information. For example, location is used as a metric as described herein. In addition, information about a particular location may be displayed, stored and / or associated with athletic performance in detail. For example, the position information of the user's position in each minimum time unit (for example, 1 second, 1 minute, 5 minutes, 30 minutes, etc.) is acquired and stored. This way, if the user was in the park at 1 minute and then ran to the bridge at 8 minutes, the information about the park would be associated with the athletic performance at 1 minute and the information about the bridge would be 8 Associated with athletic performance at the point of minutes. The position description information may indicate the type of position, the history of the position, the event that occurs at the position, and the like. The location description information may then be displayed, with the user displaying the progress of athletic performance data (eg, video, audio, video data).
(Conclusion) Although the above description has been given for specific examples including the current preferred embodiments of the present invention, it will be apparent to those skilled in the art that there are many modifications and substitutions for the above systems and methods. .. For example, various aspects of the invention may be used in different combinations as long as they do not deviate from the invention. Also, different subcombinations of various aspects of the invention can be used together in a single system or method. As an example, the software and applications described herein can be implemented as computer-readable instructions stored on a computer-readable medium. Also, as long as it does not deviate from the present invention, the various elements, components, and / or steps described above have been modified, reordered, omitted, and / or additional components, components, and / or steps. May be added. Therefore, the present invention should be construed in a broad sense as described in the appended claims.
(Cross-reference to related applications) This application is a priority from US Provisional Application No. 61 / 4,12,285, entitled "SYSTEMS AND METHODS FOR TIME-BASED ATHLETIC ACTIVITY MEASUREMENT AND DISPLAY" filed on November 10, 2010. Claiming advantages, the content of this application is incorporated herein by reference in its entirety.
101: Computer, 103: Computing unit, 105: Processor unit, 107: System memory, 115: Network interface, 117: Hard disk drive, 119: Removable optical disk drive, 121: Input device, 123: Output device
28 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| JP2010517725A | Cites | Japan |
| JP2006031504A | Cites | Japan |
| WO2009073610A2 | Cites | World Intellectual Property Organization (WIPO) |
| US20080109158A1 | Cites | United States of America |
63 members in 8 offices
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 41228510 | United States of America | P | |
| 41228510 | United States of America | P | |
| 61412285 | United States of America | – | |
| 61412285 | – | – | – |
| US20100412285P | – | – | – |
Members63
| Document | Office | Kind | |
|---|---|---|---|
| CA2817573A1 | Canada | A1 | |
| CA2955632A1 | Canada | A1 | |
| WO2012064956A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2012251079A1 | United States of America | A1 | |
| EP2638491A1 | European Patent Office (EPO) | A1 | |
| KR20130105677A | Republic of Korea | A | |
| CN103443795A | China | A | |
| JP2014502179A | Japan | A | |
| US8831407B2 | United States of America | B2 | |
| US2014375817A1 | United States of America | A1 | |
| KR20150038498A | Republic of Korea | A | |
| US2015253120A1 | United States of America | A1 | |
| KR101560955B1 | Republic of Korea | B1 | |
| JP5847831B2 | Japan | B2 | |
| JP2016105592A | Japan | A | |
| US9389057B2 | United States of America | B2 | |
| BR112013011690A2 | Brazil | A2 | |
| US9429411B2 | United States of America | B2 | |
| CN103443795B | China | B | |
| US2016332029A1 | United States of America | A1 | |
| CN107066776A | China | A | |
| US9757619B2 | United States of America | B2 | |
| US2018008863A1 | United States of America | A1 | |
| KR101818092B1 | Republic of Korea | B1 | |
| KR20180005288A | Republic of Korea | A | |
| JP6262187B2 | Japan | B2 | |
| JP2018075391A | Japan | A | |
| US10010752B2 | United States of America | B2 | |
| CA2817573C | Canada | C | |
| US2018272188A1 | United States of America | A1 | |
| KR101926319B1 | Republic of Korea | B1 | |
| US10293209B2 | United States of America | B2 | |
| JP6527929B2 | Japan | B2 | |
| US2019232109A1 | United States of America | A1 | |
| JP2019193794A | Japan | A | |
| US10632343B2 | United States of America | B2 | |
| US2020246662A1 | United States of America | A1 | |
| JP6818079B2This record | Japan | B2 | |
| JP2021072881A | Japan | A | |
| CN113270185A | China | A | |
| US2022262485A1 | United States of America | A1 | |
| EP2638491B1 | European Patent Office (EPO) | B1 | |
| US11568977B2 | United States of America | B2 | |
| EP4138095A1 | European Patent Office (EPO) | A1 | |
| US11600371B2 | United States of America | B2 | |
| US2023136147A1 | United States of America | A1 | |
| US2023178209A1 | United States of America | A1 | |
| US2023326572A1 | United States of America | A1 | |
| US11817198B2 | United States of America | B2 | |
| US2024038360A1 | United States of America | A1 | |
| JP2024016117A | Japan | A | |
| JP7432499B2 | Japan | B2 | |
| US11935640B2 | United States of America | B2 | |
| US2024185983A1 | United States of America | A1 | |
| US2024185984A1 | United States of America | A1 | |
| CN118262863A | China | A | |
| CN113270185B | China | B | |
| US12170138B2 | United States of America | B2 | |
| US12224053B2 | United States of America | B2 | |
| US12322488B2 | United States of America | B2 | |
| US12322489B2 | United States of America | B2 | |
| JP7715783B2 | Japan | B2 | |
| US2025266144A1 | United States of America | A1 |
13 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Written request for extension of timeJAPANESE INTERMEDIATE CODE: A601A601 | A601 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for extension of timeJAPANESE INTERMEDIATE CODE: A601A601 | A601 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on retrievalJAPANESE INTERMEDIATE CODE: A971007A977 | A977 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 6818079
- Publication, DOCDB
- 6818079
- Publication, EPODOC
- JP6818079B
- Application
- 90551
- Application, DOCDB
- 2019090551
- Application, EPODOC
- JP20190090551
Titles2
- Japanese
- 時間ベースでアスレチック活動を測定し表示するシステムおよび方法
- English
- Systems and methods for measuring and displaying athletic activity on a time basis
Classification
- CPC, 12
- G16H40/63
- G16H20/30
- G16Z99/00
- G16H40/67
- G16H50/70
- H04N5/9205
- H04N7/181
- A63B24/0062
- G01B5/02
- G01P15/09
- G09B5/02
- G16H50/20
- IPC, 4
- A63B69 00
- G16H20 30
- G16H40 67
- G16Z99 00
