Sports events broadcasting systems and methods

CROSS-REFERENCE(S) TO RELATED APPLICATION(S)

This application claims the benefit of Provisional Application No. <patcit id="pcit0001" dnum="WO62660687A"><text>62/660687, filed April 20, 2018</text></patcit>, the disclosure of which is hereby incorporated by reference.

BACKGROUND

The present disclosure generally relates to data broadcasting, and more specifically to a system and method for recording the path of travel and telemetry metadata of a sports ball, sports athletes, or other elements for subsequent processing and broadcasting, enabling various applications and interactions with a user.

When a sporting event is broadcast and televised in real time, many of the most important plays occur in short moments of suspense and excitement. For example, during the broadcast of a soccer game there are numerous instances in which a specific play may be of particular interest to the audience, such as during penalty shootouts, a remarkable save by a goalkeeper, a goal scored from long range, and the like. These plays may typically occur within just a few seconds, time which may be a determining factor of whether a team wins or loses a game that may take more than 3 hours to finish.

Broadcasters typically provide slow motion replays in an attempt to extend and improve a viewer's experience of a match. In order to do this, many different cameras are used to capture numerous shots, angles, and takes; thus, video editors are able to quickly review which angles are most suitable for a given replay, make the necessary video edits, and then broadcast the replay from one or more of the available angles/takes to the audience. However, current broadcasting techniques only allow for capturing moments from different angles with cameras that are fixed in specific parts of the stadium. This can result in a lack of accuracy in keeping track of the ball throughout its trajectory, as well as a lack of flexibility regarding the selection of camera takes.

The mounting of cameras in/on sports balls to record the balls' trajectory has been attempted. However, factors such as high image capture stability/very fast frame rate requirements for post-processing and producing high quality output images have hindered further developments in this field. Although some advances have been made in relation to the monitoring of a sports ball, such as registering and providing data related to the sports ball telemetry, these advances have mostly focused on the impact made by/on an individual sportsperson during the course of an athletic activity. Therefore, these applications have mainly been used as athletic activity assessment tools and not as a method/opportunity to record broadcastable material to an audience.

Hence, there is a definite need for a system and method that enables the recording of images from the perspective of a sports ball or individual players which may then be processed into broadcast quality images for the enjoyment of an audience.

SUMMARY

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

The current disclosure describes a system and method that allows for recording and broadcasting footage from the perspective of a sports ball, individual players, and locations around a sports field during a sports activity, enabling various interactive applications with users. The system and method may enhance the quality and value of footage broadcast to an audience, eliminating camera mobility restrictions that are a typical drawback of current broadcasting methods and fulfilling fast frame rate requirements for video post-processing. Additionally, the system and method may increase the number of possible sets of camera footage to be broadcast by providing more than one set of processed video footage. The current disclosure also contemplates other applications, such as processing of raw data through a rendering engine to produce virtual reality (VR), augmented reality (AR), and mixed reality (MR) experiences that may be employed in the training of sports players or for the enjoyment of an audience that may view a replay broadcast from different perspectives (e.g., from a sports ball perspective, perspective of individual players, or a global three-dimensional perspective). Other applications may include allowing users, such as members of an audience, to enjoy AR, VR, and MR experiences by creating interactive volumes that may be viewed and engaged by users through AR/VR/MR devices, or enjoying 360 degree action-focused replays that can be viewed in AR/VR/MR views and which may, as well, be shared with other stadiums. In some embodiments, systems and methods of the current disclosure may additionally be adapted for other types of events that may take place in stadiums, such as concerts, plays, and other entertainment events.

According to an embodiment, a broadcasting system includes a wireless transceiver hub (which may include, e.g., a wireless pitch data transmission grid mounted under a sports pitch and/or antennas mounted around the sports pitch) communicatively connected for receiving data from a sports ball and sports equipment on individual players and transmitting such data to a data processing server. Received data includes raw video footage of the sports ball and individual players' trajectory and locomotion as well as sports telemetry metadata of the sports ball. The data is then transferred to a data processing server which analyses the data and generates directional data that is used to control a stadium camera system communicatively connected to the data processing server (e.g., via the wireless transceiver hub). The stadium camera system includes a plurality of action-focused cameras that, based on the received directional data sent by the data processing server, auto-compensate and regulate rotation, focus, and zoom of cameras in order to generate footage data comprising uniform action coverage covering 360 degrees field of view around a spherical focus zone determined by the location of the sports ball, individual players, or combinations thereof.. The data is then sent back to the processing server for further processing and synthesizing, e.g., from an original high frame rate of at least 100 frames per second (FPS) to produce a clean footage at a frame rate of at least 24 FPS.

In some embodiments, the plurality of action-focused cameras of the stadium camera system includes Light Detection and Ranging (LIDAR) devices mounted thereon, which may provide precise distance and depth information of action taking place in the sports pitch. In other embodiments, the plurality of action-focused cameras of the stadium camera system includes electroacoustic transducers, including microphones and loudspeakers, which enable the recording and reproduction of sound data originating from the action taking place in the sports stadium.

In some embodiments, the spherical focus zone may comprise a fixed diameter or a variable diameter that may be determined based on the action taking place in the sports field.

In various embodiments, the processed footage may be generated from the perspective of the sports ball, of individual players, of 360 degree action-focused views and sounds ready to be broadcast to an audience, and combinations thereof. In some embodiments, processed footage broadcasting may include image data, 3D geometries, video data, audio data, textual data, haptic data, or a combination thereof.

According to an embodiment, sports equipment wearable by individual players, such as articles of clothing, articles of footwear, or athletic protective equipment, may include image capturing devices mounted upon them in order to capture raw video footage from the perspective of individual players. In addition, the sports equipment may include a sensor module connected to the image capturing devices for capturing individual players' motion telemetry metadata and enable data transfer.

According to an embodiment, the sports ball includes an outer layer enclosing a hollow void, such as in a soccer ball, American football, rugby, basketball, volleyball, and the like. In other embodiments, the sports ball is a non-hollow sports ball and includes a single, solid layer or multiple different layers, such as in a baseball, bowling ball, golf ball, and the like.

According to an embodiment, a sports ball includes one or more image capturing devices mounted in the sports ball for capturing video footage of the trajectory and locomotion of the sports ball, as well as a sensor module for receiving the raw video footage of trajectory and locomotion of said sports ball, generating telemetry metadata of said sports ball, and wirelessly transmitting data (e.g., the raw video footage and telemetry data) to some other device, such as to upload the data to a data processing server via a wireless transceiver hub. The sensor module also may include memory for storing this video footage and telemetry metadata of the sports ball.

According to an embodiment, image capturing devices may be embedded in the sports ball covering in areas that allow for a suitable concealment. For example, in the case of a soccer ball, image capturing devices may be mounted in the black pentagonal patches that typically make-up part of the design of soccer balls. Yet further in this embodiment, the number of cameras mounted on the sports ball may vary according to the design of the sports ball.

According to an embodiment, the image capturing devices include one or more layers of soft protective lens mounted on top of a camera lens for providing damage and shock protection. According to yet another embodiment, the camera lens may be sandwiched between two or more layers of soft protective lens for providing damage and shock protection. The number of protective layers may depend upon the specific material composition and thickness of each layer.

According to an embodiment, the sensor module mounted within the sports ball may include an Inertia Measuring Unit (IMU), a transceiver, a memory, and a power source, all operatively connected to a processor. Generally, the sensor module is configured to receive raw video data taken by the image capturing devices as well as telemetry metadata related to the movement of the sports ball for subsequent processing and broadcasting. Preferably, the transceivers are millimeter-wave (mmW) transceivers. The power source is configured to provide power to the sensor module; the memory may be adapted to store application program instructions and to store sports ball telemetry metadata from the IMU; the IMU, which may include one or more accelerometers and gyroscopes, is configured to measure and report the velocity, acceleration, angular momentum, speed of translation, speed of rotation, and other telemetry metadata of the sports ball; the mmW transceivers may allow the sports ball to receive mmW signals and to send the data back when interacting with digital reality content, and may also enable positional tracking of the sports ball; and the processor may be configured to implement application programs stored in the memory of the sports ball. In certain embodiments the IMU and mmW transceivers may be decoupled (i.e., separate from each other). In other embodiments, the IMU and mmW transceivers may be coupled together, forming one operational component within the sensor module.

According to an embodiment, combining the capabilities of the IMU with the positional tracking provided by the mmW transceivers, may enable sub-centimeter or sub-millimeter positional and orientational tracking, which may increase accuracy when tracking the real-time position and orientation of the sports ball and may improve the general user experience. Tracking of the client devices may be performed employing several techniques known (e.g., time of arrival (TOA), angle of arrival (AOA), visual imaging, radar technology, etc.).

According to an embodiment, a ball charging system employed to charge the power source in sensor module may include a ball charging device where the sports ball may be connected for being powered by inductive charging. Exterior markings on the sports ball may indicate the location of an inductive coil that receives charge from the ball charging device, or may otherwise facilitate optimum orientation of the sports ball for being charged.

According to an embodiment, a wireless pitch data transmission grid mounted under the sports pitch and/or antennas mounted around the sports pitch provide the sports ball with a wireless data connection and may allow the sports ball to upload data for further processing and broadcasting. The wireless pitch data transmission grid and antennas enable different wireless systems communication, including but not limited to millimeter wave (mmW)-based communication or a combination of mmW-based and sub 6 GHz-based communication. In other embodiments, 4G antenna systems may be used as support for the mmW/sub GHz antenna systems. In other embodiments, the antennas may use wireless local area networking (WiFi), preferably, but not limited to, providing data at 16 GHz.

According to an embodiment, a method for processing and synthesizing video footage performed by the data processing server includes the steps of obtaining raw video data from image capturing devices mounted in sports balls and on individual players along with telemetry metadata; determining a real ball direction in world space, sending directional data to a stadium camera system; obtaining 360 degree action-focused broadcast data from the stadium camera system; applying camera footage selection/discarding rules; applying data-broadcast triggering rules; and applying other video footage processing techniques on the data received from the sports ball, from the image capturing devices mounted on the sports equipment of individual players, and from the stadium camera system.

According to an embodiment, a method for determining a real ball direction in world space includes the steps of detecting the movement of a sports ball; determining an initial spatial orientation of the sports ball; determining the sports ball telemetry metadata; and analyzing the data to obtain a real ball direction.

According to an embodiment, a camera footage selection/discarding method within ball space may be performed by the data processing server based on a set of camera footage selection/discarding rules. The camera footage selection/discarding method within ball space may be performed in order to process images sent to the data processing server by each of the image capturing devices mounted in the sports ball via the wireless pitch data transmission grid, selecting only footage that may add value to a final footage to be broadcast to an audience. For example, a soccer ball may send camera footage from all of the cameras to the data processing server while the sports ball is displaced during an athletic activity. Then, a camera footage selection rule may instruct the data processing server to select footage from all cameras complying with that camera footage selection rule, and to discard footage from all cameras compliant with camera footage discarding rules. Camera footage may be selected from one camera for a given set of video frames. Additionally, camera footage may also be selected from more than one camera for a given set of video frames for providing more than one set of processed footage for broadcasting to an audience.

According to an embodiment, the data-broadcast triggering rules are based on and directly linked to events that are specific to the rules of the sports event being broadcast.

According to an embodiment, various other applications for the broadcasting system are contemplated, such as employing the broadcasting system for interactions with a user as an augmented reality (AR), virtual reality (VR) and/or mixed reality (MR) system. In this embodiment, raw data captured by image capturing devices (e.g., mounted in the sports ball and/or on the sports equipment of individual players is transmitted to a data processing server (e.g., a processing/rendering server) after being uploaded via a wireless transceiver hub (e.g., a wireless pitch data transmission grid and/or antennas). Subsequently, the data processing server may analyze and process the raw data received to generate directional data that is then sent to the stadium camera system comprising a plurality of action-focused cameras that, based on directional data sent by the data processing server, auto-compensate and regulate rotation, focus, and zoom of cameras in order to generate footage data comprising uniform action coverage covering 360 degrees field of view around a spherical focus zone determined by the location of the sports ball, individual players, or combinations thereof. The data is sent back to the data processing server which, applying data-broadcast triggering rules, noise filtering methods, and other video processing and rendering techniques, processes the raw data and 360 degree action-focused broadcast data to create context-full scenarios that may be used for AR/VR/MR interactions with individual players or with members of an audience.

In an embodiment of AR/VR/MR experiences provided to individual players, the AR/VR/MR system may be employed not only to train athletic skills of individual players, but also to provide psychological conditioning, such as mentally preparing individual players for a penalty shootout. In an embodiment of AR/VR/MR experiences provided to members of an audience, the AR/VR/MR system may be employed to allow members of an audience to view and experience the broadcast of a replay from the perspective of one or more individual players and/or from the perspective of a sports ball. In an embodiment, the data from the image capturing devices on the sports equipment of individual players are used by the processing/rendering server to create interactive volumes that enable AR/VR/MR experiences. In an embodiment, the compensation and modification of the rotation, focus, and zoom of each of the action-focused cameras within the stadium camera system generates 360 degree action-focused broadcast data that the processing/rendering server processes and renders in order to create 360 degree AR/VR/MR experiences around action taking place in the sports pitch. In some embodiments, the 360 degree AR/VR/MR experiences may be shared with one or more other remote stadiums through a cloud server in order to simulate the sports event taking place in the one or more remote stadiums.

The above summary does not include an exhaustive list of all aspects of the present disclosure. It is contemplated that the disclosure includes all systems and methods that can be practiced from all suitable combinations of the various aspects summarized above, as well as those disclosed in the Detailed Description below, and particularly pointed out in the claims filed with the application. Such combinations have particular advantages not specifically recited in the above summary. Other features and advantages of the present invention will be apparent from the accompanying drawings and from the detailed description that follows below.

DESCRIPTION OF THE DRAWINGS

The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein: <ul id="ul0001" list-style="none" compact="compact"><li><figref idref="f0001"><b>FIG. 1</b></figref> illustrates a diagram of a broadcasting system, according to an embodiment.</li><li><figref idref="f0002"><b>FIG. 2</b></figref> illustrates sample sports equipment that may be utilized in the broadcasting system, according to an embodiment.</li><li><figref idref="f0003"><b>FIGS. 3A and 3B</b></figref> illustrate sample sports balls suitable for being employed in the broadcasting system of the current disclosure, according to an embodiment.</li><li><figref idref="f0004"><b>FIG. 4</b></figref> illustrates a sports ball including one or more image capturing devices and a sensor module for receiving captured video footage of the sports ball trajectory and locomotion as well as generating the sports ball telemetry metadata, respectively, according to an embodiment.</li><li><figref idref="f0005"><b>FIG. 5</b></figref> illustrates a close-up view of an image capturing device mounted in the sports ball, according to an embodiment.</li><li><figref idref="f0006"><b>FIG. 6</b></figref> illustrates image capturing device protective layers, according to an embodiment.</li><li><figref idref="f0007"><b>FIG. 7</b></figref> illustrates a sensor module mounted within the sports ball, according to an embodiment.</li><li><figref idref="f0008"><b>FIG. 8</b></figref> illustrates a ball charging system that may be employed to charge a power source within the sensor module of the sports ball, according to an embodiment.</li><li><figref idref="f0009"><b>FIG. 9</b></figref> illustrates a wireless pitch data transmission grid that may be mounted under the sports pitch, according to an embodiment.</li><li><figref idref="f0010"><b>FIG. 10</b></figref> illustrates a method for processing and synthesizing video footage, according to an embodiment.</li><li><figref idref="f0011"><b>FIG. 11</b></figref> illustrates a method for determining a real ball direction within world space, according to an embodiment.</li><li><figref idref="f0012"><b>FIG. 12</b></figref> illustrates a stadium camera system that may be used to generate 360 degree action-focused broadcast data, according to an embodiment.</li><li><figref idref="f0013"><b>FIGS. 13A and 13B</b></figref> illustrate a diagram of a camera footage selection/discarding within ball space, according to an embodiment.</li><li><figref idref="f0014"><b>FIG. 14</b></figref> illustrates a sample set of camera footage selection/discarding rules using a soccer ball as an example, according to an embodiment.</li><li><figref idref="f0015"><b>FIG. 15</b></figref> illustrates a sample set of data broadcasting rules, according to an embodiment.</li><li><figref idref="f0016"><b>FIG. 16</b></figref> illustrates a diagram of video footage synthesizing/filtering, according to an embodiment.</li><li><figref idref="f0017"><b>FIG. 17</b></figref> illustrates applications of the broadcasting system being employed for interactions with a user through virtual reality and/or augmented reality, according to an embodiment.</li></ul>

DETAILED DESCRIPTION

In the following description, reference is made to drawings which show by way of illustration various embodiments. Also, various embodiments will be described below by referring to several examples. It is to be understood that the embodiments may include changes in design and structure without departing from the scope of the claimed subject matter.

<figref idref="f0001"><b>FIG. 1</b></figref> illustrates a broadcasting system <b>100,</b> according to an embodiment. The broadcasting system <b>100</b> includes an action perspective data capturing module <b>102</b> which may comprise a sports ball <b>104</b> and one or more individual players <b>106</b>. Sports equipment <b>108</b> on the individual players <b>106,</b> and the sports ball <b>104</b>, may include image capturing devices <b>110</b> mounted upon them and configured to capture and transmit raw video footage. Additional devices such as a sensor module mounted in the sports ball <b>104</b> and on sports equipment <b>108</b> on the individual players <b>106</b> may capture motion telemetry metadata from the sports ball <b>104</b> and from the individual players <b>106,</b> respectively. The raw data <b>112</b> may include raw video footage and telemetry metadata.

Raw data <b>112,</b> which includes raw video footage captured by the image capturing devices <b>110</b> mounted in the sports ball <b>104</b> and on individual players <b>106,</b> in addition to the telemetry metadata captured by the sensor module in the sports ball <b>104</b>, are transmitted to a wireless transceiver hub, which may include, e.g., a wireless pitch data transmission grid <b>114</b> mounted under the sports pitch and/or antennas <b>116</b> mounted around the sports pitch, which in turn transmit the raw data <b>112</b> to a data processing server <b>118</b> for analysis and processing.

After obtaining the raw video data and telemetry metadata, the data processing server <b>118</b> may proceed by determining a real ball direction within world space. Information of the real ball direction within world space along with telemetry metadata sent by the sensor module included in the image capturing devices <b>110</b> on sports equipment <b>108</b> worn by individual players <b>106</b> provides a stadium camera system <b>120</b> with directional data <b>122</b> that action-focused cameras <b>124</b> included in the stadium camera system <b>120</b> may focus on. The stadium camera system <b>120</b> may send real-time 360 degree action-focused broadcast data <b>126</b> back to the data processing server <b>118</b> for further processing.

In some embodiments, the action-focused cameras <b>124</b> include a Light Detection and Ranging (LIDAR) devices mounted thereon. The LIDAR devices may provide precise distance and depth information of action taking place in the sports pitch. Data obtained from the LIDAR devices may be included in the 360 degree action-focused broadcast data <b>126</b> that is sent back to the data processing server <b>118</b> for further processing.

In some embodiments the plurality of action-focused cameras <b>124</b> of the stadium camera system <b>120</b> includes electroacoustic transducers, including microphones and loudspeakers, respectively configured to record and reproduce sound data originating from the action taking place on the sports pitch.

Subsequently, the data processing server <b>118</b>, through footage selection/discarding rules of footage sent by the image capturing devices <b>110</b> mounted in the sports ball <b>104</b> and on individual players <b>106,</b> applying data-broadcast triggering rules, noise filtering methods, and other video processing techniques, synthesizes the raw data <b>112</b> and 360 degree action-focused broadcast data <b>126</b> into processed data <b>128</b>. A processed data signal is then transmitted for subsequent presentation to an audience, e.g., via display <b>130</b>. Through the broadcasting system <b>100</b>, footage from the raw data <b>112</b> and 360 degree action-focused broadcast data <b>126</b> is received at a high frame rate of at least 100 frames per second (FPS) and is converted into clean, processed data <b>128</b> at a low frame rate of at least 24 FPS that may be viewed as a processed footage broadcasting <b>132</b> including on a viewing means such as display <b>130</b> for enjoyment of an audience. The processed data <b>128</b> may be viewed as a reconstructed replay from different angles and perspectives for a specific scene of the sports event.

In some embodiments, processed footage broadcasting <b>132</b> may include image data, 3D geometries, video data, textual data, haptic data, audio data, or a combination thereof.

In some embodiments, systems and methods of the current disclosure may additionally be adapted for other types of events that may take place in stadiums, such as concerts, plays, and other entertainment events. For application in concerts and plays, real-time motion-capturing techniques known in the art may be applied to performers.

<figref idref="f0002"><b>FIG. 2</b></figref> illustrates sports equipment <b>108</b> that may be utilized in the broadcasting system <b>100,</b> according to an embodiment. In some embodiments of the present disclosure, the piece of sports equipment <b>108</b> could be wearable by the individual players, such as an article of clothing, an article of footwear, or athletic protective equipment. In these embodiments, the image capturing devices <b>110</b> may be physically coupled to the portion of the body of an individual player by a variety of releasable or non-releasable coupling means such as, for example, straps, adhesives, pockets, clips, or by being integrated into an article of clothing (e.g., shirt, pants, sock, glove, or hat), footwear, or athletic protective equipment worn by the individual player.

In an embodiment, the sports equipment <b>108</b> includes sports uniform <b>202</b> and sports shoes <b>204</b>. The image capturing devices <b>110</b> that may be mounted upon the sports equipment <b>108</b> may preferably include video-recording cameras, and may be employed to record raw video footage from the perspective of the individual players. The video-recording cameras may capture video footage at a high rate of at least 100 FPS and covering at least 120 degrees of field view. The sports equipment <b>108</b> additionally includes a sensor module connected to the image capturing devices <b>110</b> for capturing individual players motion telemetry metadata and enabling data transfer.

<figref idref="f0003"><b>FIGS. 3A and 3B</b></figref> illustrate sports balls <b>104</b> that may be suitable for being employed in broadcasting system <b>100,</b> according to an embodiment.

<figref idref="f0003"><b>FIG. 3A</b></figref> shows sports balls <b>104</b> including an outer layer enclosing a hollow void, according to an embodiment. Examples of these hollow sports balls <b>104</b> include but are not limited to soccer balls <b>302</b>, basketballs <b>304</b>, American footballs <b>306</b>, rugby balls <b>308</b>, volleyballs <b>310</b>, and the like. The outer layer may be stitched, bonded, and/or glued together from panels of leather or plastic and laced to allow access to an internal air bladder, if necessary.

<figref idref="f0003"><b>FIG. 3B</b></figref> shows non-hollow sports balls <b>104</b> including a single solid layer or multiple different layers. Examples of these non-hollow sports balls <b>104</b> include but are not limited to baseballs <b>312</b>, bowling balls <b>314</b>, golf balls <b>316</b>, and the like.

<figref idref="f0004"><b>FIG. 4</b></figref> illustrates a sports ball circuitry <b>400</b> including a plurality of image capturing devices <b>110</b> for recording video footage of trajectory and locomotion of the sports ball <b>104</b>, and a sensor module <b>402</b> for receiving video footage of captured by image capture devices <b>110</b> of the sports ball, generating telemetry metadata of the sports ball, and wirelessly transmitting data (e.g., raw video footage and telemetry data) to some other device, such as to a wireless transceiver hub for upload to a data processing server. The sensor module <b>402</b> also may include memory for storing and/or processing this video footage in addition to motion telemetry metadata of the sports ball <b>104</b>, according to an embodiment. Internal circuitry and a framework enable a suitable connection between the image capturing device <b>110</b> and the sensor module <b>402</b>.

The sensor module <b>402</b> may be physically coupled to the sports ball <b>104</b> by a variety of coupling means depending on the nature of the sports ball <b>104</b>. For example, the sensor module <b>402</b> may be physically coupled to a sports ball <b>104</b> by being attached to the exterior of the sports ball <b>104</b>, by being attached to an interior surface of a hollow sports ball <b>104</b>, by being suspended by a suspension system in the interior of a hollow sports ball <b>104</b>, or by being integrated into the outer layer or other layer of a multi-layer, non-hollow sports ball <b>104.</b>

Exemplary techniques that may be employed to mount the sensor module <b>402</b> to the sports ball <b>104</b> are disclosed in United States Patent No. <patcit id="pcit0002" dnum="US7740551B"><text>7,740,551</text></patcit>, and United States Patent No. <patcit id="pcit0003" dnum="US8517869B"><text>8,517,869, both filed on November 18, 2009</text></patcit> and which are incorporated herein by reference.

<figref idref="f0005"><b>FIG.</b> 5</figref> illustrates a close-up view <b>500</b> of an image capturing device <b>110</b> mounted in a soccer ball <b>302</b>, according to an embodiment. The image capturing device <b>110</b> may be embedded in the ball covering in areas that allow for a suitable concealment. For example, the plurality of image capturing devices <b>110</b> may be mounted in the black pentagonal patches <b>504</b> that typically make-up part of the design of soccer balls <b>302</b>, thus avoiding users noticing the presence of the image capturing devices <b>110</b>.

The number of image capturing devices <b>110</b> may vary according to the design of the sports ball. Thus, in the case of a soccer ball <b>302</b> with 12 black pentagonal patches <b>504</b> and 20 white pentagonal patches <b>506</b>, a total of 12 image capturing devices <b>110</b> may be mounted in the sports ball, with one image capturing device <b>110</b> mounted per black pentagonal patch <b>504</b>. The image capturing devices <b>110</b> may capture video footage at a high rate of at least 100 FPS and covering at least 90 degrees of field view each. Thus, for a soccer ball <b>302</b> with 12 image capturing devices <b>110</b>, a total of at least 1080 degrees of field view may be covered.

<figref idref="f0006"><b>FIG. 6</b></figref> illustrates image capturing device protective layers <b>600</b>, according to an embodiment. A camera lens <b>602</b> of image capturing device may be protected by one or more layers of soft protective lens <b>604</b> mounted on top of the camera lens <b>602.</b> According to yet another embodiment, the camera lens <b>602</b> may be sandwiched between two or more layers of soft protective lens <b>604</b> for providing damage and shock protection to the camera lens <b>602</b>. The number of protective layers may depend on the specific polymer material composition and thickness of layer of soft protective lens <b>604</b>.

Suitable materials for soft protective lens <b>604</b> may include neoprene, which displays high elasticity and cannot easily be cracked or damaged upon impact.

According to yet other embodiments, other suitable methods for protecting a image capturing device may be employed. For example, suitable methods for protecting an image capturing device are mentioned in the United States Pre-Grant Publication No. <patcit id="pcit0004" dnum="US20130129338A"><text>2013/0129338, filed on October 15, 2012</text></patcit>, which is herein incorporated by reference, where a camera protection system includes three layers of protective material. The outer layer is made of a firm yet flexible material such as Santoprene™ vinyl (Santoprene is a trademark of the ExxonMobil Corporation for their proprietary line of thermoplastic vulcanizate (TPV)), vinyl or nitrile based compound. The second inner layer is made of a softer material such as neoprene or other similar soft and spongy/foam materials that have good compression and decompression properties. The third interior layer is made of Jersey or other suitable soft cloth material designed to protect the finish of a lens barrel wherein the camera lens may be located.

<figref idref="f0007"><b>FIG. 7</b></figref> illustrates a sensor module <b>402</b> mounted in the sports ball and on sports equipment on individual players, according to an embodiment. The sensor module <b>402</b> includes an Inertia Measuring Unit <b>702</b> (IMU), transceivers <b>704</b>, a memory <b>706</b>, and a power source <b>708</b>, all operatively connected to a processor <b>710</b>. Preferably, and as shown in <figref idref="f0007"><b>FIG. 7</b></figref>, the transceivers <b>704</b> may be mmW transceivers <b>704</b>. In other embodiments, one or more of the sensor module <b>402</b> components may be omitted, or one or more additional components may be added. Generally, the sensor module <b>402</b> is configured to receive raw video data taken by the image capturing devices as well as telemetry metadata related to movement of the sports ball and, optionally, individual players for subsequent processing and broadcasting.

The IMU <b>702</b> measures and reports the velocity, acceleration, angular momentum, and other telemetry metadata of the sports ball and/or individual players using a combination of accelerometers and gyroscopes.

Accelerometers within the IMU <b>702</b> may be capable of measuring the acceleration of the sports ball and individual players, including the acceleration due to the Earth's gravitational field. In one embodiment, accelerometers within the IMU <b>702</b> may include a tri-axial accelerometer that is capable of measuring acceleration in three orthogonal directions. In other embodiments one, two, three, or more separate accelerometers may be included within IMU <b>702</b>.

Gyroscopes included in the IMU <b>702</b> or in addition to gyroscopes included in the IMU <b>702</b>, apart from measuring angular momentum of a sports ball in motion, may also serve for maintaining the rotation of the sensor module <b>402</b> independent of the rotation of the sports ball.

MmW transceivers <b>704</b> may allow the sports ball and sports equipment on individual players to receive mmW wireless signals and to upload data including raw video footage and telemetry metadata for subsequent processing and broadcasting. The mmW transceivers <b>704</b> may also be configured to enable positional tracking of the sports ball and sports equipment. Data transfer and receiving of the mmW transceiver <b>704</b> to and from other devices may take place over a personal area network or local area network using, for example, one or more of the following protocols: ANT, ANT + by Dynastream Innovations, Bluetooth, Bluetooth Low Energy Technology, BlueRobin, or suitable wireless personal or local area network protocols.

In an embodiment, mmW-based communication systems, a combination of mmW-based and sub 6 GHz-based communication, or wireless local area networking (WiFi), preferably, but not limited to, providing data at 16 GHz, are used for data transfer and receiving by mmW transceivers <b>704</b>. In other embodiments, 4G antenna systems may be used as support the mmW/sub GHz antenna systems.

The memory <b>706</b> may be adapted to store application program instructions and to store telemetry metadata of the sports ball and individual players from the IMU <b>702</b> as well as raw footage taken by the image capturing device.

The power source <b>708</b> is configured to provide power to the image capturing device and to the sensor module <b>402</b>.

In one embodiment, the power source <b>708</b> may be a battery. The power source <b>708</b> may be built into the sensor module <b>402</b> or removable from the sensor module <b>402</b>, and may be rechargeable or non-rechargeable. In one embodiment, the sensor module <b>402</b> may be repowered by replacing one power source <b>708</b> with another power source <b>708</b>. In another embodiment, the power source <b>708</b> may be recharged by a cable attached to a charging source, such as a universal serial bus ("USB"), FireWire, Ethernet, Thunderbolt, or headphone cable, attached to a personal computer. In yet another embodiment, the power source <b>708</b> may be recharged by inductive charging, wherein an electromagnetic field is used to transfer energy from an inductive charger to the power source <b>708</b> when the two are brought in close proximity, but need not be plugged into one another via a cable. In another embodiment, a docking station may be used to facilitate charging.

The processor <b>710</b> may be adapted to implement application programs stored in the memory <b>706</b> of the sensor module <b>402</b>. The processor <b>710</b> may also be capable of implementing analog or digital signal processing algorithms such as raw data reduction or filtering. For example, the processor <b>710</b> may be configured to receive and process raw data from the IMU <b>702</b> and raw video footage from image capturing device.

In an embodiment, combining the capabilities of the IMU <b>702</b> with the positional tracking provided by the mmW transceivers <b>704</b> may enable sub-centimeter or sub-millimeter positional and orientational tracking, which may increase accuracy when tracking the real-time position and orientation of the client devices and may improve the general user experience.

Tracking of the client devices may be performed employing several techniques known in the art. For example, tracking may be performed by employing time of arrival (TOA) tracking technique, which uses information gathered from three or more antennas. The client device then sends out a signal that is received by all of the antennas within range. Then, each antenna measures the amount of time it has taken to receive the signal from the time the signal was sent, triangulating the position of the client device. In other embodiments, tracking of client devices may be performed by using an angle of arrival (AOA) technique which, instead of using the time it takes for a signal to reach three base stations like TOA does, uses the angle at which a client device signal arrives at the antennas. By comparing the angle-of-arrival data among multiple antennas (at least three), the relative location of a client device can be triangulated. In further embodiments, other tracking techniques known in the art may be employed (e.g., visual imaging, radar technology, etc.).

<figref idref="f0008"><b>FIG.</b> 8</figref> illustrates a ball charging system <b>800</b> that may be employed to charge the power source in sensor module, according to an embodiment.

According to an embodiment, the ball charging system <b>800</b> may provide power through inductive charging, in which case an inductive coil may be mounted in the sports ball <b>104</b> and coupled to the power source <b>708</b> of sensor module <b>402</b> for charging with a ball charging device <b>802</b>. The sports ball <b>104</b> may have exterior markings <b>804</b> to indicate the location of the inductive coil or to otherwise facilitate optimum orientation of the sports ball <b>104</b> for charging with the ball charging device <b>802</b>.

<figref idref="f0009"><b>FIG. 9</b></figref> illustrates a wireless pitch data transmission grid <b>114</b> mounted under the sports pitch <b>902</b>, which may be used to provide the sports ball <b>104</b> with a wireless data connection and allow the sports ball <b>104</b> to upload data for further processing and broadcasting, according to an embodiment. The wireless pitch data transmission grid <b>114</b> may include different data transmission/reception nodes <b>904</b> positioned at a distance of around 2 meters separating each in both the longitudinal (X) and latitudinal (Y) axes. Each data transmission/reception node <b>904</b> in the wireless pitch data transmission grid <b>114</b> may include transceivers for enabling wireless data transmission.

According to other embodiments, a combination of wireless pitch data transmission grid <b>114</b> and antennas <b>116</b> may also be implemented for providing enhanced connectivity and ensure data upload. The antennas <b>116</b> may be mounted around the sports pitch <b>902</b>.

According to yet other embodiments, antennas <b>116</b> may be employed in place of the wireless pitch data transmission grid <b>114</b>.

The wireless pitch data transmission grid <b>114</b> and antennas <b>116</b> enable different wireless systems communication, preferably mmW-based communication, a combination of mmW-based and sub 6 GHz-based communication, or wireless local area networking (WiFi), preferably, but not limited to, providing data at 16 GHz.

Transmission speed from the sports ball <b>104</b> to the wireless pitch data transmission grid <b>114</b> and/or to the antennas <b>116</b> may be of at least around 5 gigabytes per second.

<figref idref="f0010"><b>FIG. 10</b></figref> illustrates a method for processing and synthesizing video footage <b>1000</b> performed by the data processing server, according to an embodiment. The method for processing and synthesizing video footage <b>1000</b> may start by obtaining raw video data and telemetry metadata from image capturing devices mounted in sports balls and/or on individual players at step <b>1002</b>. The method may continue by determining a real ball direction in world space at step <b>1004</b>, sending directional data to stadium camera system at step <b>1006</b>, obtaining 360° action-focused broadcast data from stadium camera system at step <b>1008,</b> applying camera footage selection/discarding rules at step <b>1010</b>, applying data-broadcast triggering rules at step <b>1012</b>, and processing raw data (e.g., synthesizing/filtering) through other video processing techniques at step <b>1014</b> to reconstruct scenes for presentation to an audience.

The step of processing raw data through other video processing techniques <b>1014</b> may include synthesizing/filtering raw data <b>112</b> coming from image capturing devices <b>110</b> mounted in the sports ball <b>104</b> and on the sports equipment <b>108</b> of individual players <b>106</b>, as well as 360° action-focused broadcast data from the stadium camera system.

<figref idref="f0011"><b>FIG. 11</b></figref> illustrates a method for determining a real ball direction in world space <b>1002</b>, according to an embodiment. Data obtained by the method for determining a real ball direction in world space <b>1002</b> may be combined with a set of camera footage selection/discarding rules, video filtering, and other video processing techniques for ultimately broadcasting footage from the perspective of a sports ball <b>104</b>. "World space" as used herein refers to any physical area outside of the sports ball where the sports ball may travel during an athletic activity.

The method for determining a real ball direction in world space <b>1002</b> may begin by detecting the movement of the sports ball at step <b>1102</b>, which may be performed based on acceleration data captured by IMU <b>702</b> of the sensor module <b>402</b> described in <figref idref="f0007"><b>FIG. 7</b></figref>. In the case of a soccer ball, for example, the detected movement may include the soccer ball rolling on the ground or flying in the air as a result of being kicked by a player.

Subsequently, and in response to the determination of the occurrence of a movement to track, an initial space orientation of the sports ball may be determined at step <b>1104</b>, which may be made by reference to a coordinate axis system. The determination of the initial spatial orientation of the sports ball at step <b>1104</b> may be made with respect to a gravity vector or with respect to an Earth magnetic field vector. In the case of a soccer ball, the determination of the initial spatial orientation of the sports ball relative to the specific movement to be tracked may be defined, for example, as the spatial orientation of the soccer ball just before, at the moment of, or just after the soccer ball is kicked by an individual, depending on the algorithm employed.

Afterwards, a change in the spatial orientation may be determined at step <b>1106</b> in a similar way as the determination of an initial space orientation of the sports ball at step <b>1104</b>, except that additional information about changes in the orientation of the gravity vector or magnetic field may be additionally factored in.

Then, a determination of the sports ball telemetry metadata at step <b>1108</b> may be performed. Telemetry metadata may refer to ball speed, ball spin rate, ball spin axis, and ball launch angle data, all being information captured by the IMU or inferred by the data processing server from data captured by the IMU. Telemetry metadata, in conjunction with high speed video footage taken by image capturing devices from the image capturing device, the initial spatial orientation, and the changes in spatial orientation of the sports ball, may be analyzed by the data processing server to obtain a real ball direction in world space at step <b>1110</b>. Suitable analysis techniques for obtaining a real ball direction in world space include regression analysis, amongst others.

<figref idref="f0012"><b>FIG. 12</b></figref> illustrates a stadium camera system <b>120</b> which may be employed to provide a high density, high quality and uniformly targeted broadcast data to the data processing server, according to an embodiment. The stadium camera system <b>120</b> may include an arrangement with a plurality of action-focused cameras <b>124</b> positioned in the area of the stadium <b>1202</b> around the sports pitch <b>902</b> and configured to record the action taking place in the sports pitch <b>902</b>. Directional data <b>122</b> sent by the data processing server serve as instructions for the stadium camera system <b>120</b> to control the rotation, focus, and zoom of each of the action-focused cameras <b>124</b> in order to capture the action taking place in the sports pitch <b>902</b>. In some embodiments, the action-focused cameras <b>124</b> include one or more LIDAR devices mounted thereon. The LIDAR devices may provide precise distance and depth information of action taking place in the sports pitch <b>902</b>. Data obtained from the LIDAR devices may be included in the 360 degree action-focused broadcast data <b>126</b> that is sent back to the data processing server for further processing.

In <figref idref="f0012"><b>FIG. 12</b></figref>, where a circular stadium <b>1202</b> is employed to illustrate the stadium camera system <b>120</b>, 36 action-focused cameras <b>124</b> are configured to follow the action in the sports pitch <b>902</b>. Each of the 36 action-focused cameras <b>124</b> may be used to cover at least 10 degrees of field of view, adding up to 360 degrees broadcast coverage. However, a greater or lower number of action-focused cameras <b>124</b> may as well be employed, with respective compensations in field of view coverage required. Additionally, other shapes apart from circular shapes may be used for the stadium <b>1202</b>, including oval shapes, rectangular shapes, squared shapes, pentagonal shapes, and the like.

According to an embodiment, the stadium camera system <b>120</b> is configured to capture a spherical focus zone <b>1204</b>, which includes the area within the sports field where the most relevant action of the sports event takes place. Diameter of the spherical focus zone <b>1204</b> may depend on the initial configuration of the stadium camera system <b>120</b>. This configuration may depend on different sports event priorities. In an embodiment, a stadium camera system <b>120</b> configured for a smaller spherical focus zone <b>1204</b> may be based on focusing on an area within about 2 to 10 meters around the sports ball <b>104</b>. In another embodiment, a stadium camera system <b>120</b> configured for a larger spherical focus zone <b>1204</b> may be based on focusing on an area within about 10 and about 50 meters around the sports ball <b>104</b> when taking into account individual players <b>106</b> located relatively close to the action.

According to another embodiment, the spherical focus zone <b>1204</b> may be static or dynamic. For a static spherical focus zone <b>1204</b>, diameter of the spherical focus zone <b>1204</b> may be fixed, meaning that the focus of the stadium camera system <b>120</b> may, independently of the type of action taking place, always be on the action taking place within about 2 to 10 meters around the sports ball <b>104</b>, or within about 10 to 50 meters around the sports ball <b>104</b> when taking into account individual players <b>106</b> located relatively close to the action. On the other hand, for a dynamic spherical focus zone <b>1204</b>, the spherical focus zone <b>1204</b> may increase or decrease in diameter depending on the action taking place. For example, in the case of a soccer match, a goal kick or a free kick may trigger an expansion of the spherical focus zone <b>1204</b>, while a penalty kick may trigger a contraction of the spherical focus zone <b>1204</b>.

According to an embodiment, stadium camera system <b>120</b> may be configured to compensate and modify the rotation, focus, and zoom of each of the action-focused cameras <b>124</b> depending on where the spherical focus zone <b>1204</b> is located with respect to the action-focused cameras <b>124</b>. Compensation and modification of the rotation, focus, and zoom of each of the action-focused cameras <b>124</b> is performed in order to obtain highly uniform 360 degree action-focused broadcast data <b>126</b> to be sent back to the data processing server. In this embodiment, each of the action-focused cameras <b>124</b> may, at any specific moment in time, record the action within the spherical focus zone <b>1204</b> employing different levels of rotation, focus, and zoom. For example, if the spherical focus zone <b>1204</b> is located close to a specific group of action-focused cameras <b>124</b>, the zoom and focus parameters from each of these action-focused cameras <b>124</b> may be lower than the zoom and focus parameters from action-focused cameras <b>124</b> located farther away from the spherical focus zone <b>1204</b>. Likewise, when the spherical focus zone <b>1204</b> moves away from the specific group of action-focused cameras <b>124</b> initially located close to the spherical focus zone <b>1204</b>, then the zoom and focus parameters from each of these action-focused cameras <b>124</b> may be higher than before. Rotation of the action-focused cameras <b>124</b> may as well be dependent on the location of the spherical focus zone <b>1204</b>. In order to perform the compensation and modification of the rotation, zoom, and focus parameters, the distance and position between each of the action-focused cameras <b>124</b> and the spherical focus zone <b>1204</b> is measured by the data processing server and is provided to the stadium camera system <b>120</b> as a set of real-time instructions to achieve the rotation, zoom, and focus compensation. Additionally, the action-focused cameras <b>124</b> may need to be calibrated before or at the beginning of the sports event.

<figref idref="f0013"><b>FIGS. 13A and 13B</b></figref> illustrate a diagram of camera footage selection/discarding within ball space <b>1300</b>, which may be performed by the data processing server based on a set of camera footage selection/discarding rules, according to an embodiment. "Ball space", as used herein, refers to the space on the exterior covering a sports ball <b>104</b> wherein a plurality of image capturing devices <b>110</b> has been mounted. The camera footage selection/discarding within ball space <b>1300</b> may be performed in order to process images sent to the data processing server by each of the image capturing devices <b>110</b> via the wireless pitch data transmission grid <b>114</b>, selecting only footage that may add value to a final footage to be broadcast to an audience. It is important to note that the processing performed by the data processing server is done on footage data that is already sent, or is being sent, by the image capturing devices <b>110</b> on the a sports ball <b>104</b>. Based on one or more triggers, e.g., events on the sports field, the data processing server may determine which segments of footage to take from each of the one or more image capturing devices <b>110</b>. Thus, the sports ball <b>104</b> may continue rotating or moving to different places of the sports field while recording new footage without interrupting the processing performed by the processing server <b>104</b>.

The set of rules upon which the camera footage selection/discarding within ball space <b>1300</b> is based may be more easily applied after a real ball direction has been determined (e.g., by the method for determining a real ball direction in world space <b>1002</b> described with reference to <figref idref="f0011"><b>FIG. 11</b></figref> or any other suitable methods), allowing the data processing server to focus on a given set of camera footage relevant for broadcasting to an audience.

In <figref idref="f0013"><b>FIGS. 13A and 13B</b></figref>, various image capturing devices <b>110</b> record footage while mounted on a sports ball <b>104</b> traveling on a direction <b>1302</b> set from left to right in world space with a clockwise rotation <b>1304</b> and send, in real-time, the footage to the processing server. Then, as shown in <figref idref="f0013"><b>FIG. 13A</b></figref>, once sufficient camera footage to reconstruct a specific scene determined by the data processing server has been transferred to the data processing server, a camera footage selection rule may instruct the data processing server to select footage from Camera 1 when complying with that camera footage selection rule, whereas footage from Camera 2 may be discarded for including images compliant with a camera footage discarding rule. Then, as shown in <figref idref="f0013"><b>FIG. 13B</b></figref>, after the image that Camera 1 was capturing is not compliant with the camera footage selection rule, and thus complies with a camera footage discarding rule, footage from Camera 1 may be discarded and footage from Camera 2 may then be added to the processed footage compilation.

According to an embodiment, footage may be selected from one image capturing device <b>110</b> within the ball space for a given set of video frames.

According to yet another embodiment, different footage recorded simultaneously by more than one image capturing device <b>110</b> from different locations and angles within the ball space may be selected for a given set of video frames. Recording footage from more than one image capturing device <b>110</b> for a given set of frames may provide a video control operator

(not shown) with a greater number of sets of possible processed footage to select and broadcast to an audience.

<figref idref="f0014"><b>FIG. 14</b></figref> illustrates a sample set of camera footage selection/discarding rules <b>1400</b> which may be performed by the data processing server, according to an embodiment. In <figref idref="f0014"><b>FIG. 14</b></figref>, camera footage selection/discarding rules <b>1400</b> is illustrated by using a soccer ball as an example. However, it may be understood that the camera footage selection/discarding rules may differ depending on the sports or activity taking place within a stadium. Accordingly, a set of camera footage selection rules <b>1402</b> may include selecting camera footage from image capturing devices when the soccer ball is in: <ul id="ul0002" list-style="bullet"><li>proximity to a goal <b>1404</b>, whenever the soccer ball is located relatively close to the goal;</li><li>proximity to an audience <b>1406</b>, whenever the soccer ball has deviated from its course and gone out of the soccer pitch towards the audience <b>1406</b>; and,</li><li>proximity to one or more players <b>1408</b>, whenever the trajectory of the soccer ball is directed towards the one or more players.</li></ul>

As may be noted, camera footage selection rules <b>1402</b> may ensure that only footage from image capturing devices recording relevant images is taken into consideration for final video broadcasting.

The processed data obtained after analysis and processing of raw data may be used for reconstructing specific scenes (e.g., for providing a replay of a penalty shootout, a sequence related to a referee's ruling, etc.) that can then be broadcast on a display or other viewing means for enjoyment of an audience.

Likewise, a set of camera footage discarding rules <b>1410</b> may also be considered. The set of camera footage discarding rules <b>1410</b> may include discarding camera footage from image capturing devices that are directed towards: <ul id="ul0003" list-style="bullet"><li>the sky/rooftop <b>1412</b>;</li><li>the ground surface in direct contact with the sports ball <b>1414</b>; and,</li><li>an obstruction <b>1416</b> such as an advertising board in close proximity to the soccer ball.</li></ul>

As may be appreciated, camera footage discarding rules <b>1410</b> work based on eliminating images that may not provide any value to an audience.

<figref idref="f0015"><b>FIG. 15</b></figref> illustrates a sample set of data-broadcast triggering rules <b>1500</b> that may trigger data broadcasting by the data processing server in the form of a replay. In the current disclosure, a replay refers to a reconstructed scene based on raw footage obtained from image recording devices mounted in a sports ball, sports equipment on players, or stadium cameras, to be broadcast to an audience. Thus, the data-broadcast triggering rules <b>1500</b> trigger the data processing server to select and process specific parts of the received footage in order to reconstruct the scene in the form of a replay. In <figref idref="f0015"><b>FIG. 15</b></figref>, different scenarios are depicted that may serve as data-broadcast triggering rules <b>1500</b> in the sample case of a soccer match. However, other data-broadcast triggering rules <b>1500</b> may be used to trigger data broadcasting when using the broadcasting system in other types of sports or entertainment events taking place in a stadium. It is to be noted that only one of the scenarios depicted in <figref idref="f0015"><b>FIG. 15</b></figref> may occur at a single moment in time. Whenever an event triggers data-broadcast triggering rule <b>1500</b>, the data processing server <b>118</b> receives a signal from the sports ball or sports equipment through the wireless pitch data transmission grid with instructions to process and broadcast data-broadcast triggering event.

Examples of data-broadcast triggering rules <b>1500</b>, as shown in <figref idref="f0015"><b>FIG. 15</b></figref>, include: <ul id="ul0004" list-style="bullet"><li>offside <b>1502</b>, which occurs when an individual player <b>106</b> is in the opposing team's half of the sports pitch <b>902</b> and is also nearer to the opponent goal line <b>1504</b> than both the soccer ball and the closest opponent. For an offside data-broadcast triggering rule <b>1500</b> to trigger data broadcasting, geo-location data, emitted by the sensor module of the sports equipment worn by the individual player in offside <b>1502</b> position, is gathered and checked against the geo-location data from other individual players within the sports pitch <b>902</b>;</li><li>goal <b>1506</b>, which occurs when the soccer ball has passed completely over the goal line <b>1504</b> between the goal posts <b>1508</b>. For a goal data-broadcast triggering rule <b>1500</b> to trigger data broadcasting, geo-location data, emitted by the sensor module of the soccer ball, is gathered and checked against the position of the goal line <b>1504</b> between the goal posts <b>1508</b>;</li></ul><ul id="ul0005" list-style="bullet"><li>out of bounds <b>1510</b>, which occurs when the soccer ball has passed completely over the lateral boundaries <b>1512</b> of the sports pitch <b>902</b>. For an out of bounds data-broadcast triggering rule <b>1500</b> to trigger data broadcasting, geo-location data, emitted by the sensor module of the soccer ball, is gathered and checked against the position of the lateral boundaries <b>1512</b> of the sports pitch <b>902</b>; and,</li><li>corner kick <b>1514</b>, which occurs when the soccer ball has crossed the goal line <b>1504</b> without a goal <b>1506</b> having been scored, and having been last touched by a defending player. For a corner kick <b>1514</b> to trigger data broadcasting, geo-location data, emitted by the sensor module of the soccer ball, is gathered and checked against the position of the goal line <b>1504</b> taking into account whether the last player to have had contact with the ball was a defending or attacking individual player <b>106</b>.</li></ul>

As may be appreciated, in general, data-broadcast triggering rules <b>1500</b> are based on and connected to events that are specific to the rules of the sports event being watched.

<figref idref="f0016"><b>FIG. 16</b></figref> illustrates a diagram of video footage synthesizing/filtering <b>1600</b>, according to an embodiment. In <figref idref="f0016"><b>FIG. 16</b></figref>, raw video footage <b>1602</b> received from the plurality of image capturing devices <b>110</b> mounted in the sports ball and/or from the image capturing devices on the sports equipment, is received at a high frame rate of at least 100 FPS. This raw video footage <b>1602</b>, after being synthesized/filtered by implementation of camera footage selection/discarding rules (e.g., camera footage selection/discarding rules <b>1400</b> of <figref idref="f0014"><b>FIG. 14</b></figref>), data broadcasting rules, video noise filtering methods, and other suitable video processing techniques, produces a processed data <b>128</b> at a low frame rate of at least 24 FPS.

According to various embodiments, produced processed data <b>128</b> may be selected from the perspective of the sports ball, from the perspective of individual players, from a 360 degree action-focused view obtained from the stadium camera system, or from combinations thereof. For example a broadcast replay of a penalty shootout may include a few seconds of footage from the perspective of a soccer ball, a few seconds from the perspective of the individual player kicking the penalty, a few seconds from the perspective of the goalkeeper in an attempt to save the soccer ball, and a few seconds from the perspective obtained by the stadium camera system.

<figref idref="f0017"><b>FIG. 17</b></figref> illustrates AR/VR/MR broadcasting system <b>1700</b> for providing various experiences to a user, such as a member of an audience, according to an embodiment.

In the embodiment of a AR/VR/MR broadcasting system <b>1700</b>, an action perspective data capturing module <b>1702</b> includes a sports ball <b>1704</b> and one or more individual players <b>1706</b> with image capturing devices <b>1708</b> mounted upon their sports equipment <b>1710</b> and configured to capture and transmit raw data <b>1712</b>, such as raw video footage and telemetry metadata, for subsequent analysis and processing. The raw data <b>1712</b> is transmitted to a processing/rendering server <b>1714</b> after being uploaded to the wireless pitch data transmission grid <b>1716</b> and/or antennas <b>1718</b>. At this stage, the processing/rendering server <b>1714</b> analyzes and processes the raw data <b>1712</b> received and generates directional data <b>1720</b> that is then sent to the stadium camera system <b>1722</b> comprising a plurality of action-focused cameras that, based on directional data sent by the data processing server, auto-compensate and regulate rotation, focus, and zoom of cameras in order to generate uniform action coverage covering 360 degrees field of view around a spherical focus zone determined by the location of the sports ball, individual players, or combinations thereof to create 360 degree action-focused broadcast data <b>1724</b> that is sent back to the processing/rendering server <b>1714</b>.

Then, the processing/rendering server <b>1714</b>, applying data-broadcast triggering rules, noise filtering methods, and other video processing and rendering techniques, processes the raw data <b>1712</b> and 360 degree action-focused broadcast data <b>1724</b> into processed data <b>1726</b> to create context-full scenarios. These context-full scenarios may be used for generating AR/VR/MR experiences <b>1728</b> for enjoyment of users <b>1730</b> such as members of an audience through suitable user devices, such as AR/VR/MR headsets <b>1732</b>.

According to an embodiment, in the case of AR/VR/MR experiences <b>1728</b> with individual players <b>1706</b>, the AR/VR/MR broadcasting system <b>1700</b> may be employed not only to train athletic skills of said individual players <b>1706</b> but also to provide psychological conditioning, such as mentally preparing one or more individual players <b>1706</b> for a penalty shootout. Through the AR/VR/MR broadcasting system <b>1700</b>, the processing/rendering server <b>1714</b> may recreate scenarios from previous matches, serving as a personalized training program that may be used in a virtual reality/augmented reality training center.

According to another embodiment, in the case of AR/VR/MR experiences <b>1728</b> provided to members of an audience, the AR/VR/MR broadcasting system <b>1700</b> may allow members of an audience to view and experience the broadcast of a replay from the perspective of one or more individual players <b>1706</b> and/or from the perspective of a sports ball <b>1704</b>.

According to another embodiment, the processing/rendering server <b>1714</b> is able to create augmented reality volumes that users <b>1730</b>, such as members of an audience, may interact with to enjoy further AR/VR/MR experiences <b>1728</b>. These interactive augmented reality volumes may be created by distance interpolation methods applied on the sports equipment <b>1710</b> to calculate the height and shape of an individual player <b>1706</b>. In this embodiment, a content database <b>1736</b> includes information from all of the individual players <b>1706</b> as well as from the sports pitch <b>1734</b>. Forms of AR interactions with individual players <b>1706</b> may include viewing player statistics, highlights, biography, and the like. Forms of AR interactions with the sports pitch <b>1734</b> may include viewing further details about the sports pitch <b>1734</b> and stadium, including history, dimensions and capacity, statistics, highlights, and the like. Forms of AR interactions with the sports ball <b>104</b> may include current sports ball <b>104</b> locomotion data such as ball speed, ball spin rate, ball spin axis, and ball launch angle data, amongst others. In further embodiments, initial AR interactions may as well include options that lead to VR/MR interactions, such as being able to view, through AR/VR/MR headsets <b>1732</b>, the sports event from the perspective of one or more individual players <b>1706</b> by utilizing data captured by the image capturing devices <b>1708</b> on the one or more individual players <b>1706</b>.

According to another embodiment, compensation and modification of the rotation, focus, and zoom of each action-focused camera <b>1738</b> within the stadium camera system <b>1722</b> generates 360 degree action-focused broadcast data <b>1724</b> that the processing/rendering server <b>1714</b> processes and renders in order to create 360 degree AR/VR/MR experiences <b>1728</b> around the action taking place in the sports pitch <b>1734</b> that may be viewed by users <b>1730</b> through AR/VR/MR headsets <b>1732</b>. Yet further in this embodiment, the 360 degree AR/VR/MR experiences <b>1728</b> may also be shared with one or more remote sports stadiums through a cloud server in order to simulate the action of the sports event taking place in the original stadium into the one or more remote stadiums. For AR/VR/MR experiences <b>1728</b> to be shared between stadiums, the sports pitch <b>1734</b> of the one or more target remote stadiums may be mapped against the sports pitch <b>1734</b> of the original stadium and overlay against the processed data <b>1726</b>, providing users <b>1730</b> with a sensation that may be similar to being present at the original stadium.

A system and method for providing augmented reality through a simulation engine is disclosed in the United States Pre-Grant Publication No.<patcit id="pcit0005" dnum="US20130218542A"><text> 2013/0218542 filed on November 29, 2012</text></patcit> by the same inventor of the current disclosure, and is herein incorporated by reference. Moreover, United States Pre-Grant Publication No. <patcit id="pcit0006" dnum="US20130215229A"><text>2013/0215229 and filed on August 22, 2013</text></patcit> by the same inventor of the current disclosure discloses a system and method for creating a virtual reality environment based on the recording of a real scene, and is herein also incorporated by reference.

The subject matter of this application is also related to the subject matter of U.S. Pre-Grant Patent Publication No. <patcit id="pcit0007" dnum="US20150328516A1"><text>2015/0328516 A1</text></patcit> entitled "Sports Ball Athletic Activity Monitoring Methods and Systems," filed on May 14, 2014. That application, including Appendices, is herein incorporated by reference.

While certain embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that the invention is not limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those of ordinary skill in the art. The description is thus to be regarded as illustrative instead of limiting.