Systems and methods using mobile devices for augmented reality
Abstract
Provided is a system, method, device, means and computer program code for operating a mobile device, which includes: program instructions for detecting the capture of an image; An instruction for detecting the associated location and time; an instruction for sending a request for information associated with the image to the processing system, the request including information identifying the location and the time; and an instruction for receiving An instruction from the processing system's response, the response including information associated with the image.

Term
5.1 yearsto projected expiry
Projected expiry 24 October 2031, counted from filing; an application has no term until it is granted.
- Priority
- Filed
- Published
- Today
- Projected expiry
16 claims: 2 independent, 14 dependent
- 1一种便携式无线通信设备,包括: 通信端口 ; 处理器; 存储器;以及 程序,其中,所述程序存储在所述存储器中并配置成由所述处理器来执行,所述程序包 括: 用于对图像的捕获进行检测的指令; 用于对与所述图像的所述捕获相关联的位置和时间进行检测的指令; 用于向处理系统发送对与所述图像相关联的信息的请求的指令,所述请求包括用于识 别所述位置和所述时间的信息;以及 用于接收来自所述处理系统的响应的指令,所述响应包括与所述图像相关联的信息。
- 2根据权利要求1所述的便携式无线通信设备,其中,与所述图像相关联的所述信息 包括以下中的至少一个:(i)图像覆盖,(ii)统计信息,(iii)位置信息和(iv)位置数据。
- 3根据权利要求2所述的便携式无线通信设备,其中,所述图像覆盖包括以下中的至 少一个:(i)首攻线,(ii)争球线和(iii)比赛场标志。
- 4根据权利要求1所述的便携式无线通信设备,其中,来自所述处理系统的所述响应 包括用于识别与所述图像相关联的事件、个体和位置中的至少一个的信息。
- 5根据权利要求1所述的便携式无线通信设备,其中,来自所述处理系统的所述响应 包括对显示在所述图像上的图形覆盖进行定义的数据,所述数据包括所述图形覆盖和所述 图形覆盖的位置。
- 6根据权利要求5所述的便携式无线通信设备,还包括: 用于在所述位置中显示所述图形覆盖的指令。
- 7根据权利要求1所述的便携式无线通信设备,其中,所述响应包括用于识别与所述 图像相关联的事件的数据,所述设备还包括: 用于请求与所述事件相关联的更新信息的指令。 根据权利要求7所述的便携式无线通信设备,其中,自动执行用于请求与所述事件 相关联的更新信息的所述指令,直到以下情况中至少一个:完成所述事件、或检测到来自所 述用户的输入。
- 89. 根据权利要求1所述的便携式无线通信设备,其中,所述响应包括用于识别与所述 图像相关联的事件的数据,所述设备还包括: 用于基于所述事件显示所述用户可得到的一组信息选项的指令。
- 910. 根据权利要求9所述的便携式无线通信设备,其中,所述用户可得到的所述信息选 项包括:(i)事件统计数据,(ii)事件视频数据,(iii)与所述事件的位置相关联的位置数 据和(iv)相关的事件数据。
- 1011. 根据权利要求1所述的便携式无线通信设备,其中,所述响应包括用于识别事件的 数据,其中所述事件为体育事件。
- 1112. 一种事件数据系统,包括: 数据存储设备,所述数据存储设备用于存储对多个位置和与所述多个位置中的每个位 置相关联的多个事件进行定义的数据; 计算机处理器,所述计算机处理器用于执行程序指令并用于从所述数据存储设备中检 索对多个位置和多个事件进行定义的所述数据; 存储器,所述存储器耦连到所述计算机处理器,所述存储器用于存储程序指令,所述程 序指令由所述计算机处理器执行从而 从与所述位置中的一个位置和所述事件中的一个事件处的用户相关联的移动设备接 收传感器数据,所述传感器数据从所述移动设备中的至少第一传感器收集并且与所述移动 设备捕获的图像相关联; 至少部分地基于所述传感器数据来确定所述位置中的一个位置; 至少部分地基于所述传感器数据来确定所述事件中的一个事件;以及 向所述移动设备发送与所述图像相关联的信息。
- 1213. 根据权利要求12所述的事件数据系统,其中,所述传感器数据包括位置数据。
- 1314. 根据权利要求13所述的事件数据系统,其中,用于由所述计算机处理器执行以对 所述位置中的一个位置和所述事件中的一个事件进行确定的所述程序指令包括基于所述 位置数据来对所述位置中的一个位置进行识别的程序指令。
- 1415. 根据权利要求14所述的事件数据系统,其中,用于由所述计算机处理器执行以对 所述事件进行确定的所述程序指令包括基于所述位置中的所述被识别出的一个位置和从 所述移动设备接收的时间戳数据来对所述事件中的一个事件进行确定的程序指令。
- 1516. 根据权利要求12所述的事件数据系统,其中,与所述图像相关联的所述信息包括 用于识别由所述移动设备显示的图像覆盖的数据。
- 1617. 根据权利要求12所述的事件数据系统,其中,与所述图像相关联的所述信息包括 用于识别与所述事件相关联的统计信息的数据。 1 根据权利要求12所述的事件数据系统,其中,与所述图像相关联的所述信息包括 用于识别与在所述图像被所述移动设备捕获的时间点处的所述事件相关联的统计信息的 数据。
Independent claims16
63 paragraphs, as filed
System and method for enhancing authenticity using mobile equipment Technical field
[0001] The embodiment relates to a mobile device. More specifically, embodiments relate to the use of mobile devices to enhance the view of the location with additional information.
Background technique
[0002] Viewers of events (such as sports events) are interested in understanding statistics and information associated with the event. When watching sports events on TV, statistics, scores, and other information are presented to viewers as overlays on the video stream of the game. Other graphics techniques are also used to enhance the information presented to the audience, including the first attack yard line in a football game and so on. Expect to provide similar content, statistics and information to the audience of live events.
Description of the drawings
[0003] FIG. 1 shows a system structure in which some embodiments can be implemented;
[0004] FIG. 2 shows an example usage of a mobile system according to some embodiments;
[0005] FIG. 3 is a block diagram showing a user interface according to some embodiments;
[0006] FIG. 4 is a flowchart depicting processing in accordance with some embodiments; and
[0007] FIG. 5 is a block diagram of a mobile device according to some embodiments.
Detailed ways
[0008] Embodiments of the present invention relate to a system and method for using a mobile device to provide additional or enhanced information related to an event or location.
[0009] In some embodiments, mobile devices, such as smart phones, tablet computers, or other portable communication and computing devices, are provided with software that allows users to use the mobile device to obtain additional or enhanced information related to events or locations (here Referred to as "applications" or "mobile applications"). Some embodiments allow users to obtain news, scores, graphics, and other information associated with the event or location by capturing images of the event or location using an image capture device. This additional or enhanced information can then be provided to the user as a graphic overlay or text overlay on the display of the mobile device. In some embodiments, users can enjoy enhanced information on the display device of their mobile device, such as scores, statistics, specific local features, and other information.
[0010] In order to illustrate the features of some embodiments, exemplary (not limiting) examples will be provided and referenced throughout this disclosure. In an illustrative example, a user of a mobile device configured to work in accordance with the present invention is attending a professional football game. During the game, users sometimes want to get game updates or statistics that may not be easily available in the stadium. For example, the user may want to see the image of the first attack mark (this image is similar to the one shown in some TV rugby matches).<sup>st</sup> and ten graphics are similar) or find the statistics of the athletes. The user may also wish to find the location of the favorite food stall in the stadium or the nearest lounge. The user may also wish to locate friends who are also attending the game and are also operating the mobile device configured in accordance with the present invention. As will be described further below, embodiments of the present invention allow some or all of these situations to occur. Upon reading this disclosure, those skilled in the art will recognize that similar technologies can be used in conjunction with other events or locations to provide users with additional data and information related to the event or location
Access.
[0011] The features of some embodiments will now be described by referring to FIG. 1, which is a block diagram of a mobile information system 100 according to some embodiments. As shown in FIG. 1, the system 100 includes a mobile device 102 that communicates with a content engine 140 via a network 110. The mobile device 102 may be a device operated by an individual who has registered or is authorized to receive information from the content engine 140. Although only a single mobile device 102 is shown in FIG. 1, multiple mobile devices 102 may interact with and receive information from one or more content engines 140 via one or more networks 110. Access information. Furthermore, according to some embodiments, individual mobile devices 102 may interact with each other (directly or through the content engine 140) to allow users to locate each other and interact with each other. As described further herein, some or all of the functions that allow the mobile device 102 to interact with the content engine 140 may be provided by using a mobile application installed on the mobile device 102. The following shows examples of different types of data associated with locations or events that can be provided to the mobile device 102 in conjunction with FIGS. 2-3. However, other implementations and examples will be apparent to those skilled in the art when reading this disclosure. of.
[0012] The mobile device 102 may be, for example, a mobile phone, a personal digital assistant (PDA), a personal computer, or the like. For example, the mobile device 102 may be an iPhone® from Apple, a BlackBerry® from RIM, a mobile phone using the Google Android® operating system, a portable or tablet computer (such as an iPad® from Apple), and so on. According to some embodiments, the mobile device 102 may be operated to send information related to the location or event to the remote content engine 140 and receive information related to the location or event from the content engine 140. For example, the data sent from the mobile device 102 may include geolocation data and image data, which are used by the content engine 140 to identify and send information that can be beneficial to enhance the user's view of the location or event. In the illustrative example introduced above, the mobile device 102 may be operated by a user attending a football game. The information sent to the content engine 140 may include a geocoded location of the mobile device 102 that indicates that the user is at a specific rugby stadium at a specific moment. [0013] The mobile device 102 may also send one or more images (such as an image of a playing field, an image of a part of the playing field, an image of an athlete, or a feature in a stadium) that is captured by the user and associated with the user's viewing of a football game. Image of seat reservation). The content engine 140 may use the aforementioned one or more images to retrieve and return additional information that may be of interest to the user (for example, statistics, scores, etc., as described further below). In this way, a user operating the mobile device 102 can receive target information and related information associated with a live event or location, thereby enhancing the user's experience of the event or location.
[0014] According to some embodiments, the mobile device 102 can capture and send geographic location data and image data. In some embodiments, the image captured by the mobile device 102 may be marked or appended with a time/date stamp and metadata identifying the location. In some embodiments, the mobile device 102 attaches or sends information identifying the user. The information sent from the mobile device 102 is sent to one or more remote devices or systems (such as the content engine 140) through the network 110. In some embodiments, the mobile device 102 may perform some image recognition processing to facilitate content recognition by the content engine 140. For example, in the illustrative example, the user may point the camera of the mobile device 102 at the football field during a football game. The image recognition software in the mobile device 140 can operate on the image to recognize code signs and cross-border signs on the playing field, and can mark these signs on the image. The content engine 140 can then provide metadata that allows graphic overlays (such as first and ten images or red zone images) to be overlaid on the display screen of the mobile device 102.
[0015] FIG. 1 shows several communication paths between the mobile device 102 and the content engine 140 (and other devices and data sources). The mobile device 102 may communicate via one or more wired networks and/or wireless networks 110, for example.
As an example, the wireless network may be a cellular network (represented by the cellular transmitter 112). The mobile device 102 may communicate through a cellular network or other wireless network, and may then communicate with the network 114 through the gateway 116 (eg, the Internet or other public or private networks). An access point, such as an access point 118, may be provided to facilitate data or other communication access to the network 114. The access point 118 may, for example, comply with 802.11g (or other) communication standards.
[0016] In some embodiments, the mobile device 102 may perform both voice communication and data communication over the wireless network 110 via the access point 118. For example, the mobile device 102 may be able to make or receive phone calls, send and receive emails, send and receive short message service ("SMS") messages, send and receive email messages, access electronic documents, and send and receive streaming messages over a wireless network via the access point 118. The media and so on. Similar communication can be performed via the network 112. Multiple mobile devices 102 may communicate with each other directly via a cellular network or through a network 114 based on interaction with the content engine 140 or other services.
[0017] In some embodiments, the mobile device 102 may also establish communication through other means, such as a wired connection to a network, peer-to-peer communication with other devices (such as using Bluetooth to connect to the Internet, etc.).
[0018] The mobile device 102 may communicate with one or more services, such as a location service provider 120, a web service provider 130, and a content engine 140, for example, through the network 110. For example, the mobile device 102 may communicate with one or more location services 120 to obtain a geocode associated with the location of the mobile device 102 and/or the location of an event or activity associated with an image captured by the mobile device 102 Location data. The location service 120 may also retrieve or identify additional information associated with the location (such as map or location information associated with data or images from the mobile device 102). Continuing the exemplary example introduced above, as a specific example, the location service 120 may provide stadium information or playing field information associated with a rugby game attended by the user. In some embodiments, the content engine 140 may use geocoded location data received from the mobile device 102 to identify or retrieve information from the positioning module 142 to provide the user with enhanced location data. The content engine 140 may also use the geocoded location data and time stamp information received from the mobile device to identify or retrieve event information from the event module 144 to provide users with enhanced event information or statistical information. In addition, the content engine 140 may send targeted advertisements to the mobile device 102 based on information received from the mobile device 102 and/or information retrieved using the positioning module 142 or the event module 144.
[0019] For example, continuing the exemplary example introduced above, a rugby fan attending a rugby game can point the camera of his mobile phone at the playing field during the game. The mobile phone will send the image and time stamp and geographic location data to the content engine 140, and the content engine 140 will then use this information to retrieve information about the specific game and the progress of the game that occurred when the image was captured by the mobile device. The content engine 140 may proceed by first determining the location of the image (and by querying the data stored at the positioning module 142 or the data accessible by the positioning module 142). The content engine 140 may determine that the image was obtained in a specific rugby stadium based on the geocoding information. Based on the timestamp and/or information from the captured image, the content engine 140 may (eg, by querying statistics from the event module 144 in real time) to determine the specific progress or status of the game at the time the image was obtained. The content engine can then return a play-by-play recap of the game at the moment the image was captured. In this way, rugby fans who watch the game in person on the spot can replay aspects of the game or watch specific information related to the game that the rugby fan may miss when watching the game on the spot. In some embodiments, the content engine 140 may return image, text, video, or audio information to the mobile device 102 for presentation or display to the user.
[0020] The mobile device 102 may also access other data through one or more wired and/or wireless networks 110. For example, through the mobile device 102, content providers such as news sites, RSS feeds, Web sites, blogs, social networking sites, and developer networks can be accessed. Such access can be raised by invoking a Web browsing function or application (such as a browser) in response to the user launching a Web browser application installed on the mobile device 102.
for.
[0021] The mobile device 102 can work as a phone, an email device, a network communication device, a media player device, etc., under the control of one or more application programs installed on the mobile device 102. In some embodiments, the user operating the mobile device 102 may use the touch screen keypad on the display 104 of the device 102 to interact with the application. You can also use the tactile keypad. Information and graphics are presented to the user on the display screen 104. Examples of screens and examples of information that can be presented to the user will be shown and discussed below in conjunction with FIGS. 2 and 3 (although those skilled in the art will recognize that the example screens are illustrative and not restrictive when reading this disclosure. , And can use a variety of different display and presentation of data or information).
[0022] In some embodiments, the content engine 140 and other services may be operated or maintained by broadcasters or information service providers. In some embodiments, these entities may also distribute or provide mobile applications installed on the mobile device 102 to allow interaction and functionality as described herein. According to some embodiments, the mobile application program may be stored in or accessible by the memory of the mobile device 102, and the memory of the mobile device 102 allows the user of the mobile device to obtain additional data or information provided by the present invention.
[0023] Those skilled in the art will recognize when reading this disclosure that embodiments of the present invention can be used in conjunction with many different types of events or locations. For example, embodiments of the present invention allow a user to operate a mobile device to obtain enhanced or additional information related to different events (such as football, baseball, soccer, golf, race, or other events on the spot) and location.
[0024] According to some embodiments, the user of the mobile device 102 may launch a mobile application stored on the device 102 to obtain additional information related to the event or location. The mobile application can prompt the user to select the type of information requested (such as selecting game or event information, location information, etc.), or the mobile application can only return a set of standard information (such as scores or statistics, etc.).
[0025] The features of the mobile device 102 will be further described below in conjunction with FIG. 5. Preferably, in some embodiments, the mobile device 102 can communicate with a remote system (such as the content engine 140) via wireless communication technology, and can also receive and capture information associated with events or locations where additional information is desired. In some embodiments, a camera or other image capture device may be used to capture information, while in some embodiments, a sensor (such as a radio frequency identification (RFID) sensor) may be used. In some embodiments, the information used to identify the event or location requesting additional information may include data entered by the user of the mobile device 102 (such as a request for specific statistics related to a game, athlete, or location, etc.) . According to some embodiments, the information identifying the activity may be automatically captured by one or more sensors or components of the mobile device 102, and may be sent to the content engine 140 for identifying additional information associated with the event or location.
[0026] Referring now to FIG. 2, FIG. 2 is a block diagram depicting a mobile device 202 in communication with a remote content engine 240 (eg, through a network such as the network of FIG. 1, but the network is not shown in FIG. 2). In the block diagram of Figure 2, a user (not shown) is attending a rugby game in a rugby stadium. The user interacting with the mobile device 202 uses an image capture device (such as a camera or a video recorder) of the mobile device 202 to capture an image of a portion of the playing field 210. According to some embodiments, a mobile application installed on the mobile device 202 runs to automatically (or, in some embodiments, based on user input or control) capture images and manipulate the images to identify and occur at the location. Information associated with the event. For example, according to some embodiments, the content engine 240 uses geocoding data associated with the location of the mobile device 202 at the time of image capture to identify the playing field as a particular playing field (in the example, the playing field is the Minnesota Vikings (Minnesota Vikings)). Vikings)'s home stadium). Use other information to identify the current event that occurred at the location.
For example, the content engine 240 may use the location data and the time stamp received from the mobile device 202 to determine that the current game in the stadium is a game between Vikings and Saints. In addition, the score up to the time stamp is 14-0. In some embodiments, once the initial image capture is performed at the location, a dialogue can be established between the mobile device 202 and the content engine 240 to ensure that the mobile device 202 Promote continuous reporting of ongoing events. For example, in some embodiments, the initial image capture is used to trigger or initiate a conversation, so that you can get the ongoing information without searching or interacting with the buttons or menus of the mobile device 202. Information about the event.
[0027] According to some embodiments, additional information, graphics, and details can be obtained. As shown, the portion of the playing field 210 captured by the image capturing device is a portion of the playing field close to one of the goal areas. The image is displayed on the display device 206 together with additional information overlaid on the image of the playing field. The additional information includes information related to the current playing field position, line of face-off, and first attack mark. In some embodiments, the mobile application installed and running on the mobile device 202 is configured to perform certain image recognition functions, such as determining the characteristics of events and locations. In the example of a rugby field, the application can be configured to detect line marks, first strike marks, goal zones, and so on. When a part of the image of the playing field is captured by the mobile device 202, the application can perform image processing to identify these items. In some embodiments, the content engine 240 may assist (or perform completely) identification. Once the items or characteristics of the playing field or image are identified, the data associated with these items can be displayed as overlays or graphics to enhance the information presented to the user. For example, in the image of FIG. 2, the line of the faceoff identifier or the figure may be overlaid or presented on the display device 206. Similarly, first attack signs or lines, score information or other statistical data, etc. may be overlaid or presented on the display device 206.
[0028] In this way, users of mobile devices can enjoy accurate and relevant information related to events or locations to enhance their experience. In some embodiments, for users in an event or location, other options and data may be available. As shown in Figure 2, multiple icons or buttons 203a-n can be provided to allow the user to select other types of information. As shown in the figure, the user can select from detailed game statistics 204a, statistics 204b from various leagues, and stadium information 204n. Those skilled in the art will recognize that these are merely illustrative examples, and other options or choices may be provided.
[0029] Each of the options 204a-n can cause location, time, and other information to be sent to the content engine 240 so that this information can be used to obtain additional or enhanced data. For example, if the user selects the option of obtaining stadium information 204n, the map or seat map of the stadium or game venue where the user is currently located may be retrieved from the content engine 240. An illustrative display is shown in FIG. 3, where the mobile device 302 is shown showing a seating map 306 of the stadium where the user is currently located. According to some embodiments, the seat map 306 may be positioned to show where the user is sitting (this may be based approximately on geocoding information, or based on the actual seat number entered by the user or scanned using the camera of the mobile device 302). The user may be prompted to select from one or more options to display additional information, such as coverage of the place where the canteen is located or the place where the nearest lounge is located, and so on.
[0030] Those skilled in the art will recognize that the example user interfaces in FIGS. 2 and 3 are for illustrative purposes only. The features of the present invention may be expected to be used in other types of locations or events. For example, the embodiment may be used in other sports games, such as football, golf, basketball, etc., to use image technology to identify the characteristics of the event. In an embodiment used in a golf tournament, for example, a user can capture an image of a specific hole area on the playing field, and the content engine 240 may identify the playing field and the hole area and return including prominent features such as pin positions , The distance between the ball and the ball bar, the cross-section or elevation view of the ball area, etc.) interactive or detailed view of the ball area. The result is a system and method that allows mobile device users to enjoy information that the user would not get during a live event or at a location.
[0031] According to some embodiments, the mobile device 202 storage can be loaded to the mobile from media, broadcast, or other entities (such as the entity that operates the content engine 240) or from an application repository (such as Apples App Store, etc.) Mobile application on device 202. The application program allows the user to capture images associated with the event or location when it is launched, and allows the user to make these images processed by the application program or by the content engine 240 to identify the characteristics of the image and obtain additional information related to the event or location.
[0032] As discussed above in connection with FIG. 1, the content engine 140 may include multiple modules that process data and access and utilize additional data. As used herein, "modules" can be implemented in software for execution by different types of processors. The identified module of executable code may, for example, include one or more physical blocks or logical blocks of computer instructions that may be organized as objects, procedures, or functions. However, the executable file (excecutable) of the identified module does not need to be physically located together but may include different instructions stored in different locations (disparate instructions), which when logically combined together constitute the module And achieve the stated purpose for the module.
[0033] As used herein, a module of executable code may be a single instruction or many instructions, and may even be distributed on several different code segments, in different programs, and on several memory devices. Similarly, the operating data can be identified and explained in the module, and the operating data can be implemented in any suitable form and organized in any suitable type of data structure. Operational data can be aggregated into a single data group, or can be distributed in different locations including on different storage devices, and can exist at least in part only as electronic signals on a system or network. In addition, all the modules or part of the modules can also be implemented in the form of programmable hardware devices, such as field programmable gate arrays, programmable array logic, programmable logic devices, etc., or implemented as hard-wired integrated circuits.
[0034] Reference is now made to FIG. 4, which is a flowchart depicting a process 400 for operating a mobile application in accordance with some embodiments. A mobile device such as the mobile device 102 in FIG. 1 (or the mobile device 500 described in further detail below in conjunction with FIG. 5) may be used to perform some or all of the steps of the process 400.
[0035] In the process 400, the user of the mobile device 102 is in a live event, activity, or location and wishes to obtain additional information related to the event, location, or activity. Before the processing of the steps of FIG. 4, it is assumed that the user operating the mobile device 102 installs and (if necessary) configures the mobile application according to the present invention. The mobile application can be installed from a mobile device (for example, by interacting with an application download system) or from a personal computer that communicates with the mobile device. You can download applications from the application market (such as the iTunes (S) store (iTunes ® Store) or the Android® store (Android® Store)). Furthermore, in some embodiments, before the processing in 402, it is assumed that the user has performed arbitrary configuration or personalization of the mobile application. For example, the user may input information related to themselves or their preferences and so on. The user can also input information related to team or sports (or other activity) preferences, so that the content engine 140 can provide information related to the user's interests.
[0036] As shown, the processing in FIG. 4 starts at 402. In 402, a user operating the mobile device 102 (such as the user who captured an image of a football stadium described above) performs an image of an event, location, or activity. Capture to trigger a request for additional data or information. In some embodiments, while the mobile application is running, any image captured by the mobile device can trigger a request for additional data or information.
[0037] The image data captured in 402 is appended with additional data in 404, the additional data including geographic location data and a time stamp. In some embodiments, perspective data (such as the angle of the mobile device when the image was captured) may also be appended to allow more precise processing of the request. According to some embodiments, an image processing module or software component may be used to process the captured image (for example, to identify layers, perspective, etc., for the mobile device 102 and/or the content engine
140 or other systems or equipment for further processing).
[0038] Processing continues in 406, and in 406, the data is sent to the content engine 140 for further processing. For example, the network described above in Figure 1 can be used to send data. The request can uniquely identify the mobile device 102 and the user, so that targeted, personalized information and preferences can be used in processing the request. The content engine 140 operates on the request to identify locations and events associated with the image, and identify related data, images, and other information to be returned to the mobile device 102. The processing continues in 408. In 408, the mobile device 102 receives the metadata (or additional information, data, or image) and displays the metadata on the display device of the mobile device 102. In some embodiments, once the image or initial request is sent, a dialog is established, in which the step of receiving and displaying metadata continues until the application terminates or a new image or request is received. In this way, embodiments allow users of mobile devices to receive accurate and relevant information related to events, locations, or activities in the field.
[0039] Additional details of some embodiments of a mobile device that can be used in conjunction with embodiments of the present invention will now be described with reference to FIG. 5. In FIG. 5, details of a mobile device 500 according to some embodiments are shown. As depicted, the mobile device 500 includes multiple components that can be controlled or perform functions in conjunction with one or more application programs 510-512 to perform features of some embodiments.
[0040] The mobile device 500 may include a memory interface 502, one or more data processors, image processors and/or central processing units 504, and a peripheral interface 506. The memory interface 502, the one or more processors 504, and/or the peripheral interface 506 may be separate components, or may be integrated in one or more integrated circuits. The various components in the mobile device 500 may be coupled through one or more communication buses or signal lines.
[0041] Sensors, devices, and subsystems can be coupled to the peripheral interface 506 to facilitate multiple functions. For example, one or more sensors may be provided to facilitate the collection, use, and interaction of data and information and to implement the functions of the application described herein, the one or more sensors including biometric sensors 514 and 528 , An accelerometer 516, an optoelectronic device 516, a proximity sensor 520, a camera 522, a wireless communication unit 524, and an audio unit 526.
[0042] The mobile device 500 may include one or more input/output (I/O) devices and/or sensor devices. For example, the input controller 534 may be provided with a speaker and a microphone (not shown) to facilitate voice-enabled functions, such as telephone and voice mail functions. In some embodiments, a speaker may be included to facilitate hands-free voice functions, such as speaker phone functions. An audio jack can also be included for use of headphones and/or microphones.
[0043] The I/O subsystem 530 may include a touch screen controller 532 and/or other one or more input controllers 534. The touch screen controller 532 may be coupled to the touch screen 536. The touch screen 536 and the touch screen controller 532 may, for example, use any of a number of touch sensing technologies and other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 536 to detect the touch screen 536 and The touch screen controller 532 touches and moves or pauses. The touch sensing technology includes but is not limited to: capacitive technology, resistive technology, infrared technology, and surface acoustic wave technology.
[0044] Other one or more input controllers 534 may be coupled to other input/control devices 538, such as one or more buttons, rocker switches, thumb wheels, infrared ports, USB ports, and/or such as The pointing device of the stylus. One or more buttons (not shown) may include up/down buttons for volume control of the speaker and/or microphone. In some implementations, a proximity sensor 520 may be included to help detect that the user places the mobile device 500 adjacent to the user's ears, and disengage the touch screen display 536 accordingly to avoid unexpected function calls. In some implementations, when the mobile device 500 is close to the users ear, the touch screen display 536 can be turned off to save
Additional power.
[0045] Other sensors can also be used. For example, in some implementations, an optoelectronic device 518 may be provided to help adjust the brightness of the touch screen display 538. In some implementations, the accelerometer 516 can be used to detect the movement of the mobile device 500. In some embodiments, the mobile device 500 may include circuits and sensors for supporting a location determining capability (location determining capability), such as a global positioning system (GPS) or other positioning system (for example, using Wi-Fi). Fi access points, TV signals, cellular grids, uniform resource locator (URL) systems) provide location determination capabilities. In some implementations, a positioning system (eg, GPS receiver) may be integrated in the mobile device 500 or configured as a separate device that can be coupled to the mobile device 500 through the peripheral interface 506 to provide access to location-based services. Data from one or more locations or positioning systems can be sent to a remote entity, such as the content engine 140 (of FIG. 1), for analysis and used to compare information associated with the location and events or activities associated with the location. Relevant information for identification. For example, data from one or more locations or positioning systems can be sent along with image data, time stamp data, or user requests to obtain the location of the mobile device. Information related to the event at the location and perform image processing or analysis of the image associated with the location.
[0046] Location services and location-based services can be used, for example, to tag data sent from the mobile device 500 to the content engine 140. For example, such location data may be attached to a message sent to the content engine 140 that is associated with a request for additional information about images, events, locations, or activities (such as the request submitted above at 406 in FIG. 4). data). In this way, location-based data can be used to enhance users' viewing or enjoyment of live events or activities (such as watching sports games).
[0047] The mobile device 500 may also include a camera lens and a sensor 520. In some implementations, the camera lens and sensor 520 may be positioned on the back of the mobile device 500. The camera can capture still images and/or video. The camera can be used, for example, to capture images of items, areas, people, locations, etc. associated with events or locations. The image captured by the camera lens and sensor 520 may be appended with geographic location data (eg from a positioning system) and time and date information to allow the mobile application and content engine 140 to identify data and information associated with the image.
[0048] The mobile device 500 may also include one or more wireless communication subsystems 524, such as an 802.11b/g communication device and/or a Bluetooth@ communication device. It can also support other communication protocols, including other 802. X communication protocols (such as WiMax, Wi-Fi), Code Division Multiple Access (CDMA), and Global Mobile Communications System (GSM), Enhanced Data GSM Evolution Technology (EDGE), 3G (such as EV-DO (Evolution Data Only), Universal Mobile Telecommunications System (UMTS), High Speed Downlink Packet Access (HSDPA)), etc.
[0049] In some implementations, additional sensors or subsystems may be coupled to the peripheral interface 506 via a connector, such as a universal serial bus (USB) port or docking port, or other wired port connection.
[0050] The memory interface 502 may be coupled to the memory 508. The memory 508 may include high-speed random access memory and/or non-volatile memory, such as one or more magnetic disk storage devices, one or more optical storage devices, and/or flash memory (e.g., NAND, NOR). The memory 508 may store an operating system, such as Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks. The operating system may include instructions for processing basic system services and instructions for performing hardware-based tasks. In some implementations, the operating system may be a kernel (for example, a UNIX kernel).
[0051] The memory 508 may also store application programs 510-512. The application programs 510-512 function in conjunction with the processor 504 to enable the mobile device to operate to perform specific functions, including the mobile events and diagrams described herein.
Like processing related functions. The memory 508 may also store data, which includes but is not limited to: documents, images, video files, audio files, and other data. In some implementations, the memory 508 stores address book data, which may include contact information (such as addresses, phone numbers, etc.) for one or more individuals, organizations, services, or entities.
[0052] Once the application is started, the user can interact with the application, and the mobile device can function in accordance with the program instructions associated with the application. For example, once the mobile application is started, the user can perform the processing of FIG. 4 described above.
[0053] Therefore, embodiments of the present invention allow mobile device users to obtain additional information and data related to the event, activity, or location by simply and quickly capturing images associated with the event, activity, or location. The image can then be appended with additional information, such as graphics, statistics, or other data that help improve the user's experience of the event, activity, or location. Although the present invention has been described in conjunction with specific exemplary embodiments, it should be understood that the disclosed embodiments can be modified to those skilled in the art without departing from the spirit and scope of the present invention as set forth in the appended claims. The language is obvious changes, substitutions and substitutions.
4 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4
Every citation, both ways
| Document | Relation | Office | Category | Cited during | Relevant claims |
|---|---|---|---|---|---|
| US11627141B2 | Cited by | United States of America | – | Applicant | – |
| US11297399B1 | Cited by | United States of America | – | Applicant | – |
| US12393977B2 | Cited by | United States of America | – | Applicant | – |
| US11166121B2 | Cited by | United States of America | – | Applicant | – |
| US11558678B2 | Cited by | United States of America | – | Applicant | – |
| CN105009163A | Cited by | China | – | Search report | – |
| US10997758B1 | Cited by | United States of America | – | Applicant | – |
| US12387403B2 | Cited by | United States of America | – | Applicant | – |
| US11972014B2 | Cited by | United States of America | – | Applicant | – |
| US11803345B2 | Cited by | United States of America | – | Applicant | – |
| US11349796B2 | Cited by | United States of America | – | Applicant | – |
| US12113764B2 | Cited by | United States of America | – | Applicant | – |
| US10811053B2 | Cited by | United States of America | – | Applicant | – |
| US11830117B2 | Cited by | United States of America | – | Applicant | – |
| US11468615B2 | Cited by | United States of America | – | Applicant | – |
| US11783862B2 | Cited by | United States of America | – | Applicant | – |
| US11902287B2 | Cited by | United States of America | – | Applicant | – |
| US11317240B2 | Cited by | United States of America | – | Applicant | – |
| US12155617B1 | Cited by | United States of America | – | Applicant | – |
| US12155618B2 | Cited by | United States of America | – | Applicant | – |
| US12231437B2 | Cited by | United States of America | – | Applicant | – |
| CN107710772A | Cited by | China | – | Search report | – |
| US11741136B2 | Cited by | United States of America | – | Applicant | – |
| US10779113B2 | Cited by | United States of America | – | Applicant | – |
| US12236148B2 | Cited by | United States of America | – | Applicant | – |
| US11588825B2 | Cited by | United States of America | – | Applicant | – |
| US11496544B2 | Cited by | United States of America | – | Applicant | – |
| US11250887B2 | Cited by | United States of America | – | Applicant | – |
| CN106663276A | Cited by | China | – | Search report | – |
| US2007162942A1 | Cites | United States of America | YX | Search report | 1-18 |
| US2009049004A1 | Cites | United States of America | YX | Search report | 1-18 |
| US2009316951A1 | Cites | United States of America | X | Search report | – |
7 members in 4 offices
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 12911222 | United States of America | – | |
| 91122210 | United States of America | A | |
| 12911222 | – | – | – |
| US20100911222 | – | – | – |
Members7
| Document | Office | Kind | |
|---|---|---|---|
| EP2444910A1 | European Patent Office (EPO) | A1 | |
| US2012099800A1 | United States of America | A1 | |
| JP2012104106A | Japan | A | |
| CN102572575AThis record | China | A | |
| US8660369B2 | United States of America | B2 | |
| JP6015888B2 | Japan | B2 | |
| CN102572575B | China | B |
3 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Patent grantGrantedGR01 | GR01 | |
| Entry into substantive examinationC10 | C10 | |
| PublicationC06 | C06 |
Numbers
- Publication
- 102572575
- Publication, DOCDB
- 102572575
- Publication, EPODOC
- CN102572575
- Application
- 103289946
- Application, DOCDB
- 201110328994
- Application, EPODOC
- CN20111328994
Titles2
- Chinese
- 使用移动设备的用于增强真实性的系统及方法
- English
- System and method for enhancing authenticity using mobile equipment
Classification
- CPC, 2
- G06F16/58
- G06F16/9537
- IPC, 3
- H04N21 431
- H04N21 436
- H04W88 02