Combat action selection using situational awareness

wtifl Mvattsa (wnn) >n»ribn nma

Combat action selection using situational awareness

Microsoft Corporation C. 196686 WO 2009/002706 PCT/US2008/066532

COMBAT ACTION SELECTION USING SITUATIONAL AWARENESS

BACKGROUND

[0001] In several video games, a player is represented as a character and traverses through a virtual environment Within the virtual environment, the player can encounter several different situations. In a combat situation, the player engages one or more opponents with the objective of damaging and/or destroying the opponents. The player can damage and/or destroy opponents through various combat actions. Control of these combat actions can result in a narrow and boring action, which can detract from the gaming experience for the user. For example, these actions may be a simple punch or kick to the opponent. In current video games, to perform more complicated actions, the user provides several inputs from a game controller to perform actions that are more exciting. However, the several inputs can be difficult to learn and can be unintuitive such that the more complicated actions are underutilized by players within the video games.

[0002] The discussion above is merely provided for general background information and is not intended to be used as an aid in determining the scope of the claimed subject matter.

SUMMARY

[0003] A game environment is disclosed where actions are automatically selected based on a situational awareness for a player in the game environment. The situational awareness can be determined based on conditions of the player, objects and other characters in the game environment.

[0004] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. The claimed subject matter is not limited to implementations that solve any or all disadvantages noted in the background. BRIEF DESCRIPTION OF THE DRAWINGS [0005] FIG. 1 is an isometric view of an exemplary view gaming and media system.

[0006] FIG. 2 is an exemplary functional block diagram of components of the gaming and media system shown in FIG. 1. 1 WO 2009/002706 PCT/US2008/066532 [00071 FIG· 3 is a block diagram of components for selecting actions in a game environment.

[0008] FIG. 4 is a flow diagram of a method for selecting an action.

[0009] FIGS. 5-9 are illustrations of exemplary game environments.

DETAILED DESCRIPTION

[0010] FIG. 1 shows an exemplary gaming and media system 100. The following discussion of FIG. 1 is intended to provide a brief, general description of a suitable environment in which concepts presented herein may be implemented. As shown in FIG. 1, gaming and media system 100 includes a game and media console (hereinafter “console”) 102. In general, console 102 is one type of computing system, as will be further described below. Console 102 is configured to accommodate one or more wireless controllers, as represented by controllers 104(1) and 104(2). Console 102 is equipped with an internal hard disk drive (not shown) and a portable media drive 106 that supports various forms of portable storage media, as represented by optical storage disc 108. Examples of suitable portable storage media include DVD, CD-ROM, game discs, and so forth. Console 102 also includes two memory unit card receptacles 125(1) and 125(2), for receiving removable flash-type memory units 140. A command button 135 on console 102 enables and disables wireless peripheral support.

[0011] As depicted in FIG. 1, console 102 also includes an optical port 130 for communicating wirelessly with one or more devices and two USB (Universal Serial Bus) ports 110(1) and 110(2) to support a wired connection for additional controllers, or other peripherals. In some implementations, the number and arrangement of additional ports may be modified. A power button 112 and an eject button 114 are also positioned on the front face of game console 102. Power button 112 is selected to apply power to the game console, and can also provide access to other features and controls, and eject button 114 alternately opens and closes the tray of a portable media drive 106 to enable insertion and extraction of a storage disc 108.

[0012] Console 102 connects to a television or other display 150 via A/V interfacing cables 120. In one implementation, console 102 is equipped with a dedicated A/V port (not shown) configured for content-secured digital communication using A/V cables 120 (e.g., A/V cables suitable for coupling to a High Definition Multimedia Interface “HDMI” port on a high definition monitor or other display device). A power cable 122 provides power to the game console. Console 102 may be further configured with broadband capabilities, as 2 WO 2009/002706 PCT/US2008/066532 represented by a cable or modem connector 124 to facilitate access to a network, such as the Internet. The broadband capabilities can also be provided wirelessly, through a broadband network such as a wireless fidelity (Wi-Fi) network.

[0013] Each controller 104 is coupled to console 102 via a wired or wireless interface. In the illustrated implementation, the controllers are USB-compatible and are coupled to console 102 via a wireless or USB port 110. Console 102 may be equipped with any of a wide variety of user interaction mechanisms. In an example illustrated in FIG. 1, each controller 104 is equipped with two thumbsticks 132(1) and 132(2), a D-pad 134, buttons 136, and two triggers 138. These controllers are merely representative, and other known gaming controllers may be substituted for, or added to, those shown in FIG. 1.

[0014] In one implementation (not shown), a memory unit (MU) 140 may also be inserted into console 100 to provide additional and portable storage. Portable MUs enable users to store game parameters for use when playing on other consoles. In this implementation, each controller is configured to accommodate two MUs 140, although more or less than two MUs may also be employed.

[0015] Gaming and media system 100 is generally configured for playing games stored on a memory medium, as well as for downloading and playing games, and reproducing prerecorded music and videos, from both electronic and hard media sources. With the different storage offerings, titles can be played from the hard disk drive, from optical disk media (e.g., 108), from an online source, or from MU 140. A sample of the types of media that gaming and media system 100 is capable of playing include: [0016] Game titles played from CD and DVD discs, from the hard disk drive, or from an online source.

[0017] Digital music played from a CD in portable media drive 106, from a file on the hard disk drive (e.g., music in the Windows Media Audio (WMA) format), or from online streaming sources.

[0018] Digital audio/video played from a DVD disc in portable media drive 106, from a file on the hard disk drive (e.g., Active Streaming Format), or from online streaming sources.

[0019] During operation, console 102 is configured to receive input from controllers 104 and display information on display 150. For example, console 102 can display a user interface on display 150 to allow a user to operate and interact with an interactive game title. 3 WO 2009/002706 PCT/US2008/066532 [0020] FIG. 2 is a functional block diagram of gaming and media system 100 and shows functional components of gaming and media system 100 in more detail. Console 102 has a central processing unit (CPU) 200, and a memory controller 202 that facilitates processor access to various types of memory, including a flash Read Only Memory (ROM) 204, a Random Access Memory (RAM) 206, a hard disk drive 208, and portable media drive 106. In one implementation, CPU 200 includes a level 1 cache 210, and a level 2 cache 212 to temporarily store data and hence reduce the number of memory access cycles made to the hard drive 208, thereby improving processing speed and throughput.

[0021] CPU 200, memory controller 202, and various memory devices are interconnected via one or more buses (not shown). The details of the bus that is used in this implementation are not particularly relevant to understanding the subject matter of interest being discussed herein. However, it will be understood that such a bus might include one or more of serial and parallel buses, a memory bus, a peripheral bus, and a processor or local bus, using any of a variety of bus architectures. By way of example, such architectures can include an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnects (PCI) bus also known as a Mezzanine bus.

[0022] In one implementation, CPU 200, memory controller 202, ROM 204, and RAM 206 are integrated onto a common module 214. In this implementation, ROM 204 is configured as a flash ROM that is connected to memory controller 202 via a Peripheral Component Interconnect (PCI) bus and a ROM bus (neither of which are shown). RAM 206 is configured as multiple Double Data Rate Synchronous Dynamic RAM (DDR SDRAM) modules that are independently controlled by memory controller 202 via separate buses (not shown). Hard disk drive 208 and portable media drive 106 are shown connected to the memory controller via the PCI bus and an AT Attachment (ATA) bus 216. However, in other implementations, dedicated data bus structures of different types can also be applied in the alternative.

[0023] A three-dimensional graphics processing unit (GPU) 220 and a video encoder 222 form a video processing pipeline for high speed and high resolution (e.g., High Definition) graphics processing. Data are carried from graphics processing unit 220 to video encoder 222 via a digital video bus (not shown). An audio processing unit 224 and an audio codec (coder/decoder) 226 form a corresponding audio processing pipeline for multi 4 WO 2009/002706 PCT/US2008/066532 channel audio processing of various digital audio formats. Audio data are carried between audio processing unit 224 and audio codec 226 via a communication link (not shown). The video and audio processing pipelines output data to an A/V (audio/video) port 228 for transmission to a television or other display. In the illustrated implementation, video and audio processing components 220-228 are mounted on module 214.

[0024] FIG. 2 shows module 214 including a USB host controller 230 and a network interface 232. USB host controller 230 is shown in communication with CPU 200 and memory controller 202 via a bus (e.g., PCI bus) and serves as host for peripheral controllers 104(1)-104(4). Network interface 232 provides access to a network (e.g., Internet, home network, etc.) and may be any of a wide variety of various wire or wireless interface components including an Ethernet card, a modem, a wireless access card, a Bluetooth module, a cable modem, and the like.

[00251 In the implementation depicted in FIG. 2, console 102 includes a controller support subassembly 240 for supporting four controllers 104(1)-104(4). The controller support subassembly 240 includes any hardware and software components needed to support wired and wireless operation with an external control device, such as for example, a media and game controller. A front panel I/O subassembly 242 supports the multiple functionalities of power button 112, the eject button 114, as well as any LEDs (light emitting diodes) or other indicators exposed on the outer surface of console 102. Subassemblies 240 and 242 are in communication with module 214 via one or more cable assemblies 244. In other implementations, console 102 can include additional controller subassemblies. The illustrated implementation also shows an optical I/O interface 235 that is configured to send and receive signals that can be communicated to module 214.

[0026] MUs 140(1) and 140(2) are illustrated as being connectable to MU ports “A” 130(1) and “B” 130(2) respectively. Additional MUs (e.g., MUs 140(3)-140(6)) are illustrated as being connectable to controllers 104(1) and 104(3), i.e., two MUs for each controller. Controllers 104(2) and 104(4) can also be configured to receive MUs (not shown). Each MU 140 offers additional storage on which games, game parameters, and other data may be stored. In some implementations, the other data can include any of a digital game component, an executable gaming application, an instruction set for expanding a gaming application, and a media file. When inserted into console 102 or a controller, MU 140 can be accessed by memory controller 202. 5

<img img-format="tif" img-content="drawing" file="IL201667AD00021.tif" id="idf0001" />

WO 2009/002706 PCT/US2008/066532 [0027] A system power supply module 250 provides power to the components of gaming system J 00. A fan 252 cools the circuitry within console 102. An application 260 comprising machine instructions is stored on hard disk drive 208. When console 102 is powered on, various portions of application 260 are loaded into RAM 206, and/or caches 210 and 212, for execution on CPU 200, wherein application 260 is one such example. Various applications can be stored on hard disk drive 208 for execution on CPU 200.

[0028] Gaming and media system 100 may be operated as a standalone system by simply connecting the system to display 150 (FIG. 1), a television, a video projector, or other display device. In this standalone mode, gaming and media system 100 enables one or more players to play games, or enjoy digital media, e.g., by watching movies, or listening to music. However, with the integration of broadband connectivity made available through network interface 232, gaming and media system 100 may further be operated as a participant in a larger network gaming community.

[0029] FIG. 3 is a block diagram of a game environment 300 that can be executed on a gaming system such as gaming system 100. Within game environment 300, a user operates a player character throughout a virtual world. The game environment 300 can display the player character as well as other characters (e.g., opponents, friends) and objects (e.g., moveable, stationary). The game environment 300 interacts with an environment monitoring module 302 and an action selection module 304 to select actions within the game environment 300 based on input 306 from a user.

[0030] The input 306 from the user can involve any particular operation of a game controller (e.g. controller 104) such as a simple “combat” button (e.g. one of buttons 136) being depressed and be accompanied by a directional movement of a joystick that is provided to game environment 300. The operation of the game controller can also involve triggers, joysticks, tilt sensing, position sensing, etc. as desired. Using the operation of the game controller, which in this case is a single combat button, a specified action can be selected to be performed within the game environment 300 based on a situational awareness of a player. The directional movement can also be utilized to determine a particular opponent to attack or a particular object to utilize when performing an attack. When input 306 is received, environment monitoring module 302 accesses object conditions 308 and character conditions 310 to determine a situational awareness for the player character. The situational awareness can be a status that changes as the player moves 6

<img img-format="tif" img-content="drawing" file="IL201667AD00022.tif" id="idf0002" />

WO 2009/002706 PCT/US2008/066532 about the game environment 300. Given the current situational awareness status, an action can be selected that is entertaining to a user and independent of further inputs. Thus, the user does not need to provide complicated inputs to render an entertaining action. Each time the combat button is depressed, the situational awareness of the player is determined to select an action based on the determined situational awareness status.

[0031] Object conditions 308 relate to a position and state of objects within an environment. For example, the objects can include weapons, furniture, walls, cliffs, vehicles, and/or any other objects both movable and stationary within a game playing environment. If a player is holding a weapon, then the weapon can be used by the player for combat. The weapon also may be associated with a particular attack range. Additionally, if a piece of furniture is close to the player, the piece can be used in an action by the player to engage an opponent. Objects can also be thrown and/or kicked at opponents. Character conditions 310 refer to both the player character as well as other characters in the environment such as opponents and friends. The character conditions 310 also refer to a state for each of the characters within the game environment 300. For example, certain combat actions may only be available if an opponent is lying on the ground and/or stunned. Additionally, a player character may throw a right-handed punch or a left-handed punch depending on a stance for the player character. Environment monitoring module 302 passes the object conditions 308 and character conditions 310 to action selection module 304.

[0032J Action selection module 304 accesses a number of different actions 312, prerequisites 314 for each of the actions and a priority ranking 316 for each of the actions. Actions 312 can be a number of resulting actions for execution within game environment 300, including but not limited to, striking opponents, grappling opponents, parrying and counter attacking an opponent’s attack, blocking, striking or grappling an opponent into or off of objects, throwing or kicking objects towards opponents, using objects as leverage for more elaborate or dramatic moves, punching, kicking, using a weapon, etc. The actions may also have variations, such as a left-handed and right-handed punch, jump kick and round house kick, etc.

[0033] Each of the actions 312 includes one or more prerequisites for its performance, which are noted in prerequisites 314. Action selection module 304 determines if actions 312 are valid based on the object conditions 308 and character conditions 310. If the object conditions 308 and character conditions 310 match prerequisites for one or more actions, 7

<img img-format="tif" img-content="drawing" file="IL201667AD00023.tif" id="idf0003" />

WO 2009/002706 PCT/US2008/066532 these actions are noted as valid actions. The prerequisites correspond to object conditions and character conditions that are determined by environment monitoring module 302. For example, if an opponent is within close range (a character condition), a punch may be executed by the player upon receipt of an operation of a game controller. If the opponent is further away and out of close range, the opponent may only be within kicking range and thus a kicking action can be used upon receipt of the operation since the punching action prerequisite (where an opponent is in close range) is not met. Furthermore, if an opponent is within close range of an object, the player may use the object as a weapon for attacking the opponent. The prerequisites can also be utilized to produce combination attacks, wherein the input operation is provided in immediate intervals. Such combination attacks could involve a block followed by a punch, a punch followed by the player thrusting his knee into the opponent, a block followed by the player throwing the opponent into the wall and/or a punch/kick combination.

[0034] Priority ranking 316 can assign a priority to each of the actions 312 in a number of different ways. For example, the priority ranking 316 can be preset by a game developer of a gaming title or selected by a user. The priority ranking can include any number of unique values, such as 2 (i.e. low and high), 3 (i.e. low, medium and high) 5, 10 or any other number as desired. Valid actions, as determined by action selection module 304 given the situational awareness status, have their priority rank analyzed for selection in game environment 300. In one embodiment, more elaborate and dramatic actions receive a higher priority and will be selected over other actions which are not as dramatic. For example, if both a simple punch action and a furniture throwing action have met prerequisites based on the object conditions 308 and character conditions 310, the furniture throwing action can be selected if provided with a higher priority ranking than the punch action. In addition, the priority ranking for actions can be selected randomly or successively changed each time an action is used to provide a variety for selected actions. For example, the player could successively throw a left-handed punch followed by a right-handed punch. Based on the actions 312, prerequisites 314 and priority ranking 316, action selection module 304 outputs a selected action 318 to be performed within game environment 300.

[0035J FIG. 4 is a flow diagram of a method 400 for executing actions within a game environment. This method can be repeated several times as desired to select and execute an action (e.g. first action, second action, third action) given a player’s situational awareness when a user provides an operation of a game controller such as depressing a combat button. 8 WO 2009/002706 PCT/US2008/066532

The same operation can produce a different action based on the player’s situational awareness. Method 400 begins at step 402, wherein player input indicative of the operation (i.e. the combat button) is received. Again, the combat button can be a single button so as to not require complicated inputs from a user. The combat button can also be accompanied by directional movement and/or other buttons. In one embodiment, selection of actions can be independent of any other input provided by the user. In yet a further embodiment, directional movement accompanying the combat button can be used as a guide for determining a particular opponent for which to attack.

[0036] At step 404, the player character conditions are accessed including a position and state for the player character. For example, the conditions can relate to where the player is in relation to other objects and characters, whether the player is holding a particular weapon, which direction the player is facing, etc. Next, at step 406, opponent character conditions are accessed including position and state of opponents. For example, an opponent can be within a particular zone, lying on the ground, stunned, attacking the player, etc. At step 408, object conditions including position and state for objects within a gaming environment are accessed. For example, these conditions can include the relation of objects to other character and/or objects, whether the object is stationary or moveable, a size of the object, an attack range if the object is a weapon, etc. Steps 404, 406 and 408 provide a situational awareness status for the player such that a suitable action can be selected.

[0037] Valid actions are then determined at 410 based on whether the determined conditions meet prerequisites of the actions. Valid actions can be placed in a list that is determined based on whether player conditions, opponent conditions and object conditions meet prerequisites for the actions. For example, if a particular object is not within range for an action, then a prerequisite for that action is not met. In step 412, a final action for execution in the game is selected based on a priority rank. For example, an opponent may be within a range where the player can punch the opponent or grab an opponent and throw the opponent off of an object. If the priority ranking for throwing the opponent off of the object is higher, that action is selected over the punch action. Method 400 can then be repeated for subsequent actions within the game environment based on the same operation provided by the user.

[0038] FIGS. 5-9 provide example environments for performing combat actions. By way of example only, the actions for performance in these environments include six actions, 9 WO 2009/002706 PCT/1JS2008/066532 noted as punch, kick, use weapon to attack, smash opponent’s face into object, throw opponent into object and kick opponent into object. More or less actions can be provided as desired, for example throwing an object, a counter attack, etc. Each of these actions can be performed by an operation of a game controller, such as pressing a single button, the same button being used for each action depending on a situational awareness for the player. Upon execution of the operation, the situational awareness is determined based on object and character conditions in the environment.

[0039] A table is provided below for the exemplary actions, their respective prerequisites and priority ranking. It will be appreciated that more or less actions, conditions and priority rankings can be utilized within environment 300. Within FIGS. 5-9, environment monitoring module 302 can be used to determine conditions and actions selection module 304 can use the table to select an action based on the conditions and a priority. FIGS. 5-9 also include zones of a player, which can be adjusted based on characteristics of players, opponents, other characters and/or objects. For example, if a player is holding a weapon, an attack zone for the player using the weapon can be larger than an attack zone for the player when not holding the weapon.

Action No. Action Prerequisites (i.e. conditions) Priority 1 Punch Opponent in first zone of a player Low 2 Kick Opponent in second zone of a player Low 3 Use Weapon Player holding weapon and opponent in second zone of a player High 4 Smash opponent’s face into object Opponent in first zone, object in first zone of a player and height of object is small High 5 Throw opponent into object Opponent in first zone, object in first zone of a player and height of object is large High 6 Kick opponent into object Opponent in second zone of a player and object in first or second zone High

Table 1. A list of actions, prerequisites and priority ranking. 10 WO 2009/002706 PCT/US2008/066532 [0040] FIG. 5 is a diagram of an environment 500 wherein a player 502 is engaging an opponent 504. Environment 500 includes a first zone 506 and a second zone 508 of the player 502. In this environment, a selected action is based on an attack range (i.e. a particular zone), which is measured by the player character 502 and its distance to the opponent 504. In environment 500, opponent 504 is within the first zone 506. In this case, the player is close enough to opponent 504 to perform the punch action (action 1) when a combat button is depressed. As a result, a punch is selected and performed within the environment. The other actions (2-6) are not selected since their prerequisites are not met. Actions 4 and 5 have one prerequisite that is met (that the opponent is in the first zone), but the other prerequisites are not met and thus do not form valid actions.

[0041] In FIG. 6, environment 600 is shown where a player 602 is further away from an opponent 604 than in environment 500. Environment 600 includes a first zone 606 and a second zone 608 of the player 602. In this situation, opponent 604 is within the second zone 608. When further away, opponent 602, upon pressing a combat button, will kick the opponent 604 rather than the punch that is performed in environment 500 since a prerequisite for the punch action (being within first zone 606) is not met. With reference to Table 1, actions 2, 3 and 6 all require that the opponent be within the second zone. However, since actions 3 and 6 have other prerequisites not met, action 2 is selected.

[0042] FIG. 7 is an environment 700 that illustrates the player 702 and an opponent 704. Environment 700 also includes a first zone 706 and a second zone 708 of the player 702. In this situation, player 702 is holding a weapon 710, which is an object condition. Both action 2 (kick) and action 3 (use weapon) have their prerequisites met and form a valid action list based on the object conditions and character conditions. However, action 3 has a high priority ranking, so that action is selected to be executed over the kick action, which has a low priority ranking. It is also worth noting that second zone 708 is larger than second zone 608 of FIG. 6 due to a range for weapon 710 that is larger than a kicking range.

[0043] FIG. 8 illustrates an environment 800, where a player 802 is engaging an opponent 804. A first zone 806 and a second zone 808 are also provided within environment 800. In addition, an object 810 is also provided within first zone 806 of the player 802. The object conditions include 1) an object is in the first zone; and 2) the height of the object is small. The character conditions include an opponent in the first zone. Upon pressing the command button, rather than having player 802 merely punch opponent 804, the player 802 can use object 810 to provide a more dramatic move. Both action 1 and 4 have their prerequisites 11

<img img-format="tif" img-content="drawing" file="IL201667AD00024.tif" id="idf0004" />

WO 2009/002706 PCT/US2008/066532 met. Action 4 is selected since its priority rank is high where the action 1 priority rank is low. Thus, upon the operation of the game controller by the user, player 802 will smash the opponent’s face into object 810.

[0044] FIG. 9 is environment 900 including a player 902 and an opponent 904. Environment 900 includes a first zone 906 and a second zone 908 of the player 902. In addition, an object 910 is provided within first zone 906. Object 910 has a large height. Referring to Table 1, both actions 1 and 5 have their prerequisites met. However, action 5 has a higher priority rank and is selected for action. Thus, the player 902 can throw opponent 904 into object 910 upon actuation of a combat button from a user.

[0045] Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. 12 □’Ewan -n^a , crnxan rwzn ατα iniab^a ρηοαι^ p&gt;ns?n irn nr -jaoa ,pna ηχΏ- naoana ma™ na^maa np’-ioa .zrtwan rwaa mp^an bmfr oxnm ......Gtoca uer □ιηπη by »*···»· · sw J«w\ _ _

♦ ,.~... Q2 Ua/2)12 012507 «KB1D .(mcna navin) cras&amp;amp;’an rwa

<img img-format="tif" img-content="drawing" file="IL201667AD00025.tif" id="idf0005" />